Senior Data Engineer/Architect
Intuition IT Solutions · Chennai, Tamil Nadu, India
Tailor my CV for this job — freeRole: Senior Data Engineer/Architect
Key Responsibilities
Pipeline Engineering: Design and tune scalable Databricks, PySpark, AWS S3, SQL, and Informatica (PowerCenter/IICS) pipelines. Automate workflows using Python and Shell scripting.Data Integration & Modeling: Build Star/Snowflake dimensional models, Data Marts, and EDW/CDW systems from Oracle, SQL Server, MongoDB, and flat file sources.Optimize Spark/Databricks pipelines for performance and scalability.Implement data governance and access control using Unity Catalog.
Required Skills
Tech Stack: Databricks, PySpark, AWS S3, Informatica, SQL, Python, Shell Scripting, Oracle, MS SQL Server, MongoDB.Core Concepts: Dimensional Modeling, ETL/ELT Architecture, Data Marts, EDW/CDW.