Senior Data Engineer
RapidBrains · Chennai, Tamil Nadu, India
Tailor my CV for this job — freeJob DescriptionWe are seeking an experienced Senior Data Engineer with 6+ years of experience to lead data ingestion, transformation, and optimization initiatives within Microsoft Fabric Lakehouse environments. The candidate will be responsible for enterprise data integration, ELT pipeline development, high-volume data processing, and implementation of scalable data solutions.Key ResponsibilitiesManage end-to-end development of enterprise data ingestion and transformation pipelines.Implement Microsoft Fabric Lakehouse solutions using Medallion architecture.Configure and optimize Fivetran connectors for Oracle, SQL Server, and other data sources.Develop incremental loading, CDC, and large-scale data backfill processes.Optimize Lakehouse performance, data storage, and processing workflows.Implement pipeline monitoring, data quality checks, and failure tracking.Manage Dev/Test/Prod deployments and production support.Collaborate with cross-functional teams to ensure reliable and scalable data delivery.Required Skills6+ years of experience in Data Engineering.Hands-on experience with Microsoft Fabric or Azure Synapse Analytics / Azure Data Factory.Strong experience with Fivetran or similar ELT tools.Proficiency in SQL and Python.Strong knowledge of Lakehouse and Medallion architecture (Bronze, Silver, Gold).Experience with CDC, incremental loading, and high-volume data processing.Knowledge of Oracle, SQL Server, data modeling, and pipeline optimization.Experience with monitoring, troubleshooting, and deployment processes.