Microsoft Fabric Data Engineer
HMG AMERICA LLC · Chennai, Tamil Nadu, India
Apply & track with Apply EdgeThe candidate will be responsible for designing, developing, and maintaining scalable data pipelines and modern data platforms using Microsoft Fabric.Key ResponsibilitiesDesign and develop scalable data engineering solutions using Microsoft Fabric.Build and maintain data pipelines using Fabric Data Factory / Data Pipelines.Develop and manage Fabric Lakehouse and OneLake solutions.Perform data ingestion, transformation, cleansing, and integration from multiple sources.Develop data processing solutions using Apache Spark, PySpark, and Python.Write optimized SQL queries for data transformation, validation, and analysis.Work with Delta Lake and implement reliable and scalable data storage solutions.Develop ETL/ELT workflows and implement incremental data loading strategies.Integrate data from Azure services, databases, APIs, files, and other enterprise sources.Optimize data pipelines and Spark workloads for performance and cost efficiency.Implement data quality, validation, monitoring, and error-handling mechanisms.Work closely with Data Architects, Analysts, Data Scientists, and business stakeholders.Support data migration and modernization initiatives from legacy/Azure/Databricks platforms to Microsoft Fabric.Implement security, access control, and governance following organizational standards.Troubleshoot production data pipelines and resolve performance or data-quality issues.Mandatory SkillsStrong hands-on experience with Microsoft FabricOneLakeFabric LakehouseFabric Data Factory / Data PipelinesPySparkPythonSQLApache SparkDelta LakeStrong understanding of ETL/ELT conceptsExperience developing and optimizing data pipelinesGood understanding of data modeling and modern data architectureGood to HaveExperience with Azure Data FactoryAzure Data Lake Storage (ADLS)DatabricksAzure Synapse AnalyticsPower BIMicrosoft PurviewGit / Azure DevOpsCI/CDExperience with real-time/streaming dataMicrosoft Fabric or Azure data certifications