Lead Data Engineer
Xome · Chennai, Tamil Nadu, India
Tailor my CV for this job — free- 8 to 10 years of experience in data engineering with a strong track record of delivering production-grade data solutions
- Strong proficiency in Python (PySpark, Pandas) and SQL for data transformation, pipeline development, and performance tuning
- Proficient with Microsoft Fabric including Lakehouses, Warehouses, Dataflows Gen2, and Data Pipelines
- Strong experience with SQL Server including schema design, stored procedures, indexing, and query optimization
- Experience with MongoDB and MongoDB Atlas for NoSQL data modeling, indexing, aggregation pipelines, and Atlas Search
- Solid experience designing and operating ETL/ELT pipelines in production, including error handling, monitoring, and SLA management
- Familiarity with containerization using Docker and orchestration with Kubernetes for deploying and managing data workloads
- Experience with Power BI including dataset design, DAX, semantic modeling, and enabling self-service reporting
- Strong exposure to AI-enabled development — using AI coding assistants, prompt-driven development, or LLM-integrated tooling to build and accelerate data engineering workflows
- Experience leading or managing a small team of engineers — task allocation, mentoring, and performance support
- Good understanding of data modeling concepts — dimensional modeling, star/snowflake schemas, data vault
- Ability to communicate technical ideas clearly to both technical and non-technical audiences