AWS Data Engineer Lead

Position: AWS Data Engineer LeadExperience: 8–10 Years

Location: Chennai, BangaloreKey Skills: AWS Data Engineering, Databricks, PySpark, SQLAbout The RoleWe are seeking an experienced AWS Data Engineer Lead to drive the design and delivery of robust, scalable data engineering solutions on AWS.

You'll lead a team building high-performance data pipelines, lakehouse architectures, and analytics platforms, while championing engineering excellence and cloud-native best practices.Key ResponsibilitiesLead architecture and development of scalable data pipelines using AWS Glue, EMR, Lambda, and Step FunctionsDesign and manage cloud-native data lakes using S3, Lake Formation, and RedshiftDefine engineering standards, review architecture decisions, and drive best practices across the teamBuild real-time and batch data processing solutions using Kinesis / Kafka, Spark, and Glue StreamingPartner with data architects and analytics teams to design efficient data models and pipelinesImplement strong data governance, cataloging, and security controls (IAM, Lake Formation, KMS)Optimize infrastructure for performance, scalability, and cost using AWS best practicesSet up monitoring, alerting, and observability (CloudWatch, CloudTrail)Mentor data engineers, lead code/design reviews, and manage sprint deliverablesEvaluate and adopt new AWS data services to keep the platform modern and efficientRequired SkillsStrong hands-on experience with AWS Glue, EMR, Redshift, S3, Lambda, AthenaProficiency in PySpark, SQL, and Python for large-scale ETL/ELT developmentSolid understanding of data lake / lakehouse design (Delta/Iceberg/Hudi a plus)Experience with data modeling and building scalable data warehousesHands-on experience with CI/CD (CodePipeline/Jenkins) and Infrastructure-as-Code (Terraform/CloudFormation)Strong knowledge of AWS security and governance (IAM, Lake Formation, KMS)Proven experience leading engineering teams in an Agile delivery environmentExcellent problem-solving, communication, and stakeholder management skillsGood To HaveExperience with Kafka/Kinesis for real-time streaming pipelinesExposure to QuickSight or other BI/visualization toolsFamiliarity with Apache Iceberg / Hudi for open table formatsAWS certifications: AWS Certified Data Analytics – Specialty, AWS Certified Solutions ArchitectWhy Join Us?Lead impactful, large-scale data initiatives on a modern AWS stackCollaborative, growth-oriented culture with strong technical mentorshipAttractive compensation, flexible working arrangements, and career advancement opportunitiesSkills: sql,databricks,aws data engineering,pyspark,aws data engineer