Senior Data Engineer
Atain · Abu Dhabi Emirate, United Arab Emirates
Tailor my CV for this job — freeAirline domain.Job Summary:We are looking for an experienced Senior Data Engineer with 7+ years of hands-on experience in designing and building scalable data platforms using Databricks, Apache Spark, and Azure.The ideal candidate should have strong expertise in data engineering, distributed data processing, ETL/ELT pipelines, and Lakehouse architecture, along with relevant Airline/Aviation domain experience.
Key Responsibilities
Design and develop scalable ETL/ELT pipelines using Databricks & Apache SparkBuild high-performance batch and real-time data processing solutionsDevelop and maintain data platforms using: Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse AnalyticsImplement Lakehouse architecture using Delta LakeOptimize data pipelines for performance, scalability, and costImplement data quality, governance, monitoring, and reliability frameworksCollaborate with architects, developers, and business teams to deliver enterprise-scale data solutions
Required Skills
7+ years of Data Engineering experienceStrong hands-on experience with Databricks & Apache SparkStrong expertise in the Azure Data ecosystemProficiency in Python and/or ScalaStrong understanding of distributed computing and data processingExperience in data modeling and pipeline architectureStrong software engineering and system design practicesAirline / Aviation / Travel domain experience is mandatory/preferredAbout Atain:(http://www.atain.com)Atain is an enterprise orchestration partner that aligns people, processes, and platforms with AI to redefine work and deliver assured outcomes. It is enabled through the SMART Frameworkdriving superior metrics with AI-redefined work, the TechBud platform, a GenAI foundation built on zero-pilot architecture and ISO 42001 standards, a robust partner ecosystem, and deep domain expertise. Atain's Unified Hub continuously senses, predicts, and re-orchestrates work across people, processes, and platforms to deliver assured outcomes. The centers of skill and scale combine deep expertise with AI to deliver assured outcomes. For more information, visit www.atain.comAtain is ISO 27001:2013, CMMI SVC Level 5 and ISAE-3402 compliant for IT, and COPC Certified v6.0, ISO 27001:2013 and PCI DSS 3.2 certified for BPO processes. The organization follows Six Sigma rigor for process improvements.It is our policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.