Data Engineer
Discovered MENA · Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates
قدّم وتابع مع أبلاي إيدجData Engineer – Abu DhabiDiscover the OpportunityWe’re partnering with a leading financial services organisation in Abu Dhabi that is continuing to invest heavily in its Data & AI capabilities.They’re looking for an experienced Data Engineer to build the scalable data infrastructure and pipelines that underpin advanced AI and machine learning solutions across the business.This is a hands-on engineering role where you’ll work closely with AI, ML and software engineering teams, ensuring they have access to reliable, high-quality data at scale.Discover the ResponsibilitiesDesign, build and optimise scalable ETL/ELT pipelines to ingest, process and transform structured and unstructured dataDevelop reliable data infrastructure capable of supporting large-scale AI, machine learning and analytics workloadsContinuously test, monitor and optimise data pipelines to improve performance, reliability and data integrityWork closely with AI/ML and software engineering teams to make high-quality data easily accessible for downstream applicationsImplement strong data quality, validation, governance and security practices across the data lifecycleMaintain clear documentation around data architecture, lineage and metadataDiscover the Requirements5+ years of experience in Data Engineering, ETL development, data warehousing or similar positionsStrong hands-on experience designing and managing ETL/ELT workflows using technologies such as Airflow, dbt, Luigi or similarExcellent Python and SQL skills, alongside experience with Scala, Java or another relevant programming languageExperience working with big data architectures and optimising large-scale data pipelinesHands-on experience with cloud data environments across Azure, AWS or GCPExperience processing and managing large-scale structured and unstructured datasetsStrong understanding of data quality, governance, monitoring and engineering best practicesExcellent problem-solving skills with the ability to diagnose performance and data issuesBachelor’s degree in Computer Science, Engineering or a related technical disciplineWhy Join?Work on large-scale Data & AI initiatives within a highly ambitious technology environmentBuild the data foundations behind production AI and machine learning solutionsWork alongside experienced Data, AI, ML and Software EngineersTake ownership of technically challenging data engineering problems with genuine business impact