Data Engineer

Data Engineer - Abu DhabiWe have a fantastic opportunity, partnered with a global investment firm in Abu Dhabi who are looking for an experienced, hands-on Data Engineer who is capable of designing, building, and operating data pipelines and models that power analytics and applications across Investment teams and Middle/Back office functions.You will have financial markets familiarity (securities, prices, corporate actions, positions/holdings) and thrive in ambiguous environments, proactively shaping solutions, not waiting for tickets. You’ll own data end-to-end: from ingesting vendor and internal sources, to modeling in an interal lakehouse, to making data discoverable, reliable, and cost-efficient.You’ll partner closely with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures that balance speed, governance, and scalability.

Responsibilities

Participate in requirements clarification and sprint planning sessions.Design technical solutions and implement them, inc ETL Pipelines.Build robust data pipelines in PySparkOptimize ETL ProcessesWriting unit and integration tests.Support QA teammates in the acceptance process. Essential Experience/Qualifications:Min 5 Years of experience in IT/Data within a financial services environmentBachelor in IT or related field (mandatory)Required Skills:Exceptional logical reasoning and problem-solving skills.Programming: Proficiency in PySpark for distributed computing and Python for ETL development.SQL: Strong expertise in writing and optimizing complex SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake.Data Warehousing: Experience working with data warehousing concepts and platforms, ideally DataBricks.ETL Tools: Familiarity with ETL tools & processes.Data Modelling: Experience with dimensional modelling, normalization/denormalization, and schema design.Version Control: Proficiency with version control tools like Git to manage codebases and collaborate on development.Data Pipeline Monitoring: Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance.Please note - this role is a permanent position based in Abu Dhabi and remote working is not an option. Relocation packages are on offer for candidates outside of the region.