Senior Data Engineer (Python)

We are looking for an experienced Senior Data Engineer to design, develop, and maintain scalable data solutions that support business-critical analytics and data products. The ideal candidate will have strong expertise in data engineering, cloud technologies, data modelling, workflow orchestration, and real-time data processing, combined with a strong analytical mindset and the ability to lead technical discussions and collaborate effectively across teams.

Job Responsibilities

Design, develop, and maintain robust, scalable data pipelines that extract, load, and transform data from a variety of sources into data warehouses and analytical platforms.Design and implement OLTP and OLAP data models that align with business requirements and enable efficient, reliable querying and analysis.Lead the design and development of ETL/ELT processes, data infrastructure, and data engineering solutions.Design, build, and optimise workflow orchestration using Apache Airflow and dbt, including task dependencies, transformations, monitoring, and automation.Develop and support real-time and streaming data pipelines using technologies such as Kafka, Google Pub/Sub, PySpark, and Dataflow.Ensure orchestration pipelines and data products are reliable, scalable, performant, and resilient, taking into consideration data volume, velocity, and variety.Work collaboratively across data engineering teams, vendors, and internal stakeholders to continuously improve data products, processes, and platforms.Take ownership and accountability for assigned initiatives, from solution design and development through to end-to-end testing and implementation.Conduct comprehensive technical feasibility assessments, evaluating architectural and data modelling options, including their trade-offs, benefits, limitations, scalability, and operational impact.Contribute to the development and adoption of data engineering best practices across coding standards, DevOps, documentation, metadata management, testing, and deployment.Ensure a high standard of engineering quality while delivering solutions within agreed project timelines.Document current-state and future-state solution architectures, data models, and technical designs to strengthen knowledge sharing and support the team's collective capability.Support cloud migration initiatives, identifying appropriate migration strategies, risks, dependencies, and potential implementation pitfalls.Leverage AI tools and techniques effectively to improve engineering productivity, accelerate problem-solving, and focus effort on higher-impact architectural and technical challenges.

Required Skills

5+ years of experience in data engineering, with experience operating at a senior level and/or leading data engineering initiatives.Strong proficiency in Python and SQL.Solid understanding of OLTP concepts, including normalized relational schema design.Strong understanding of OLAP concepts, dimensional modelling, and analytical data model design.Proven experience designing and building **data pipelines, ETL/ELT