Data, Engineer

Master works is seeking a Data Engineer to join our team and play a key role in developing, operating, and maintaining the organization's data pipelines and data platform infrastructure. The role will be responsible for ensuring reliable data processing, platform availability, security, performance, and compliance with pipeline SLAs.Key ResponsibilitiesDesign, develop, and maintain ELT/ETL pipelines to produce clean, structured, and reliable datasetsBuild and maintain data orchestration workflows using Apache AirflowDevelop and test data transformations using SQL, Python, and PySparkMonitor pipeline execution, troubleshoot processing issues, and proactively address SLA risksAdminister and maintain lakehouse, object storage, Apache Spark, and Trino environmentsBuild and maintain CI/CD pipelines using Bitbucket and JenkinsManage user access, roles, permissions, and resource quotas across data platformsMonitor platform performance, respond to incidents, and perform system upgrades and patchingOptimize storage configurations, including partitioning, data formats, and data retentionCollaborate with Data Integration, Data Engineering, BI, and Analytics Engineering teams to support data initiativesMaintain infrastructure documentation, operational procedures, and technical runbooksParticipate in capacity planning, platform optimization, and cost-management initiativesProvide coverage and support for Data Integration activities during team absences or periods of increased workloadRequirementsQualificationsBachelor's degree in Computer Science, Information Systems, Software Engineering, or a related fieldMinimum 5 years of relevant experience in Data Engineering or a related fieldStrong proficiency in SQL, Python, PySpark, Apache Spark, Trino, and Apache AirflowHands-on experience with lakehouse architecture, object storage, and ELT/ETL developmentPractical experience with Bitbucket, Jenkins, and CI/CD practicesKnowledge of access management, platform monitoring, incident response, and performance optimizationExperience working with enterprise data platforms and supporting production data environmentsKey Skills & ExperienceELT/ETL Pipeline DevelopmentApache Airflow OrchestrationSQL, Python & PySparkApache Spark & TrinoLakehouse Architecture & Object StorageCI/CD using Bitbucket & JenkinsData Platform AdministrationAccess, Role, Permission & Quota ManagementPipeline Monitoring & Incident ResolutionPerformance & Storage Optimization

Location: Client Site