Lead Data Engineer

Key ResponsibilitiesLead the design and development of scalable batch and streaming data pipelines using Java, Spark, and KafkaArchitect data platforms covering ingestion, transformation, storage, and serving layersBuild and maintain data services and APIs using Spring BootDefine data models, partitioning strategies, and schema management for data lake and warehouse environmentsOwn code quality through code reviews, design reviews, and engineering best practicesMentor and coach data engineers, and support their technical growthOptimize pipeline performance, cost, and JVM/Spark tuningImplement data quality checks, monitoring, alerting, and observabilityDrive CI/CD, automated testing, and infrastructure-as-code practicesLead root-cause analysis for production data incidentsEnsure data security, governance, and privacy compliance (including PIPEDA requirements)Contribute to estimation, sprint planning, and delivery in an Agile environment