Data and AI Engineering Expert

The Data and AI Engineering Expert is a senior hands-on technical authority responsible for the design, development, and operationalization of enterprise data and AI platforms across ENEC. This role leads the engineering delivery of scalable, secure, and compliant data pipelines, AI/ML solutions, and analytics platforms leveraging technologies such as Databricks (Delta Lake, Unity Catalog, MLflow, Delta Live Tables), Microsoft Azure (Azure Data Factory, Azure ML, Microsoft Fabric, Azure AI Foundry, Copilot Studio), Collibra (Data Governance & Data Quality), Power BI, and OT/industrial data systems including PI System, SCADA, and DCS.The Expert applies deep engineering expertise to architect and deliver production-grade solutions, ensures data governance and quality standards are upheld, and drives the adoption of AI and analytics capabilities that directly support ENEC's mission of safe, innovative, and efficient nuclear energy generation. This role acts as a principal technical contributor and mentor, enabling operational excellence and digital transformation at scale.Activity: Data Engineering Architecture & Platform DevelopmentResponsibilities and Accountabilities:• Design, build, and maintain scalable, secure, and high-performance data platforms including Lakehouse architectures using Databricks Delta Lake, Unity Catalog, and Delta Live Tables (DLT).• Develop and operationalize robust data pipelines, ETL/ELT workflows, and integration frameworks using Azure Data Factory, Databricks Workflows, and related orchestration tools.• Architect and implement data models, semantic layers, and data products that serve enterprise analytics, AI, and reporting needs.• Ensure seamless integration of OT and industrial data sources — including PI System, SCADA, and DCS — into enterprise data platforms.• Design and implement APIs, data contracts, and integration frameworks to enable enterprise-wide data consumption.• Ensure platform scalability, resilience, high availability, and disaster recovery capabilities in compliance with nuclear and regulatory requirements.• Apply and enforce data standards, naming conventions, and metadata management practices across all data assets using Collibra and Unity Catalog.Responsibilities and Accountabilities:• Design, develop, and deploy production-grade machine learning, deep learning, and generative AI models using Azure ML, MLflow, and Databricks ML.• Engineer end-to-end MLOps pipelines covering model training, versioning, validation, deployment, monitoring, and retraining — ensuring reliability and reproducibility.• Build and operationalize AI-powered solutions including predictive analytics, anomaly detection, natural language processing (NLP), and GenAI/LLM-based applications using Azure AI Foundry and Copilot Studio.• Develop BI and semantic models in Microsoft Fabric and Power BI, enabling self-service analytics and executive reporting across the organization.• Apply Responsible AI principles and governance frameworks to all AI and ML solutions, ensuring explainability, fairness, and compliance.• Conduct rigorous model evaluation, performance benchmarking, and validation to ensure solutions meet accuracy, reliability, and safety standards.• Contribute to the continuous improvement of AI engineering standards, patterns, and reusable components across the enterprise.Activity: Advanced Subject Matter KnowledgeResponsibilities and Accountabilities:• Demonstrates deep, hands-on expertise in enterprise data engineering, AI/ML platform development, and cloud-native architectures within highly regulated environments.• Maintains current knowledge of global trends in data engineering, MLOps, GenAI, cloud technologies (Azure, hybrid, on-premise), and nuclear industry compliance requirements.• Understands the full lifecycle of data and AI platforms including design, development, testing, deployment, monitoring, and decommissioning.• Applies comprehensive knowledge of data governance frameworks (Collibra, Unity Catalog), master data management, data quality, and lineage management.• Possesses strong awareness of OT/IT convergence, industrial data systems (PI System, SCADA, DCS), and their integration into enterprise analytics environments.• Maintains expert-level proficiency in programming languages and frameworks including Python, SQL, Spark, and relevant AI/ML libraries.Activity: Complex Problem Solving & InnovationResponsibilities and Accountabilities:• Tackles complex, ambiguous engineering challenges in data platform architecture, AI model development, and system integration — delivering innovative, compliant, and production-ready solutions.• Leads root cause analysis and corrective/preventive actions for platform incidents, data quality failures, model degradation, and system disruptions.• Develops and implements robust engineering solutions to address performance bottlenecks, scalability constraints, and integration challenges.• Navigates conflicting technical requirements, evolving regulatory standards, and stakeholder needs to deliver optimal engineering outcomes.• Drives continuous improvement by benchmarking against global engineering best practices, evaluating emerging technologies, and implementing lessons learned.• Leads proof-of-concept and pilot initiatives to evaluate new data and AI technologies and engineering approachesActivity: Applied Skills & Professional Know-HowResponsibilities and Accountabilities:• Expertly engineers, deploys, and operates scalable, secure, and compliant data and AI platforms across Databricks, Azure, and OT environments.• Applies hands-on proficiency in building data pipelines, ML models, GenAI solutions, BI semantic models, and governance frameworks in production environments.• Mentors and develops junior and mid-level data engineers, data scientists, and analytics engineers — building future-ready technical capabilities.• Leads technical design reviews, code reviews, and architecture assessments to uphold engineering quality and best practices.• Effectively translates complex technical concepts into clear, actionable insights for both technical and non-technical stakeholders.• Documents solutions, engineering patterns, and technical standards to build institutional knowledge and enable knowledge transfer.Activity: Security, Governance & ComplianceResponsibilities and Accountabilities:• Design and enforce data security, access control, and privacy frameworks across all data and AI platforms using Unity Catalog, Collibra, and Azure security controls.• Ensure all data engineering and AI solutions comply with national and international nuclear regulations, FANR requirements, and Responsible AI principles.• Maintain comprehensive data lineage, audit trails, and documentation to support regulatory, audit, and governance requirements.• Implement and enforce data quality frameworks and data governance policies using Collibra Data Quality and Unity Catalog.• Conduct regular platform security assessments, data quality audits, and compliance reviews.• Oversee risk management, audit readiness, and the implementation of robust technical controls for all platform operations.Minimum• Bachelor’s degree in computer science, Information Technology, Data Management, Engineering, or related discipline.• Minimum 12+ years' hands-on experience in enterprise data engineering, AI/ML platform development, and cloud-native architectures, including production deployment and operations.• Experience embedding governance within modern data platforms (preferably Databricks) and integrating SAP/Oracle ERP domains.Preferred• Master’s degree in a relevant field.• Experience in energy, utilities, nuclear, financial services, government, or other highly regulated sectors.• Demonstrated AI governance experience (provenance, bias monitoring, model data requirements) in data bricks or similar AI/analytics platforms exposure.• Demonstrated experience leading large-scale data and AI engineering programsCertification - Multiple cloud and AI certifications. Microsoft Fabric, Azure AI Foundry, or Databricks Unity Catalog specialty certifications. Industry publications or contributions in data engineering or AI.Relevant certifications in one or more of: Databricks (Data Engineer Associate/Professional, ML Professional), Microsoft Azure (Data Engineer, AI Engineer, Solutions Architect), MLOps, or Data Governance (Collibra).