DataOps Consultant, Lakehouse Support - Abu Dhabi, United Arab Emirates

Project DescriptionL2 DataOps Consultant – Lakehouse Support for an investment management environmentProvide operational diagnostics and incident management for Lakehouse data platformsOwn L2 incident resolution across data pipelinesCollaborate with Platform Engineering, Data Engineers, and Data Domain teamsApply ITSM, change management, and problem management to minimize recurring issuesUtilize investment management domain knowledge for faster incident resolution and root cause analysis (RCA)Key ResponsibilitiesOwn end-to-end L2 incident resolution for Lakehouse data platformsPerform operational diagnostics across batch and streaming data pipelinesCoordinate issue resolution with Platform Engineering, Data Engineering, and business teamsManage incidents using ITSM tools such as ServiceNowTroubleshoot issues using metadata, data lineage, and technical documentationMaintain clear ownership, escalation, and communication during incidentsConduct RCA and implement preventive measures through problem managementSupport change management activities and ensure operational stabilityMandatory SkillsStrong experience in Data Operations (L2 Support)Hands-on experience with Lakehouse architectures (Databricks, Delta Lake, or equivalent)Expertise in incident management and ITSM processesExperience troubleshooting batch and streaming data pipelinesKnowledge of metadata-driven operations, data lineage, and observabilityStrong skills in Root Cause Analysis (RCA), change management, and problem managementExperience owning incidents from identification to resolutionWorking knowledge of investment management data:Portfolio & PositionsTrade LifecycleMarket DataRisk & Performance DataExperience as a Data Engineer in Databricks and Delta LakeHands-on knowledge of Delta Lake internalsNice-to-Have SkillsPalantir Foundry – DQC setup, pipeline diagnostics, build failure troubleshootingMonte Carlo – Data quality monitoring and observabilityAzure DevOps – Repository management and CI/CDExperience with Dynatrace or other observability toolsExperience with enterprise-scale data platformsKnowledge of batch orchestration and workflow toolsFamiliarity with investment management systems such as Optima and CardiaUnderstanding of portfolio concepts such as Maturity Date and Value DateStrong understanding of data lineage, metadata, and observability concepts