Lead Data Databricks
Perficient India · Hyderabad, Telangana, India
Apply & track with Apply EdgeWe are looking for a Lead Azure Databricks Engineer Locations: #Hyderabad |#Bangalore | #Chennai | #Pune | #NagpurExperience: 9+ Years
The ideal candidate will design, build, and optimize scalable data pipelines and support analytics initiatives on the Azure platform.
Responsibilities
Design and maintain ETL/ELT pipelines using Azure DatabricksWrite efficient PySpark and Python code for large-scale data processingDevelop and optimize complex SQL queries for data transformation and reportingWork with Delta Lake, Azure Data Lake Storage (ADLS), and Azure Data FactoryMonitor and troubleshoot pipeline performanceCollaborate with data analysts and business teams to deliver reliable datasets
Requirements
7+ years of experience in data engineeringStrong hands-on skills in Azure Databricks, PySpark, SQL, and PythonUnderstanding of data pipeline design, ETL/ELT concepts, and data warehousingFamiliarity with Azure ecosystem tools is a plusGood problem-solving and communication skillsPreferred CertificationsDatabricks Certified Data Engineer Associate or ProfessionalDatabricks Champion