Apply Edge Start your job search

Senior Databricks Solution Architect

Unison Group · Tunis, Tunis, Tunisia

Apply & track with Apply Edge
We are seeking a Senior Databricks Architect to design, implement, and optimize enterprise-scale data platforms using the Databricks Lakehouse Platform. The ideal candidate will have deep expertise in Databricks architecture, Apache Spark, Delta Lake, data engineering, cloud platforms, and enterprise data solutions.Key ResponsibilitiesDesign and architect Databricks Lakehouse solutions for large-scale enterprise data platformsLead end-to-end Databricks implementation, including architecture, development, deployment, and optimizationDefine Databricks workspace architecture, cluster strategies, security models, and operational standardsDesign and develop scalable data pipelines using Databricks, Apache Spark, PySpark, SQL, and Delta LakeImplement data ingestion frameworks supporting batch and real-time data processingDesign Delta Lake architectures including:Delta tablesMedallion architecture (Bronze/Silver/Gold layers)Data quality frameworksSchema evolution and optimizationPerform Databricks performance tuning:Cluster optimizationSpark job optimizationQuery tuningCost optimizationImplement Databricks governance and security using:Unity CatalogAccess controlsData lineageAudit capabilitiesLead migration projects from legacy data platforms to Databricks LakehouseDefine best practices for Databricks CI/CD, DevOps, and environment managementCollaborate with data engineers, data scientists, analysts, and enterprise architectsProvide technical guidance, architecture documentation, and design reviewsSkills & ExperienceStrong experience in data engineering, big data, or solution architectureStrong hands-on experience with Databricks PlatformExpert knowledge of:Apache SparkPySpark / ScalaDelta LakeSQLData Lakehouse architectureETL/ELT developmentExperience designing and delivering enterprise Databricks solutionsStrong experience with cloud platforms:Azure Databricks (preferred)AWS DatabricksGoogle Cloud DatabricksExperience with:Databricks WorkflowsJobs orchestrationNotebooksReposCluster managementUnity CatalogPreferred SkillsDatabricks Certified Data Engineer Professional / Databricks Certified ArchitectExperience with:MLflowDatabricks Machine LearningFeature StoreModel deploymentMLOpsKnowledge of streaming technologies:Structured StreamingKafkaExperience with data governance, compliance, and enterprise security frameworksKey CompetenciesStrong Databricks architecture and implementation expertiseAbility to design scalable and cost-efficient Lakehouse solutionsStrong troubleshooting and performance optimization skillsAbility to lead technical discussions with enterprise stakeholders