Apply Edge Start your job search

Data Engineer/ Architect (Python, Spark, Databricks, Data Lake)

Ampstek · Dubai, United Arab Emirates

Apply & track with Apply Edge
Title: Data Engineer/ Architect (Python, Spark, Databricks, Data Lake)Location: Dubai, UAE (Hybrid)Employment Contract.Job Description: - 10+ years of experience for Data Lake Engineer- Strong experience with Python, SQL and languages like PySpark and distributed data processing frameworks using Spark- Hands-on experience in Data Lake- Experience with CI/CD tools and infrastructure automation- Experience deploying CI/CD pipelines in cloud environments- Strong understanding of data modeling, ETL, and batch/stream processing.- Should be aware of agile terminologiesMandatory skills* - Python, Spark, Databricks, CI/CD, Docker, Kubernetes, Cloud deployment, Data pipelines, - The role needs strong Python skills and should have strong Data lake concepts.- They should handle CI/CD deployment tracking.Desired skills* - Knowledge of containerization and orchestration (Docker, Kubernetes) will be a nice to have skill.