Senior Big Data Engineer

🚀 WE’RE HIRING | Senior Data Engineer – Big Data & Cloud📍 Location: Dubai, UAE🏢 Client: Leading Digital Infrastructure & Technology Company💼 Payroll: Teamware Human Resource Solutions LLC🕒 Employment Type: Full-Time🎯 Experience: 8–15 Years🌐 Domain: Big Data | Data Engineering | Cloud | Real-Time Streaming | Analytics🌟 About the RoleTeamware Human Resource Solutions LLC is looking for an experienced Senior Data Engineer with 8–15 years of experience in Big Data and Data Engineering.The ideal candidate should have strong hands-on experience in scalable data pipelines, ETL/ELT, real-time streaming, Hadoop/Cloudera, Spark, Kafka, and cloud platforms. Experience across AWS, Azure, GCP, OpenShift/Kubernetes, along with exposure to AI/ML, NLP, and Statistical Modeling, will be highly valued.🎯 Key Responsibilities🔹 Design, develop, and maintain scalable ETL/ELT data pipelines for batch and real-time processing.🔹 Build and manage real-time streaming pipelines using Apache Kafka, Spark Streaming, and/or Flink.🔹 Develop high-performance data workflows across Cloudera/Hadoop and Cloud platforms.🔹 Build robust data ingestion frameworks using Kafka and Apache NiFi.🔹 Design and optimize data warehouse architectures and data models.🔹 Automate data workflows using Airflow and Oozie.🔹 Deploy and manage data applications on OpenShift/Kubernetes.🔹 Implement CI/CD pipelines and collaborate with DevOps teams for automated deployment.🔹 Drive data migration and integration across on-premise and cloud environments.🔹 Ensure strong data quality, governance, security, performance, and reliability.🧠 Must-Have Skills✅ 8–15 years of experience in Data Engineering / Big Data✅ Strong hands-on experience in Hadoop / Cloudera✅ Strong experience with Apache Spark & Spark Streaming✅ Hands-on experience with Apache Kafka✅ Strong ETL/ELT and Data Pipeline development experience✅ Experience with Hive & HBase✅ Experience with AWS / Azure / GCP✅ Experience with Flink✅ Experience with Airflow / Oozie✅ Experience with NiFi✅ Experience with OpenShift / Kubernetes✅ Strong experience in Data Migration & Data Integration✅ Understanding of Data Quality, Governance & Security⭐ Good to Have➕ Exposure to AI / Machine Learning➕ NLP experience➕ Statistical Modeling➕ Experience with large-scale enterprise data platforms➕ Strong technical leadership and stakeholder management capabilities🎓 QualificationsBachelor’s degree in Computer Science, Engineering, Information Technology, or a related discipline with relevant professional experience.💎 Why Join?🚀 Work with Leading Digital Infrastructure & Technology Company on large-scale digital and data transformation initiatives in Dubai.☁️ Work across modern Big Data, Cloud & Real-Time Streaming technologies.🌐 Opportunity to work on enterprise-grade data platforms in an international environment.📩 Interested candidates can share their updated CV to shaik.d@twsol.com