Data Engineer - Senior Specialist

Job Overview:We are seeking a talented and motivated Senior Data Engineer with expertise in Scala and Python to join our data engineering team. This individual will play a key role in the design, development, and optimization of our data infrastructure and data pipelines. The ideal candidate has a passion for building scalable, high-performance systems and is eager to broaden their knowledge across the entire data engineering stack, from hardware infrastructure to project development.Key responsibilities:

• Collaborate with cross-functional teams to design, develop, and maintain data engineering solutions using Scala, Python, and Apache Spark.
• Implementation of new data engineering technologies, frameworks, and tools, such as HDFS, MongoDB, and PostgreSQL, to enhance performance, scalability, and efficiency.
• Understand and optimize hardware and resource consumption for data engineering projects.
• Develop a deep understanding of hardware infrastructure, including servers, clusters, and distributed systems, to ensure optimal data processing and storage.
• Design and architect high-performance, fault-tolerant, and scalable data pipelines.
• Conduct research and stay current with the latest advancements in data engineering, hardware technologies, and distributed computing paradigms.
• Mentor and guide junior team members, fostering a culture of continuous learning and skill development.
• Collaborate with stakeholders to gather requirements, propose technical solutions, and deliver high-quality data engineering projects.

Requirements

• 2-3 years of professional experience as a Software Engineer, with a focus on data engineering.
• Keen interest in hardware infrastructure, resource consumption optimization, and data engineering project development.
• Proven ability to work effectively in an Agile development environment and manage multiple priorities.
• Strong problem-solving, analytical thinking, communication, and collaboration skills.