Principal Data Engineer - II

Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sourcesImplement real-time data streaming and batch processing solutions to support diverse business needsBuild and optimize data storage solutions, including data lakes, data warehouses, and databasesEnsure data systems and pipelines are scalable, secure, and performantClean, transform, and prepare raw data into usable formats for analytics and machine learningCollaborate with Data Scientists and Analysts to define data requirements and deliver solutionsMonitor the performance and reliability of data pipelines and systems, implementing improvements where necessaryTroubleshoot and resolve data-related issues, ensuring minimal downtimeImplement and enforce data quality checks, validation processes, and monitoring mechanismsCollaborate with Data Governance teams to ensure data complies with organizational standards and policiesWork closely with cross-functional teams, including Data Architects, Analysts, and Business Teams, to understand requirements and deliver data solutionsProvide technical expertise and guidance on data engineering best practicesStay updated on emerging tools, technologies, and industry trendsEvaluate and recommend technologies to enhance data engineering capabilitiesRequirementsBachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.7 to 8 years of experience as a Data Engineer or in a similar role, with expertise in building and maintaining data pipelines and infrastructure.Hands-on experience with big data tools, cloud platforms, and data integration techniques.Expertise in SQL and working with relational and NoSQL databases.Experience with data orchestration tools (e.g., ODI, SSIS, Apache Airflow, dbt, Prefect).Proficiency in programming languages like Python, Java, or Scala.Familiarity with data processing frameworks (e.g., Apache Spark, Kafka).Strong problem-solving and analytical skills.Excellent communication and collaboration abilities.Ability to work in a fast-paced, team-oriented environment.BenefitsCompetitive salaryFuel CardHealth benefitsProfessional development opportunitiesInclusive work culture & much more