Apply Edge Start your job search

Senior Data Engineer

LatentView Analytics · Chennai, Tamil Nadu, India

Apply & track with Apply Edge

Job SummaryWe are looking for a Data Engineer / Senior Data Engineer with 4–6 years of overall experience and strong hands-on development experience in Python, SQL, and Google Cloud Platform (GCP). The candidate will be responsible for designing, developing, and maintaining scalable, distributed, and fault-tolerant data pipelines and data applications.The ideal candidate should have practical experience with BigQuery, Dataflow, Google Cloud Storage (GCS), PostgreSQL, and cloud-based/traditional data warehouses. Experience with Spark, Kafka, Hadoop, Cloud Composer, Pub/Sub, Cloud Functions, and Cloud SQL will be an added advantage.Job ResponsibilitiesDesign, develop, and maintain scalable and fault-tolerant data pipelines from scratch.Build and optimize data solutions using Python and SQL.Develop data pipelines and applications using GCP services, including BigQuery, Dataflow, GCS, and PostgreSQL.Work with both relational and non-relational databases to support data integration and analytics requirements.Develop and maintain data-focused applications across cloud and traditional data warehouse environments.Ensure data pipelines are reliable, scalable, performant, and highly available.Troubleshoot data pipeline, application, and production issues and implement appropriate solutions.Collaborate with engineering, analytics, and business teams to understand requirements and deliver data solutions.Work with big-data technologies such as Apache Spark, Hadoop, and Kafka where required.Explore and adopt new tools, technologies, and techniques to improve data engineering processes.Provide technical guidance and support to new team members/joiners.Contribute to code reviews, documentation, testing, and best practices.Work effectively in a dynamic environment where requirements and problems may not always be clearly defined.Required Skills4–6 years of Data Engineering experiencePython & SQL – 3+ yearsGCP – BigQuery, Dataflow, GCSPostgreSQL / relational & NoSQL databasesData pipeline development – 2+ yearsETL/ELT & distributed systemsCloud & traditional data warehousesApache Spark / Kafka / Hadoop – preferredStrong problem-solving and communication skillsWe are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.