Apply Edge Start your job search

Data Engineer

MW Partners · San Jose, CA

Apply & track with Apply Edge
Responsibilities and duties:Design, build, optimize, and maintain scalable data pipelines that support Growth Monetization initiatives.Write complex SQL queries to analyze A/B experiment resultsDevelop and enhance ETL/ELT workflows for large-scale structured and unstructured datasets.Optimize pipeline performance, reliability, scalability, and data quality across distributed systems.Work with Big Data technologies and best practices to process high-volume datasets efficiently.Build automated monitoring, alerting, and validation frameworks for pipeline health and data integrity.Partner with Data Science, Product, Marketing, and Engineering teams to deliver actionable insights and scalable data solutions.Requirements:Strong SQL expertise with the ability to write and optimize complex queries on large datasets.Hands-on experience with Big Data technologies such as Hadoop, Hive, Spark, or similar distributed processing frameworks.Experience building and optimizing scalable data pipelines in cloud and enterprise environments.Proficiency in ETL orchestration and workflow management tools.Experience with data quality, pipeline monitoring, and performance tuning.Ability to collaborate effectively with technical and non-technical stakeholders in a fast-paced environment.