Senior Data Engineer

Key Responsibilities

Data ingestion: Design, build, and maintain scalable batch data pipelines to ingest enrollment data from disparate sources using Python, Airflow, and SQL.Data quality & validation: Implement robust data validation rules and data quality frameworks to ensure accuracy, consistency, and reliability across all datasets.Data transformation: Perform efficient batch data transformations and historical tracking using dbt, Snowflake, and PostgreSQL.Historical trackingREST API development: Build high-performance RESTful APIs using Node.js / NestJS to serve processed enrollment data to downstream systems.Event publishing: Integrate asynchronous event publishing/messaging workflows using Apache Kafka.