Data Engineer - Python & Microservices

We are seeking an experienced Data Engineer with strong expertise in Python, Microservices Architecture, Data Transformation, and Backend Engineering to join our Data Engineering team. The ideal candidate will be responsible for designing and developing scalable backend services, data processing frameworks, RESTful APIs, and data transformation pipelines that support enterprise data-driven applications.This role requires strong hands-on experience with Python-based web frameworks, database technologies, ETL pipelines, microservices, API security, and modern software engineering practices. Candidates should have experience building production-grade applications with a focus on scalability, reliability, security, and performance.RequirementsKey Responsibilities Design, develop, and maintain scalable backend applications and web frameworks using Python Build robust RESTful APIs and microservices to serve enterprise datasets and business applications Develop and optimize data transformation pipelines to process, clean, enrich, and prepare data for analytics and business consumption Design and implement scalable data access layers integrating multiple relational and NoSQL databases Collaborate with frontend developers to integrate user-facing components with backend services Ensure applications are secure, highly available, performant, and maintainable Design and maintain database schemas and data models aligned with business requirements Implement ETL processes for extracting, transforming, and loading large-scale datasets Optimize database performance, query execution, and data retrieval mechanisms Troubleshoot production issues and implement scalable solutions for long-term platform stability Participate in code reviews, testing activities, technical design discussions, and engineering best practices Work closely with business stakeholders, architects, and engineering teams within Agile delivery environmentsRequired Technical SkillsPython Development Strong hands-on experience in Core Python development Expertise in building backend services and APIs using Python Strong understanding of object-oriented programming principles and software design patterns Experience writing clean, reusable, maintainable, and production-quality codeWeb Frameworks & API DevelopmentStrong experience with one or more Python frameworks including: FastAPI Flask Django PyramidExperience with: RESTful API design and development API versioning and documentation Routing and middleware implementation Authentication and authorization Framework testing and debuggingMicroservices Architecture Strong experience designing and developing microservices-based applications Deep understanding of distributed systems architecture Experience building scalable and resilient service-oriented platforms Knowledge of service communication patterns and API orchestration Experience handling concurrent requests and high-volume transaction processingAsynchronous Programming Strong understanding of asyncio and asynchronous programming concepts Experience handling concurrent connections and non-blocking operations Knowledge of performance optimization for I/O-intensive applicationsSecurity & API Protection Strong understanding of API and microservices security best practices Experience implementing:OAuth 2.0JWT AuthenticationAPI Gateway integrationsEncryption and secure communication protocols Experience implementing authentication, authorization, and access control mechanismsDatabase & ORM Expertise Strong experience with relational and NoSQL databases Experience designing database schemas and optimizing database performance Strong proficiency with:SQLPostgreSQLMySQLMongoDBRedisHands-on experience with ORMs including: SQLAlchemy Django ORMAbility to: Define models Perform CRUD operations Write optimized queries Handle transactions Manage database migrationsData Engineering & Transformation Experience building and maintaining ETL pipelines Strong understanding of data transformation, enrichment, aggregation, and cleansing techniques Experience ensuring data quality, consistency, and integrity Ability to support analytical and data-driven applications through scalable processing frameworksDevOps & CI/CD Experience building and maintaining CI/CD pipelines Experience deploying and supporting production-grade applications Understanding of infrastructure automation and modern software delivery practices Experience with release management and deployment workflowsBig Data & Data TechnologiesExposure to technologies such as: Hadoop Apache Spark Apache KafkaUnderstanding of: Data Warehousing concepts Distributed data processing Enterprise data architecturesVersion Control & Development Practices Strong experience with Git version control Experience with:Branching strategiesCode reviewsPull RequestsMerge conflict resolutionCollaborative development workflowsTesting & Debugging Experience with:Unit TestingIntegration TestingLoggingMonitoringPerformance TroubleshootingProduction SupportNice to Have Experience with AWS, Azure, or GCP Experience with Docker and Kubernetes Exposure to cloud-native architectures Knowledge of data governance, compliance, privacy, and security standards Experience supporting large-scale enterprise data platformsRequired Competencies Strong analytical and problem-solving skills Excellent communication and stakeholder management capabilities Strong collaboration and teamwork skills Ability to work effectively in Agile/Scrum environments Strong ownership mindset with attention to detail Ability to document solutions and communicate technical concepts clearlyEducationBachelor's Degree in Computer Science, Information Technology, Engineering, Data Engineering, or a related field.