Senior Data Engineer - Python & Microservices

We are looking for an experienced Senior Python Data Engineer with strong expertise in Python development, microservices architecture, data engineering, and backend API development. The ideal candidate will have hands-on experience building scalable Python-based applications and data services, designing robust REST APIs, performing complex data transformations, and developing high-performance backend frameworks to support enterprise data-driven applications.This role requires strong proficiency in Python web frameworks, asynchronous programming, microservices architecture, ETL processes, database management, and modern software engineering best practices. Exposure to big data technologies, DevOps practices, and cloud-native architectures will be highly advantageous.RequirementsKey ResponsibilitiesDesign, develop, and maintain scalable Python-based web frameworks and backend servicesDevelop robust RESTful APIs using Python frameworks such as FastAPI, Flask, or DjangoBuild and maintain microservices-based applications supporting enterprise data platformsDesign and implement data transformation pipelines for data ingestion, processing, and enrichmentDevelop backend systems to efficiently serve datasets through APIs and other interfacesCollaborate with cross-functional teams to deliver scalable and secure data-driven applicationsDesign and maintain relational and NoSQL database schemasDevelop efficient ETL (Extract, Transform, Load) processes for enterprise data requirementsOptimize application and database performance to ensure scalability and reliabilityImplement asynchronous programming techniques using asyncio and optimize concurrent connections and I/O operationsEnsure data integrity, consistency, and quality across data transformation pipelinesParticipate in code reviews and contribute to software engineering best practicesTroubleshoot, debug, and resolve production issues across applications and data pipelinesCollaborate closely with stakeholders and engineering teams throughout the SDLCRequired Technical SkillsCore Python DevelopmentStrong hands-on expertise in Core PythonExperience building enterprise-grade Python applicationsStrong understanding of:Python programming conceptsObject-oriented programmingAsynchronous programming (asyncio)Concurrent connections handlingI/O optimization techniquesClean code and software design principlesPython Web FrameworksHands-on experience with one or more of the following:FastAPIFlaskDjangoPyramidStrong understanding of:RESTful API developmentRoutingAuthentication mechanismsTesting frameworksDatabase integrationsFramework architecture and scalabilityMicroservices ArchitectureStrong experience with:Microservices-based application designService-oriented architecturesAPI integrationsDistributed systemsEnterprise backend servicesKnowledge of:API GatewaysService communication patternsScalable backend architecturesSecurity & API ManagementExperience implementing:OAuthJWT AuthenticationAPI Security Best PracticesAuthorization mechanismsEncryption standardsSecure API development practicesData Engineering & Data TransformationsStrong hands-on experience with:Data transformation pipelinesETL processesData cleansing and enrichmentData aggregation techniquesData quality and integrity managementExperience in:Dataset preparationData processing workflowsEnterprise data platformsDatabase ManagementExperience working with:Relational DatabasesPostgreSQLMySQLSQL Server (preferred)NoSQL DatabasesMongoDBRedis (good to have)Strong knowledge of:Database schema designPerformance optimizationTransactions managementEfficient data retrieval techniquesORM FrameworksHands-on experience with:SQLAlchemyDjango ORMAbility to perform:CRUD operationsQuery optimizationTransaction handlingData modellingDevOps & CI/CDExperience with:CI/CD pipeline development and maintenanceGit-based workflowsVersion control best practicesBranching strategiesCode reviewsProduction deploymentsBig Data Technologies (Preferred)Exposure to:Apache SparkHadoopApache KafkaUnderstanding of:Data warehousing conceptsLarge-scale data processing architecturesScripting SkillsStrong proficiency in:SQLShell ScriptingPython scriptingCloud & Containerization (Good to Have)Exposure to:AWSMicrosoft AzureGoogle Cloud Platform (GCP)DockerKubernetesData Governance (Good to Have)Knowledge of:Data governance principlesData security best practicesCompliance frameworksEnterprise data management practicesPreferred Additional SkillsExperience with R Programming LanguageExperience working on enterprise-scale data engineering initiativesExposure to cloud-native architectures and containerized deploymentsRequired CompetenciesStrong analytical and problem-solving skillsExcellent communication and stakeholder management capabilitiesStrong debugging and troubleshooting skillsAbility to work effectively in Agile and collaborative environmentsStrong ownership mindset and attention to detailAbility to adapt quickly to evolving business and technical requirementsStrong documentation and technical communication skills