Apply Edge Start your job search

Senior Full-Stack Engineer

TMC Middle East · Abu Dhabi Emirate, United Arab Emirates

Apply & track with Apply Edge
About the RoleWe are looking for a Senior Full-Stack Engineer to own and evolve our enterprise datagovernance and cataloging platform. This is a high-impact role where you will work acrossthe full stack: a FastAPI/Python backend, Celery async workers, and a constellation of internalmicroservices. You will be responsible for building features, debugging production issuesend-to-end, and ensuring platform reliability.Key Responsibilities● Design, develop, and maintain backend APIs using FastAPI, SQLAlchemy, and Pydantic● Build and enhance frontend features in React and TypeScript (Redux, React Flow for lineage visualization)Develop and maintain Celery async tasks (Elasticsearch sync, query execution, lineage creation, metastore updates)Integrate with external services: Trino (SQL engine), Elasticsearch (search), Hive Metastore (metadata), Vault(secrets), Keycloak/OAuth2 (auth), and internal microservicesDebug complex cross-layer issues spanning API routes, ORM relationships, SQL parsing, frontend state management, and Docker containersWrite and maintain database migrations using AlembicManage Docker-based local development and contribute to CI/CD pipeline improvementsEnsure code quality through linting, testing, and code reviewRequired Skills and ExperienceBackend (Primary Focus)5+ years with Python (3.10+), strong grasp of async patterns, ORM pitfalls, and debuggingHands-on experience with FastAPI (route design, middleware, dependency injection, Pydantic models)Deep experience with SQLAlchemy ORMWorking knowledge of Celery (task design, debouncing, beat scheduling, worker debugging)Familiarity with Trino/Presto SQL dialect Data & InfrastructureExperience with PostgreSQL (queries, indexing, migrations)Working knowledge of Elasticsearch (index management, document sync, search queries)Experience with Docker and Docker Compose for local development and debugging (container logs, exec, restart workflows)Familiarity with Redis as a message broker and cacheExposure to Hive Metastore or similar catalog systems is a plusNice to HaveExperience with data governance or data catalog platforms (Apache Atlas, DataHub, Amundsen, Collibra, or similar)Knowledge of Apache Iceberg table format and its catalog integrationExperience with Spark job submission via KubernetesFamiliarity with Apache Arrow / Flight for high-performance data transferExperience with DBT and artifact managementUnderstanding of data classification and access policy frameworksExperience with LDAP / Active Directory integrationFamiliarity with Nginx reverse proxy configuration