Software Engineer (AI & Python Development)

Job Title: Software Engineer (AI & Python Development)We are looking for an Software Engineer (AI & IT-Python Development) to join our growing AI team and help build, scale, and maintain the backend infrastructure powering our unified AI platforms.

The ideal candidate has a solid foundation in backend engineering, a working knowledge of AI/ML systems, and the drive to experiment and ship real products.

Key Responsibilities

Design and maintain a unified LLM gateway that integrates multiple AI providers (OpenAI, Anthropic Claude, Google Gemini, and others) under a single API layerManage authentication, API key lifecycle, and multi-tenant access control for platform usersOptimize response streaming from LLM providers to deliver low-latency, real-time chat experiencesRun pre-trained model experiments for question-answering or semantic search.Monitor backend performance, debug production issues, and improve system observability with logging and alertingStay up to date with new AI model releases and evaluate integrations into the platform Requirements:Education:Bachelor’s degree in Computer Science, Information Technology, or a related field. Exceptional will be considered.Experience:Familiarity with pre-trained NLP models (Sentence Transformers, Mistral, MiniLM, T5, LLaMA, Gemma).Knowledge of Fast API, API Gateway Must, Hybrid caching.Knowledge of Git, Docker.Knowledge on LiteLLM, Langchain, Autogen Required Skills:Knowledge of Python, Kong Gateway, Redis caching, Lang cacheFamiliarity with machine learning / NLP concepts: embeddings, semantic search, similarity.Knowledge of data preprocessing: Pandas, NumPy.Strong attention to detail and willingness to learn.Familiarity with Git, Docker. Additional Requirements:Strong communication skills in English (both written and spoken).Proactive problem-solver with excellent collaboration skills.Ability to work in a fast-paced, agile environment.Compensation & Benefits:Weekly Holidays: 2 days/week (Friday & Saturday)Salary Review: AnnuallyFestival Bonuses: 2 per yearLeave Entitlement: Sick Leave & Annual LeavePerformance Recognition: Yearly Awards Based on PerformanceWork Environment: 3 offices Premises, Friendly, collaborative, and supportiveOffice Location: Panthopath, Dhaka. Others Benefits:Skill development and learning support (online courses, workshops)Employee wellness support and periodic team outingsOpportunity to work on global digital productsCareer advancement within Gakk Media ltd and its sister companies