Senior AI Engineer

Project description VR-122229Join our Development Center in Bucharest, and become a member of our open-minded, progressive and professional team. In this role you will be working on projects for one our world famous clients.You will have a chance to grow your technical and soft skills, and build a thorough expertise of the industry of our client.On top of attractive salary and benefits package, Luxoft will invest into your professional training, and allow you to grow your professional career.ResponsibilitiesRole Summary:Work in a scaled Agile working environmentBe part of a global and diverse teamContribute to all stages of software development lifecycleParticipate in peer-reviews of solution designs and related codeMaintain high standards of software quality within the team by following good practices and habitsUse frameworks like Google Agent Development Kit (Google ADK) and LangGraph to build robust, controllable, and observable agentic architecturesAssist in the design of LLM-powered agents and multi-agent workflows (planning, tool use, orchestration, memory, and human-in-the-loop)Lead the implementation, deployment and test of multi-agent systemsMentor junior engineers on best practices for LLM engineering and agentic system developmentDrive technical discussions and decisions related to AI architecture and framework adoptionProactively identify and address technical debt and areas for improvement in AI systemsRepresent the team in cross-functional technical discussions and stakeholder meetingsKey Responsibilities:Design and build complex agentic systems with multiple interacting agentsImplement robust orchestration logic (state machines / graphs, retries, fallbacks, escalation to humans)Implement RAG pipelines, tool calling, and sophisticated system prompts for optimal reliability, latency, and cost controlApply core ML concepts to evaluate and improve agent performance, including dataset curation and bias/safety checksLead the development of agents using Google ADK and/or LangGraph, leveraging advanced features for orchestration, memory, evaluation, and observabilityIntegrate with supporting libraries and infrastructure (e.g., LangChain/LlamaIndex, vector databases, message queues, monitoring tools) with minimal supervisionDefine success metrics, build evaluation suites for agents (automatic + human evaluation), and drive continuous improvementCurate and maintain comprehensive prompt/test datasets; run regression tests for new model versions and prompt changesDeploy and operate AI services in production, establishing CI/CD pipelines, observability, logging, and tracingDebug complex failures end-to-end, identifying and document root causes across models, prompts, APIs, tools, and dataWork closely with product managers and stakeholders to shape requirements, translate them into agent capabilities, and manage expectationsDocument comprehensive designs, decisions, and runbooks for complex systemsSkillsMust haveEducation & experience3+ years of experience as Software Engineer / ML Engineer / AI Engineer, with at least 1-2 years working directly with LLMs in real applications (not just experiments or coursework)Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field (or equivalent practical experience) Core technical skills Programming & software engineering:Strong proficiency in Python (core language features, packaging, testing, async, type hints)Very strong software engineering practices: version control (Git), unit/integration testing, code reviews, CI/CDExperience building and consuming REST/gRPC APIs and integrating external tools/services Machine Learning (good understanding):Understanding of core ML concepts: supervised/unsupervised learning, train/validation/test splits, overfitting, regularization, and common metrics (precision, recall, F1, ROC-AUC, etc.)Good understanding of deep learning basics (neural networks, embeddings) and at least one ML/DL framework (e.g., PyTorch, TensorFlow, JAX, scikit-learn) LLMs & agentic AI (very strong understanding):Deep practical knowledge of large language models:Tokenization, context windows, temperature, top-p, system vs user promptsPrompt engineering patterns (ReAct, chain-of-thought, tool-calling/tool-use)Fine-tuning / adapters / instruction-tuning, or experience with RAG as an alternativeExperience building LLM-powered applications end-to-end: from idea → prototype → productionFamiliarity with safety and reliability considerations: hallucinations, guardrails, content filtering, privacy Agentic frameworks (required understanding, experience preferred):Conceptual understanding of modern agentic frameworks and patterns (stateful graphs, multi-agent coordination, human-in-the-loop, memory, and evaluation)Hands-on experience with at least one of: o Google Agent Development Kit (ADK)building multi-agent workflows, using its orchestration, tools, and evaluation features o LangGraphdesigning graph-based, stateful agent workflows with cycles, branches, and durable executionCandidates must be able to read, reason about, and extend ADK/LangGraph-based codebasesDirect production experience with both ADK and LangGraph is a strong plus Data & infra:Experience working with vector databases (e.g., Pinecone, Weaviate, pgvector, Chroma) for retrieval-augmented generationComfortable with SQL and basic data modelingExperience deploying on at least one major cloud platform (GCP, AWS, Azure) and using managed services (e.g., serverless runtimes, container orchestration, secrets management) Soft skills:Ability to translate ambiguous business requirements into concrete technical designsStrong communication skills; able to explain trade-offs to both technical and non-technical stakeholdersComfort working in an experimental environment with rapid iteration, but with a strong bias towards production quality and maintainabilityNice to haveExperience with:Vertex AI / Gemini or other hosted LLM ecosystemsRelated frameworks and tools: LangChain, LlamaIndex, semantic search, evaluation frameworks (e.g., RAGAS, custom eval harnesses)Monitoring and observability stacks (OpenTelemetry, Prometheus/Grafana/NewRelic, Datadog, etc.)Background in one or more of:Information retrieval / searchNLP (beyond LLMs): classic text processing, embeddings, semantic similaritySecurity & compliance for AI systems (PII handling, access control, audit logging)Contributions to open-source AI projects, blog posts, or talks about LLMs/agentic systems