AI Engineer / AI Developer / AI Specialist

CMC Global is a member of CMC Corporation with an aspiration to bring ICT products, solutions, and services of Vietnam to the international market.Established in March 2017 as a strategic move of the Corporation to enter the global stage, we are proud to be the leading company in Vietnam in providing a wide variety of comprehensive IT Solutions & Services, ranging from Traditional services to Digital Transformation, as well as Consultancy, to organizations worldwide.Working location: District 1, Ho Chi Minh CityWorking type: Full-time, OnsiteEnglish requirement: Not requiredPOSITION 1: AI ENGINEERJOB DESCRIPTIONDevelop AI applications and AI services based on Large Language Models and Generative AI.Build end-to-end AI solutions from prototype and proof of concept to production deployment.Design and implement RAG pipelines, including document processing, chunking, embedding, vector search and retrieval.Develop and optimize prompts for different AI use cases.Integrate LLMs with APIs, databases, knowledge bases and enterprise systems.Build RESTful APIs and microservices for AI applications.Implement evaluation, logging and monitoring mechanisms for AI services.Troubleshoot and optimize AI applications regarding output quality, hallucination, context, token usage, latency and operational cost.Work closely with AI Specialists, Backend Engineers, DevOps Engineers and Quality Engineers throughout the development lifecycle.Research and evaluate suitable models, frameworks and technologies for each AI use case.REQUIREMENTSAt least 2 years of experience in Software Engineering or AI Engineering.Strong programming skills in at least one language: Python, Java or Go.Hands-on experience with LLM, Generative AI, RAG and Prompt Engineering.Understanding of embedding, vector search and vector databases.Experience developing RESTful APIs or microservices.Ability to build an AI application end-to-end, from prototype to production.Understanding of databases, cloud platforms and software architecture.Basic experience with Docker and CI/CD.Understanding of common LLM challenges, including hallucination, context management, token limits, latency and cost.Good debugging, problem-solving and AI application optimization skills.Experience with LangChain, LangGraph, LlamaIndex or equivalent frameworks is an advantage.Experience with AWS, Azure or GCP is an advantage.POSITION 2: SENIOR AI DEVELOPERJOB DESCRIPTIONProvide technical leadership for AI applications and the AI platform.Design production-grade, end-to-end architecture for LLM and Generative AI solutions.Design and develop RAG, Agentic AI and tool-calling solutions.Define technical standards, development frameworks, coding conventions and best practices for the AI engineering team.Evaluate and select suitable models, AI frameworks, vector databases and cloud services.Design integrations between AI services, APIs, databases, knowledge bases and enterprise systems.Ensure the scalability, performance, reliability, security and maintainability of AI solutions.Establish LLM evaluation, guardrails, observability, logging and monitoring mechanisms.Review solution designs and source code and resolve complex technical issues.Mentor AI Engineers and support the team in making technical and architectural decisions.Collaborate with Business Analysts, AI Specialists, Backend Engineers, DevOps, Security and Quality teams.REQUIREMENTSAt least 5 years of experience in Software Engineering or AI Engineering.Strong programming skills in Python, Java or Go.Hands-on experience with LLM, Generative AI, RAG, Prompt Engineering, embedding and vector search.Strong experience with Agentic AI, tool calling and agent orchestration.Proven experience designing and implementing production-grade AI architecture.Strong knowledge of APIs, microservices and distributed systems.Experience with at least one cloud platform: AWS, Azure or GCP.Hands-on experience with Docker, Kubernetes and CI/CD.Good understanding of LLM Evaluation, Guardrails and Observability.Strong understanding of scalability, latency, security, monitoring and cost optimization for AI systems.Experience in technical leadership, architecture decisions, code review and mentoring.Experience with LangChain, LangGraph, LlamaIndex, CrewAI, AutoGen or equivalent frameworks is an advantage.Experience in Banking, Financial Services or Fintech is an advantage.POSITION 3: AI SPECIALISTJOB DESCRIPTIONAct as the bridge between business teams and the AI engineering team.Work with stakeholders to identify business pain points and define valuable, feasible AI use cases.Analyze business requirements and translate them into AI product requirements, workflows and acceptance criteria.Design AI Chatbots and AI Agents, including workflows, tools, orchestration and human approval mechanisms.Develop, tune and optimize system prompts and task-specific prompts.Design and implement RAG solutions, knowledge bases, metadata structures and document collections.Define LLM evaluation approaches, including golden datasets, evaluation metrics, pass rates and benchmarking.Design guardrails, AI safety controls and data access policies.Support API integration by reviewing API specifications, OpenAPI/Swagger documentation and JSON structures.Coordinate with AI Engineers, Business Analysts and Quality Engineers during development, testing and production deployment.Monitor AI output quality and recommend improvements to prompts, retrieval logic, knowledge data and agent workflows.Evaluate the business value, risks and expected ROI of AI use cases.REQUIREMENTS3–5 years of experience as a Business Analyst, Consultant, AI Specialist or in a similar role.Experience participating in at least one AI Chatbot or AI Product implemented for real users.Strong experience in Prompt Engineering, including system prompts, prompt tuning and prompt optimization.Good understanding and hands-on experience with RAG.Experience building or managing knowledge bases, metadata and document collections.Understanding of LLM Evaluation, including golden datasets, metrics, pass rates and benchmarking.Ability to design AI Agents, including workflows, tools, orchestration and human approval.Ability to understand API documentation, OpenAPI/Swagger and JSON.Basic SQL knowledge.Understanding of guardrails, AI safety and data access policies.Proficiency in Jira, Confluence and Excel or Power BI.Strong analytical, stakeholder management and communication skills.NICE TO HAVEExperience with LangChain, LangGraph, CrewAI or AutoGen.Experience with Azure OpenAI, Azure AI Foundry, AWS Bedrock or Vertex AI.Experience with Azure AI Search, Pinecone, Weaviate or Milvus.Understanding of NIST AI RMF or the EU AI Act.Experience in Banking, Finance, Aviation or Real Estate.BENEFITSTraining and career development opportunities.Compensation package: up to 14 months’ salary/year + Project bonus (if any).Extra package: 16 million VND/employee/year (bonuses for Tet, New Year, Birthday, CMC Corp’s Birthday, 2/9, Mid-Autumn, etc.).Salary review: 2 times/year or based on excellent performance.Opportunity to work with newest technology trends and develop your career in an international environment, building large-scale & global software products.Onsite opportunities: short-term and long-term assignments in US, EU, Asia.Paid annual leave: 12 days/year + birthday gift.Full benefits under Vietnamese labor law plus CMC Global’s benefits (PTI premium healthcare, company trip, holidays, year-end party, etc.).Exciting leisure activities: football club, family day, happy hour, art/sport events.Working hours: 8 hours/day (Mon–Fri), flexible time (check-in 8:00–9:00, check-out 17:00–18:00).