AI Infrastructure Architect

ENGAGEMENT: Full-timeWORK MODE: Onsite - Riyadh, Saudi ArabiaJOB DESCRIPTION:Key ResponsibilitiesDesign on-premise architecture for managing LLMs and GPU infrastructure with minimum cost and maximum efficiency.Produce High-Level Designs (HLDs) and Low-Level Designs (LLDs) for each AI/agentic use case.Determine which LLM(s) should be used for a given use case and define the right-fit approach per scenario.Define GPU parallelisation strategy – how models and workloads should be split across available GPU resources.Design agent orchestration patterns for how multiple AI agents should coordinate and communicate within the client's infrastructure.Partner closely with the MLOps/LLMOps Engineer, who will operationalize the architectures this role designs – clear separation: this role designs, MLOps/LLMOps runs.Must-Have QualificationsProven experience architecting on-premise AI/ML infrastructure – this is not a cloud-architecture role at this stage of the engagement.Strong understanding of GPU infrastructure, including parallelization techniques for LLM workloads.Experience designing agent orchestration approaches for multi-agent generative AI systems.Ability to produce clear HLD/LLD documentation that operations teams can execute against.Comfort working in a highly regulated, on-premise-first environment (no cloud infrastructure is currently in use for this engagement).Nice-to-HavePrior architecture experience within banking or financial services.Familiarity with regulatory/compliance constraints affecting infrastructure design in BFSI environments.Experience advising on cloud-migration-readiness architecture (client anticipates future migration once regulatory approval is granted).Working ArrangementThis role requires regular on-site presence given the level of stakeholder interaction and design collaboration required, and is structured as a full-time on-site posting.ABOUT USHyper Lychee Labs is an IT services and consulting company committed to delivering innovative and impactful solutions to a diverse client base, including Fortune 500 companies, the Government of India, and forward-thinking startups. With a focus on leveraging technology for transformation, the company provides custom software development, complex systems implementation, and strategic consulting. Our team of talented professionals collaborates to ensure exceptional results tailored to clients’ needs. Dedicated to fostering a culture of creativity, diversity, and inclusion, Hyper Lychee Labs strives to empower businesses to thrive in a rapidly evolving world.