Scientific Chemistry (Python, AI Evaluation)

About UsGramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.Role OverviewWe are looking for a scientific computing professional to contribute to an advanced AI training initiative focused on developing rigorous STEM coding datasets. The project involves creating and validating complex chemistry problems that help train and evaluate frontier AI models. You will be responsible for scientific problem design, Python implementation, and rigorous quality validation, ensuring that every task meets strict standards for scientific correctness, determinism, and evaluation performance.CONTRACT: Short-term freelanceCOMMITMENT: Hourly - up 40 40h/weekLOCATIONS: Remote - Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Kenya, Nigeria, Turkey, VietnamNOTE: Must have published research or academic project experience in a STEM domain.ResponsibilitiesDesign scientific coding tasks consisting of one main chemistry problem and at least 3 logically connected, progressively structured sub-problemsDevelop verified golden solutions in Python with complete unit test coverageCreate discriminative test cases that distinguish correct from incorrect AI-generated outputsExecute quality control validation through the Central Task Platform (CTP), including Tier 1 structural checks and Tier 2 quality rubricsIterate on task specifications, implementations, and test cases based on QC feedbackOptimize tasks to meet Pass@K evaluation criteria across multiple LLM judges, including GPT, Gemini, and NemotronEnsure scientific correctness, determinism, well-posedness, and adherence to project quality standardsMaintain high first-submission quality and minimize rework, targeting consistent L1 approvalParticipate in review meetings, feedback sessions, and project standups during required overlap hoursRequirementsMaster's degree or PhD in ChemistryStrong Python programming skills with experience in scientific computingExperience using scientific Python libraries such as NumPy, SciPy, SymPy, or relevant domain-specific toolsAbility to formulate rigorous scientific problems with clear constraints and expected outputsExperience writing or implementing scientific solutions with unit tests and deterministic outputsPrior experience in AI data annotation, scientific research, or scientific writingFamiliarity with LLM evaluation frameworks, coding benchmarks, or AI-generated code assessmentPublished research or academic project experience involving chemistry or another STEM discipline