Assessments Lead

About LearnviaLearnvia is a nonprofit learning collaborative that brings educators and researchers together to improve student success in gateway math courses, the courses that can open the door to degree completion, STEM pathways and high demand careers. By helping more students succeed in these critical courses, Learnvia aims to expand opportunity for students and strengthen the pipeline into fields that drive innovation.Launched by Carnegie Mellon University in 2025 and generously supported by the Gates Foundation, Learnvia turns the science of learning into classroom practice. We pair research based, interactive courseware that is free to students with faculty support, professional learning, peer collaboration and continuous research to strengthen teaching and learning over time. Our Titles span gateway math, beginning with Calculus and growing to include Precalculus and Quantitative Reasoning.The OpportunityAssessment is one of the most requested parts of what we offer instructors. We are building a growing portfolio of assessment initiatives that help instructors understand and support student learning. Each one must stay closely aligned to the courseware students are actually using, and true to how we believe students should be assessed.The Assessment Lead will build and improve our assessment program and be the connective thread between our academic content experts and our software engineering team. Reporting to the Director of Product, this person develops a deep understanding of how Learnvia approaches assessment and makes sure that philosophy, pedagogy and point of view carry through into everything we build. The role combines hands-on work on assessment items and quality with helping Content and Product turn our assessment goals into phased Releases, coordinating pilots and partnerships, and defining what we need to learn before we commit to later phases.This role is ideal for someone who is equally at home improving an individual assessment item, in a conversation about how students demonstrate mathematical understanding, and in a conversation about requirements and Release plans, and who understands that good assessment depends on rigorous content, sound pedagogy and dependable software.Key ResponsibilitiesBuilding the Assessment ProgramLead the design of interactive, auto-graded formative and summative assessments, including homework, quizzes, exam banks, and their algorithmic or randomized variants, aligned to learning objectives.Develop a deep understanding of Learnvia’s research-based, active-learning approach and the science of learning behind our courseware.Set and maintain review standards and quality assurance processes for assessment content.Partner with the Content team so that assessment content reflects our assessment approach and stays aligned to the courseware.Oversee AI-assisted item generation and test bank algorithms, including the tools, prompts, human review, and quality standards that keep generated items accurate and aligned.Coordinate review of assessment content before each Release.Connecting Strategy to DeliveryHelp Content and Product translate our broader assessment goals into phased Releases, instructor workflows and clear decisions about what Learnvia should build or explore with partners.Work between academic content, user experience, and software engineering teams so that what we build reflects our assessment approach, from early requirements through the full development cycle.Translate our assessment approach into clear requirements and acceptance criteria, working with cross team leaders.Review designs, prototypes and builds for fidelity to our assessment pedagogy, and raise gaps early with a proposed path forward.Oversee how assessments work in instructors' LMSs (Canvas, Blackboard, D2L) through LTI, including gradebook sync, compatibility with proctoring and lockdown browsers, accommodations such as extended time, and accessibility.Help each team understand the other’s constraints, so content decisions account for what the software can do and engineering decisions account for how students learn and are assessed.Own delivery plans for assessment Releases, from scope to launch, and manage dependencies across Content and Engineering, tracking milestones and risks and raising each risk early with a proposed mitigation.Report progress to Learnvia leadership and funders on assessment work.Coordinating Pilots and PartnershipsCoordinate assessment pilots with instructors, and use the evidence they produce to refine requirements.Serve as the day to day lead for assessment partners and early access institutions, through to General Availability.Gather instructor and partner feedback and bring it back into the product roadmap.Setting the Learning AgendaCreate a coherent learning agenda that defines what Learnvia needs to learn about item quality, instructor use, delivery, grading, instrumentation and student outcomes before committing to later phases.Make sure pilots and instrumentation capture the evidence that agenda calls for, and bring what we learn back into Release decisions.Ideal CandidateThe ideal candidate is eager to help bring research informed assessment to gateway math. They bring real expertise in assessment, teaching and learning, and postsecondary mathematics, and they appreciate that assessment carries real stakes for students and instructors, and that trust in an assessment product depends on accuracy, alignment and reliability.They are as comfortable improving a single assessment item as shaping a phased plan, and they look for evidence before committing to scale. They are a natural translator between academic and technical teams, able to hold a clear point of view on assessment while respecting the realities of building software. They are comfortable navigating ambiguity in an early stage, mission driven organization. They listen well, follow through, communicate clearly and early, and keep a calm, low drama presence when plans change.QualificationsBachelor’s degree in Mathematics, Education, Assessment and Measurement, Learning Science or a related field required; advanced degree preferred.Strong experience in the field of assessment, such as assessment design, item development, measurement or running assessment programs.Deep grounding in teaching and learning, ideally including classroom teaching experience or work in learning science or instructional design.Experience in postsecondary education, with an understanding of how faculty, departments and institutions make decisions about courses and assessment.5+ years of experience in assessment development, program management or product management, ideally in education technology, higher education or mission driven digital platforms.Experience developing digital assessments or courseware in higher education, edtech, or digital publishing.Demonstrated experience working between academic or content experts and software engineering teams, translating pedagogical goals into requirements a team can build.Experience coordinating pilots or partnerships with instructors, institutions or platform providers, and using evidence to refine requirements.Hands-on experience with assessment content development, including item writing, item bank structure, alignment, review and quality standards; familiarity with tool supported content generation is a plus.Experience working within agile product development, with comfort using Jira or similar tools to plan and track work.Excellent communication and organizational skills, with the ability to manage several priorities at once in a remote environment.Location & SalaryThe salary range for this full time role is $100,000 to $125,000 based on experience and qualifications. This position is remote within the U.S., with a preference for Pittsburgh and approximately 20% travel to meet team members and institutional partners. Learnvia offers a competitive benefits package, including medical, dental, retirement and additional benefits.To Be ConsideredPlease submit your resume via LinkedIn. Applications received by Nov. 13, 2026 will receive priority consideration; the position is open until filled. Our process includes an initial phone screening, interviews with key colleagues, a writing sample, and one final interview. Questions? Contact Michael Puskaric Huang at michael.puskarichuang@learnvia.org.We Encourage You to ApplyDon’t meet every qualification? Research suggests that many talented people, particularly women and people from groups historically underrepresented in education and technology, hesitate to apply unless they meet every listed requirement. At Learnvia, we know that skills are built through many kinds of professional, educational and lived experience. If this role excites you and you believe you could do it well, we encourage you to apply, even if your background doesn’t match every item above.Learnvia is an equal opportunity employer. We welcome applicants of all backgrounds and do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other legally protected characteristic. If you need an accommodation at any point in the application process, please contact michael.puskarichuang@learnvia.org.