Research program D

Evaluation science and reproducibility

Rigorous ways to measure and compare AI systems, including the methods ALGEDI applies to its own work.

A result is only as strong as the instrument that produced it. This program designs and validates those instruments: rubrics, controls, failure taxonomies and replication packages. It also holds ALGEDI’s own publications to the same standard.

Open questions

  1. What makes a behavioral benchmark valid for the claim it is used to support?
  2. How stable is a measured result across repeated trials and across model versions?
  3. Which controls distinguish a genuine failure from an artifact of the test itself?

Research in this program

ALG-002
Publication status: Research question

Agent completion verification

When an agent reports that a task is complete, how often does independent evidence agree? This entry frames the question and the checks that would settle it. It reports no results.

  • Program B · Agentic execution
  • Program D · Evaluation methodology
  • No artifacts yet
ALG-003
Publication status: Research question

Post-hoc explanation and decision consistency

When a model explains a decision after making it, does the explanation match the evidence that was available to justify the decision? This entry defines the question without any claim about hidden internal reasoning. It reports no results.

  • Program A · AI behavior and reliability
  • Program D · Evaluation methodology
  • No artifacts yet
ALG-004
Publication status: Research question

Evaluating AI-generated educational content

A rubric-based approach to judging AI-generated learning material for correctness, curriculum alignment, level appropriateness, answer-key accuracy and instructional quality. This entry defines the question. It reports no results and no model comparison.

  • Program D · Evaluation methodology
  • No artifacts yet