Research question
Can a rubric for AI-generated educational content achieve acceptable agreement between independent raters, and, under equivalent generation conditions, how do systems differ on it?
Why this question
Generated learning material can be fluent and still wrong: an incorrect answer key, a mismatch with the curriculum level, or an exercise that does not teach what it claims to. Those failures matter more than style, and they need a rubric that independent raters apply consistently.
Rubric dimensions under consideration
- Factual or linguistic correctness
- Curriculum alignment
- Level appropriateness
- Answer-key correctness
- Instructional quality
Conditions for any comparison
Model comparisons will be published only after every system is tested under equivalent conditions: the same prompts, inputs, curriculum targets and scoring procedure, with versions and dates recorded.
Hypothesis
Unavailable No formal hypothesis is registered yet.
Method
Unavailable The rubric and protocol have not been published.
Results
Unavailable No evaluation has been run. No comparison between models is implied.
Revision history
- Entry created as a research question.
Cite this entry
Sai Bharath Siliveri (2026). Evaluating AI-generated educational content. ALGEDI SI Research Labs, ALG-004, research question, revision of 2026-10-15. https://algedi.si/research/educational-content-evaluation/