PurePromptOpen workspace

Summarization Quality Checklist

Copied 5

Checklist for verifying an AI-generated summary is accurate and actually useful, not just fluent.

Shared by Parshu · Published Aug 1, 2026

eval-checklist

Use this to check a summary an AI produced from a longer source (article, meeting transcript, document, thread). - Does every claim in the summary actually appear in the source — no invented facts, numbers, or conclusions the source doesn't support? - Are the most important points included, not just the ones that were easiest to compress? Check against what you'd have flagged as important yourself. - Is anything materially misleading by omission — a caveat, disagreement, or exception in the source that got dropped, changing the takeaway? - Are numbers, dates, names, and quotes copied accurately, not paraphrased into something subtly different? - Does the summary's tone match the source's actual certainty — presenting a tentative claim as settled fact, or vice versa, is a common failure? - Is it the right length for its purpose — a one-line summary that's actually three paragraphs, or a "brief" that omits something you needed? - If the source contained multiple viewpoints or a disagreement, does the summary represent that, or silently pick one side? If you haven't read the full source yourself, treat the summary as unverified rather than trusted — spot-check at least the parts that matter most before acting on it.

Discussion

Sign in to leave feedback.

No comments yet — be the first to weigh in.