Reference-based scoring

/'reh.fer.uhns bayst 'skaw.rihng/ Scoring that compares output to a ground truth/expected output. It works best when "correctness" is well-defined. (noun)

“We use reference-based scoring for extraction tasks with known answers.”

Related Evaluation terms

• Absolute scoring
• Agent
• Alignment
• Annotation schema
• Baseline
• Baseline experiment
• Benchmark
• Calibration
• CI/CD integration
• Coherence
• Confidence interval
• Eval
• Eval harness
• Eval leakage
• Experiment
• Factuality
• Failure mode
• Faithfulness
• Feedback signal
• Groundedness
• Hallucination
• Inter-annotator agreement (IAA)
• LLM-as-a-judge
• Loop
• Model comparison
• Multimodal
• Non-determinism
• Offline evaluation
• Pairwise evaluation
• Pass@k
• Playground
• Quality gate
• RAG (retrieval-augmented generation)
• RAG evaluation
• Reference-free scoring
• Regression testing
• Release criteria
• Remote evaluation
• Rubric
• Safety
• Score distribution
• Scorer
• Semantic failure
• Signal-to-noise ratio
• Task (eval task)
• Toxicity score