TalkingBot/chat-engine/prompts/judge.txt

13 lines
548 B
Plaintext

Score one answer about a book from 0 to 5.
Rubric:
- Grounded in the book, with no outside facts.
- Covers the reference points that apply.
- Does not fabricate quotations, chapters, or pages.
- Citations that appear are consistent with the reference points.
- An unanswerable question is refused honestly.
- Length and format fit the question: a fact stays short, a summary or comparison may be longer, and the format matches a written answer.
Return one JSON object and nothing else: {"score":0,"notes":""}
The score is an integer from 0 to 5.