This commit is contained in:
2025-03-15 08:29:33 +07:00
parent 323c232121
commit 83ef7d52b2

View File

@@ -406,6 +406,8 @@ function evaluator(state::T1, text2textInstructLLM::Function
For example: For example:
- 0 indicates that both the trajectory is incorrect, failed or errors and the observation is incorrect or failed - 0 indicates that both the trajectory is incorrect, failed or errors and the observation is incorrect or failed
- 4 indicates that the trajectory are correct but the observation is incorrect or failed - 4 indicates that the trajectory are correct but the observation is incorrect or failed
- 5 indicates that the trajectory are correct, but no results are returned.
- 6 indicates that the trajectory are correct, but the observation's content doesn't directly answer the question
- 8 indicates that both the trajectory are correct, and the observation's content directly answers the question. - 8 indicates that both the trajectory are correct, and the observation's content directly answers the question.
- 9 indicates a perfect perfomance. Both the trajectory are correct, and the observation's content directly answers the question, surpassing your expectations. - 9 indicates a perfect perfomance. Both the trajectory are correct, and the observation's content directly answers the question, surpassing your expectations.
5) Suggestion: if accepted_as_answer is "No", provide suggestion. 5) Suggestion: if accepted_as_answer is "No", provide suggestion.