diff --git a/src/interface.jl b/src/interface.jl index 845d217..87b1c8d 100644 --- a/src/interface.jl +++ b/src/interface.jl @@ -406,6 +406,8 @@ function evaluator(state::T1, text2textInstructLLM::Function For example: - 0 indicates that both the trajectory is incorrect, failed or errors and the observation is incorrect or failed - 4 indicates that the trajectory are correct but the observation is incorrect or failed + - 5 indicates that the trajectory are correct, but no results are returned. + - 6 indicates that the trajectory are correct, but the observation's content doesn't directly answer the question - 8 indicates that both the trajectory are correct, and the observation's content directly answers the question. - 9 indicates a perfect perfomance. Both the trajectory are correct, and the observation's content directly answers the question, surpassing your expectations. 5) Suggestion: if accepted_as_answer is "No", provide suggestion.