How do you evaluate the three benchmarks?
For example, benchmarks like LongBench v2 do not come with built-in chunks, but I found that the model still generates ref_chunks in the model responses under your eval_results folder. Does additional preprocessing (such as adding chunk tags to the original text) need to be performed during evaluation? If so, could you please provide the corresponding script? Thank you!
How do you evaluate the three benchmarks?
For example, benchmarks like LongBench v2 do not come with built-in chunks, but I found that the model still generates ref_chunks in the model responses under your eval_results folder. Does additional preprocessing (such as adding chunk tags to the original text) need to be performed during evaluation? If so, could you please provide the corresponding script? Thank you!