Question about SQA result when retaining 64 tokens

[flying-rgb]

I found that SQA results(64 tokens) achieve 69.8, same as retaining 192 tokens.
But I can't get similar results runing your script. I can only get nearly 68.7.

[liuyafeng0609]

我遇到了同样的问题，你最后的结论是什么呢？

[xjiangmed]

I encountered the same problem. Total: 4241, Correct: 1384, Accuracy: 32.63%, IMG-Accuracy: 68.62%