Somewhat Higher PPL Running on 4*A10

[Frederick666666]

Hi, Thank you for your work.
When running wiki103 gpt2 baseline and corresponding InRank pretraining experiments on 4*A10,
the final evaluation performance of PPL is a bit higher. Does the running machine affect the running results?

[jiaweizzhao]

It's possible that the underlying machine and precision affects the results. Can you share with us the details of your setup and scripts? We would be happy to help further.