The original splits over UniRef50 can be found in the original repo. Using a subset of them, need to compute either:
- the randomized masking perplexity
- the pseudo-perplexity with exhaustive single-token masking
Will likely do the former for computational efficiency.
The original splits over UniRef50 can be found in the original repo. Using a subset of them, need to compute either:
Will likely do the former for computational efficiency.