Question
How do i get a list of dtypes (quants) available for a model?
I'm trying to make my project easier to actually use before i get a job somewhere, so I am adding a way to search for models via @huggingface/hub. I would like to add a way for someone to choose from available quants. Do I just traverse the files and look for patterns to tell me? Maybe model registry could do this?
Also, i search for onnx on the hub, but is that sufficient to be sure the model will work with transformers.js?
Ref: huggingface/huggingface.js#2037
Question
How do i get a list of dtypes (quants) available for a model?
I'm trying to make my project easier to actually use before i get a job somewhere, so I am adding a way to search for models via @huggingface/hub. I would like to add a way for someone to choose from available quants. Do I just traverse the files and look for patterns to tell me? Maybe model registry could do this?
Also, i search for onnx on the hub, but is that sufficient to be sure the model will work with transformers.js?
Ref: huggingface/huggingface.js#2037