Failed to get model weights for url (https://huggingface.co/Alibaba-NLP/gte-large-en-v1.5/resolve/main/pytorch_model.bin)

[JessieLiue]

Model: https://huggingface.co/Alibaba-NLP/gte-large-en-v1.5
When deploying this model, container crashed, and we get below error:
Weights not found: request error: HTTP status client error (404 Not Found) for url (https://huggingface.co/Alibaba-NLP/gte-large-en-v1.5/resolve/main/pytorch_model.bin)
Please help check the model's right weith path.
Thanks!

[alvarobartt]

Hey @JessieLiue thanks for reporting, this is rather odd, are you deploying from Microsoft Foundry Classic i.e., former Azure AI Foundry; or from Azure Machine Learning? Could you share the model URI you're using (including the version), so that I can reproduce? 🙏🏻

I tried with cargo r --release --features candle,metal,http --no-default-features -- --model-id Alibaba-NLP/gte-large-en-v1.5 on https://github.com/huggingface/text-embeddings-inference, as well as the docker run ... counterpart and it worked fine with Text Embeddings Inference v1.9.3, if that helps.