Skip to content

HuggingFace Provider: Embeddings #167

Description

@Kamilbenkirane

Sub-issue of #148

Scope

Add embeddings via HuggingFace's hf-inference feature-extraction endpoint.

  • Endpoint: POST https://router.huggingface.co/hf-inference/models/{model_id}/pipeline/feature-extraction
  • Request: {"inputs": "text"}
  • Response: JSON [[float, ...]]
  • Auth: Authorization: Bearer hf_XXX via HF_TOKEN
  • Streaming: Not supported

Files

Create: src/celeste/modalities/embeddings/providers/huggingface/
Modify: src/celeste/modalities/embeddings/providers/__init__.py, src/celeste/modalities/embeddings/models.py

Shares the HuggingFaceInferenceClient mixin created in the Image Generation sub-issue.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions