modal_type

vaidehiBhamare changed pull request status to closed
vaidehiBhamare changed pull request status to open

I cannot run this branch. I receive an error:

{
    "timestamp": "2025-09-21T14:53:49.699583Z",
    "level": "WARN",
    "message": "`modules.json` could be downloaded but parsing the modules failed: unknown variant `custom_st.Transformer`, expected one of `sentence_transformers.models.Dense`, `sentence_transformers.models.Normalize`, `sentence_transformers.models.Pooling`, `sentence_transformers.models.Transformer` at line 6 column 35; so no Dense modules will be downloaded.",
    "target": "text_embeddings_backend",
    "filename": "backends/src/lib.rs",
    "line_number": 737,
    "span": {
        "name": "download_dense_modules"
    },
    "spans": [
        {
            "name": "download_dense_modules"
        }
    ]
}
{
    "timestamp": "2025-09-21T14:53:49.699603Z",
    "level": "INFO",
    "message": "Dense modules downloaded in 386.988361ms",
    "target": "text_embeddings_backend",
    "filename": "backends/src/lib.rs",
    "line_number": 433
}
{
    "timestamp": "2025-09-21T14:53:49.699677Z",
    "level": "ERROR",
    "message": "Could not start Candle backend: Could not start backend: Model is not supported\n\nCaused by:\n    unknown variant `rotary`, expected one of `absolute`, `alibi`, `rope`",
    "target": "text_embeddings_backend",
    "filename": "backends/src/lib.rs",
    "line_number": 448
}

do you know the fix?

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment