Skip to content

HF model not found after model pulled successfully #488

@brl0

Description

@brl0

Greetings!

I'm attempting to use models from Hugging Face but run into the same error regardless of what model I try. Here is an example:

$ docker model run hf.co/unsloth/Qwen3-4B-GGUF "model info"
Unable to find model 'hf.co/unsloth/Qwen3-4B-GGUF' locally. Pulling from the server.
f6f851777709: Pull complete [==================================================>]  2.497GB/2.497GB
Model pulled successfully
Failed to generate a response: error response: status=404 body=error while getting model: get model '"hf.co/unsloth/qwen3-4b-gguf"': model not found

This could be related to #461.

I'm not sure if this is due to a lack of understanding on my part, or a bug, I'd appreciate any feedback.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions