-
Notifications
You must be signed in to change notification settings - Fork 68
Open
Description
Greetings!
I'm attempting to use models from Hugging Face but run into the same error regardless of what model I try. Here is an example:
$ docker model run hf.co/unsloth/Qwen3-4B-GGUF "model info"
Unable to find model 'hf.co/unsloth/Qwen3-4B-GGUF' locally. Pulling from the server.
f6f851777709: Pull complete [==================================================>] 2.497GB/2.497GB
Model pulled successfully
Failed to generate a response: error response: status=404 body=error while getting model: get model '"hf.co/unsloth/qwen3-4b-gguf"': model not found
This could be related to #461.
I'm not sure if this is due to a lack of understanding on my part, or a bug, I'd appreciate any feedback.
Metadata
Metadata
Assignees
Labels
No labels