Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: Cortex models list isn't respected #1860

Open
2 of 7 tasks
jagauthier opened this issue Jan 15, 2025 · 2 comments
Open
2 of 7 tasks

bug: Cortex models list isn't respected #1860

jagauthier opened this issue Jan 15, 2025 · 2 comments
Assignees
Labels
type: bug Something isn't working

Comments

@jagauthier
Copy link

Cortex version

1.0.8

Describe the issue and expected behaviour

After downloading a second model,I cannot start it, or reference any of the (correct) models by model ID.

Steps to Reproduce

Download two models.

#cortex models  list
+---------+----------------------------------------+
| (Index) | ID                                     |
+---------+----------------------------------------+
| 1       | llama3.2:3b-gguf-q4-km                 |
+---------+----------------------------------------+
| 2       | bartowski:phi-4-GGUF:phi-4-Q6_K_L.gguf |
+---------+----------------------------------------+

Try to start and stop them.

#cortex models start 2
llama3.2:3b-gguf-q4-km model started successfully. Use `cortex run llama3.2:3b-gguf-q4-km` for interactive chat shell
cortex models start 1
Failed to get model repository branches: cortexso/1
Model 1 not found!
cortex models stop 2
Failed to stop model: {"message":"Model not found: 2"}
cortex models stop 1
Failed to stop model: {"message":"Model not found: 1"}

Screenshots / Logs

No response

What is your OS?

  • Windows
  • Mac Silicon
  • Mac Intel
  • Linux / Ubuntu

What engine are you running?

  • cortex.llamacpp (default)
  • cortex.tensorrt-llm (Nvidia GPUs)
  • cortex.onnx (NPUs, DirectML)

Hardware Specs eg OS version, GPU

No response

@jagauthier jagauthier added the type: bug Something isn't working label Jan 15, 2025
@github-project-automation github-project-automation bot moved this to Investigating in Menlo Jan 15, 2025
@jagauthier jagauthier changed the title bug: [DESCRIPTION] Cortex models list isn't respected bug: Cortex models list isn't respected Jan 15, 2025
@vansangpfiev
Copy link
Contributor

Hi @jagauthier, model ID here means llama3.2:3b-gguf-q4-km or bartowski:phi-4-GGUF:phi-4-Q6_K_L.gguf. So, the correct command should be

cortex models start lama3.2:3b-gguf-q4-km
cortex models stop lama3.2:3b-gguf-q4-km

@jagauthier
Copy link
Author

That makes sense. Except for models start 2 working!

@vansangpfiev vansangpfiev self-assigned this Jan 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
Status: Investigating
Development

No branches or pull requests

2 participants