Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cortex support Jinja2 template #1882

Open
1 task
TC117 opened this issue Jan 22, 2025 · 0 comments
Open
1 task

Cortex support Jinja2 template #1882

TC117 opened this issue Jan 22, 2025 · 0 comments
Labels
P1: important Important feature / fix

Comments

@TC117
Copy link

TC117 commented Jan 22, 2025

Goal

  • Cortex support Jinja2 template for Deepseek Distill models

Problems

  • We are unable to pick up the chat_template from GGUF file due to Cortex's design
    • GGUF uses a Jinja2 template
    • We currently parse Jinja templates into Cortex's format
    • This causes a lot of compatibility issues

Task

  • Cortex can parse Jinja2 templates

Image
@github-project-automation github-project-automation bot moved this to Investigating in Menlo Jan 22, 2025
@TC117 TC117 added the P1: important Important feature / fix label Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
P1: important Important feature / fix
Projects
Menlo
Status: Investigating
Milestone
No milestone
Development

No branches or pull requests
1 participant
@TC117