Skip to content

Commit

Permalink
feat: implement inference server by using vllm
Browse files Browse the repository at this point in the history 
Signed-off-by: jerryzhuang <[email protected]>
  • Loading branch information
@zhuangqh
zhuangqh committed Oct 15, 2024
1 parent 1d99028 commit a0db62e
Show file tree
Hide file tree
Showing 4 changed files with 2,047 additions and 335 deletions.
Loading

0 comments on commit a0db62e

Please sign in to comment.