Bob 是一款 macOS 平台的翻译和 OCR 软件。

SGLang is a fast serving framework for large language models and vision language models.

📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

🚀🚀🚀 A collection of some awesome public YOLO object detection series projects and the related object detection datasets.

Zotero chat PDF with GPT, ChatGPT, Claude, Gemini, DeepSeek

🚀 DeepSeek-V3大模型逆向API【特长：良心厂商】（官方贼便宜，建议直接走官方），支持高速流式输出、多轮对话，联网搜索，r1深度思考，零配置部署，多路token支持，仅供测试，如需商用请前往官方开放平台。

批量为视频或者音频生成字幕，并可批量将字幕翻译成其它语言。这是一个客户端工具, 跨平台支持 mac 和 windows 系统, 支持百度，火山，deeplx, openai, deepseek, ollama 等多个翻译服务

🚀🚀🚀A collection of some wesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.

RAG-GPT, leveraging LLM and RAG technology, learns from user-customized knowledge bases to provide contextually relevant answers for a wide range of queries, ensuring rapid and accurate information retrieval.

BigCodeBench: Benchmarking Code Generation Towards AGI

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

A Reactive CLI that generates git commit messages with Ollama, ChatGPT, Gemini, Claude, Mistral and other AI

🔥🔥🔥 A collection of some awesome public CUDA, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR and High Performance Computing (HPC) projects.

基于NineAi2.4.2的二开版本，含编译包和整合包，无需授权，全套源码，开箱即用，喜欢的给个Star~

A LLM RAG system runs on your laptop. 大模型检索增强生成系统，可以轻松部署在笔记本电脑上，实现本地知识库智能问答。

💭 一个可二次开发 Chat Bot 对话 Web 端 MVP 原型模板, 基于 Vue3、Vite 6、TypeScript、Naive UI 、UnoCSS 等主流技术构建, 🧤简单集成大模型 API, 采用单轮 AI 问答对话模式, 每次提问独立响应, 无需上下文, 支持打字机效果流式输出, 集成 markdown-it 预览, 💼 易于定制和快速搭建 Chat 类大语言模型产品 (附示例截图)

Free large language model (LLM) support for Neovim, provides commands to interact with LLM (like ChatGPT, ChatGLM, kimi, deepseek, openrouter and local llms). Support Github models.

PowerShell module that enables you to use AI Code Completion in the command line.

这是一个基于 Next.js 构建的多语言 AI 模型评估平台，支持多模型对比和实时流式响应。A multilingual AI model evaluation platform built with Next.js, allowing users to compare responses from multiple models and receive a final judgment.

百聆 是一个类似GPT-4o的语音对话机器人，通过ASR+LLM+TTS实现，时延低至800ms，低配置也可运行，支持打断