Skip to content

Commit

Permalink
add oobabooga guide
Browse files Browse the repository at this point in the history
  • Loading branch information
kasumi-1 committed Dec 17, 2023
1 parent d59e666 commit 518aae1
Show file tree
Hide file tree
Showing 2 changed files with 47 additions and 0 deletions.
1 change: 1 addition & 0 deletions docs/SUMMARY.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@
* [Using Coqui](./guides/using-coqui.md)
* [Using LLaVA](./guides/using-llava.md)
* [Using SpeechT5](./guides/using-speecht5.md)
* [Using Oobabooga](./guides/using-oobabooga.md)

## 🌻 Tutorials

Expand Down
46 changes: 46 additions & 0 deletions docs/guides/using-oobabooga.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
---
title: Using Oobabooga
order: 12
---

You can find the full Oobabooga documentation [here](https://github.com/oobabooga/text-generation-webui/wiki).


## Step 1 - Install Oobabooga

```bash
python3 -m venv venv
source venv/bin/activate
# choose correct requirements.txt for your system
pip install -r requirements.txt
# install the openai extension
pip install -r extensions/openai/requirements.txt
```

## Step 2 - Start the server

```bash
python server.py --api
```

## Step 3 - Configure Oobabooga

Open http://127.0.0.1:7860/ in your browser and configure the server.

Make sure you load the model in the "Model" tab.


## Step 4 - Enable the server in the client

Set ChatBot Backend to ChatGPT in the client settings:

```md
settings -> ChatBot -> ChatBot Backend -> ChatGPT
```

Next, set the **OpenAI URL** to `http://localhost:5000`


```md
settings -> ChatBot -> ChatGPT -> OpenAI URL -> http://localhost:5000
```

0 comments on commit 518aae1

Please sign in to comment.