Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
irony authored Feb 15, 2024
1 parent 9f08cdd commit 7648e3e
Showing 1 changed file with 8 additions and 8 deletions.
16 changes: 8 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ This is the main repo for fetching data from sources and adding them to our data

## Current Status

First working prototype for pipeline but doesn't work on large PDF files yet.
Test the app in Discord channel #rapporter-att-granska by using the command /pdf <url> and Garbo will be answering with a parsed JSON

## Data Flow

Expand All @@ -19,7 +19,7 @@ Some of the following steps will be performed in parallel and most will be async
5. Build query from prompt together with relevant embeddings
6. Send to LLM
7. Verify the results first automatically
8. Verify results in Discord channel (separate PR #2)
8. Verify results in Discord channel
9. Save to Wikidata or other database (not done)

### Get Started
Expand All @@ -37,11 +37,11 @@ NOTE: To add a new job to the queue manually you can uncomment the lines in inde

Create a .env file in the root lib and add these tokens/secrets before running the application:

OPENAI_API_KEY=
OPENAI_ORG_ID=
DISCORD_APPLICATION_ID=
DISCORD_TOKEN=
DISCORD_SERVER_ID=
OPENAI_API_KEY=
OPENAI_ORG_ID=
DISCORD_APPLICATION_ID=
DISCORD_TOKEN=
DISCORD_SERVER_ID=

### Next steps / Tasks

Expand All @@ -51,7 +51,7 @@ DISCORD_SERVER_ID=
- [x] Split PDF text into smaller chunks (maybe using langchain pdf instead of custom?)
- [x] Add chunks to vector database (ChromaDB)
- [x] Use vector database with langchain when doing queries to limit amount of tokens
- [ ] DevOps/Kubernetes setup for databases and deployment
- [x] DevOps/Kubernetes setup for databases and deployment (see [https://github.com/Klimatbyran/infra](infra) repo - private)
- [ ] Tests etc

### Operations
Expand Down

0 comments on commit 7648e3e

Please sign in to comment.