Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement whisper #28

Open
wants to merge 14 commits into
base: main
Choose a base branch
from

Conversation

gonzafirewall
Copy link

Implement whisper in worker
receive the transcriptions request
download file from queenbee
because of whisper dependencies sizes need to change the onefile to onedir because else reach 4gb max size to onefile.

here an example how to test with last openai client.

`from openai import OpenAI
client = OpenAI(api_key="123", base_url="http://localhost:8000/v1")

audio_file= open("audio.mp3", "rb")
transcript = client.audio.transcriptions.create(
model="base",
file=audio_file
)
print(transcript)`

@AtlantisPleb
Copy link

Cool, thanks for this.

Having trouble running poetry install on M2 Mac:

  • Installing triton (2.1.0): Failed

  RuntimeError

  Unable to find installation candidates for triton (2.1.0)

Seeing issues like openai/whisper#683 (comment) and python-poetry/poetry#8673 -- guessing there's some issue with Triton builds not being available for the Mac platform? Does Triton need to be built separately unless you're on Linux?

@gonzafirewall
Copy link
Author

I see that triton dependency were in the project before my changes, but i know that openai-whisper with poetry doesnt work very well. because of that in the build i put poetry run pip install openai-whisper
I don't have access to a macbook environment to test it at this time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants