Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: support metadata output from LLM #266

Open
kdziedzic68 opened this issue Jan 2, 2025 · 2 comments
Open

feat: support metadata output from LLM #266

kdziedzic68 opened this issue Jan 2, 2025 · 2 comments
Assignees
@kdziedzic68
Labels
feature New feature or request priority Top priority issue
Milestone
Ragbits 0.7

Comments

@kdziedzic68
Copy link
Collaborator

Feature description

Implement generate_with_metadata method for LLM classes.

The method would return pydantic model with text output and metadata.

Motivation

We have been requested to return log probs from LLM - the amount of work for generic version is almost the same

Additional context

No response
@kdziedzic68 kdziedzic68 added the feature New feature or request label Jan 2, 2025
@kdziedzic68 kdziedzic68 self-assigned this Jan 2, 2025
@ludwiktrammer ludwiktrammer moved this to In Progress in ragbits Jan 2, 2025
@ludwiktrammer ludwiktrammer added this to the Ragbits 0.7 milestone Jan 2, 2025
@micpst
Copy link
Collaborator

micpst commented Jan 2, 2025

related to #261

@micpst
Copy link
Collaborator

micpst commented Jan 2, 2025

does it have to be separate method? i think we can add metadata to the current generate method implementation

@ludwiktrammer ludwiktrammer added the priority Top priority issue label Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kdziedzic68 kdziedzic68

Labels
feature New feature or request priority Top priority issue
Projects
ragbits
Status: In Progress
Milestone
Ragbits 0.7
Development

No branches or pull requests
3 participants
@ludwiktrammer @micpst @kdziedzic68