Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[model:performance] Experiment with including bugs with their performance impact is none in the training set only #3901

Open
suhaibmujahid opened this issue Dec 6, 2023 · 1 comment
Open

[model:performance] Experiment with including bugs with their performance impact is none in the training set only #3901

suhaibmujahid opened this issue Dec 6, 2023 · 1 comment

Comments

@suhaibmujahid
Copy link
Member

suhaibmujahid commented Dec 6, 2023 •
edited
Loading

Yeah, let's do that for now, if it is "none" it should not be considered as a perf bug.

We can file a follow-up issue to investigate using these as performance or not as performance in the training set but excluding them from the test set to see if they have any impact.

Originally posted by @marco-c in #3895 (comment)

Depends on: #3876

See also: #3923
@suhaibmujahid suhaibmujahid mentioned this issue Dec 6, 2023
Merged
@suhaibmujahid suhaibmujahid changed the title [model:performance] Experiment with excluding bugs with their performance impact is none from the training set only [model:performance] Experiment with including bugs with their performance impact is none in the training set only Dec 6, 2023
@suhaibmujahid suhaibmujahid mentioned this issue Dec 13, 2023
Open
@marco-c
Copy link
Collaborator

marco-c commented Nov 14, 2024

Depends on #4407.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@marco-c @suhaibmujahid