Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change success rate calculation #2349

Open
manumoreira opened this issue Jul 2, 2024 · 0 comments
Open

Change success rate calculation #2349

manumoreira opened this issue Jul 2, 2024 · 0 comments

Comments

@manumoreira
Copy link
Contributor

The current success rate calculation is not accurate, and impacts negatively in the way the survey broker (SB) works.
The typical use case is: a survey starts with Initial success rate at 0.5% and a target of 100. The SB calculates a huge Batch Size 200000. After one day of survey the survey gets 10 completed and 15 exhausted respondents (the 10 completes, plus 5 extra refused/failed/noneligible), then the Actual Success Rate is 66%, then the Estimated Success rate (ESR) is 6.7% (134 times bigger than the ISR) and consequently the batch size drops from 200000 to 1341. The SB already activated +10.000 respondents by now, which it won’t “deactivate”.

@manumoreira manumoreira moved this to To do in Dev sprints 24-25 Jul 19, 2024
@manumoreira manumoreira moved this from To do to On hold in Dev sprints 24-25 Jan 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: On hold
Development

No branches or pull requests

1 participant