Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bbc parser optimization #38

Merged
merged 20 commits into from
Dec 17, 2024
Merged

Bbc parser optimization #38

merged 20 commits into from
Dec 17, 2024

Conversation

unenglishable
Copy link
Collaborator

No description provided.

handle_info will receive asynchronously and print when parsers have
started
can be reused later by batch processing functions
extracts bodies and signatures as lists from post

will be processed later as a batch
uses a single process to parse all posts/signatures for a thread page
split genserver and poolboy timeouts

reduce receive timeout to ensure quick loading
don't allow call to go over half a second
@akinsey akinsey merged commit 9c844d6 into main Dec 17, 2024
4 checks passed
@akinsey akinsey deleted the bbc-parser-optimization branch December 17, 2024 20:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants