Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade to psycopg3 for performance increases #10258

Open
RayBB opened this issue Jan 3, 2025 · 0 comments · May be fixed by #10259
Open

Upgrade to psycopg3 for performance increases #10258

RayBB opened this issue Jan 3, 2025 · 0 comments · May be fixed by #10259
Labels
Affects: Database Lead: @mekarpeles Issues overseen by Mek (Staff: Program Lead) [managed] Priority: 3 Issues that we can consider at our leisure. [managed] State: Blocked Work has stopped, waiting for something (Info, Dependent fix, etc. See comments). [managed] Theme: Performance Issues related to UI or Server performance. [managed] Type: Feature Request Issue describes a feature or enhancement we'd like to implement. [managed]

Comments

@RayBB
Copy link
Collaborator

RayBB commented Jan 3, 2025 •
edited
Loading

Proposal

Related to #6052
Also related to the performance discussion https://internetarchive.slack.com/archives/C0ETZV72L/p1735828712694179

A relevant reddit thread:

if you are using psycopg2 already and want to go async, it should be straightforward to upgrade to psycopg3

Impressive benchmarks:

What's different:
https://www.psycopg.org/psycopg3/docs/basic/from_pg2.html

Requires Postgres 10, as such it is
Blocked by #5675

Justification

No response

Breakdown

Requirements Checklist

  • [ ]

Related files

Stakeholders

Instructions for Contributors

Please run these commands to ensure your repository is up to date before creating a new branch to work on this issue and each time after pushing code to Github, because the pre-commit bot may add commits to your PRs upstream.
@RayBB RayBB added Type: Feature Request Issue describes a feature or enhancement we'd like to implement. [managed] Needs: Breakdown This big issue needs a checklist or subissues to describe a breakdown of work. [managed] Needs: Triage This issue needs triage. The team needs to decide who should own it, what to do, by when. [managed] Needs: Lead labels Jan 3, 2025
@RayBB RayBB linked a pull request Jan 3, 2025 that will close this issue
Draft
@RayBB RayBB changed the title Consider upgrading to psycopg3 for performance increases Upgrade to psycopg3 for performance increases Jan 4, 2025
@RayBB RayBB added State: Blocked Work has stopped, waiting for something (Info, Dependent fix, etc. See comments). [managed] Theme: Performance Issues related to UI or Server performance. [managed] labels Jan 4, 2025
@mekarpeles mekarpeles added Priority: 3 Issues that we can consider at our leisure. [managed] Lead: @mekarpeles Issues overseen by Mek (Staff: Program Lead) [managed] Affects: Database and removed Needs: Triage This issue needs triage. The team needs to decide who should own it, what to do, by when. [managed] labels Jan 6, 2025
@mekarpeles mekarpeles added this to the 2025 (Provisional) milestone Jan 6, 2025
@mekarpeles mekarpeles removed this from the 2025 (Provisional) milestone Jan 6, 2025
@mekarpeles mekarpeles removed the Needs: Breakdown This big issue needs a checklist or subissues to describe a breakdown of work. [managed] label Jan 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Affects: Database Lead: @mekarpeles Issues overseen by Mek (Staff: Program Lead) [managed] Priority: 3 Issues that we can consider at our leisure. [managed] State: Blocked Work has stopped, waiting for something (Info, Dependent fix, etc. See comments). [managed] Theme: Performance Issues related to UI or Server performance. [managed] Type: Feature Request Issue describes a feature or enhancement we'd like to implement. [managed]
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

upgrade to psycgopg3 internetarchive/openlibrary
2 participants
@RayBB @mekarpeles