Skip to content

Commit

Permalink
feat(scrape_pacer_free): log number of documents requiring OCR
Browse files Browse the repository at this point in the history
  • Loading branch information
quevon24 committed Aug 8, 2024
1 parent 7190f22 commit 459084b
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -327,6 +327,7 @@ def ocr_available(queue: str, index: bool) -> None:
.order_by()
)
count = rds.count()
logger.info(f"Total documents requiring OCR: {count}")
throttle = CeleryThrottle(queue_name=q)
for i, pk in enumerate(rds):
throttle.maybe_wait()
Expand Down

0 comments on commit 459084b

Please sign in to comment.