Skip to content

Commit

Permalink
Incorporate feedback from review
Browse files Browse the repository at this point in the history
  • Loading branch information
sandbergja committed Dec 19, 2023
1 parent 5589b79 commit 98d1f0e
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions docs/indexing.md
Original file line number Diff line number Diff line change
Expand Up @@ -95,10 +95,10 @@ Takes 6-7 hours to complete.
If needed, [use the SCSB API to request new full dump records from the system to be generated into the SCSB bucket](./scsb/request_full.md).
If needed, [pull the most recent SCSB full dump records into dump files](./scsb/dump_files.md).
Then, if needed, [pull the most recent SCSB full dump records into dump files](./scsb/dump_files.md).
This is only necessary if the most recent "Full Partner ReCAP Records" is missing files, or if
the monthly process hasn't run for a while and there is no recent event of this type.
Note that this process takes 24 hours, and you can't deploy in the middle of the process.
Note that this process takes 12 hours, and you can't deploy in the middle of the process.
Once the files are all downloaded and processed, index them with
Expand Down
2 changes: 1 addition & 1 deletion docs/scsb/dump_files.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,5 +9,5 @@ CTRL+b d (to detach from tmux)
```
This kicks off an import job which will return immediately. This can be monitored in [sidekiq busy queue](https://bibdata.princeton.edu/sidekiq/busy) or [sidekiq waiting queue](https://bibdata.princeton.edu/sidekiq/queues/default)

Takes 24-25 hours to complete. As they download and unpack they will be placed
Takes 11-12 hours to complete. As they download and unpack they will be placed
in `/tmp/updates/` and as they are processed they will be moved to `/data/bibdata_files/scsb_update_files/`; you can follow the progress by listing the files in these directories. You can also find the most recent Full Partner ReCAP Records from [the events page](https://bibdata.princeton.edu/events), and look at the dump files in its json. Be sure not to deploy bibdata in the middle of this job, or else the job will have to start all over again from the beginning.

0 comments on commit 98d1f0e

Please sign in to comment.