Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add GH Action workflows for ingest #52

Merged
merged 2 commits into from
Jun 10, 2024
Merged

Add GH Action workflows for ingest #52

merged 2 commits into from
Jun 10, 2024

Conversation

joverlee521
Copy link
Contributor

@joverlee521 joverlee521 commented Jun 7, 2024

Description of proposed changes

  1. The ingest-ncbi GH Action workflow is scheduled to run daily at 10AM PDT so that we get automated updates of the NCBI data.

  2. The ingest-fauna GH Action workflow is available to be run manually as needed whenever new data has been uploaded to fauna.

Outside of this PR, I had to add avian-flu to our supported pathogens to use the short-lived AWS credentials in pathogen-repo-build and added organization secrets RETHINK_AUTH_KEY and RETHINK_HOST to this repo.

Related issue(s)

Resolves #43

Checklist

Automated runs of the ingest workflow for the public NCBI data.
This is scheduled to run daily similar to other pathogen ingests.

We are not running the phylogenetic builds automatically for now since
there are frequent outgroups that need to be manually excluded.
The ingest-fauna workflow is not scheduled to run automatically since
updates to fauna are done manually.

This at least makes it easy to run the workflow via GH Actions instead
of having to do it locally.
@joverlee521 joverlee521 requested a review from a team June 7, 2024 22:06
@joverlee521 joverlee521 merged commit b8de6b2 into master Jun 10, 2024
14 checks passed
@joverlee521 joverlee521 deleted the automate-ingest branch June 10, 2024 22:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Automate ingest via GH Actions
2 participants