Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add base data migration #521

Open
theferrit32 opened this issue May 9, 2022 · 0 comments
Open

Add base data migration #521

theferrit32 opened this issue May 9, 2022 · 0 comments

Comments

@theferrit32
Copy link
Contributor

This task is to create a migration file in cloud storage that only contains base data. This enables loading a genegraph instance with the base data without needing to redownload and load those files into Jena.

For kubernetes deployments using this migration as GENEGRAPH_DATA_VERSION environment variable, in order to reload the stream data upon redeployment of a new code version, the commit or image hash needs to be included in the /data/ directory path so they do not collide. Right now they don't collide (at least in staging) because those cloudbuilds update the GENEGRAPH_DATA_VERSION variable in the architecture repo to include the image hash, under the assumption that all deployments will create a migration file with the image hash in the filename, in a helm hook prior to being deployed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant