Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

run script to create eval data files for past weeks and upload to s3 #10

Open
elray1 opened this issue Nov 13, 2024 · 1 comment
Open

Comments

@elray1
Copy link
Contributor

elray1 commented Nov 13, 2024

Here is a quick script I have used for this before.

# This script generates predictions for the gbq_qr_hhs_only model for all reference dates.
# Retrospective model fits are generated using the data that would have been available in
# real time.
#
# To maintain transparency about which model outputs were and were not generated in
# real time, these model outputs are stored in flusion/retrospective-hub.

# This script should be run with code/gbq as the working directory:
# python retrospective-experiments/gbq_qr_hhs_only.py

import os
import datetime
from multiprocessing import Pool


def run_command(command):
    """Run system command"""
    os.system(command)


missing_dates = [
    (datetime.date(2024, 10, 7) + datetime.timedelta(-i * 7)).isoformat() \
        for i in range(77)]
missing_dates

output_root = '../../retrospective-hub/model-output'

commands = [f'uv run get_covid_clade_counts.py --as-of={date}' \
                for date in missing_dates]

for command in commands:
    run_command(command)
@elray1
Copy link
Contributor Author

elray1 commented Nov 13, 2024

I (Evan) may need to do the actual s3 upload for these files.

@elray1 elray1 changed the title run script to create intermediate data files and upload to s3 run script to create eval data files for past weeks and upload to s3 Nov 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant