New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

scientific data management #40

Open

ynikitenko opened this issue Aug 5, 2024 · 0 comments

Labels

2024

ynikitenko commented Aug 5, 2024

This is not directly connected to Python, but

data management is an important part of data analysis,
Python is a general purpose high-level language that is helpful with managing data. The author is making a presentation about managing files with a wrapper around rsync written in Python.
HSF has no dedicated group for "data management" (at least what I could find in its GitHub).

Discussion topics:

data storage. File system vs database vs...
data management (synchronisation, versions, ...). Working on one cluster vs (sustainably) copying part of the data to a local cluster / computer / etc.

eduardo-rodrigues added the 2024 label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment