Configuration file

The config file is located in the same place where Python installs the package. This file allows you to define all static paths and initially looks like this:

{
    "hf_repo_id": "thuerey-group/pbdl-dataset", // hugging face repository
    "local_datasets_dir": "./",                 // where local datasets are stored
    "global_dataset_dir": "./datasets/",        // where global datasets are cached
    "dataset_ext": ".hdf5"
}

For added flexibility, all settings in the configuration file can be overwritten by specifying the corresponding arguments when creating a Dataloader instance.

dataset = Dataloader(
    "my-dataset",
    time_steps=10,
    local_datasets_dir="./local_datasets/" # overwrite config
)