Changing the run procedure

Second stage of an experiment is Run, i.e., execution of the experiment.

To create a custom run procedure, a corresponding directory in experiments/ have to be created (see, for example, experiments/parsec). The only required file here is run.py which describes the procedure. Note that in most cases, it does not have to be written from scratch; most of the functionality to build and run benchmarks can be inherited from the Runner abstract class implemented in core/run.py and the user has to specify only those part that differ.

Some variants of the experiment may require setting specific environment variables. For example, AddressSanitizer can be fine-tuned via runtime flags in the ASAN_OPTIONS variable. For this, the user shall add this flag in the corresponding subclass of Environment in environment.py and add this subclass in the list Config.environments in config.py.