shackleton scraper todo Check files in the output directory and don't redownload files (in the event that the process stops and restarts)