Skip to content

Fast script for downloading and parsing articles from arxiv. In addition, there is a script for creating triplets.

Notifications You must be signed in to change notification settings

Vloods/arxiv_downloader

Repository files navigation

Arxiv Downloader

Script to download articles from Arxiv. Loads the metadata, PDF and txt files for each article.

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.

Prerequsites

Docker and Docker-compose must be installed for successful launch.

Installing

  1. Download the repository;

  2. You need to add the config.ini file to the configs folder. config.ini example:

     [DEFAULT]
     ACCESS_KEY = <key>
     SECRET_KEY = <key>
    
  3. Open a terminal and go to the repository directory.

     cd <path to repos>
    
  4. Build

     docker-compose build
    
  5. Run

     docker-compose up
    

About

Fast script for downloading and parsing articles from arxiv. In addition, there is a script for creating triplets.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published