The program aimed to extract university data and publication scores from the SINTA website using Scrapy. The targeted website is static, and the data is not loaded using JavaScript, which makes Scrapy an appropriate choice due to its efficiency and speed in handling static data on websites. The extracted data included relevant data such as the university's name, location, and publication scores. The data was saved in CSV format for further processing and analysis.
URL: https://sinta.kemdikbud.go.id/affiliations
Website:
Scrapy Documentation https://scrapy.org/
pip install scrapy
pip3 install scrapy
scrapy runspider scraper.py
scrapy runspider scraper.py -o data.csv
scrapy runspider scraper.py -o data.json