This will scrape all professors in a specified university and dump it into one JSON file.
###Requirements:
- Install scrapy
###Usage:
- Go to
rmp_scraper/spiders/rmp_spider.pyand change theuniversityvariable to the university you want to scrape. - In a terminal run this command inside the root folder for this project
rmp-scraper:
$ scrapy crawl rmp_scraper -o output/outputFileName.json
Notes:
Created this before making rmp-api for use with a RateMyProfessor chrome extension.