This project is an automated scraper for collecting information about food additives using Selenium and Python from https://www.aditivos-alimentarios.com/. It is designed to obtain the database required for the Android app aditivos-alimentarios-app, which allows users to search for food additives and consult their toxicity. The scraper automatically detects installed browsers, manages WebDrivers, and saves the results to a database.
- Automatic detection of installed browsers (Chrome, Firefox, Edge, Safari)
- Automatic installation and management of WebDrivers
- Scraping of food additives data
- Saving results to a database
- Python 3.8+
- A supported browser installed (Chrome, Firefox, Edge, Safari)
- Dependencies listed in
requirements.txt
- Clone this repository:
git clone https://github.com/adamff-dev/food-additives-scraper.git cd food-additives-scraper - Install the dependencies:
pip install -r requirements.txt
Run the main script:
python main.pyThe script will detect the installed browser, install the required WebDriver, and start scraping food additives data from https://www.aditivos-alimentarios.com/.
main.py: Main execution scriptmodules/: Auxiliary modulesWebDriverInstaller.py: WebDriver installer and managerAditivosTools.py: Tools for scraping and saving dataProgressBar.py,SharedTools.py: Additional utilities
MIT