GitHub - Hasuzawa/web-crawler: Simple Web Crawler · GitHub

Name		Name	Last commit message	Last commit date
.config		.config
.github		.github
.vscode		.vscode
web_crawler		web_crawler
.editorconfig		.editorconfig
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
main.py		main.py
poetry.lock		poetry.lock
pyproject.toml		pyproject.toml

Repository files navigation

Simple Web Crawler

This is a simple web crawler for scrapping images from a game wiki for machine learning purpose.

For large dataset, cloud storage such as AWS S3 bucket or Google GCP should be considered.

About

Simple Web Crawler

GPL-3.0 license

0 stars

1 watching

Report repository

Releases

Packages

Used by

Contributors

Languages