GitHub - mrorii/tabebot: tabelog crawler · GitHub
Skip to content

mrorii/tabebot

Folders and files

Repository files navigation

tabebot

A minimal crawler for tabelog, written on top of Scrapy

Quick Usage

git clone https://github.com/mrorii/tabebot.git && cd tabebot
pip install -r requirements.txt
# Modify `USER_AGENT` in tabebot/settings.py

scrapy crawl tabebot

This will start writing out scraped results to:

  • business.json
  • review.json
  • user.json

in the working directory.

Crawl responsibly.

Screenshot

Example output:

About

tabelog crawler

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

Contributors

Languages