Monitor scraper with prometheus

[kevinrawal]

Use Prometheus to monitor the scraper.

some examples:

• Success rate
• Unsuccessful scrape
• how often have we blocked
• website traffic visited by our users.

Tasks

• Monitor success and failure rate for scraping.