I have to crawl data from websites to build a regression model.
Do you know any websites good for crawling? please recommend in the comment.
There’s a ton of websites you can crawl through, from ecommerce to blogs; your creativity will be your greatest limitation. You can check out this repo I made where I scrape news sites to calculate how positive their content is, for example: https://github.com/mihailthebuilder/news-positivity-research
1 Like