Web Host/ Service to Fetch Batch of URLs

I have a checklist of concerning one million URLs that I would certainly such as brought and also prefer to not run this procedure on my very own internet server. I am asking yourself if there are any kind of business remedies to this - i.e. any kind of solutions that will certainly take my checklist of URLs and also return the HTML for each and every (running it behind proxies, etc, if essential).

0
2019-12-02 02:59:11
Source Share
Answers: 1

A Linux digital exclusive web server (some valued at much less than $10/mo) can be made use of to finish this job with marginal arrangement - see the wget man page for guidelines if you pick to go this course.

0
2019-12-03 04:36:42
Source