Coding for a makeshift newsroom: schedule a Python script in your own piece of cloud

So you want to run a web-scraping Python script every day?
Well there’s a zillion strategies for that, but for cheap (free) & easy (relatively), I went with a little piece of cloud from Amazon Web Services.

You’ll need a few things for this:
1. An AWS account and an EC2 (tiny virtual server) instance. A fine tutorial series is here.
2. A Python script to run. (NB, if you use any exotic libraries, you’ll have to install them in your virtual server)
3. (Optional) Filezilla, to extract your scraped files onto your own machine. A tutorial for that is here.

Great thanks to the NICAR session that intro’d me to AWS. Join IRE today!

Be the first to comment on "Coding for a makeshift newsroom: schedule a Python script in your own piece of cloud"

Leave a comment

Your email address will not be published.


*


*