Coding, Python

Python fun #5 : Hi-performance RSS Content Downloader

[Disclaimer: In Python world, I am just a noobie. Sharing my experience along the way of learning. I am more than happy to hear from you.]

I just completed a content downloader which grabs links from a given RSS feed, and then downloads all the linked contents simultaneously. “Bandwidth is your only limit” 😉

It DON’T work on Windows. Yet.

For the downloading part, it primarily depends on the URLGrabber library which in turn depend on PycURL library. On the other hand, for parallelism and other staffs it depends on Python’s built-in libraries, e.g. Multiprocessing, XML parsing, URLlib2.

You can even use proxy settings, bandwidth-control, FTP’s user/password etc.

Here it goes:

As, don’t allow GitHub code embedding, you have to click the link to check this out.

Thanks !


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s