Quantcast
Viewing latest article 22
Browse Latest Browse All 26

How to create a database of items from RSS feeds for analysis (not for an application), updated as RSS items published?

I need to create a database of items from rss feeds and I'd like it to be updated asynchronously (via push ala AJAX) rather than pull (ala scraping RSS via python/magpie in php). The database will be used for analysis not for an application, so it needs to scale. If anyone knows of an rss feed reader application for which you can simply export the items from your feed via xml, that'd be great.

I'd prefer not to create a bunch of server infrastructure to get a php rss parser to play with mysql on chron jobs, but I will do so if necessary. Also interested in potential python solutions.

I've taken a look at Superfeedr/PubSubHubbub, but not sure that's the right solution for me.


Viewing latest article 22
Browse Latest Browse All 26

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>