Approaching large RSS project
Posted: Sat Nov 20, 2010 4:38 pm
Hello everybody,
I'm trying to put together an application that will gather information from several major rss feeds.
Users will be able to retrieve the feeds sorting by subject, source or a more complex set of options and filters.
I have serious concerns regarding the performance of the application, as the number of sources that information is gathered from is relatively high (e.g. 20), the feeds are updated several times a day and the user will need to be able to search the content of the feeds to display only certain news items.
I was wondering...
There are so many scripts to access RSS feeds (MagPie, SimplePie, Rss2html), does anyone have any reccomendation? Or should I start from SimpleXML and extend it as I see fit?
Should I save the feeds in a database and access them from there? Would that make display and search operations easier?
Caching... do you think I will need it? How should I approach it?
Thank you very much for any pointers/suggestions that might be given!
SR
I'm trying to put together an application that will gather information from several major rss feeds.
Users will be able to retrieve the feeds sorting by subject, source or a more complex set of options and filters.
I have serious concerns regarding the performance of the application, as the number of sources that information is gathered from is relatively high (e.g. 20), the feeds are updated several times a day and the user will need to be able to search the content of the feeds to display only certain news items.
I was wondering...
There are so many scripts to access RSS feeds (MagPie, SimplePie, Rss2html), does anyone have any reccomendation? Or should I start from SimpleXML and extend it as I see fit?
Should I save the feeds in a database and access them from there? Would that make display and search operations easier?
Caching... do you think I will need it? How should I approach it?
Thank you very much for any pointers/suggestions that might be given!
SR