Help Designing New System
Posted: Wed Jul 07, 2010 4:30 pm
I need help architecting a news indexing system. I have clear system requirements but do not have the technical background to determine the best technologies to use. . The system I want developed would have the following functionality…
News Aggregator System
System should query major search engine’s news articles based on a predefined keyword list. The system would locally store news data gathered each day. The system would also index news feeds from a predefined list of websites w/ rss feeds. Once the data is stored in a local database a user could review and flag for deletion any unwanted articles. The remaining articles would be used to feed content to Wordpress.
Given these system requirements – how would you go about designing this system? Would you use open source software such as MagPie? I plan to post this job on a freelance site but would like to have a clear technology direction first. I hope I’m posting this in the correct forum.
News Aggregator System
System should query major search engine’s news articles based on a predefined keyword list. The system would locally store news data gathered each day. The system would also index news feeds from a predefined list of websites w/ rss feeds. Once the data is stored in a local database a user could review and flag for deletion any unwanted articles. The remaining articles would be used to feed content to Wordpress.
Given these system requirements – how would you go about designing this system? Would you use open source software such as MagPie? I plan to post this job on a freelance site but would like to have a clear technology direction first. I hope I’m posting this in the correct forum.