Page 1 of 1

Can this be done?

Posted: Thu May 21, 2009 9:32 am
by Weered
Hi Guys,

Brand new to the site. I am scouring the net for an answer to a question regarding a concept I would like to integrate into my site. Basically it is a University/Student community with various perks (http://campushalifax.com not exactly live yet). One of which that I would like to have is a consolidated classifieds search directory that compiles all the listings from the various school classifieds directories local to eastern Canada (done with permission of course).

So, is there a way to write some sort of PHP code to periodically (Say a freq of 30 min), scan and compile these remote pages and then add them to a searchable directory on my site?

Odd question I know, but as an amature developer I am clueless to whether or not this is even possible.

Thanks,

Re: Can this be done?

Posted: Thu May 21, 2009 9:37 am
by jaoudestudios
You can easily achieve the frequency aspect by using a cron if you are on linux.

Re: Can this be done?

Posted: Thu May 21, 2009 9:57 am
by Weered
It is on Linux, however the frequency is only a small part of the issue. Whether or not the entire process can be done is the big question.

Re: Can this be done?

Posted: Thu May 21, 2009 11:27 am
by jaoudestudios
You can read the remote pages using file function, then you will have to parse the information and save it in a normalised database. Then yes it would be searchable on your site.