Link spidering

PHP programming forum. Ask questions or help people concerning PHP code. Don't understand a function? Need help implementing a class? Don't understand a class? Here is where to ask. Remember to do your homework!

Moderator: General Moderators

Post Reply
mjseaden
Forum Contributor
Posts: 458
Joined: Wed Mar 17, 2004 5:49 am

Link spidering

Post by mjseaden »

Hello,

I own quite a valuable Spanish property site. Unfortunately there are dishonest link exchange partners out there who remove their link from their site at some random point in the future, therefore I need to be able to spider the sites with whom I am exchanging links both to check that they are still active, and that they are still holding my link.

Can anyone recommend a good script in PHP to check a site for a link.

Many thanks

Mark
User avatar
nielsene
DevNet Resident
Posts: 1834
Joined: Fri Aug 16, 2002 8:57 am
Location: Watertown, MA

Post by nielsene »

You could probably use the WebUnitTest case from simpletest. Simply make a list of link partners and loop through each checking for a link to your homepage.
Post Reply