do you know how can i make a spider ( like google spider)

PHP programming forum. Ask questions or help people concerning PHP code. Don't understand a function? Need help implementing a class? Don't understand a class? Here is where to ask. Remember to do your homework!

Moderator: General Moderators

Post Reply
mgtm3
Forum Newbie
Posts: 6
Joined: Fri May 23, 2008 5:59 am

do you know how can i make a spider ( like google spider)

Post by mgtm3 »

i want to make a spider that can read other websites source code and give them to me

do you know how?
User avatar
onion2k
Jedi Mod
Posts: 5263
Joined: Tue Dec 21, 2004 5:03 pm
Location: usrlab.com

Re: do you know how can i make a spider ( like google spider)

Post by onion2k »

To be brutally honest ... if you're stuck on "how can I make a spider?" rather than the "how can I make a good spider?" then you probably shouldn't bother. Even a basic spider is a lot of quite hard work, and creating a good spider (eg one that's fast and obeys rules) is very difficult.

That said though, I have seen a few open source examples, so you could try downloading some of those and see if they'll solve your problem.
Post Reply