Best way to setup URL Blacklist?
Posted: Thu Sep 23, 2010 9:14 pm
Ahoy,
I'm creating a simple site that allows people to submit links which then get published for everyone else to visit. To try and preempt links leading to malware and the like, I want to implement a blacklist URL filter. I downloaded the lists from URLblacklist.com and was going to just insert each URL into a giant mysql table, but it seems the table would be obscenely large.
Is there a fast way to compare a URL to all the URLs listed in a file? Or would I be better off to just create a giant table?
ConQuesimo
I'm creating a simple site that allows people to submit links which then get published for everyone else to visit. To try and preempt links leading to malware and the like, I want to implement a blacklist URL filter. I downloaded the lists from URLblacklist.com and was going to just insert each URL into a giant mysql table, but it seems the table would be obscenely large.
Is there a fast way to compare a URL to all the URLs listed in a file? Or would I be better off to just create a giant table?
ConQuesimo