Lucene like search. Looking for solution.

Ye' old general discussion board. Basically, for everything that isn't covered elsewhere. Come here to shoot the breeze, shoot your mouth off, or whatever suits your fancy.
This forum is not for asking programming related questions.

Moderator: General Moderators

Post Reply
jmut
Forum Regular
Posts: 945
Joined: Tue Jul 05, 2005 3:54 am
Location: Sofia, Bulgaria
Contact:

Lucene like search. Looking for solution.

Post by jmut »

Hi,
Currently I am looking for a search engine that will help me index all stuff I need searchable and of course do it fast. Being a Zend Framework user my first thought was Zend_Search_Lucence but then again after reading all discussions in mailing list and on couple of blogs it seems so far ZSL is only good for low to medium sized indexes and not really used in big production scenario. From what I see I will need to index millions of documents in couple of months. So two more solutinos popped up after some googling:
1. sphinx -> know absolutely nothing about it yet just read it is possible solution somewhere.
2. solr -> read about it here and there and seems to be quite good solution able to search over millions in fraction of second......well at least way faster than ZSL.

So my questions is if someone can share real experience and guide me in some direction and give opinion.
Thanks
User avatar
Eran
DevNet Master
Posts: 3549
Joined: Fri Jan 18, 2008 12:36 am
Location: Israel, ME

Re: Lucene like search. Looking for solution.

Post by Eran »

Sphinx is very very good. Has tight integration with PHP and MySQL, and can actually run many queries faster than MySQL itself (not just for text search - very fast grouping and order by). Highly recommended.
User avatar
Chris Corbyn
Breakbeat Nuttzer
Posts: 13098
Joined: Wed Mar 24, 2004 7:57 am
Location: Melbourne, Australia

Re: Lucene like search. Looking for solution.

Post by Chris Corbyn »

pytrin wrote:Sphinx is very very good. Has tight integration with PHP and MySQL, and can actually run many queries faster than MySQL itself (not just for text search - very fast grouping and order by). Highly recommended.
Sphinx, for sure is great. We dropped lucene in favour of sphinx recently and we use it's storage engine for MySQL so we can JOIN a keyword query into an existing SQL query for a record in our system. It also meant that we didn't have to rewrite our mappers which are inherently SQL-centric.

Also: 30 minutes to re-index with Lucene.... or 10 seconds with Sphinx. I know which I choose ;)
jmut
Forum Regular
Posts: 945
Joined: Tue Jul 05, 2005 3:54 am
Location: Sofia, Bulgaria
Contact:

Re: Lucene like search. Looking for solution.

Post by jmut »

Thanks all for info. Decision makers thing we should go with lucene solution so I guess we'll stick with solar...should be good enough I am sure. Time will tell :)
Now I am in a quest for php solr lib or something. I want to go with json communication but seems it's only possible to get response in json and no actually send one in json. We'll see.
Post Reply