Since V1.0 was released I always promised to improve the search speed, and so I have done. After 2 years of hard coding and code punching, I can hereby reveal fresh results from the next killer beast kicking even Google down to the ground it seems. SQL and Sphinx - stay scared, you will be had by the blistering speed of SOTDS.
I will leave you with a proven search hit result: "65620 hits for: readme in 0.0440s"
And that is from a database consisting of 64millions searchable words.
Even Google cannot go this fast on search speed (they show first 10 hits in 0.10-0.19 seconds) , their fact says "About 10,400,000 results - (0.19 seconds) ". Sure it says 10million hits, but you can NEVER seen beyond 1000 hits anyway (just try below). If you want to check the next 10 items add 0.11, if you go to page 10, add 0.27 and it gets worse and worse for every page. Now, keeping that it mind, duplicate an average of 0.11s x 100 pages (with 10 in each) and do the math. Simple fact: Google is slow and lagging behind.
My search engine spits out 50 hits (5 times more than Google) in just 0.04s, which is about 2 x faster than google.
Fact:
https://www.google.com/#q=%22readme%22&start=999
Surprised?
Now check page 1 vs page 25
https://www.google.com/#q=%22readme%22&start=920 0.27
https://www.google.com/#q=%22readme%22&start=0 0.11
So, in simple terms. Google can spit out MAX 1000 hits on one screen (if stitched together)....oh about after 11 seconds!
My version can spit out 65620 hits (initial 50 shown in 0.04s - the rest in background for 1-2 seconds.) And voila. SOTDS is therefore approx 65 times faster than Google. Makes you wonder, right?
Note: I do understand that you can change search settings to show max 100 hits on 1 single page, but the fact remains the same, the results given to the human eye is presented slower than what if SOTDS would to do the same. I guess Google didn't need all that hardware after all, as SOTDS can perform this search speed even on 1.63ghz single core Pentium M computer with 512mb of RAM (quick test at the time of writing).
And please understand, the above statement is sarcastic, as SOTDS does not search the web. It searches locally, single user. But, it do wonder if my search engine technique would have the hardware ball-park of Google to live in? We could most likely get search hits before we even knew we searched for them! Can we talk AI anyone?
