Advertise with us

Control Panel Forum Hosting Help ASP.NET 4.5 & SQL 2012 Hosting Resources Notice

Home » Resources » How to Add Intelligence to your Search Engine

ASP.NET	ADO.NET	Web Services	Remoting	Visual Studio 2005
Error Bank	Interview Questions	Tips & Tricks	XML	HTML
Jscript/Javascript	IIS	Windows		General

Submit Resource or code snippet ... and get surprise gifts ASP.NET web hosting

Win Digital camera, ASP.NET Books, Free softwares!!

How to Add Intelligence to your Search Engine

04 Nov, 2010

Author: Gino Abraham
Infosys Technologies

Summary
This article helps you in understading how to make use of natural language processors to enhance the search feature in your website.

.NET Classes used :

Conventinal Way of Searching :

When there is a requirement to add a Search feature inside a website to search through knowledge base the first thing that will crack our mind is to add a Free Text Search with some Keywords. If it is a SQL server we will hit a free text query over a specific keyword index else we might lookout for some third party indexing utility like lucene.net to to fetch best matching result for the end user. This is called Keyword Searching. The search key words will be like CEO Infosys,Asp.net

Adding Intelligence to your Search :

How do you add intelligence to your search. There are many ways to do that. If you hit a search in google for Semantic Search you will get many results. My intention out here is to let the newbies know how they can add intelligence to their search using some open source tools.

The intelligence that am talking about is to decode a sentence given by the End user in the search box. if end user passes a sentence like who is the CEO of Infosys, the search engine should be able to decode this and fetch results accordingly.

How can we Achieve this :

We should have a natural language processing capability at our end to achieve this feature. We can always leverage few open source tools to get out natural sentence processed. One such tool is Sharp NLP which a Dotnet version of Open NLP. You can download Sharp NLP @ http://sharpnlp.codeplex.com/. Sharp NLP uses princeton universities Wordnet library as a backend(list of words stored) to process our sentence. Processing here mean knocking off unwanted words from the Search Sentence given.

For eg: In our search sentence who is the CEO of Infosys. We could get some verbs,conjuntions,adjectives,nouns a sentence. Sharp NLP can be used to find the Parts of speech and accordingly we can avoid unwanted words from the sentence and then hit a search on our database.

There are few websites which does natural language processing on the key words passed and respond with an answer if the search text is a question type. For eg for the search sentence above Ask.com will respond as follows.

Kris Gopalakrishnan is the CEO of Infosys

Source:Wikipedia

Am doing a reasearch on how to achieve this, you can soon expect a detailed blog on this with samples hosted. Till then Happy Coding

Feedbacks about this page from members:

Hi - Santosh Pabba

Hi, This is a nice thinking, I'm eagerly waiting for your reply.....

A newbie of ASP.Net

(29 Nov 2011)

GoodJob - HoganYu

well

(02 May 2012)

Submit Feedback View All Feedbacks

Total members: 250658
Average new registrations per day (in last 7 days): 7

New Registration: Open

Register Now

Talk to Webmaster
Tony John

Facebook
Google+
Twitter