DevWebProSE
 


Click to Play

Google Introduces Google Friend...
Once again, Matt Cutts broke Google news for us. He introduced Google Friend Connect API at PubCon South in Austin, Texas and WebProNews has exclusive...

Latest Web News

How Important Is Allinanchor To Your Site?
It is a known fact that the number of links to a particular website play a crucial role in deciding its position on the search engine ranking results. But, how important this is and what are the metrics used...

Hyperic Releases Website Monitoring Additions
Hyperic, the provider of open source web infrastructure management software, on Monday announced the addition of an advanced business intelligence platform (Hyperic Operations IQ) to its web application...

No More Free Open Source Software
Dave Rosenberg wrote an post titled "Open source becomes paid software in 2009?. He writes: "I suspect that in 2009 it will start becoming clearer as...


03.17.09

Use And Practice Of Natural Language Processing

By Joe Hall

Not long ago we got word that a new search engine will launch in May that will rely heavily on Natural Language Processing (NLP). And we have even heard Eric Schmidt, CEO of Google, hint that the search giant would be implementing a greater emphasis on NLP:

Wouldn't it be nice if Google understood the meaning of your phrase rather than just the words that are in that phrase? We have a lot of discoveries in that area that are going to roll out in the next little while. (via)

As search marketers it's important that we stay on top of the world of search technologies and trends. Therefore I thought it would be a good idea to learn the basis of NLP. For this I have turned to a true expert in the field. Marie-Claire Jenkins (a.k.a CJ) is completing a PhD in Natural Language Processing and Artificial Intelligence at the University of East Anglia. She is an extremely seasoned SEO who has worked with corporate clients on all things related to search. You can learn more about CJ by visiting her web site Science for SEO.

What follows is my interview with CJ about Natural Language Processing:

Joe: Can you define Natural Language Processing for the layman?

CJ: It is the area of computing that deals with words.  Words form texts, texts form collections of many texts, leading to an awful lot of words.  This "bag of words" needs to be analyzed so that a machine can make sense of them.  If it can't, there is no way of retrieving information from the texts and so they are in effect useless.

Linguistic analysis is used to analyze and represent the texts.  Once the computer can represent the language in some way (patterns, reoccurring words, synonymy...) the information in the texts can be manipulated.  This mimics the human understanding of language.  NLP is a sub field of artificial intelligence and computational linguistics.

The Premier Event for Search Engine
Marketing & Optimization -
Register Now

A little history...

NLP was first used in 1948 for use in a look-up dictionary at Birkbeck College in London.  The code-breakers from the 2nd World War were highly interested as this was a new thing to work on now the war was over.  Machine translation was actually the 1st research area involving NLP in the 1950's, a problem that has still not been solved today.  NLP uses a wealth of research done by linguists such as Noam Chomsky, John Fillmore who revolutionized the way we search for patterns in language which is what NLP is all about.  Research has since continued and improvements have been made.

It is a very old area of research, and an extremely difficult one. The double helix has been discovered, quantum mechanics, the radar, kidney dialysis machines, man has walked on the moon...but the problem of NLP has not yet been solved, although there have been some breakthroughs.  This how hard it is.

Joe: Are there any examples of NLP in our daily life, online or off, that can help us understand this technology a bit more?

Continue reading this article.


Joe Hall is a web developer, writer, marketer, and artist that has worked on both the national and local levels around a variety of diverse topics and technologies. Most of his work has been focused on developing the tools needed for small businesses and nonprofits to become empowered on the internet. Describing him self as "web-head", Joe, engages the internet with a passion and desire to bring change and new opportunities to his clients and users. Joe is the founder and owner of JOZSOFT. JOZSOFT provides multimedia web development and internet marketing for web based and traditional companies. He is a guest author for Marketing Pilgrim.

About DevWebProSE
DevWebProSE is for professional developers ... those who build and manage applications and sophisticated websites. DevWebProUK delivers via news and expert advice New Strategies In Development.





DevWebProSE is brought to you by:

SecurityConfig.com NetworkingFiles.com
ITmanagementNews.com WebProASP.com
DatabaseProNews.com SQLProNews.com
ITcertificationNews.com SysAdminNews.com
LinuxProNews.com WirelessProNews.com
CProgrammingTrends.com ITmanagementNews.com






-- DevWebProSe is an iEntry, Inc. publication --
iEntry, Inc. 2549 Richmond Rd. Lexington KY, 40509
 © 2009 iEntry Inc.  All Rights Reserved  Privacy Policy  Legal 

advertising info | news headlines | free newsletters | comments/feedback | submit article