Nerd Industries: Stuart Robinson's blog

Another step towards a real semantic web has been taken recently with the incorporation of Evri.com's technology into articles from The Washington Post. (One small step for the semantic web, one giant leap for Evri.)

I originally learned about evri.com on Twitter. A colleague at Powerset, Will Fitzgerald, tweeted:

Evri (http::www.evri.com) looks mighty. (A company formed around what I do for my day job)

Yesterday another Tweet alerted me to the partnership with The Washington Post:

Evri is now showing up all over the washingtonpost.com on all articles published today. Like this one: http://is.gd/jshy

If you follow the link in the tweet, you'll find a Washington Post article that has a handy little widget providing information about some of the entities discussed in it.

You can poke around on the widget and start exploring. Want to know more about the House Appropriation Committee? It's only a click away.

Maybe you want to know about The White House. Again, just another click.

(Not all of the relationships are of the same semantic type. The last time I checked, Stevie Wonder, wasn't part of Obama's cabinet. The relationships are clusters, it seems, and not a more narrowly defined one such as cabinet membership.)

But the best collection of named entities isn't going to provide very valuable information if there isn't a way of aligning its contents with relevant entities in a the free text of newspaper articles. A good illustration of this was revealed a little while ago when Marshall Kirkpatrick (from ReadWriteWeb) commented on Google's exposure of semantic data, pointing out that it sometimes got things badly wrong, like stating that Jesus was born in 1963. The problem wasn't that Jesus wasn't born in 1963. The problem was that it wasn't the right Jesus. The query was about Jesus Christ, but they returned data for a different Jesus. (It reminds me of a joke I once heard about prison inmates finding religion. The punch line went something like: "That's not Jesus, our Lord and Savior. That's Jesús [Spanish pronunciation], your cellmates."

The point is that you need some reasonably sophisticated technology in order to identify entities in a document and then figure out which entities they correspond to in your database of known entities. The Jesus example shows that relying on first name alone isn't going to do the trick. Figuring out what will is going to be one of the major tasks that researchers in natural language processing will tackle in the coming years. It's a good time to be a computational linguist.