For as long as anyone can remember, the US has had a game show called Jeopardy. The basic premise of the show is that an answer is displayed and the contestants have to ‘answer’ by giving the question. The information is given in a particularly obtuse manner, not dissimilar in form to a crossword clue.
Recently, Jeopardy saw two human champions take on a computer called Watson. To cut to the chase, Watson slaughtered its competition.
This was a major step forward. Not that long ago, Watson would make the kind of idiot mistakes that we humans love to snigger about when an artificial intelligence system is rash enough to take us on.
Understanding us humans is not easy: “She’s a star” does not mean that she’s a cosmic gas ball — the relationship is conditional on context.
Then we have the language disambiguation — “time flies like an arrow” — or the fact that meaning can oscillate: in any 16-year-old’s tweet, ‘wicked’ can mean good or bad, even within the same 140 characters.
While any human could have used a traditional search engine to come up with the facts, Watson’s ability was to interpret the bizarre Jeopardy-speak and output the answer itself, not just find a document detailing it.
Why does this matter?
In the late sixties, when computers were first being properly applied to business, it was clear that they could never cope with the real way in which business was done.
People sent letters in prose or had telephone conversations; rich, human, subtle, flexible information. However, it was realised that some tasks could be simply defined and were highly repetitive.
The information could be defined and laid out so that where it actually was solved the computer’s problem of what it meant.
The number in row 34, column 15 was the inventory of widgets and the computer could do a wonderful thing: it could watch that number and if it got near zero, it could order more widgets.
The IT industry was born, a purchase ledger clerk was automated out of existence and we never looked back. The format of laid-out information became structured information and the thing processing it evolved into the relational database. Almost every software application now has a database powering it.
Now, after 50 years, the computers are catching up and the technologies are becoming available to let computers understand human-friendly information.
Not just spotting keywords, but actually extracting meaning from emails, phone calls and video. We no longer need to slavishly fit to what the computer needs, but rather they fit to us — we are in the era of Meaning-Based Computing.
This is important as 85 per cent of all information in a company is human-friendly, or unstructured. But where transaction-type data is growing at 22 per cent, human-friendly information is growing at 62 per cent a year.