Joho the Blogwolframalpha Archives - Joho the Blog

July 17, 2009

Search matchups

Google vs. Yahoo

Google vs. WolframAlpha

Google vs. Bing

(via Keith Dawson)

[Tags: ]


June 5, 2009

Bing, Google … and Kayak

I’ve been poking around Microsoft’s Bing. The short answer is that it’s not going to move me off of Google. Of course, my Google inertia is pretty much sleeping-hippopotamus-like at this point. Plus, Bing’s ripping off of (see below) has me pretty cheesed.

Bing does some useful and clever things. But, I think some of the coverage has actually undersold Google. For example, Hiawatha Bray in the Boston Globe, whose writing I like a lot, today opens his review with the clever idea of searching for “google” at Bing and for “bing” at Google. He says Bing gives you a concentrated dosage of stuff about Google, while Google is all over the map with its “bing” results. Well, sure! “Google” is a made-up word with only one dominant meaning, so of course Bing gives you concentrated Google goodness. But “Bing” has lots of meanings, so Google’s right to return a mix of bingy words…with Microsoft Bing as the top result. Now, it is true that, as Hiawatha says, Microsoft gives its “Google” results in convenient tabs about Microsoft the corporate entity as well as listing sub-pages within the google domain, while Google’s top return on “Microsoft” only gives you a set of sub-pages. Microsoft looks more like WolframAlpha in that regard, and that’s a good way to look. But, Google also recently added easier ways to refine and expand searches (by timeline, by WonderWheel), etc., as Hiawatha points out. So, it really depends on what you’re trying to do. As always. (Type MSFT into either and you’ll get similar boxed stock data.)

Hiawatha writes: “Say you want the latest weather or traffic data. Google will tell you where to get it. Bing will just give it to you.” Not exactly. Type “weather” into either site and you get your local weather at the top, in pretty much identical displays. Google’s been doing that for quite a while. Likewise, type an airline and flight number and Google will tell you if it’s on time. But the “traffic” trick doesn’t work for Google. For that you have to go to Google Maps and click on the “Traffic” button (assuming you’re signed in). I wonder how long it’ll take Google to add Bing’s way of responding.

When it comes to shopping, Bing has some very nice touches. Well, primarily it has faceted classification — like, and also using Endeca‘s engine? — that lets you sort a big list based on multiple criteria, using any of them in any order. Also, Bing has separate ratings by users and experts. On the other hand, Google found many many more copies of “splinter cell double agent” for sale than Bing did.

As many have noted, Bing’s handling of video searches is stellar. Hover over any of the thumbnails and the thumbnail starts to play. But, as someone pointed out — sorry, I lost the link — there seems to be no way to keep users from turning off the adult filter, which means that every school and library now has the greatest multi-screen porn browser ever invented. You can browse for porn videos on Google, of course, but with Bing it’s like watching all of them all at once. Well, maybe this will be like catching a kid smoking and making him smoke an entire pack all at once.

And now we come to Bing’s travel searches. OMG. Bing blatantly ripped off [Disclosure: I’m old friends with the Kayak folks.] Just take a look at this post. If you’re going to rip off an innovative design, then at least innovate on top of it! Grrrr…

[Tags: ]

Later that morning: I just came across a very amusing article in Ars Technica about the new Google Squared app that puts info into tables. It makes clear why some sites (e.g., WolframAlpha) are willing to pay the price to gain the benefits of curation. (via Lee Baker, Berkman summer intern)


May 17, 2009

WolframAlpha’s big problem

After a day of poking at the awesome WolframAlpha and watching some of the reactions around the Web, a major problem has emerged. WA is fantastic if it has what you’re looking for. But if it doesn’t, it looks like it’s failed, as in: “What? It can’t tell me how much energy it would take to move Henry VIII one kilometer, expressed in cheeseburger-calories? What a piece of crap!”

Google doesn’t have this problem. If you get no hits, it’s almost always because you’ve so egregiously mistyped something that no one else on the planet has ever posted anything with that same typo. Or, it’s because you’ve put an odd phrase in quotes, which requires taking the special action of, well, putting things in quotes. Almost always, Google succeeds at what it does (find pages that contain particular text), even when it fails at doing what you want (find a particular answer).

WolframAlpha, on the other hand, is like a roomful of idiot savants. Each knows a scary amount about a topic. And, unlike a such a roomful, WA also knows how to recombine and compute what each of the savants knows. But if the room doesn’t have the savant you’re looking for, you get back nothing but a “Huh?”

The eclecticism of WolframAlpha is its selling point. But the delight that it knows things you would never have guessed at means that you can have trouble guessing what it knows about. The question is whether general users will go back enough times to be trained on the sorts of questions it can answer. If not, WA will remain an awesome tool for specialists but will not become the broad, general-purpose tool it wants to be.

It would, however, be a completely awesome addition to Google…a path I suspect Stephen Wolfram does not want to take.

[Tags: ]


May 8, 2009

WolframAlpha vs. Google

David Talbot at Technology Review has run the same queries through Google and WolframAlpha. (WA isn’t yet open to the general public, i.e., to you and me.) The queries tend to be of the sort that WA will be better at: comparisons and computations. WA comes out well, but be sure to read David’s writeup of comments on his article.

The overall conclusion is, I think, that it’s going to take a while for WA to train us on the sorts of questions it can answer and how best to ask those questions.

(Some me-centric links: Live blog of Wolfram’s presentation at Harvard. Video of that presentation. My podcast interview with him. My too-early assessment of WA.)

[Tags: ]

1 Comment »

May 7, 2009

Wolfram podcast

My interview with Stephen Wolfram about WolframAlpha is now available. Some other me-based resources:

The unedited version weighs in at a full 55 minutes. The edited version will spare you some of my throat-clearing, and some dumb questions.

A post about what I think the significance of WolframAlpha will be.

Live blog of Wolfram’s presentation at Harvard.

Wolfram’s presentation at Harvard.

[Tags: ]

Comments Off on Wolfram podcast

May 4, 2009

How important is WolframAlpha?

The Independent calls WolframAlpha “An invention that could change the Internet forever.” It concludes: “Wolfram Alpha has the potential to become one of the biggest names on the planet.”

Nova Spivak, a smart Semantic Web guy, says it could be as important as Google.

Ton Zijlstra, on the other hand, who knows a thing or two about knowledge and knowledge management, feels like it’s been overhyped. After seeing the video of Wolfram talking at Harvard, Ton writes:

No crawling? Centralized database, adding data from partners? Manual updating? Adding is tricky? Manually adding metadata (curating)? For all its coolness on the front of WolframAlpha, on the back end this sounds like it’s the mechanical turk of the semantic web.

(“The mechanical turk of the semantic web.” Great phrase. And while I’m in parentheses, ReadWriteWeb has useful screenshots of WolframAlpha, and here’s my unedited 55-minute interview with Wolfram.)

I am somewhere in between, definitely over in the Enthusiastic half of the field. I think WolframAlpha [WA] will become a standard part of the Internet’s tool set, but is not transformative.

WA works because it’s curated. Real human beings decide what topics to include (geography but not 6 Degrees of Courtney Love), which data to ingest, what metadata is worth capturing, how that metadata is interrelated (= an ontology), which correlations to present to the user when she queries it (daily tonnage of fish captured by the French compared to daily production of garbage in NYC), and how that information should be presented. Wolfram insists that an expert be present in each data stream to ensure the quality of the data. Given all that human intervention, WA then performs its algorithmic computations … which are themselves curated. WA is as curated as an almanac.

Curation is a source of its strength. It increases the reliability of the information, it enables the computations, and it lets the results pages present interesting and relevant information far beyond the simple factual answer to the question. The richness of those pages will be big factor in the site’s success.

Curation is also WA’s limitation. If it stays purely curated, without areas in which the Big Anyone can contribute, it won’t be able to grow at Internet speeds. Someone with a good idea — provide info on meds and interactions, or add recipes so ingredients can be mashed up with nutritional and ecological info — will have to suggest it to WolframAlpha, Inc. and hope they take it up. (You could to this sorta kinda through the API, but not get the scaling effects of actually adding data to the system.) And WA will suffer from the perspectival problems inevitable in all curated systems: WA reflects Stephen Wolfram’s interests and perspective. It covers what he thinks is interesting. It covers it from his point of view. It will have to make decisions on topics for which there are no good answers: Is Pluto a planet? Does Scientology go on the list of religions? Does the page on rabbits include nutritional information about rabbit meat? (That, by the way, was Wolfram’s example in my interview of him. If you look at the site from Europe, a “rabbit” query does include the nutritional info, but not if you log in from a US IP address.) But WA doesn’t have to scale up to Internet Supersize to be supersized useful.

So, given those strengths and limitations, how important is WA?

Once people figure out what types of questions it’s good at, I think it will become a standard part of our tools, and for some areas of inquiry, it may be indispensable. I don’t know those areas well enough to give an example that will hold up, but I can imagine WA becoming the first place geneticists go when they have a question about a gene sequence or chemists who want to know about a molecule. I think it is likely to be so useful within particular fields that it becomes the standard place to look first…Like for movies, except for broad, multiple fields, with the ability to cross-compute.

But more broadly, is WA the next Google? Does it transform the Internet?

I don’t think so. Its computational abilities mean it does something not currently done (or not done well enough for a crowd of users), and the aesthetics of its responses make it quite accessible. But how many computational questions do you have a day? If you want to know how many tons of fish France catches, WA will work as an almanac. But that’s not transformational. If you want to know how many tons divided by the average weight of a French person, WA is for you. But the computational uses that are distinctive of WA and for which WA will frequently be an astounding tool are not frequent enough for WA to be transformational on the order of a Google or Wikipedia.

There are at least two other ways it could be transformational, however.

First, its biggest effect may be on metadata. If WA takes off, as I suspect it will, people and organizations will want to get their data into it. But to contribute their data, they will have to put it into WA’s metadata schema. Those schema then become a standard way we organize data. WA could be the killer app of the Semantic Web … the app that gives people both a motive for putting their data into ontologies and a standardized set of ontologies that makes it easy to do so.

Second, a robust computational engine with access to a very wide array of data is a new idea on the Internet. (Ok, nothing is new. But WA is going to bring this idea to mainstream awareness.) That transforms our expectations, just as Wikipedia is important not just because it’s a great encyclopedia but because it proved the power of collaborative crowds. But, WA’s lesson — there’s more that can be computed than we ever imagined — isn’t as counter-intuitive as Wikipedia’s, so it is not as apple-cart-upsetting, so it’s not as transformational. Our cultural reaction to Wikipedia is to be amazed by what we’ve done. With WA, we are likely to be amazed by what Wolfram has done.

That is the final reason why I think WA is not likely to be as big a deal as Google or Wikipedia, and I say this while being enthusiastic — wowed, even — about WA. WA’s big benefit is that it answers questions authoritatively. WA nails facts down. (Please take the discussion about facts in a postmodern age into the comments section. Thank you.) It thus ends conversation. Google and Wikipedia aim at continuing and even provoking conversation. They are rich with links and pointers. Even as Wikipedia provides a narrative that it hopes is reliable, it takes every opportunity to get you to go to a new page. WA does have links — including links to Wikipedia — but most are hidden one click below the surface. So, the distinction I’m drawing is far from absolute. Nevertheless, it seems right to me: WA is designed to get you out of a state of doubt by showing you a simple, accurate, reliable, true answer to your question. That’s an important service, but answers can be dead-ends on the Web: you get your answer and get off. WA as question-answerer bookends WA’s curated creation process: A relatively (not totally) closed process that has a great deal of value, but keeps it from the participatory model that generally has had the biggest effects on the Net.

Providing solid, reliable answers to difficult questions is hugely valuable. WolframAlpha’s approach is ambitious and brilliant. WolframAlpha is a genius. But that’s not enough to fundamentally alter the Net.

Nevertheless, I am wowed.[Tags: ]


April 29, 2009

Wolfram interview

The Berkman Center has posted the raw audio of my 55 minute interview with Stephen Wolfram, about his deeply cool WolframAlpha program (which he talked about here yesterday). On the other hand, if you wait a few days, you can skip some throat-clearing on my part, as well as my driving him down an alley based on my not seeing where WolframAlpha puts links to other pieces of information. As is so often the case, the edited version will be better.

[Tags: ]

Comments Off on Wolfram interview

April 16, 2009

WolframAlpha alpha

Seb Schmoller went to a webinar put on by Stephen Wolfram about the upcoming WolframAlpha search engine (well, answering engine) and came away impressed…

[Tags: ]