Clay Shirky has given us a surprising number of Internet myths. And by this I mean not falsehoods but the opposite: Broad, illuminating ways of making sense of what’s going on. For example, Clay’s post about the power law distribution of links in the blogosphere (based on research by Cameron Marlow) changed how we view authority, fame, and success in the Web ecosystem, and provided the structure within which Chris Anderson could point to the Long Tail. And Clay’s Ontology Is Overrated made clear that a change in how we categorize our world affects very real power relationships; that essay was highly influential, including on my own Everything Is Miscellaneous.

Clay’s new post — The Collapse of Complex Business Models — gives us a broad way of understanding why those who used to provide us with content will not be the ones who give us content in the future…and why they cannot fathom why not.

5 Comments »

There’s a terrific colloquy between Google and Geoff Nunberg in response to Geoff’s critique of Google’s handling of the metadata attached to the books Google is digitizing (which I blogged about here). It’s fascinating for its content, but also very cool as a conversation between a company and its market. Of course, it would have been even better if Google had initiated this conversation when it started its digitization project.

[Tags: metadata books google_books libraries everything_is_miscellaneous ]

2 Comments »

Terry Jones has an excellent post that lists the problems introduced by maintaining a hard distinction between metadata and data.

Terry cites Everything Is Miscellaneous (thanks, Terry), which argues that the distinction, which is hard-coded in the Age of Databases, becomes a merely functional difference in the Age of Messy Links: Metadata is what you know and data is what you’re looking for. For example, the year of a CD is metadata about the CD if you know the year a Bob Dylan CD came out but you don’t remember the title, and the title can be metadata if you know the title but want to find the year. And in both cases, it could all be metadata in your search for lyrics.

This is all very squishy and messy because the distinction is, as Terry says, artificial. It comes from thinking about experience as content that gets processed, as if we worked the way computers do. More exactly, it comes from thinking about experience as a set of Experience Atoms that then have to be assembled; metadata are the labels that tell you that Atom A goes into Atom Z. But experience is far more like language than like particle physics or Ikea assembly instructions. And that’s for a very good reason: linguistic creatures’ experience cannot be understood apart from language. Language doesn’t neatly separate into content and meta-content. It all comes together and it’s all intertwingled. Language is so very non-atomic that it makes atoms realize how lonely they’ve been.

That doesn’t mean that computer software that separates metadata from data is useless. Lord knows I love a good database. But it also means that computer software that can treat anything as metadata depending on what we’re trying to do opens up some interesting possibilities…

[Tags: everything_is_miscellaneous fluiddb metadata databases language ]

3 Comments »

Ben Fry posts an amazing visualization of the changes in the six editions of Darwin’s Origin of Species, based on meticulous work done by Dr. John van Wyhe and others. From Ben’s introductory text:

The second edition, for instance, adds a notable “by the Creator” to the closing paragraph, giving greater attribution to a higher power. In another example, the phrase “survival of the fittest” — usually considered central to the theory and often attributed to Darwin — instead came from British philosopher Herbert Spencer, and didn’t appear until the fifth edition of the text.

[Tags: darwin evolution drafts everything_is_miscellaneous transparency ]

1 Comment »

The latest Radio Berkman episode has me interviewing Steve Schultze about his RECAP project that posts public domain legal records that otherwise you’d have to pay to access. And the federal courts are not all that happy about it.

[Tags: law public_domain pacer recap copyright copyleft everything_is_miscellaneous ]

Be the first to comment »

Geoff Nunberg has a fantastic post warning about the poor quality of the metadata attached to the books Google is scanning into its soon to be dominant-to-the-point-of-monopoly digital library. Apparently, the attempt to gather metadata automatically from the scans has resulted in the introduction of legions of errors. But the real problems are, as Geoff points out, that Google seems not to have a plan for dealing with this problem and that it has not opened up the metadata design process.

[Tags: google_books libraries metadata worldcat everything_is_miscellaneous ]

4 Comments »

Tucows is participating in the Canadian copyright consultation process. Rather than submitting a comment written in the usual lawyerly prose, Elliot Noss, Tucow’s CEO, asked me to write up something about copyright in my usual imprecise and incoherent prose. I like Elliot a lot, and I care about copyright, so I wrote about the argument that without strong copyright protection, creators won’t have an incentive to create. The piece is now posted… [The next day: I absolutely should have mentioned that this was a commissioned piece. I.e., Elliot paid me to write something, and posted it unaltered.]

[Tags: copyleft copyright culture canada everything_is_miscellaneous ]

13 Comments »

The Encyclopedia of Life is encouraging citizen contributions to its experts-vetted pages, so far with what seem like excellent results. There’s a good article about this at Science Daily. After two years, they’ve got 150,000 species pages underway, with 1.4 million stubs awaiting drafting.

[Tags: crowdsourcing everything_is_miscellaneous science biology taxonomy ]

4 Comments »

Amusing Dilbert today, for those who can’t resist a good taxonomy joke. (Thanks for the tip, Helena!)

[Tags: everything_is_miscellaneous comics dilbert humor taxonomy ]

1 Comment »

I know I’m not the only one who’s finding WolframAlpha sometimes frustrating because I can’t figure out the magic words to use to invoke the genii. To give just one example, I can’t figure out how to see the frequency of the surnames Kumar and Weinberger compared side-by-side in WolframAlpha’s signature fashion. It’s a small thing because “surname Kumar” and “surname Weinberger” will get you info about each individually. But over and over, I fail to guess the way WolframAlpha wants me to phrase the question.

Search engines are easier because they have already trained us how to talk to them. We know that we generally get the same results whether we use the stop words “when,” “the,” etc. and questions marks or not. We eventually learn that quoting a phrase searches for exactly that phrase. We may even learn that in many engines, putting a dash in front of a word excludes pages containing it from the results, or that we can do marvelous and magical things with prefaces that end in a colon site:, define:. We also learn the semantics of searching: If you want to find out the name of that guy who’s Ishmael’s friend in Moby-Dick, you’ll do best to include some words likely to be on the same page, so “‘What was the name of that guy in Moby-Dick who was the hero’s friend?’” is way worse than “Moby-Dick harpoonist’.” I have no idea what the curve of query sophistication looks like, but most of us have been trained to one degree or another by the search engines who are our masters and our betters.

In short, we’re being taught a pidgin language — a simplified language for communicating across cultures. In this case, the two cultures are human and computers. I only wish the pidgin were more uniform and useful. Google has enough dominance in the market that its syntax influences other search engines. Good! But we could use some help taking the next step, formulating more complex natural language queries in a pidgin that crosses application boundaries, and that isn’t designed for standard database queries.

Or does this already exist?

Tags: search pidgin nlp natural_language_processing google everything_is_miscellaneous

3 Comments »

There’s a terrific article by Carol Kaesuk Yoon in the NY Times about research that shows that humans around the world tend to cluster the natural world in highly similar ways, even using similar-ish names.

[Tags: everything_is_miscellaneous taxonomy ]

1 Comment »

With it’s new Fresh view, Delicious builds on the TweetNews idea of using links in Tweets (and other measures) as a way to find what’s newest and most interesting. As the blog post about it says:

Underneath the hood, Fresh factors several features into the ranking like related bookmark and tweet counts, “eats our own dogfood”  by leveraging BOSS to filter for high quality results, as well as stitches tweets to related articles even if the tweets do not provide matching URLs (as ~81% of tweets do not contain URLs). Try clicking the ‘x Related Tweets’ link for any given story to see the Twitter conversation appear instantly inline.

It’s a welcome reslicing, not a whole new beast, but it seems useful.

[Tags: delivious everything_is_miscellaneous twitter news ]

1 Comment »

Jeez, it would save me a lot of time if Keynote (or Powerpoint, if you insist) let me tag slides and objects in slides (especially images). I spend way too much time looking for that slide of a “smart room” or the one that shows business vs. end-user use of Web 2.0, or that photo of an old broadcast tower. (Later that day: Maybe I should add, having just rewritten the Wikipedia entry on Interleaf, that back in the early 1990s, Interleaf gave us exactly that capability.)

Instead, I have two hacks, both a pain in the butt. First, I keep a humungous file of slides I think I’ll want to use again. Second, I’ve started putting tags into the speaker notes by putting the tags in brackets. But I use the speaker notes to speak from, so larding them up with tags is sub-optimal.

And especially if you save Keynote files in the pre-2009 multi-file formats, then it’d be a snap for third parties to build tools that extract the tags and manage them. (I have a fussy home-made utility that extracts the text from the speaker notes and builds an editable file of them. If you want it, let me know.)

Tags are easy! Tags are useful! Let tags be tags!

[Tags: tags everything_is_miscellaneous keynote powerpoint metadata whines ]

2 Comments »

The Guardian has fun article on schemes for arranging the books on your shelf, with an interesting set of comments. (It makes me want to send the entire thread a copy of Everything Is Miscellaneous.)

[Tags: everything_is_miscellaneous dewey the_guardian ]

Be the first to comment »

The AP has announced it is going to use an automated system to monitor the use of AP content on the Web, looking for copyright violations. The empire is fighting back. From the press release:

The Associated Press Board of Directors today directed The Associated Press to create a news registry that will tag and track all AP content online to assure compliance with terms of use. The system will register key identifying information about each piece of content that AP distributes as well as the terms of use of that content, and employ a built-in beacon to notify AP about how the content is used.

I think there are three possible broad-stroke outcomes:

1. The AP takes an enlightened and generous view of copyright protection and its terms of use, encouraging people to link to and cite its stories, and saving its angry face for commercial thieves, wholesale infringers, and other scum. The AP remains a major source of news, fulfills the social mission of the newspapers who are its members, and our culture is better off for it.

2. The AP’s automated system is set on a hair trigger. The AP protects its copyright so well that no one ever hears from it again.

3. The AP acts inconsistently. It sends scary letters to teenagers who copy three paragraphs about the Jonas Brothers and sics lawyers on a professor teaching a course on media studies. No one understands what the AP is doing, so we all get scared and hate it.

To start with, it’d be great if the AP’s copyright warnings didn’t just tell people what they can’t do, but also told them what they can do, and encouraged us to re-use the material as much as possible. On the other hand, since one of the aims of the new system (according to the press release) is to facilitate the use of pay walls, I expect we’ll see more of the AP’s content making itself irrelevant.

[Tags: ap media journalism free copyright copyleft everything_is_miscellaneous ]

4 Comments »

Link. (The video embeds my slides, but (1) they get more and more out of order in this YouTube; they were in the right order when I actually presented them. 2. My font got lost somewhere in the translations, and so there’s a fair bit of mis-sizing, text overflows, etc.) (I posted about one of the ideas in the talk (transparency as the new objectivity) here.)

[Tags: pdf09 transparency media politics e-democracy e-government e-gov everything_is_miscellaneous newspapers media ]

1 Comment »

I posted my post about the Sotomayor hearings over at Huffington, where I got a grand total of two comments. The second one raised an interesting point. (The first one was funny.)

Or, “Senator, would you simply prefer that the Court be comprised of the best legal minds in the nation, regardless or their race, creed, or color, despite the fact that such a concept is foreign to the race conscious liberals among us?” – Parducci

That’s a reasonable response (leaving out everything after the “despite”), but I think it’s fundamentally wrong, since it assumes there is a way to rank order legal minds. There isn’t, because there is no such order.

Look at the current Justices. You may be able to say that one particular Justice’s “legal mind” is not as good as the rest (“Judge So-and-So just isn’t up to snuff”), but there isn’t any real way to rank them in order (except perhaps by ow well their decisions accord with political sides). With heart surgeons, maybe you can look at the survival rates of their patients — and there are problems with that — but for judges, there aren’t criteria that result in a reliable, accurate, and agreed-upon quantitative ranking. Likewise, who would think there’s any sense in trying to numerically rank philosophers, historians, or chefs? You can see that a particular one isn’t in the top rank or is out of her league, but within that top rank, there isn’t a numeric ordering.

So, for nominees to the Supreme Court, the idea that we should take “the best legal minds” actually means that we should choose from among those who are highly qualified for the job. Since that class is far larger than nine, we get to choose our Justices based on many considerations, including the likely effect they’ll have on the political balance of the court and — yes — the likely effect they’ll have by bringing a diversity of experience and outlook. For the wisdom of a group is enhanced by including difference within it.

In fact, it would be interesting to see how the degree of qualification (based on whatever criteria one wants to suggest) going into the Court matches with the performance of the Justice over the course of her or his term.

[Tags: sotomayor diversity everything_is_miscellaneous philosophy ]

6 Comments »

The OCLC has an experimental site up that provides classification information for books and pubs. You type in the book’s title and author (or ISBN number, or other such ID), and it returns info about the various editions and how they’re classified in the OCLC’s Dewey Decimal Classification System or by the Library of Congress. You can then see the other books that share its Dewey Decimal number (for example, here’s Everything Is Miscellaneous, #303.4833>>Social sciences>>Social sciences, sociology & anthropology>>Social processes), at the OCLC’s useful Dewey Browser. Alas, when you click on the Library of Congress number, you get taken to a demand by the LC that you subscribe to Classification Web, instead of to the free LC Catalog (where my Misc book is listed like this).

Lots of metadata about the metadata…Gotta love it!

[Tags: everything_is_miscellaneous dewey_decimal oclc libraries books metadata ]

4 Comments »

NOTE: The 50 copies are gone. Took about an hour.

I’m trying an experiment with a business model I like to call a reverse referral fee. Here’s how it works…

You click on a link that lets you download a copy of Brad Sucks’ latest album, Out of It. The album of wonderful music is yours for free in every sense. (Share it! Please!) But, I’m going to pay Brad for each copy downloaded, at a bulk rate he and I have agreed on.

This offer is good for the first fifty people who download it. After that, you can buy a copy on your own. Of course, Brad also makes his music available for free (in every sense), but don’t you want to support a truly webby, big-hearted musician who’s giving us his talent free of copyright, studios, and DRM? Doncha?

So, if you want to be one of the fifty, click here for your free-to-you-but-not-to-me copy of Brad Sucks’ Out of It.

[Tags: bradsucks music drm copyright copyleft business_models everything_is_miscellaneous ]free ]

14 Comments »

A few years ago, I sat next to an AP photographer on a press bus as he deftly photoshopped an image he’d just taken. I asked him if he was allowed to do that, and he said the rule was that he could do anything with Photoshop that he could have done in a darkroom.

I thought of him when I saw the NY Times’ embarrassed retraction of a photo essay it had published. It turns out that the photographer had “digitally manipulated” the photos without telling his editor. Unfortunately, the NYT removed all of the photos, rather than keeping them up with the metadata that the digital manipulation had gone beyond editorial guidelines, and without telling us what those guidelines are. For all photos are manipulated. The photographer frames them, decides on what to focus on and how much of the photo should be in focus, etc., and then completes the manipulation in the darkroom, whether it’s analog or digital. To think otherwise is to fall prey to the fallacy of photographic realism that Susan Sontag warned us against.

Wouldn’t it be interesting to see what the NYT’s guidelines are and then hold a contest to see who can create the most deceptive photo while staying within those guidelines?

Scott Rosenberg, a founder of Salon and the author of a terrific new history of blogging (Say Everything), provides us with reflections on what could be one of the entries, based on stories he did for the San Francisco Examiner and Wired about the photographer Pedro Meyer. Really interesting. (Embarassingly, Scott cites me at the very end.)

[Tags: photography realism journalism media everything_is_miscellaneous ]

6 Comments »

Berkeley’s Marti Hearst, who was way ahead of everyone else in faceted classification (e.g.,flamenco) , has written a a definitive book on user interfaces to search engines. And it’s up on the Web for free, if that’s the way you roll. Thanks, Marti!

[Tags: search google user_interfaces everything_is_miscellaneous ]

4 Comments »

Jeff Jarvis has a terrific, provocative post about the narcissism of newspapers in which he discusses a number of myths. The discussion afterwards is also really inte)resting. Here’s the comment I posted there (with a minor edit or two, all of which can really be reduced to the title of this post:

Terrific post and discussion. Thanks, Jeff.

May I add one more, related, myth to your collection, Jeff? Here goes: That it’s possible to cover the day’s events.

This is just a different way of putting your formulation “One man’s [sic] noise is another man’s news.” But I think it’s worth calling out since the promise of sufficiency is a big part of traditional newspapers’ promise of value to us: “Read us once in the morning, and after going through our pages, you will know everything you need to know.” (Do radio stations still make the ridicule-worthy “Give us 8 minutes and we’ll give you the world?” claim.) Yeah, no newspaper would ever maintain that claim seriously if challenged — they know better than their readers (or at least they used to) what they’re leaving out — but it’s at the base of the idea that reading a paper is a civic duty. The paper doesn’t give us everything but it gives us enough that reading one every day makes us well-informed citizens.

The notion that newspapers give you your daily requirement of global news — which works out to wondering, along with Howard, if there is such a thing as “news” — seems to me to be as vulnerable as the old idea of objectivity. Like objectivity: (1) It’s presented as one of the basic reasons to read a newspaper; (2) it hides the fact that it’s based on cultural values; and (3) it doesn’t scale well in the age of the Net.

Ultimately, this myth is enabled – as so many of the myths of news and knowledge are — by paper. Take away the paper and the newspaper doesn’t become a paperless newspaper. It becomes a network. That’s what’s happening now, IMO. From object to network … and networks are far far harder to “monetize” (giving myself a yech here) than objects.

(By the way, this is what I was trying to ask in the question I horribly botched at PDF. Sigh.)

[Tags: newspapers journalism everything_is_miscellaneous objectivity ]

4 Comments »

Steve Myers at Poynter has a good story about NPR’s crowd-sourcing Dollar Politics project. One element of it was a request for help identifying 200 people who attended a Senate hearing, some percentage of whom were lobbyists.

[Tags: everything_is_miscellaneous media crowdsourcing npr ]

Be the first to comment »

Todd Herman is a conservative who wants his team to be using the new tools better. Conservatives need to understand the rules of engagement better. The ecosystem favors Obama. How is that working and how can Conservatives work it? “Chairman Steele said ‘Take the lid off.” What would you do if you were me?” E.g., he’s excited by Vivek Kundra’s announcement and wants to bring the data to his site where Republicans can comb it for info. But how open should a political be? How open can it be? “Can a political party really be open?” “Can we be as open as Twitter? I would love it if we could.”

He points to a 1997 Republican site: A virtual town. Very 1997-cool. USAToday rated it as more fun than the Disney site. The Republicans “have been here before. There’s nothing genetically stopping us from using them.” He shouts out to http://en.wikipedia.org/wiki/Saul_Alinsky.

Q: How do you envision this change in tech with the underlying philosophical approaches changing the Rep party?
A: I love that our elected leaders can have pretty direct communication with the voters. I think it’s changing that way. But we need to change the rules of engagement, e.g., away from gotcha.

Q: [jay rosen] Cognitive dissonance while listening to you: You seem to address us as if you didn’t know that the Bush admin had an opacity agenda. E.g., Ashcroft’s 2001 memo saying err on the side of not honoring FOIA requests. So, I’d think the Reps should be asking why it was in favor of opacity.
A: It’s a long conversation. Todd points to some instances of the Obama admin’s lack of transparency. “I’d gladly buy you dinner to have a long conversation about it…”
Jay: Good enough! Where are we going?

You picked on DemocraticUnderground, but missed FreeRepublic. But you asked us socratically what we would do if we were you. What would you do if you were us and saw the way the REpublicans manipulated voter roles?
A: I don’t accept the premise, but my question goes both way.

[Great to have a conservative speaking. IMO, it'd would have been better if he hadn't used it as a way to address his political grievances, and instead solely focused on the issues of tech, politics, governance where we genuinely share interests. But, that's just me.]

[Tags: egov everything_is_miscellaneous e-gov pdf09 e-government e-democracy politics ]

Be the first to comment »

At Personal Democracy Forum, ChallengePost.com announces itself as a “marketplace for challenges” of theX Prize sort. You can create a challenge at their site, or create a “wish” by using #cpost at Twitter.

[Tags: xprize challenges markets everything_is_miscellaneous pdf pdf09 ]

Be the first to comment »

EverythingIsMiscellaneous.com was hacked by dirty stinking bad-hackers so that it was spewing Xanax ads. We think this was an XML-RPC exploitation. It’s now fixed (thanks Brad Sucks!), and I’ve asked that it be reviewed by StopBadware.org so that it will no longer be put behind a warning page. Sorry if this has inconvenienced any of you.

[Tags: everything_is_miscellaneous hacked ]

3 Comments »

I’m embarrassed to say that it’s been years since I’ve read Newsweek, so I may be the last to have noticed, but Newsweek is no longer a news magazine.

I picked up the June 16 issue somewhere for free — on a shuttle flight, I think — and thumbed through the offbeat, humorous, human-interest features, only to find myself at the back cover. Important note: I grabbed it because Stephen Colbert was advertised on the cover as “guest editor,” although except for a couple of funny essays, I don’t think that actually affected the content.

Newsweek and Time used to be your way to catch up on the week’s news. They covered the news. This particular issue of Newsweek made no such attempt. Rather, it had a theme: Iraq. The articles, in a 27-page section called “Features” (in a 68-page issue) included a photo essay, an essay on “how we’ll know we’ve won,” speculation on how we might commemorate the war, and articles on video games, West Point grads who are worried they’ll miss the war, families disrupted by deployments, Canada’s attitude towards conscientious objectors, soldiers who love battle, and a backgrounder on Iraq vs. Iran. Some of these were interesting articles, but they weren’t news of the week’s happenings.

As for coverage of events outside of Iraq: None…unless it made it into one of the fun sections, like the humorous quotes of the week.

The rest of the issue reads like blog posts: opinions, reviews, provocative essays, bright little snippets.

Not that there’s anything wrong with this. Coverage is one of those big, ingrained ideas that actually make little sense — like objectivity, except coverage makes much less sense than that. Newsweek’s problem is that now that it’s lost its news-in-a-capsule medicinal prescription, will people take the weekly dose, since it’s now competing with the monthlies (The Atlantic, Harpers, etc.) and even with the Sunday magazine that comes with your newspaper?

I doubt it. But it’s not like I have a better idea. With news now spreading at the speed of typing, would anyone today start a magazine that reports on what happened last week? Newsweek is right to decide that rather than attempting coverage it will focus on being interesting. The problem is that there’s an over-supply of interesting now, and it is likely to remain a buyer’s market.

[Tags: journalism media news everything_is_miscellaneous ]

2 Comments »

In my endless ego surfing, trying to fill an emptiness for which no number of trackbacks can suffice, I came across a posting about Everything Is Miscellaneous on the TWelchConsulting blog. Towards the end, the post says:

Imagine after Maria mastered that formula, this message appeared on her computer screen: “Maria, learners who enjoyed solving equations about one dimensional motion in physics with examples from space science also enjoyed . . . “

Sort of a cool idea…

[Tags: everything_is_miscellaneous education amazon ]

2 Comments »

Yesterday, I was sitting in the comfy chair, waiting for the dentist to come back with a larger mallet, browsing around on my Blackberry (“Your Knothole to the Web!”). I settled on part 5 of Akma’s series on exegesis. I like Akma, I’m interested in how we interpret texts, Akma’s Christian perspective deeply respects its differences with others, Akma is a genuine scholar, and he is a lovely, funny writer. What could be bad? Nothin’ that doesn’t have the word “dentist” in it!

So, there I am, in a three-minute interstice. Before the Web, I’d have been contemplating my aching stub of a tooth. Now I’m getting to spend time with a wise friend talking about something I barely understand. It feels like the Web has made Time itself better.

Sure, I’m just as likely to have clicked on a link to some gossip or a joke. Telling you about Akma served my twin nefarious purposes of pointing you at his series on exegesis and making me sound smart by reference. But, while the Web is not ubiquitous, it’s worth remembering how wonderful it is to for those of us who have ubiquitous access to it. That’s all. Just a little moment of thanks.

[Tags: misc everything_is_miscellaneous ]

1 Comment »

Michael Geist — Canada’s free-culture bulldog — summarizes a Harvard Business School working paper by economists Felix Oberholzer-Gee and Koleman Strumpf “File Sharing and Copyright” that argues that the inability to strictly enforce today’s draconian and clinically insane copyright laws has in fact benefited society. It’s been slashdotted.

Tags: copyright copyleft everything_is_miscellaneous

1 Comment »

Newsy, a project in collaboration with Univ. of Missouri’s Journalism School, pulls together a half-dozen media reports on a topic, stringing them together with their own reporter-at-a-desk commentary. The sources include mainstream news and less mainstream news. For example, here’s Newsy’s meta-coverage of China’s new Net blockage:

Newsy is a manual curation and production project. At least during this beta phase, it seems to be doing one or two a day, which means they may have more luck getting their stories embedded elsewhere than in drawing a regular crowd to their own site. In fact, the site has announced a syndication deal with Mediacom to provide stories for mid-Missouri cable tv subscribers. (The project is also probably a Fair Use lawsuit magnet, unfortunately.)

[Tags: media news missouri global_voices everything_is_miscellaneous newspapers journalism copyright copyleft fair_use ]

Be the first to comment »

DBpedia extracts information from Wikipedia, building a database that you can query. This isn’t easy because much of the information in Wikipedia is unstructured. On the other hand, there’s an awful lot that’s structured enough so that an algorithm can reliably deduce the semantic content from the language and the layout. For example, the boxed info on bio pages is pretty standardized, so your algorithm can usually assume that the text that follows “Born: ” is a date and not a place name. As the DBpedia site says:

The DBpedia knowledge base currently describes more than 2.6 million things, including at least 213,000 persons, 328,000 places, 57,000 music albums, 36,000 films, 20,000 companies. The knowledge base consists of 274 million pieces of information (RDF triples). It features labels and short abstracts for these things in 30 different languages; 609,000 links to images and 3,150,000 links to external web pages; 4,878,100 external links into other RDF datasets, 415,000 Wikipedia categories, and 75,000 YAGO categories.

Over time, the site will get better and better at extracting info from Wikipedia. And as it does so, it’s building a generalized corpus of query-able knowledge.

As of now, the means of querying the knowledge requires some familiarity with building database queries. But, the world has accumulated lots of facility with putting front-ends onto databases. DBpedia is working on something differentL accumulating an encyclopedic database, open to all and expressed in the open language of the Semantic Web.

(Via Mirek Sopek.) [Tags: wikipedia semantic_web everything_is_miscellaneous ]

4 Comments »

Stuart Shieber, one of Harvard’s Open Access ringleaders, has started a blog on that topic. He says it’ll be occasional — maybe per week, not per day — and it promises to be reflective and important to those who care about making more of the world’s research and knowledge available to, well, the world. (Stuart is the director of Harvard’s Office for Scholarly Communication, and was one of the important voices in the push for Harvard’s open access initiatives.)

[Tags: open_access stuart_shieber harvard everything_is_miscellaneous ]

Be the first to comment »

I’ve been poking around Microsoft’s Bing. The short answer is that it’s not going to move me off of Google. Of course, my Google inertia is pretty much sleeping-hippopotamus-like at this point. Plus, Bing’s ripping off of Kayak.com (see below) has me pretty cheesed.

Bing does some useful and clever things. But, I think some of the coverage has actually undersold Google. For example, Hiawatha Bray in the Boston Globe, whose writing I like a lot, today opens his review with the clever idea of searching for “google” at Bing and for “bing” at Google. He says Bing gives you a concentrated dosage of stuff about Google, while Google is all over the map with its “bing” results. Well, sure! “Google” is a made-up word with only one dominant meaning, so of course Bing gives you concentrated Google goodness. But “Bing” has lots of meanings, so Google’s right to return a mix of bingy words…with Microsoft Bing as the top result. Now, it is true that, as Hiawatha says, Microsoft gives its “Google” results in convenient tabs about Microsoft the corporate entity as well as listing sub-pages within the google domain, while Google’s top return on “Microsoft” only gives you a set of sub-pages. Microsoft looks more like WolframAlpha in that regard, and that’s a good way to look. But, Google also recently added easier ways to refine and expand searches (by timeline, by WonderWheel), etc., as Hiawatha points out. So, it really depends on what you’re trying to do. As always. (Type MSFT into either and you’ll get similar boxed stock data.)

Hiawatha writes: “Say you want the latest weather or traffic data. Google will tell you where to get it. Bing will just give it to you.” Not exactly. Type “weather” into either site and you get your local weather at the top, in pretty much identical displays. Google’s been doing that for quite a while. Likewise, type an airline and flight number and Google will tell you if it’s on time. But the “traffic” trick doesn’t work for Google. For that you have to go to Google Maps and click on the “Traffic” button (assuming you’re signed in). I wonder how long it’ll take Google to add Bing’s way of responding.

When it comes to shopping, Bing has some very nice touches. Well, primarily it has faceted classification — like NewEgg.com, and also using Endeca‘s engine? — that lets you sort a big list based on multiple criteria, using any of them in any order. Also, Bing has separate ratings by users and experts. On the other hand, Google found many many more copies of “splinter cell double agent” for sale than Bing did.

As many have noted, Bing’s handling of video searches is stellar. Hover over any of the thumbnails and the thumbnail starts to play. But, as someone pointed out — sorry, I lost the link — there seems to be no way to keep users from turning off the adult filter, which means that every school and library now has the greatest multi-screen porn browser ever invented. You can browse for porn videos on Google, of course, but with Bing it’s like watching all of them all at once. Well, maybe this will be like catching a kid smoking and making him smoke an entire pack all at once.

And now we come to Bing’s travel searches. OMG. Bing blatantly ripped off Kayak.com. [Disclosure: I'm old friends with the Kayak folks.] Just take a look at this post. If you’re going to rip off an innovative design, then at least innovate on top of it! Grrrr…

[Tags: bing google search wolframalpha everything_is_miscellaneous kayak ]

Later that morning: I just came across a very amusing article in Ars Technica about the new Google Squared app that puts info into tables. It makes clear why some sites (e.g., WolframAlpha) are willing to pay the price to gain the benefits of curation. (via Lee Baker, Berkman summer intern)

15 Comments »

Donald and Jill Knuth have posted about their collection of 962 photos of diamond shaped signs. The post points to two other sites about diamond shaped signs (1 2), as well as to a Google Maps mashup. To complete the webbiness, I heard about this via a tweet from nanofoo.

[Tags: everything_is_miscellaneous knuth diamond_shaped_signs signs traffic_signs road_signs ]

1 Comment »

E Ink has sold itself to Prime View International, a large Taiwanese display manufacturer, and I don’t understand why.

Now, it’s not surprising I don’t understand why. I have no info about E Ink’s financial state other than this article by Robert Weisman in the Boston Globe, and in any case I’m not a great financial guy (and I have the bank statements to prove it). So, my surprise may well be due to nothing but ignorance. Nevertheless, here’s why I was taken aback by the announcement.
E Ink is on a roll in a market that is about to explode (in the good sense). After ten years of work developing a low-power, highly legible display, it’s got something that works. Thanks to Kindle, it’s proven itself in the mass market and it’s in lots of people’s hands. And the market is about to take off now that we have digital delivery systems, a new generation of hardware, and a huge disruption in the traditional publishing market. So, why would E Ink sell itself?

The price — $215M — seems relatively low for such a hot product. If they need the money to fund R&D or to build manufacturing facilities, surely (= it’s not at all sure) there were other possibilities. Apparently the market crisis made an IPO implausible, although, to tell the truth, I — with my weak financial grasp — am not convinced. Investors are looking for places to invest, and E Ink looks like it’s exactly the sort of company they’d love to back: a proven leader in a market that’s obviously on the verge of explosive growth. It’d be like getting in on the early stage of iPods, only potentially bigger, since everyone who reads eventually will have an e-reader. But, if an IPO was out, why wouldn’t E Ink have preferred other forms of investment, including giving a partnership and equity stake to Prime View?

The most likely explanation by far is that I don’t understand what I’m talking about. Another explanation is that the company and its investors simply wanted to cash in by cashing out; the Globe article suggests this. But, that again raises the question of why they’d want to exit a company with a product in a market that’s about to take off. Perhaps they have reason to think the market is not going to take off , but that seems wrong; note that Google yesterday announced it’s going to enter the online book sales business. Or maybe they have doubts about E Ink technology. Maybe they worry the cost won’t drop fast enough for a commoditized market. Maybe color isn’t on its way fast enough. Maybe they’re worried about the inability (or so I’m presuming) of their tech ever to handle video, since the winning e-reader will eventually be multimedia. Maybe they know about ebooks on the way — Apple iPad or whatever the presumed product will be called — that will make static, black-on-gray pages seem obsolete.

So, I don’t know. But it smells fishy to me…although, as I may have mentioned, my financial sniffer has never been very reliable, and I’ll be happy to be set straight about this.

[Tags: e_ink kindle displays ebooks e-books everything_is_miscellaneous ]

8 Comments »

The Columbia Science and Technology Law Review is going open access:

…we’ve refined our author agreement (already very liberal) to explicitly ensure that authors retain their copyrights, and we’re making our agreement public on our website. At the same time, we’re also embracing open publication, formally putting our articles under a Creative Commons Non-Commercial No-Derivatives license, and allowing our authors to distribute themselves under even more liberal licenses if they so choose.

Yay!

[Tags: open_access journals law_journals everything_is_miscellaneous ]

1 Comment »

The article in Gizmodo that says that WolframAlpha is racist is ridiculous. Yes, if you search at WA for “dumb,” you get a graphic “synonym network” of associations that leads to “black,” but can we please apply the most basic rule of sympathetic reading and come up with the much more plausible explanation: The network goes from “dumb” to “dim” to a bunch of words related to “dim,” including “black.” This makes WA as racist as Google’s “wonderwheel” for “dumb” leading directly to “dumb blondes” makes Google sexist.

(BTW, those WA synonym trees are pretty useless, at least in Firefox, at least on my computer; hovering over a node doesn’t reveal which word it represents. Maybe it’s just my furshlugginer configuration.)

[Tags: wwolframalpha wonderwheel google everything_is_miscellaneous ]

2 Comments »

Wired.com reports that Data.gov has opened to “mixed reviews.” Puhlease. It’s nowhere near what it will be, but OH MY TOASTY GOD, our government is now committed to making public data available in open formats to anyone who wants it. As if it were normal! As if it were obviously the right thing to do! In open formats, people!

So, sure, let’s keep an eye on it. Let’s make sure the news permeates every government department. But first let’s swoon in delight.

[Tags: egov e-gov e-government democracy open_standards open_government everything_is_miscellaneous ]

1 Comment »

The Rosenberg spy case, which was a touchstone for the left and the right — or the pinkos and the McCarthyites, as it’s thought of in the Culture Wars — has been made more understandable by the Cold War International History Project by the creation of a Timeglide time line. It’s useful as a supplement to a narrative and as a way to drill down, although by itself it’s not the optimal way of telling the story, nor is it intended to be. (It may also work better for people with brainage opposite to mine.)

I’m not an expert in the case, so I can’t judge its accuracy or completeness. But it’s got lots of links to sources. And it’s a very nice way of organizing a mass of time-based materials.

[Tags: everything_is_miscellaneous history timelines rosenbergs ]

Be the first to comment »