Creeping Inevitability: Search Engines Index Tweets

The Fail Whale

Microsoft’s search engine Bing has struck a deal with Face­book and the hot micro-messaging ser­vice Twit­ter, a brash attempt to add real-time web updates to its search results in order to make Google look like a lum­ber­ing dinosaur.

While we’re still digest­ing the news of Bing adding Twit­ter to its search engine, Google has some news of their own: they’re about to do the same exact thing.

Search­ing Twit­ter traf­fic ini­tially seems kind of odd.  Then, after a bit of thought, it starts to sound a bit bet­ter.  Finally, after a lot of reflec­tion, it starts to ven­ture into the realm of the bizarre.  Here a quick sum­mary of the stages of acceptance:

1 — Odd­ity:  Why would you want to add Twit­ter traf­fic to a search engine?  Twit­ter is all about quick thoughts between you and your ten thou­sand clos­est friends.  Search engines are sup­posed to be good at answer­ing ques­tions, and most ques­tions require more than 140 char­ac­ters to answer com­pletely.  (I’ll blithely ignore the ques­tion of whether most peo­ple doing searches actu­ally care about com­plete answers.)  On first blush, it doesn’t seem like a great match.

2 — Sense:  So why would Google and Microsoft be inter­ested in index­ing tweets, then?  Assum­ing it’s more than just a PR chasing-buzzwords stunt (not nec­es­sar­ily a good assump­tion, but…) how would index­ing tweets add value to the core of their search busi­nesses?  Well, if you treat tweets more as meta­data than search data, it starts to make more sense.  A good per­cent­age of tweets con­tain links, and once you fil­ter out spam you’re left with a lot of links that have been determined–by actual humans!–to be inter­est­ing.  Machine intel­li­gence is great, but humans are still bet­ter at fig­ur­ing out which pages are worth­while and which aren’t…this is the idea behind Mahalo and the like.  If Google and Microsoft can mine that data to improve the qual­ity of their hits, index­ing tweets sud­denly makes more sense.

3 — Non­sense:  But if that’s the goal, why make the tweets them­selves search­able?  That’s going back to treat­ing the tweets as actual data again, which seems ques­tion­able at best.  If peo­ple start to see their tweets show up in search engines that will change the way Twit­ter is used.  Right now it’s treated as an ephemeral medium; incor­rectly in the­ory, since Twit­ter is already search­able, but given how well Twitter’s search engine works, it might actu­ally be true.  With sto­ries pop­ping up all over the place remind­ing peo­ple to be cau­tious about what they put on Face­book or MySpace, does Twit­ter really want to be included in the list of ser­vices to fear?  I’m sure there are good reasons–probably money–for Twit­ter to get involved in this deal, but it’s not with­out risk.

via Bing Part­ners With Twit­ter and Face­book for Real-Time Search and  BREAKING: Google Announces Search Deal With Twit­ter.

Passing Through: 1stfans at the Brooklyn Museum

The Brook­lyn Museum has a pro­gram run­ning where they’re try­ing to use social media to expand the scope of their supporters:

The big change we’ve made is tak­ing some­thing that is all mar­ket­ing (mem­ber­ship) and turned it into some­thing that is about per­sonal inter­ac­tions and grow­ing the com­mu­nity. We’ve gone from a one-directional mem­ber­ship experience—we send you stuff again and again, and then you show up–to a tri­an­gu­lar rela­tion­ship where Shel­ley and I get to know the 1stfans, they get to know us, and they get to know each other.

The idea here is that they have a cer­tain num­ber of peo­ple who are will­ing to pay for a tra­di­tional mem­ber­ship and a cer­tain num­ber of peo­ple who use their free ser­vices, but they want to cre­ate a mid­dle tier that’s based on exclu­sive con­tent.  In this case, the exclu­sive con­tent is par­tially being dis­trib­uted via social media: a pri­vate Face­book group, pri­vate Twit­ter feed, etc.  They chose a price point of $20 and launched from there.

This pro­gram shows how hard it is to draw an audi­ence to exclu­sive con­tent.  It launched in Dec. 2008 and was tar­geted at 10,000 peo­ple who par­tic­i­pate in the museum’s free First Sat­ur­day events.  As of Feb­ru­ary, when the linked arti­cle was writ­ten, the paid pro­gram had 272 mem­bers.  I’m not sure what the total num­ber is now, but since the exclu­sive 1stfans Twit­ter account only has 218 fol­low­ers as of this morn­ing, it seems like it’s remained a very small per­cent­age of the total audi­ence the museum was tar­get­ing.  It seems to be a reminder that hav­ing an online audi­ence by no means implies that you have a mon­e­ti­z­able audience.

via Museum 2.0: 1stfans: An Audience-Specific Mem­ber­ship Pro­gram at the Brook­lyn Museum.

EDIT:  Will (from the linked inter­view) responds to this post in the com­ments with some inter­est­ing thoughts and points out a bad assump­tion on my part, you should take a look at those for a closer per­spec­tive on this.

Digestion: Users Love Stupid Content

Image by Kevin Marks

Image by Kevin Marks

Twit­ter has become a play­ground for imbe­ciles, skeevy mar­keters, D-list celebrity half-wits, and pathetic atten­tion seek­ers: Shaquille O’Neal, Kim Kar­dashian, Ryan Seacrest. Sure, some seri­ous peo­ple, like George Stephanopou­los and Al Gore, use Twit­ter. And a lot of pub­lish­ing com­pa­nies and blog­gers (myself included) use Twit­ter to send links to arti­cles we’ve pub­lished. But most of what streams across Twit­ter is junk. One recent study con­cluded that 40 per­cent of the mes­sages are “point­less babble.”

via Twitter’s Pop­u­lar­ity: Users Love Stu­pid Con­tent | Newsweek Daniel Lyons | Tech­tonic Shifts | Newsweek.com.

Really?  40% of Twit­ter mes­sages are “point­less bab­ble”?  Maybe it’s just me, but com­pared to tele­vi­sion, radio, blogs, and, well, every­day con­ver­sa­tions, that’s an amaz­ingly good signal-to-noise ratio.

While Daniel Lyons catches up with those of us who have seen Idioc­racy, a cou­ple of other thoughts:

  • $55 mil­lion in ven­ture cap­i­tal I can see.  But is some­body going to pay $1 bil­lion to acquire Twit­ter, the com­pany that has trum­peted how uncon­cerned it is with mak­ing money?
  • Twit­ter has an audience…but what kind of audi­ence is it?  Twit­ter users have become accus­tomed to fil­ter­ing their mes­sages pre­cisely because of the spam, inane com­ments, and mis­di­rected per­sonal replies that fill the net­work.  How respon­sive are Twit­ter users going to be com­pared to users of tra­di­tional web sites?
  • The intro­duc­tion of AdSense to gmail was one of the key moments in turn­ing Google from the “don’t be evil” com­pany into a bur­geon­ing Big Brother.  It was seen as sig­nif­i­cant for two rea­sons:  the ads were being placed in the con­text of per­sonal com­mu­ni­ca­tions, and Google was scan­ning email for key­words to tar­get ad place­ments.  Twit­ter would be vul­ner­a­ble to the first claim, but what about the sec­ond?  It seems like con­tex­tual place­ment would be the best/only way to effec­tively adver­tise on Twit­ter, but with that be sub­ject to as big a back­lash as gmail saw?
  • Twitter’s ser­vice is already pretty bad, quite frankly.  Con­stant server out­ages, flaky search, and no real sup­port sys­tem adds up to a ser­vice that prob­a­bly would have been aban­doned were it not free.  Are users going to put up with bad ser­vice when they have to see ads as well?  Are adver­tis­ers going to pay to place ads on a net­work that always seems to be a stiff breeze away from collapse?

Creeping Inevitability: Using Twitter Hashtags, Just Like Usenet!

Hash­tags are essen­tially a sim­ple way to cat­a­log and con­nect tweets about a spe­cific topic. They make it eas­ier for users to find addi­tional tweets on a par­tic­u­lar sub­ject, while fil­ter­ing out the inci­den­tal tweets that may just coin­ci­den­tally con­tain the same key­word. Hash­tags are also often used by con­fer­ence and event orga­niz­ers as a method of keep­ing all tweets about the event in a sin­gle stream, and they’ve even been used to coor­di­nate updates dur­ing emergencies.

via HOW TO: Use Twit­ter Hash­tags for Busi­ness.

Not a whole lot to say on the con­tent of the arti­cle itself as its pretty basic and self explana­tory.  What I find inter­est­ing, though, is the hash­tag idea itself.  It breaks the idea of a social net­work because you’re no longer just broad­cast­ing to your friends, you’re attach­ing a global tag that can be found any­where.  I won­der what would hap­pen if Usenet were intro­duced as a new prod­uct today?  That’s essen­tially what we’re look­ing at with tags, except for the char­ac­ter limits.

The fun part about Usenet was that it cre­ated com­mu­nity by start­ing with the tags (group names, as top­ics, are essen­tially just tags).  Twit­ter, though, starts with a loose com­mu­nity and has now emer­gently added tags to it.  What do the net­work maps look like for both ser­vices?  It seems to me that Usenet was actu­ally a more ‘social’ ser­vice in the sense that new com­mu­ni­ties were formed…users used to be more atomic, whereas now they’re more locked in to their indi­vid­ual, pre-determined cir­cles.  Not that Usenet was a utopia of course, even the groups that weren’t over­run by spam, porn, and bina­ries even­tu­ally devel­oped into impen­e­tra­ble tribal cliques…but that seems to be largely how Twit­ter is start­ing out.