Crowd sourcing works, here's some examples

Ever use a crowd to learn something? I have. Here’s some of my favorite ones:

1. What Netbook would you recommend?

2. Examples of “now” marketing.

3. Teaching me about microformats.

4. Top apps to load on your new iPhone 3GS.

5. Favorite Twitter app for iPhone.

6. A bunch of people’s favorite web sites.

7. Tools people use to build 2010 websites.

8. Hundreds of people teach me about “leadership.”

9. What apps/services people think should be included in a list of 2010 web ones.

10. What to do if you see FriendFeed spam.

11. What to use instead of PowerPoint to give presentations.

12. What should CIOs consider about the 2010 web?

13. Interesting groups of Twitterers.

14. Should you use Disqus, Intense Debate, BackType on your blog’s commenting system?

15. What kind of mountain bike do you recommend for $1000-$1,500?

There are plenty of other examples too, but most of these have very good answers and are participated in by dozens if not hundreds of people each.

Have you found other examples of where crowds were used to answer questions and where the answers that came back are better than what you can find elsewhere?

Real-time systems hurting long-term knowledge?

Whew, OK, now that I’m off of FriendFeed and Twitter I can start talking about what I learned while I was addicted to those systems.

One thing is that knowledge is suffering over there. See, here, it is easy to find old blogs. Just go to Google and search. What would you like me to find? Chinese Earthquake? Google has it.

Now, quick, find the first 20 tweets or FriendFeed items about the Chinese Earthquake. It’s impossible. I’m an advanced searcher and I can’t find them, even using the cool Twitter Search engine.

On April 19th, 2009 I asked about Mountain Bikes once on Twitter. Hundreds of people answered on both Twitter and FriendFeed. On Twitter? Try to bundle up all the answers and post them here in my comments. You can’t. They are effectively gone forever. All that knowledge is inaccessible. Yes, the FriendFeed thread remains, but it only contains answers that were done on FriendFeed and in that thread. There were others, but those other answers are now gone and can’t be found.

The other night Jeremiah Owyang told me that thought leaders should avoid spending a lot of time in Twitter or FriendFeed because that time will be mostly wasted. If you want to reach normal people, he argued, they know how to use Google.

And if you want to get into Google the best device — by far — is a blog. Yes, FriendFeed is pretty darn good too (it better be, it was started by a handful of superstars who left Google to start that company) but it isn’t as good as a blog and, Jeremiah argues, my thoughts were lost in the crowd most of the time anyway.

And that’s on FriendFeed which has a decent search engine (although it remains pretty darn incomplete. Here, try to find all items with the word Obama written in Washington DC on November 4th 2008. Oh, you can’t do that on FriendFeed and on Twitter search you can’t pull out the important ones and the location information is horribly inaccurate because it isn’t based on where a Tweet was done from, but from the tweeter’s home location).

Here’s an easy search: find the original Tweet of the guy who took the picture of the plane that fell into the Hudson. I can do it on FriendFeed after a few tries, but on Twitter Search? Give me a break. Over on Google? One click, but you gotta click through a blog or a journalistic report to get there. Real time search is horrid at saving our knowledge and making it accessible.

This is a HUGE opportunity for Facebook, which has more than 10x more users than Twitter and 100x more than FriendFeed.

Or, it’s how Google will get back into the social networking business and lock everyone out.

What do you say Larry Page?

Facebook: still a data roach motel when compared to Twitter and friendfeed?

Twitter has done something really remarkable: they have made the entire database of Tweets available to other companies. My favorite friendfeed is one of the beneficiaries of that “firehose” of data. You can watch my Tweets go from Twitter to friendfeed and back again. Oh, and friendfeed makes its firehose available to Twitter in return. You can see how this benefits both services. My liked items go from friendfeed to Twitter.

Now, what did Facebook do today? Well, it turned on an open stream API so that developers can put things into the stream over on Facebook. It also looks like developers can take some data off of the stream and use it in their own applications.

Loic Le Meur, CEO of Seesmic, has already shipped a version of Seesmic that does just that.

One big problem that Marshall Kirkpatrick, over at the ReadWriteWeb points out: Facebook is still keeping most of its users’ data private due to the privacy contract that it has made with its users. See, over on Twitter and friendfeed the bias for most user data is that it is public by default until you make it private (like, in friendfeed, you would have to open a room and make that explicitly private to be able to keep your data from going over to Twitter and over to Google. On Facebook it’s the opposite. If you use Facebook as designed your data only gets shown to your friends, not anyone else).

This is a HUGE difference between the openess of the Twitter/friendfeed model and the Facebook one.

Go see the comments on Marshall’s post. They are very telling about how poorly people understand what’s going on here and how they can articulate what they want.

The real elephant in the room is “where’s the money?”

The real money is in search. Yeah, I’m sure that someone at Facebook this afternoon will point out they are selling lots of display ads because they know their audience demographics pretty damn well (hint: Facebook knows EVERYTHING about who you are. I told it, for instance, that I’m a male 44-year-old democrat who loves skiing and photography, among other things).

But the REAL money has NOT shown up for Zuckerberg and crew yet. What’s that?

Search.

When I can ask Facebook “what sushi restaurants do my friends like?” ONLY THEN will you know that Facebook is getting close to the gold mine.

The thing is, Facebook doesn’t want to let you build that kind of business using its data.

THAT is reason #2 why Facebook isn’t going to turn on its real firehose for friendfeed to study, the way that Twitter has let friendfeed have access.

Reason #1, though, is that Zuckerberg hasn’t yet figured out how to change user expectations from having everything private by default to having everything public by default, the way Twitter and friendfeed work.

In an hour a group of us will be meeting with Facebook executives. If everything works out you’ll be able to follow along at http://live.twit.tv as part of a special Gillmor Gang at about 4 p.m. Pacific Time. I’ll definitely try to figure out how Facebook will change the default mode so that it can turn on the business social graph.

I also will find out if there’s a roadmap to opening up the data stream to include more data leakage outside of Facebook. If I were Zuckerberg I wouldn’t open that up until after I could change user expectations and get people to build a public instance of themselves. That could take a couple of years.

I wonder what you think of Facebook’s moves? Join us on the Gillmor Gang and over on friendfeed (we’re having a live chat about this post over on the beta friendfeed) and let’s see if we can learn something together about where Facebook is headed.

UPDATE: friendfeed cofounder Paul Buchheit just wrote this over on the live chat: “It’s not about defaults, it’s about ownership. On Facebook, you are not allowed to give other people access to your data, because your data belongs to Facebook. On FriendFeed or Twitter, you can choose to be public or private, but either way you can still access your data and do what you want with it.”

The newspaper industry just gave away another free meal, er Twitter: do they have any left?

I’m listening to Dave Winer and Jay Rosen “reboot the news.” Jay is a journalism professor and Dave is a geek that helped either birth or bootstrap all sorts of publishing technologies including blogging, RSS, OPML, XML-RPC, and more. So, hearing the two of them do an audio podcast every Sunday is very interesting.

I’ve been pretending in my head that I’m a newspaper exec. When I do that I keep beating myself around the face. Why? Because the newspaper industry keeps giving the geeks free meals. Let’s study the free meals:

Free meal #1. Giving away classified advertising to Craig’s List.
Free meal #2. Giving away photography to Flickr (look at the photos from the Chinese Earthquake, why didn’t this happen on a newspaper branded site?).
Free meal #3. Giving away front page news to blogs like Huffington Post.
Free meal #4. Giving away “small” community news like births, deaths, birthdays, etc to Facebook.
Free meal #5. Giving away real-time news to Twitter.
Free meal #6. Giving away news distribution to Google News and Amazon Kindle, among others. With new sites like Kosmix coming on strong (hundreds of percent of growth month over month).
Free meal #7. Giving away restaurant reviews to Yelp.
Free meal #8. Giving away traffic information to Google Maps.
Free meal #9. Giving away celebrity news to Facebook and Twitter. (Why is Oprah on both of those, and why didn’t the newspaper industry lock up Oprah and keep her on a newspaper brand?)
Free meal #10. Giving away local news to Topix (at least that was funded by a newspaper brand).
Free meal #11. Giving away business news to Yahoo Finance and Google Finance (and something new that will get announced tomorrow).
Free meal #12. Giving away news ranking to Memeorandum.
Free meal #13. Giving away astrology to Astrology.com.
Free meal #14. Giving away comics to Comics.com.

What is their latest giveaway? Crowd-sourced news. I visit Twitter Search every day to find out what is “hot news.” That’s something I used to look at newspapers and older media for (radio, TV) but Twitter is just plain better at telling me what is trending.

OK, so now my face is bloody because I’m seeing all the things the newspaper industry gave away. Do they have anything left to give away?

YES!

“OK, Scoble, you’ve lost it now, there isn’t anything left.”

Oh, you are wrong. There are still some tasty meals left. The rest of this post will be a plea to the newspaper industry to NOT give away the last things they have left.

Meal left #1: their distribution. About half of the houses in Washington D.C., for instance, still receive the Washington Post.
Meal left #2 (partially eaten): their understanding of the local community, although this is disappearing very quickly in many communities. I’d still rather read a New York Times review of Broadway Plays or restaurants than a Yelp review, but that is changing fast too.
Meal left #3: they still have journalists who can be paid to chew on something for a while (like go to Iraq to cover the war), although this is disappearing too. Sorry, I’ve watched the blog world and we aren’t willing to self fund longer term projects. We chase the fun short stories, or things that will get a quick hit on Memeorandum or Techmeme, but doing the longer stories that require doing real reporting with hundreds of sources, say, about what a politician is doing, just isn’t there.
Meal left #4: objectivity and accountability. I can argue that lots of journalists aren’t objective, but the truth is they are part of a system that adds objectivity and accountability as a system BEFORE publishing. Blogging and Twittering, I have noticed, can be objective and accountable, but it sometimes takes time to figure that out, especially when bloggers and twitterers don’t disclose their conflicts of interests up front.
Meal left #5: Systems for aggregating and archiving information. Far beyond what I’ve seen on most blogs or on Twitter. Here, find quickly the first four Tweets about the Chinese Earthquake. Now, why does the New York Times make it easier to find the front page of the paper the day they reported the Titanic sank?. Hint: they have this figured out in a way that Twitter and others just don’t.
Meal left #6 (partially eaten): they have brands that many people who are older, and therefore understand politics, business, sports, news, influence, wealth, and many other topics, love a lot more than Facebook or Twitter.
Meal left #7: They have news systems that are very robust. Do you have the Associated Press warning you about news events coming up? Newspaper editors do. Do you have a scanner and a team of people listening to the police full time? Newspapers do (or did).
Meal left #8: They have a room of curators. People who understand the news. Understand their communities. Who pick the top stories and who add understanding onto them with photos, graphics, headlines, etc. Believe me, I’ve been watching most bloggers and most of them suck at packaging their stories.
Meal left #9: Sources. The San Jose Mercury News can get into the Mayor’s Office. I can’t. Well, I probably could, but it would take a while to figure out who to call, what the stories are, who the gatekeepers are, etc. When I visited the Capital I had a journalist as a guide. If I didn’t have someone who was familiar with the Capital I would never have gotten past all the gatekeepers and I would not have been as effective.
Meal left #10: Relationships and an understanding of same. Most of us haven’t really thought about how the Mayor of our town is related to other people. Journalists study that in depth.
Meal left #11: a newsroom. I’ve been in a few newsrooms, including the New York Times. Being there gives you access to other people who care about the news. People who’ve been around a long time and understand how to get to the bottom of a story and how to tell it in the best possible way. You also have access to all the machinery of creating news. Can you afford a 300 mm F2.8 lens? I can’t. That costs $8,000, but the local newsroom probably has several. The New York Times even has a TV studio to shoot HD interviews that I can’t yet do.
Meal left #12: great opinion writers who understand the news system a lot better than most Twitter users. The New York Times even ran a post about that today, which is causing interesting conversation.

So, what is the next meal to be given away and, how could I, as self-appointed head of journalism, keep our industry from giving it away to yet another San Francisco geek with his or her hand out?

We are in the middle of moving to a real-time system for EVERYTHING. Tomorrow afternoon at about 4 p.m. Pacific Time a company called SkyGrid will show off just how this is true. But you already have plenty of taste in Twitter, Facebook, and especially, friendfeed. But those systems are still VERY UNSATISFYING.

That is where we could work together. Why don’t the geeks and the last remaining news organizations create something new?

Let’s start with Facebook and Twitter. They are onto something, but they have NOT nailed the monetization system. Mark Zuckerberg and his team at Facebook knows they are very close. Let me explain a little of how close they are.

To do that, first let’s go back to how people buy things. I’m in the middle of buying a mountain bike, so am studying this process very closely. Here’s the buying process:

1. Something created the need in my head to buy a mountain bike. In this case it was a doctor who told me I should exercise more. I have a great trail near my house. I don’t like swimming. I don’t like running anymore (did too much running in high school when I ran four marathons). I don’t like going to the gym. So, I’ve been looking for something more fun that will help me in my goal. My friend Luke wants me to surf, and that might play into it, but I like riding a bike and I like photography, so I want to carry a camera while mountain biking.
2. Now I’m researching. That means visiting stores. That means asking my friends. Talking about it on Twitter and friendfeed. Just a few minutes ago (while writing this post) I did just that and already have dozens of replies, all in live time!
3. Soon, this week, I’ll be buying. That’ll be the only time you can really monetize me.

So, let’s look at Facebook, Twitter, friendfeed.

Can they create the need? Absolutely!
Can they help you research? Yes!
But can they monetize? No!

That’s the opportunity Mark Zuckerberg has left open and it’s only open for a little while.

So, what can we do?

How about we create our own social network? One that is a meritocracy. Best participants get recommended. Not like Twitter where celebrities get recommended above people who are actually participating. Oprah, for instance, already is on Twitter’s recommended follower list despite only being on Twitter for three days. Huh? Twitter will come to understand why that’s a pretty stupid idea. Celebrities rarely will tell you where to buy a great mountain bike and even rarer will they answer your questions in live time. Come on, do you really hold delusions that Oprah will answer your questions? I don’t.

First, let’s start with cloning Twitter. It’s the simplest to clone. Heck, there’s already an open source system that did just that. It’s called Laconica.

But remember, what we really need is a search engine to pull interesting things out.

Here’s some use cases we’ll need to design that search engine to do:

1. Local establishments. When I am walking down University Ave (or any ave) I want to be able to say “show me sushi restaurants within walking distance.” Now, imagine if Facebook did that? Well, it could tell you “four sushi restaurants have been liked by 10 or more of your friends.” But it doesn’t store location information. Friendfeed? It can give you the real time metadata, but we need more to be able to really pull back just restaurants. Relying on comments and titles, the way its engine does now, will lead to lots of noise. And Twitter? Twitter doesn’t give us enough metadata to do much of anything except to know that a few sushi restaurants were retweeted a lot or that there’s one with a popular metatag.
2. Movie feedback in real time. I remember seeing movies with my team at 7 a.m. on release day when I worked at Microsoft (they bought tickets for lots of us and made us go early in the morning so that we’d be at work on time). The email lists would tell everyone else whether the movie was any good or not. So, why can’t we do that? And rate theaters at the same time?
3. News sharing. Already Twitter does THAT pretty well. I knew about the Chinese Earthquake while it was happening thanks to just watching Twitter. But months later? Try to pull out the important Tweets. I can’t. Over on friendfeed I can. Over on Facebook? Nope, because my friends started yelling at me when I pulled Tweets in there. They like baby photos and personal information, meant for close friends, but not a lot of news. Facebook is going to have a tough time getting over that.
4. Product feedback. I need a way to look for good feedback about all sorts of stuff. Dave Winer just bought a toaster oven that he has been raving about. Now go to Twitter Search and tell me about his toaster oven. I couldn’t find his info. Over on friendfeed I was able to find his info, but it’s unstatisfying, because I can’t see who else liked that particular toaster oven.

So, how do we build what I need?

I have some ideas. First, let’s assume we can match friendfeed. That’s already a tall order. That company was started by four superstars from Google. I’m not a superstar from Google.

But, I know that there are a few technology superstars at, say, the New York Times. I’ve met a few of them on my travels and there are a few others out there, too, and if we pool our efforts we could convince others to join us. There’s lots of engineers on the streets right now.

How about making a platform that would enable everyone to build their own little Twitter? You know, have a community of people that they could draw out of Twitter and over to your private community? Friendfeed is very close to that. Watch how I’m using Twitter to get my Twitter followers to answer questions over on friendfeed. But that means you’ve gotta have something that adds functionality onto Twitter over on our own site.

Look at my question on Twitter and friendfeed about mountain bikes again. What do you notice is missing?

1. Price data.
2. Comparison charts.
3. Separation of very credible and uncredible answers. Let’s say someone from Nike’s adventure team, who I believe is the winningest mountain bike team, comes over and answers my question. Why is his or her answer the same as everyone else’s? Doesn’t he or she have more credibility and authority?
4. Other metadata that shouldn’t be visible, like metatags. Maybe someone wants to connect my answers to another answer on, say, bike components. But why should that connection be visible? Today building such a connection in Twitter, Facebook, and friendfeed is not possible. So, how would we do it? Invisible comments and a command line interface. More on that in a minute.
5. My ability to mark different people as credible for different reasons. Let’s say the CEO of Specialized came over and commented on that thread. He would be credible, but he would be biased toward pushing Specialized. So, he’s not as credible as, say, someone from the Nike adventure team, at least when it came to bikes. He might be VERY credible when it comes to other biking topics, though, and even in bikes he’s more credible, than, say, me, who has no expertise in the industry.
6. Connection with existing resources. I like how Mahalo does this. If they don’t have a human-built connection they add algorithmic ones from Google.
7. Links to places to buy. Anytime I mention “mountain bikes” why doesn’t Twitter and friendfeed bring up a link to different mountain bike stores? Heck, even Amazon ships Mountain Bikes and if I included my affiliate link (I have not here) I would get paid some cash everytime someone bought a bike.
8. Comprehensive links to all the reviews that already have been done about the products that are getting mentioned in there. I have to manually put each one of them into Google to find more info. Why is that?

Here’s what I meant by “invisible comments.” Look at friendfeed. Each comment is a piece of metadata that can be used by the search engine. For instance, I can put “greattoasteroven” into a comment, like I did underneath Dave Winer’s toaster oven post, and now you can use friendfeed’s search engine to find it. But why does that “metatag” have to be visible? Here, let’s design an invisible commenting engine.

First, let’s invoke the invisible commenting engine. We could pick something like %%0, which is a string that would never get used. So, let’s design an invisble comment:

%%0 metatag=”greattoasteroven” This one could do metatags.
%%0 location=”25 Pinehurst Lane, Half Moon Bay, CA 94019″ This one could do location.
%%0 price=”$1,499″ This one could do price.
%%0 language=”german” this could tell the search engine to pull this entry up only if the speaker wanted german results
%%0 invisible=”Dave Winer is a nice guy.” This could be used to leave a comment for you, or for the search engine, but that wouldn’t be visible for the outside world. You could even use that to make things only visible to certain people, so you could have private conversations INSIDE the comment thread.
%%0 administrator=davew This one could make Dave Winer an administrator of the item, which would give his comments a different color, and would enable him to delete or edit comments on that thread.
%%0 post comment at 12:01 p.m. Pacific Time April 29, 2009: “this comment will appear on April 29th at 12:01″
%%0 credibility=10:davew This would mark Dave Winer as “highly credible” on this topic, and because everyone else has a default credibility of 5, would give him a different color and a star icon. You could then do the next invisible comment:
%%0 display credibility of >8 only (this would make only comments of people with credibility of 8 or above visible, once the user had invoked this).

Anyway, I could keep going all night long. In the real-time web having such a console would be important to be able to talk to the search engine. We could brainstorm such things all night long.

Now, isn’t that “geeky?” Yes. Would the celebrities that now are moving into Twitter get it? No AND yes!

See, while the geeks might be stuck with such a command-line interface, I expect that very quickly developers of applications like Tweetie, Twhirl, and TweetDeck would add on UIs to take advantage of the invisible functionality. You could click a “price” button in TweetDeck, for instance, which would show you the price of the bike you are now looking at (or allow you to input it as a Tweet-like message, if you knew the price).

This would build a very rich microblogging service and I think everyone else would want to build invisible comments into their system and interroperate with the ones we designed.

But, no, I suspect this whole post is for naught. I suspect that the newspaper industry will give away their last few meals to the geeks in San Francisco yet again.

Why is that?

Mike Arrington and I disagree on the future

[kyte.tv appKey=MarbachViewerEmbedded&uri=channels/6118/401143&tbid=k_3522&premium=true&height=500&width=425]

Last Saturday on the Gillmor Gang Mike Arrington wondered aloud whether Twitter had won a “winners take all” game and whether that meant that friendfeed was toast. He then wrote a blog post titled “FriendFeed is in danger of becoming the coolest app no one uses.”

If Arrington is right, then Friendster would have kept MySpace from happening. MySpace would have kept Facebook from happening. Facebook would have kept Twitter from happening.

The thing is that Arrington and I disagree about the future.

He is right about one thing. Twitter has won. It is now the favorite way for people to do microblogging. It LOOKS like a “winner take all” thing, right? After all, who will use a different service than all those celebrities now? To be serious we already know that Twitterers won’t switch, because last year Twitter was down all the time and no one switched, even when they were being abused by the technology.

So that game IS over and Arrington is right about that.

But, is the microblogging game where the cash is? No, I don’t think so.

Well, then, where is the cash?

Search.

“Huh?” I can hear you asking. “Twitter has real-time web search already.”

Yes, but it isn’t all that good.

Here, let’s demonstrate. Remember the plane that crashed in the Hudson?

I want you to find the original picture that someone sent in from their iPhone over Twitter.

Here, I’ll do the searches for you. Go to Twitter Search and type in Hudson Plane Crash. See all the noise? Yeah, the picture is there somewhere but it’s hard to find.

Now, here’s another search, this time using some of the filtering systems over on friendfeed. The picture stands right out.

See, what is going on here is that for search to work you MUST have metadata. Google built a multi-billion-dollar business on the metadata of linking. The next big business will build on top of the metadata of these three things:

1. Who shared or commented on an item. The search above I knew I had liked the picture, so I constrained the search to only things I’ve liked.
2. How many comments or likes are on an item. The search above I knew had tons of comments and likes, so I looked only for items that had more than five likes. That got rid of 95% of the noise.
3. What was said in the item. See on Twitter there’s only 140 characters and other people can’t add tags or info onto that item. On friendfeed I can leave a comment underneath a tweet and make it even more searchable. These comments get indexed in seconds now, which makes them very useful. I can add “cool tweet” to a Tweet and then search for that tweet later. Here’s an example.

NONE of these pieces of metadata are available in Twitter.

This is not just about friendfeed, either. Over on Facebook Mark Zuckerberg has a TON of extra metadata to study as well. He knows who has commented on each other’s walls or who has sent a message, so he knows who your “real” friends are.

Now, to be fair, Twitter does have some metadata to study as well. Retweets are metadata. Already Retweetfeed and TweetMeme are watching that metadata and there are other sites as well.

Twitter can also study hashtags, but I have been talking to people about why I think they are dead. Certainly hashtags are less relevant in the future.

But, notice what Twitter’s metadata is: it has to be included INSIDE a Tweet, where Facebook and friendfeed’s metadata is OUTSIDE the Tweet. Which gives you more characters to communicate with your friends.

So, why are the dollars in search and not just in microblogging?

Well, let’s look how people buy something.

Someone or something creates the need in their head to buy something. I have a baby on the way so I’m starting to look at strollers again since our old one isn’t good enough for a two-baby family.

That’s the “need.”

Then I start talking to my friends. That’s where Twitter and Facebook and Friendfeed come in. I also start researching. That’s where Google comes in and parenting sites and all that.

Then we make a decision. NOW that is the only place where monetization is possible.

Let’s say I decided on a Bugaboo stroller. I search Google for such. Notice all the ads along the right side!

Why are all those ads there? Because businesses know that’s where the money is. Not in blasting ads on the Superbowl. Not in bothering you with ads in my videos or on my blog, where there aren’t many people buying strollers.

No, they want to hit you AT THE MOMENT YOU ARE BUYING.

So, why would Bugaboo want to put ads inside your Tweets? Hint, they won’t. They won’t get many sales that way. But, what if you are searching for information on strollers? Absolutely! That means you’re looking to buy.

OK, here’s where we differ on the future.

We found our new doctor on Yelp. You’ll find all sorts of things this way in the future.

How about a restaurant? A plumber? A TV repair shop? A lawyer?

Consider that you’re walking down the street with a future version of Facebook or Twitter or friendfeed in your hand. You’re looking for a restaurant.

Which is going to be able to bring back the best restaurants that your friends care about?

That requires having metadata to study. That’s why Facebook copied friendfeed’s likes so that it can come back and say “there are four restaurants that have more than 20 likes from your friends within walking distance.”

Translation: the future hasn’t been built yet. That’s why Twitter has not won the entire game yet. That’s why this is a fun industry to watch.

Oh, and Mike, you only have 62 comments and 72 likes, which demonstrates you haven’t done enough with these systems to see the real value. I have 18,300 comments and 17,284 likes and now I have a database that ANYONE can search and find a LOT of value. Plus, I have now been to the future and you haven’t. Yet. You’ll get there. :-)

I gave my Twitter and friendfeed followers a look at the video I did, discussing our disagreement and here’s the comment area that erupted. Keep in mind that this is a live chat room and you can add comments and I’ll see and be able to answer them live on screen there. Oh, that’s something else that Twitter and Facebook can’t yet do. Like I said, I’ve been to the future. You should come and join me.

What I hate about real-time web (your productivity goes to hell)

For the past 12 hours I’ve had friendfeed running, along with another secret tool that’s coming in May that shows me news updating in real time, and another screen is running Tweetdeck here.

This is powerful stuff, I can talk with the world and see reactions coming in live. We’ve turned the Web from something that took weeks to discover new sites to a big chat room that pushes items at you in crazy fast manner and moves them down the screen.

More and more geeks are complaining to me that they can no longer keep up with Facebook, Twitter, friendfeed, and all the other things.

Linda Stone defined this problem as continuous partial attention.

I think it’s worse than that. Continuous partial inattention. I dare you to open up the new friendfeed in a window next to your work, point it at the aggregation of all the people I’m following, and try to get any work done.

Now, some of you are saying “well, unfollow.” But there’s something interesting for me in seeing all sorts of little conversations that hundreds or thousands of people are having.

The thing is I +can’t+ unfollow. Why not? You might say I’m addicted. Better people than me already have.

But there’s no going back for me. I will not give up this new world.

That means that we need new skills to deal with this new world.

One new skill? We now will share filters. I shared one with you in another post. Yesterday there was a big earthquake in Italy. Here’s a filter to help you find all the news about it. You can write me filters that will bring other things to my attention that I might miss in the stream of noise.

Other skills? We’ll need to build new news aggregation sites, like the “trending” feature on Twitter Search or Techmeme that will find the news “needles” in the stack of noise “hay.”

But right now we’re entering a period of transition. One where some of us will not be able to cope. Or we’ll be sucked in so deeply that we suffer career or family consequences. I’m struggling with the balance here myself.

I don’t know the answers here, other than to know that this new world does have its problems.

New friendfeed: Twitter that moves? Facebook filtering before Facebook?

Techcrunch has it up. Go see the new version. It’s wild.

More details coming shortly.

What I like about it:

Display is quite different, it no longer shows icons of aggregated services but instead looks more like Twitter.

Real-time. It’s all realtime.

You can direct message people who are following you.

There’s greatly improved filtering and searching.

There’s now a profile page.

You can now remove people’s entries from filtered display with Gmail like operators.

They’ve rethought the friendfeed rooms and made them more useful.

There’s a simplified API coming.

You can subscribe to likes and comments separately now as feeds.

I have videos of the friendfeed announcements that are uploading now. They will be up by noon at http://scobleizer.blip.tv

UPDATE: Thomas Hawk has his review up here. The new version will be up on http://beta.friendfeed.com soon (within minutes).