Quote of the week/year/century

“I think that people have learned that money is not made in banks. It is made by real people working hard at real jobs. Actually, deep down we knew that all along. We just have to learn it again.”

Asbjorn Jonsson, third-generation Icelandic fisherman

The bubble of unreality that is Thursday afternoon

The Future of Web Apps spent thursday afternoon in that pleasant reality that is the most positive future.  What I mean by that was we were all buying into business as usual — there’s a rich VC market waiting to snap up and fund innovations and we all have a shot at being rich, well, any time now.

But before I get into that, here’s a review of this afternoon’s sessions:

Learning Journey

I missed most of Alvin Woon’s presentation, but took away this, badly paraphrased:  You can do user centered design with users that domn’t know what they want.  If users have never had it before, the can’t know what they want.  There’s something wise and hopeless in there.  Mostly a cry for iterating to solutions.  Building something new is learning, for all involved.  The learning journey is the key here.

XMPP and PubSub

Blaine Cook was back on the stage talking about XMPP and PubSub as a way out of endless wasted polling of site A by site B looking for, say twitter updates.  It sounds great.  I’m a huge fan of XMPP as a mechamism for handling the more complex connection cases than simple HTTP.  Good stuff.  I asked a question about the requirement of the server, now, to have to manage potentially millions of subscriptions.  Blaine says it will be no worse than current, but I’m still left feeling that my app that is PubSub aware is going to be having to keep some sort of state for the potential millions of connections.  I’m not sure about this, just a feeling.  I’m dying to do some XMPP experimentation soon, maybe with secret project BrightLunch or something.

Open Tech

Dave Recordon from Six Apart did some nice work on stage, putting the case for open standards, like OpenId, OAuth, microformats etc as the essential next steps in blowing the social web wide open to all.  Thanks Dave, it made sense and was a compelling case for all the pen tech that you and yours been working on.

Objective J and Cappucino

Thanks Francisco.  Interesting. Not sure I want or need Cappucino, though.  Unless I was quickly making a desktop app for the web, but not sure I want to replace a desktop app with a web app just because I can.  Sorry, but it all felt a bit 4GLly to me.  “We’ll solve all your problems for you, etc….”

The Pitch Competition

Are we noticing what is going on out in the real world?  The pitch comp felt a bit weird.  I’m sure I saw the panel talk down at a solid business model that might work now and encourage the pitcher to go for some model of giving it all away for free for a bit.   Maybe they were right, but I’m getting the feeling that we’re in a bit of an unreal bubble.  The economy and banks are in trouble, and we’re still going on like there’s a lot of hot VC cash for your ideas.  Is that true?  Or are we living in a cute little bubble for the next couple of days.

A great day all around, though.  Thanks Carsonified people, and especially Mike for the handwritten note on the postcard attached to my badge. And as the train pulls into Brighton, I’m ready to do it all again tomorrow,

Future of Web Apps: Thursday morning summary

I’m at the Future of Web Apps conference today and tomorrow in London.  Here are a few summary notes from this morning.

Note: this gets pretty technical in places.

The mornings’s theme seems to have been about operations and development isuses.

Digg Recommendations

Kevin Rose, from Digg, talked about Digg and the new Digg recommendations.  I’ve done lots of work in this area with our Recommendation Ventures web services, so it was really interesting to hear Digg’s experiences. A few points:

• When Digg added recommendations, they saw a 4 times increase in the number of people ‘friending’ other people, and a 40% increase in diggs (votes on news stories).  This goes along with the conventional wisdom regarding recommendations — they help keep visitors on your site longer and encourage interaction.
• Digg generates recommendations by clustering around keywords in their existing taxonomy. This generates better recommendations, by allowing a person to have differing interests, and generating and blending speciific recommendations for for those topic areas.  I suspect the do the clustering/bucketting to make the calculations less expensive, too.
• Digg have built custome graph stuff in Python to generate recommendations.  Nice to hear the Python namecheck there.

Web Applications

Edwin Aoki from AOL talked fairly generally about the Web Application Ecosystem..  A few points:

• Web apps have probably suffered from the release of a lot of device development kits this year:  iPhone, Android, more Flash development.  So, a step back into putting programs on devices rather than developing apps to run on all devices.
• Basically, end user consumers don’t care about open web standard and that.  They just want ot do stuff in usable apps.
• Web Services are important for building the fundamental services for creating enduring value, rather than another website.  (I think I got the point of that comment…)

Languages and Scaling and Operations

I guess every tech conference has to have a session to poke fun at programming languages.  Jokes cast at Ruby, PHP, Python and Perl by Joe Stump (Digg) and Blaine Cook (ex-Twitter). But some important points as well:

• languages don’t scale.  Scaling is something else, comes from actual systems architecture. (Therefore, who cares what language is used, keep developers happy)
• Web Apps need to be able to scale horizontally onto lots of small cheap boxes. Architect this in from the beginning to avoid pain later, but don’t sweat it too much.
• Capacity management matters.
• Use message queues.  Defer tasks into the background if you can.  This is essential when systems grow, and add lots of flexibility.
• Use caches such as memcache, but do it intelligently: cache invalidation is often a hard problem to solve.  Easy to add to the cache, harder to keep it consistent.
• Look out for herd-effects on cache invalidation: All servers then go and re-fetch data at once. Stagger invalidation times across servers.

Message Queues

Matt Biddulph from Dopplr talked about using message queues. Interesting stuff.  Basically, this is all about moving server processes into queues, so you can have one or more worker save servers to handle less-time-critical parts of the application in the background.

A few notes:

• Queues make life easy because:
  • Easy to add and remove slaves, which means easy scaling
  • Improve application performance by delaying things that don’t matter now to lower priority background processing
  • Easy performance monitoring .. look at the queues
• “Enterprise Integration Patterns by Hohpe, Woolf et al.” is worth reading.

Monitor your media coverage & conversations - low cost

Back in my dark old days as a corporate PR consultant, we had a room full of poor sods somewhere in the bowels of the machine, cutting out column cms from dead-trees-pages. Why? So we could justify our exorbitant fees and monitor our clients reputations. It was also so we could respond to a debate or manage an “issue”.

In some ways, nothing’s really changed. That is still going on, but many people would say the real action is now happening online. And the best thing is, I don’t have to feel sorry for the Google search spiders having to crawl through the myriad pages to retrieve what I want. It’s what they love best!

Here’s a helpful piece from E-Consultancy about how to monitor opinions, articles, conversations relevant to you and your organisation - without paying a brass razoo (in most cases).

Before you get cracking (because you know it’s time) - here’s a quick Nodestone guide to getting sorted.

1.  Know what your goals are

- Do you just want to know what being said about you online, or are you planning to enter the conversation (and if you are not sure, best you be reading up on the power of web 2.0, blogging and the social web. See our presentation here for a start.

- How far do you want to go and what resources do you have to manage your responses?

2.  What key words are most relevant to you

- Various spellings and shortened versions of your company, major projects/products and names of key people

- Competitors

- Major stakeholders (eg. legislators, major customers/shareholders, funding partners).

- The sector that you are in

- Other key words, eg topics you would scan for when reading a newspaper

3. How are you planning to circulate and act on what you find?

- If there is a live debate on a blog or in a forum about your key topics, what will you do? Who will be ready and able to respond to misinformation or genuine criticism?

- If there is a chance to offer a positive follow-up story to an influential blogger or mainstream journalist, who and how will (you) act?

- If there is a positive story about your project/organisation - what will you do? Who will you share it with?

- If there is an interesting story written, how can you use it in your own communications?

- Will you carefully subscribe to certain blogs or newsfeeds and read them?

Welcome to the great conversation of “us”. In some ways it’s never been easier. If you do nothing more than have a play with Google Alerts - you will learn a lot.

If you want to discuss a proper strategy about media monitoring and reputation management, give me a tinkle. We’ld love to help you improve your communications. It might be as simple as a short chat and a sign post to send you off in the right direction.