inicio mail me! sindicaci;ón

Archive for Measurement

Social Computing Adoption … To Pilot or Not To Pilot

by Jon Husband

.

Further to my post a couple of months back about the ROII (Return on Investment in Interaction), I noticed AppGap blog colleague Patti Anklam’s guest post on Dave Snowden’s Cognitive Edge blog wherein she riffs of a blog post titled "Enterprise 2.0 – Skip the Pilot".

Notwithstanding Michael Idinipulos’ claim to be committing heresy, in the past I have read any number of E2.0 pundits’ suggestions that value will be realized more quickly and more steadily when social computing is introduced to an organzation as "the way things get done around here" when it comes to dealing with and responding the need to beuild useful knowedge from information flows … rather than in small controlled pilots.

Michael adds his voice to that chorus.

Patti picks up on that point and adds to it the notion that the ROII may come from harvesting the output from increased numbers of people, increased numbers of interactions and increased diversity (of perspectives).  These metrics are not as hard as past metrics used to measure work and effectiveness, but given that a number of well-known voices have coalesced around the same observable network dynamics, we can expect that they will come to be reference points regarding the effectiveness of adopting E2.0 tools and services.

.

Piloting Social Media

A good blog by Michael Indinopulis, "Enterprise 2.0: Skip the Pilot" introduces a nice complex notion. His actual premise is that piloting (the sense that we pilot collaboration software, something I’ve done quite a bit of) is based on using small control groups. We introduce the software carefully, exposing it to only a few people, learn from them what the strengths and weaknesses are, work up required training, make the change management plan, and so on.

But social media is different from traditional software. As he says, "Traditional IT enables transactions; Enterprise 2.0 enables interactions." And interaction is fundamentally different from transactions, which are bounded and constrained. We can’t understand the power of interactions until there are many of them, going out in multiple directions, increasing exponentially.

And there is no value to any individual until there are sufficient interactions bouncing around out there. The solution, therefore, to a moribund social media pilot is not to shut it down and reconsider, but to "Make it bigger. Open it up. Invite more people. Tell them to invite even more people. That’s the only way you’re going to find out the real behavior and the real value."

One of my early lessons about increasing knowledge flow in organizations was the answer to the question, "How do you stimulate knowledge flow in a network?" Possibilities:

Increase the number of people

Increase the number of interactions

Increase the diversity

.

Powered by Qumana

Share and Enjoy:
  • E-mail this story to a friend!
  • Print this article!
  • TwitThis
  • del.icio.us
  • Facebook
  • Reddit
  • Digg
  • Google
  • StumbleUpon
  • SphereIt

The Return On Investment in Interaction (ROII) – Using Twitter for Purposeful Contextual Social Search in Social Medical Networks

by Jon Husband

The Return on Investment (ROI) with respect to the use of social computing is a hot topic these days, as more and more organizations and business sectors are realizing social media and social computing are here to stay.  Indeed, I just finished co-authoring (with Jay Cross) an article for CLO Magazine laying the groundwork for a new approach to making decisions about investing in social computing capability and dynamics in business environments.  I’ll share an abbreviated version here in the next several days.

A number of other practitioners and theorists who pay attention to networks and their dynamics (such as FASTForward’s Jevon Macdonald and Joe McKendrick, Dion Hinchcliffe, Valdis Krebs, Matthew Hodgson, Patti Anklam, Jessica Lipnack, and others) have covered the same or similar ground.  It is becoming more apparent that the returns from network activities are found in intangibles that do not fit well into the industrial era concept of Return on Investment (an accounting concept used to make investment decisions in stable, time-defined, typically single-purpose use cases).  New assumptions and methods for assessing what to do are needed.

So, I’d like to use the reporting in a ZDNet article that caught my eye titled A Real ROI From Twitter ?  The Start of Social Medical Networks“  to discuss several of the key issues about whether or not to use social computing to achieve purposeful goals and objectives..

.

There may not be a big enough return on tweeting yet to report it to your CFO. But it won’t be long before there’s a clear, return on tweeting to report it to your doctor.

[ Snip ... ]

At the Autism One Conference in Chicago, a Web-based program for collecting data on individual cases of the brain development disorder will be unveiled. It’s called ChARMTracker and is designed, at the start, to help ease the burdens of each parent trying to keep track of the drugs, nutritional supplements, physical therapies and dietary tacks being taken to treat their sons or daughters. They will also use it to keep track of any observations about their behaviors that might seem pertinent and how their children are performing academically, as a result of the constantly changing constellation of combinations that are being applied to the still-mystic condition.

[ Snip ... ]

Horn has, for instance, collected 60 two-inch thick binders of observations, medical and supplement records about Sophie, over the last 11 years. Those records would be available to Sophie’s doctors and health care aides, in an instant, if ChARMtracker had been around from the start. They would also be part of a growing mound of evidence on how drugs, supplements, therapies and diet affected autistic individuals, as they grew and evolved.

[ Snip .. ]

Pramila has founded another company, MedicalMine Inc., which will take what she has developed and try to extend the approach to other chronic physical conditions and forms of disease management.

If all goes well, parents and patients will not just be collecting and sharing data through sites like this on the Web. They’ll be communicating with doctors and providing real-time evidence of results, through tweets and other instant messaging technologies. In some cases, sensors will provide constant streams of data that will be put into the record and analyzed, for individuals and the group, as a whole.

These social medical networks could wind up being “the most fundamental IT app” that a family or its friends need, when desperately seeking answers about afflictions suffered by anyone they care about.

For that, every data element – and every tweet – will count.

And, over the long haul, produce a calculable return.

.

So, to begin measuring increases in effectiveness and value in a networked social computing environment, please consider the concept of Return on Investment in Interaction (ROII), which we have derived from the principles of Metcalfe’s Law of Networks (as have many of the others cited above).  Why, you may ask, do the above excerpts portend being able to identify and / or assess Return on Investment in Interaction ?

Identifying and Measuring ROII (Return on Investment in Interaction)

The focus in purposeful networked environments is to do what’s important and involve those who know what’s important, why it’s important and what they know (or know how to find out) about a problem or issue.

Let’s define some core assumptions about ROII :

  • Continuous flows of information are the raw material of value creation and overall performance,
  • Information flows are carried by links, alerts, RSS feeds, search engines, aggregation and filtering of content, etc.
  • All leading social / collaboration platforms now feature social networking, search and computing capabilities,
  • These platforms’ architectures facilitate purposeful cross-silo communications and exchange.

Social networking pioneer Valdis Krebs has outlined four generic metrics that are becoming widely accepted as leading to observable, tangible, measurable outputs:

  • Increase in size of network  
  • Increase in internal network connectivity 
  • Increase in connection to valuable 3rd parties   
  • Increase in number of projects formed from all three factors above 

It’s important, we think, to note here that we are not proposing a definitive answer but rather the need to debate and clarify the issue(s). However, an attentive read of the ZDNet article referenced above clearly aligns with Krebs’ four principles:

1. Increase in size of network:  As The CHARMTracker database grows and the volume of families’ data it holds increases, it’s utility to doctors, other health care professionals and the families themselves increases.  And, as the article points out, if and when the data begins to be (appropriately) used by those networked around the health issues, the value of the interaction will increase in an (likely) exponential fashion.

2. Increase in internal network connectivity:  Again, as suggested by the paragraphs excerpted from the ZDNet article, as more and more participants are networked into the CHARMTracker information and begin to use the dynamics of social networks to seek for and circulate pertinent and useful information, each time a piece of information is useful to someone there’s a tangible return on the intangible capacity offered by the flows of information and knowledge.

3. Increase in connection to valuable 3rd parties:  As more information fills the CHARMTracker database, and more doctors, health care professional and families use it, the apparent value will become clear to others with expertise or value to provide to the social medical network that will have grown up around autism issues.  Expect to see both volunteer and for-profit services to be added to the growing ecosystem of knowledge and attention.  

This expected outcome reminds me of the core argument of Shoshan Zuboff’s book “The Support Economy – Why Corporation Are Failing Individuals and the Next Episode of Capitalism”, wherein she argues that the complexity surrounding many issues in today’s society are such that all sorts of people (consumers, families, professionals, and so on) will need “support” that can be designed, built and delivered via the digital interlinked infrastructure we know as the Web.

4. Increase in number of projects formed from all three factors above:  It’s pretty easy to imagine that as the CHARMTRacker database and its use(s) take root, there will be other clever and useful projects that grow out of the experience and the learning it affords.  Doc Searls, of Cluetrain Manifesto and VRM (Vendor Relations Management) fame once sagely noted that one of the critical outcomes of operating in purposeful social networks was the “scaffolding” (building in layer upon layer) of useful knowledge. 

That’s how circulating pertinent information and sharing useful knowledge works .. we don’t go backwards, we build on what’s useful and what works.  That’s how Return On Investment in Interaction will work and will deliver value to organization and groups who decide to use social networks, linked information and data, and social computing dynamics to accelerate their effectiveness towards achieving their purpose.

.

Share and Enjoy:
  • E-mail this story to a friend!
  • Print this article!
  • TwitThis
  • del.icio.us
  • Facebook
  • Reddit
  • Digg
  • Google
  • StumbleUpon
  • SphereIt

Social Media must be able to do things and get measured – KETC and the Mortgage Crisis

by Rob Paterson

Back in May, we started to think about how a TV Station could help its city cope with the then emerging mortgage crisis. Thanks to CPB, we at KETC got our chance to test our ideas that we could.

The test is over and the results are in. A major part of the project was measurement. We knew that emotion and anecdote – powerful as it is – would not be enough.

How do we measure media? In most cases on air we can get a sense of who is watching. On the web we know exactly who is watching. As we started the experiment to see if a Public TV station could help a community help itself we had to know more – we had to know if what we did – on air, on the web, in person and by measuring itself (Remember in Quantum the act of measurement affects the measured) had an impact.

Would what we did activate action?

Would what we did change perceptions?

Would what we did have a result in improving the health of our community?

Might acting as a social catalyst be the higher goal and role for public media?

Well dear readers, the research is in – yes to all of the above.

A huge thank you to Professor Dhavan Shah and his wonderful team at the University of Wisconsin

Ketccontentcallimpact

One of the points that we measured was the number of calls that the United Way got from people seeking help timed against our on air pieces. Here you can see a massive bump directly related to what we did.

Ketccontentimpact2

Ketccontentimpact3

There is more – we found that the act of measuring/surveying had also a huge impact

Ketcmeasureimpact

What do these numbers mean? Are they good, OK or mediocre?

Ketcanalysis

Ketcactionsummary

I have shared with you just the highlights – we have a lot more information that tells us that not only were we able to shift beliefs, motivate reaching out and action but also increase support for the station.

It is going to be fascinating to see what happens as this work spreads more broadly in the public TV and Radio world.

It’s one thing to bring good content and information to the public. It is another to be able to help activate the public to take back power and control into their lives.

I feel that we are on the edge of a breakthrough – the networked world is finding its place and its organization

Share and Enjoy:
  • E-mail this story to a friend!
  • Print this article!
  • TwitThis
  • del.icio.us
  • Facebook
  • Reddit
  • Digg
  • Google
  • StumbleUpon
  • SphereIt

Culture – The Secret to a 2.0 Organization

by Rob Paterson

What is the secret of a 2.0 organization? Is it merely the mastery of the tools?

If your organization is all about control and top down – it is unlikely that having a Wordpress site will take you to the new world of networks. To make a 2.0 world work for those you serve means that you have to have such a world working inside your organization.

So what do you do to get this? It is clear to me that we have made this shift at KETC in St Louis.

The context of this story is a project that KETC is working on to find ways of activating the community in St Louis to help reduce the pain of the mortgage crisis.

In so doing we are testing the big idea that Public Media can do more than bring Jane Austen to your TV screen. The CPB is testing this idea in St Louis and if we have enough progress – will expand the test to many other cities and stations.

So an important task that we have to fulfill will be to help the system replicate what we have done.

The easy part of this task will be the “Whats”. The Content we created, what we did on air, on the web, in meetings with the community etc. But I don’t think that only talking of the “what” will be very helpful. I think that it will be the “how” that is the real secret. The “how” will be about the new culture – the new set of work and social norms that are behind becoming a convener.

We surely have to become a Convener inside the station before we can have much a of a chance of being the Trusted Convener outside. That is the really hard work. I know that KETC has pulled this off. But how can I tell you about the how. How do you tell another about a new way of being?

This weekend while watching the Olympics I had an aha about the “How” that I would like to try here with you.

Here is a picture of the Canadian men’s 8 at the Olympics yesterday.

When all the 8 in the boat and the cox are aligned – something magic happens. All the effort is applied to the work. When this happens, you feel it. It is almost a spiritual feeling. It’s a form of magic. The boat just flies. You dissolve into a field that is the boat, the 8 and the cox. You are ONE. All friction and resistance is gone.

With a big race and your reputation on the line – the pressure to get aligned is huge – you can feel if one person is not there with you.

This is what it feels like in our KETC project meetings now. It feels like the boat is flying – it feels so good to be with the other members of the boat.

The pressure is there. As the guinea pig for Public Media we feel the eyes of thousands upon us. Upping the pressure to perform seems to help with transformation. Like heat applied to water creates steam or heat applied to iron with other things creates steel.

So creating pressure about results, time and scale is a first step. You don’t go gradually into this – you have to go full tilt.

We had no time. the project is only 3 months long. So there was no time to be incompetent. In the early days we had to re-arrange the boat a bit to get the team that could do the work and do it with the others. We could not tolerate anyone in the boat who could not pull their weight. We acted immediately when it was clear that the mission was being threatened. This is not the pub media way but it is the real community way. Real communities see everything and expect a lot. Real communities are not soft.

But after this initial shift – we know we have the right team. With the right team we build energy and confidence over time. There is a trust and a confidence in each other that has been developed by publicly and transparently experiencing the abilities of the others.

To get this transparency – we have a process that is built around all involved making public commitments.

It has developed by a simple part of the Project Management process – the day starts with asking each other for help. Every day we meet for 30 minutes to talk about what is going on and all the cards are face up on the table. We have learned to be explicit. Not rude but very clear. A very different norm from the past or most organizations. Accountability is fully visible.

This does not seem like the typical meeting that many of us have. It is very operational – what has to get done today and this week. But it is also very social. As trust has built there is also a lot of laughter and banter. The walls of the silos are coming down. We are finding that people who we did not know or trust much can be very helpful and that they can work miracles. Especially when the chips are down.

We have set major milestones and we have surpassed them all. Everyone has been tested in public. By being open – by being demanding in public – we are closer. Nothing is not unsaid anymore. You don’t have to whinge in the washroom. This is more than transparency – this is “clarity”.

So how does this happen? Well we are set up as I now see like an 8. The engine room is of course the department heads – they do the rowing. But it is the project management structure and discipline that makes the 8 go so well. So let’s look at this because all can replicate this.

First of all we have “Cox”. Not the project sponsor, not the President but the Cox (The Project Manager). In an 8, it is the cox – usually a very small person (Our PM is new and is very young but is an old soul) – who not only steers but who encourages and who works with the crew to respond to threats and opportunities as they happen on the water in the race. He is always pulling us back to the task. He is always asking the awkward question – he is always asking for more clarity. He uses humor and self-deprecation to get his way. But behind him is the power of the coach and the President. He can always use disappointment as power – “Do we really have to go to Jack about this?” usually settles most issues without escalation.

So the PM/Cox not only sets the process tone but also shows us how to use power as a convener. He uses personal power and almost never has to escalate because all the conversations are in the open – bad behavior – is obvious to all – social pressure ensures good behavior.

There is no doubt in my mind that Project Management is a key skill in the operation of a high performing organization. What it does is it keeps focus – it forces accountability – it manages the white space between the silos – for this is where the cooperation is demanded. For a while it all feels forced for this is new. But after 9 weeks it is our new normal.

Of course what is really happening is that the PM is “Convening”. He is holding the kind of open and trusted space that enables groups to work well with each other. The central process at KETC has become Convening.

We are also seeing that the project never ends. There is always complex work that is measured by outcomes to do. That raises another issue. Outcomes and measurement: in the old norm, we were soft on both. Now everything that we do has to have an objective and hence has to have a measure. This again was awkward at first but now is a new normal.

Which brings us to the “Coach”. The Coach in an 8 is not the cox. The coach’s work is all about ensuring that the goals are set and the capability is ready. We have such a role being played at KETC – the project Sponsor.

There is a lot of discipline in the role. The coach is not one of the guys. The coach pushes all the time. the coach has expectations.The coach sees the needs of the whole race/project. She sees how this race/project connects to others. She sees the development needs and she has an eagle eye on personnel. If someone is not working out, she has to deal with this.

Part of her power comes from her appointment. She has been selected by the “Club President”. She can escalate and does over personnel and budget issues. But she settles organizational issues from her position. But not all her power is delegated from the President. She has her own power based on her own achievements. For the coach is also rooted in their own talent. She has deep skills in a key area – Community Engagement. She has a track record of her own in getting tough jobs done well.

Finally we have the club president. He is responsible for the financial envelope – which provides the boat etc. This is a separate role to that of the Coach or the Cox. But in most organizations this person does all of this.

This is what I mean by Top Down organizations being political. They tend to be like medieval courts, where factions compete for influence and power. All the work happens in the corridors or in secret. Little is really visible. All in the end is decided by the King.

What is happening at KETC is that all the key work is now taking place in a process that is fully transparent. The President can look at the boat in the water and see all the workings. Accountability is clear.

  • Each rower has his or her part and they have to be visibly working with the rest of the 8.
  • The cox’s ability to get the boat running optimally in each race is clear to all – especially in the boat itself.
  • The results of the boat belong to the coach – her role is clear.
  • The resources for the club are the President’s role – and he is delivering and he also sets the tone.

The President in our case, asked the team for it all. He wants Gold in an Olympic setting and he asks for nothing less. In asking for all, he is getting it.

So that’s my metaphor. If you run your organization like a rowing team, if you set up the key roles as you find in a rowing team, you can make the shift inside from 1.0 to 2.0.

The irony is that the 2.0 world is more disciplined than the 1.0 world. But as you can see much of the discipline happens because of visibility and clarity. It’s like being in a small town. What you say and what you do can never be a secret. So your word and your actions define you. In a small town you also have to help each other.

In the 1.0 world of the huge city – there is little social pressure. All is anonimity. So there have to be rules and policemen and gaming the system.

Installing the kind of Project Management Process that we are using at KETC gives you a good shot at making this shift.

Share and Enjoy:
  • E-mail this story to a friend!
  • Print this article!
  • TwitThis
  • del.icio.us
  • Facebook
  • Reddit
  • Digg
  • Google
  • StumbleUpon
  • SphereIt

What will drive the change in media? Measurement and Money

by Rob Paterson

Today Google announce that content providers on YouTube will get real time analytics form those who watch the video. In TV terms – real time personal ratings!(NYT)

In a move to provide better data to its users, YouTube formally announced late Wednesday that it had added a free feature that will show video creators when and where viewers are watching their videos. With this, the company hopes to turn YouTube from an online video site into a place where marketers can test their messages, Tracy Chan, YouTube product manager, said.

This program, called YouTube Insight, provides a detailed view of a video’s popularity, both over time and geographically, broken down by state. (Internationally, YouTube Insight is not as insightful, providing only popularity by country.)

YouTube has provided basic analytical information to creators of videos since its introduction, including the number of views, the viewers’ ratings of the video, and the number of comments left. Advertisers received a slightly more sophisticated summary.

With the Insight information, video creators can dig into the specifics of a video’s performance and find, for example, that it peaks on Fridays in winter months, or it has taken several weeks to get traction — information that can help better promote their work. The information, presented as a color-coded map and a graph of a video’s popularity, is accessible through a link from a video creator’s account page on YouTube. The company will update the data once a day.

What does this mean? How will this accelerate the shift from traditional to social media?

yarmouthweb

Next week I will be publishing an interview with Brian Hurlburt who is doing a Sam Walton in local news/publishing in Yarmouth Nova Scotia. Brian has become the most important source of what is going on in a small town. One of the most important tools in Brian’s kit bag is measurement. He can show the local B & B, the church group, the activist group, the tourism folks what kind of traction they are getting on the web. They know exactly who is looking at them and how and why. Of course traditional advertising cannot do this.

Brian’s story I think is at the heart of the shift to come and the YouTube announcement fits into this context.

Brian’s experience is telling him that the money will leave the traditional media once there is only an initial base of people online. They will go to the new, even when the pool is not that large because what is there is so clearly measurable.

For isn’t mass media is really a lottery? Even when you win, you may not know enough about what happened. But with highly measurable new media, you can refine and refine until you get exactly what you want.

Now a small business in a small town can have TV ads. Access to the media itself is cheap. Making the video is cheap. With measurement you can tailor the offering to suit you best. Now even large businesses can have video ads that are fully measurable.

Why would you pay a regular TV station or a local newspaper for an offering that costs so much more and where you have no idea what will happen?

I think that we are going to see a major move here. I think that, just as Craigslist gutted Personals, so measurable web-based media will gut the rest of mass advertising. As the money flows so will the attention and the shift to online will accelerate.

The money will move because of measurement and it will move before the masses move to online. There is less time to respond that conventional TV, Radio and Print think.

This is surely why Google are working so hard on Analytics.

Share and Enjoy:
  • E-mail this story to a friend!
  • Print this article!
  • TwitThis
  • del.icio.us
  • Facebook
  • Reddit
  • Digg
  • Google
  • StumbleUpon
  • SphereIt