Blog

10 Things to Monitor with Agency Online Dialogues
Sunday, February 7th, 2010

Tim Bonnemann just put up a great post that suggests ten things to look for in the recently launched Ideascale dialogues by federal agencies. Tim’s focus is on the core things that could be improved upon relative to the open government dialogue that took place last summer.

It’s a good list and could represent a real break through if we had progress on many of the items. My guess is that there will be some progress on a few fronts and with some agencies, but that the speed with which agencies have had to pull together these dialogues will likely mean only moderate steps forward. It may be more realistic to think about these dialogues as a chance for agencies to experiment with a new platform and build up their skills, so it can be improved upon in future attempts.

Here are Tim’s ten things to look for:

  1. Expectation management: Is the agency clear about the scope of their participation initiative and their promise to the public? Do participants know what impact they can reasonably expect and when?
  2. Community ground rules: Every agency should have these “rules of engagement” in place and be ready to enforce them if needed. Bonus points for friendly, easy-to-understand language!
  3. Level of convener involvement/participation: Does the agency become actively engaged in the discussions?
  4. Quality of moderation: Will the agency manage to keep discussions on topic and moderate distractions in a fair but timely manner?
  5. Quantity of participation over time: How many participants will sign up? How much content will they produce? (luckily, IdeaScale exposes a few basic metrics in real time, such as number of ideas, comments, votes and registered users)
  6. Outreach and diversity of participants: Does the agency manage to attract a broad range of participants from various backgrounds? Or do usual suspects dominate the discussions?
  7. Conclusion and impact: This one will be especially interesting as there doesn’t seem to be an end date defined for any of these initiatives. In case of ongoing participation programs, does the agency at least share interim results?
  8. Tech support: Does the agency address technical support questions and resolve any issues in a timely manner?
  9. Project communications: Does the agency offer ways for participants to stay in the loop (or get up to speed quickly) with regard to current state of the discussion, frequently asked questions, highlights, interim results, next steps etc.?
  10. Mood: Overall, how happy is everyone with the process? What’s the energy level? Are things productive? Etc.
  1. Thanks! I agree we can’t expect perfect scores quite yet.

    I’ve spotted a few examples of dedicated moderators and staff engaging early in the process (answering questions, thanking participants for their contributions and enforcing the ground rules) which would be a clear improvement over the laissez-faire approach we saw in phase 1 of last year’s dialogue.