Michael Quinn Patton, “Measuring Learning: Developmental Evaluation”, Tamarack Institute, 2007/05/10

Measurements appropriate for a dynamic state may not be appropriate for a static state.

Michael Quinn Patton is an independent organizational development consultant and has written five major books on the art and science of program evaluation, including the influential “Utilization-Focused Evaluation,” first published in 1978, in which he emphasized the importance of designing evaluations to insure their usefulness, rather than simply creating long reports that may never get read or never result in any practical changes.

Michael’s most recent book, Getting to Maybe: How the World is Changed, a collaboration with Frances Westley and Brenda Zimmerman, was published in 2006.

Traditional evaluation is often about finding a model that can work across time and space, that can be replicated. The most wide-spread models of traditional evaluation include summative and formative evaluations.

Summative evaluations are usually done at the end of a program to assess whether the model that was proposed for the program worked. Formative evaluations are done at the beginning of a program while you’re working out the bugs and improving the model. You do a formative evaluation in to order get ready for summative evaluation — both assume that you can work out the best model, then proceed to implement it.

In developmental evaluation, you expect the world to be dynamic, so that you will never arrive at a summative state. In innovative processes, participants may find they never get to a model for very long, or in a meaningful way. Using a summative approach during a developmental stage of an innovative process may do harm by imposing a static data collection model on a very dynamic adaptive process. Looking for a recipe may force your community and the people in it to fit your model and your prescription – contrast this to the metaphor of raising a child – where there is no recipe, but you try different things until you find what works.

Developmental evaluation fits when a group needs ways to get periodic feedback, reflect on it, then act on it. The Stacey Matrix can be helpful to help a group determine if you need a developmental evaluation approach. The matrix measures the degree of certainty about the efficacy of an intervention and the amount of agreement there is within a group.

Learning Centre – Communities Collaborating for Impact

Interview MP3 audio

Q&A MP3 audio

Advertisements
About

David Ing blogs at coevolving.com , photoblogs at daviding.com , and microblogs at http://ingbrief.wordpress.com . See .

Tagged with: ,
Posted in Talk Audio Download
One comment on “Michael Quinn Patton, “Measuring Learning: Developmental Evaluation”, Tamarack Institute, 2007/05/10
  1. The evaluation is for improvement not for policing. However, people from developing countries need to understand. This approach and philosophy will work when people implement projects sincerely and honestly.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Beyond this media queue
This content is syndicated to Twitter. For professional perspectives, look to Coevolving Innovations; for a photoblog, look to Reflections, Distractions.
  • Android PDF links
    On Android Oreo tablet, reference links on my PDF book don’t show up via Adobe Acrobat nor Google PDF Reader.  Links show up with qPDF Viewer, Foxit PDF Reader & Editor, and Xodo PDF Reader & Editor.  Presumption of basic functionality by bigger names is untrue. Advertisements
  • Kubuntu 17.10 LaTeX textgreek.sty
    Under Ubuntu 16.04, building a PDF under TeXstudio worked.  Under Kubuntu 17.10 (with pdfTeX 3.14159265-2.6-1.40.18 (TeX Live 2017/Debian)), running the same input files resulted in: ! LaTeX Error: File `textgreek.sty' not found. These seemed like an error with reported in Feb. 2015, as “texlive-latex-extra: missing dependency – textgreek.sty requires l […]
  • 2017/11/07 10:15 Donna Dillenberger, “Cognitive Blockchain”, Cascon
    Plenary #cascon @DonnaExplorer IBM Fellow, IBM Research, Global leader of Enterprise Systems This digest was created in real-time during the meeting,based on the speaker’s presentation(s) and comments from the audience. The content should not be viewed as an official transcript of the meeting, but only as an interpretation by a single individual. Lapses, gra […]
  • 2017/10/25 09:30 Michael Mehaffy, “Horizons of Pattern Languages: Software, Cities, Planet”, PLoP
    Plenary @michaelwmehaffy Pattern Languages of Program PLoP2017 This digest was created in real-time during the meeting,based on the speaker’s presentation(s) and comments from the audience. The content should not be viewed as an official transcript of the meeting, but only as an interpretation by a single individual. Lapses, grammatical errors, and typing mi […]
  • 2017/10/21 08:35 Yodan Rofe, “The issue of ‘feeling’ as a criterion for choosing between different patterns or configurations (social and spatial)”, Purplsoc
    Plenary by Yodan Rofe #purplsoc Pursuit of Pattern Languages for Societal Change http://www.purplsoc.org/conference2017/ At Ben Gurion University of the Negev, Ph.D. from U.C. Berkeley This digest was created in real-time during the meeting,based on the speaker’s presentation(s) and comments from the audience. The content should not be viewed as an official […]
  • 2017/10/20 18:05 Christian Kohls, “Patterns for Creative Space”, Purplsoc
    Plenary @chrisimweb #purplsoc Pursuit of Pattern Languages for Societal Change http://www.purplsoc.org/conference2017/ This digest was created in real-time during the meeting,based on the speaker’s presentation(s) and comments from the audience. The content should not be viewed as an official transcript of the meeting, but only as an interpretation by a sing […]
Contact
I welcome your e-mail. If you don't have my address, here's a contact page.
%d bloggers like this: