As mentioned in my post last week, transformations are changes in knowing, doing, and being. After identifying what the transformations are that a program or service purports to facilitate, evaluating those transformations can then inform program improvements and be used to communicate value to stakeholders.
Measuring transformations at different points in time provides insight in the evolution of behavior. Measuring indicators right after the program that would show a change in knowing. As a participant then begins to apply that learning, following up in the weeks following the program could show a change in doing. Checking back in three months down the road to see how the patron’s behavior is changed shows a longer term outcome in being.
For example, Hack the News in a teen program at the library teaches about HTML and how websites are built. Quizzing teens on what certain markup tags do is one measure of their change in knowing. Evaluating the remixes students make or other content original content students create using HTML after learning the skills is a measure of changes in doing. Checking in with the same students months later about changes in how they communicate and participate on the web - from manipulating layout or personal websites to embedding more content on blogs to expand into other coding languages - measures changes in being.
For one of the transformations your pilot site is working towards, please list some possible changes in knowing, changes in doing, and changes in being.
Unsure what the transformations a program or service enables are? Try creating a Theory of Change to outline transformation progression from knowing, to doing, to being! A Theory of Change shows a progression of steps an individual takes through a program using a series of “so that” statements and outlines the change each step encourages along the way to the ultimate outcome.
This helps identify the steps where one should focus evaluation activities to demonstrate impact. Read this article for more.
I would love to hear from you about transformations this pilot is supporting or any questions/comments you may have!
University of Washington, TASCHA