{"id":5015,"date":"2017-09-20T02:00:03","date_gmt":"2017-09-20T06:00:03","guid":{"rendered":"http:\/\/www.artsjournal.com\/engage\/?p=5015"},"modified":"2017-09-12T10:41:12","modified_gmt":"2017-09-12T14:41:12","slug":"evaluating-engagement-outcomes","status":"publish","type":"post","link":"https:\/\/www.artsjournal.com\/engage\/2017\/09\/evaluating-engagement-outcomes\/","title":{"rendered":"Evaluating Engagement: Outcomes"},"content":{"rendered":"<p><span style=\"font-weight: 400;\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-4911 alignleft\" src=\"https:\/\/www.artsjournal.com\/engage\/wp-content\/uploads\/2017\/04\/Clipboard.jpg\" alt=\"\" width=\"240\" height=\"211\" \/><\/span><\/p>\n<p style=\"text-align: justify;\">Evaluation of any kind is a challenge for nonprofit organizations generally and for nonprofit arts organizations in particular. Resource constraints and focus on mission, sometimes at the expense of critical management issues, make evaluation a frequent afterthought if considered at all.<\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">Evaluating community engagement is particularly difficult because it is in its infancy as a practice for arts organizations. As such, it is no surprise that techniques of evaluation specific to it are not nearly as advanced or as systematized as those available for fundraising, marketing, or other arts management functions. <\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">In addition, there are at least two vastly dissimilar categories of evaluation that are important for community engagement practitioners. One is, of course, evaluation of the outcomes of the work. The other, however, may be as important because it determines how successful any community engagement project can be. That is the effectiveness of the engagement process itself.<\/span><\/p>\n<p style=\"text-align: justify;\"><b>Evaluating Engagement Process Effectiveness<br \/>\n<\/b><span style=\"font-weight: 400;\">Last spring I presented an overview of my current thinking about evaluating the effectiveness of community engagement processes. (<a href=\"https:\/\/www.artsjournal.com\/engage\/2017\/05\/evaluating-engagement\/\">Evaluating Engagement)<\/a> It was (and is) based on four fundamental principles: strength of the relationship, mutually understood benefit to the parties involved, partnership in planning and implementation, and quality of the relationship maintenance plan. The last is extremely important because, due to the arts industry\u2019s focus on events it is easy to move away from a newly built relationship once the originating program is over.<\/span><\/p>\n<p style=\"text-align: justify;\"><b>Evaluating Engagement Results<br \/>\n<\/b><span style=\"font-weight: 400;\">Our principal attention today is the evaluation of engagement results. Evaluating the community outcomes of community engagement work, while still not widely understood within the arts industry, has the advantage of being directly related to the field of community development to which a good deal of thought has been given. Based on work by <\/span><a href=\"http:\/\/www.animatingdemocracy.org\/aesthetic-perspectives\"><span style=\"font-weight: 400;\">Americans for the Arts\u2019 Animating Democracy initiative<\/span><\/a><span style=\"font-weight: 400;\"> and the University of Pennsylvania\u2019s <\/span><a href=\"http:\/\/impact.sp2.upenn.edu\/siap\/\"><span style=\"font-weight: 400;\">Social Impact of the Arts Project<\/span><\/a><span style=\"font-weight: 400;\">, here are some rudimentary sample categories for various kinds of engagement projects.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Evidence of relationships<\/span><span style=\"font-weight: 400;\">, for example:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Participation by community members in discussions, surveys, events<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Press, social media mentions<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Instances of community seeking organizational assistance<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Evidence of mutual benefit<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Success in community-desired outcomes<\/span><span style=\"font-weight: 400;\">, for example:<\/span>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Decreased violence<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Increased school retention<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Reduced racism<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Evidence of success in organizationally-desired outcomes<\/span><span style=\"font-weight: 400;\">, for example<\/span>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Variety of new funding sources<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Increased ticket sales<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Vibrancy in programmatic offerings\u2013vibrancy in genres, styles\u2013reflecting influence of the community<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">As with any successful evaluation project, the intended outcomes must be articulated in the planning process rather than created after the fact. They are the means by which the project should be judged.(What&#8217;s given above are simply samples. Criteria specific to the project, arts organization, and participating community must be developed as part of the planning.) <\/span><\/p>\n<p style=\"text-align: justify;\"><span style=\"font-weight: 400;\">This aspect of the work demands extra time and thought on the front end and is a key reason <\/span><i><span style=\"font-weight: 400;\">any<\/span><\/i><span style=\"font-weight: 400;\"> evaluation, not just of community engagement, is ignored or avoided in practice. The tendency to shortchange evaluation is perhaps understandable in the context of the industry\u2019s extremely limited time and human resources, but it is also shortsighted and counterproductive. For ourselves, for our community partners, and for our funders, we need to be able to have information to improve our work and demonstrate its value.<\/span><\/p>\n<p>Engage!<\/p>\n<p>Doug<\/p>\n<p>Image:<span class=\"ccIcn ccIcnSmall\"><a href=\"https:\/\/creativecommons.org\/licenses\/by-nc\/2.0\/\"><img decoding=\"async\" title=\"Attribution\" src=\"https:\/\/s.yimg.com\/pw\/images\/cc_icon_attribution_small.gif\" alt=\"Attribution\" border=\"0\" \/><img decoding=\"async\" title=\"Noncommercial\" src=\"https:\/\/s.yimg.com\/pw\/images\/cc_icon_noncomm_small.gif\" alt=\"Noncommercial\" border=\"0\" \/><\/a><\/span> <a title=\"Attribution-NonCommercial License\" href=\"https:\/\/creativecommons.org\/licenses\/by-nc\/2.0\/\" target=\"_blank\" rel=\"noopener noreferrer\">Some rights reserved<\/a> by <a href=\"https:\/\/www.flickr.com\/photos\/143213400@N07\/\" target=\"_blank\" rel=\"noopener noreferrer\">sepyle86<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Evaluating Engagement: Outcomes as a follow up to an earlier post on evaluating engagement processes<\/p>\n","protected":false},"author":2,"featured_media":4911,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Evaluating Engagement: Outcomes as a follow up to an earlier post on evaluating engagement processes","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[10],"tags":[12,13,72,38],"class_list":{"0":"post-5015","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-the-practice-of-engagement","8":"tag-arts","9":"tag-community-engagement","10":"tag-evaluation","11":"tag-management","12":"entry"},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/www.artsjournal.com\/engage\/wp-content\/uploads\/2017\/04\/Clipboard.jpg","jetpack_shortlink":"https:\/\/wp.me\/p1G6h9-1iT","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":6612,"url":"https:\/\/www.artsjournal.com\/engage\/2022\/04\/assessing-engagement\/","url_meta":{"origin":5015,"position":0},"title":"Assessing Engagement","author":"Doug Borwick","date":"April 13, 2022","format":false,"excerpt":"The time has come to apply greater rigor to evaluating engagement processes, results, and the state of community engagement in the nonprofit arts industry.","rel":"","context":"In &quot;The Practice of Engagement&quot;","block_context":{"text":"The Practice of Engagement","link":"https:\/\/www.artsjournal.com\/engage\/category\/the-practice-of-engagement\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/engage\/wp-content\/uploads\/2017\/04\/Clipboard.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":4945,"url":"https:\/\/www.artsjournal.com\/engage\/2017\/06\/engagement-terminology\/","url_meta":{"origin":5015,"position":1},"title":"Engagement Terminology","author":"Doug Borwick","date":"June 21, 2017","format":false,"excerpt":"We need good definitions to make our work more effective. Here is an updated set from my perspective, for what it's worth.","rel":"","context":"In &quot;The Practice of Engagement&quot;","block_context":{"text":"The Practice of Engagement","link":"https:\/\/www.artsjournal.com\/engage\/category\/the-practice-of-engagement\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/engage\/wp-content\/uploads\/2015\/08\/Dictionary-300x202.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":4993,"url":"https:\/\/www.artsjournal.com\/engage\/2017\/08\/the-boards-role-in-community-engagement-i\/","url_meta":{"origin":5015,"position":2},"title":"The Board&#8217;s Role in Community Engagement: I","author":"Doug Borwick","date":"August 9, 2017","format":false,"excerpt":"The board of directors can and should be a supportive resource for community engagement.","rel":"","context":"In &quot;The Practice of Engagement&quot;","block_context":{"text":"The Practice of Engagement","link":"https:\/\/www.artsjournal.com\/engage\/category\/the-practice-of-engagement\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/engage\/wp-content\/uploads\/2017\/06\/BoardOfDirs-300x199.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":6345,"url":"https:\/\/www.artsjournal.com\/engage\/2021\/04\/benchmarking-maybe-not\/","url_meta":{"origin":5015,"position":3},"title":"Benchmarking? Maybe Not","author":"Guest Blogger","date":"April 14, 2021","format":false,"excerpt":"Benchmarking equity may not be effective. If it is attempted, it must be approached cautiously so as not to cause more harm than good.","rel":"","context":"In &quot;Guest Post&quot;","block_context":{"text":"Guest Post","link":"https:\/\/www.artsjournal.com\/engage\/category\/guest-post\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/engage\/wp-content\/uploads\/2021\/04\/SelenaAnguiano.jpeg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":4909,"url":"https:\/\/www.artsjournal.com\/engage\/2017\/05\/evaluating-engagement\/","url_meta":{"origin":5015,"position":4},"title":"Evaluating Engagement","author":"Doug Borwick","date":"May 3, 2017","format":false,"excerpt":"Evaluating Engagement: Criteria for (and measures of) effective engagement","rel":"","context":"In &quot;Principles&quot;","block_context":{"text":"Principles","link":"https:\/\/www.artsjournal.com\/engage\/category\/principles\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/engage\/wp-content\/uploads\/2017\/04\/Clipboard.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":4595,"url":"https:\/\/www.artsjournal.com\/engage\/2016\/07\/community-engagement-training-request-for-assistance\/","url_meta":{"origin":5015,"position":5},"title":"Community Engagement Training?\u2013Request for Assistance","author":"Doug Borwick","date":"July 20, 2016","format":false,"excerpt":"A request for advice on the need for and nature of community engagement training for the field.","rel":"","context":"In &quot;The Practice of Engagement&quot;","block_context":{"text":"The Practice of Engagement","link":"https:\/\/www.artsjournal.com\/engage\/category\/the-practice-of-engagement\/"},"img":{"alt_text":"Help?","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/engage\/wp-content\/uploads\/2016\/07\/Help-e1467384634528.jpg?resize=350%2C200","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/posts\/5015","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/comments?post=5015"}],"version-history":[{"count":5,"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/posts\/5015\/revisions"}],"predecessor-version":[{"id":5020,"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/posts\/5015\/revisions\/5020"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/media\/4911"}],"wp:attachment":[{"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/media?parent=5015"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/categories?post=5015"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.artsjournal.com\/engage\/wp-json\/wp\/v2\/tags?post=5015"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}