{"id":109,"date":"2011-10-03T15:19:09","date_gmt":"2011-10-03T22:19:09","guid":{"rendered":"http:\/\/www.artsjournal.com\/newbeans\/?p=109"},"modified":"2011-10-03T15:19:09","modified_gmt":"2011-10-03T22:19:09","slug":"the-evaluation-problem","status":"publish","type":"post","link":"https:\/\/www.artsjournal.com\/newbeans\/2011\/10\/the-evaluation-problem.html","title":{"rendered":"The Evaluation Problem"},"content":{"rendered":"

\"\"<\/a>Diane Ragsdale<\/a> and Devon Smith<\/a> have written tandem arguments about the difference and relative laxness of arts incubators over technology incubators. I won\u2019t go into all that they\u2019ve said, as you should be reading their blogs anyway, but in sum it comes down to an argument that arts incubators, rather than adopting the put up or shut up attitude of tech incubators, whose average support time is 33 months and at the end of which they let you fly or fall on your own, instead adopt a system that coddles companies and encourages them to stick around half-formed, like a college student on the couch.<\/p>\n

The honest truth is that we don\u2019t really prepare new arts organizations to function in the \u201creal world.\u201d Ragsdale, in her post, hypothesizes that 100 years or more of separating the \u201cfine arts world\u201d from the \u201cmainstream audience\u201d means that artists starting new organizations may feel less beholden to any bottom line or found audience. If I were to put it bluntly, I think it would go something like this: incubators, in those circumstances where they aren\u2019t effectively preparing the artists at the core of their new endeavors for the real world, sometimes end up instead preparing them to believe that the arts aren\u2019t really a collaborative enterprise between artist and audience, that they aren\u2019t beholden to the interests and attitudes of whatever segment of the world they hope to lure through their door, that because they are the genius\/next-big-thing, people will find them.<\/p>\n

And so, as Devon points out, they favor \u201cgood process\u201d (usually, here, artistic process) over good business practice. They\u2019re \u201ctoo nice.\u201d<\/p>\n

And yet, both because I know of fantastic incubator programs (see, for example, Intersection for the Arts (for organizations) or the still-launching artist residency program at Z Space) in which there are demonstrable goals, expectations etc. I wonder how much of this attitude towards arts incubatees (and the incubators who enable them) can really be laid at the feet of either the incubators on the fledgling companies.\u00a0\u00a0What I think is hardest to incorporate into those programs, even the good ones, is the dual-pronged fork-in-the-butt called evaluation. Prong 1: predictive benchmarking and modeling for financial success, and evaluating yourself against those benchmarks. It is not (much as it may seem to be) blasphemy to say that an artistic organization needs to be able to demonstrate the ability to draw an audience, and to further say that that organization be given a specified amount of time (and as much support as possible) to do so. Prong 2: evaluation of work. Just like it\u2019s not blasphemy to say that organizations are beholden to a bottom line, it\u2019s also not blasphemy to say that they are beholden to a certain quality of work\u2014here not necessarily meaning the flashiest costumes or the most expensive set, but meaning the alignment of audience expectations and satisfaction with the stated outcomes of a piece of work. No one who is trying to launch a company should be creating art for their own living room, unless there\u2019s a fundraiser going on in front of the fireplace.<\/p>\n

In both of these evaluative areas, we are currently failing our fledgling companies. As both Devon and Diane point out, while we provide desks and phones and space, maybe some internet access, in the tech world incubator projects are given access to the greatest minds Silicon Valley has to offer. They are given a strong, proven curriculum, a good chunk of money and the collective wisdom of the group in exchange for a percentage of future profits. They further are evaluated (and evaluate themselves) on a standard set of metrics that mean they always know where they are in relation to where they want to be.<\/p>\n

This method is, of course, messy. Fifty percent or more of start-ups fail in the first few years out of the nest, often taking all of that financial and intellectual investment with them. Sometimes, despite all odds, a start-up deemed a \u201cgreat idea\u201d flat lines because of shifts in the marketplace or new or different attitudes from the consumer. And this method may not be a perfect fit for the arts\u2014but we\u2019re not far enough along in the conversation to even judge that yet, are we?<\/p>\n

As we continue to examine the now-completed surveying (over 25,000 responses) associated with the intrinsic impact project, there\u2019s a lot that we haven\u2019t really teased out yet. But even just a cursory look at the responses make it clear that, for example, in multiple cases self-described \u201cedgy\u201d companies that felt their work would push their audiences into a lot of uncomfortable places generally don\u2019t, that while subscribers have basic loyalty to the company (and fill out the survey at a ratio of about 2 to 1) they generally are less impressed and impacted by any individual show, and that impact is not really at all dependent on the budget of the company, the size of the theatre or the relative \u201cquality\u201d of the parts. Some of this is confirmation of existing thinking, some of it is new\u2014but all of it, I think, provides a possible basic language for evaluation, both for members of the producing company and whatever support structures sit behind it.<\/p>\n","protected":false},"excerpt":{"rendered":"

Diane Ragsdale and Devon Smith have written tandem arguments about the difference and relative laxness of arts incubators over technology incubators. I won\u2019t go into all that they\u2019ve said, as you should be reading their blogs anyway, but in sum it comes down to an argument that arts incubators, rather than adopting the put up […]<\/p>\n","protected":false},"author":2,"featured_media":110,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[7,4],"tags":[],"class_list":{"0":"post-109","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-language","8":"category-main","9":"entry"},"_links":{"self":[{"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/posts\/109","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/comments?post=109"}],"version-history":[{"count":0,"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/posts\/109\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/media\/110"}],"wp:attachment":[{"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/media?parent=109"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/categories?post=109"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.artsjournal.com\/newbeans\/wp-json\/wp\/v2\/tags?post=109"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}