{"id":1760,"date":"2014-12-21T18:17:37","date_gmt":"2014-12-22T02:17:37","guid":{"rendered":"http:\/\/www.artsjournal.com\/worth\/?p=1760"},"modified":"2014-12-21T18:17:37","modified_gmt":"2014-12-22T02:17:37","slug":"problems-with-data-measuring-diversity","status":"publish","type":"post","link":"https:\/\/www.artsjournal.com\/worth\/2014\/12\/problems-with-data-measuring-diversity\/","title":{"rendered":"Problems with data: measuring diversity"},"content":{"rendered":"<p><a href=\"https:\/\/www.artsjournal.com\/worth\/wp-content\/uploads\/2014\/12\/north-korea.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-medium wp-image-1763\" src=\"https:\/\/www.artsjournal.com\/worth\/wp-content\/uploads\/2014\/12\/north-korea-300x169.jpg\" alt=\"just like Canada!\" width=\"300\" height=\"169\" srcset=\"https:\/\/www.artsjournal.com\/worth\/wp-content\/uploads\/2014\/12\/north-korea-300x169.jpg 300w, https:\/\/www.artsjournal.com\/worth\/wp-content\/uploads\/2014\/12\/north-korea-1024x576.jpg 1024w, https:\/\/www.artsjournal.com\/worth\/wp-content\/uploads\/2014\/12\/north-korea-750x420.jpg 750w, https:\/\/www.artsjournal.com\/worth\/wp-content\/uploads\/2014\/12\/north-korea.jpg 1280w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a>Diversity &#8211; in audiences, employees, and boards of trustees &#8211; matters to arts administrators, and to researchers who study organizations and societies. But how do we <em>measure<\/em> diversity?<\/p>\n<p>The <em>diversity index<\/em> is constructed like this: suppose everybody comes from one of four different population groups: Blue, Green, Purple and Red. Let the fraction of the population that is Blue be given by B, the fraction that is Green be given by G, and so on, where B, G, P and R are all numbers between zero (if nobody comes from that group) and one (if everybody in the population comes from that group). The diversity index D is found by taking<\/p>\n<p>D = 1.0 &#8211; B<sup>2<\/sup>\u00a0&#8211; G<sup>2<\/sup>\u00a0&#8211; P<sup>2<\/sup>\u00a0&#8211; R<sup>2\u00a0<\/sup><\/p>\n<p><span style=\"line-height: 1.5;\">If B = 0.4, G = 0.3, P = 0.2, and R = 0.1, then the diversity index D = 1.0 &#8211; 0.16 &#8211; 0.09 &#8211; 0.04 &#8211; 0.01 = 0.7. A lower value for D means less diversity. The lowest number D could be is 0 &#8211; that would be the case if everyone came from one group and nobody came from any of the others. For a population with 4 groups, the highest D could be is 0.75 (that&#8217;s what you get when B = G = P = R = 0.25).<\/span><\/p>\n<p>The diversity index has a lot of use across the sciences. Biologists can use it to compare the diversity of plant and animal species in an eco-system. Economists studying industrial organization can use it to measure whether a sector is highly concentrated amongst only a few firms (i.e., if most sales come from just one or two firms, rather than being spread equally over many firms).<\/p>\n<p>And of course we can use it to measure diversity in populations, either in general, or specifically regarding audiences or employees, and where the groups can be defined by race and ethnicity, or by religion, for example.<\/p>\n<p>This all sounds straightforward, but in fact there is a big problem underlying it. To illustrate, let&#8217;s take a recent post from Richard Florida at City Lab: &#8216;<a href=\"http:\/\/www.citylab.com\/politics\/2014\/12\/the-link-between-religious-diversity-and-economic-development\/372585\/\">The Link Between Religious Diversity and Economic Development<\/a>.&#8217;:<\/p>\n<blockquote><p>How does religion, and especially religious diversity, affect our economies?<\/p>\n<p>I decided to take a look using data from the Pew Research Center\u2019s Religion &amp; Public Life Project on \u201c<a href=\"http:\/\/www.pewforum.org\/2014\/04\/04\/global-religious-diversity\/\">global religious diversity<\/a>.\u201d The Pew data track the level of religious diversity, measured as the percentage of the population that belongs to eight major religious groups in countries around the world. These include the five major world religions\u2014Buddhism, Christianity, Hinduism, Islam, and Judaism\u2014which account for about three-quarters of the world\u2019s population, as well folk or traditional religions, the religiously unaffiliated (atheists, agnostics, etc.), and other religious groups (Baha\u2019i, Sikhism, Taoism, etc.). &#8230;<\/p>\n<p>Five key findings jump out from this analysis.<\/p><\/blockquote>\n<ul>\n<li>\n<blockquote><p>First and foremost, religious diversity is associated with the overall productivity and economic competitiveness of nations. Religious diversity is positively associated with total factor productivity (.32) based on <a href=\"http:\/\/microdata.worldbank.org\/index.php\/citations\/9122\">World Bank measures<\/a> and overall economic competitiveness (.56) as ranked by the World Economic Forum. It is also associated with higher levels of entrepreneurship (.37) based on the <a href=\"http:\/\/www.gemconsortium.org\/\">Global Entrepreneurship Monitor<\/a>\u00a0rankings.<\/p><\/blockquote>\n<\/li>\n<li>\n<blockquote><p>Pluralism is also associated with more urbanized societies, with a positive correlation to national levels of urbanization (.31).<\/p><\/blockquote>\n<\/li>\n<li>\n<blockquote><p>Religious diversity tracks key markers of social tolerance. It is positively correlated to the Gallup survey responses on the acceptance of racial and ethnic minorities (.45) and the acceptance of gays and lesbians (.31). There is an even stronger relationship between religious diversity and the treatment of women based on the <a href=\"http:\/\/hdr.undp.org\/en\/faq-page\/gender-inequality-index-gii#t294n117\">UN\u2019s Gender Inequality Index<\/a>, where more gender equal nations also have more religious diversity (.55).<\/p><\/blockquote>\n<\/li>\n<li>\n<blockquote><p>Pluralism is tied up with the broad shift to a post-industrial knowledge-based economy, as it is positively correlated with share of workers in the creative class (.42).<\/p><\/blockquote>\n<\/li>\n<li>\n<blockquote><p>Finally, pluralism is associated with the overall the happiness and well-being of nations. It is positively correlated with Gallup\u2019s <a href=\"http:\/\/www.gallup.com\/strategicconsulting\/en-us\/worldpoll.aspx\">overall measure of life satisfaction <\/a>(with a correlation of.32) and even more so with the United Nations\u2019 assessment of overall <a href=\"http:\/\/hdr.undp.org\/en\/statistics\/hdi\">human development<\/a> (.38).<\/p><\/blockquote>\n<\/li>\n<\/ul>\n<p>The Pew study can be found <a href=\"http:\/\/www.pewforum.org\/2014\/04\/04\/global-religious-diversity\/\">here<\/a>, its methodology <a href=\"http:\/\/www.pewforum.org\/2014\/04\/04\/methodology-2\/\">here<\/a>, and its results for all the countries <a href=\"http:\/\/www.pewforum.org\/files\/2014\/04\/Religious-Diversity-appendix-1.pdf\">here<\/a>. Note that the Pew study calculates diversity just as I did above, except (1) it has 8 types of religious affiliation (as opposed to my 4 groups), and (2) the index is scaled such that the number 10 represents maximum diversity.<\/p>\n<p>So what&#8217;s the problem? Look at the <a href=\"http:\/\/www.pewforum.org\/files\/2014\/04\/Religious-Diversity-appendix-1.pdf\">data<\/a>. Tied in diversity (at a rank considered &#8216;high&#8217;, though not &#8216;very high&#8217;) at a figure of 5.3 comes Canada, and &#8230; North Korea. Now I haven&#8217;t been to North Korea, but I did spend the first 3\/4 of my life in Canada, and based on what I have read of the DPRK, religious life is not very similar in the two places. In the &#8216;very high&#8217; diversity countries, we have a near tie between South Korea at 7.4 and China at 7.3, and again, I think most observers would say there is a pretty significant difference in religious life between the two.<\/p>\n<p>What&#8217;s going on? The problem <em>isn&#8217;t<\/em> in the data collection; I fully trust that Pew got the numbers right. The problem is in the index. To go back to my original example, the diversity index looks at diversity across Blue, Green, Purple and Red <em>without considering which groups are dominant<\/em>. And a country that is 90% Blue and 10% Green might be very different from a country that is 90% Purple and 10% Red, even though the diversity index will be <em>identical<\/em> in the two places.<\/p>\n<p>If you were wanting to use diversity as an explanatory variable about some aspects of policy or society in the US, would you treat a zip code that was 80% African-American and 20% white the same as one that was 80% white and 20% Asian-American? The diversity index for the two zip codes would be the same (0.2). Only if you thought that relative shares mattered, but that it did <em>not<\/em> matter who was in the majority, would the index be useful.<\/p>\n<p>The diversity index is only useful if all that matters is the relative shares in the mix regardless of which shares are which. Sometimes that can be useful, if, say, I am measuring species of butterflies in a field, or industrial concentration in energy production. But religion and race are trickier than that. And in those cases, skipping the index, and instead using actual shares by the different groups, is advisable.<\/p>\n<p>And so I don&#8217;t think Professor Florida has given us much to work with here.<\/p>\n<p>Academic footnote: I actually wrote a paper on this once, &#8216;A Note on the Use and Misuse of the Racial Diversity Index,&#8217; <a href=\"http:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/j.1541-0072.2008.00276.x\/abstract\"><em>Policy Studies Journal<\/em><\/a>, 36(3) (August 2008): 445-59.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Diversity &#8211; in audiences, employees, and boards of trustees &#8211; matters to arts administrators, and to researchers who study organizations and societies. But how do we measure diversity? The diversity index is constructed like this: suppose everybody comes from one of four different population groups: Blue, Green, Purple and Red. Let the fraction of the [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":1763,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[26],"tags":[],"class_list":{"0":"post-1760","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-issues","8":"entry"},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/www.artsjournal.com\/worth\/wp-content\/uploads\/2014\/12\/north-korea.jpg","jetpack_shortlink":"https:\/\/wp.me\/p3dIW5-so","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":2664,"url":"https:\/\/www.artsjournal.com\/worth\/2021\/05\/do-we-know-how-changing-prices-affects-the-income-diversity-of-audiences\/","url_meta":{"origin":1760,"position":0},"title":"Do we know how changing prices affects the income-diversity of audiences?","author":"Michael Rushton","date":"May 13, 2021","format":false,"excerpt":"In the very first few weeks of Econ 101 students are introduced to the \"demand curve\", relating how changes to the price of a product affect the quantity demanded of the product, all other things held equal. I've spent many years drawing these on blackboards, but they are a lot\u2026","rel":"","context":"With 3 comments","block_context":{"text":"With 3 comments","link":"https:\/\/www.artsjournal.com\/worth\/2021\/05\/do-we-know-how-changing-prices-affects-the-income-diversity-of-audiences\/#comments"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2021\/05\/price.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2021\/05\/price.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2021\/05\/price.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":2103,"url":"https:\/\/www.artsjournal.com\/worth\/2016\/09\/diversity-in-the-arts-where-are-we-now\/","url_meta":{"origin":1760,"position":1},"title":"Diversity in the Arts: Where are we now?","author":"Michael Rushton","date":"September 3, 2016","format":false,"excerpt":"The people at Createquity have put together a great piece on different ways of thinking about what has surely become the hot discussion topic in the art world: diversity. They reveal the depth and complexity of the issue, and provide many links worth pursuing. A good read. But still... Go\u2026","rel":"","context":"In &quot;issues&quot;","block_context":{"text":"issues","link":"https:\/\/www.artsjournal.com\/worth\/category\/issues\/"},"img":{"alt_text":"now we're talking","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2016\/09\/BSO.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2016\/09\/BSO.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2016\/09\/BSO.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2016\/09\/BSO.jpg?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":2130,"url":"https:\/\/www.artsjournal.com\/worth\/2016\/10\/viewpoint-diversity\/","url_meta":{"origin":1760,"position":2},"title":"Viewpoint diversity","author":"Michael Rushton","date":"October 27, 2016","format":false,"excerpt":"In a guest blog at Scientific American, social psychologist Clay Routledge asks whether American (and presumably this applies to other countries) universities allot an excessive amount of attention to racial, gender, and cultural diversity, but insufficient attention to viewpoint diversity. He notes that his own field of study is particularly\u2026","rel":"","context":"In &quot;issues&quot;","block_context":{"text":"issues","link":"https:\/\/www.artsjournal.com\/worth\/category\/issues\/"},"img":{"alt_text":"inside joke","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2016\/10\/diversity.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2016\/10\/diversity.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2016\/10\/diversity.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":4647,"url":"https:\/\/www.artsjournal.com\/worth\/2026\/02\/representation-and-portrayal-at-the-bbc\/","url_meta":{"origin":1760,"position":3},"title":"Representation and portrayal at the BBC","author":"Michael Rushton","date":"February 4, 2026","format":false,"excerpt":"At home we watch a lot of BBC-produced television. Some of it is very good, some of it is very silly, but we are entertained enough. Anyone who has seen older and newer episodes of shows will pick up on the fact that productions at the BBC have made an\u2026","rel":"","context":"In &quot;issues&quot;","block_context":{"text":"issues","link":"https:\/\/www.artsjournal.com\/worth\/category\/issues\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2026\/02\/image.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":2223,"url":"https:\/\/www.artsjournal.com\/worth\/2017\/07\/the-problem-with-ranking-cities-cultural-vibrancy\/","url_meta":{"origin":1760,"position":4},"title":"The problem with ranking cities&#8217; cultural vibrancy","author":"Michael Rushton","date":"July 10, 2017","format":false,"excerpt":"Two recent publications derive indices to rank different cities according to their cultural vibrancy - from the National Center for Arts Research in the United States, and the European Commission for European cities. They have the same fundamental problem. In each report, a selection of data series applying to cities'\u2026","rel":"","context":"In &quot;issues&quot;","block_context":{"text":"issues","link":"https:\/\/www.artsjournal.com\/worth\/category\/issues\/"},"img":{"alt_text":"not this again","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2017\/07\/whirlwind-computer.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":1846,"url":"https:\/\/www.artsjournal.com\/worth\/2015\/03\/a-policy-for-the-arts-the-white-paper-of-1965\/","url_meta":{"origin":1760,"position":5},"title":"A Policy for the Arts: The White Paper of 1965 (updated with a link)","author":"Michael Rushton","date":"March 5, 2015","format":false,"excerpt":"During the past few weeks the British art world has been marking the 50th anniversary of the publication of A Policy for the Arts: The First Steps, a White Paper authored by Member of Parliament Jennie Lee, presented to Parliament on behalf of the Labour government of the time (on\u2026","rel":"","context":"In &quot;issues&quot;","block_context":{"text":"issues","link":"https:\/\/www.artsjournal.com\/worth\/category\/issues\/"},"img":{"alt_text":"tasteful","src":"https:\/\/i0.wp.com\/www.artsjournal.com\/worth\/wp-content\/uploads\/2015\/03\/IMG_0810-e1425599780648-225x300.jpg?resize=350%2C200","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/posts\/1760","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/comments?post=1760"}],"version-history":[{"count":4,"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/posts\/1760\/revisions"}],"predecessor-version":[{"id":1765,"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/posts\/1760\/revisions\/1765"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/media\/1763"}],"wp:attachment":[{"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/media?parent=1760"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/categories?post=1760"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.artsjournal.com\/worth\/wp-json\/wp\/v2\/tags?post=1760"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}