A New Twist on Arts Education and Test Scores
The organization I work for is fortunate, very fortunate indeed to have a grant from the USDOE as part of its Arts Education Model Development and Dissemination (AEMDD) program.
It is near impossible to be awarded one of these highly competitive grants unless you have a quasi-experimental research design as part of the overall project design. Essentially what makes it a quasi-experimental design is that it lacks a randomized control. It does have a control group (otherwise it would be a non-experimental design), and the common lens of research across all of these USDOE AEMDD grants is standardized test scores in ELA and math.
The USDOE is particularly interested in the question of how the project or let's use the term "treatment" will affect the ELA and math test scores for those students who participate versus students of similar demographics that do not.
Today more than ever, using the state ELA and math tests raises a very complicated question that you might not have dealt with or considered a few years ago. It is provoked by the test scores having risen dramatically across New York State over the past couple of years, in nearly every school district regardless of the approach of the individual district.
So, you've got scores catapulting across the State of New York, no matter what the treatment, reform, intervention, and here we are trying to measure our program using these very same test scores.
Yes, of course, the research will still report out on the differences between students in the program and those who are not. So, what's the big deal you might ask?
But wait, consider this: the gold standard of ELA and math assessment, the NAEP scores, are at odds with these increases. And there's even more, including a fair number of people in education who are either reporting or suspecting an increase in cheating, or scores being changed by educators as an outgrowth of the increasing stakes associated with these tests.
Do you see a problem?
No? Yes? Maybe?
All this has led many to question the validity of these tests. The Chancellor of the New York State Board of Regents, Merryl Tisch, recently addressed this issue by saying that the tests would be revised to make them less predictable.
So, you might have thought this post would be the usual jeremiad against standardized testing leading to a narrowing of the curriculum. Nope, this is an altogether different twist, essentially centered in fundamental questions about the validity of research components that are based on these test scores.
Now, to be fair, we are looking at a host of other issues, both qualitative and quantitative. But, when considerable questions are being raised about the standardized tests themselves, it positions whatever research you might be doing on the effects of your program on ELA and math tests to prospectively be an even bigger house of cards than ever before.

It is near impossible to be awarded one of these highly competitive grants unless you have a quasi-experimental research design as part of the overall project design. Essentially what makes it a quasi-experimental design is that it lacks a randomized control. It does have a control group (otherwise it would be a non-experimental design), and the common lens of research across all of these USDOE AEMDD grants is standardized test scores in ELA and math.
The USDOE is particularly interested in the question of how the project or let's use the term "treatment" will affect the ELA and math test scores for those students who participate versus students of similar demographics that do not.
Today more than ever, using the state ELA and math tests raises a very complicated question that you might not have dealt with or considered a few years ago. It is provoked by the test scores having risen dramatically across New York State over the past couple of years, in nearly every school district regardless of the approach of the individual district.
So, you've got scores catapulting across the State of New York, no matter what the treatment, reform, intervention, and here we are trying to measure our program using these very same test scores.
Yes, of course, the research will still report out on the differences between students in the program and those who are not. So, what's the big deal you might ask?
But wait, consider this: the gold standard of ELA and math assessment, the NAEP scores, are at odds with these increases. And there's even more, including a fair number of people in education who are either reporting or suspecting an increase in cheating, or scores being changed by educators as an outgrowth of the increasing stakes associated with these tests.
Do you see a problem?
No? Yes? Maybe?
All this has led many to question the validity of these tests. The Chancellor of the New York State Board of Regents, Merryl Tisch, recently addressed this issue by saying that the tests would be revised to make them less predictable.
So, you might have thought this post would be the usual jeremiad against standardized testing leading to a narrowing of the curriculum. Nope, this is an altogether different twist, essentially centered in fundamental questions about the validity of research components that are based on these test scores.
Now, to be fair, we are looking at a host of other issues, both qualitative and quantitative. But, when considerable questions are being raised about the standardized tests themselves, it positions whatever research you might be doing on the effects of your program on ELA and math tests to prospectively be an even bigger house of cards than ever before.

Categories:
AJ Ads
Introducing
AJ Arts Blog Ads
Now you can reach the most discerning arts blog readers on the internet. Target individual blogs or topics in the ArtsJournal ad network.
Advertise Here
AJ Arts Blog Ads
Now you can reach the most discerning arts blog readers on the internet. Target individual blogs or topics in the ArtsJournal ad network.
Advertise Here
AJ Blogs
AJBlogCentral | rssculture
About Last Night
Terry Teachout on the arts in New York City
Terry Teachout on the arts in New York City
Artful Manager
Andrew Taylor on the business of arts & culture
Andrew Taylor on the business of arts & culture
blog riley
rock culture approximately
rock culture approximately
critical difference
Laura Collins-Hughes on arts, culture and coverage
Laura Collins-Hughes on arts, culture and coverage
Dewey21C
Richard Kessler on arts education
Richard Kessler on arts education
diacritical
Douglas McLennan's blog
Douglas McLennan's blog
Dog Days
Dalouge Smith advocates for the Arts
Dalouge Smith advocates for the Arts
Flyover
Art from the American Outback
Art from the American Outback
Life's a Pitch
For immediate release: the arts are marketable
For immediate release: the arts are marketable
Mind the Gap
No genre is the new genre
No genre is the new genre
Performance Monkey
David Jays on theatre and dance
David Jays on theatre and dance
Plain English
Paul Levy measures the Angles
Paul Levy measures the Angles
Real Clear Arts
Judith H. Dobrzynski on Culture
Judith H. Dobrzynski on Culture
Rockwell Matters
John Rockwell on the arts
John Rockwell on the arts
Straight Up |
Jan Herman - arts, media & culture with 'tude
Jan Herman - arts, media & culture with 'tude
dance
Foot in Mouth
Apollinaire Scherr talks about dance
Apollinaire Scherr talks about dance
Seeing Things
Tobi Tobias on dance et al...
Tobi Tobias on dance et al...
jazz
Jazz Beyond Jazz
Howard Mandel's freelance Urban Improvisation
Howard Mandel's freelance Urban Improvisation
ListenGood
Focus on New Orleans. Jazz and Other Sounds
Focus on New Orleans. Jazz and Other Sounds
Rifftides
Doug Ramsey on Jazz and other matters...
Doug Ramsey on Jazz and other matters...
media
Out There
Jeff Weinstein's Cultural Mixology
Jeff Weinstein's Cultural Mixology
Serious Popcorn
Martha Bayles on Film...
Martha Bayles on Film...
classical music
Creative Destruction
Fresh ideas on building arts communities
Fresh ideas on building arts communities
The Future of Classical Music?
Greg Sandow performs a book-in-progress
Greg Sandow performs a book-in-progress
On the Record
Exploring Orchestras w/ Henry Fogel
Exploring Orchestras w/ Henry Fogel
Overflow
Harvey Sachs on music, and various digressions
Harvey Sachs on music, and various digressions
PianoMorphosis
Bruce Brubaker on all things Piano
Bruce Brubaker on all things Piano
PostClassic
Kyle Gann on music after the fact
Kyle Gann on music after the fact
Sandow
Greg Sandow on the future of Classical Music
Greg Sandow on the future of Classical Music
Slipped Disc
Norman Lebrecht on Shifting Sound Worlds
Norman Lebrecht on Shifting Sound Worlds
publishing
book/daddy
Jerome Weeks on Books
Jerome Weeks on Books
Quick Study
Scott McLemee on books, ideas & trash-culture ephemera
Scott McLemee on books, ideas & trash-culture ephemera
theatre
Drama Queen
Wendy Rosenfield: covering drama, onstage and off
Wendy Rosenfield: covering drama, onstage and off
lies like truth
Chloe Veltman on how culture will save the world
Chloe Veltman on how culture will save the world
visual
Aesthetic Grounds
Public Art, Public Space
Public Art, Public Space
Another Bouncing Ball
Regina Hackett takes her Art To Go
Regina Hackett takes her Art To Go
Artopia
John Perreault's art diary
John Perreault's art diary
CultureGrrl
Lee Rosenbaum's Cultural Commentary
Lee Rosenbaum's Cultural Commentary
Modern Art Notes
Tyler Green's modern & contemporary art blog
Tyler Green's modern & contemporary art blog

6 Comments
Leave a comment