{"id":18147,"date":"2017-03-08T11:52:37","date_gmt":"2017-03-08T16:52:37","guid":{"rendered":"http:\/\/peterlevine.ws\/?p=18147"},"modified":"2017-03-08T11:58:39","modified_gmt":"2017-03-08T16:58:39","slug":"school-choice-is-a-question-of-values-not-data","status":"publish","type":"post","link":"https:\/\/peterlevine.ws\/?p=18147","title":{"rendered":"school choice is a question of values not data"},"content":{"rendered":"<p>I disagree with my friend Robert\u00a0Pondiscio\u00a0about many policies, but I agree with an essential aspect of his argument in a US News article <a href=\"https:\/\/www.usnews.com\/opinion\/knowledge-bank\/articles\/2017-03-06\/test-based-evidence-alone-doesnt-tell-us-whether-school-choice-works?src=usn_tw\">entitled\u00a0<\/a>&#8220;Asking the Wrong Questions on School Choice.&#8221;<\/p>\n<p>Some impressive-looking recent studies assert that school choice doesn&#8217;t &#8220;work&#8221; because test scores go down when families use vouchers to transfer their kids to private schools. The <a href=\"https:\/\/www.nytimes.com\/2017\/02\/23\/upshot\/dismal-results-from-vouchers-surprise-researchers-as-devos-era-begins.html?_r=0\">New York Times<\/a>\u00a0describes these results as &#8220;dismal&#8221; and cites &#8220;harms&#8221; to the children from voucher experiments. Pondiscio believes that the preponderance of the evidence still &#8220;tends to favor school choice.&#8221; I don&#8217;t know if that is right, but I&#8217;m with Pondiscio that &#8220;this entire debate puts the cart before the horse.&#8221;<\/p>\n<p>After all, who said that test scores are the purpose of schooling? &#8220;Choice exists to allow parents to educate their children in accordance with their own needs, desires and values.&#8221; Some parents will prefer schools that achieve lower scores on state standardized tests because they value other ends. To measure choice in terms of test scores &#8220;says, in effect, that one&#8217;s values, aspirations and priorities for one&#8217;s child amount to nothing.&#8221; He concludes:<\/p>\n<blockquote><p>If we limit the frame of this debate to academic outputs alone, every new study provides ammunition, but never a conclusion. The real debate we should be having is, &#8220;What kind of system do we want?&#8221; Answer that question first, then use evidence to improve the school designs, policies and programs we have agreed deserve public support.<\/p><\/blockquote>\n<p>I&#8217;ve made similar\u00a0points in debates about, for example, the <a href=\"https:\/\/www.academia.edu\/16372927\/Jobs_Jobs_Jobs_The_Economic_Impact_of_Public_Work\">economic impact of civic engagement<\/a>, the <a href=\"http:\/\/www.infoagepub.com\/products\/Problematizing-Service-Learning\">educational value of service learning<\/a>, and the <a href=\"https:\/\/www.amazon.com\/Are-Ones-Have-Been-Waiting\/dp\/019993942X\/\">evaluation of policy<\/a>\u00a0more generally. We live in an age when science has enormous prestige and values are widely viewed as merely subjective. In that context, it&#8217;s common to treat programs and policies much as\u00a0scientists would view natural phenomena, as things that arise\u00a0on their own and have measurable effects. To decide whether they &#8220;work&#8221; means measuring their causal impact with apparently objective measures, of which state-written tests are good examples. Negative results lead to strongly value-laden conclusions&#8211;such as the <em>Times&#8217;<\/em> headline about &#8220;dismal failures&#8221;&#8211;that are not themselves scientific.<\/p>\n<p>In fact, programs and policies arise because people have value commitments. They strive to make their ideas work, albeit for various and contested purposes. Usually nothing works at first.\u00a0If its impact improves, it&#8217;s because people have <em>made<\/em> it work by refining and improving the practice. The reason that data provides &#8220;ammunition, but never a conclusion&#8221; is that\u00a0any empirical result can be changed by revising and improving the program under study. Therefore, the fundamental question is not what works but what we should value and try to make work.<\/p>\n<p><span style=\"font-weight: 400;\">An everyday example is public schooling. Nineteenth century reformers like Horace Mann drew from previous thinkers\u2014and from successful experiences in countries like Prussia\u2014to propose a new idea: every child should be educated at the government\u2019s expense in a state-funded common school under local political control. Since then, not only have educators and policymakers refined and revised most aspects of public schooling, but scholars have critically evaluated actual schools from a wide variety of perspectives. A few observers have concluded that Horace Mann\u2019s core idea was misplaced,<\/span><span style=\"font-weight: 400;\"> but most see their role as helping to make his vision <\/span><i><span style=\"font-weight: 400;\">become<\/span><\/i><span style=\"font-weight: 400;\"> successful. Public schools did not arise like a new species in Darwinian evolution to survive or fail on its own. Nor did Horace Mann propose a hypothesis that could be tested with a single experiment (e.g., \u201cCommon schools will work.\u201d). Rather, universal public schooling originated with an argument that combined values and empirical predictions, and it launched a process of improvement that has combined research with practice.<\/span><\/p>\n<p>The question is whether individual family choice\u00a0is a transcendent value. Robert Pondiscio argues that using test scores to assess vouchers makes family preferences &#8220;amount to nothing.&#8221; I think we all value parental choice to a degree, but everyone also weighs other concerns: children&#8217;s rights, interests, and preferences, community values, prosperity at the state and national scales, democratic ideals of collective self-governance, our responsibilities to children other than one&#8217;s own, and criteria of excellence that may be unpopular.<\/p>\n<p>I agree that the American ideal of the common school has always been a bit problematic, and versions of family choice common in Western Europe may get the balance\u00a0better than we do with our odd mix of local monopoly schools plus radical economic inequality. But if we seriously considered the question &#8220;What kind of system do we want?&#8221;, I&#8217;m not sure the answer would be a system driven by parental preferences.<\/p>\n<p>I should add that another kind of reasoning (besides scientism) motivates experiments with school choice. Some people think that market competition always or generally increases efficiency, so that introducing choice into a former monopoly will improve outcomes, almost regardless of how they&#8217;re measured. Then the effects of vouchers on test scores becomes an experiment in the efficiency hypothesis. Even if the results are mixed, the existence of major, high-quality, and recent studies in which the effects are strongly negative sounds like counter-evidence. I think that should embarrass proponents of market efficiency, of whom one was Elizabeth Warren in <em>The Two-Income Trap: Why Middle-Class Parents are Going Broke<\/em> (2003):<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-18159\" src=\"http:\/\/peterlevine.ws\/images\/Warren_vouchers.png\" alt=\"\" width=\"556\" height=\"418\" srcset=\"https:\/\/peterlevine.ws\/images\/Warren_vouchers.png 556w, https:\/\/peterlevine.ws\/images\/Warren_vouchers-300x226.png 300w\" sizes=\"auto, (max-width: 556px) 100vw, 556px\" \/><\/p>\n<p>However, as Pondiscio\u00a0argues, you can support choice as an inherent value, not because of an empirical hypothesis about economic efficiency.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I disagree with my friend Robert\u00a0Pondiscio\u00a0about many policies, but I agree with an essential aspect of his argument in a US News article entitled\u00a0&#8220;Asking the Wrong Questions on School Choice.&#8221; Some impressive-looking recent studies assert that school choice doesn&#8217;t &#8220;work&#8221; because test scores go down when families use vouchers to transfer their kids to private [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[7],"tags":[],"class_list":["post-18147","post","type-post","status-publish","format-standard","hentry","category-education-policy"],"acf":[],"_links":{"self":[{"href":"https:\/\/peterlevine.ws\/index.php?rest_route=\/wp\/v2\/posts\/18147","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/peterlevine.ws\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/peterlevine.ws\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/peterlevine.ws\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/peterlevine.ws\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=18147"}],"version-history":[{"count":11,"href":"https:\/\/peterlevine.ws\/index.php?rest_route=\/wp\/v2\/posts\/18147\/revisions"}],"predecessor-version":[{"id":18162,"href":"https:\/\/peterlevine.ws\/index.php?rest_route=\/wp\/v2\/posts\/18147\/revisions\/18162"}],"wp:attachment":[{"href":"https:\/\/peterlevine.ws\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=18147"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/peterlevine.ws\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=18147"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/peterlevine.ws\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=18147"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}