Showing posts with label Testing. Show all posts
Showing posts with label Testing. Show all posts

Wednesday, July 5, 2017

Kasich Education Vetoes a Mixed Bag for Kids

While Gov. John Kasich's line-item veto of the Ohio Legislature's freeze on Medicaid has rightly eaten up much of the veto discussion, Kasich also vetoed 11 different education provisions in House Bill 49 -- the state's beinnial budget. For a complete rundown, look here. But I would like to focus on a couple things.

CHARTER SCHOOLS

In several of the vetoes regarding charter schools, Kasich said he struck the provision because it was unfair, or treated schools differently, or lowered standards. My issue with this reasoning is, well, that's kind of been the story of Ohio's charter school system. Ohio charters have been treated differently, held to lower standards and been unfairly funded at the expense of children in local public schools since 1998.

So why the sudden call to conscience? I don't know. But let me take a few of the vetoes in turn.

1) He vetoed a provision that would have allowed charters to count student growth as 60 percent of its student achievement measure rather than the current 20 percent. He claimed this was because it would hold charters to a lower standard than local schools. But that's only true if you believe that student growth is not as effective a measure as straight performance. And while there are real concerns with how student growth is calculated and used, putting more emphasis on that measure could encourage schools to spend more time with more students rather than just focusing on high fliers whose high scores would help a school's rating more than growing the lower scoring students. That's not a horrible public policy outcome. And we have always held charters to different standards than local schools -- that's been part of the point with charter law and criticism of it.

2) He vetoed a provision that would have allowed sponsors that were stripped of their ability to sponsor schools this school year to sponsor them again this year if they scored 3 out of 4 or higher on academics. His reason? Because they would still score poorly on the other bureaucratic measures under which they are now evaluated. But this is exactly the problem the legislature was trying to address -- you have some of the highest rated sponsors for academics (arguably the most important of the three charter school sponsor measures) unable to continue sponsoring schools because they don't meet the bureaucratic measures. Instead, with his veto Kasich essentially is putting a greater emphasis on whether a sponsor fills out forms correctly than whether the schools they oversee serve kids well. I fail to see how that outcome upholds quality for kids.

SCHOOL DISTRICT FUNDING

Several of Kasich's vetoes would directly harm the funding for kids in local school districts.

1) He vetoed a provision that would have helped ease the removal of Tangible Personal Property (TPP) tax reimbursement payments to districts, forcing many districts to deal with much steeper cliffs. He claimed schools have had enough time to cope with this loss. Kasich has never really understood why removing this formerly $1 billion a year payment for kids in local schools was so detrimental. I think it stems from a fundamental misunderstanding (or deliberate misunderstanding) of the 2005 law that eliminated the TPP. In exchange for the elimination of the TPP (which went mostly to kids in school districts), the state agreed to make school districts whole with Commercial Activity Tax payments until a real replacement could be developed. It's that last part of the agreement whose promise Kasich broke in 2011 when he decided to eliminate the reimbursement payments, cutting funding to kids in local school districts by $1.8 billion in that budget. The last year before Kasich, the TPP payment was $920 million. Now it's all but gone. Which is why when lawmakers claim they've increased funding to schools, they NEVER include this lost revenue. Anyway, Kasich's draconian adherence to this false narrative about TPP continues to be one of his greatest failings. And kids will suffer for it.

2) Kasich vetoed a couple provisions that would have allowed school districts to apply for state matching funds for new buildings at lower local share matches if they phased them in over time. He claimed this would have created inequities among districts. Which is a nice sentiment, but the whole reason the legislature did this is because of the current system's inequities. Some districts are caught in a nether zone where they are considered too "wealthy" for a big state match, but also too poor to fund the whole thing -- hence the current inequity. However, if they could go for a smaller bond issue, kids in those districts might be able to access the same new buildings as many other districts in the state. Again, this punishes districts who are neither wealthy nor poor, but are less wealthy than the wealthiest.

HOSING APPALACHIA. AGAIN.


Throughout Kasich's turn in the Governor's office he has found new and creative ways to hurt rural Appalachian schools. When he developed what was supposed to be his signature "Achievement Everywhere" school funding plan (a plan that was dumped unceremoniously by his own party), the plan disproportionately hurt rural Appalachian districts. He used school funding formulations that would downplay the poverty in Appalachia. And now he vetoed a provision that would allow school districts to give state tests in paper rather than computer formats. Rural Appalachian districts simply don't have enough computers to give tests over computers effectively or efficiently. We also know that kids who take paper tests tend to do better than those who take them on computers. So Kasich is forcing kids in mostly rural Appalachian districts to take more time taking tests and in a format that's biased against them. All in the name of what? "Standards"?

Part of his decision I think stems from Kasich's sharing of the school reform bias toward assessments that show kids doing worse. I've discussed this before, but just because kids to worse on a test doesn't mean that test is more accurately assessing their proficiency in a subject. Does anyone honestly believe that a test showing that only 1/3 of students are proficient readers is a more accurate read of how kids are doing than one that suggests 85 percent are?

Kasich made some decent vetoes on education provisions. His veto of a provision that would have forced College Credit Plus students (kids who take college courses in high school) to receive a C or higher to receive college credit when college students can receive credit for a D makes sense.

His veto of a provision that would have exempted some special education private schools from state assessments was generally fair.

His veto of a provision allowing Education Service Centers to sponsor schools from all over the state was also a small victory.

But overall, Kasich's vetoes were cloaked in a veneer of fairness that hides
the unfair and inequitable approach his administration has used in education policy since 2011.

Tuesday, August 16, 2016

National Bureau of Economic Research: Charter Schools Decrease Future Students' Earnings


In a devastating new paper by the National Bureau of Economic Research, the authors find that charter schools overall have a negative impact on students' test scores and future earnings. That means if you send your child to a charter, the data shows that decision will likely dim your child's economic future. And even the higher performing charters generally don't improve students' future earnings.

Not good news for the nation's charter school sector, which also was hit recently by the NAACP coming out against for-profit operators running these schools, while calling for a moratorium on new ones.

Here are the NBER authors' findings:
"We find that, at the mean, charter schools have no impact on test scores and a negative impact on earnings. No Excuses charter schools increase test scores and four-year college enrollment, but have a small and statistically insignificant impact on earnings, while regular charter schools decrease test scores, four-year college enrollment, and earnings. Using school-level estimates, we find that charter schools that decrease test scores also tend to decrease earnings, while charter schools that increase test scores have no discernible impact on earnings. In contrast, high school graduation effects are predictive of earnings effects for both low- and high-value added schools."
Worse, they conclude that it appears that in high-performing charter schools, the schools have focused so much on improving math and reading scores that they've de-emphasized arts, foreign languages and other "soft skills", which ends up hurting students in the long run because students need these skills to achieve in the market place. The authors theorize that this could be why high-performing charters do improve scores, but have zero impact on earnings.
"Much more troubling, it seems, is the possibility that what it takes to increase achievement among the poor in charter schools deprives them of other skills that are important for labor markets."
Far from being an attack on charters, the paper is a sober, scientific look at what many of us are seeking: a determination of whether education actually improves kids' lives in the long term. And it also helps bring greater clarity to the question of whether improving test scores will mean anything in children's adult lives.

I've always thought it silly to conclude that America is failing because our students score in the middle of the pack (or toward the bottom) on international tests. We still are the world's dominant economy and military force, not to mention its creative and innovative hub. To say our public schools didn't have a lot to do with our country's nearly 8 decades as the world's powerhouse is extraordinarily unfair, or at least intellectually dishonest.

What this report also tells me is that focusing on test score improvement does not necessarily mean we will be improving the economic lives of our citizens. For if we do it by leaving behind the subjects that have separated our educational system from the world for decades, we'll be improving our test scores by limiting our students' future.

It also tells me that three decades into the charter school experiment, charters may not be providing the long-term benefit to our society that many hoped they would. And it certainly shows (again) that investing $1 billion in nearly 400, as Ohio does, seems unjustified. Investing in our state's few high-quality charters and dumping the poor performers seems like the obvious solution.

But seemingly obvious solutions have eluded our state's leaders for so long on this topic that I would fully expect it to continue.

Thursday, December 10, 2015

New ESEA Returns Power to States. But is that a Good Thing?

It looks like the federal government is going to back off and let states handle more education policy. This is a direct response to the uproar over testing, No Child Left Behind, Common Core, Race to the Top and other heavy-handed, top-down federal initiatives.

To be clear, this doesn't mean testing is going away; it's just that states can limit the time it takes to do them. It also limits the stakes inherent in the tests and no longer requires test scores to be tied to teacher evaluations, which I have always considered a mistake because of year-to-year fluctuations in test results.

But I have to admit that I'm concerned about leaving stuff this important up to the states. Now in some states, it will be fine -- states that have a history of valuing and committing to public education. But in other states, especially those in the least-educated corners of our nation, I fear they will see this and wipe their brows, knowing they will no longer be held to account for failing to properly serve kids.

This whole accountability regime has me flummoxed, I must admit. I like that AYP forces wealthy districts to have to figure out how to serve even small numbers of at-risk youth. I like that my 1st grader is learning tougher math concepts than even my 5th grader did four years ago.

But I hate all the testing and what it's done to the anxiety many kids (including my own) feel, not to mention teachers, administrators, and even entire communities as they get rated based on these things. I want my kids learning cool things. But I hate that it's taken tests to stimulate it.

This concern stretches now nationally with the federal government's step back. Without the high-stakes tests, will kids still be learning these concepts? In some states yes, others no. Without the federal hammer, will at-risk kids be served in all districts? In some states yes, others no. Without as much testing, will we be able to determine if kids are learning all they'll need in the 21st Century world? In some states yes, others no.

This is the problem with the federal government stepping back -- it will lead to the Balkanization of American education. I remember when kids would move here from Tennessee or Kentucky when I was a kid and they'd be 6 months to a year behind what we were learning. That's not good.

I also remember that when we let states handle important civil rights issues previously, it was not our nation's proudest moment. That's also not good.

But I also know that the federal government went too far, overtested and created in many ways a poisonous, high-stakes atmosphere that turned talented teachers away from the profession and created test-anxiety in 8 year olds. This is also not good.

I would hope this policy shift would grant our nation the opportunity to find a better balance. There is little question that basing so much upon how 8 year olds do on a test one day out of 180 does not give a full or complete picture of a school's worth. But it does grant us at least some window into what's going on at the school. If we're going to have tests, they should measure more than analytic ability, but also a kid's creative and practical abilities too, which will drive curriculum to be more creative and practical. The results of these more comprehensive assessments are far less driven by demographics than our current batch.

But learning involves more than tests. As Einstein said, "Not everything that can be counted counts, and not everything that counts can be counted." There are skills that are far more predictive of a child's ultimate success than how well they do on a standardized math test in 4th grade. Things like a love of learning -- what I contend is the most powerful predictor -- grit, independence, critical thinking, teamwork, and a host of other measures should also be valued. I don't know if it's possible to assess these through a quantitative test. But these are all things we want our kids to know and learn how to do. Yet the recent focus on the three Rs had been so intense that kids are only learning the other important concepts by chance.

Getting the federal government out of the picture in many ways will free up states to innovate on these ideas. However, only a handful probably will. And kids in those states will be really lucky. My fear is the rest of our kids won't be. They'll be stuck in a watered-down version of today's accountability structure that will be somewhat less onerous, but also filled with far fewer, and lower expectations.

I have always thought that the best role for the federal government in education is funding. The feds are in the position to provide enough revenue so that, for example, Ohio can finally live up to its funding requirements under the Ohio Constitution. If I had been President, Race to the Top would have been a call to provide adequate and equitable funding to establish a world-class education system throughout the United States. In order to receive this funding, states would have to show their funding formula equitably distributes funding to every child in the state. Then the feds would make up the shortfall on adequacy, if states didn't have enough funding to adequately pay for the formula.

The problem with No Child Left Behind and Race to the Top was both provided far too few resources for the far too many strings that came attached with them. My concept is kind of the opposite: A few strings dealing with funding formulas (you can only keep getting the money if your formula continues to equitably distribute the funds so every kid gets what they need to succeed) and far greater resourcing.

Perhaps this step back will give our leaders the chance to re-think the federal government's role in the national education sphere. I doubt that it will, but with each new turn, there's always fresh hope.

What I pray does not happen is that kids in some states and regions of the country now fall further behind because their local leaders care less about public education than leaders in other states. That, I fear, may be even worse than high-stakes testing. Though not much.

Tuesday, June 17, 2014

Happy Birthday Standardized Tests!!!! Um...yeah.

My dad pointed out something to me on Facebook today: June 17 marks the 113th birthday of the American standardized test. I have to say that our country's education system has never really been the same since.

While China has had standardized tests for centuries, introducing them in America has been fraught with issues, which are well documented. The most important to me, frankly, is whether they actually predict future life success, or merely tell us who is set up to succeed in the first place.

For example, using an Excel regression analysis, I can predict 3 out of 4 Ohio school district standardized test performance ratings on the state's Performance Index Score. All I need to know is a district's percentage of children living in poverty, or their median income.

And despite the fact that American kids have never done well on international tests, the last 40-50 years has been dominated by the American economy (still #1 on GDP), we won the Cold War, and America has dominated the production of intellectual property.

So do these tests scores really tell us that we suck, or are in crisis? Do they tell us anything that's useful or predictive?

My son, who is 9, already has test anxiety because of the number and importance of these standardized tests. I'm seriously considering opting him out of future tests until high school.

However, not all testing is necessarily bad. Used to assess kids so teachers can better direct learning toward individual student needs is a great use, for example. Using them to assess teachers and classrooms? Not so obviously great.

However, I have great sympathy for the many parents I have met whose children were ignored until standardized testing -- and the accountability that came with them -- forced schools to pay attention and teach them. That has always been the standardized testing result that has kept me from advocating their immediate burning, though I certainly have a book of matches at the ready.

Then there's the promising work of Robert J. Sternberg, who was at Tufts University  for awhile (my alma mater -- shameless plug. By the way, we took him from Yale. How's that taste, New Haven?). Sternberg has developed tests that assess the creative, analytical and practical skills of students. One study from his work in the 1990s found that the students who did well on the analytical portion of the tests had the background of those who perform well on our standardized tests today -- more wealthy and white. However, on the creative and practical portions, the results showed a great mix of diverse socio-economic and cultural backgrounds. Other studies have verified those results.

Imagine if our high-stakes regime measured the other two categories? Maybe, then, traditionally low-performing Cleveland wouldn't qualify for Vouchers and Charters because their students do so well on creative and practical skills, while perhaps traditionally high-performing Hudson would qualify because their students don't?

Imagine that paradigm shift, eh?

As our testing regime becomes more high-stakes, and more importance is placed on succeeding on these things, perhaps it's time to develop tests that measure the whole student, not just their ability to analyze things and memorize. There's more to life than that, and there's more to schooling than that.

Until that happens, though, I fear all our testing regime will do is narrow curriculum, minimize the importance of the kind of thinking that can lead to true innovation and success, and force us into becoming a nation of rote learners who can't come up with ideas, but sure can tell you everything you need to know about someone else's.

Unless, that is, parents, administrators, teachers and others stand up and say, "No more!"

Tuesday, February 18, 2014

Blizzard Bags Prove High-Stakes Testing Impact

Both of my sons had another day off from school today. Now that we've hit our so-called "Calamity Day" limit (meaning that starting today, all snow days must be made up), the schools sent home a thing they call a "Blizzard Bag." No, it doesn't mean everyone gets some DQ. It means every kid gets a big amount of homework.

I was actually curious, from a policy perspective, what my two sons' bags would look like. My third grader is just getting ready to take the state proficiency tests in a couple months. My preschooler is not. What I saw was something very interesting: Guess which bag you would prefer to do? That's right. The preschool bag.

The third-grade bag required little more than practicing for the Ohio proficiency tests.


Meanwhile, my 4-year-old's preschool bag involved exploring his world -- counting how many toys he has (way too many thanks to generous family), how fast it takes to melt snow, drawing pictures of what snow looks like before, during and after it melts. 

The preschool bag looks a lot more like the learning experiences I had as a kid that I loved to do. The third-grade bag looks a lot more like the admissions testing experiences I had that I hated. 

What's the difference? 

Testing. 

In third grade, Ohio starts the march toward testing. In preschool, kids aren't tested. Yes, there is a kindergarten readiness assessment, but it doesn't count toward a school district's Report Card rating. So it's not nearly the high-stakes test that my third grader's test will be in a few months.

As many of you know, I am not one of these "all tests must go away" types. I think testing has its place as an assessment tool for teachers to more carefully craft individualized learning for students and get a general idea of district and building performance. 

When tests become everything, though, learning begins to resemble my third grader's Blizzard Bag. And, by the way, I don't blame teachers or school officials at all for this. Theirs is the responsible response to a test, test, test public policy instituted at the state level.

And, frankly, I get it. If teachers can free up class time for real learning by having kids practice their proficiency tests at home, I would do that too.

But my fear is that as we delve even deeper into higher and higher stakes tests, more and more school days will resemble what my son's learning day -- taking a bunch of tests, painfully counting how many more questions were left, and hating every second. This is not the learning experience our kids need. But it is the one our adult policymakers have thrust upon them.

And as someone who was one of those policymakers for a few years, I would like to apologize for anything I did to further our course down this high-stakes path.

Do not confuse my concern over testing with my full-throated support for standards. I love the fact that my third grader is learning pre-algebraic concepts and thinks the way I solve complex math problems is "old-fashioned." I think Common Core holds a lot more promise to provide meaningful learning than our current regime. Even the Common Core tests try to get at higher levels of thought by having kids think critically and show work.

But a test is a test. I don't know many, if any, kids that like tests. But I know many, including my own, who would love to do the Blizzard Bag my preschool son brought home. We need a lot more of that kind of stuff going on in our schools, and a lot less of the standardized test prep that teaches kids not so much how their world works, but how tests work -- a valuable skill no doubt, but one that does not an education make.

As long as our policymakers put so much stock in tests, though, schools must teach these test taking skills for their own survival. 

But it's so much cooler to watch snow melt.

Thursday, March 8, 2012

Study: Grads Don't Need all that College Remediation

Here's something interesting. It appears that all those High School graduates taking remedial courses their first years in college don't really need it. From the story in Inside Higher Ed:
The research, which analyzed data from a large, urban community college system and a statewide two-year system, found that up to a third of students who placed into remedial classes on the basis of the placement tests could have passed college-level classes with a grade of B or better.
So who told these students they needed remediation? Standardized tests. In particular, the COMPASS and ACCUPLACER exams (from ACT, Inc. and College Board, respectively). According to Inside Higher Ed:
The accuracy of placement tests has been the subject of little research, the researchers said. But the new studies suggest that colleges should reconsider how they use the tests to decide which students need remediation.
What is so troubling is enrollment in remediation courses in college has a significant impact on the student finishing college.
... remedial education is a black hole from which comparatively few students ever emerge. Only 25 percent of students in remedial classes will eventually earn a degree from a community college or transfer to a four-year college, research has found.
Once again, research has demonstrated the limitations of standardized testing. This is why making these things even more high stakes is potentially dangerous. Tests can be quite helpful when used as evaluative tools to improve and direct instruction.

However, extrapolating their results to the extent that it permanently affects students' academic careers or other non-evaluative measures is extremely problematic.