Archive
Coming Soon: Vision 2020 2.0
I had a long day at work, so I was glad to get home and see my email, containing today’s Education Currents Newsletter (which is still not up on their website), containing this announcement:
Save the dates of July 9-11, 2013, for this year’s VISION 2020 Summer Conference in Oklahoma City, hosted by the Oklahoma State Department of Education.
This conference offers learning opportunities and professional development for everyone from the engaged parent, the classroom teacher, counselor, librarian, technology instructor, treasurer, central office personnel, principal, school board member, district superintendent, and others.
Free attendee registration includes all professional development sessions at the conference.
You can track information on the conference here. Right now, it’s three days and free. We’ll see how fluid that is (the duration and cost changed multiple times last year). Last summer’s big event was a great time for this blog, bringing an increase in subscribers and daily hits. Oh, and people went places and learned things. Most importantly, the conference inspired this picture.
Let the planning begin!
The School I Choose
The mantra this week is that parents should get to choose the schools their children attend; that their zip code shouldn’t choose it for them. It’s quite the idyllic belief – that out there, somewhere is the perfect school.
As a parent, I’m still looking. Here’s what I hope to find.
- I choose a school that values children for the unique individuals they are.
- I choose a school with a strong, active PTA.
- I choose a school where the parents of the other children value education as much as I do.
- I choose a school that has well-paid faculty who are happy to come to work.
- I choose a school where the teachers receive meaningful professional development and are treated as professionals.
- I choose a school that teaches all students, regardless of background or ability.
- I choose a school that has enough technology to prepare my child for the world after school.
- I choose an elementary school with a safe and exciting playground.
- I choose a school that can afford a resource officer, even though I live in a community that looks like it would never need one.
- I choose a school with enough counselors to tend to every child’s social and psychological needs.
- I choose a school not driven mad by testing.
- I choose a middle school with teachers who work in teams to help children transition into adolescent learners.
- I choose a school that offers art, music, PE, and computer instruction at all levels.
- I choose a school that has a strong collaborative relationship with a Career Tech center.
- I choose a school that fosters reading for reading’s sake and writing for writing’s sake.
- I choose a school with every student receiving support to be on grade level in reading and math.
- I choose a school that doesn’t arbitrarily mandate retention based on flawed tests.
- I choose a high school that offers a variety of courses that allow students to explore their career possibilities.
- I choose a school that encourages the study of Current Events.
- I choose a school that teaches people not to be defined by their mistakes.
- I choose a school where the parents support their children in sports while also respecting the boundaries between the field and the stands.
- I choose a school with good breakfasts and lunches.
- I choose a school that can raise money for band trips and cheerleader uniforms but doesn’t have to for teacher supplies.
- I choose a school that operates under mandates fully funded by the state.
- I choose a school focused on children rather than A-F Report Cards.
- I choose a school with no bullying.
- I choose a school with board members who listen to the professionals in their district.
- I choose a school that is a partner with its community.
- I choose a school where the teachers have manageable class sizes.
- I choose a school with teachers who will laugh when students properly pull off a flash mob.
- I choose a school with at least one nurse.
- I choose a school with at least one librarian.
- I choose a school with spirit.
- I choose a school that takes field trips and has class parties.
- I choose a school with fully-equipped science labs.
- I choose a school that teaches social studies and civic engagement to all students.
- I choose a school that values service-learning.
- I choose a school that has well-maintained buses with comfortable seats.
- I choose a school with a safe room, a roof that doesn’t leak, and functioning heat and air.
- I choose a school that encourages participation in Math Counts, Geography Bee, Science Fair, Competitive Speech and Debate, and Robotics.
Maybe I haven’t found the perfect school yet. I haven’t even created the perfect list, I’m sure. I came up with these 40 things in about 15 minutes. Nonetheless, I’m still grateful for the schools my children attend(ed). I know most feel the same way.
National School Choice Week
Prepare to see the PR machines in overdrive. School Choice Week is being celebrated around the country as state legislatures prepare to begin their annual work. In Oklahoma, this means 600 bills that relate to education in some way or another. I would try to provide a digest of them, but I try to keep my blog between 500 and 800 words. Most of these bills are likely to be consolidated or fall to the side completely.
The mythology of school choice goes something like this: students are too often trapped in struggling schools with no alternatives. If the state would only make their money portable, then any private school in the state would take those kids. Short of that, we can just reinvent public schools as charters. Or pull the parent trigger and make schools charters. Or allow any student who feels unsafe to transfer to any other school.
Last year, Superintendent Barresi issued a press release to mark this momentous occasion. In part, it read:
I am a huge advocate of a parent’s right to choose the education that best suits the needs of their children,” Barresi said. “In a free country, with so many exceptional school offerings, there is no reason a child’s education should be bound by his parent’s income level or his geographical location.
This is all empty rhetoric. For school choice to be the great equalizer, you have to have some guarantee that the school you choose would choose you back. Private schools don’t have to. Charter schools technically do, but as I’ve mentioned before, they can insert codicils into their policies that make it extremely difficult for special needs students or children needing remediation to attend. While Oklahoma charter schools still tend to be locally-sprung entities, there are national charter school chains making huge profits.
Nor are the results from private schools and charter schools comparable with those from public schools. In fact, with the private schools, there are no results. They don’t take the same tests. In our data-driven school climates, you would think there might be a push to find out if the potential recipients of vouchers are worth the cash. And charter schools actually did worse overall than the state on the A-F Report Cards.
If we pass a full-on voucher law, does that mean Casady and Holland Hall are just going to change their standards and let anybody in? Does it mean they’re going to expand to offer programs to twice as many students? Of course not. We don’t have private schools – elite or otherwise – in all parts of the state either. Vouchers would be a good boost for families already choosing private schools. In some locations, they would also be a small boost in revenue for schools trying to stay in business. They will not, however, increase equity in public education.
Readers of this blog tend to be independent thinkers. As you hear the various talking points this week, try to find the subtext. Whom will this proposal benefit? What part of the narrative is self-serving or incomplete?
The good news is that I’ll have blog material all week long.
A Brief Primer in “Scholarly Jargon”
One prescient commenter on the Oklahoman’s editorial slamming the CCOSA/OSSBA commissioned study of A-F Report Cards attributed the paper’s snarky tone to a lack of understanding. The writer stated, “Really dok, your inability to grasp the jargon of a scholarly report doesn’t mean it’s skewed.” I think this is part of the problem. Grades scaled A-F appeal most to people who want a simplistic answer to the key question, “How is my school doing?” Research done by real live scholars breaks that mold.
To help the editorial writers, I’ve captured ten statements from the report containing scholarly jargon and provided a brief explanation. Why ten? Because it’s a nice round number that people recognize. And that’s what really matters.
Statements
- The scores assigned to represent proficiency levels (0, .2, 1.0, 1.2) do not seem to correspond to any recognizable metric.
- The metric does not justify the mathematical manipulations performed in the A-F scaling.
- The use of proficiency levels rather than test scores in these computations introduces grouping error.
- Information is lacking regarding classification consistency.
- Attendance and graduation rates are known to be correlated with socioeconomic status.
- By not making explicit threats to the validity of report card grades, the OSDE misinforms the public about the credibility and utility of the A-F accountability system.
- There is a nonlinear relationship between proficiency level and growth since growth is restricted at the top.
- The A-F accountability system is susceptible to forms of “test score pollution.”
- The A-F accountability system stands in contrast with more comprehensive understandings of measuring organizational effectiveness.
- [E]xternal inducements to task performance reliably undermine motivation.
Explanations
- The idea of a recognizable metric is that the system would use some kind of a scale that makes sense or sound familiar. The A-F grades are recognizable. The scale used to assign value to performance, as the report indicates, is completely arbitrary.
- The SDE created a formula in which an advanced score is worth six times the value of a limited knowledge score. They manipulated the results to create a performance index that does not tell anybody how many students actually passed each test. And the justification for the formula is completely unclear.
- This image I uploaded a while back showing the distribution of Report Card GPAs by poverty levels gives a good visual explanation of grouping error.
- The classification inconsistency comes from the fact that test results come before performance levels are set. The four categories are not equally grouped. For example, on one test, the range of scores for Proficient may be just a few responses from high to low. On the test for the same subject in the next grade, it may be much larger. On some tests, the range of scores for Advanced is very narrow. On others, it is quite wide.
- Statistically, correlation is the relationship between two variables. One common mistake is to say that correlation shows causation. It doesn’t necessarily. Poverty is highly correlated with other variables such as low school achievement, poor health, and family dysfunction. In this report, the researchers discuss correlation to explain why attendance rates and graduation rates are somewhat factors that schools can’t control. I would add that if a school is doing well in terms of student achievement and growth, is attendance really all that important? Yes, students should be in school whenever possible. If they aren’t, and they still do well, though, what is the huge concern?
- I would have re-written this sentence. The authors don’t mean the SDE should make “explicit threats.” They mean, “There are threats, and the SDE should state these explicitly.” Months of scrutiny have exposed many flaws in the methodology for the grades. The SDE’s denial of those concerns and promotion of these grades misinforms the public.
- Do you remember calculating slope in Algebra? Slope is the way to represent a linear relationship. Slope is also a way to explain correlation … rise over run … y = mx + b … But sometimes the relationship curves. Students scoring poorly have a lot more opportunity for growth than students scoring very well. Taking the average of student growth and applying it to students misrepresents this reality. Badly.
- A huge problem in accountability systems is the idea that they force schools to filter all curriculum decisions into various methods of test preparation. Nothing else gets through. Tests should sample what students know. Instead, they end up capturing the entirety of what has been taught. This is test score pollution.
- In short, the A-F Report Cards keep us from seeing whether or not schools are truly effective. They capture a snapshot of all the wrong things.
- I absolutely loved this sentence from page 23. It contests the idea that before A-F…before API…before NCLB, schools were complacent. Nothing could be farther from the truth. I’ve said repeatedly on this blog that schools try to improve continuously because the people working there care about their kids. Nobody wants to be embarrassed (or validated) by grades that misinform the public. Ultimately, when the teacher is with the class, that all goes out the window.
The truth is that most of us aren’t professional researchers or scholars. Most Oklahomans aren’t even educators. That’s perfectly fine. We all speak a variety of languages that make sense in our own circles. I’m an educator and a researcher. I get what the report says. But even if I didn’t I wouldn’t take the intellectually dishonest path of rejecting the findings. The researchers at OU and OSU are spot on with this report. I detect that most people get that, even if certain newspapers do not.
Research Reporting > Editorial Writing
Yesterday, for the second time in a month, the Oklahoman criticized a university study showing flaws in the SDE’s A-F Report Cards. First it was Dr. Jonathan Willmer’s report showing that poverty and other family indicators are strong predictors of a school’s final grade. Now, on the heels of CCOSA/OSSBA report showing huge statistical flaws in the A-F methodology, they again are skeptics.
Willmer is a professor at Oklahoma City University. He is the chair of the Department of Economics and Finance. He is not a pawn of professional educators. He is simply a scholar who saw a trend and decided to calculate it.
On the other hand, CCOSA and OSSBA represent administrators and school board members, respectively. Questioning their motives makes sense for an anti-education newspaper. However, the report was written by the Oklahoma Center for Education Policy (University of Oklahoma) and the Center for Educational Research and Evaluation (Oklahoma State University). The findings were then sent to two “internationally known experts” on research and educational measurements: Robert Lee Linn, a University of Colorado professor with more than 250 publications; and Robert J. Sternberg, a George Kaiser Family Foundation Professor of Ethical Leadership. Again, these are scholars who provided a look at the A-F methodology through a research lens.
The newspaper called the report “the latest attempt by opponents of accountability and transparency to roll back the A-F grading system, which they view as flawed, mostly because it’s easily understood.” That’s a tired claim. Nobody is running from accountability and transparency. Publish test scores. Divulge spending. Open is good. But the A-F Report Cards typify the difference between simple and simplistic – between “easily understood” and “misleading.”
The paper goes on to say that “parents seemed to quickly grasp that a D or F grade indicates lackluster school performance.” From my dealings with parents, they understand something entirely different – that these grades are highly flawed, and that schools are not adjusting how they work to improve based upon the grades they received.
To appear conciliatory at the end of the editorial, the Oklahoman admits that “some kernels of wheat may be found among the report’s chaff.” They go on to not explain to us what those kernels may be.
Here are the facts. Researchers from OU, OSU, OCU, CU, and The Kaiser Foundation have all agreed that flaws exist in the A-F Report Cards. These flaws are systematic. They are profound. They undermine a serious person’s attempt to find meaning in the results. What the researchers don’t say is that this was the intent all along – to dumb down the standards for accountability and transparency.
I Dare You to Bring CornNuts
I mentioned a couple of weeks ago that the SDE was accepting volunteers to be on the TLE working group that would inform the TLE Commission in its task to select Other Academic Measures to use in the evaluation of teachers in non-tested subjects. According to emails forwarded to me by readers, over 200 people signed up. I can’t take credit for all of that, but maybe an icebreaker activity for the working group can be developing a formula for evaluating the impact of this blog.
One can dream, right?
Seriously, though, the group has gotten so big that the SDE is dividing them up into three smaller groups. The first meeting is today. Participants have been told three things and three things only:
- The meeting is at Langston-OKC
- Dress comfortably
- Bring your own snacks and drinks
One can infer from the second point that a dress Snuggie™ (I haven’t checked, but you know they have to make one like a tuxedo) would be appropriate. The third point raises several possibilities, however. Clearly there will be no chocolate fountain and crabcakes. I do suggest bringing something, though. A full day without nourishment can be brutal.
I had a college class with a guy who always ate CornNuts. It didn’t matter where you sat in the room, you could hear them and smell them. It’s not a horrible snack if you are the one eating them, but I have a thing about sounds and smells.
Overall, the variety of snacks is likely to be more interesting than the exchange of ideas. It will certainly be more fulfilling. Hopefully the snacks people bring with them will be less irritating than the topic at hand.
The truth is, your ideas are merely a prop. The real work on VAM is being done by a company called SAS out of Cary, NC. Fortune Magazine just ranked them 2nd on the list of top 100 companies to work for in the United States – right behind Google. Business analytics are a growth industry, after all.
In all seriousness, if you go today, speak up. In all likelihood, the SDE staff that will be there have their mind made up about what measures will be used. That doesn’t mean that collectively, we can’t make it interesting.
In Defense of Superintendents
I caught one item on the editorial page of the Oklahoman over the weekend ripping school district superintendents in general. I totally missed another one targeting two specifically, though. So thanks go to Melissa Abdo from Jenks for tweeting about it and putting it on my radar.
The editorial from Sunday was typical for them. Somebody at the newspaper is incredulous that superintendents continue complaining about funding. Let’s review…
First the legislature failed to fully fund its mandates. Then the SDE withheld more than twice what is mandated this summer. Then they made a slight adjustment in August when online enrollment numbers were known. Finally, they released mid-term adjustment funding levels in December, while still withholding millions of dollars from the formula. The mid-term adjustments strongly favored the state’s online schools.
Unlike the Oklahoman, the Tulsa World, for its part, did this radical thing called interviewing people. They actually talked to school district officials about their concerns over the mid-term surprise. The result was what’s known as an article full of facts. I know…I sound like some kind of beatnik muckraker. Reporting facts in stories in a way that’s designed to present a balanced view so readers can make up their own mind is no way to operate – well, not if your intent is to funnel the billions spent in Oklahoma on real education into the coffers of large, multi-national corporations.
This follows a typical pattern. The World reports a story that includes the perspective of people running schools. Then, after a few days pass, the Oklahoman criticizes the scary Education Establishment on the editorial page. What happened Saturday, however, was altogether different.
This is the one I missed – the one Abdo mentioned on Twitter this morning. Tucked into the Saturday Scissortails post on the editorial page was a blurb criticizing Jenks Public Schools for picking an internal candidate as its next superintendent. The blurb also criticized Tulsa Public Schools for sticking with Keith Ballard for one more year:
With the retirement of Superintendent Kirby Lehman, Jenks schools could have charted a new course. Instead, they promoted Deputy Superintendent Stacey Butterfield, who called Lehman a mentor. This is telling because Lehman’s recent tenure has been marked by frivolous lawsuits and a disturbing attitude toward less-fortunate children. He championed filing lawsuits targeting the parents of special-needs students (which the state Supreme Court tossed) and griped about funding charter schools serving poor minority children (whose parents can’t afford Jenks homes). In 2005, Jenks joined a teachers union lawsuit demanding a billion-dollar increase in school appropriations (also laughed out of court). Sadly, other troubled Tulsa-area schools are following a similar path. Union promoted a deputy superintendent and Tulsa replaced “retiring” Superintendent Keith Ballard … with Keith Ballard for another year. Rather than moving ahead, this suggests that these schools will continue advocating an agenda that hasn‘t benefitted students.
Again I should point out that the husband of Superintendent Barresi’s one-time chief-of-staff writes editorials for the Oklahoman. I should also point out that as chief-of-staff, she caught a lot of grief for calling certain Tulsa-area superintendents dirtbags. When the Oklahoman writes a piece out of the blue slamming two superintendents that aren’t even in its main service area, the motives have to be questioned.
Lehman and Ballard are successful professionals who don’t need me defending them. The academic excellence of Jenks is unquestioned. And the district has continued planning for growth by passing bond issues with sizeable margins. The community that knows Lehman’s work has continued supporting him, for more than two decades. That speaks volumes. Likewise, Tulsa Public Schools, under Ballard, developed the Teacher Leader Evaluation system that has since been adopted by over 400 Oklahoma school districts. This has occurred over the objections of Barresi, who wanted the TLE Commission to select a different model. Garnering the acceptance of your community and your peers is far more significant than any criticism superintendents might receive from a jaded editorial writer.
Both of these articles point to why few want to serve in this capacity. Everything superintendents do is scrutinized. Selecting an architect for a building project, choosing principals, even where you sit during a football game is seen as a referendum on your leadership. The public wants to know not only how much money you make, but where you spend your money. You spend every day in the public eye. And in some cases, newspapers will even come after you before you start on the job.
Crazy.