Georgia education
State foresaw test problemsThe state Department of Education knew as early as July 2007 that tens of thousands of sixth- and seventh-graders were on track to bomb on this year's mandatory social studies test, documents obtained by the Atlanta Journal-Constitution show.
But officials allowed the testing to go forward, apparently without warning schools, teachers, parents or students of the likelihood of widespread failures.
Vino Wong/AJC |
| Students who don't pass the state CRCT or other exams required to get promoted to the next level typically have to attend summer school. |
State school officials released the documents as criticism mounted Thursday of how they handled this year's statewide Criterion-Referenced Competency Test.
"This is atrocious and unforgivable," said Jason Adams, a seventh-grade teacher at Lost Mountain Middle School in Cobb County. "This is the kind of thing where a heads-up to teachers would have been nice."
Dana Tofig, the education agency's spokesman, said early projections were based on pilot questions given to students who hadn't been taught the state's new social studies curriculum. Officials assumed students would score higher this year.
The documents show students taking the pilot test answered large numbers of questions incorrectly.
By February, six weeks before testing began, officials had put a precise number on the predicted failures: 69 percent of students in both grades would likely not meet the bar.
The prediction proved generous.
Students, teachers and parents learned this week that 70 to 80 percent of middle-schoolers in the two grades had failed to pass the social studies test this spring. On the eighth-grade math test, which students must pass to go on to high school, only about 60 percent had passed — 20 percentage points fewer than the year before.
Teachers 'devastated'
The results are preliminary. Official and complete results are due next month.
Yet on Wednesday, state Superintendent Kathy Cox announced the state was throwing out the social studies results, blaming a vague curriculum and imprecise direction for teachers. She said the math results would stand and defended the test as necessarily more rigorous.
The state's testing contractor, CTB/McGraw-Hill, tried out 80 potential new questions with a sampling of Georgia students in the spring of 2007, according to state education documents. Committees made up largely of Georgia teachers chose 60 questions for the 2008 test, despite the poor results from the pilot.
Tofig said Cox was not available for an interview Thursday.
He said the pilot, or "field," test results were speculative, and useful only for setting the minimum score, known as a cut score, needed to pass the test. Pilot scores are not always predictive, Tofig said, noting that a cut-score committee projected 52 percent of eighth-graders would fail the math exam, while only 40 percent actually did.
"You really don't know what's going to happen until you get the data," Tofig said.
The department made no changes based on the anticipated social studies scores, he said. Nor did it share the projections beyond a small circle of state officials.
"A limited number of people had seen that in February," Tofig said. "That whole process is secure." To protect the tests' integrity, he added, "it has to be secure."
The state made the projections public in April when the state board approved cut scores for the tests.
The results "came as a great surprise to curriculum leaders" in the school districts, said Deborah White, executive director of the Georgia Association of Curriculum and Instructional Supervisors. "Teachers were devastated."
Cherokee County Superintendent Frank Petruzielo also said school systems had no idea what was coming. But he said the result should not have surprised state officials.
"Maybe they underestimated," he said. "But they knew the failure rate was going to be extraordinary."
Petruzielo agreed that vague teaching guidelines contributed to the high failure fate in social studies. But he said the state also raised the standards on eighth-grade math enough to trip up even accomplished students. He said state officials may have been "overreaching" to improve student test performance.
"The bar was simply set too high too soon," Petruzielo said. "We weren't able to show how much progress kids have made year to year when just getting over the bar was such a Herculean task."
The state Board of Education raised the cut score in sixth- and seventh-grade social studies from 23 and 22 correct answers, respectively, to 32 and 31 right answers out of 60 questions. In eighth-grade math, the cut score decreased, from 35 to 32.
State board member William Bradley Bryant said he expected a gap between performance last year and this year.
"The only thing we could have done with the cut scores was say, 'Are we more comfortable with more people passing the test even if that meant lowering the bar?' " said Bryant, whose district includes Gwinnett, DeKalb and Decatur. "It would look good on paper, but it's more important for them to leave the grade with the content knowledge we think they need."
He said he wasn't sure if a connection could be made between the projections and the results released this week.
Tim Callahan, spokesman for the Professional Association of Georgia Educators, said state officials should have acted to head off disaster when they saw the warning signs in the pilot test.
"You would not have let the train continue on in the dark and wreck like it has now," he said. A panel Cox is convening to look into what happened will likely do some things that should have been done before, he said.
Superintendents not told
Teachers have complained repeatedly about inadequate training as the curriculum has been revamped, said Callahan — whose group's 72,000 members are mostly teachers.
In recent weeks, as dismal scores trickled in, teachers called the state in alarm, Callahan said. "The initial response was kind of flippant and cold," he said. "They were like, 'Well, you didn't do your job.' "
Gwinnett Superintendent J. Alvin Wilbanks said local superintendents were given no direct information that the failure rates would be so high. School leaders did know scores would drop because of the new tests and higher standards.
He said he doesn't know if sharing the projections would have helped.
"With those projections, what you got is what you got and I don't know what knowing about it would have done," Wilbanks said. "But it's always nice to have information and prepare people. I don't know if you'd still administer the test."
Vote for this story!

Is it therapy to buy a pair of shoes? Discuss ... or nominate your favorite place to find those shoes!

McDonald's has unveiled a line of bigger burgers that will satisfy large appetites and scare cardiologists.

Photos: Janet Jackson, Monica, Maxwell, Jamie Foxx, New Edition, Keri Hilson, Ciara and more!

Husband and wife architects created a modern house that's still warm and inviting.

"My confidence is through the roof ... I can do anything," says Sonya Moste of Fayetteville.

Francoeur's Franks? Shef's Chefs? Just some of the passionate fans who have cheered the team.
Comments
By tristan
Mar 12, 2009 4:44 PM | Link to this
Yeah when i took this test and it was absolutly terrible. the questions didnt make sense and half of them werent even taught to us. my teacher told us about all the mistakes on it like a month after we took it because there wasnt a word about it.
By tristan
Mar 12, 2009 4:43 PM | Link to this
Yeah when i took this test and it was absolutly terrible. the questions didnt make sense and half of them werent even taught to us. my teacher told us about all the mistakes on it like a month after we took it because there wasnt a word about it.
By angry parent
Jun 26, 2008 11:11 AM | Link to this
The problem with most schools like Smitha is the PARENTS. Most of them are uneducated thugs themselves, who teach their kids to be just like them. What happened to family support? Stop blaming the teachers and start educating your children at home. No child can be successful without themselves, their teachers, and their PARENTS!!! Ignorance is bliss!!!
By administraor
Jun 17, 2008 10:33 AM | Link to this
About Smitha...a good strong administrator can clean up and disturb the "thug" culture and change it. Starting with the top ten list of non-negotiables eveloped by the school and parent leaders. The first being no one student has the right to take away others' education. If they do...they'll be in a different setting-pronto. I've been a principal in two major cities and watched the culture transform where achievement comes first. Also,you have to believe they can all achieve and build pride. All students can succeed even on the CRCT but it helps to know the rules of the "game" and the rules were not clearly explained to all the players.
By Concerned Parent
May 29, 2008 8:24 AM | Link to this
In reading these comments, I'm amazed at how many have the same concerns as me. There is not enough emphasis on basic skills in middle school, and there is not enough homework, most particulary in math (there is too much emphasis on math "journals"). How can you learn math without doing math homework (i.e., actual text book problem solving) nightly. Skills must be practiced in order to be mastered. Throughout middle school, my 2 children rarely had math homework. One child is now a 9th grader and I am even discouraged at the lack of math homework on that level. He should be doing 25 skill problems a night in order to actually learn and retain the lesson. I certainly remember doing such homework nightly. One must PRACTICE, PRACTICE, PRACTICE in order to get better at skills. I was also surprised to read that someone else didn't have a math text book. I went through that same situation with my 6th grader last year. What a struggle that was, and with no text book, there was no way for me to get a handle on the goal of the lesson so that I could help him. When I raised the issue with the administration, I was told that that, due to the change in curriculum, the 6th grade didn't have math text books [last year] and that the teachers were having to search the web and pull material from websites in order to teach the lesson. What is wrong with that picture? Well, that particular child of mine struggled on many levels through half of 7th grade this year in the local public school. Seeing the writing on the wall, we pulled him out over the holiday break and enrolled him into a private school. It's amazing how much math and other homework he now has. And do you know what - he "gets" it now, and most importantly, with helpful and cooperative teachers and administration (MUCH more helpful than what we were encountering in the public system), he has gone through a whole attitude adjustment and is now enthusiastic about working hard and very proud of his grades. I'm not surprised by the CRCT results given my personal experience with the curriculum. I only hope it wakes people up that there is something drastically wrong with the system. That many students failing certainly takes the responsibility for failure off the students. WAKE UP! Get back to basic skills and teaching techniques and quit giving middle schoolers "life science" parenting projects with babydolls.
By High school teacher
May 28, 2008 4:10 PM | Link to this
I see that many parents are concerned about the disparity between the CRCT results and their child's grades. All too often teachers are told to give plenty of extra credit work to augment grades. I have seen many extra credit projects that have been completed by parents...so what has the child learned? But the child gets the credit to bring that B or C up. Another issue for grades is the fact that many schools do not allow teachers to assign zeros for work that is not done...or even an F for substandard work such as completing only a small percentage of assigned tasks. When mom does the project and junior doesn't do schoolwork or makeup work, then the grade is not a true reflection of the learning (OR LACK OF) taking place. Where do these "no zeros" and "mandatory" extra credit policies come from? Parent pressure on the administration and school systems. Many parents take a grade less than an A as a personal affront. They link their child's success with their own success.
As a veteran high school teacher, I am amazed with how often parents want to know what kind of extra credit their child can do to bring the grade up...not to passing, but to an A or from a low failing grade such as a 20% to a 70%...in the last week of school. This padding of grades is rampant from elementary school through high school. If the parents would demand "truth in grading" then they would have a more realistic idea of their child's progress. But are they honest enough with themselves to face the truth?
By Lisa
May 28, 2008 10:40 AM | Link to this
Who is teaching our 8th grade students the CRCT math in summer schools? The same teachers that were so effective during the year? My daughter struggled all year, I tried to help but there was no book for me to understand what they were learnig like my 3 other children. Something has got to give.
By 7th Grade Social Studies Teacher
May 27, 2008 6:37 PM | Link to this
For those of you who think the standards are "dumbed-down," I challenge you to take a long, hard look at them. Simply go to the Georgia Department of Education website and pull up 7th grade social studies standards. You will be amazed at what is there, and you will be the one who feels "dumb." I guarantee that most adults in the state of Georgia, including everybody at the state department, would have failed the 7th grade social studies test. The standards were impossible, and the test was even more so. Please don't make comments until you look at the standards. Become educated.
By Concerned parent and teacher
May 25, 2008 1:57 AM | Link to this
This fiasco is not the students or the parents fault! The State rolled out the Georgia Performance Standards and told teachers to teach it...and they did. The teachers assigned tasks and projects to help students meet these GPS standards. The students worked faithfully to complete these tasks. They did all they could. So place the blame where it is due. THE PROBLEM IS WITH THE TEST, NOT THE STUDENTS OR THE PARENTS. You cannot give teachers broad concepts to teach and then create a test that is very, very, specific. I doubt Ms. Cox herself could pass the 6th or 7th grade Social Studies test that was created! The test questions just did not line up to the curriculum the teachers were told to teach. (Too much pressure is placed on students to pass this test anyway) What if a child suffers from test anxiety?
By Fugetaboutit
May 25, 2008 1:43 AM | Link to this
The numbers (test scores and numbers who passed) does not make the difference. What does is are these students learning how to learn? Do they have the basic skills in place to pick up a piece of literature and decipher it as well as question it? Once that is in place I would hope that the focus is not on trivial pursuit type learning in which many facts are expected to be memorized.
While we can all agree that all of us should know certain information, if we learn information in a meaningful way, if it is critically analyzed or pondered, that type of learning takes us further.
I would be very interested in reading the questions. Developing good questions is an art and few are good at this.
Good questions reinforce what is learned not make it more ambivalent.
Good questions also allow for varying points of view since all of us bring different experiences to the table.
Basically, if we teach our students the skills they need to actively pursue information and be able to apply it consistently, we have done well by them.
What I find is that too often there are bits of information that take away from what we are supposed to learn. For example, Paul Revere shouting that the British were coming. Yes, he did that, but what is more important is that we know what type of government our forefathers were trying to get away from, how it figures into the change of government, why this was significant, how does it apply today, does it make the student aware that all of us play an active role in the metamorphosis of government, etc...?
Too often, the way students are taught is through a sound byte. I say let's teach students to critically analyze what is thrown at them. When students learn this way, they seek information, they try to put all the pieces (including the trivia) together and can remember it better.
Too, what do we really want everyone to know and understand? Let's decide.
Maybe we need to establish more homogeneous guidelines for why parts of history were distinct from one another. From there, we can fill in the specifics that I tend to refer to as "trivia" or facts that by themselves mean little. Knowing a date is not as important as understanding why something happened was significant. While it is good to have some idea of the chronological order in which history evolved, it is much more important to understand the importance of its impact.
So back to this so called test debacle. We need good tests and a good idea of what we want to teach and why.
[1 2 3 4 5 6 7 8 9 10] next
Commenting is open from 8 a.m. to 5 p.m. M-F, except on Tuesday when it's open until 9 p.m.
Post a comment
*HTML not allowed in comments. Your e-mail address is required.
Request a comment be removed