Okay that’s an exaggeration. I\u00a0know we can’t really stop using AIMSWeb MAZE. For the time being, it is the best option we have, and there are no alternatives. But someone, PLEASE, make an alternative!<\/p>\n
Let’s back up and do a quick overview of AIMSWeb MAZE, which you probably use in your school district if you have any kind of reading intervention program. AIMSWeb is a benchmarking and progress monitoring system used widely in schools across the nation. If a student is receiving an intervention, they are likely being monitored once a week with AIMSWeb to make sure they are on track and making gains. If they ARE making progress \/ gains, then this data is used to prove that the intervention is working. If they are NOT making progress \/ gains, then this data is used as evidence that the child may need a different (form of the) intervention.<\/p>\n
Weekly data points\u00a0are necessary to make sure everyone is staying on track. Think of it like weighing yourself every week you are on a diet. You don’t want to weigh yourself daily, because you will likely see too much variation. But on a weekly basis, you are more likely to see an accurate trend over time.<\/p>\n
To track student progress in reading,<\/span> AIMSWeb offers two types of progress monitoring tools. R-CBM tracks a student’s progress in reading fluency; the student reads out loud for 60 seconds, and we would record the number of correct words per minute (CWPM) and errors.<\/p>\n MAZE, on the other hand, is a tool used to measure comprehension. Comprehension is\u00a0a much more complex construct than fluency.\u00a0The following information is taken from the Pearson AIMSWeb Training workbook:<\/p>\n “Maze is a multiple-choice cloze task that students complete while reading silently. The first sentence of a 150-400 word passage is left intact. Thereafter, every 7th word is replaced with three words inside parenthesis. One of the words is the exact one from the original passage.”<\/span><\/em><\/p>\n The students in an intervention take one AIMSWeb MAZE probe ever week. They are given 3 minutes to circle as many correct responses as they can.<\/p>\n As the title of this post suggests, I am not a fan of MAZE. As part of my teacher\u00a0education, I am trained to be skeptical of any assessment tool and analyze it\u00a0for purpose, benefits, and limitations. When I see that a\u00a0tool claims to assess comprehension, I am even more critical and skeptical. I know that comprehension\u00a0is a complex, multifaceted construct that is nearly impossible to assess in multiple choice or scantron format. Comprehension should be a conversation, not an assessment. This isn\u2019t a critique of just AIMSWeb, but of all tools that claim they can assess comprehension in just a few short, simple questions.<\/span><\/p>\n Unfortunately, I see only one benefit to MAZE: it is easy to score. The following are the limitations as I see them with the AIMSWeb MAZE assessment.<\/p>\n Putting the response choices\u00a0within the sentence (as opposed to a question at the end of the sentence) interrupts the flow of reading. The student has to pause and consider all 3 options right then and there. If they choose the incorrect option, it will negatively impact how they comprehend the rest of the sentence or passage.<\/p>\n Consider the following: \u201cMost mornings he just tapped a (all, bit, more) of food into the bowl\u2026(6.26)\u201d In this example, I\u2019ve had students get confused and circle 2 answers (bit more) and read it that way, because the words occur together in line, and this made sense when the student read it out loud.<\/p>\n Now consider this example: \u201cThis is happening (in, to, for) you,” the fish proclaimed. (6.26).\u201d In this excerpt, I personally think there are 2 options that make sense (to and for).<\/p>\n Some common and effective comprehension assessment questions include text-dependent questions, inferencing, close reading questions, questions about the text or author\u2019s purpose. Never in the history of ever has Cloze Reading been considered an effective measure of comprehension. Cloze reading is a sentence-level, low level skill that does not require the reader to build a mental model and comprehend the meaning of the text.<\/span><\/p>\n MAZE allows 3 minutes. Imagine what our students could prove they know and understand if given a bit more time. Think of how many 504s, IEPs, and student plans you have read that have included \u2018extended time\u2019 as an accommodation.<\/p>\n If your intervention is guiding students with adopting and applying reading strategies, as so many good comprehension interventions do, then MAZE won\u2019t give you any usable information to modify your instruction to meet student needs.<\/span><\/p>\n Students don\u2019t actually have to comprehend the passage to answer the questions. If they have an adequate grasp of English syntax and grammar, then they can simply answer the questions by selecting the correct part of speech or most sensible option for that sentence or even phrase.\u00a0<\/span><\/p>\n AIMSWeb claims that, of the 3 response options, 1 is the correct answer, 1 is a near distractor (a word of the same \u2018type\u2019 or part of speech), and 1 is a far distractor (randomly selected, dissimilar part of speech). <\/span><\/p>\n Consider this example from 6.9: (Was, Jim, Day) stopped playing and ran to the (root, door, thus). Do you think \u2018Day\u2019 and \u2018root\u2019 were appropriately challenging near distractors? And, back to points 1 and 3 above, this tells me little to nothing about my students\u2019 ability to comprehend the text, and gives me little to nothing to go on to adjust my instruction to help them improve their scores.<\/span><\/p>\n So in all, you can gather that I am not a very big fan of MAZE. And yet, it is a piece of data. ONE piece. We need to be triangulating student data and making sure to never make high stakes decisions based on solitary data points. Consider classroom evidence, Fountas & Pinnell benchmarking, MAP or STAR scores, and any other data points you can to obtain a whole picture on a student.<\/p>\n I’d love to hear what you think of AIMSWeb MAZE. I understand that many, many teachers and administrators love it. What\u00a0are your thoughts on this tool – good, bad, or other?<\/p>\n1. The format is confusing for students and negatively impacts their performance. <\/span><\/h6>\n
2. Cloze Tasks cannot adequately measure comprehension<\/span><\/h6>\n
3. Comprehension should never be timed. <\/span><\/h6>\n
4. MAZE doesn\u2019t align to instruction. <\/span><\/h6>\n
5. You don\u2019t need to comprehend the passage to \u2018pass\u2019 MAZE <\/span><\/h6>\n
6. The distractors are not appropriately challenging. <\/span><\/h6>\n
\n