Authentic Application of Data Analysis to Advance Your Practices
Are you teaching in a school where you are required to conduct preassessments? Are you comfortable developing preassessments? What changes do you make based on the preassessments’ outcomes? The preassessment process is significant for you and your students. And, fortunately, the process is quick, easy, and provides with some of the most important data to advance the effectiveness of your practices!
Start with Preassessments in the Assessment Cycle
In my last blog post, I introduced the Assessment Cycle (shown above). Preassessments must be conducted BEFORE starting the teaching, learning, and schooling associated with any unit of learning. Understandably, units of learning may last from a few days to a few weeks. Your time is valuable and you want to both optimize the opportunities and maximize the measures. Following the five steps of the preassessment process allows you to work smarter, not harder.
- Identify Overarching Goals and Purposes Framing the Unit of Learning
- Develop 10-12 Appropriate Preassessment Items
- Conduct Your Preassessment THE DAY BEFORE Starting a New Unit of Learning
- Analyze the Data
- Use the Same Preassessment for the Postassessment
Step 1: Identify Overarching Goals and Purposes Framing the Unit of Learning
For any unit of learning, whether it is designed for a single curriculum from one content area or for cross-curriculum integrating content from several different content areas, you must identify the overarching goals or purposes for the unit. Your overarching goals or purposes should be based on and aligned with the standards and expectations for your content area(s) [including the anticipated knowledge, skills, and dispositions] published by the national professional association(s), the state department of education, school district, and school/department/grade level. During your educator preparation program, you visited these websites to locate the standards. Most units of learning are framed by 10-12 overarching goals or purposes.
Step 2: Develop 10-12 Appropriate Preassessment Items
Each of your 10-12 overarching goals or purposes should be developed into a preassessment item. [Please notice that preassessment includes items rather than questions. You may be developing statements rather than questions; plus later you will be conducting an item analysis, not a question analysis.]
Usually, preassessment items are developed into one of two forms: Selected Answers or Constructed Reponses. However, in some content areas and grade levels, preassessment items may include Demonstrated Performances and Spoken Conversations.
Selected Answers expect students to pick an answer from a set of possible answers, i.e., multiple choice, true/false, fill-in-the-blank from a provided list, matching, ordering, ranking, rating, and so forth. The provided set of possible answers should be logical and reasonable; they should not be silly or tricky. You are attempting to discover the information your students do and do not possess before the unit of learning. You are not attempting to entertain, confuse, or embarrass your students.
Selected Answer preassessment items are more difficult to develop but easiest to score. Scoring involves looking at the answers that most likely have been circled, underlined, bubbled, and so forth. However, since Selected Answer preassessment items provided a set of possible answers, each student has a chance of selecting the correct answer merely by guessing. You cannot be sure if the student actually possesses the information—or if they can guess well.
Constructed Responses expect students to write an answer in words from memory, i.e., no set of possible responses is provided. Constructed Responses include writing a single letter (not from a set of possible responses for a multiple choice item), a single word, a few words, a phrase, a sentence, multiple sentences, a paragraph, multiple paragraphs, story, essay, report, and so forth. Just as with Selected Answers, your items should be logical and reasonable; they should not be silly or tricky. Again, you are attempting to discover the information your students do and do not possess, not entertain, confuse, or embarrass your students.
Constructed Response preassessment items are easier to develop but more difficult to score. Scoring involves designing a rubric in advance so you are ready for the range of responses you will receive. You must determine all of the possibilities before you start scoring, such as spelling, grammar, punctuation, accuracy, specificity, and so forth.
Demonstrated Performances expect students to show an outcome. For Preassessment Items, a Demonstrated Performance may include writing a mathematical computation, drawing, etc., or pointing to words, pictures, objects, etc.—especially for students who are non- or novice readers in the classroom language. The Demonstrated Performance relies on memory, not a set of provided possible performances.
Demonstrated Performance preassessment items can be easy or difficult to develop depending on the anticipated outcome, easy to score, but can be more difficult to administer since for some Demonstrated Performances, the teacher must meet with each student individually and in a location where other students will not view the Demonstrated Performance.
Spoken Communications expect students to speak an outcome. For Preassessment Items, a Spoken Communication may include saying a single letter (again, not from a set of possible answers for a multiple choice item), a single word, a few words, a phrase, a sentence, multiple sentences, and so forth. Spoken Communications are more appropriate for Formative and Summative Assessments, which will be detailed in upcoming blogs.
Just as with Demonstrated Performances, a Spoken Communication preassessment item scan be easy or difficult to develop depending on the anticipated communication, easy or difficult to score again depending on the anticipated communication, and difficult to administer since for most Spoken Communications, the teacher must meet with each student individually and in a location where other students will not hear the Spoken Communication.
Step 3: Conduct Your Preassessment THE DAY BEFORE Starting a New Unit of Learning
Many teachers do not conduct preassessments. When teachers skip preassessments, they are not aware of their students’ knowledge, skills, and dispositions, or acknowledge their students’ strengths and weaknesses. These teachers start the teaching, learning, and schooling as if all students are the same and the teacher possesses magical powers associated with their students’ capabilities, needs, and interests. Likewise, teachers who do not conduct preassessments or analyze their preassessment data are not aware of their own teaching practices or acknowledge their strengths and weaknesses. Conducting the preassessment and analyzing the data both equips and empowers teacher to modify and advance their practices. One of my colleagues says, If you always do what you always do, you will get what you always get. Most teachers want to increase their student engagement and achievement while they improve their effectiveness and self-efficacy.
Just as teachers who do not conduct preassessments or analyze their preassessment data before starting a new unit of learning, teachers who conduct their preassessments on the same day they start a new unit of learning, most likely, are not interested in modifying or advancing their practices. Therefore, the preassessment for a new unit of learning should be conducted THE DAY BEFORE starting the new unit so you have time to modify the teaching, learning, and schooling appropriately. Conducting preassessments should require less than 15 minutes. You should allocate these 15 minutes with enough time to transition from the completed unit of learning to the new unit of learning. It is suggested that you return your feedback to the summative assessment from the completed unit and then transition to the new unit on a Friday (or the last day of the week that you meet with these students). Then you have time to analyze data and modify your practices.
Step 4: Analyze the Data
The most convenient approach to analyze data is to create a table with the item numbers along the x-axis and the students’ codes along the y-axis. Insert an x for each student’s correct outcome on every item. This display allows you to see the full picture of the preassessment scores.
| Item | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 |
| Student | ||||||||||
| A | + | + | + | + | + | |||||
| B | + | + | + | |||||||
| C | + | + | + | + | + | |||||
| D | + | + | ||||||||
| E | + | |||||||||
| F | + | + | + | + | ||||||
| G | + | + | + | + | + | + | ||||
| H | + | + | ||||||||
| I | + | + | + | |||||||
| J | ||||||||||
| K | + | + | ||||||||
| L | + | |||||||||
| M | + | + | + | + | + | + | + | |||
| N | + | + | + | + | + | |||||
| O | + | + | ||||||||
| P | + | |||||||||
| Q | ||||||||||
| R | ||||||||||
| S | + | + | ||||||||
| T | + | + | + | + |
Then, use an Excel spread sheet to enter the scores to generate two bar graphs. One bar graph, the Preassessment by Item Number (in Figure 1) shows the item numbers along the x-axis and the number of correct outcomes on the y-axis. The other bar graph, the Preassessment by Student Code (in Figure 2) shows the student codes along the x-axis the number of correct outcomes on the y-axis as shown.
The bar graphs will reveal several different scenarios including:
- the preassessment item outcomes that your students already possess
- the preassessment item outcomes that they need to learn
- the preassessment items that you should use when you teach this unit of learning again in the future
- the preassessment items that you need to redevelop before you teach this unit of learning again in the future
However, you SHOULD NOT redevelop the preassessment items during the unit of learning. You must use the same items for the post assessment so you can compare and contrast change over time. If you redevelop the items, your data will not align and your analyses will not be helpful.
Step 5: Use the SAME Preassessment for the Postassessment
You must use the SAME Preassessment for the Postassessment to fully comprehend your students’ growth. Now you can create the same table and two bar graphs with the Postassessment data as you created for the Preassessment Data as shown in Figures 3 and 4.
Finally, you can create bar graphs that compare the contrast change over time as shown in Figures 5 and 6.
CAUTION: You SHOULD NOT redevelop the preassessment items during the unit of learning. If you redevelop the items, your data will not align and your analyses will not be helpful.
Modification of your practices will be detailed in an upcoming blog post.
