Wednesday, July 10, 2013

Definition of Formal Assessment









Group work for formative assessments: 

What?
Definition:
As assessment that allows the students to improve mistakes and it dictates future instruction from the teacher.  
In other words, formative assessment is not a tool or an event, but a variety of strategies that involve acting on the assessment data to improve learning.
What makes formative assessment formative is that it is immediately used to make adjustments so as to form new learning.” (Shepard, 2008).

Characteristics:

frequent, flexible, variety, precedes summative assessments,
building toward the summative’s skillset
answers 3 questions:
“Where am I going?”
“Where am I now?”
“How can I close the gap between the two?”

So What?

Examples:
Google Form, exit ticket, thumbs-up, quiz, essay feedback (nongraded), Socratic discussions, “Socrative” website, 3-minute paper


Misconceptions/Non-examples:
Final test, no chance to improve, Gotcha Quiz, big impact, no feedback, grading on participation,
What is the difference between formative and informative assessments?
Quick guages are informative, whereas formative is more concrete (on essays / papers, comments, feedback, etc.)

Now What?
1.  Create a Checklist to Assess ANY Informative and Formative Assessment
2.  Post your Assessment Checklist below as a comment.
3.  Create 6 or more formative/informative assessments for the unit that you have written a performance summative assessment.
4.  Be ready to share how your informative and formative assessment embody the items on your checklist.

  1. Analyzing their content standards to identify and agree on a limited number of essential standards and learning targets…those that students must master to ensure continued academic success.
  2. Creating assessment maps for each unit of study that include planned flexible time for intervention, sequence effective learning of the essentials and provide consistent formative assessment experiences prior to summative, evaluative assessments.
  3. Agreeing on student-friendly versions of the essential standards and sharing them with students.
  4. Collaboratively developing short, targeted formative assessments that directly align to the essential standards being learned and match what has been taught.
  5. Analyzing the assessment results, as a team, to pinpoint specific learning problems and agreeing on instructional actions to address such problems with those students who need additional time and support.
  6. Taking action in a timely fashion…providing students with feedback, more practice, and additional opportunities to demonstrate their learning…prior to summatively evaluating student mastery of the essential standards and targets.

Goals for improving Pre- and Summative assessments

To improve these assessments, I will need to formalize which grammatical concepts should be taught and in what order in the aid to improving student writing. This is kind of subjective, in that I have an idea as to which concepts are required of that level, but I also want to be able to nimbly jump around to whichever ones students display a lack of skill in. So, they can vary from year-to-year and class-to-class.
I also want to do a better job of using more samples of student writing; while I do use at least 1 or 2 for writing throughout the trimester, I need to do more of them on the whole. I want to use them for more activities, especially in small-groups, and more interactively. For example: the plan, as of now, is to load the sample student essays (without my comments, when possible) onto ibooks, the Kno App, which is what our textbooks will be on, or a googledoc that they can all edit (I'm leaning in this direction, currently). Their group will be responsible for peer-reviewing / editing specific portions / pages of the document, which will show up on the projector as they do it. Then, we'll review the essay and their comments together, decide on a score form the AP scale, and then compare that to the grade I gave them (or the grade the AP reader gave the essay in the case of the AP essays from the books they give us). This will be helpful, interactive, and informational as far as what I expect and the AP board expects from a synthesis essay. To go along with this, I want to make a checklist out of the AP writing rubric that they can use for each sample essay to help them determine the score. This will make it easier to identify the qualities they think it displays in a more digestible form than its current "written-as-paragraph" state.

Pre-Assessments

Pre-Assessment -


The Pre-Assessment I’ve used is similar in structure, content, and style to the final product: A “Synthesis” essay. Synthesis, according to the AP Language board, basically means writing formally, answering a prompt, citing multiple sources of literary merit (be it poetry, essay, literary nonfiction, fiction, etc.) to help answer / prove the students’ point of view regarding the prompt. Their first two essays in this style are the pre-assessment, and what I’m judging them on is:
- organization, of both paragraphs (attention-getters, support, concluding statement / transition) and the essay as a whole (paragraph arrangement, order, introductory paragraph and concluding paragraph)
- Thesis statement - it should be the last 1 or 2 sentences of the introductory paragraph, and include an opinionated statement of position (if it can’t be argued, it’s not a strong thesis - thesis statements have opinions!), as well as why that statement matters or how it is accomplished. The first essays are usually geared more toward “How authors accomplish _____,” as the first units are focused on tone, using diction, syntax, etc. A more advanced option is to write about why the literature matters, how it’s innovative or convincing, writing about it using lenses of literary criticism, etc.
- Quotation usage - Students must be able to cite evidence accurately and convincingly (which requires skills in analyzing literature) as well as being technically proficient with it (punctuating it correctly, citing it correctly, etc.).
- Grammatical conventions - I want to know what they can do, what I must teach, etc. Areas of specific concern are the use of: parallel structure; appositive phrases; avoidance of comma splices; using multiple symbols (;:,-), etc.


These first essays are not required to be a certain length, and that’s part of the assessment; I do, however, mention this: that when AP graders are reading their essays, they aren’t SUPPOSED to be biased by length; however, studies show that students who make it onto the 3rd page of their handwritten AP test essays usually score, on average, at least a point higher than their counterparts who don’t make it to the 3rd page. So, when assigning these essays, I generally go by the same “informal rule” - that students should aim to make it to the 3rd page of the essay. I won’t necessarily penalize them for not making it, but most essays require a certain amount of space to completely convey their point of view, convincingly, to the audience of informed readers.


Attached are the first two packets for 9th grade that I’ve used in the past; the essay prompts can be found on the back pages. Students have been able to choose between either of the essay options (or in the case that there are three, all three). The second two attachments will act as the assessment essays for 10th grade Pre-AP English class; I’ve yet to decide whether I’ll do one or two pre-assessments for 10th grade, as this will be the first year I’ve taught it, and I will have had most of the incoming students in Pre-AP English 9A/B the previous year. In the past, students have received full credit (20 points in the Essays / Major Tests category, which is worth 40% of their grade) for completing the assignment in a satisfactory manner (I'm the judge of that).


https://docs.google.com/a/isd110.org/file/d/0BzChdz6CxM6oSmtKZ1BTd09XR1E/edit?usp=sharing
https://docs.google.com/file/d/0BzChdz6CxM6oUnF5bk9Ha185YjA/edit?usp=sharing
https://docs.google.com/a/isd110.org/file/d/0BzChdz6CxM6oTmJydGVxZDVUZzg/edit?usp=sharing
https://docs.google.com/a/isd110.org/file/d/0BzChdz6CxM6oT0lTUVRLS2lRSFk/edit?usp=sharing

Also attached is the sort of "Writing checklist" that I give the students before all writing assignments; it includes good and bad examples of all writing components, a checklist of the things that "good academic writing" usually includes, examples of how to integrate different types of quotations, and a basic outline form that they can use if they wish, but for some assignments are not required to. 
https://docs.google.com/a/isd110.org/file/d/0BzChdz6CxM6odjBWN0NvN1R0R2s/edit?usp=sharing

Tuesday, July 9, 2013

Summative Performance Assessment

Dusty Neibauer


This is an AP-style essay in that it combines multiple resources and critical essays (literary theories of multiple varieties) to take a position on and issue in The Grapes of Wrath. It synthesizes them into a cohesive whole, and is the largest of the AP-style synthesis essays they write (as well as the most valuable). This essay is worth 50 points in the Major Essays / Tests category (compared to 20 each for each of the 2 sample essays, and 25 each for the 3 formative essays) Here is the assignment containing the prompts:




Clearly stated objectives that are tied to standards.
I provide an AP-style checklist that lists the qualities of an essay that corresponds with the number that essay would get.



A product/performance should be created during this process.
The essay is written during the summative performance; they have done multiple other examples throughout


Cumulative evidence of proficiency throughout the process.
The multiple AP-style essays as both diagnostic (x2) (20 points each in Major Essays / Tests category) and formative (x3) (25 points each in Major Essays / Tests category) , serve as progress trackers, with teacher feedback on each according to common elements of literary analysis (knowledge of theme, motif, symbol, etc.) as well as the grammatical mini-lesson attached to the essay (using appositive phrases, subordinate clauses, etc.). The links to the example lessons and the prompts for which the essays are used are here:


https://docs.google.com/a/isd110.org/file/d/0BzChdz6CxM6oVno0Rl94MlBYWk0/edit?usp=sharing
https://docs.google.com/file/d/0BzChdz6CxM6oUnF5bk9Ha185YjA/edit?usp=sharing
https://docs.google.com/a/isd110.org/file/d/0BzChdz6CxM6oOUZBX3dVYno1djQ/edit?usp=sharing
https://docs.google.com/file/d/0BzChdz6CxM6oa0hBMzBQeHBNR3c/edit?usp=sharing
https://docs.google.com/a/isd110.org/file/d/0BzChdz6CxM6oT0lTUVRLS2lRSFk/edit?usp=sharing



Students demonstrate autonomous engagement/ability throughout the learning process as well as throughout the creation of the product/performance.
This is judged through the writing, through Socratic discussions, through small group involvement, etc.


Students use creativity/problem-solving skills to demonstrate their knowledge.
Students can use outside sources, such as novels, essays, articles, poems, etc. to aid in their writing toward the prompt’s theme. This helps them show creativity, initiative, and critical analytical / literary thinking and knowledge.

Group Insights / Group notes for assessment desires

Shawn - have a solid assessment -
Eric - pre-assessment
Holly - user friendly yet students can use them
Scott -
more story problems, etc. -
Nicole - new, creative formative assessments
Judy - curious
Katie - exciting testing vs. typical crap
Evan - new curricula, getting it going
Kiersten - many levels while being rigorous
Kathy - check to be on right path
Dusty - get some assessments! 10th grade
Mike - create multiple levels of ass. for quality, not punitive
Drew - possible standards-based grading
Sarah - new grade level, build on the current ones
Michael - project-based assessments
Cara - IB - expand the choice board concept for other units
Mary - Work on ones for writing skills
Bethany - flipped classroom assessments - quick check ones

Patterns:
- Differentiation between skill levels
- Creative ones that aren't necessarily traditional
- Instant feedback / information for students to be able to work with and observe
- Just getting new ones, for people that are switching between the grades / curriculum
- more rigorous ones

Critical Friend
Shawnsy

Group insights:
student assessment
pre/post ones - full package - rubrics, etc.
more meaningful, part of the unit, organically
more creative / nontraditional
differentiated ones


Expect and accept non-closure - I'm a "results" guy - I shall identify the problem, work toward a solution, and then move on to the assessment. It's not natural to me to let the problem just hang there and linger if I can do something about it, so that's going to be tough to accept. I expect that I'll engage in discussion and work moving toward a more "loose" perception of assessment and what it can be.

The most natural part, for me, will be the "suspension of belief" part, because it's something that I preach the gospel of in my classes. If students aren't able to suspend their own beliefs / perceptions of the world / experiences, then they can't truly understand authorial purpose, characterization, or even culture (both their own and others'). Thus, I'm used to doing this, and believe that I shall succeed!


Performance-based summative assessment
Definition:
It's many things: from short answers, to essays, to involved lab activities; it's not a traditional test, necessarily.
Congress says: any form of testing that requires a student to create an answer or a product that demonstrates his/her knowledge or skills.
Must demonstrate their ability to apply skills to situations that aren't in those formulaic modes.

Characteristics:
It does not work toward identifying a correct answer off of a list of those possible; instead, they display original, creative thought, and students are active participants in demonstrating said knowledge.
Meier says: "it requires schools to invest in seven interrelated components: active learning; formative and summative documentation; strategies for corrective action; multiple ways for students to express and exhibit learning; graduation-level performance tasks that are aligned with the school’s learning standards; external evaluators of student work; and a focus on professional development."
And all it requires is what the Japanese and Finns already provide: School time for serious professional work, not just classroom instruction, and deep investments in cultivating teacher capacity.

Examples:
constructed response, essays, performance tasks, hands-on learning, demonstrating evidence through citing sources, etc.
 At Mission Hill, the school I helped found in Boston, we had a simple graph that charted each child’s reading progress from the time s/he entered the school until s/he graduated — and it was based upon an oral interview.
The interviewer scored samples of a student reading aloud and discussing the text with the interviewer twice a year, providing the student’s teachers with a valuable piece of hard evidence.

Non-Examples:
Wordbank / fill in the blank / multiple choice exams / quizzes
One-answer style situations

Checklist for Performance-based summative assessment
___ Objectives (tied to standards) for the assignment are stated clearly
___ Evidence of a(n) product/performance should be evident and clearly visible
___ Student demonstrated proficient, cumulative evidence of formative assessments ("checkmarks")
___ Students demonstrate autonomous engagement/ability throughout the learning process, as well as throughout the creation of the product / performance.
___ Students use creativity / problem solving skills to demonstrate their knowledge


Day 2

Blogged response to the metaphor of the Unit Plan:
The unit plan has multiple ways of achieving the same ends; Like Wild Bill said, the journey is often not linear, and that mirrors both the acquisition of knowledge and the process by which it's often presented. I think that knowledge seeps in over time, and must be acquired not at different points - that's why, especially when teaching writing and literature analysis, one must see it as, to borrow my group's metaphor, a rising tide. While it is slow and uneven at times, it will indeed rise...it's inevitable - students will acquire knowledge...we just have to keep reviewing what they need to know, insisting that they meet our high standards, etc. Teachers either take on the role of gravity or the moon in this metaphor, which can be seen as mostly good...although we shouldn't necessarily strive to be immovable objects / forces of nature in all aspects of teaching.