Pedagogy Now! Creating Effective Evaluation Techniques

Thanks to everyone who attended our CAA workshop, Creating Effective Evaluation Techniques. We had a great time presenting and got a lot of feedback through all the fabulous questions and comments.
As promised, here is our powerpoint presentation PDF. Please feel free to give us any feedback, to ask us questions via the blog or email, or to ask us to address particular issues in the blog. We are also happy to come to your school to do a workshop tailored to your program’s needs. Contact us here:

PedNow_CAA2014_final

Advertisements

Grading Rubric for Studio Art Visual Thesis

In the University of Cincinnati’s School of Art, Fine Arts majors are required to spend their entire senior year working on their thesis projects. These projects consist of two parts: the written thesis and the visual thesis. )For information on the rubric for the written thesis, click this link.)

The Senior Thesis Seminar course is set up to provide guidance and support for the seniors as they actualize their projects. This course has three learning outcomes, one of which is directly related to the visual work they are doing:

“Students will demonstrate substantial professional accomplishment in a coherent body of artwork through exhibition in DAAPWorks.” (Ed. The title of the senior end-of-year show.)

Here is the rubric that is used by faculty to grade the visual thesis projects. There are six major categories that faculty want to evaluate, and this rubric makes clear that they are not all weighted equally. The standards of excellence for each category are well-defined, although it should be noted that tweaking is done to the wording every year, depending on who is teaching the course.

Grading Rubric for Studio Art Written Thesis

Many studio art programs require not only a visual thesis of artwork, but also a written thesis that accompanies the visual work. Given that the students are writing about their creative process and research methodologies, this kind of written document can be challenging to grade for professors.

Here is a rubric that is used by faculty in the School of Art at the University of Cincinnati to grade the written thesis papers of their studio art seniors. Please note that they chose to focus the grading process on three main areas: Content, Sources and Mechanics. These items cover everything that faculty want to see in the document, and enabled them to keep the rubric relatively simple.

This rubric also ties in directly to one of the three learning outcomes for the course, specifically:

“Students will demonstrate their ability to research and articulate their visual thesis project and its connections to art history, to contemporary art, and the cultural milieu through verbal and written critical discourse.”

This rubric enables faculty to see very clearly which students are achieving that  outcome and which aren’t.

For information about the rubric for the visual part of the thesis, click on this link.

Learning Outcomes vs. Goals/Objectives

Is there a difference between the terms “learning outcomes”, “goals”, and “objectives”?

Well, yes.

In reality, these terms are often used interchangeably by educators. We all know what we are talking about when we use these terms, whether we are talking about them in terms of an individual class or an entire departmental curriculum. Although the differences between “goals” and “objectives” are relatively slight, there is in fact an important difference between those terms and “learning outcomes”:

A “goal” is the general result or achievement toward which effort is directed. It implies that you might not get there, as these are only the results you intend to get. (ex. “To gain an understanding of basic composition principals.”)

An “objective” is the specific result or achievement toward which effort is directed. Like “goals”, it also implies that you might not get there, as these are only the results you intend to get. (ex. “To  become familiar with the principals of line, shape, form, contrast, and color in artwork.”)

An “outcome”, on the other hand, is something that follows from an action. It states that you will get there and that there will be evidence of learning that took place. It also outlines the means by which students will achieve the learning. (ex. “Students will demonstrate effective use of the compositional principals of artwork, both graphic and aesthetic, in the creation of a studio project and/or a written research project.”

An “outcome” will also make evident what exactly will be assessed. This is why creating a learning outcome can be so helpful when figuring out what to grade and how to grade it. A well-written learning outcome for a course or a project will initiate the seamless “threading” process that leads a teacher from the outcome to the assignment to the critique to the grading of the work produced.

Please note that both “goals” and “objectives” are usually written with the passive voice. “Outcomes”, on the other hand, are written in the active voice. This difference is clear in the above examples. Verbs like “interpret”, “identify”, “present”, “design”, “analyze”, “apply”, “illustrate”, “explain”, “demonstrate”, and “create” are all very useful when creating a learning outcome statement.

For more information on this subject, the University of Connecticut has published an excellent Assessment Primer that covers these differences in depth.

Self-Assessment = Getting them to Think about their work

There is a lot of chatter in the education community about Self-Assessment. In feeling somewhat dissatisfied that my rubrics are often more useful to me than to my students, I decided this fall to institute more consistent self-assessment into assignments. This assessment has taken two forms – the most obvious is actually giving them the rubric and asking them to complete it and turn it in with the project (the hope here is that this will provoke them to actually read the rubric!). The second is providing them with a series of questions about their work. The goal for me with self-assessment is that they think through what they are doing, rather than waiting for a longed for, but often mysterious grade from me. In the past I have asked them to write a self-evaluation with their projects, building up to an overall statement by the end of the semester. My new approach is giving them self-assessment questions tailored to the assignments.

It’s nearing the end of the semester and what has come of this new approach? Some students have been diligent in their responses, some slackers, just as I imagined. The real bonus has been getting a fix on whether they actually understand the assignments – they may be doing it right, but are they connecting the dots? Ultimately, their self-assessments have been more valuable all along the way than the end of semester course evaluations that at my school at least, are an agony of filling in bubbles and navigating obtuse data. If I ask a student “Which aperture gave you consistently shallow depth of field?” not only am I getting them to think about the result (rather than just look at it), I am also getting a sense as to whether they understand what they have done. It’s helping me to see on an assignment-to-assignment basis whether I am an effective teacher. How carefully or thoughtfully they respond, helps me to also understand whether my students are diligent learners. An obvious lesson is that those who skip the assessment are often the most problematic learners. A corollary bonus is that I get a sense of my student’s expectations. By offering them the opportunity to score their own rubric then match it to mine, room opens up for a conversation about those expectations.

Self-assessment takes time and for me is always a work in progress. I highly recommend incorporating it into assignment delivery and course expectations.

Pedagogy Now! Teaching Teachers to Teach

Attached is a PDF of the 2012 SPE presentation by Janie, Suz and Angela. This is intended to be helpful in jumpstarting ideas surrounding the topics. It is, of course, missing our fabulous presenter skills! Please note that movies are inactive and not all the links translated as live in this PDF, however there should be enough info to point you in the right direction for further research.
PedagogyNow_Web

Sample Grading Rubric

Let’s say you have a basic understanding of the value of specific criteria for grading and now need to create a grading rubric that you will fill out and hand back to students. There are many different formats you can use for creating rubrics.

Here is one example that I’ve used for an Introduction to Photography class. This is used to grade the final project of the semester, and, as such, covers both technical expertise as well as aesthetic issues.