Course Evaluations and Their Uses- Initial Thoughts

It surprises me that we haven’t yet made a post about course evaluations. Perhaps because this blog focuses more on preparing to teach and then actually teaching a course, we have paid relatively little attention to date to what happens at the end of a course besides handing out grades.

It is important, however, to pay attention to course evaluations, because they play such a significant role in tools that teachers can use to self-evaluate, but also because administrations use them to evaluate teaching effectiveness. This latter point is incredibly important for those who are in a tenure-track position, but also important for all others whose performance will be measured in part through course evaluations.

For starters, please read the article “How to Use Student Evaluations Wisely” by Professor David D. Perlmutter,, Dean of the College of Media & Communication at Texas Tech University.

In it, he discusses how such evaluations can be and are used both by administrators as well as by faculty. In future posts, I will discuss my take on course evaluations and address some of the points Professor Perlmutter makes.

Advertisements

Pedagogy Now! Creating Effective Evaluation Techniques

Thanks to everyone who attended our CAA workshop, Creating Effective Evaluation Techniques. We had a great time presenting and got a lot of feedback through all the fabulous questions and comments.
As promised, here is our powerpoint presentation PDF. Please feel free to give us any feedback, to ask us questions via the blog or email, or to ask us to address particular issues in the blog. We are also happy to come to your school to do a workshop tailored to your program’s needs. Contact us here:

PedNow_CAA2014_final

Technology in the Classroom- Use of Laptops, Notebooks & Smartphones

The issue of whether students should be allowed to use their laptops, smartphones, notebook computers, etc. while class is going on has been a hot topic for many professors for a long time now. This is a topic for which there is no one perfect solution, as use of these devices can make total sense for some courses but not for others. While more and more professors seem to be finding ways to integrate the use of these devices into their classes in a way that is acceptable to both them and to the students themselves, it still remains a challenge.

David Gooblar recently published an article in his Pedagogy Unbound blog in which he cites a method used by two professors at the University of British Columbia. At the start of the semester, they have the students themselves collaborate on a usage policy that everyone in the class will be expected to follow throughout the term. This approach has the advantage of making the students be part of the solution to the problem, thus increasing the probability of their buying into whatever policies are decided upon. (The solution that seems to be least-successful is the one in which the professor dictates the terms of usage to the students. That seems to light the fire of student ingenuity as they then try to find ways around whatever you’ve dictated.)

In a lecture class of roughly 70 students, I prefer a more hybrid solution. I would address this issue on the first day of class. A colleague of mine who is a psychology professor had polled her students about what they found to be the top five most annoying classroom behaviors exhibited by fellow students during class. Number one on their list was “side conversations”, closely followed by “laptop and cell phone use”. For each point on the list, I asked my students to articulate why they thought that item was on the list. What made that behavior particularly annoying?

They determined that, in the case of laptops and cell phones, it was the distraction factor, I then gave them a few minutes to discuss amongst themselves possible solutions. They spoke up and in the end agreed to try to minimize disruptive use of technology.

I went on to tell them that they would have plenty of opportunities to use both laptops and smartphones during class time, as there were times that I would expect them to conduct in-class research or to participate in online polls, take notes, etc. But I also told them that there would be times when it would not only be inappropriate but unnecessary to be on their devices and that, at those times, I would require that they be put to sleep or turned off.

I am convinced that this kind of open conversation on the first day was the reason why  the use of technological devices never became a problem in that class, despite its size. It also helped that I asked them to use their devices at minimum in every second class, even if only for a few minutes. This seemed to diffuse some of the pent up need to power up a screen and allowed them to focus better for the remainder of the class.

You’ve Made a Mistake- Now What??!!

Every person who has ever taught a class has made an error of some sort. Sometimes you know you’ve made one immediately, while sometimes the mistake becomes evident only after a period of time.

I was recently contacted by an adjunct professor who had been provided by her university with a syllabus, lesson plans, assignment instructions, grading rubrics, etc. for a very technical class. One of the assignments had a set of relatively complex instructions. Five weeks into the project, she discovered to her horror that she had interpreted the instructions for the assignment in a certain way, and while half of the class had followed her lead, the other half of the class had interpreted them completely differently. Because of this, this second group was generating work that was different than that of their classmates. How should a professor handle something like this and still be fair to all?

While there were a number of solutions to this specific problem, the key to resolving any problem that arises from a teacher error is to admit to the class that you made a mistake. Give them a brief outline of what happened- they don’t need to know all the details, just enough to give them a picture of what led to the confusion/misunderstanding/error. This shows them that you are on top of it now, and that you understand the necessity of working towards a fair solution. Then present them with that solution, which is just what this professor did.

In this case, the best solution had to strike a balance between what was done by both groups prior to discovery of the error, what the assignment originally intended (learning outcomes), how well the work already done by both groups would achieve the learning outcomes of the assignment, and importantly how the professor wanted to grade the assignment from this point forward.

Learning Outcomes vs. Goals/Objectives

Is there a difference between the terms “learning outcomes”, “goals”, and “objectives”?

Well, yes.

In reality, these terms are often used interchangeably by educators. We all know what we are talking about when we use these terms, whether we are talking about them in terms of an individual class or an entire departmental curriculum. Although the differences between “goals” and “objectives” are relatively slight, there is in fact an important difference between those terms and “learning outcomes”:

A “goal” is the general result or achievement toward which effort is directed. It implies that you might not get there, as these are only the results you intend to get. (ex. “To gain an understanding of basic composition principals.”)

An “objective” is the specific result or achievement toward which effort is directed. Like “goals”, it also implies that you might not get there, as these are only the results you intend to get. (ex. “To  become familiar with the principals of line, shape, form, contrast, and color in artwork.”)

An “outcome”, on the other hand, is something that follows from an action. It states that you will get there and that there will be evidence of learning that took place. It also outlines the means by which students will achieve the learning. (ex. “Students will demonstrate effective use of the compositional principals of artwork, both graphic and aesthetic, in the creation of a studio project and/or a written research project.”

An “outcome” will also make evident what exactly will be assessed. This is why creating a learning outcome can be so helpful when figuring out what to grade and how to grade it. A well-written learning outcome for a course or a project will initiate the seamless “threading” process that leads a teacher from the outcome to the assignment to the critique to the grading of the work produced.

Please note that both “goals” and “objectives” are usually written with the passive voice. “Outcomes”, on the other hand, are written in the active voice. This difference is clear in the above examples. Verbs like “interpret”, “identify”, “present”, “design”, “analyze”, “apply”, “illustrate”, “explain”, “demonstrate”, and “create” are all very useful when creating a learning outcome statement.

For more information on this subject, the University of Connecticut has published an excellent Assessment Primer that covers these differences in depth.

Pedagogy Now! Teaching Teachers to Teach

Attached is a PDF of the 2012 SPE presentation by Janie, Suz and Angela. This is intended to be helpful in jumpstarting ideas surrounding the topics. It is, of course, missing our fabulous presenter skills! Please note that movies are inactive and not all the links translated as live in this PDF, however there should be enough info to point you in the right direction for further research.
PedagogyNow_Web

What is a Syllabus?

A syllabus is a document that summarizes and outlines the most important information about the a course. It sets the contract between teacher and student for the duration of the course and, as such, should be adhered to.

If, however, you find that you need to change something important (like a project due date) in the middle of a semester, make sure that you announce it verbally to your class AND send it to them in writing either via e-mail or as an online announcement via Blackboard or similar site where your course information resides.