Resources and Publications

Resources and Publications

Main Content

Defining Active Learning

Michael Prince defines active learning as the “use of instructional methods that require students to engage in meaningful learning activities and think about what they are doing” (paraphrased).

This can be as simple as answering a question or as complex as solving a case with a team of peers. In other words, the emphasis is on active engagement, processing and application.

Content

Quite simply, to engage the student in the act of learning more fully. But how can you tell this is a good thing? Take a look at some observations from a study by Dr. Eric Mazur, a Harvard professor, and active learning pioneer, to answer that question.

In the electro-encephalogram (EEG) displayed in Mazur’s work, all of the class periods register flat lines. In fact, most of them are more flatlined than Sleep! They actually look much more similar to the brainwaves for watching TV. This is passive activity as registered by the brain.

On the other hand, where it says lab and homework or study, the brainwaves show some promise. That’s because by reading, taking notes, or by working actively on an experiment, the subject is engaging more of their brain and actively trying to learn instead of passively receiving information. By engaging more of their brain in learning, they are creating more neural pathways, helping them to remember the material better and connect it to other pieces of knowledge that already have or will gain later.

Content

Not every active learning strategy is suited to every level of learning. For example, it would make no sense to give a first-year student an active learning assignment that required evaluation until you know that they can remember and understand the basic ideas. For example, if the learning outcome says, "Students will know..." or "Students will identify..." a Top Hat quiz might be the best active learning strategy. If the learning outcome says "Students will differentiate..." or "Students will argue/defend..." assigning a case to analyze may be more suitable. As we move through the strategies, we will identify the best fit for students in Bloom's Taxonomy.

This doesn’t mean that everything has to change overnight. Just like there are levels to learning, there are levels to teaching, too. Small changes are best. Enacting one small change to your teaching arsenal and then another next semester, and so on, will put you ahead in the long run by creating less stress for you and more interactivity for your students each semester. You also don't have to use these techniques in every class meeting. The lowest effort examples can be used more frequently. The high effort examples can be used once a week or less. Start slowly and build.

Active Learning Resources

The following instructional strategies can be used in your classroom to better engage students in the act of learning.

Each strategy is categorized by level of implementation difficulty, shows the targeted level of Bloom’s Taxonomy, explains how to use the strategy and the variations available.

Content

Level of Difficulty: Moderate

Bloom’s Taxonomy Level: Apply, Analyze and Evaluate

What is it?

Teams rotate around the classroom, composing answers to questions, as well as giving thought to answers from other groups. Each station has a question that relates to an important class concept. The whole technique closes with a report out of a synthesis of all the answers to a particular question.

How do I use it?

  • Set up one question on the same topic for each station.
  • Better discussions will happen if there is more than one answer or approach to the question.
  • Put the question up on a Word Document or Powerpoint and open each document on the screens in the classroom. (This can also be done with poster paper if you are not in an active learning space with screens)
  • Give each group a set amount of time to answer the question on the document before moving to the next station.
  • When all groups have reached their last station, give each group a set amount of time to sum up all the answers for a report out.
  • Have each group report out a synthesized answer from all the answers listed at their station. This should not just be a list of all the answers, but should communicate solutions that agree, and solutions that conflict.

Variations

Case Studies: Rather than asking a question, this can be used with case studies. Use a different case study for each station.

Micro-Learning: Use this method to roll out several micro lessons (small units of content that can be digested in 5 minutes or less). Ask students to sum up the most important takeaway at the end rather than answering a question. Then, rather than a synthesis, have students share the top two or three takeaways from each station.

Top Hat: Low stakes review questions could be asked using a CarmenCanvas or Top Hat quiz at the end of the activity, rather than a report out.

Content

Level of Difficulty: Low

Bloom’s Taxonomy Levels: Remember, Understand (Reflections could encompass Apply, Analyze and Evaluate)

When people hear Active Learning Strategy, they often think of group work, but there are several active learning strategies that are for individuals. Metacognition (or thinking about thinking) is a highly effective learning tool for students and can be helped along with active learning strategies that call for self-assessment and reflection. These tools can also be helpful to instructors as they reveal what the students know going in and what they take away at the end of class. If the takeaways don’t match the learning outcomes, there may be issues with understanding that need to be addressed. These strategies include:

  • Quizzes
  • Polls
  • Reflections
  • Minute Papers (Muddiest Point)

Quizzes, Polls and Reflections are fairly self explanatory, but we’ll explore the Minute Paper on its own page.

All of these strategies can be as high tech or low tech as you want them to be. For example, you can assign a Minute Paper as a Discussion Board post or have the students fill out an index card and leave it on the front podium as they leave the room. Quizzes and Polls can be conducted on paper or through Carmen, Top Hat or Qualtrics. And Reflections can be submitted as documents or as online submissions or discussion question responses through Carmen, or even as Blog Posts at u.OSU.edu.

The inherent flexibility of these strategies makes them useful for all types of classroom situations: auditorium sized lectures, active learning spaces, digital classes and labs.

Content

Level of Difficulty: Low

Bloom’s Taxonomy Level: Remember, Understand

What is it?

The Minute Paper is an end of class exercise aimed at getting the students to assess and take ownership of their own learning. In addition, it provides feedback for the professor on whether or not the students understood the main points of a lecture or class period.

How do I use it?

  • At the end of a class period, present the class with the following questions:
    • What are the two significant things you learned during this session?
    • What question(s) do you have that still need to be answered?
  • Have the students respond in the format that makes the best sense to you
    • Handout with the questions on it
    • Index cards
    • Anonymous Discussion Board post in Top Hat
    • Discussion Board Post in CarmenCanvas
    • A written assignment in CarmenCanvas
    • An Essay Question in a CarmenCanvas Quiz

Variations

Muddiest Point – The Muddiest Point exercise is a question that can stand alone or be added to this exercise, simply ask students to tell you the biggest thing that they don’t understand. This can be returned to you in any of the formats above.

Content

Level of Difficulty: High

Bloom’s Taxonomy Level: Apply, Analyze, Evaluate and Create

What is it?

A student-centered approach to learning in which students learn about a subject by working in groups to solve and open-ended problem. Sometimes it’s called Project-Based Learning, but Project-Based Learning is also used to describe the whole class of this type of activity including Authentic Learning and Challenge-Based Learning. Here’s what students will do in a PBL exercise:

  • Examine and define the problem.
  • Explore what they already know about underlying issues related to it.
  • Determine what they need to learn and where they can acquire the information and tools necessary to solve the problem.
  • Evaluate possible ways to solve the problem.
  • Solve the problem.
  • Report on their findings.

Problems can be either short or long, taking multiple class periods or weeks to complete. Depending upon the task set for the students, this can sit a a variety of levels of Bloom’s Taxonomy.  Consider the level of learning you are looking for when creating your project.

How do I use it?

  • Articulate the learning outcomes of the project. What do you want students to know or be able to do as a result of participating in the assignment?
  • Create the problem. Ideally, this will be a real-world situation that resembles something students may encounter in their future careers or lives. Cases are often the basis of PBL activities.
  • Establish ground rules at the beginning to prepare students to work effectively in groups.
  • Introduce students to group processes and do some warm up exercises to allow them to practice assessing both their own work and that of their peers.
  • Consider having students take on different roles or divide up the work up amongst themselves. Alternatively, the project might require students to assume various perspectives, such as those of government officials, local business owners, etc.
  • Establish how you will evaluate and assess the assignment. Consider making the assessments students make of their own work and that of their peers part of the assignment grade.

Variations

Authentic Learning: Applying knowledge to real-world problems that mimic the work of professionals in the field and then report their findings to an audience beyond the classroom.

Challenge-Based Learning: Identify real-life situations or issues and put the students to work on them using collaborative learning. This involves the students finding both the problem and the solution, so the activity is self-directed and typically takes an entire semester to solve. The students then reflect on and publish their findings to a worldwide audience. Some of these projects fail, and that is okay. It’s the research and the findings that are important here.

Content

Level of Difficulty: High

Bloom’s Taxonomy Level: Apply, Analyze and Evaluate

What is it?

A synthesis of flipped classroom, peer instruction and problem-based learning, Team-Based Learning is a strategy that involves moving the work of the lecture or reading portion of the class to pre-class activity and then using class time to apply the knowledge gained.

How do I use it?

Assign Preparatory Materials

Students engage with the content outside of class so they can be ready for in-class discussion and application. This can be done through readings, videos, or podcasts posted in CarmenCanvas.

Students take the Individual Readiness Assurance Test (IRAT) – (Five minutes)

This quick five minute quiz, taken individually, activates the student’s prior knowledge and helps boost retention of the pre-class materials. This multiple choice quiz should be no longer than 10 questions and should have one correct answer and no more than three distractors. each question is worth a maximum of 4 points. Students can choose to distribute those points across all four answers, split them evenly between two, or if they are confident that they have the correct answer, put all four on one answer.

Teams take the Team (or Group) Readiness Assurance Test (T/GRAT) – (Ten minutes)

The TRAT (or GRAT) repeats the questions from the IRAT. Teams should be set up ahead of time, rather than randomized on the fly, and be comprised of 5 – 7 people. It’s also best to keep the same teams for the whole semester. Team members come together with their completed IRATs to take the quiz again and choose the answers as a team. If there is a dispute between team members on what the correct answer is, the team works together to find the best answer, and scratch off their chosen box on the IF-AT form for each question. If they find a star under their answer, they got it right. If they didn’t get it right, they deliberate again to make another choice. The maximum number of points for each question is 4, and the number of points gained goes down with each attempt.

Appeals Process – (Outside class)

If a team believes that a question is unclear or misleading, they can appeal to the instructor. Generally, this is done in writing viaemail, but can be done in person, depending on the instructor’s preference.

Mini-lecture Clarification – (Ten minutes)

Following the review of the TRAT results, the instructor can make decisions about what needs to be addressed for the sake of clarity or to be sure that there are no misconceptions or misunderstandings. Things that the class did well on don’t need to be covered in this mini-lecture, saving time for the application exercise.

Application Exercise – (20 minutes)

At the end of the mini-lecture, the instructor introduces an application exercise, based on the material that was covered in the pre-class content. 

The Application Exercise is the most important piece of a TBL exercise. The IRAT/TRAT and mini-lecture serve to clarify and remind the students about the pre-class content, using retrieval, peer instruction, and didactic techniques. But the application exercise is where the students begin to analyze, evaluate, and apply that content to real-life situations. Therefore it is critical that this piece be allotted the most time for completion and be a good example of how the pre-class knowledge is applied in the field.

During this portion, the instructor travels between teams facilitating discussion and assisting with questions. This exercise can include previous material so it connects concepts within the whole course and should be built with the Learning Outcomes in mind, utilizing the Four S Framework (see text box) to structure and guide the development.

Summation and Debrief – (Five minutes)

The final step is a brief summation of the groups’ findings and a quick review of the material from the professor’s point of view.

Variations

Top Hat is anticipating the release of a new platform to administer the IRAT and TRAT portions of this exercise in Fall 2018. Watch for updates.

More Resources

Team-Based Learning at the University of Texas

This video walks the viewer through team-based learning from a planning perspective and from a student perspective, in addition the viewer gets to see all the steps in action.

Duke School of Medicine Embraces Team-Based Learning

This video gives a high-level view of Team-Based Learning from both the teacher and student perspective. It doesn’t get into the details of the activity, but it’s a good overview.

Content

Level of Difficulty: Low

Bloom’s Taxonomy Level: Apply, Analyze and Evaluate

What is it?

A low-risk, collaborative active learning strategy that can be used in all sorts of classroom situations. It involves the instructor posing a challenging question, giving them a moment to think about it, collaborate with a neighbor and then share their agreed upon answer with the class.

How Do I Use It?

  • Formulate a good open-ended question that could have several paths to an answer and requires application, analysis, and/or evaluation.
  • Pose the question to the students
  • Give the students one minute to think about the question on their own
  • Have the students discuss their answers with their collaboration partner for several minutes
  • Solicit student comments or take a classroom vote

Variations

Top Hat

This strategy pairs well with Top Hat as the report out at the end. This can be done through a Discussion Question.

Repeated Question

Ask the question, have the students answer on their own through Top Hat or another method, then “pair” to discuss, then answer the question again. Use Top Hat to gauge if any ground was gained through the “pair” portion of the activity.

Think-Pair-Square

Instead of collaborating only with one other person, each pair would choose another pair to form a square for further collaboration on a question before coming back to the full classroom.

Content

Level of Difficulty: Moderate

Bloom’s Taxonomy Level: Remember and Understand

What is it?

An app-based, electronic polling and presentation system, used for everything from clicker-response questions and live discussions, to online, interactive textbooks that include videos and questions.

How do I use it?

At its core, Top Hat is a clicker question system. To use it in its most basic form:

  1. Create a question based on the pre-work material or lecture you are giving
  2. Go to www.tophat.com and sign into or create your account
  3. Open your course, or create a new course
  4. Click Create and choose Question from the dropdown list
  5. Choose the type of question you wish to ask
  6. When you are ready, present the question to the class using the Present button

In more advanced applications, Top Hat can be used to foster discussion, assign interactive homework and allow for review of material and questions. See an instructional designer for more details on how to utilize more advanced features.

Variations

Top Hat pairs well several other active learning strategies, including Think-Pair-Share, Problem-Based Learning, Minute Paper/Muddiest Point and Team-Based Learning.

Top Hat Resources and Support

The ODEE Resource Center is an excellent starting point for getting started with the platform

Syncing Your Carmen Roster with Top Hat

Syncing the Gradebook

Top Hat Interactive Guides provide step-by-step, up-to-date instructions for using Top Hat. Here’s how to access them:

  • Once you are signed into Top Hat, click the question mark in the top right hand corner
  • Choose Interactive Guides from the drop down menu
  • For your first time in Top Hat, choose Top Hat Tour from the guide menu

Top Hat also offers a support webpage, where you can email a question to their support team.

Top Hat Blog offers tips and stories ranging from Top Hat utilization to teaching with technology.

Assessment Bibliography

Where do you start to find information about classroom assessment and course evaluation?

This digital collection and bibliography will guide you to resources, along with a brief description and links where appropriate, to help you find what you need. For more information about assessment, contact Mary Higginbotham.

Content

Angelo TA, Cross KP. Classroom assessment techniques: A handbook for college teachers. Second ed. San Francisco: Jossey-Bass Publishers; 1993.

This revised and greatly expanded edition of their 1988 handbook … offers teachers at all levels of experience detailed, how-to advice on classroom assessment – from what it is and how it works to how to plan, implement, and analyze assessment projects. The authors illustrate their approach through numerous case studies and examples that detail the real-life classroom experiences of teachers carrying out successful classroom assessment projects. (from back cover)

Banta TW, Palomba CA. Assessment essentials: Planning, implementing, and improving assessment in higher education. Second ed. San Francisco: Jossey-Bass & Pfeiffer Imprints; 2015.

This second edition of Assessment Essentials updates the bestselling first edition, the go-to resource on outcomes assessment in higher education. In this thoroughly revised edition, you will find, in a familiar framework, nearly all new material, examples from more than 100 campuses, and indispensable descriptions of direct and indirect assessment methods that have helped to educate faculty, staff, and students about assessment. (Amazon.com)

Diamond RM. Designing and assessing courses and curricula: A practical guide. Third ed. San Francisco: Jossey-Bass; 2008.

Designing and Assessing Courses and Curricula reflects the most current knowledge and practice in course and curriculum design and connects this knowledge with the critical task of assessing learning outcomes at both course and curricular levels. This thoroughly revised and expanded third edition of the best-selling book positions course design as a tool for educational change and contains a wealth of new material including new chapters, case examples, and resources. (Amazon.com)

Maki P.  Assessing for learning: Building a sustainable commitment across the institution. Sterling, Va.: Stylus Pub.; 2010.

This book is designed to assist colleges and universities build a sustainable commitment to assessing student learning at both the institution and program levels. It provides the tools for collective inquiry among faculty, staff, administrators and students to develop evidence of students’ abilities to integrate, apply and transfer learning, as well as to construct their own meaning. Each chapter also concludes with (1) an Additional Resources section that includes references to meta-sites with further resources, so users can pursue particular issues in greater depth and detail and (2) worksheets, guides, and exercises designed to build collaborative ownership of assessment. (Amazon.com)

Stevens DD, Levi A, Walvoord BE. Introduction to rubrics: An assessment tool to save grading time, convey effective feedback, and promote student learning. Second ed. Sterling, Virginia: Stylus; 2013.

This new edition…provides a fundamental introduction to the principles and purposes of rubrics, with guidance on how to construct them, use them to align course content to learning outcomes, and apply them in a wide variety of courses, and to all forms of assignment. (Amazon.com)

Suskie LA. Assessing student learning: A common sense guide. San Francisco, CA: Jossey-Bass; 2009.

The first edition of Assessing Student Learning has become the standard reference for college faculty and administrators who are charged with the task of assessing student learning within their institutions. The second edition of this landmark book offers the same practical guidance and is designed to meet ever-increasing demands for improvement and accountability. This edition includes expanded coverage of vital assessment topics such as promoting an assessment culture, characteristics of good assessment, audiences for assessment, organizing and coordinating assessment, assessing attitudes and values, setting benchmarks and standards, and using results to inform and improve teaching, learning, planning, and decision making. (Amazon.com)

Sylvia, LM, Barr, JT. Pharmacy education: What matters in learning and teaching. Sudbury, MA: Jones and Bartlett Learning; 2011.

Pharmacy Education: What Matters in Learning and Teaching is an essential resource for any pharmacy faculty member. More than a narration of the philosophical aspects of teaching and personal perspectives on life as a faculty member, it explores ‘what matters”, “why it matters”, and “how to apply” the matter to teaching, learning, and assessment in pharmacy education. It covers a variety of teaching settings (e.g., large classroom, small group teaching, clinical site) and guides the reader in developing a deeper understanding of what it means to be a teacher. Scenarios are included in each chapter, offering readers the opportunity to readily apply educational theory to their role as educators and to adapt the book’s content to their specific educational setting. The reader, whether a part-time faculty member, full-time faculty member, or adjunct professor/preceptor, is given the opportunity to personalize the material addressed in the text to his/her stage of development through engagement in reflective workbook exercises. (Amazon.com)

Walvoord BEF. Assessment clear and simple: A practical guide for institutions, departments, and general education. San Francisco, CA: Jossey-Bass; 2010.

The first edition of Assessment Clear and Simple quickly became the essential go-to guide for anyone who participates in the assessment process in higher education. With the increased pressure to perform assessment to demonstrate accountability, Assessment Clear and Simple is needed more than ever. This second edition of the classic resource offers a concise, step-by-step guide that helps make assessment simple, cost-efficient, and useful to an institution. It contains effective strategies for meeting the requirements of accreditation agencies, legislatures, review boards, and others, while emphasizing and showing how to move from data to actions that improve student learning. (Amazon.com)

Content

Assessing Your Course (University Center for the Advancement of Teaching, The Ohio State University)

UCAT’s website offers a wealth of resources to support teaching and learning at Ohio State, including multiple resources for classroom assessment.  From the page above, link to pages that discuss developing an assessment plan, offer additional readings about course design and assessment, and share other sources for information about course assessment, including conferences, web sites and multiple taxonomies of learning.

Assessment at Ohio State (Office of Academic Affairs, the Ohio State University)

This site describes learning outcomes assessment as conducted at Ohio State.  Included on this web site are links to resources that may be helpful, including offices and projects at Ohio State that support assessment, higher education organizations that provide information about assessment, and examples from other universities’ assessment offices.

Assessment Update (Jossey-Bass)

Assessment Update is dedicated to covering the latest developments in the rapidly evolving area of higher education assessment. Assessment Update offers all academic leaders up-to-date information and practical advice on conducting assessments in a range of areas, including student learning and outcomes, faculty instruction, academic programs and curricula, student services, and overall institutional functioning. (Research Gate)

Eberly Center for Teaching Excellence and Educational Innovation (Carnegie Mellon University) 

This office offers support services for Carnegie Mellon instructional staff, but also offers multiple online resources, including a collection of resources on how to assess teaching and learning.

Making Learning Outcomes Usable & Transparent (National Institute for Learning Outcomes Assessment)

Established in 2008, the National Institute for Learning Outcomes Assessment (NILOA) assists institutions and others in discovering and adopting promising practices in the assessment of college student learning outcomes. Documenting what students learn, know and can do is of growing interest to colleges and universities, accrediting groups, higher education associations, foundations and others beyond campus, including students, their families, employers, and policy makers. Included in this web site is a helpful resource library on assessment topics. (NIOLA website)

Teaching and Learning Bibliography

Content

Bradshaw, Martha, J. and Lowenstein, Arlene, eds. Innovative Teaching Strategies in Nursing and Related Health Professions. Sixth Edition. (Burlington, M.A.: Jones and Bartlett, 2014).

An excellent and comprehensive resource that has chapters covering virtually every facet of teaching in healthcare. From programmatic evaluation down to specific pedagogical approaches, Bradshaw and Lowenstein’s work provides a clear, accessible treatment of so many different topics that every educator in the health sciences will find something applicable to take away. The division of sections and chapters makes it easy to quickly find those areas of interest to the reader and many of the chapters follow a straightforward system of organization that moves from theory through conditions of learning and highlights potential problems or issues.

Bruff, Derek. Teaching with Classroom Response Systems: Creating Active Learning Environments. (San Francisco, CA: Jossey Bass, 2009).

Bruff’s book is a comprehensive treatment of the issues surrounding the use of clicker questions to engage students. This is essential reading for those who teach large ‘lecture style’ classes and want to understand the easiest ways to make their class time more interactive and produce greater learning gains for students. It’s worth the time it takes to read but if you’re short on time, click here to download Bruff’s list of key takeaways.

Content

Boser, Ulrich. Learn Better: Mastering the Skills for Success in Life, Business, and School, Or, How to Become an Expert in Just About Anything. (New York: Rodale, 2017).

Boser’s book is a readable introduction to different elements and experts in the field of learning. This book won’t generate many ready-made strategies for teaching in classroom environments, but serves its purpose as a quick but relatively shallow dive into the latest research on learning. In this way, it is a successor to Carey’s How We Learn.

Carey, Benedict. How We Learn: The Surprising Truth About When, Where, and Why it Happens. (New York: Random House, 2014).

Carey’s book is another quick and interesting read that approaches the science of learning from a functional perspective by focusing on key (often counterintuitive) learning tools like forgetting and daydreaming. Like Boser’s book, it is more valuable for those who want to understand ways to increase the effectiveness of their own learning.