Deeper Assessment: Why don’t we practice what we know we should do?

As part of my work as an innovation coach with the Virginia is for Learners Innovation Network, I collaborated with Julie Foss to present a four-part series on Deeper Assessment. This post is cross-posted with Advanced Learning Partnerships (ALP), a partner in the Virginia is for Learners Innovation Network who has graciously asked me to participate as a coach.

Driving Questions: What do we really want students to know and be able to do? How do we determine what’s important? To them? To us? To our subject areas? To our communities?

The four-part series on Deeper Assessment began with a high-level overview of using backwards design to decide what we really want students to know and do. Prioritizing learning outcomes is a common first step in designing a guaranteed and viable curriculum that prepares students beyond “the test.” Prioritizing standards helps determine vertical scope to prepare students for future courses in their sequence as well as to develop transferable skills across courses and subject areas. Ultimately, the highest priority standards help prepare students for “life,” whatever that may look like now, a month from now, or years from now.

The session started with a short clip from Ted Dintersmith’s Most Likely to Succeed of Linda Darling-Hammond sharing research on how fleeting inert knowledge is. Inert knowledge is information we memorize and repeat but never really use, and we lose about 90% of all inert knowledge we are exposed to. The clip from Dintersmith’s Innovation Playlist reports findings from a study conducted at the Lawrenceville Academy in New Jersey, where over two years, students were re-tested in the fall on their final science exams. Average scores went from a B+ to an F. Most students failed their exams after just three months. Moderator Julie Foss asked the 20+ participants in the session whether they might expect these same outcomes in their own divisions.

  • Justin Roerink, principal of the Hanover Center for Trades & Technology speculated that the trend might be found in a lot of classrooms. He queried, “How important is the material we are asking students to learn?” He further questioned the value of material we present to students if they don’t remember it a day, a week, or a month later. He encouraged increased use of hands-on assessments.
  • Stephanie Haskins from Staunton City Schools, noted that for a long time teachers have been caught up in the details of what needs to be taught rather than the big ideas of, “what is the important concept here?” She suggested that now is a good time to back up and forget about “all the details and all the bullets” and focus on the big ideas we really want students to understand. These big ideas will be far more memorable.
Priority Standards: You get what you aim for.

Moderator John Ross shared an overview of a backwards design process, one that many educators hear about but few use in practice, at least according to his experience. In that process, prioritized standards lead to those big ideas Stephanie Haskins references. Then assessments are developed first, based on those big ideas, and prior to considering any instructional materials or activities. That’s the crux of backwards design: design the assessment first. Using a “Fist to Five” formative protocol, participants were asked “How does this backwards design process resonate with current practice in your division?” The most common responses were 2s and 3s. 

  • Stephen Castle from Hanover County acknowledged “4 in theory…2 or 3 in practice” further noting that it’s important to dedicate time to build a truly collaborative PLC structure where teachers can do the work of prioritizing standards and determining a systematic and structured approach to addressing them. He acknowledged that despite these efforts, some teachers may still be reluctant to trust that taking a mastery-based approach is going to yield the results they want on “the test” at the end of the year. He suggested many teachers pull back from more authentic instruction prior to testing and rely on “drill-and-kill” to get information pushed into students’ inert knowledge, which we know from Linda Darling-Hammond, doesn’t stick.
  • Andrea Hand from Fairfax County Public Schools concurred with Castle and shared the idea of the tension between “have to have versus nice to have syndrome.” Some educators believe that one thing they “have to have” is good test scores at the end of the year, so they focus on that. Once they feel comfortable that will happen they can then work on the more authentic learning and others which, to them, fall under the category of “nice to have.” She suggests that the more we can advocate and align the “have to haves” with our collective beliefs around authentic learning it would guarantee students more of those experiences. 

This tension is real, but many of the participants felt that our unique circumstances have given us reason to get back to what we know works to provide more authentic instruction that prioritizes learning outcomes to the needs of students, not just trying to cram in inert knowledge students will likely soon forget. Many of the participants continued through the rest of the week with additional sessions on designing performance-based tasks, creating learning progressions that lead to standards-based rubrics, and exploring portfolios and other resources to capture evidence of student learning.

Check out the conversation at this YouTube link, as well as the agenda with downloadable resources, a link to the slide deck, and links to resources from the other three sessions.

Going Online? Stay Calm and Consider These Tips

Ready or not, many teachers are now going to experience delivering instruction online. Prep time has been far from optimal, but there are a few steps teachers can take as they venture into the delivery of online learning to their students. Whether experienced pros or newbies to online delivery, it’s all about the learning, not the technology. Don’t get wrapped up in the technology. Don’t try to use every feature at the get go…or ever. Stay calm. Focus on the learning and continue to be the learning leader, regardless of what technologies your students use—even if you don’t use technology!

If you’re going to do this, here are some considerations when moving instruction online.

It’s about LEARNING, not just being online. Just because your class may have an online component now, that doesn’t mean it ALL has to be online. We learn in a variety of ways, and much of it is offline. Use online components to bring students together, check on their progress, and provide feedback. Then send them off to interact with content, read some things, watch some videos, complete projects, and create new products that they can then share with you.

Ask your students how THEY want to learn. This is a great opportunity to put personalization and differentiation into practice—true personalization, in which students are given the opportunity to determine what it is they want to learn, how they want to learn it, and how they’ll demonstrate what they’ve learned. If your learning goals don’t require writing an essay or answer a multiple-choice question, then don’t force students to do these things. Ask your students for their ideas. They might turn their mad Instagram, SnapChat, and TikTok skills into demonstrations of what they know and can do. And if they’re intrinsically motivated to use the tools at their disposal, you’re likely to get better learning out of the experience.

Focus on the learning, not the technology. At the end of the day, or your class, what is it you want your students to know and be able to do? Learning isn’t measured by time spent watching a video or the number of responses made on a discussion board. Very often, there are a variety of tools students can use to demonstrate their learning, not just one single tool. Give students one simple option—the lowest common denominator—for submitting their work, but encourage them to suggest and justify other tools. As students explore and use other tools successfully to capture their learning, share those exemplars with the rest of the class.

Every online activity is an opportunity to promote digital citizenship, but your students may need support being good digital citizens. Create practice opportunities to model how to use common online tools, like how to engage in an online discussion effectively. I like the simple “compliment-connect-question” format, which I learned from some teachers in Lee’s Summit, MO, but you can find lots of protocols online. Consider creating simple narrated slides or screencapture movies that reinforce appropriate procedures, like using online resources, citing intellectual property, or even how to use some features of your LMS. Share exemplars of past student-generated documents, videos, or other artifacts so students have expectations when creating and submitting their own.

Give your students responsibility for the online environment. Just as you would have helpers in your class, establish ways that students can contribute to the online learning environment. If you’re going to do some synchronous webconferencing, put students in charge of monitoring the chat room, creating a question queue, summarizing main ideas, and determining next steps. If you’re incorporating student groups, consider using students contracts with different roles and have students be responsible for monitoring and reporting on how well the group is meeting timelines and creating information. Most importantly, determine how students can contribute to the online learning activities that you incorporate. You do not have to be the leader of every activity. To do this you need to ask them.

It doesn’t always have to be online. Every day we communicate with others through a variety of means, even at a distance. Consider whether phone calls or texting can support your students as they learn from home. The Remind app sends text reminders to students and parents who have signed up for them. Service like Free Conference Call can let you set up group calls to check in with your students. And while email is technically online, it’s also a great way to interact with students, and automated emails and reminders can be generated through some LMS, calendar programs, and other tools.

Take a deep breath. We’re all going to get through this. Keep focused on what you do well—lead learning for your students—and let the learning continue!

John Ross has been developing and delivering online learning to students of all ages for more than two decades. His astronomy course developed with his friend and expert science teacher Anita Deck was honored as one of the Best High School Courses on iTunes U, and he has shared his experiences in his book “Online Professional Development. Design, Deliver, Succeed!” published by Corwin.

Designing Online Learning

As a coach with Advanced Learning Partnerships, I have the privilege of working school divisions participating in the Virginia is for Learners Innovative Network (#VA4LIN). If you live in Virginia you may have heard about this sweeping initiative launched by the Virginia Department of Education with support from VaSCL, JMU, and Ted Dintersmith. ALP coaches are working with the schools and divisions in the network who have identified their own priorities for promoting innovation.

One of the divisions I’m working with, Bedford County Public Schools, has already initiated efforts related to personalized learning prior to joining the network and asked for some support with developing online and blended learning. Division staff want to leverage online technologies to provide more personalized support for both learning opportunities for students and professional development for adults in the system. I met with a group of ITRTs (Instructional Technology Resource Teachers), library/media specialists, and others in Bedford County on May 9 to review instructional design for online and blended learning. Our goal was to develop design specifications for educators in Bedford County to refer to when designing their own learning materials.

Educators from Bedford County Public Schools discuss designing powerful online learning.

I provided access to materials based on my book, Online Professional Development, Design, Deliver, Succeed! and subsequent publications. We reviewed key instructional design principles, considered how staff are currently addressing them, and considered how these principles might be presented in the first draft of a design specifications document. The key ideas we reviewed include:

  1. Know your audience.
  2. Define your learning outcomes.
  3. Assess your learning outcomes.
  4. Consider your visual design.
  5. Match media to your outcomes.
  6. Evaluate your learning.

You can access the slide deck with links to handouts and templates on Google Drive. Let me know if it’s helpful. Next steps for the, the participants include returning to existing online professional learning to review what has already been developed and determine how the specifications might impact that work.

Considering implications of instructional design principles on practice.