RILS 2021: Design Innovation in Educational Assessment Systems

Center for Assessment Reidy Interactive Lecture Series · March 26, 2021

RILS 2021: Design Innovation in Educational Assessment Systems — Center for Assessment Reidy Interactive Lecture Series, March 26, 2021.
Published

March 26, 2021

Event
Colloquium
Slides
24
Format
Converted from PowerPoint

This deck is an image-based copy of the original slides. Builds and animations are flattened; the slide text is reproduced below for search and screen readers.

Slide text
  1. RILS 2021: Design Innovation in Educational Assessment Systems The National Center for the Improvement of Educational Assessment September 2021 This work is licensed under a Creative Commons Attribution 4.0 International License.
  2. Welcome to RILS 2021 Executive Director Scott Marion of the National Center for the Improvement of Educational Assessment introduces participant to RILS 2021 RILS 2021: Innovation in Educational Assessment Systems 2
  3. Introduction to RILS • Identify overall focus for RILS 2021 and intended outcomes • Introduce structure of the five sessions including focus and outcomes for each session • Explain that each session stands alone but they are intended to support a larger agenda RILS 2021: Innovation in Educational Assessment Systems 3
  4. Welcome to RILS 2021: Session 1 Session 1: Introduction to Design Innovation Design & Innovation in the creation of education assessment systems RILS 2021: Innovation in Educational Assessment Systems 4
  5. Why focus on Innovation in an Assessment Systems? • Assessment systems are often seen as burdensome and of little use by stakeholders. • Assessment is considered an essential lynchpin for effective education. • Social and economic pressures to raise student educational attainment • Ensure greater equity of educational outcomes for all students • Assessment is essential component to effectively educating students • Assessment (it is believed) has not yet fulfilled its promise • Rapidly advancing technologies can allow for use of simulations, interactivity, and collaboration • Need to motivate and engage students • Signal changes for curriculum and instruction, such as inclusion of 21st century skills RILS 2021: Innovation in Educational Assessment Systems 5
  6. Defining Design & Innovation Before further discussion about innovation, let’s clarify the meaning of these words… Poll Everywhere (??) Structure TBD • Identify the first 3 words that you associate with the word: Innovation. • Identify the first 3 words that you associate with the word: Design. • Do they mean the same thing? • How are the two related? RILS 2021: Innovation in Educational Assessment Systems 6
  7. Let’s start with Innovation… Innovation: Make changes in something established, especially by introducing new methods, ideas, or products. Is making changes enough to be innovative? RILS 2021: Innovation in Educational Assessment Systems 7
  8. Refining our understanding of innovation through design thinking… Design: A plan for arranging elements in such a way as best to accomplish a particular purpose that achieves value for all stakeholders. Is making changes How is value enough to be determined? innovative? RILS 2021: Innovation in Educational Assessment Systems 8
  9. Refining our understanding of Design Thinking as a strategy for Innovation A model of thinking that places the people you’re trying to serve and other important stakeholders at the center of the design, innovation, and implementation process by encouraging different perspectives and approaches in viewing and solving problems. Is making How do you changes How is value plan for enough to be determined? design innovative? innovation? RILS 2021: Innovation in Educational Assessment Systems 9
  10. Design Innovation Innovation includes: Desirability - the quality of being wanted; Feasibility - the possibility, capability, or likelihood of something being done or accomplished, and viability; and Viability – ability to work as intended and succeed. In other words, Design innovation is a process that leads to innovation. There is no one process for innovating. RILS 2021: Innovation in Educational Assessment Systems 10
  11. Design Innovation for an Assessment System Ensure a common understanding of a system of assessments What does this mean? First, we need to be sure we have a common understanding of what constitutes an assessment system Definition of an assessment system: Scott RILS 2021: Innovation in Educational Assessment Systems 11
  12. Model for Design Innovation: Human Centered Design RILS 2021: Innovation in Educational Assessment Systems 12
  13. Design Innovation: Human Centered Design Planning: Understand opportunity area, organizational capacity, and feasibility. Why engage in Design Innovation for an assessment system? • What are you trying to accomplish? • How is this change valued by those who use the end product? • How will you know that a change is an improvement? • What change can be made that will result in improvement? RILS 2021: Innovation in Educational Assessment Systems 13
  14. Closure – Session 1 • Takeaways from session: • What is innovation? • What is design thinking and design innovation? • Why is design innovation important is the construction of innovative assessment systems. RILS 2021: Innovation in Educational Assessment Systems 14
  15. Welcome to RILS 2021: Session 2 Design Innovation -- Planning: Understanding the Problem – Root Cause Analysis Identify agenda and outcomes RILS 2021: Innovation in Educational Assessment Systems 15
  16. Design Innovation: Human Centered Design Design Innovation of an assessment system assumes: • A basic knowledge of the characteristics of the system, including: • Areas of strength • Areas of need • Culture of individuals in the system • A profound knowledge of the system, including: • Build shared ownership of improvement • Detect and learn from variations in practice • Build and share knowledge among practitioners • Motivate users and innovators RILS 2021: Innovation in Educational Assessment Systems 16
  17. Model for Design Innovation: Human Centered Design RILS 2021: Innovation in Educational Assessment Systems 17
  18. Design Innovation: Human Centered Design The planning process includes root cause analysis; in other words: Why engage in Design Innovation for an assessment system? Problem Analysis requires: • identifying the important elements of a problem situation by analyzing relevant information, • framing problems, • identifying possible causes, • seeking additional needed information, • framing and reframing possible solutions, • exhibiting conceptual flexibility, • assisting others to form reasoned opinions about problems and issues RILS 2021: Innovation in Educational Assessment Systems 18
  19. Root Cause Analysis What is it? How do you engage in the process to determine the gap between what is and what is desired? Juan D’Brot Chris Brandt (25 minutes) Individuals from organizations to discuss their successes with Root Cause Analysis (20 minutes) RILS 2021: Innovation in Educational Assessment Systems 19
  20. Closure – Session 2 • Takeaways from session: • What does the planning phase include? • What is a root cause analysis? • How does root cause analysis fit into design innovation? RILS 2021: Innovation in Educational Assessment Systems 20
  21. Welcome to RILS 2021: Session 3 Design Innovation: Engaging stakeholders in the design process Identify agenda and outcomes RILS 2021: Innovation in Educational Assessment Systems 21
  22. Learning “Innovation is not a lightbulb moment of genius. It calls for deep understanding and rigorous discernment.” RILS 2021: Innovation in Educational Assessment Systems 22
  23. Welcome to RILS 2021: Session 4 Design Innovation: Creating a Theory of Action Identify agenda and outcomes RILS 2021: Innovation in Educational Assessment Systems 23
  24. Learning “Innovation is not a lightbulb moment of genius. It calls for deep understanding and rigorous discernment.” RILS 2021: Innovation in Educational Assessment Systems 24