RILS 2021: Design Innovation in
Educational Assessment Systems
The National Center for the Improvement of Educational Assessment
September 2021
This work is licensed under a
Creative Commons Attribution 4.0
International License.
Welcome to RILS 2021
Executive Director Scott Marion of the
National Center for the Improvement of Educational
Assessment
introduces participant to RILS 2021
RILS 2021: Innovation in Educational Assessment Systems 2
Introduction to RILS
• Identify overall focus for RILS 2021 and intended outcomes
• Introduce structure of the five sessions including focus and
outcomes for each session
• Explain that each session stands alone but they are intended
to support a larger agenda
RILS 2021: Innovation in Educational Assessment Systems 3
Welcome to RILS 2021: Session 1
Session 1: Introduction to Design Innovation
Design & Innovation in the creation of education
assessment systems
RILS 2021: Innovation in Educational Assessment Systems 4
Why focus on Innovation in an Assessment Systems?
• Assessment systems are often seen as burdensome and of little use by
stakeholders.
• Assessment is considered an essential lynchpin for effective education.
• Social and economic pressures to raise student educational attainment
• Ensure greater equity of educational outcomes for all students
• Assessment is essential component to effectively educating students
• Assessment (it is believed) has not yet fulfilled its promise
• Rapidly advancing technologies can allow for use of simulations, interactivity, and
collaboration
• Need to motivate and engage students
• Signal changes for curriculum and instruction, such as inclusion of 21st century skills
RILS 2021: Innovation in Educational Assessment Systems 5
Defining Design & Innovation
Before further discussion about innovation, let’s clarify the meaning of
these words…
Poll Everywhere (??) Structure TBD
• Identify the first 3 words that you associate with the word:
Innovation.
• Identify the first 3 words that you associate with the word:
Design.
• Do they mean the same thing?
• How are the two related?
RILS 2021: Innovation in Educational Assessment Systems 6
Let’s start with Innovation…
Innovation: Make changes in something established, especially by
introducing new methods, ideas, or products.
Is making
changes
enough to
be
innovative?
RILS 2021: Innovation in Educational Assessment Systems 7
Refining our understanding of innovation through design
thinking…
Design: A plan for arranging elements in such a way as
best to accomplish a particular purpose that achieves value
for all stakeholders.
Is making
changes How is value
enough to be determined?
innovative?
RILS 2021: Innovation in Educational Assessment Systems 8
Refining our understanding of Design Thinking
as a strategy for Innovation
A model of thinking that places the people you’re trying to serve and
other important stakeholders at the center of the design, innovation,
and implementation process by encouraging different perspectives
and approaches in viewing and solving problems.
Is making How do you
changes How is value plan for
enough to be determined? design
innovative? innovation?
RILS 2021: Innovation in Educational Assessment Systems 9
Design Innovation
Innovation includes:
Desirability - the quality of being
wanted;
Feasibility - the possibility, capability, or
likelihood of something being done or
accomplished, and viability; and
Viability – ability to work as intended
and succeed.
In other words, Design innovation is a
process that leads to innovation.
There is no one process for innovating.
RILS 2021: Innovation in Educational Assessment Systems 10
Design Innovation for an Assessment System
Ensure a common understanding of a system of assessments
What does this mean?
First, we need to be sure we have a common understanding of
what constitutes an assessment system
Definition of an assessment system:
Scott
RILS 2021: Innovation in Educational Assessment Systems 11
Model for Design Innovation:
Human Centered Design
RILS 2021: Innovation in Educational Assessment Systems 12
Design Innovation: Human Centered Design
Planning: Understand opportunity area, organizational capacity,
and feasibility.
Why engage in Design Innovation for an assessment system?
• What are you trying to accomplish?
• How is this change valued by those who use the end product?
• How will you know that a change is an improvement?
• What change can be made that will result in improvement?
RILS 2021: Innovation in Educational Assessment Systems 13
Closure – Session 1
• Takeaways from session:
• What is innovation?
• What is design thinking and design innovation?
• Why is design innovation important is the construction of innovative
assessment systems.
RILS 2021: Innovation in Educational Assessment Systems 14
Welcome to RILS 2021: Session 2
Design Innovation -- Planning:
Understanding the Problem – Root Cause Analysis
Identify agenda and outcomes
RILS 2021: Innovation in Educational Assessment Systems 15
Design Innovation: Human Centered Design
Design Innovation of an assessment system assumes:
• A basic knowledge of the characteristics of the system, including:
• Areas of strength
• Areas of need
• Culture of individuals in the system
• A profound knowledge of the system, including:
• Build shared ownership of improvement
• Detect and learn from variations in practice
• Build and share knowledge among practitioners
• Motivate users and innovators
RILS 2021: Innovation in Educational Assessment Systems 16
Model for Design Innovation:
Human Centered Design
RILS 2021: Innovation in Educational Assessment Systems 17
Design Innovation: Human Centered Design
The planning process includes root cause analysis; in other words:
Why engage in Design Innovation for an assessment system?
Problem Analysis requires:
• identifying the important elements of a problem situation by analyzing relevant
information,
• framing problems,
• identifying possible causes,
• seeking additional needed information,
• framing and reframing possible solutions,
• exhibiting conceptual flexibility,
• assisting others to form reasoned opinions about problems and issues
RILS 2021: Innovation in Educational Assessment Systems 18
Root Cause Analysis
What is it?
How do you engage in the process to determine the gap between what is and
what is desired?
Juan D’Brot
Chris Brandt
(25 minutes)
Individuals from organizations to discuss their successes with Root Cause
Analysis
(20 minutes)
RILS 2021: Innovation in Educational Assessment Systems 19
Closure – Session 2
• Takeaways from session:
• What does the planning phase include?
• What is a root cause analysis?
• How does root cause analysis fit into design innovation?
RILS 2021: Innovation in Educational Assessment Systems 20
Welcome to RILS 2021: Session 3
Design Innovation: Engaging stakeholders in the design
process
Identify agenda and outcomes
RILS 2021: Innovation in Educational Assessment Systems 21
Learning
“Innovation is not a lightbulb moment of genius. It calls for
deep understanding and rigorous discernment.”
RILS 2021: Innovation in Educational Assessment Systems 22
Welcome to RILS 2021: Session 4
Design Innovation: Creating a Theory of Action
Identify agenda and outcomes
RILS 2021: Innovation in Educational Assessment Systems 23
Learning
“Innovation is not a lightbulb moment of genius. It calls for
deep understanding and rigorous discernment.”
RILS 2021: Innovation in Educational Assessment Systems 24
About this copy
RILS 2021: Design Innovation in Educational Assessment Systems — Center for Assessment Reidy Interactive Lecture Series, March 26, 2021.
This is an image-based copy of the original PowerPoint slides; builds and animations are flattened.