LITERASEE
CROWDSOURCING ASSESSMENT LITERACY
Damian W Betebenner
National Center for the Improvement of Educational Assessment
Portsmouth, NH September 29th, 2016
Crowdsourcing Assessment Literacy
What could possibly go wrong?
In our work with SEAs over the last
decade the most significant challenge is often
communication.
How to communicate
assessment/accountability
results to stakeholders.
Formative Assessment
Curriculum
Standards
Summative Assessment
Accountability
Proficiency
Growth
THE PROBLEM:
Content specialists aren’t the literacy content developers
• Assessment literacy materials are often an
afterthought.
• When they are produced, they often resemble
textbook material: long and tedious.
• Assessment content specialists are not web-
developers (often word documents)
People are busy and
don’t have time to
read long articles.
THE VISION:
For assessment in education to fulfill its potential,
consumers of assessment results must be able to
have productive conversations about the results.
Assessment literacy is the foundation for these
conversations.
THE VISION:
Assessment literacy materials need to be (and can be)
user friendly.
• Web first!!! Utilizing all the web has to offer: pictures,
video, interactivity, color, …
• Viewable on multiple devices.
• Brief, broken into small modules.
• Sharable via social media, embeddable into other
web-based content.
Which way to the solution?
GENERAL OBSERVATIONS:
• SEAs are more alike than they are different.
• Effective communication is about establishing a clear
and consistent vocabulary.
• Great materials produced in one state can be reused/
repurposed in another.
• The modern web allows content specialists to be
content developers!
OBSERVATIONS:
Put 100 assessment specialist in a room and ask them
about a topic and you’ll hear 150 different points of
view. Our field does not speak with one voice. But that’s
OK.
Good artists copy;
Great artists steal.
Pablo Picasso
OPEN BY DESIGN:
Steal this website? Nah. just use it. We’ll share.
The goal is to spread knowledge.
We want this content to be read, shared, copied and
improved.
• A web-application for the development of web-based
assessment literacy content.
• Conceptualized in 2015. Co-developed as part of Center for
Assessment Internship in 2015 and 2016.
• Inspired GitHub based collaboration and by content
platforms like Medium:
• Allows interactive graphics
• Allows robust forking for easy modification
• Built on top of GitHub allowing for robust sharing and
collaboration. Public & Private Repos supported.
• Content creators own all their content and can
license it as they wish. For example
• Create - Collaborate - Communicate
Literasee: Baby steps with growth
https://view.literasee.io/Literasee/Georgia/report
• Continue working with states to produce assessment
literacy content turning assessment content experts into
content developers.
• Extend/refine/simplify Literasee to produce new use
cases.
• Check it out at literasee.io
About this copy
Literasee Crowdsourcing Assessment Literacy — Center for Assessment Reidy Interactive Lecture Series, June 29, 2016.
This is an image-based copy of the original Keynote slides; builds and animations are flattened.