Rhode Island SGP Growth Calculations in 2021 & 2022
Academic Impact, Accountability and Recovery
Damian Betebenner — Center for Assessment
Ana Karantonis — RIDE
Rhode Island DOE
TAC Meeting
June 2nd, 2022
Calculation of SGPs in 2022. A look back to 2021
• Not surprisingly 2021 presented numerous challenges in the
administration of state assessments as well as the calculation of
SGPs based upon those assessments.
• Overall, despite several formidable challenges, the analyses
went extremely well and the psychometrics seemed to hold up
well.
• We begin with a quick recap of what was done in 2021 since
there is much overlap with what will be done in 2022.
Rhode Island SGP Growth Calculations in 2021 & 2022
SGP Analysis Performed in 2021
• In 2021, two types of SGP analyses were conducted with both
RICAS and WIDA-ACCESS data:
• Cohort referenced analyses: These analyses create growth norms from
the 2019 to 2021 students. These growth norms yield cohort means/
median SGPs of 50 and obscure COVID-19 academic impact.
• Baseline referenced analyses: Historical growth norms were created
using 2019 and prior data. These growth growth analyses don’t have
mean/median SGPs of 50 and can be used to investigate overall
COVID-19 academic impact.
Rhode Island SGP Growth Calculations in 2021 & 2022
SGP Analysis To Be Performed in 2022
• In 2022, the same two types of SGP analyses will be conducted
with RICAS and WIDA-ACCESS data:
• Cohort referenced analyses: These analyses create growth norms from
the 2021 to 2022 students. It’s possible for grades 6, 7, and 8 to use pre-
covid 2019 as a second prior. We need to discuss whether this potential
second prior is desirable. These growth norms yield cohort means/median
SGPs of 50 and obscure COVID-19 academic impact.
• Baseline referenced analyses: Historical growth norms were created using
2018 to 2019 data. These growth growth analyses don’t have mean/
median SGPs of 50 and can be used to investigate overall COVID-19
academic impact and recovery.
Rhode Island SGP Growth Calculations in 2021 & 2022
SGP Analysis Plans for 2022
• Cohort referenced SGPs
• Growth norms created from the current cohort of students.
• Mean/median will by 50 for all grade x content area analyses
• Cannot investigate overall impact & recover of the pandemic on students.
• Can investigate differential impact & recovery of the pandemic on students.
• Does not require scale stability across years.
• Projections possible
• Baseline referenced SGPs.
• Growth norms created from historical (i.e., pre-COVID) cohorts of students.
• Mean/median 50 for historical cohort, not necessarily 50 for current cohort.
• Extent of deviation from (i.e. below) 50 is indicative of less learning/pandemic related academic impact.
• Mean SGP deviation of 5 corresponds to an effect size of 0.18.
• Can investigate BOTH overall impact & recovery as well as differential impact & recovery.
• Requires scale stability across years.
• Projections possible
Rhode Island SGP Growth Calculations in 2021 & 2022
SGP Analysis Plans for 2021 & 2022
• A significant difference between 2021 and 2022 is that in 2022 Rhode
Island and other states will be required to use assessment results for
accountability purposes.
• In 2021 (and 2020) accountability systems were put on hold due to the
pandemic.
• The use of baseline SGPs in 2021 was supported, in part, by idea of
using data for reporting (as opposed to accountability) purposes: What
was the academic impact of the pandemic?
• With accountability coming on line in 2022 an additional set of
important considerations is in play in thinking about how growth is
used.
Rhode Island SGP Growth Calculations in 2021 & 2022
Academic Impact 2021 (Part 1)
SGP Analysis Plans for 2021 & 2022
• Less than typical participation in 2021 complicated comparisons with
2019 data in many states.
• In general, Rhode Island had good participation.
• Participation in almost all grades was greater than 80% and close
to 90% in elementary school grades.
• In 2022, missing 2021 data will impede the calculation of growth for a
small percentage of students with no prior scores
• We will apply multiple imputation to those missing data as well to
evaluate the impact the missing data has on summary results.
Rhode Island SGP Growth Calculations in 2021 & 2022
Pandemic Related Academic Impact
• As stated previously, any discussion of recovery implies some
understanding of what the impact is/was.
• As a basis for investigating academic impact/recovery, we undertook a
comprehensive look at academic impact in Rhode Island
• RICAS: Determined academic impact from 2019 to 2021 using grades
3, 4, 5, 6, 7, and 8 in ELA and mathematics.
• WIDA-ACCESS: Determined academic impact from 2020 to 2021
using grades K to 12 ELP
Rhode Island SGP Growth Calculations in 2021 & 2022
How do we quantify academic impact using test data
• The pandemic was like a “headwind” that (presumably) slowed down the learning of
students due to a variety of factors.
• We can use test data in two ways to quantify the impact of this headwind:
• Best way: Quantify how much the rate of learning (i.e., growth) slowed:
• RICAS: Use historical skip-year growth norms to quantify growth and compare to pre-COVID growth.
• ACCESS: Use historical consecutive-year growth norms and compare to pre-COVID growth
• Next best way: Look at how much 2021 status changed:
• RICAS: Use 2019 status (or some adjustment thereof) as a proxy.
• ACCESS: Use 2020 status (or some adjustment thereof) as a proxy.
• Adjustments include (potentially) imputation for missing data
Rhode Island SGP Growth Calculations in 2021 & 2022
Status Based Impact: Grade 8 Mathematics
Rhode Island SGP Growth Calculations in 2021 & 2022
Status Based Impact: Grade 8 Mathematics
Rhode Island SGP Growth Calculations in 2021 & 2022
Growth Based Impact: Grade 8 Mathematics
Rhode Island SGP Growth Calculations in 2021 & 2022
Growth Based Impact: Grade 8 Mathematics
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS Mathematics Grade 8
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 6 2019 to Grade 8 2021 Status: Grade 8 2019 to Grade 8 2021 Summary
2019 Grade 6 Scaled Score Decile Cuts 2019 Grade 8 Scaled Score
Academic Impact: Overall and by Quintile
Grade 8 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
Severe
Observed + Imputed
2019 to 2021 Mean Conditional Status (+ Imputed) 2.5 2021 Percentiles (+ Imputed)
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
Observed
Severe Severe Severe Severe Severe
2021 Grade 8 Scaled Score Decile Cuts
2021 Grade 8 Scaled Score
0.5 Participation
0 0.00 Total Status Growth
450 450 2019: 24.5% Proficient
2021: 16.1% Proficient
Growth/Status Change Legend
2019 Grade 6 Scaled Score with Achievement Level Cuts Grade 8 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 8 Median SGPs by Quintile 2019 & 2021 Grade 8 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 8 Students 49.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 8 Students 458 (−1.33) 474 (−0.56) 486 (−0.02) 497 ( 0.51) 516 ( 1.43) 486 (0.00)
2021 Grade 8 Students 23.0 19.0 21.0 22.0 25.5 22.0 2021 Grade 8 Students 450 (−1.71) 466 (−0.94) 479 (−0.34) 490 ( 0.21) 510 ( 1.14) 479 (−0.31) Calculations suppressed
Academic Impact (Observed) −26.0 −31.0 −29.0 −28.0 −24.5 −28.0 Change (Observed) −8 (−0.38) −8 (−0.38) −7 (−0.32) −6 (−0.30) −6 (−0.29) −7 (−0.31)
Academic Impact (+ Imputed) −26.0 −27.3 −27.0 −27.0 −26.0 −27.0 Change (+ Imputed) −7 (−0.15) −8 (−0.25) −7 (−0.25) −6 (−0.28) −6 (−0.35) −8 (−0.37)
due to small group N (< 50)
Count Observed 2019 1,753 2,087 1,901 1,974 1,907 9,622 Count Observed 2019 2,199 2,125 2,077 2,013 2,196 10,610
Count Observed 2021 1,450 1,736 1,543 1,850 1,812 8,391 Count Observed 2021 1,595 2,012 1,900 1,645 1,829 8,981
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 8 Status Change (Observed)
30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 8 Status Change (+ Imputed)
0.55 0.043: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
2021 to 2019 Conditional Status Difference (Observed)
0.97: Correlation SGP and Conditional Status Difference 10 0.45
2019 to 2021
2019 Grade 6 Scaled Score with Decile & Achievement Level Cuts Grade 8 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS ELA Grade 3
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Status: Grade 3 2019 to Grade 3 2021 Summary
2019 Grade 3 Scaled Score
Academic Impact: Overall and by Quintile
Grade 3 Scaled/Standardized Score and Achievement Level Cuts
2 2019 Percentiles (Observed)
Overall
2021 Percentiles (Observed)
2021 Percentiles (+ Imputed) Moderate
1.5 2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
1 Modest to None Moderate Large Large Severe
500 0 0.00 Participation
−0.5 Total Status Growth
475 −1 2019 10,532 10,188 (96.7%) NA
2021 9,923 9,068 (91.4%) NA
No Growth Data:
450 2019: 47.9% Proficient
2021: 40.4% Proficient
−3 Growth/Status Change Legend
RICAS ELA 0 10 20 30 40 50
Grade 3 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
Grade 3 2019 Grade 3 Students
2021 Grade 3 Students
2019 & 2021 Grade 3 Mean Scaled (Standardized) Scores by Quintile
Overall
493 (−0.24) Calculations suppressed
None
Change (Observed) 0 ( 0.01) −5 (−0.21) −7 (−0.29) −6 (−0.28) −7 (−0.30) −6 (−0.24)
Change (+ Imputed) 0 (0.51) −5 (0.35) −7 (0.32) −7 (0.36) −7 (0.41) −6 (−0.25)
due to small group N (< 50)
Count Observed 2019 1,905 2,190 2,125 1,816 2,151 10,187
Count Observed 2021 1,968 1,603 1,837 1,927 1,733 9,068
2021 to 2019 Scaled/Standardized Score Difference
0.60 2021 to 2019 Grade 3 Status Change (Observed)
0.55 2021 to 2019 Grade 3 Status Change (+ Imputed)
Grade 3 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS ELA Grade 4
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Status: Grade 4 2019 to Grade 4 2021 Summary
2019 Grade 4 Scaled Score
Academic Impact: Overall and by Quintile
Grade 4 Scaled/Standardized Score and Achievement Level Cuts
2.5 2019 Percentiles (Observed)
Overall
2021 Percentiles (Observed)
2021 Percentiles (+ Imputed) Moderate
2 2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
Moderate Moderate Moderate Moderate Moderate
Participation
Total Status Growth
475 2019 10,738 10,399 (96.8%) NA
2021 10,073 9,232 (91.7%) NA
No Growth Data:
450 2019: 37.2% Proficient
2021: 35.4% Proficient
Growth/Status Change Legend
RICAS ELA 0 10 20 30 40 50
Grade 4 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
Grade 4 2019 Grade 4 Students
2021 Grade 4 Students
2019 & 2021 Grade 4 Mean Scaled (Standardized) Scores by Quintile
Overall
491 (−0.12) Calculations suppressed
None
Change (Observed) −3 (−0.15) −4 (−0.22) −3 (−0.13) −0 (−0.01) −1 (−0.07) −2 (−0.12)
Change (+ Imputed) −3 (0.33) −4 (0.21) −3 (0.26) −0 (0.33) −1 (0.26) −3 (−0.14)
due to small group N (< 50)
Count Observed 2019 2,004 2,355 1,712 2,272 2,056 10,399
Count Observed 2021 1,782 1,750 2,092 1,882 1,726 9,232
2021 to 2019 Scaled/Standardized Score Difference
0.65 2021 to 2019 Grade 4 Status Change (Observed)
0.60 2021 to 2019 Grade 4 Status Change (+ Imputed)
Grade 4 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS ELA Grade 5
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 3 2019 to Grade 5 2021 Status: Grade 5 2019 to Grade 5 2021 Summary
2019 Grade 3 Scaled Score Decile Cuts 2019 Grade 5 Scaled Score
Academic Impact: Overall and by Quintile
Grade 5 Scaled/Standardized Score and Achievement Level Cuts
Observed + Imputed
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2019 to 2021 Mean Conditional Status (+ Imputed) 2 2021 Percentiles (+ Imputed) Large
Observed
2021 Grade 5 Scaled Score Decile Cuts
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
Moderate Large Large Large Large
2021 Grade 5 Scaled Score
Participation
Total Status Growth
450 450 −2 2019: 39.1% Proficient
2021: 33.4% Proficient
−3 Growth/Status Change Legend
2019 Grade 3 Scaled Score with Achievement Level Cuts Grade 5 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 5 Median SGPs by Quintile 2019 & 2021 Grade 5 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 5 Students 50.0 50.0 52.0 48.0 50.0 50.0 2019 Grade 5 Students 464 (−1.41) 485 (−0.45) 495 ( 0.05) 505 ( 0.52) 524 ( 1.39) 494 (0.00)
2021 Grade 5 Students 40.0 30.0 30.0 34.0 36.0 34.0 2021 Grade 5 Students 459 (−1.62) 479 (−0.69) 491 (−0.14) 502 ( 0.38) 520 ( 1.23) 490 (−0.18) Calculations suppressed
Academic Impact (Observed) −10.0 −20.0 −22.0 −14.0 −14.0 −16.0 Change (Observed) −5 (−0.21) −5 (−0.24) −4 (−0.19) −3 (−0.14) −3 (−0.16) −4 (−0.18)
Academic Impact (+ Imputed) −11.4 −19.3 −22.5 −17.0 −16.0 −17.0 Change (+ Imputed) −4 (0.11) −5 (0.13) −4 (0.21) −3 (0.28) −4 (0.30) −4 (−0.20)
due to small group N (< 50)
Count Observed 2019 1,868 1,926 1,978 1,912 2,024 9,708 Count Observed 2019 2,271 1,983 2,259 2,109 2,072 10,694
Count Observed 2021 1,589 1,854 1,819 1,564 1,844 8,670 Count Observed 2021 1,925 1,907 1,744 2,065 1,805 9,446
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 5 Status Change (Observed)
30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 5 Status Change (+ Imputed)
0.55 0.43: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
2021 to 2019 Conditional Status Difference (Observed)
0.98: Correlation SGP and Conditional Status Difference 10 0.45
2019 to 2021
2019 Grade 3 Scaled Score with Decile & Achievement Level Cuts Grade 5 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS ELA Grade 6
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 4 2019 to Grade 6 2021 Status: Grade 6 2019 to Grade 6 2021 Summary
2019 Grade 4 Scaled Score Decile Cuts 2019 Grade 6 Scaled Score
Academic Impact: Overall and by Quintile
Grade 6 Scaled/Standardized Score and Achievement Level Cuts
Observed + Imputed
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
Observed
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2019 to 2021 Mean Conditional Status (+ Imputed) 2021 Percentiles (+ Imputed) Moderate
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
2021 Grade 6 Scaled Score Decile Cuts
1.5 2019 and 2021 Mean Scaled Scores
90 Large Large Large Moderate Modest to None
2021 Grade 6 Scaled Score
Participation
−0.16 Total Status Growth
450 10 10 450 2019: 39.1% Proficient
2021: 32.6% Proficient
Growth/Status Change Legend
2019 Grade 4 Scaled Score with Achievement Level Cuts Grade 6 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 6 Median SGPs by Quintile 2019 & 2021 Grade 6 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 6 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 6 Students 455 (−1.42) 478 (−0.53) 493 ( 0.04) 507 ( 0.57) 527 ( 1.37) 492 (0.00)
2021 Grade 6 Students 29.0 26.0 35.0 40.0 51.0 36.0 2021 Grade 6 Students 448 (−1.66) 471 (−0.79) 488 (−0.16) 503 ( 0.43) 527 ( 1.34) 488 (−0.16) Calculations suppressed
Academic Impact (Observed) −21.0 −24.0 −15.0 −10.0 1.0 −14 Change (Observed) −6 (−0.24) −7 (−0.26) −5 (−0.20) −4 (−0.14) −1 (−0.03) −4 (−0.16)
Academic Impact (+ Imputed) −17.5 −19.9 −15.0 −11.0 −2.0 −14.0 Change (+ Imputed) −6 (−0.25) −7 (−0.14) −5 ( 0.04) −4 ( 0.22) −1 ( 0.49) −5 (−0.19)
due to small group N (< 50)
Count Observed 2019 1,945 1,997 1,891 1,979 1,969 9,781 Count Observed 2019 2,261 1,981 2,329 2,010 2,211 10,792
Count Observed 2021 1,485 1,552 1,701 1,835 1,704 8,277 Count Observed 2021 1,724 1,875 1,667 2,017 1,711 8,994
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 2021 to 2019 Grade 6 Status Change (Observed)
30 0.50 2021 to 2019 Grade 6 Status Change (+ Imputed)
2021 to 2019 SGP Difference (+ Imputed)
0.45 0.80: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
2021 to 2019 Conditional Status Difference (Observed)
0.99: Correlation SGP and Conditional Status Difference 10
2019 to 2021
2019 Grade 4 Scaled Score with Decile & Achievement Level Cuts Grade 6 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS ELA Grade 7
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 5 2019 to Grade 7 2021 Status: Grade 7 2019 to Grade 7 2021 Summary
2019 Grade 5 Scaled Score Decile Cuts 2019 Grade 7 Scaled Score
Academic Impact: Overall and by Quintile
Grade 7 Scaled/Standardized Score and Achievement Level Cuts
Overall
Observed + Imputed
2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed)
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2019 to 2021 Mean Conditional Status (+ Imputed)
2021 Percentiles (+ Imputed) Moderate
Observed
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
2021 Grade 7 Scaled Score Decile Cuts
Moderate Moderate Moderate Moderate Moderate
2021 Grade 7 Scaled Score
Participation
−0.11 Total Status Growth
450 450 2019: 31.5% Proficient
2021: 28.7% Proficient
−2.5 Growth/Status Change Legend
2019 Grade 5 Scaled Score with Achievement Level Cuts Grade 7 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 7 Median SGPs by Quintile 2019 & 2021 Grade 7 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 7 Students 51.0 49.0 50.0 49.0 51.0 50.0 2019 Grade 7 Students 456 (−1.40) 476 (−0.54) 489 ( 0.02) 501 ( 0.53) 522 ( 1.41) 489 (0.00)
2021 Grade 7 Students 39.0 33.0 37.0 42.0 40.0 38.0 2021 Grade 7 Students 454 (−1.48) 473 (−0.67) 486 (−0.12) 499 ( 0.44) 520 ( 1.34) 486 (−0.11) Calculations suppressed
Academic Impact (Observed) −12.0 −16.0 −13.0 −7.0 −11.0 −12.0 Change (Observed) −2 (−0.08) −3 (−0.13) −3 (−0.13) −2 (−0.09) −2 (−0.08) −3 (−0.11)
Academic Impact (+ Imputed) −12.0 −12.1 −11.3 −9.0 −11.4 −11.1 Change (+ Imputed) −2 (−0.03) −3 (−0.02) −3 ( 0.03) −3 ( 0.09) −2 ( 0.16) −3 (−0.13)
due to small group N (< 50)
Count Observed 2019 1,826 1,867 2,037 1,847 1,980 9,557 Count Observed 2019 2,150 2,184 2,026 2,128 2,128 10,616
Count Observed 2021 1,498 1,717 1,811 1,675 1,685 8,386 Count Observed 2021 1,889 1,883 1,736 1,820 1,832 9,160
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.60 2021 to 2019 Grade 7 Status Change (Observed)
30 0.55 2021 to 2019 Grade 7 Status Change (+ Imputed)
2021 to 2019 SGP Difference (+ Imputed)
0.50 0.16: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
2021 to 2019 Conditional Status Difference (Observed)
0.95: Correlation SGP and Conditional Status Difference 10
2019 to 2021
2019 Grade 5 Scaled Score with Decile & Achievement Level Cuts Grade 7 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS ELA Grade 8
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 6 2019 to Grade 8 2021 Status: Grade 8 2019 to Grade 8 2021 Summary
2019 Grade 6 Scaled Score Decile Cuts 2019 Grade 8 Scaled Score
Academic Impact: Overall and by Quintile
Grade 8 Scaled/Standardized Score and Achievement Level Cuts
Overall
Observed + Imputed
2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed)
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2019 to 2021 Mean Conditional Status (+ Imputed)
2021 Percentiles (+ Imputed) Moderate
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
Observed
2021 Grade 8 Scaled Score Decile Cuts
2019 and 2021 Mean Scaled Scores
Moderate Moderate Moderate Large Large
2021 Grade 8 Scaled Score
Participation
−0.14 Total Status Growth
450 10 10 450 2019: 36.3% Proficient
2021: 28.8% Proficient
Growth/Status Change Legend
2019 Grade 6 Scaled Score with Achievement Level Cuts Grade 8 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 8 Median SGPs by Quintile 2019 & 2021 Grade 8 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 8 Students 50.0 50.0 49.0 50.0 50.0 50.0 2019 Grade 8 Students 454 (−1.40) 476 (−0.55) 490 ( 0.02) 504 ( 0.56) 524 ( 1.37) 490 (0.00)
2021 Grade 8 Students 39.0 37.0 36.0 34.0 31.0 35.0 2021 Grade 8 Students 450 (−1.55) 473 (−0.66) 488 (−0.06) 501 ( 0.43) 520 ( 1.20) 486 (−0.14) Calculations suppressed
Academic Impact (Observed) −11.0 −13.0 −13.0 −16.0 −19.0 −15.0 Change (Observed) −4 (−0.15) −3 (−0.12) −2 (−0.08) −3 (−0.12) −4 (−0.17) −4 (−0.14)
Academic Impact (+ Imputed) −9.0 −10.0 −12.5 −15.0 −18.0 −13.0 Change (+ Imputed) −3 (−0.04) −3 ( 0.06) −2 ( 0.15) −3 ( 0.16) −5 ( 0.19) −4 (−0.17)
due to small group N (< 50)
Count Observed 2019 1,806 1,872 1,939 2,016 1,905 9,538 Count Observed 2019 2,168 2,046 2,166 1,879 2,232 10,491
Count Observed 2021 1,654 1,509 1,816 1,605 1,856 8,440 Count Observed 2021 1,854 1,745 2,017 1,747 1,742 9,105
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.55 2021 to 2019 Grade 8 Status Change (Observed)
30 2021 to 2019 SGP Difference (+ Imputed) 0.50 2021 to 2019 Grade 8 Status Change (+ Imputed)
0.32: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
2021 to 2019 Conditional Status Difference (Observed) 0.45
0.95: Correlation SGP and Conditional Status Difference 10 0.40
2019 to 2021
2019 Grade 6 Scaled Score with Decile & Achievement Level Cuts Grade 8 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS Mathematics Grade 3
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Status: Grade 3 2019 to Grade 3 2021 Summary
2019 Grade 3 Scaled Score
Academic Impact: Overall and by Quintile
Grade 3 Scaled/Standardized Score and Achievement Level Cuts
2019 Percentiles (Observed)
Overall
2021 Percentiles (Observed)
2 2021 Percentiles (+ Imputed) Large
2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
Large Severe Large Severe Large
Participation
Total Status Growth
475 2019 10,532 10,321 (98.0%) NA
−1 2021 9,923 9,065 (91.4%) NA
No Growth Data:
450 2019: 36.1% Proficient
2021: 25.1% Proficient
−2.5 Growth/Status Change Legend
RICAS Mathematics 0 10 20 30 40 50
Grade 3 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
Grade 3 2019 Grade 3 Students
2021 Grade 3 Students
2019 & 2021 Grade 3 Mean Scaled (Standardized) Scores by Quintile
Overall
481 (−0.40) Calculations suppressed
None
Change (Observed) −10 (−0.42) −12 (−0.49) −10 (−0.39) −9 (−0.37) −8 (−0.33) −10 (−0.40)
Change (+ Imputed) −10 (−0.11) −12 (−0.17) −10 (−0.08) −9 (−0.08) −8 (−0.03) −10 (−0.39)
due to small group N (< 50)
Count Observed 2019 2,115 1,974 2,217 1,921 2,094 10,321
Count Observed 2021 1,764 1,974 1,755 1,694 1,878 9,065
2021 to 2019 Scaled/Standardized Score Difference
0.55 2021 to 2019 Grade 3 Status Change (Observed)
2021 to 2019 Grade 3 Status Change (+ Imputed)
Grade 3 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS Mathematics Grade 4
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Status: Grade 4 2019 to Grade 4 2021 Summary
2019 Grade 4 Scaled Score
Academic Impact: Overall and by Quintile
Grade 4 Scaled/Standardized Score and Achievement Level Cuts
2.5 2019 Percentiles (Observed)
Overall
2021 Percentiles (Observed)
2021 Percentiles (+ Imputed) Large
2 2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
Large Severe Severe Large Large
Participation
Total Status Growth
−0.5 2019 10,738 10,509 (97.9%) NA
−1 2021 10,073 9,237 (91.7%) NA
No Growth Data:
450 2019: 32.6% Proficient
2021: 20.8% Proficient
Growth/Status Change Legend
RICAS Mathematics 0 10 20 30 40 50
Grade 4 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
Grade 4 2019 Grade 4 Students
2021 Grade 4 Students
2019 & 2021 Grade 4 Mean Scaled (Standardized) Scores by Quintile
Overall
480 (−0.38) Calculations suppressed
None
Change (Observed) −8 (−0.35) −13 (−0.55) −10 (−0.42) −7 (−0.32) −6 (−0.28) −9 (−0.38)
Change (+ Imputed) −8 ( 0.01) −12 (−0.23) −10 (−0.14) −8 (−0.08) −7 (−0.08) −9 (−0.38)
due to small group N (< 50)
Count Observed 2019 2,140 2,072 2,010 2,182 2,105 10,509
Count Observed 2021 1,777 1,812 2,010 1,875 1,763 9,237
2021 to 2019 Scaled/Standardized Score Difference
0.60 2021 to 2019 Grade 4 Status Change (Observed)
0.55 2021 to 2019 Grade 4 Status Change (+ Imputed)
Grade 4 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS Mathematics Grade 5
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 3 2019 to Grade 5 2021 Status: Grade 5 2019 to Grade 5 2021 Summary
2019 Grade 3 Scaled Score Decile Cuts 2019 Grade 5 Scaled Score
Academic Impact: Overall and by Quintile
Grade 5 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
Observed + Imputed
2019 to 2021 Mean Conditional Status (+ Imputed) 2021 Percentiles (+ Imputed) Large
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
2 2019 and 2021 Mean Scaled Scores
Observed
2021 Grade 5 Scaled Score Decile Cuts
1.5 Large Large Large Large Large
2021 Grade 5 Scaled Score
500 80 500 0.5 Participation
60 60 0 0.00 Total Status Growth
450 450 2019: 30.1% Proficient
2021: 20.3% Proficient
Growth/Status Change Legend
2019 Grade 3 Scaled Score with Achievement Level Cuts Grade 5 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 5 Median SGPs by Quintile 2019 & 2021 Grade 5 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 5 Students 51.0 48.0 50.0 49.0 51.0 50.0 2019 Grade 5 Students 458 (−1.40) 478 (−0.49) 489 ( 0.04) 500 ( 0.55) 518 ( 1.38) 488 (0.00)
2021 Grade 5 Students 31.0 27.0 27.0 28.0 27.0 28.0 2021 Grade 5 Students 454 (−1.59) 470 (−0.84) 481 (−0.32) 494 ( 0.25) 512 ( 1.11) 482 (−0.28) Calculations suppressed
Academic Impact (Observed) −20.0 −21.0 −23.0 −21.0 −24.0 −22 Change (Observed) −4 (−0.19) −7 (−0.35) −8 (−0.37) −7 (−0.31) −6 (−0.27) −6 (−0.28)
Academic Impact (+ Imputed) −19.0 −19.6 −22.0 −21.0 −24.0 −21.0 Change (+ Imputed) −4 ( 0.00) −7 (−0.18) −8 (−0.21) −7 (−0.16) −6 (−0.16) −6 (−0.30)
due to small group N (< 50)
Count Observed 2019 1,809 2,021 1,887 1,856 1,954 9,527 Count Observed 2019 2,299 2,076 2,061 2,272 2,099 10,807
Count Observed 2021 1,715 1,666 1,896 1,690 1,770 8,737 Count Observed 2021 2,009 1,661 2,035 1,817 1,910 9,432
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 5 Status Change (Observed)
30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 5 Status Change (+ Imputed)
0.55 0.32: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
2021 to 2019 Conditional Status Difference (Observed)
1.00: Correlation SGP and Conditional Status Difference 10 0.45
2019 to 2021
2019 Grade 3 Scaled Score with Decile & Achievement Level Cuts Grade 5 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS Mathematics Grade 6
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 4 2019 to Grade 6 2021 Status: Grade 6 2019 to Grade 6 2021 Summary
2019 Grade 4 Scaled Score Decile Cuts 2019 Grade 6 Scaled Score
Academic Impact: Overall and by Quintile
Grade 6 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
Observed + Imputed
2019 to 2021 Mean Conditional Status (+ Imputed)
2021 Percentiles (+ Imputed) Severe
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
2 2019 and 2021 Mean Scaled Scores
Observed
2021 Grade 6 Scaled Score Decile Cuts
Large Severe Severe Severe Severe
2021 Grade 6 Scaled Score
0.5 Participation
0 0.00 Total Status Growth
450 450 2019: 27.9% Proficient
2021: 17.8% Proficient
Growth/Status Change Legend
2019 Grade 4 Scaled Score with Achievement Level Cuts Grade 6 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 6 Median SGPs by Quintile 2019 & 2021 Grade 6 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 6 Students 50.0 49.0 51.0 50.0 50.0 50.0 2019 Grade 6 Students 458 (−1.43) 477 (−0.52) 488 (−0.01) 498 ( 0.49) 518 ( 1.42) 488 (0.00)
2021 Grade 6 Students 26.5 15.0 14.0 17.0 22.0 19.0 2021 Grade 6 Students 454 (−1.62) 468 (−0.92) 479 (−0.40) 492 ( 0.19) 512 ( 1.13) 481 (−0.32) Calculations suppressed
Academic Impact (Observed) −23.5 −34.0 −37.0 −33.0 −28.0 −31.0 Change (Observed) −4 (−0.19) −8 (−0.40) −8 (−0.39) −6 (−0.31) −6 (−0.29) −7 (−0.32)
Academic Impact (+ Imputed) −23.0 −30.0 −33.0 −31.0 −28.0 −28.9 Change (+ Imputed) −4 ( 0.07) −8 (−0.21) −8 (−0.24) −7 (−0.21) −6 (−0.28) −7 (−0.35)
due to small group N (< 50)
Count Observed 2019 1,941 1,894 1,800 1,969 1,909 9,513 Count Observed 2019 2,075 2,338 2,035 2,311 2,151 10,910
Count Observed 2021 1,548 1,628 1,583 1,781 1,740 8,280 Count Observed 2021 1,650 1,963 1,720 1,868 1,735 8,936
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 6 Status Change (Observed)
30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 6 Status Change (+ Imputed)
0.55 0.84: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
2021 to 2019 Conditional Status Difference (Observed)
0.94: Correlation SGP and Conditional Status Difference 10
2019 to 2021
2019 Grade 4 Scaled Score with Decile & Achievement Level Cuts Grade 6 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS Mathematics Grade 7
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 5 2019 to Grade 7 2021 Status: Grade 7 2019 to Grade 7 2021 Summary
2019 Grade 5 Scaled Score Decile Cuts 2019 Grade 7 Scaled Score
Academic Impact: Overall and by Quintile
Grade 7 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
Observed + Imputed
2019 to 2021 Mean Conditional Status (Observed) 2.5 2021 Percentiles (Observed)
2019 to 2021 Mean Conditional Status (+ Imputed) 2021 Percentiles (+ Imputed) Large
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
Observed
2019 and 2021 Mean Scaled Scores
2021 Grade 7 Scaled Score Decile Cuts
Large Large Large Large Large
2021 Grade 7 Scaled Score
0.5 Participation
60 60 0 0.00 Total Status Growth
450 450 2019: 27.6% Proficient
2021: 20.4% Proficient
−2.5 Growth/Status Change Legend
2019 Grade 5 Scaled Score with Achievement Level Cuts Grade 7 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 7 Median SGPs by Quintile 2019 & 2021 Grade 7 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 7 Students 50.0 50.0 51.0 50.0 50.0 50.0 2019 Grade 7 Students 454 (−1.41) 473 (−0.60) 486 (−0.02) 498 ( 0.52) 518 ( 1.44) 486 (0.00)
2021 Grade 7 Students 33.0 32.0 31.0 28.0 33.0 32.0 2021 Grade 7 Students 454 (−1.43) 470 (−0.70) 482 (−0.20) 494 ( 0.35) 514 ( 1.23) 483 (−0.16) Calculations suppressed
Academic Impact (Observed) −17.0 −18.0 −20.0 −22.0 −17.0 −18.0 Change (Observed) −0 (−0.01) −2 (−0.10) −4 (−0.17) −4 (−0.18) −5 (−0.21) −4 (−0.16)
Academic Impact (+ Imputed) −16.2 −15.0 −17.5 −20.8 −19.0 −17.0 Change (+ Imputed) −0 ( 0.17) −3 ( 0.03) −4 (−0.05) −4 (−0.10) −5 (−0.19) −4 (−0.19)
due to small group N (< 50)
Count Observed 2019 1,914 1,750 2,049 1,966 1,964 9,643 Count Observed 2019 1,922 2,428 2,122 2,059 2,189 10,720
Count Observed 2021 1,654 1,568 1,605 1,663 1,854 8,344 Count Observed 2021 1,846 1,806 1,915 1,649 1,844 9,060
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.60 2021 to 2019 Grade 7 Status Change (Observed)
30 2021 to 2019 SGP Difference (+ Imputed) 2021 to 2019 Grade 7 Status Change (+ Imputed)
0.22: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
2021 to 2019 Conditional Status Difference (Observed) 0.50
0.96: Correlation SGP and Conditional Status Difference 10 0.45
2019 to 2021
2019 Grade 5 Scaled Score with Decile & Achievement Level Cuts Grade 7 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS Mathematics Grade 8
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 6 2019 to Grade 8 2021 Status: Grade 8 2019 to Grade 8 2021 Summary
2019 Grade 6 Scaled Score Decile Cuts 2019 Grade 8 Scaled Score
Academic Impact: Overall and by Quintile
Grade 8 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
Severe
Observed + Imputed
2019 to 2021 Mean Conditional Status (+ Imputed) 2.5 2021 Percentiles (+ Imputed)
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
Observed
Severe Severe Severe Severe Severe
2021 Grade 8 Scaled Score Decile Cuts
2021 Grade 8 Scaled Score
0.5 Participation
0 0.00 Total Status Growth
450 450 2019: 24.5% Proficient
2021: 16.1% Proficient
Growth/Status Change Legend
2019 Grade 6 Scaled Score with Achievement Level Cuts Grade 8 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 8 Median SGPs by Quintile 2019 & 2021 Grade 8 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 8 Students 49.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 8 Students 458 (−1.33) 474 (−0.56) 486 (−0.02) 497 ( 0.51) 516 ( 1.43) 486 (0.00)
2021 Grade 8 Students 23.0 19.0 21.0 22.0 25.5 22.0 2021 Grade 8 Students 450 (−1.71) 466 (−0.94) 479 (−0.34) 490 ( 0.21) 510 ( 1.14) 479 (−0.31) Calculations suppressed
Academic Impact (Observed) −26.0 −31.0 −29.0 −28.0 −24.5 −28.0 Change (Observed) −8 (−0.38) −8 (−0.38) −7 (−0.32) −6 (−0.30) −6 (−0.29) −7 (−0.31)
Academic Impact (+ Imputed) −26.0 −27.3 −27.0 −27.0 −26.0 −27.0 Change (+ Imputed) −7 (−0.15) −8 (−0.25) −7 (−0.25) −6 (−0.28) −6 (−0.35) −8 (−0.37)
due to small group N (< 50)
Count Observed 2019 1,753 2,087 1,901 1,974 1,907 9,622 Count Observed 2019 2,199 2,125 2,077 2,013 2,196 10,610
Count Observed 2021 1,450 1,736 1,543 1,850 1,812 8,391 Count Observed 2021 1,595 2,012 1,900 1,645 1,829 8,981
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 8 Status Change (Observed)
30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 8 Status Change (+ Imputed)
0.55 0.043: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
2021 to 2019 Conditional Status Difference (Observed)
0.97: Correlation SGP and Conditional Status Difference 10 0.45
2019 to 2021
2019 Grade 6 Scaled Score with Decile & Achievement Level Cuts Grade 8 Percentile Ranks and Scaled Scores (2019 Norm)
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS ELA and Mathematics
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact Grade & Content Area
Impact Recovery
−40 −25 −15 −5 5 20 Growth Change
−0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change
Modest
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50)
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8
All Students Moderate Moderate Large Moderate Moderate Moderate Large Large Large Severe Large Severe
Economically Disadvantaged Students Large Moderate Large Moderate Moderate Moderate Severe Severe Large Severe Moderate Large
Non−Economically Disadvantaged Students Large Moderate Large Moderate Moderate Large Large Large Large Severe Large Severe
African American Students Moderate Moderate Moderate Moderate Modest to None Modest to None Severe Severe Large Large Moderate Severe
Asian Students Moderate Modest to None Large Moderate Moderate Moderate Large Large Large Severe Moderate Severe
White Students Moderate Moderate Large Moderate Moderate Large Large Large Large Severe Large Severe
Hispanic Students Large Moderate Large Large Moderate Moderate Severe Severe Large Severe Moderate Large
ELL Students Moderate Moderate Large Moderate Modest to None Modest to None Large Large Large Large Moderate Large
Special Education Students Modest to None Modest to None Moderate Moderate Moderate Moderate Moderate Moderate Moderate Large Large Large
Non−Special Education Students Large Moderate Large Moderate Moderate Moderate Severe Severe Large Severe Large Severe
Female Students Large Moderate Large Large Moderate Large Large Large Large Severe Large Severe
Male Students Moderate Moderate Moderate Moderate Moderate Moderate Large Large Large Severe Large Severe
Rhode Island SGP Growth Calculations in 2021 & 2022
ELA And Mathematics
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact Grade, Content Area & Achievement Quintile
Impact Recovery
−40 −25 −15 −5 5 20 Growth Change
NOTE: Quintiles for each student
−0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change subgroup are based upon quintile
Modest cuts defined for All Students.
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50) Box width indicates group proportion.
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8
Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile
All Students
Economically Disadvantaged Students
Non−Economically Disadvantaged Students
African American Students
Asian Students
White Students
Hispanic Students
ELL Students
Special Education Students
Non−Special Education Students
Female Students
Male Students
Rhode Island SGP Growth Calculations in 2021 & 2022
RICAS ELA and Mathematics
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact Grade & Content Area
Impact Recovery
−40 −25 −15 −5 5 20 Growth Change
−0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change
Modest
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50)
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8
All Students Moderate Moderate Large Moderate Moderate Moderate Large Large Large Severe Large Severe
District 01 Moderate Improvement Modest to None Moderate Large Large Moderate Modest to None Moderate Large Moderate Severe
District 06 Large Modest to None Moderate Moderate Large Severe Moderate Moderate Moderate Severe Large Severe
District 07 Large Moderate Large Large Moderate Large Severe Severe Severe Severe Large Severe
District 08 Modest to None Moderate Moderate Large Large Severe Large Large Large Severe Severe Severe
District 10 Large Moderate Large Large Moderate Large Severe Severe Large Severe Large Severe
District 26 Large Modest to None Moderate Large Moderate Large Severe Severe Severe Severe Moderate Severe
District 28 Moderate Moderate Large Moderate Moderate Moderate Severe Large Large Large Moderate Severe
District 35 Moderate Modest to None Large Large Large Modest to None Large Large Large Severe Severe Large
District 39 Moderate Moderate Moderate Moderate Modest to None Moderate Severe Severe Large Severe Moderate Large
Rhode Island SGP Growth Calculations in 2021 & 2022
ELA And Mathematics
Rhode Island 2019 to 2021 COVID⌧19 Academic Impact Grade, Content Area & Achievement Quintile
Impact Recovery
−40 −25 −15 −5 5 20 Growth Change
NOTE: Quintiles for each student
−0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change subgroup are based upon quintile
Modest cuts defined for All Students.
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50) Box width indicates group proportion.
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8
Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile
All Students
District 01
District 06
District 07
District 08
District 10
District 26
District 28
District 35
District 39
Rhode Island SGP Growth Calculations in 2021 & 2022
WIDA ACCESS WIDA⌧ACCESS Composite
WIDA RI 2020 to 2021 COVID⌧19 Academic Impact Grade & Content Area
Impact Recovery
−40 −25 −15 −5 5 20 Growth Change
−0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change
Modest
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50)
WIDA−ACCESS Composite
Grade 0 Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 9 Grade 10 Grade 11 Grade 12
All Students Moderate Moderate Moderate Large Large Large Large Moderate Large Moderate Moderate Modest to None Modest to None
Rhode Island SGP Growth Calculations in 2021 & 2022
WIDA⌧ACCESS Composite
WIDA RI 2020 to 2021 COVID⌧19 Academic Impact Grade, Content Area & Achievement Quintile
Impact Recovery
−40 −25 −15 −5 5 20 Growth Change
−0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change
Modest
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50)
WIDA−ACCESS Composite
Grade 0 Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 9 Grade 10 Grade 11 Grade 12
Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile
All Students
Rhode Island SGP Growth Calculations in 2021 & 2022
All Students
Multi⌧State 2019 to 2021 COVID⌧19 Academic Impact ELA And Mathematics by Grade
Growth/Status Change Legend
Modest
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50)
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8
Rhode Island Moderate Moderate Large Moderate Moderate Moderate Large Large Large Severe Large Severe
State A Moderate Moderate Modest to None Moderate Modest to None Moderate Large Large Large Large Large Large
State B Moderate Moderate Moderate Moderate Large Moderate
State C Moderate Moderate Large Large Large Large Severe Severe Severe Severe Large Severe
State D Moderate Moderate Large Large Large Large Large Moderate Severe Severe Large Severe
State E Large Moderate Large Moderate Large Moderate Severe Large Large Severe Large Large
State F Moderate Moderate Moderate Moderate Moderate Moderate Moderate Large Large Large Large Large
State G Moderate Moderate Large Moderate Moderate Moderate Severe Large Severe Large Large Large
State H Large Large Large Moderate Large Moderate Large Severe Large Large Moderate Moderate
State I Moderate Large Moderate Moderate Modest to None Moderate Moderate Moderate Moderate Moderate Moderate Moderate
Rhode Island SGP Growth Calculations in 2021 & 2022
Academic Recovery in 2022 (Part 2)
SGP Analyses in 2021 (2022 and beyond)
• Spring 2021 represented (probably) an ideal time to get a snapshot of
student attainment as we were presumably at or near the point of
maximal impact on student attainment.
• That is, recovery had not really begun for most students in earnest.
• It’s impossible to talk about recovery sensibly without understanding
how big the impact is.
• Monitoring recovery will be at least as critical as monitoring the
impact of the pandemic on student achievement.
• Beware the K-shaped recovery!
Rhode Island SGP Growth Calculations in 2021 & 2022
Four Academic
Recovery
Scenarios with
RICAS: V-, U-, L-,
and No-recovery
Rhode Island SGP Growth Calculations in 2021 & 2022
SGP Analyses for Recovery
• Just as impact is synonymous with learning deceleration, recovery is
synonymous with learning acceleration
• The huge impacts of the pandemic made learning deceleration (i.e., detection
of learning loss/academic impact) unmistakable.
• Recovery is unlikely to be as pronounced requiring more careful/subtle
investigation of results.
• Early indications thus far from a couple of states with preliminary results with
suggest (overall) an L-shaped recovery.
• This validates results from last year
• Likely implies student learning stabilizing: neither recovering nor
deteriorating further.
Rhode Island SGP Growth Calculations in 2021 & 2022
Baseline SGP: What is Recovery
• Given the negative pandemic impacts, recovery is synonymous with learning acceleration.
• However, not all acceleration can be considered recovery
• Acceleration versus 2021 versus acceleration versus 2019
V-Shaped Recovery (> 60)
60 U-Shaped Recovery (50 to 60)
Median 2021 Baseline SGP 50 Median 2022 Baseline SGP
L-Shaped “Recovery” (40 to 50)
Note: Any median SGP above 30
in 2022 would be considered
acceleration. But only values
10 Downward Spiral (< 40) above 50 would be sufficient to
begin catching students up to
where they would have been
absent the pandemic.
Baseline SGP: What is Recovery
• Given the negative pandemic impacts, recovery is synonymous with learning acceleration.
• However, not all acceleration can be considered recovery
• Acceleration versus 2021 versus acceleration versus 2019
V-Shaped Recovery (> 60)
U-Shaped Recovery (50 to 60)
Median 2021 Baseline SGP 50 L-Shaped “Recovery” (40 to 50) Median 2022 Baseline SGP
Note: Any median SGP above 30
in 2022 would be considered
20 Downward Spiral (< 40) acceleration. But only values
10 above 50 would be sufficient to
begin catching students up to
where they would have been
absent the pandemic.
STAR Math Fall to Fall Median SGP results
Grade Fall 2019 Fall 2020 Fall 2021
www.nciea.org 42
STAR Reading Fall to Fall Median SGP results
Grade Fall 2019 Fall 2020 Fall 2021
www.nciea.org 43
Growth for Accountability in 2022 (Part 3)
SGP for Accountability
• It is not clear whether growth from 2021 to 2022 will have returned
to pre-pandemic levels.
• Any differences between baseline referenced and cohort referenced
growth raises the question of which growth metric to use for
accountability.
• In discussions thus far with other states the general recommendation
is to use cohort referenced growth for accountability even if growth
differs from pre-pandemic levels.
Rhode Island SGP Growth Calculations in 2021 & 2022
SGP for Accountability
• Good arguments can be made for the use of either cohort or baseline
referenced growth.
• Baseline referenced growth holds to pre-pandemic standards.
• If baseline growth results << cohort reference growth results, then
use of cohort referenced growth would set lower standards (relative
to pre-pandemic)
• If cohort growth results << baseline growth results, then the use of
cohort referenced growth would set high standards.
• Ultimately, the decision on what growth metric to use should align with
the purpose of the accountability system.
Rhode Island SGP Growth Calculations in 2021 & 2022
SGP Calculation: Technical considerations
• The possibility exists to utilize a second prior score for students in
grades 6, 7, and 8
• The second prior would come for pre-COVID, 2019 RICAS
administration.
• Possible issue with comparison of students with two priors versus
students with one prior due to data from pre-COVID
Rhode Island SGP Growth Calculations in 2021 & 2022
SGP Calculation: Technical considerations
• PSAT/SAT growth calculations
• Under normal circumstances growth is calculated from Grade 8
(ELA and Math) to PSAT 10 (ELA and Math)
• Under normal circumstances growth is calculated from PSAT 10 to
SAT 11.
• PSAT 10 growth cannot be calculated in 2022 due to a lack of
grade 8 data in 2020.
• SAT 11 growth can be calculated (both cohort and baseline
referenced).
Rhode Island SGP Growth Calculations in 2021 & 2022
Growth & Accountability: Questions for TAC
• What are your thoughts/recommendations regarding which type of
growth (cohort referenced/baseline referenced) to use with
accountability?
• How many priors should Rhode Island use in growth analyses
considering that a second prior would apply only to grades 6 and
higher and utilize a 2019 (pre-COVID) score?
• Any suggestions regarding calculation and use of SAT growth in 2022.
Rhode Island SGP Growth Calculations in 2021 & 2022
About this copy
Rhode Island Growth in 2022 — Rhode Island Department of Education, June 2, 2022.
This is an image-based copy of the original Keynote slides; builds and animations are flattened.