Rhode Island Growth in 2022

Rhode Island Department of Education · June 2, 2022

Rhode Island Growth in 2022 — Rhode Island Department of Education, June 2, 2022.
Published

June 2, 2022

Event
State agency
Slides
51
Format
Converted from Keynote

This deck is an image-based copy of the original slides. Builds and animations are flattened; the slide text is reproduced below for search and screen readers.

Slide text
  1. Rhode Island SGP Growth Calculations in 2021 & 2022 Academic Impact, Accountability and Recovery Damian Betebenner — Center for Assessment Ana Karantonis — RIDE Rhode Island DOE TAC Meeting June 2nd, 2022
  2. Calculation of SGPs in 2022. A look back to 2021 • Not surprisingly 2021 presented numerous challenges in the administration of state assessments as well as the calculation of SGPs based upon those assessments. • Overall, despite several formidable challenges, the analyses went extremely well and the psychometrics seemed to hold up well. • We begin with a quick recap of what was done in 2021 since there is much overlap with what will be done in 2022. Rhode Island SGP Growth Calculations in 2021 & 2022
  3. SGP Analysis Performed in 2021 • In 2021, two types of SGP analyses were conducted with both RICAS and WIDA-ACCESS data: • Cohort referenced analyses: These analyses create growth norms from the 2019 to 2021 students. These growth norms yield cohort means/ median SGPs of 50 and obscure COVID-19 academic impact. • Baseline referenced analyses: Historical growth norms were created using 2019 and prior data. These growth growth analyses don’t have mean/median SGPs of 50 and can be used to investigate overall COVID-19 academic impact. Rhode Island SGP Growth Calculations in 2021 & 2022
  4. SGP Analysis To Be Performed in 2022 • In 2022, the same two types of SGP analyses will be conducted with RICAS and WIDA-ACCESS data: • Cohort referenced analyses: These analyses create growth norms from the 2021 to 2022 students. It’s possible for grades 6, 7, and 8 to use pre- covid 2019 as a second prior. We need to discuss whether this potential second prior is desirable. These growth norms yield cohort means/median SGPs of 50 and obscure COVID-19 academic impact. • Baseline referenced analyses: Historical growth norms were created using 2018 to 2019 data. These growth growth analyses don’t have mean/ median SGPs of 50 and can be used to investigate overall COVID-19 academic impact and recovery. Rhode Island SGP Growth Calculations in 2021 & 2022
  5. SGP Analysis Plans for 2022 • Cohort referenced SGPs • Growth norms created from the current cohort of students. • Mean/median will by 50 for all grade x content area analyses • Cannot investigate overall impact & recover of the pandemic on students. • Can investigate differential impact & recovery of the pandemic on students. • Does not require scale stability across years. • Projections possible • Baseline referenced SGPs. • Growth norms created from historical (i.e., pre-COVID) cohorts of students. • Mean/median 50 for historical cohort, not necessarily 50 for current cohort. • Extent of deviation from (i.e. below) 50 is indicative of less learning/pandemic related academic impact. • Mean SGP deviation of 5 corresponds to an effect size of 0.18. • Can investigate BOTH overall impact & recovery as well as differential impact & recovery. • Requires scale stability across years. • Projections possible Rhode Island SGP Growth Calculations in 2021 & 2022
  6. SGP Analysis Plans for 2021 & 2022 • A significant difference between 2021 and 2022 is that in 2022 Rhode Island and other states will be required to use assessment results for accountability purposes. • In 2021 (and 2020) accountability systems were put on hold due to the pandemic. • The use of baseline SGPs in 2021 was supported, in part, by idea of using data for reporting (as opposed to accountability) purposes: What was the academic impact of the pandemic? • With accountability coming on line in 2022 an additional set of important considerations is in play in thinking about how growth is used. Rhode Island SGP Growth Calculations in 2021 & 2022
  7. Academic Impact 2021 (Part 1)
  8. SGP Analysis Plans for 2021 & 2022 • Less than typical participation in 2021 complicated comparisons with 2019 data in many states. • In general, Rhode Island had good participation. • Participation in almost all grades was greater than 80% and close to 90% in elementary school grades. • In 2022, missing 2021 data will impede the calculation of growth for a small percentage of students with no prior scores • We will apply multiple imputation to those missing data as well to evaluate the impact the missing data has on summary results. Rhode Island SGP Growth Calculations in 2021 & 2022
  9. Pandemic Related Academic Impact • As stated previously, any discussion of recovery implies some understanding of what the impact is/was. • As a basis for investigating academic impact/recovery, we undertook a comprehensive look at academic impact in Rhode Island • RICAS: Determined academic impact from 2019 to 2021 using grades 3, 4, 5, 6, 7, and 8 in ELA and mathematics. • WIDA-ACCESS: Determined academic impact from 2020 to 2021 using grades K to 12 ELP Rhode Island SGP Growth Calculations in 2021 & 2022
  10. How do we quantify academic impact using test data • The pandemic was like a “headwind” that (presumably) slowed down the learning of students due to a variety of factors. • We can use test data in two ways to quantify the impact of this headwind: • Best way: Quantify how much the rate of learning (i.e., growth) slowed: • RICAS: Use historical skip-year growth norms to quantify growth and compare to pre-COVID growth. • ACCESS: Use historical consecutive-year growth norms and compare to pre-COVID growth • Next best way: Look at how much 2021 status changed: • RICAS: Use 2019 status (or some adjustment thereof) as a proxy. • ACCESS: Use 2020 status (or some adjustment thereof) as a proxy. • Adjustments include (potentially) imputation for missing data Rhode Island SGP Growth Calculations in 2021 & 2022
  11. Status Based Impact: Grade 8 Mathematics Rhode Island SGP Growth Calculations in 2021 & 2022
  12. Status Based Impact: Grade 8 Mathematics Rhode Island SGP Growth Calculations in 2021 & 2022
  13. Growth Based Impact: Grade 8 Mathematics Rhode Island SGP Growth Calculations in 2021 & 2022
  14. Growth Based Impact: Grade 8 Mathematics Rhode Island SGP Growth Calculations in 2021 & 2022
  15. RICAS Mathematics Grade 8 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Growth: Grade 6 2019 to Grade 8 2021 Status: Grade 8 2019 to Grade 8 2021 Summary 2019 Grade 6 Scaled Score Decile Cuts 2019 Grade 8 Scaled Score Academic Impact: Overall and by Quintile Grade 8 Scaled/Standardized Score and Achievement Level Cuts 2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed) Overall 2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed) Severe Observed + Imputed 2019 to 2021 Mean Conditional Status (+ Imputed) 2.5 2021 Percentiles (+ Imputed) 2019 to 2021 Growth Impact 2019 to 2021 Status Impact 2019 and 2021 Mean Scaled Scores Observed Severe Severe Severe Severe Severe 2021 Grade 8 Scaled Score Decile Cuts 2021 Grade 8 Scaled Score 0.5 Participation 0 0.00 Total Status Growth 450 450 2019: 24.5% Proficient 2021: 16.1% Proficient Growth/Status Change Legend 2019 Grade 6 Scaled Score with Achievement Level Cuts Grade 8 Overall Percentile Ranks Modest Severe Large Moderate to Improvement 2019 & 2021 Grade 8 Median SGPs by Quintile 2019 & 2021 Grade 8 Mean Scaled (Standardized) Scores by Quintile None Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall 2019 Grade 8 Students 49.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 8 Students 458 (−1.33) 474 (−0.56) 486 (−0.02) 497 ( 0.51) 516 ( 1.43) 486 (0.00) 2021 Grade 8 Students 23.0 19.0 21.0 22.0 25.5 22.0 2021 Grade 8 Students 450 (−1.71) 466 (−0.94) 479 (−0.34) 490 ( 0.21) 510 ( 1.14) 479 (−0.31) Calculations suppressed Academic Impact (Observed) −26.0 −31.0 −29.0 −28.0 −24.5 −28.0 Change (Observed) −8 (−0.38) −8 (−0.38) −7 (−0.32) −6 (−0.30) −6 (−0.29) −7 (−0.31) Academic Impact (+ Imputed) −26.0 −27.3 −27.0 −27.0 −26.0 −27.0 Change (+ Imputed) −7 (−0.15) −8 (−0.25) −7 (−0.25) −6 (−0.28) −6 (−0.35) −8 (−0.37) due to small group N (< 50) Count Observed 2019 1,753 2,087 1,901 1,974 1,907 9,622 Count Observed 2019 2,199 2,125 2,077 2,013 2,196 10,610 Count Observed 2021 1,450 1,736 1,543 1,850 1,812 8,391 Count Observed 2021 1,595 2,012 1,900 1,645 1,829 8,981 2021 to 2019 Scaled/Standardized Score Difference 2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 8 Status Change (Observed) 30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 8 Status Change (+ Imputed) 0.55 0.043: Correlation SGP and Status Percentile Change Conditional Status/Growth Change 2021 to 2019 Conditional Status Difference (Observed) 0.97: Correlation SGP and Conditional Status Difference 10 0.45 2019 to 2021 2019 Grade 6 Scaled Score with Decile & Achievement Level Cuts Grade 8 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  16. RICAS ELA Grade 3 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Status: Grade 3 2019 to Grade 3 2021 Summary 2019 Grade 3 Scaled Score Academic Impact: Overall and by Quintile Grade 3 Scaled/Standardized Score and Achievement Level Cuts 2 2019 Percentiles (Observed) Overall 2021 Percentiles (Observed) 2021 Percentiles (+ Imputed) Moderate 1.5 2019 to 2021 Status Impact 2019 and 2021 Mean Scaled Scores 1 Modest to None Moderate Large Large Severe 500 0 0.00 Participation −0.5 Total Status Growth 475 −1 2019 10,532 10,188 (96.7%) NA 2021 9,923 9,068 (91.4%) NA No Growth Data: 450 2019: 47.9% Proficient 2021: 40.4% Proficient −3 Growth/Status Change Legend RICAS ELA 0 10 20 30 40 50 Grade 3 Overall Percentile Ranks Modest Severe Large Moderate to Improvement Grade 3 2019 Grade 3 Students 2021 Grade 3 Students 2019 & 2021 Grade 3 Mean Scaled (Standardized) Scores by Quintile Overall 493 (−0.24) Calculations suppressed None Change (Observed) 0 ( 0.01) −5 (−0.21) −7 (−0.29) −6 (−0.28) −7 (−0.30) −6 (−0.24) Change (+ Imputed) 0 (0.51) −5 (0.35) −7 (0.32) −7 (0.36) −7 (0.41) −6 (−0.25) due to small group N (< 50) Count Observed 2019 1,905 2,190 2,125 1,816 2,151 10,187 Count Observed 2021 1,968 1,603 1,837 1,927 1,733 9,068 2021 to 2019 Scaled/Standardized Score Difference 0.60 2021 to 2019 Grade 3 Status Change (Observed) 0.55 2021 to 2019 Grade 3 Status Change (+ Imputed) Grade 3 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  17. RICAS ELA Grade 4 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Status: Grade 4 2019 to Grade 4 2021 Summary 2019 Grade 4 Scaled Score Academic Impact: Overall and by Quintile Grade 4 Scaled/Standardized Score and Achievement Level Cuts 2.5 2019 Percentiles (Observed) Overall 2021 Percentiles (Observed) 2021 Percentiles (+ Imputed) Moderate 2 2019 to 2021 Status Impact 2019 and 2021 Mean Scaled Scores Moderate Moderate Moderate Moderate Moderate Participation Total Status Growth 475 2019 10,738 10,399 (96.8%) NA 2021 10,073 9,232 (91.7%) NA No Growth Data: 450 2019: 37.2% Proficient 2021: 35.4% Proficient Growth/Status Change Legend RICAS ELA 0 10 20 30 40 50 Grade 4 Overall Percentile Ranks Modest Severe Large Moderate to Improvement Grade 4 2019 Grade 4 Students 2021 Grade 4 Students 2019 & 2021 Grade 4 Mean Scaled (Standardized) Scores by Quintile Overall 491 (−0.12) Calculations suppressed None Change (Observed) −3 (−0.15) −4 (−0.22) −3 (−0.13) −0 (−0.01) −1 (−0.07) −2 (−0.12) Change (+ Imputed) −3 (0.33) −4 (0.21) −3 (0.26) −0 (0.33) −1 (0.26) −3 (−0.14) due to small group N (< 50) Count Observed 2019 2,004 2,355 1,712 2,272 2,056 10,399 Count Observed 2021 1,782 1,750 2,092 1,882 1,726 9,232 2021 to 2019 Scaled/Standardized Score Difference 0.65 2021 to 2019 Grade 4 Status Change (Observed) 0.60 2021 to 2019 Grade 4 Status Change (+ Imputed) Grade 4 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  18. RICAS ELA Grade 5 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Growth: Grade 3 2019 to Grade 5 2021 Status: Grade 5 2019 to Grade 5 2021 Summary 2019 Grade 3 Scaled Score Decile Cuts 2019 Grade 5 Scaled Score Academic Impact: Overall and by Quintile Grade 5 Scaled/Standardized Score and Achievement Level Cuts Observed + Imputed 2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed) Overall 2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed) 2019 to 2021 Mean Conditional Status (+ Imputed) 2 2021 Percentiles (+ Imputed) Large Observed 2021 Grade 5 Scaled Score Decile Cuts 2019 to 2021 Growth Impact 2019 to 2021 Status Impact 2019 and 2021 Mean Scaled Scores Moderate Large Large Large Large 2021 Grade 5 Scaled Score Participation Total Status Growth 450 450 −2 2019: 39.1% Proficient 2021: 33.4% Proficient −3 Growth/Status Change Legend 2019 Grade 3 Scaled Score with Achievement Level Cuts Grade 5 Overall Percentile Ranks Modest Severe Large Moderate to Improvement 2019 & 2021 Grade 5 Median SGPs by Quintile 2019 & 2021 Grade 5 Mean Scaled (Standardized) Scores by Quintile None Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall 2019 Grade 5 Students 50.0 50.0 52.0 48.0 50.0 50.0 2019 Grade 5 Students 464 (−1.41) 485 (−0.45) 495 ( 0.05) 505 ( 0.52) 524 ( 1.39) 494 (0.00) 2021 Grade 5 Students 40.0 30.0 30.0 34.0 36.0 34.0 2021 Grade 5 Students 459 (−1.62) 479 (−0.69) 491 (−0.14) 502 ( 0.38) 520 ( 1.23) 490 (−0.18) Calculations suppressed Academic Impact (Observed) −10.0 −20.0 −22.0 −14.0 −14.0 −16.0 Change (Observed) −5 (−0.21) −5 (−0.24) −4 (−0.19) −3 (−0.14) −3 (−0.16) −4 (−0.18) Academic Impact (+ Imputed) −11.4 −19.3 −22.5 −17.0 −16.0 −17.0 Change (+ Imputed) −4 (0.11) −5 (0.13) −4 (0.21) −3 (0.28) −4 (0.30) −4 (−0.20) due to small group N (< 50) Count Observed 2019 1,868 1,926 1,978 1,912 2,024 9,708 Count Observed 2019 2,271 1,983 2,259 2,109 2,072 10,694 Count Observed 2021 1,589 1,854 1,819 1,564 1,844 8,670 Count Observed 2021 1,925 1,907 1,744 2,065 1,805 9,446 2021 to 2019 Scaled/Standardized Score Difference 2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 5 Status Change (Observed) 30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 5 Status Change (+ Imputed) 0.55 0.43: Correlation SGP and Status Percentile Change Conditional Status/Growth Change 2021 to 2019 Conditional Status Difference (Observed) 0.98: Correlation SGP and Conditional Status Difference 10 0.45 2019 to 2021 2019 Grade 3 Scaled Score with Decile & Achievement Level Cuts Grade 5 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  19. RICAS ELA Grade 6 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Growth: Grade 4 2019 to Grade 6 2021 Status: Grade 6 2019 to Grade 6 2021 Summary 2019 Grade 4 Scaled Score Decile Cuts 2019 Grade 6 Scaled Score Academic Impact: Overall and by Quintile Grade 6 Scaled/Standardized Score and Achievement Level Cuts Observed + Imputed 2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed) Overall Observed 2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed) 2019 to 2021 Mean Conditional Status (+ Imputed) 2021 Percentiles (+ Imputed) Moderate 2019 to 2021 Growth Impact 2019 to 2021 Status Impact 2021 Grade 6 Scaled Score Decile Cuts 1.5 2019 and 2021 Mean Scaled Scores 90 Large Large Large Moderate Modest to None 2021 Grade 6 Scaled Score Participation −0.16 Total Status Growth 450 10 10 450 2019: 39.1% Proficient 2021: 32.6% Proficient Growth/Status Change Legend 2019 Grade 4 Scaled Score with Achievement Level Cuts Grade 6 Overall Percentile Ranks Modest Severe Large Moderate to Improvement 2019 & 2021 Grade 6 Median SGPs by Quintile 2019 & 2021 Grade 6 Mean Scaled (Standardized) Scores by Quintile None Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall 2019 Grade 6 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 6 Students 455 (−1.42) 478 (−0.53) 493 ( 0.04) 507 ( 0.57) 527 ( 1.37) 492 (0.00) 2021 Grade 6 Students 29.0 26.0 35.0 40.0 51.0 36.0 2021 Grade 6 Students 448 (−1.66) 471 (−0.79) 488 (−0.16) 503 ( 0.43) 527 ( 1.34) 488 (−0.16) Calculations suppressed Academic Impact (Observed) −21.0 −24.0 −15.0 −10.0 1.0 −14 Change (Observed) −6 (−0.24) −7 (−0.26) −5 (−0.20) −4 (−0.14) −1 (−0.03) −4 (−0.16) Academic Impact (+ Imputed) −17.5 −19.9 −15.0 −11.0 −2.0 −14.0 Change (+ Imputed) −6 (−0.25) −7 (−0.14) −5 ( 0.04) −4 ( 0.22) −1 ( 0.49) −5 (−0.19) due to small group N (< 50) Count Observed 2019 1,945 1,997 1,891 1,979 1,969 9,781 Count Observed 2019 2,261 1,981 2,329 2,010 2,211 10,792 Count Observed 2021 1,485 1,552 1,701 1,835 1,704 8,277 Count Observed 2021 1,724 1,875 1,667 2,017 1,711 8,994 2021 to 2019 Scaled/Standardized Score Difference 2021 to 2019 SGP Difference (Observed) 2021 to 2019 Grade 6 Status Change (Observed) 30 0.50 2021 to 2019 Grade 6 Status Change (+ Imputed) 2021 to 2019 SGP Difference (+ Imputed) 0.45 0.80: Correlation SGP and Status Percentile Change Conditional Status/Growth Change 2021 to 2019 Conditional Status Difference (Observed) 0.99: Correlation SGP and Conditional Status Difference 10 2019 to 2021 2019 Grade 4 Scaled Score with Decile & Achievement Level Cuts Grade 6 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  20. RICAS ELA Grade 7 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Growth: Grade 5 2019 to Grade 7 2021 Status: Grade 7 2019 to Grade 7 2021 Summary 2019 Grade 5 Scaled Score Decile Cuts 2019 Grade 7 Scaled Score Academic Impact: Overall and by Quintile Grade 7 Scaled/Standardized Score and Achievement Level Cuts Overall Observed + Imputed 2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed) 2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed) 2019 to 2021 Mean Conditional Status (+ Imputed) 2021 Percentiles (+ Imputed) Moderate Observed 2019 to 2021 Growth Impact 2019 to 2021 Status Impact 2019 and 2021 Mean Scaled Scores 2021 Grade 7 Scaled Score Decile Cuts Moderate Moderate Moderate Moderate Moderate 2021 Grade 7 Scaled Score Participation −0.11 Total Status Growth 450 450 2019: 31.5% Proficient 2021: 28.7% Proficient −2.5 Growth/Status Change Legend 2019 Grade 5 Scaled Score with Achievement Level Cuts Grade 7 Overall Percentile Ranks Modest Severe Large Moderate to Improvement 2019 & 2021 Grade 7 Median SGPs by Quintile 2019 & 2021 Grade 7 Mean Scaled (Standardized) Scores by Quintile None Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall 2019 Grade 7 Students 51.0 49.0 50.0 49.0 51.0 50.0 2019 Grade 7 Students 456 (−1.40) 476 (−0.54) 489 ( 0.02) 501 ( 0.53) 522 ( 1.41) 489 (0.00) 2021 Grade 7 Students 39.0 33.0 37.0 42.0 40.0 38.0 2021 Grade 7 Students 454 (−1.48) 473 (−0.67) 486 (−0.12) 499 ( 0.44) 520 ( 1.34) 486 (−0.11) Calculations suppressed Academic Impact (Observed) −12.0 −16.0 −13.0 −7.0 −11.0 −12.0 Change (Observed) −2 (−0.08) −3 (−0.13) −3 (−0.13) −2 (−0.09) −2 (−0.08) −3 (−0.11) Academic Impact (+ Imputed) −12.0 −12.1 −11.3 −9.0 −11.4 −11.1 Change (+ Imputed) −2 (−0.03) −3 (−0.02) −3 ( 0.03) −3 ( 0.09) −2 ( 0.16) −3 (−0.13) due to small group N (< 50) Count Observed 2019 1,826 1,867 2,037 1,847 1,980 9,557 Count Observed 2019 2,150 2,184 2,026 2,128 2,128 10,616 Count Observed 2021 1,498 1,717 1,811 1,675 1,685 8,386 Count Observed 2021 1,889 1,883 1,736 1,820 1,832 9,160 2021 to 2019 Scaled/Standardized Score Difference 2021 to 2019 SGP Difference (Observed) 0.60 2021 to 2019 Grade 7 Status Change (Observed) 30 0.55 2021 to 2019 Grade 7 Status Change (+ Imputed) 2021 to 2019 SGP Difference (+ Imputed) 0.50 0.16: Correlation SGP and Status Percentile Change Conditional Status/Growth Change 2021 to 2019 Conditional Status Difference (Observed) 0.95: Correlation SGP and Conditional Status Difference 10 2019 to 2021 2019 Grade 5 Scaled Score with Decile & Achievement Level Cuts Grade 7 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  21. RICAS ELA Grade 8 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Growth: Grade 6 2019 to Grade 8 2021 Status: Grade 8 2019 to Grade 8 2021 Summary 2019 Grade 6 Scaled Score Decile Cuts 2019 Grade 8 Scaled Score Academic Impact: Overall and by Quintile Grade 8 Scaled/Standardized Score and Achievement Level Cuts Overall Observed + Imputed 2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed) 2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed) 2019 to 2021 Mean Conditional Status (+ Imputed) 2021 Percentiles (+ Imputed) Moderate 2019 to 2021 Growth Impact 2019 to 2021 Status Impact Observed 2021 Grade 8 Scaled Score Decile Cuts 2019 and 2021 Mean Scaled Scores Moderate Moderate Moderate Large Large 2021 Grade 8 Scaled Score Participation −0.14 Total Status Growth 450 10 10 450 2019: 36.3% Proficient 2021: 28.8% Proficient Growth/Status Change Legend 2019 Grade 6 Scaled Score with Achievement Level Cuts Grade 8 Overall Percentile Ranks Modest Severe Large Moderate to Improvement 2019 & 2021 Grade 8 Median SGPs by Quintile 2019 & 2021 Grade 8 Mean Scaled (Standardized) Scores by Quintile None Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall 2019 Grade 8 Students 50.0 50.0 49.0 50.0 50.0 50.0 2019 Grade 8 Students 454 (−1.40) 476 (−0.55) 490 ( 0.02) 504 ( 0.56) 524 ( 1.37) 490 (0.00) 2021 Grade 8 Students 39.0 37.0 36.0 34.0 31.0 35.0 2021 Grade 8 Students 450 (−1.55) 473 (−0.66) 488 (−0.06) 501 ( 0.43) 520 ( 1.20) 486 (−0.14) Calculations suppressed Academic Impact (Observed) −11.0 −13.0 −13.0 −16.0 −19.0 −15.0 Change (Observed) −4 (−0.15) −3 (−0.12) −2 (−0.08) −3 (−0.12) −4 (−0.17) −4 (−0.14) Academic Impact (+ Imputed) −9.0 −10.0 −12.5 −15.0 −18.0 −13.0 Change (+ Imputed) −3 (−0.04) −3 ( 0.06) −2 ( 0.15) −3 ( 0.16) −5 ( 0.19) −4 (−0.17) due to small group N (< 50) Count Observed 2019 1,806 1,872 1,939 2,016 1,905 9,538 Count Observed 2019 2,168 2,046 2,166 1,879 2,232 10,491 Count Observed 2021 1,654 1,509 1,816 1,605 1,856 8,440 Count Observed 2021 1,854 1,745 2,017 1,747 1,742 9,105 2021 to 2019 Scaled/Standardized Score Difference 2021 to 2019 SGP Difference (Observed) 0.55 2021 to 2019 Grade 8 Status Change (Observed) 30 2021 to 2019 SGP Difference (+ Imputed) 0.50 2021 to 2019 Grade 8 Status Change (+ Imputed) 0.32: Correlation SGP and Status Percentile Change Conditional Status/Growth Change 2021 to 2019 Conditional Status Difference (Observed) 0.45 0.95: Correlation SGP and Conditional Status Difference 10 0.40 2019 to 2021 2019 Grade 6 Scaled Score with Decile & Achievement Level Cuts Grade 8 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  22. RICAS Mathematics Grade 3 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Status: Grade 3 2019 to Grade 3 2021 Summary 2019 Grade 3 Scaled Score Academic Impact: Overall and by Quintile Grade 3 Scaled/Standardized Score and Achievement Level Cuts 2019 Percentiles (Observed) Overall 2021 Percentiles (Observed) 2 2021 Percentiles (+ Imputed) Large 2019 to 2021 Status Impact 2019 and 2021 Mean Scaled Scores Large Severe Large Severe Large Participation Total Status Growth 475 2019 10,532 10,321 (98.0%) NA −1 2021 9,923 9,065 (91.4%) NA No Growth Data: 450 2019: 36.1% Proficient 2021: 25.1% Proficient −2.5 Growth/Status Change Legend RICAS Mathematics 0 10 20 30 40 50 Grade 3 Overall Percentile Ranks Modest Severe Large Moderate to Improvement Grade 3 2019 Grade 3 Students 2021 Grade 3 Students 2019 & 2021 Grade 3 Mean Scaled (Standardized) Scores by Quintile Overall 481 (−0.40) Calculations suppressed None Change (Observed) −10 (−0.42) −12 (−0.49) −10 (−0.39) −9 (−0.37) −8 (−0.33) −10 (−0.40) Change (+ Imputed) −10 (−0.11) −12 (−0.17) −10 (−0.08) −9 (−0.08) −8 (−0.03) −10 (−0.39) due to small group N (< 50) Count Observed 2019 2,115 1,974 2,217 1,921 2,094 10,321 Count Observed 2021 1,764 1,974 1,755 1,694 1,878 9,065 2021 to 2019 Scaled/Standardized Score Difference 0.55 2021 to 2019 Grade 3 Status Change (Observed) 2021 to 2019 Grade 3 Status Change (+ Imputed) Grade 3 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  23. RICAS Mathematics Grade 4 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Status: Grade 4 2019 to Grade 4 2021 Summary 2019 Grade 4 Scaled Score Academic Impact: Overall and by Quintile Grade 4 Scaled/Standardized Score and Achievement Level Cuts 2.5 2019 Percentiles (Observed) Overall 2021 Percentiles (Observed) 2021 Percentiles (+ Imputed) Large 2 2019 to 2021 Status Impact 2019 and 2021 Mean Scaled Scores Large Severe Severe Large Large Participation Total Status Growth −0.5 2019 10,738 10,509 (97.9%) NA −1 2021 10,073 9,237 (91.7%) NA No Growth Data: 450 2019: 32.6% Proficient 2021: 20.8% Proficient Growth/Status Change Legend RICAS Mathematics 0 10 20 30 40 50 Grade 4 Overall Percentile Ranks Modest Severe Large Moderate to Improvement Grade 4 2019 Grade 4 Students 2021 Grade 4 Students 2019 & 2021 Grade 4 Mean Scaled (Standardized) Scores by Quintile Overall 480 (−0.38) Calculations suppressed None Change (Observed) −8 (−0.35) −13 (−0.55) −10 (−0.42) −7 (−0.32) −6 (−0.28) −9 (−0.38) Change (+ Imputed) −8 ( 0.01) −12 (−0.23) −10 (−0.14) −8 (−0.08) −7 (−0.08) −9 (−0.38) due to small group N (< 50) Count Observed 2019 2,140 2,072 2,010 2,182 2,105 10,509 Count Observed 2021 1,777 1,812 2,010 1,875 1,763 9,237 2021 to 2019 Scaled/Standardized Score Difference 0.60 2021 to 2019 Grade 4 Status Change (Observed) 0.55 2021 to 2019 Grade 4 Status Change (+ Imputed) Grade 4 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  24. RICAS Mathematics Grade 5 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Growth: Grade 3 2019 to Grade 5 2021 Status: Grade 5 2019 to Grade 5 2021 Summary 2019 Grade 3 Scaled Score Decile Cuts 2019 Grade 5 Scaled Score Academic Impact: Overall and by Quintile Grade 5 Scaled/Standardized Score and Achievement Level Cuts 2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed) Overall 2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed) Observed + Imputed 2019 to 2021 Mean Conditional Status (+ Imputed) 2021 Percentiles (+ Imputed) Large 2019 to 2021 Growth Impact 2019 to 2021 Status Impact 2 2019 and 2021 Mean Scaled Scores Observed 2021 Grade 5 Scaled Score Decile Cuts 1.5 Large Large Large Large Large 2021 Grade 5 Scaled Score 500 80 500 0.5 Participation 60 60 0 0.00 Total Status Growth 450 450 2019: 30.1% Proficient 2021: 20.3% Proficient Growth/Status Change Legend 2019 Grade 3 Scaled Score with Achievement Level Cuts Grade 5 Overall Percentile Ranks Modest Severe Large Moderate to Improvement 2019 & 2021 Grade 5 Median SGPs by Quintile 2019 & 2021 Grade 5 Mean Scaled (Standardized) Scores by Quintile None Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall 2019 Grade 5 Students 51.0 48.0 50.0 49.0 51.0 50.0 2019 Grade 5 Students 458 (−1.40) 478 (−0.49) 489 ( 0.04) 500 ( 0.55) 518 ( 1.38) 488 (0.00) 2021 Grade 5 Students 31.0 27.0 27.0 28.0 27.0 28.0 2021 Grade 5 Students 454 (−1.59) 470 (−0.84) 481 (−0.32) 494 ( 0.25) 512 ( 1.11) 482 (−0.28) Calculations suppressed Academic Impact (Observed) −20.0 −21.0 −23.0 −21.0 −24.0 −22 Change (Observed) −4 (−0.19) −7 (−0.35) −8 (−0.37) −7 (−0.31) −6 (−0.27) −6 (−0.28) Academic Impact (+ Imputed) −19.0 −19.6 −22.0 −21.0 −24.0 −21.0 Change (+ Imputed) −4 ( 0.00) −7 (−0.18) −8 (−0.21) −7 (−0.16) −6 (−0.16) −6 (−0.30) due to small group N (< 50) Count Observed 2019 1,809 2,021 1,887 1,856 1,954 9,527 Count Observed 2019 2,299 2,076 2,061 2,272 2,099 10,807 Count Observed 2021 1,715 1,666 1,896 1,690 1,770 8,737 Count Observed 2021 2,009 1,661 2,035 1,817 1,910 9,432 2021 to 2019 Scaled/Standardized Score Difference 2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 5 Status Change (Observed) 30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 5 Status Change (+ Imputed) 0.55 0.32: Correlation SGP and Status Percentile Change Conditional Status/Growth Change 2021 to 2019 Conditional Status Difference (Observed) 1.00: Correlation SGP and Conditional Status Difference 10 0.45 2019 to 2021 2019 Grade 3 Scaled Score with Decile & Achievement Level Cuts Grade 5 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  25. RICAS Mathematics Grade 6 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Growth: Grade 4 2019 to Grade 6 2021 Status: Grade 6 2019 to Grade 6 2021 Summary 2019 Grade 4 Scaled Score Decile Cuts 2019 Grade 6 Scaled Score Academic Impact: Overall and by Quintile Grade 6 Scaled/Standardized Score and Achievement Level Cuts 2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed) Overall 2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed) Observed + Imputed 2019 to 2021 Mean Conditional Status (+ Imputed) 2021 Percentiles (+ Imputed) Severe 2019 to 2021 Growth Impact 2019 to 2021 Status Impact 2 2019 and 2021 Mean Scaled Scores Observed 2021 Grade 6 Scaled Score Decile Cuts Large Severe Severe Severe Severe 2021 Grade 6 Scaled Score 0.5 Participation 0 0.00 Total Status Growth 450 450 2019: 27.9% Proficient 2021: 17.8% Proficient Growth/Status Change Legend 2019 Grade 4 Scaled Score with Achievement Level Cuts Grade 6 Overall Percentile Ranks Modest Severe Large Moderate to Improvement 2019 & 2021 Grade 6 Median SGPs by Quintile 2019 & 2021 Grade 6 Mean Scaled (Standardized) Scores by Quintile None Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall 2019 Grade 6 Students 50.0 49.0 51.0 50.0 50.0 50.0 2019 Grade 6 Students 458 (−1.43) 477 (−0.52) 488 (−0.01) 498 ( 0.49) 518 ( 1.42) 488 (0.00) 2021 Grade 6 Students 26.5 15.0 14.0 17.0 22.0 19.0 2021 Grade 6 Students 454 (−1.62) 468 (−0.92) 479 (−0.40) 492 ( 0.19) 512 ( 1.13) 481 (−0.32) Calculations suppressed Academic Impact (Observed) −23.5 −34.0 −37.0 −33.0 −28.0 −31.0 Change (Observed) −4 (−0.19) −8 (−0.40) −8 (−0.39) −6 (−0.31) −6 (−0.29) −7 (−0.32) Academic Impact (+ Imputed) −23.0 −30.0 −33.0 −31.0 −28.0 −28.9 Change (+ Imputed) −4 ( 0.07) −8 (−0.21) −8 (−0.24) −7 (−0.21) −6 (−0.28) −7 (−0.35) due to small group N (< 50) Count Observed 2019 1,941 1,894 1,800 1,969 1,909 9,513 Count Observed 2019 2,075 2,338 2,035 2,311 2,151 10,910 Count Observed 2021 1,548 1,628 1,583 1,781 1,740 8,280 Count Observed 2021 1,650 1,963 1,720 1,868 1,735 8,936 2021 to 2019 Scaled/Standardized Score Difference 2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 6 Status Change (Observed) 30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 6 Status Change (+ Imputed) 0.55 0.84: Correlation SGP and Status Percentile Change Conditional Status/Growth Change 2021 to 2019 Conditional Status Difference (Observed) 0.94: Correlation SGP and Conditional Status Difference 10 2019 to 2021 2019 Grade 4 Scaled Score with Decile & Achievement Level Cuts Grade 6 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  26. RICAS Mathematics Grade 7 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Growth: Grade 5 2019 to Grade 7 2021 Status: Grade 7 2019 to Grade 7 2021 Summary 2019 Grade 5 Scaled Score Decile Cuts 2019 Grade 7 Scaled Score Academic Impact: Overall and by Quintile Grade 7 Scaled/Standardized Score and Achievement Level Cuts 2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed) Overall Observed + Imputed 2019 to 2021 Mean Conditional Status (Observed) 2.5 2021 Percentiles (Observed) 2019 to 2021 Mean Conditional Status (+ Imputed) 2021 Percentiles (+ Imputed) Large 2019 to 2021 Growth Impact 2019 to 2021 Status Impact Observed 2019 and 2021 Mean Scaled Scores 2021 Grade 7 Scaled Score Decile Cuts Large Large Large Large Large 2021 Grade 7 Scaled Score 0.5 Participation 60 60 0 0.00 Total Status Growth 450 450 2019: 27.6% Proficient 2021: 20.4% Proficient −2.5 Growth/Status Change Legend 2019 Grade 5 Scaled Score with Achievement Level Cuts Grade 7 Overall Percentile Ranks Modest Severe Large Moderate to Improvement 2019 & 2021 Grade 7 Median SGPs by Quintile 2019 & 2021 Grade 7 Mean Scaled (Standardized) Scores by Quintile None Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall 2019 Grade 7 Students 50.0 50.0 51.0 50.0 50.0 50.0 2019 Grade 7 Students 454 (−1.41) 473 (−0.60) 486 (−0.02) 498 ( 0.52) 518 ( 1.44) 486 (0.00) 2021 Grade 7 Students 33.0 32.0 31.0 28.0 33.0 32.0 2021 Grade 7 Students 454 (−1.43) 470 (−0.70) 482 (−0.20) 494 ( 0.35) 514 ( 1.23) 483 (−0.16) Calculations suppressed Academic Impact (Observed) −17.0 −18.0 −20.0 −22.0 −17.0 −18.0 Change (Observed) −0 (−0.01) −2 (−0.10) −4 (−0.17) −4 (−0.18) −5 (−0.21) −4 (−0.16) Academic Impact (+ Imputed) −16.2 −15.0 −17.5 −20.8 −19.0 −17.0 Change (+ Imputed) −0 ( 0.17) −3 ( 0.03) −4 (−0.05) −4 (−0.10) −5 (−0.19) −4 (−0.19) due to small group N (< 50) Count Observed 2019 1,914 1,750 2,049 1,966 1,964 9,643 Count Observed 2019 1,922 2,428 2,122 2,059 2,189 10,720 Count Observed 2021 1,654 1,568 1,605 1,663 1,854 8,344 Count Observed 2021 1,846 1,806 1,915 1,649 1,844 9,060 2021 to 2019 Scaled/Standardized Score Difference 2021 to 2019 SGP Difference (Observed) 0.60 2021 to 2019 Grade 7 Status Change (Observed) 30 2021 to 2019 SGP Difference (+ Imputed) 2021 to 2019 Grade 7 Status Change (+ Imputed) 0.22: Correlation SGP and Status Percentile Change Conditional Status/Growth Change 2021 to 2019 Conditional Status Difference (Observed) 0.50 0.96: Correlation SGP and Conditional Status Difference 10 0.45 2019 to 2021 2019 Grade 5 Scaled Score with Decile & Achievement Level Cuts Grade 7 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  27. RICAS Mathematics Grade 8 Rhode Island 2019 to 2021 COVID⌧19 Academic Impact All Students Growth: Grade 6 2019 to Grade 8 2021 Status: Grade 8 2019 to Grade 8 2021 Summary 2019 Grade 6 Scaled Score Decile Cuts 2019 Grade 8 Scaled Score Academic Impact: Overall and by Quintile Grade 8 Scaled/Standardized Score and Achievement Level Cuts 2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed) Overall 2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed) Severe Observed + Imputed 2019 to 2021 Mean Conditional Status (+ Imputed) 2.5 2021 Percentiles (+ Imputed) 2019 to 2021 Growth Impact 2019 to 2021 Status Impact 2019 and 2021 Mean Scaled Scores Observed Severe Severe Severe Severe Severe 2021 Grade 8 Scaled Score Decile Cuts 2021 Grade 8 Scaled Score 0.5 Participation 0 0.00 Total Status Growth 450 450 2019: 24.5% Proficient 2021: 16.1% Proficient Growth/Status Change Legend 2019 Grade 6 Scaled Score with Achievement Level Cuts Grade 8 Overall Percentile Ranks Modest Severe Large Moderate to Improvement 2019 & 2021 Grade 8 Median SGPs by Quintile 2019 & 2021 Grade 8 Mean Scaled (Standardized) Scores by Quintile None Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall 2019 Grade 8 Students 49.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 8 Students 458 (−1.33) 474 (−0.56) 486 (−0.02) 497 ( 0.51) 516 ( 1.43) 486 (0.00) 2021 Grade 8 Students 23.0 19.0 21.0 22.0 25.5 22.0 2021 Grade 8 Students 450 (−1.71) 466 (−0.94) 479 (−0.34) 490 ( 0.21) 510 ( 1.14) 479 (−0.31) Calculations suppressed Academic Impact (Observed) −26.0 −31.0 −29.0 −28.0 −24.5 −28.0 Change (Observed) −8 (−0.38) −8 (−0.38) −7 (−0.32) −6 (−0.30) −6 (−0.29) −7 (−0.31) Academic Impact (+ Imputed) −26.0 −27.3 −27.0 −27.0 −26.0 −27.0 Change (+ Imputed) −7 (−0.15) −8 (−0.25) −7 (−0.25) −6 (−0.28) −6 (−0.35) −8 (−0.37) due to small group N (< 50) Count Observed 2019 1,753 2,087 1,901 1,974 1,907 9,622 Count Observed 2019 2,199 2,125 2,077 2,013 2,196 10,610 Count Observed 2021 1,450 1,736 1,543 1,850 1,812 8,391 Count Observed 2021 1,595 2,012 1,900 1,645 1,829 8,981 2021 to 2019 Scaled/Standardized Score Difference 2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 8 Status Change (Observed) 30 2021 to 2019 SGP Difference (+ Imputed) 0.60 2021 to 2019 Grade 8 Status Change (+ Imputed) 0.55 0.043: Correlation SGP and Status Percentile Change Conditional Status/Growth Change 2021 to 2019 Conditional Status Difference (Observed) 0.97: Correlation SGP and Conditional Status Difference 10 0.45 2019 to 2021 2019 Grade 6 Scaled Score with Decile & Achievement Level Cuts Grade 8 Percentile Ranks and Scaled Scores (2019 Norm) Rhode Island SGP Growth Calculations in 2021 & 2022
  28. RICAS ELA and Mathematics Rhode Island 2019 to 2021 COVID⌧19 Academic Impact Grade & Content Area Impact Recovery −40 −25 −15 −5 5 20 Growth Change −0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change Modest Calculations suppressed Severe Large Moderate to Improvement None due to small group N (< 50) ELA Mathematics Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 All Students Moderate Moderate Large Moderate Moderate Moderate Large Large Large Severe Large Severe Economically Disadvantaged Students Large Moderate Large Moderate Moderate Moderate Severe Severe Large Severe Moderate Large Non−Economically Disadvantaged Students Large Moderate Large Moderate Moderate Large Large Large Large Severe Large Severe African American Students Moderate Moderate Moderate Moderate Modest to None Modest to None Severe Severe Large Large Moderate Severe Asian Students Moderate Modest to None Large Moderate Moderate Moderate Large Large Large Severe Moderate Severe White Students Moderate Moderate Large Moderate Moderate Large Large Large Large Severe Large Severe Hispanic Students Large Moderate Large Large Moderate Moderate Severe Severe Large Severe Moderate Large ELL Students Moderate Moderate Large Moderate Modest to None Modest to None Large Large Large Large Moderate Large Special Education Students Modest to None Modest to None Moderate Moderate Moderate Moderate Moderate Moderate Moderate Large Large Large Non−Special Education Students Large Moderate Large Moderate Moderate Moderate Severe Severe Large Severe Large Severe Female Students Large Moderate Large Large Moderate Large Large Large Large Severe Large Severe Male Students Moderate Moderate Moderate Moderate Moderate Moderate Large Large Large Severe Large Severe Rhode Island SGP Growth Calculations in 2021 & 2022
  29. ELA And Mathematics Rhode Island 2019 to 2021 COVID⌧19 Academic Impact Grade, Content Area & Achievement Quintile Impact Recovery −40 −25 −15 −5 5 20 Growth Change NOTE: Quintiles for each student −0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change subgroup are based upon quintile Modest cuts defined for All Students. Calculations suppressed Severe Large Moderate to Improvement None due to small group N (< 50) Box width indicates group proportion. ELA Mathematics Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile All Students Economically Disadvantaged Students Non−Economically Disadvantaged Students African American Students Asian Students White Students Hispanic Students ELL Students Special Education Students Non−Special Education Students Female Students Male Students Rhode Island SGP Growth Calculations in 2021 & 2022
  30. RICAS ELA and Mathematics Rhode Island 2019 to 2021 COVID⌧19 Academic Impact Grade & Content Area Impact Recovery −40 −25 −15 −5 5 20 Growth Change −0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change Modest Calculations suppressed Severe Large Moderate to Improvement None due to small group N (< 50) ELA Mathematics Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 All Students Moderate Moderate Large Moderate Moderate Moderate Large Large Large Severe Large Severe District 01 Moderate Improvement Modest to None Moderate Large Large Moderate Modest to None Moderate Large Moderate Severe District 06 Large Modest to None Moderate Moderate Large Severe Moderate Moderate Moderate Severe Large Severe District 07 Large Moderate Large Large Moderate Large Severe Severe Severe Severe Large Severe District 08 Modest to None Moderate Moderate Large Large Severe Large Large Large Severe Severe Severe District 10 Large Moderate Large Large Moderate Large Severe Severe Large Severe Large Severe District 26 Large Modest to None Moderate Large Moderate Large Severe Severe Severe Severe Moderate Severe District 28 Moderate Moderate Large Moderate Moderate Moderate Severe Large Large Large Moderate Severe District 35 Moderate Modest to None Large Large Large Modest to None Large Large Large Severe Severe Large District 39 Moderate Moderate Moderate Moderate Modest to None Moderate Severe Severe Large Severe Moderate Large Rhode Island SGP Growth Calculations in 2021 & 2022
  31. ELA And Mathematics Rhode Island 2019 to 2021 COVID⌧19 Academic Impact Grade, Content Area & Achievement Quintile Impact Recovery −40 −25 −15 −5 5 20 Growth Change NOTE: Quintiles for each student −0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change subgroup are based upon quintile Modest cuts defined for All Students. Calculations suppressed Severe Large Moderate to Improvement None due to small group N (< 50) Box width indicates group proportion. ELA Mathematics Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile All Students District 01 District 06 District 07 District 08 District 10 District 26 District 28 District 35 District 39 Rhode Island SGP Growth Calculations in 2021 & 2022
  32. WIDA ACCESS WIDA⌧ACCESS Composite WIDA RI 2020 to 2021 COVID⌧19 Academic Impact Grade & Content Area Impact Recovery −40 −25 −15 −5 5 20 Growth Change −0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change Modest Calculations suppressed Severe Large Moderate to Improvement None due to small group N (< 50) WIDA−ACCESS Composite Grade 0 Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 9 Grade 10 Grade 11 Grade 12 All Students Moderate Moderate Moderate Large Large Large Large Moderate Large Moderate Moderate Modest to None Modest to None Rhode Island SGP Growth Calculations in 2021 & 2022
  33. WIDA⌧ACCESS Composite WIDA RI 2020 to 2021 COVID⌧19 Academic Impact Grade, Content Area & Achievement Quintile Impact Recovery −40 −25 −15 −5 5 20 Growth Change −0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change Modest Calculations suppressed Severe Large Moderate to Improvement None due to small group N (< 50) WIDA−ACCESS Composite Grade 0 Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 9 Grade 10 Grade 11 Grade 12 Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile All Students Rhode Island SGP Growth Calculations in 2021 & 2022
  34. All Students Multi⌧State 2019 to 2021 COVID⌧19 Academic Impact ELA And Mathematics by Grade Growth/Status Change Legend Modest Calculations suppressed Severe Large Moderate to Improvement None due to small group N (< 50) ELA Mathematics Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Rhode Island Moderate Moderate Large Moderate Moderate Moderate Large Large Large Severe Large Severe State A Moderate Moderate Modest to None Moderate Modest to None Moderate Large Large Large Large Large Large State B Moderate Moderate Moderate Moderate Large Moderate State C Moderate Moderate Large Large Large Large Severe Severe Severe Severe Large Severe State D Moderate Moderate Large Large Large Large Large Moderate Severe Severe Large Severe State E Large Moderate Large Moderate Large Moderate Severe Large Large Severe Large Large State F Moderate Moderate Moderate Moderate Moderate Moderate Moderate Large Large Large Large Large State G Moderate Moderate Large Moderate Moderate Moderate Severe Large Severe Large Large Large State H Large Large Large Moderate Large Moderate Large Severe Large Large Moderate Moderate State I Moderate Large Moderate Moderate Modest to None Moderate Moderate Moderate Moderate Moderate Moderate Moderate Rhode Island SGP Growth Calculations in 2021 & 2022
  35. Questions
  36. Academic Recovery in 2022 (Part 2)
  37. SGP Analyses in 2021 (2022 and beyond) • Spring 2021 represented (probably) an ideal time to get a snapshot of student attainment as we were presumably at or near the point of maximal impact on student attainment. • That is, recovery had not really begun for most students in earnest. • It’s impossible to talk about recovery sensibly without understanding how big the impact is. • Monitoring recovery will be at least as critical as monitoring the impact of the pandemic on student achievement. • Beware the K-shaped recovery! Rhode Island SGP Growth Calculations in 2021 & 2022
  38. Four Academic Recovery Scenarios with RICAS: V-, U-, L-, and No-recovery Rhode Island SGP Growth Calculations in 2021 & 2022
  39. SGP Analyses for Recovery • Just as impact is synonymous with learning deceleration, recovery is synonymous with learning acceleration • The huge impacts of the pandemic made learning deceleration (i.e., detection of learning loss/academic impact) unmistakable. • Recovery is unlikely to be as pronounced requiring more careful/subtle investigation of results. • Early indications thus far from a couple of states with preliminary results with suggest (overall) an L-shaped recovery. • This validates results from last year • Likely implies student learning stabilizing: neither recovering nor deteriorating further. Rhode Island SGP Growth Calculations in 2021 & 2022
  40. Baseline SGP: What is Recovery • Given the negative pandemic impacts, recovery is synonymous with learning acceleration. • However, not all acceleration can be considered recovery • Acceleration versus 2021 versus acceleration versus 2019 V-Shaped Recovery (> 60) 60 U-Shaped Recovery (50 to 60) Median 2021 Baseline SGP 50 Median 2022 Baseline SGP L-Shaped “Recovery” (40 to 50) Note: Any median SGP above 30 in 2022 would be considered acceleration. But only values 10 Downward Spiral (< 40) above 50 would be sufficient to begin catching students up to where they would have been absent the pandemic.
  41. Baseline SGP: What is Recovery • Given the negative pandemic impacts, recovery is synonymous with learning acceleration. • However, not all acceleration can be considered recovery • Acceleration versus 2021 versus acceleration versus 2019 V-Shaped Recovery (> 60) U-Shaped Recovery (50 to 60) Median 2021 Baseline SGP 50 L-Shaped “Recovery” (40 to 50) Median 2022 Baseline SGP Note: Any median SGP above 30 in 2022 would be considered 20 Downward Spiral (< 40) acceleration. But only values 10 above 50 would be sufficient to begin catching students up to where they would have been absent the pandemic.
  42. STAR Math Fall to Fall Median SGP results Grade Fall 2019 Fall 2020 Fall 2021 www.nciea.org 42
  43. STAR Reading Fall to Fall Median SGP results Grade Fall 2019 Fall 2020 Fall 2021 www.nciea.org 43
  44. Questions
  45. Growth for Accountability in 2022 (Part 3)
  46. SGP for Accountability • It is not clear whether growth from 2021 to 2022 will have returned to pre-pandemic levels. • Any differences between baseline referenced and cohort referenced growth raises the question of which growth metric to use for accountability. • In discussions thus far with other states the general recommendation is to use cohort referenced growth for accountability even if growth differs from pre-pandemic levels. Rhode Island SGP Growth Calculations in 2021 & 2022
  47. SGP for Accountability • Good arguments can be made for the use of either cohort or baseline referenced growth. • Baseline referenced growth holds to pre-pandemic standards. • If baseline growth results << cohort reference growth results, then use of cohort referenced growth would set lower standards (relative to pre-pandemic) • If cohort growth results << baseline growth results, then the use of cohort referenced growth would set high standards. • Ultimately, the decision on what growth metric to use should align with the purpose of the accountability system. Rhode Island SGP Growth Calculations in 2021 & 2022
  48. SGP Calculation: Technical considerations • The possibility exists to utilize a second prior score for students in grades 6, 7, and 8 • The second prior would come for pre-COVID, 2019 RICAS administration. • Possible issue with comparison of students with two priors versus students with one prior due to data from pre-COVID Rhode Island SGP Growth Calculations in 2021 & 2022
  49. SGP Calculation: Technical considerations • PSAT/SAT growth calculations • Under normal circumstances growth is calculated from Grade 8 (ELA and Math) to PSAT 10 (ELA and Math) • Under normal circumstances growth is calculated from PSAT 10 to SAT 11. • PSAT 10 growth cannot be calculated in 2022 due to a lack of grade 8 data in 2020. • SAT 11 growth can be calculated (both cohort and baseline referenced). Rhode Island SGP Growth Calculations in 2021 & 2022
  50. Growth & Accountability: Questions for TAC • What are your thoughts/recommendations regarding which type of growth (cohort referenced/baseline referenced) to use with accountability? • How many priors should Rhode Island use in growth analyses considering that a second prior would apply only to grades 6 and higher and utilize a 2019 (pre-COVID) score? • Any suggestions regarding calculation and use of SAT growth in 2022. Rhode Island SGP Growth Calculations in 2021 & 2022
  51. Questions