Massachusetts SGP Growth Calculations in 2022
Operational and Investigative Considerations
Damian Betebenner — Center for Assessment
Bob Lee — DESE
Massachusetts DESE
TAC Meeting
May 9th, 2022
Calculation of SGPs in 2022. A look back to 2021
• Not surprisingly 2021 presented numerous challenges in the
administration of state assessments as well as the calculation of
SGPs based upon those assessments.
• Overall, despite several formidable challenges, the analyses
went extremely well and the psychometrics seemed to hold up
well.
• We begin with a quick recap of what was done in 2021 since
there is much overlap with what will be done in 2022.
CO SGP Growth Calculations in 2021
SGP Analysis Performed in 2021
• In 2021, two types of SGP analyses were conducted with both
MCAS and WIDA-ACCESS data:
• Cohort referenced analyses: These analyses create growth norms from
the 2019 to 2021 students. These growth norms yield cohort means/
median SGPs of 50 and obscure COVID-19 academic impact.
• Baseline referenced analyses: Historical growth norms were created
using 2019 and prior data. These growth growth analyses don’t have
mean/median SGPs of 50 and can be used to investigate overall
COVID-19 academic impact.
MA SGP Growth Calculations in 2021 & 2022
SGP Analysis To Be Performed in 2022
• In 2022, the same two types of SGP analyses will be conducted
with MCAS and WIDA-ACCESS data:
• Cohort referenced analyses: These analyses create growth norms from
the 2021 to 2022 students. It’s possible for grades 6, 7, and 8 to use
pre-covid 2019 as a second prior. We need to discuss whether this
potential second prior is desirable. These growth norms yield cohort
means/median SGPs of 50 and obscure COVID-19 academic impact.
• Baseline referenced analyses: Historical growth norms were created
using 2018 to 2019 data. These growth growth analyses don’t have
mean/median SGPs of 50 and can be used to investigate overall
COVID-19 academic impact.
MA SGP Growth Calculations in 2021 & 2022
SGP Analysis Plans for 2022
• Cohort referenced SGPs
• Growth norms created from the current cohort of students.
• Mean/median will by 50 for all grade x content area analyses
• Cannot investigate overall impact & recover of the pandemic on students.
• Can investigate differential impact & recovery of the pandemic on students.
• Does not require scale stability across years.
• Projections possible
• Baseline referenced SGPs.
• Growth norms created from historical (i.e., pre-COVID) cohorts of students.
• Mean/median 50 for historical cohort, not necessarily 50 for current cohort.
• Extent of deviation from (i.e. below) 50 is indicative of less learning/pandemic related academic impact.
• Mean SGP deviation of 5 corresponds to an effect size of 0.18.
• Can investigate BOTH overall impact & recovery as well as differential impact & recovery.
• Requires scale stability across years.
• Projections possible
MA SGP Growth Calculations in 2021 & 2022
SGP Analysis Plans for 2021 & 2022
• A significant difference between 2021 and 2022 is that in 2022
Massachusetts and other states will be required to use assessment
results for accountability purposes.
• In 2021 (and 2020) accountability systems were put on hold due to the
pandemic.
• The use of baseline SGPs in 2021 was supported, in part, by idea of
using data for reporting (as opposed to accountability) purposes: What
was the academic impact of the pandemic?
• With accountability coming on line in 2022 an additional set of
important considerations is in play in thinking about how growth is
used.
MA SGP Growth Calculations in 2021 & 2022
Growth for Accountability in 2022
SGP for Accountability
• It is not clear whether growth from 2021 to 2022 will have returned
to pre-pandemic levels.
• Any differences between baseline referenced and cohort referenced
growth raises the question of which growth metric to use for
accountability.
• In discussions thus far with DESE (and other states) the general
recommendation is to use cohort referenced growth even if growth
differs from pre-pandemic levels.
MA SGP Growth Calculations in 2021 & 2022
Growth & Accountability: Questions for TAC
• What are the TAC’s thoughts/recommendations regarding which type
of growth (cohort referenced/baseline referenced) to use with
accountability.
MA SGP Growth Calculations in 2021 & 2022
Growth for Supplemental Reporting in 2022
SGP Analysis Plans post 2021 (2022 and beyond)
• Spring 2021 represented (probably) an ideal time to get a snapshot of
student attainment as we were presumably at or near the point of
maximal impact on student attainment.
• That is, recovery had not really begun for most students in earnest.
• It’s impossible to talk about recovery sensibly without understanding
how big the impact is.
• Monitoring recovery will be at least as critical as monitoring the
impact of the pandemic on student achievement.
• Beware the K-shaped recovery!
MA SGP Growth Calculations in 2021 & 2022
SGP Analysis Plans for 2021 & 2022
• Less than typical participation in 2021 complicated comparisons with
2019 data in many states.
• In general, Massachusetts had excellent participation.
• Participation in almost all grades was greater than 90% and greater
than 95% in elementary school grades.
• In 2022, missing 2021 data will impede the calculation of growth for a
small percentage of students with no prior scores
• We will apply multiple imputation to those missing data as well to
evaluate the impact the missing data has on summary results.
MA SGP Growth Calculations in 2021 & 2022
Pandemic Related Academic Impact
• As stated previously, any discussion of recovery implies some
understanding of what the impact is/was.
• As a basis for investigating academic impact/recovery, we undertook a
comprehensive look at academic impact in MA
• MCAS: Determined academic impact from 2019 to 2021 using grades
3, 4, 5, 6, 7, 8 and 10 ELA and mathematics.
• WIDA-ACCESS: Determined academic impact from 2020 to 2021
using grades K to 12 ELP
MA SGP Growth Calculations in 2021 & 2022
How do we quantify academic impact using test data
• The pandemic was like a “headwind” that (presumably) slowed down the learning of
students due to a variety of factors.
• We can use test data in two ways to quantify the impact of this headwind:
• Best way: Quantify how much the rate of learning (i.e., growth) slowed:
• MCAS: Use historical skip-year growth norms to quantify growth and compare to pre-COVID growth.
• ACCESS: Use historical consecutive-year growth norms and compare to pre-COVID growth
• Next best way: Look at how much 2021 status changed:
• MCAS: Use 2019 status (or some adjustment thereof) as a proxy.
• ACCESS: Use 2020 status (or some adjustment thereof) as a proxy.
• Adjustments include (potentially) imputation for missing data
MA SGP Growth Calculations in 2021 & 2022 14
Status Based Impact
MA Growth Calculations in 2021 & 2022
Status Based Impact
MA SGP Growth Calculations in 2021 & 2022
Growth Based Impact
MA SGP Growth Calculations in 2021 & 2022
Growth Based Impact
MA SGP Growth Calculations in 2021 & 2022
MCAS ELA Grade 3
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth Based Impact Status: Grade 3 2019 to Grade 3 2021 Summary
2019 Grade 3 Scaled Score
Academic Impact: Overall and by Quintile
Grade 3 Scaled/Standardized Score and Achievement Level Cuts
2019 Percentiles (Observed)
Overall
2021 Percentiles (Observed)
1.5 2019 to 2021 Status Impact Moderate
2019 and 2021 Mean Scaled Scores
Large Moderate Moderate Moderate Moderate
Participation
Total Status Growth
475 2019 66,909 66,909 (100.0%) NA
2021 62,697 62,697 (100.0%) NA
No Growth Data:
450 −2.5 2019: 56.9% Proficient
−3 2021: 51.5% Proficient
Growth/Status Change Legend
MCAS ELA 0 10 20 30 40 50
Grade 3 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
Grade 3 2019 Grade 3 Students
2021 Grade 3 Students
2019 & 2021 Grade 3 Mean Scaled (Standardized) Scores by Quintile
Overall
500 (−0.21) Calculations suppressed
None
Change (Observed) −5 (−0.24) −5 (−0.21) −3 (−0.15) −3 (−0.13) −3 (−0.14) −5 (−0.21)
Count Observed 2019 13,354 12,479 12,876 16,241 11,958 66,908
due to small group N (< 50)
Count Observed 2021 13,037 11,157 13,258 15,143 10,102 62,697
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 Grade 3 Status Change (Observed)
MA SGP Growth Calculations in 2021 & 2022
Grade 3 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS ELA Grade 4
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Status: Grade 4 2019 to Grade 4 2021 Summary
2019 Grade 4 Scaled Score
Academic Impact: Overall and by Quintile
Grade 4 Scaled/Standardized Score and Achievement Level Cuts
2019 Percentiles (Observed)
Overall
2021 Percentiles (Observed)
2019 to 2021 Status Impact Moderate
1.5 2019 and 2021 Mean Scaled Scores
1 Large Moderate Moderate Moderate Modest to None
−0.18 Participation
Total Status Growth
475 2019 68,810 68,810 (100.0%) NA
2021 64,217 64,217 (100.0%) NA
No Growth Data:
450 −2.5 2019: 52.5% Proficient
−3 2021: 49.7% Proficient
Growth/Status Change Legend
MCAS ELA 0 10 20 30 40 50
Grade 4 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
Grade 4 2019 Grade 4 Students
2021 Grade 4 Students
2019 & 2021 Grade 4 Mean Scaled (Standardized) Scores by Quintile
Overall
498 (−0.18) Calculations suppressed
None
Change (Observed) −7 (−0.34) −4 (−0.19) −3 (−0.15) −4 (−0.17) −2 (−0.11) −4 (−0.18)
Count Observed 2019 13,421 13,609 15,233 12,689 13,858 68,810
due to small group N (< 50)
Count Observed 2021 12,267 13,881 12,767 11,758 13,544 64,217
2021 to 2019 Scaled/Standardized Score Difference
0.65 2021 to 2019 Grade 4 Status Change (Observed)
MA SGP Growth Calculations in 2021 & 2022
Grade 4 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS ELA Grade 5
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 3 2019 to Grade 5 2021 Status: Grade 5 2019 to Grade 5 2021 Summary
2019 Grade 3 Scaled Score Decile Cuts 2019 Grade 5 Scaled Score
Academic Impact: Overall and by Quintile
Grade 5 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
Observed
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2021 Grade 5 Scaled Score Decile Cuts
2019 to 2021 Growth Impact 2019 to 2021 Status Impact Large
1.5 2019 and 2021 Mean Scaled Scores
1 Large Severe Large Large Large
2021 Grade 5 Scaled Score
−0.21 Participation
30 Total Status Growth
2019: 52.9% Proficient
−3 2021: 47.2% Proficient
Growth/Status Change Legend
2019 Grade 3 Scaled Score with Achievement Level Cuts Grade 5 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 5 Median SGPs by Quintile 2019 & 2021 Grade 5 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 5 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 5 Students 470 (−1.45) 491 (−0.50) 501 ( 0.01) 513 ( 0.53) 531 ( 1.41) 501 (0.00)
2021 Grade 5 Students 29.0 24.0 26.0 32.0 33.0 28.0 2021 Grade 5 Students 465 (−1.71) 487 (−0.68) 498 (−0.14) 509 ( 0.37) 527 ( 1.23) 497 (−0.21) Calculations suppressed
Academic Impact (Observed) −21.0 −26.0 −24.0 −18.0 −17.0 −22.0 Change (Observed) −6 (−0.26) −4 (−0.18) −3 (−0.14) −3 (−0.16) −4 (−0.18) −4 (−0.21)
Count Observed 2019 13,444 13,478 14,276 11,742 12,795 65,735 Count Observed 2019 13,751 13,790 15,580 14,490 13,409 71,020
due to small group N (< 50)
Count Observed 2021 11,725 11,222 11,700 14,766 10,875 60,288 Count Observed 2021 13,746 13,267 12,202 12,472 12,917 64,604
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 5 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) 0.36: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.99: Correlation SGP and Conditional Status Difference 0.50
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 3 Scaled Score with Decile & Achievement Level Cuts Grade 5 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS ELA Grade 6
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 4 2019 to Grade 6 2021 Status: Grade 6 2019 to Grade 6 2021 Summary
2019 Grade 4 Scaled Score Decile Cuts 2019 Grade 6 Scaled Score
Academic Impact: Overall and by Quintile
Grade 6 Scaled/Standardized Score and Achievement Level Cuts
Observed
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
1.5 Large
2021 Grade 6 Scaled Score Decile Cuts
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
90 2019 and 2021 Mean Scaled Scores
80 Severe Large Large Large Moderate
2021 Grade 6 Scaled Score
−0.18 Participation
40 −0.5 Total Status Growth
450 450 −2 2019: 53.9% Proficient
−2.5 2021: 47.4% Proficient
Growth/Status Change Legend
2019 Grade 4 Scaled Score with Achievement Level Cuts Grade 6 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 6 Median SGPs by Quintile 2019 & 2021 Grade 6 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 6 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 6 Students 463 (−1.47) 488 (−0.52) 503 ( 0.05) 516 ( 0.58) 538 ( 1.40) 501 (0.00)
2021 Grade 6 Students 25.0 26.0 29.0 33.0 40.0 31.0 2021 Grade 6 Students 456 (−1.75) 482 (−0.75) 498 (−0.14) 513 ( 0.44) 537 ( 1.36) 497 (−0.18) Calculations suppressed
Academic Impact (Observed) −25.0 −24.0 −21.0 −17.0 −10.0 −19.0 Change (Observed) −7 (−0.28) −6 (−0.23) −5 (−0.18) −4 (−0.14) −1 (−0.04) −5 (−0.18)
Count Observed 2019 13,022 13,603 13,777 11,636 13,829 65,867 Count Observed 2019 14,008 14,408 14,352 15,147 13,373 71,288
due to small group N (< 50)
Count Observed 2021 11,665 12,141 13,621 11,400 12,405 61,232 Count Observed 2021 13,883 13,474 11,312 13,806 13,132 65,607
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 2021 to 2019 Grade 6 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) 0.91: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.89: Correlation SGP and Conditional Status Difference
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 4 Scaled Score with Decile & Achievement Level Cuts Grade 6 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS ELA Grade 7
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 5 2019 to Grade 7 2021 Status: Grade 7 2019 to Grade 7 2021 Summary
2019 Grade 5 Scaled Score Decile Cuts 2019 Grade 7 Scaled Score
Academic Impact: Overall and by Quintile
Grade 7 Scaled/Standardized Score and Achievement Level Cuts
Overall
Observed
2017 to 2019 Mean Conditional Status 2 2019 Percentiles (Observed)
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2019 to 2021 Growth Impact 2019 to 2021 Status Impact Large
2021 Grade 7 Scaled Score Decile Cuts
1.5 2019 and 2021 Mean Scaled Scores
1 Large Large Large Large Large
2021 Grade 7 Scaled Score
500 500 0 0.00 Participation
40 −0.5 Total Status Growth
450 450 2019: 49.1% Proficient
2021: 43.5% Proficient
−3 Growth/Status Change Legend
2019 Grade 5 Scaled Score with Achievement Level Cuts Grade 7 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 7 Median SGPs by Quintile 2019 & 2021 Grade 7 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 7 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 7 Students 465 (−1.45) 487 (−0.49) 500 ( 0.06) 512 ( 0.57) 531 ( 1.37) 499 (0.00)
2021 Grade 7 Students 28.0 26.0 29.0 30.0 34.0 29.0 2021 Grade 7 Students 457 (−1.79) 481 (−0.77) 495 (−0.15) 507 ( 0.36) 528 ( 1.25) 494 (−0.21) Calculations suppressed
Academic Impact (Observed) −22.0 −24.0 −21.0 −20.0 −16.0 −21.0 Change (Observed) −8 (−0.34) −6 (−0.28) −5 (−0.22) −5 (−0.21) −3 (−0.12) −5 (−0.21)
Count Observed 2019 12,121 13,012 14,378 12,099 12,837 64,447 Count Observed 2019 13,963 14,802 14,435 12,744 14,203 70,147
due to small group N (< 50)
Count Observed 2021 11,690 12,088 13,767 12,804 11,773 62,122 Count Observed 2021 12,734 14,745 12,313 12,875 14,057 66,724
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.60 2021 to 2019 Grade 7 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) 0.73: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.87: Correlation SGP and Conditional Status Difference
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 5 Scaled Score with Decile & Achievement Level Cuts Grade 7 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS ELA Grade 8
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 6 2019 to Grade 8 2021 Status: Grade 8 2019 to Grade 8 2021 Summary
2019 Grade 6 Scaled Score Decile Cuts 2019 Grade 8 Scaled Score
Academic Impact: Overall and by Quintile
Grade 8 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
Observed
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
Large
2021 Grade 8 Scaled Score Decile Cuts
2019 to 2021 Growth Impact 1.5 2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
Moderate Large Large Severe Severe
2021 Grade 8 Scaled Score
Participation
−0.5 Total Status Growth
450 450 −2 2019: 52.3% Proficient
−2.5 2021: 41.1% Proficient
Growth/Status Change Legend
2019 Grade 6 Scaled Score with Achievement Level Cuts Grade 8 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 8 Median SGPs by Quintile 2019 & 2021 Grade 8 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 8 Students 49.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 8 Students 464 (−1.44) 488 (−0.49) 502 ( 0.08) 514 ( 0.56) 534 ( 1.36) 500 (0.00)
2021 Grade 8 Students 37.0 33.0 27.0 22.0 23.0 28.0 2021 Grade 8 Students 457 (−1.72) 482 (−0.72) 496 (−0.17) 509 ( 0.35) 530 ( 1.21) 495 (−0.21) Calculations suppressed
Academic Impact (Observed) −12.0 −17.0 −23.0 −28.0 −27.0 −22 Change (Observed) −7 (−0.28) −6 (−0.22) −6 (−0.25) −5 (−0.21) −4 (−0.15) −5 (−0.21)
Count Observed 2019 12,939 11,717 13,790 13,347 12,717 64,510 Count Observed 2019 14,109 14,711 14,244 12,401 14,354 69,819
due to small group N (< 50)
Count Observed 2021 11,765 12,535 12,713 13,400 11,912 62,325 Count Observed 2021 13,911 12,223 13,186 14,442 12,993 66,755
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.55 2021 to 2019 Grade 8 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) −0.49: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.99: Correlation SGP and Conditional Status Difference 0.45
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 6 Scaled Score with Decile & Achievement Level Cuts Grade 8 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS ELA Grade 10
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 8 2019 to Grade 10 2021 Status: Grade 10 2019 to Grade 10 2021 Summary
2019 Grade 8 Scaled Score Decile Cuts 2019 Grade 10 Scaled Score
Grade 10 Scaled/Standardized Score and Achievement Level Cuts
Academic Impact: Overall and by Quintile
Observed
2021 Grade 10 Scaled Score Decile Cuts
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 1.5 2021 Percentiles (Observed)
2019 to 2021 Growth Impact 90 2019 to 2021 Status Impact Modest to None
2019 and 2021 Mean Scaled Scores
Improvement Improvement Modest to None Modest to None Modest to None
2021 Grade 10 Scaled Score
Participation
20 Total Status Growth
2019: 61.9% Proficient
−3 2021: 64.6% Proficient
Growth/Status Change Legend
2019 Grade 8 Scaled Score with Achievement Level Cuts Grade 10 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 10 Median SGPs by Quintile 2019 & 2021 Grade 10 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 10 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 10 Students 472 (−1.47) 495 (−0.48) 508 ( 0.08) 519 ( 0.56) 539 ( 1.38) 506 (0.00)
2021 Grade 10 Students 57.0 56.0 55.0 53.0 51.0 54.0 2021 Grade 10 Students 471 (−1.47) 496 (−0.45) 508 ( 0.08) 521 ( 0.65) 540 ( 1.45) 507 (0.05) Calculations suppressed
Academic Impact (Observed) 7.0 6.0 5.0 3.0 1.0 4.0 Change (Observed) −0 (−0.00) 1 ( 0.03) 0 ( 0.01) 2 ( 0.08) 2 ( 0.07) 1 (0.05)
Count Observed 2019 12,640 11,863 11,238 14,555 11,644 61,940 Count Observed 2019 13,406 15,909 13,864 12,936 13,779 69,894
due to small group N (< 50)
Count Observed 2021 11,381 10,844 12,153 10,747 12,552 57,677 Count Observed 2021 13,058 11,414 13,264 13,721 11,944 63,401
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.60 2021 to 2019 Grade 10 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) −0.38: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.64: Correlation SGP and Conditional Status Difference 0.45
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 8 Scaled Score with Decile & Achievement Level Cuts Grade 10 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS Mathematics Grade 3
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Status: Grade 3 2019 to Grade 3 2021 Summary
2019 Grade 3 Scaled Score
Academic Impact: Overall and by Quintile
Grade 3 Scaled/Standardized Score and Achievement Level Cuts
2 2019 Percentiles (Observed)
Overall
2021 Percentiles (Observed)
2019 to 2021 Status Impact Severe
1.5 2019 and 2021 Mean Scaled Scores
1 Severe Severe Severe Severe Large
Participation
−0.5 −0.47 Total Status Growth
475 −1 2019 66,995 66,995 (100.0%) NA
2021 62,698 62,698 (100.0%) NA
No Growth Data:
450 2019: 50.0% Proficient
2021: 33.9% Proficient
Growth/Status Change Legend
MCAS Mathematics 0 10 20 30 40 50 60
Grade 3 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
Grade 3 2019 Grade 3 Students
2021 Grade 3 Students
2019 & 2021 Grade 3 Mean Scaled (Standardized) Scores by Quintile
Overall
488 (−0.47) Calculations suppressed
None
Change (Observed) −15 (−0.65) −14 (−0.58) −11 (−0.45) −9 (−0.36) −6 (−0.24) −11 (−0.47)
Count Observed 2019 13,538 14,136 12,093 12,965 14,263 66,995
due to small group N (< 50)
Count Observed 2021 12,554 12,866 12,869 12,252 12,157 62,698
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 Grade 3 Status Change (Observed)
MA SGP Growth Calculations in 2021 & 2022
Grade 3 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS Mathematics Grade 4
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Status: Grade 4 2019 to Grade 4 2021 Summary
2019 Grade 4 Scaled Score
Academic Impact: Overall and by Quintile
Grade 4 Scaled/Standardized Score and Achievement Level Cuts
2 2019 Percentiles (Observed)
Overall
2021 Percentiles (Observed)
2019 to 2021 Status Impact Severe
1.5 2019 and 2021 Mean Scaled Scores
1 Severe Severe Severe Severe Large
Participation
−0.5 −0.49 Total Status Growth
475 −1 2019 68,797 68,797 (100.0%) NA
2021 64,214 64,214 (100.0%) NA
No Growth Data:
450 2019: 50.3% Proficient
2021: 33.7% Proficient
−3 Growth/Status Change Legend
MCAS Mathematics 0 10 20 30 40 50
Grade 4 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
Grade 4 2019 Grade 4 Students
2021 Grade 4 Students
2019 & 2021 Grade 4 Mean Scaled (Standardized) Scores by Quintile
Overall
488 (−0.49) Calculations suppressed
None
Change (Observed) −13 (−0.57) −13 (−0.58) −11 (−0.48) −10 (−0.43) −8 (−0.34) −11 (−0.49)
Count Observed 2019 13,879 12,765 15,701 12,865 13,587 68,797
due to small group N (< 50)
Count Observed 2021 13,177 12,604 14,029 11,110 13,294 64,214
2021 to 2019 Scaled/Standardized Score Difference
0.60 2021 to 2019 Grade 4 Status Change (Observed)
MA SGP Growth Calculations in 2021 & 2022
Grade 4 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS Mathematics Grade 5
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 3 2019 to Grade 5 2021 Status: Grade 5 2019 to Grade 5 2021 Summary
2019 Grade 3 Scaled Score Decile Cuts 2019 Grade 5 Scaled Score
Academic Impact: Overall and by Quintile
Grade 5 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2019 to 2021 Growth Impact
2019 to 2021 Status Impact Severe
Observed
2019 and 2021 Mean Scaled Scores
2021 Grade 5 Scaled Score Decile Cuts
Large Severe Severe Severe Severe
2021 Grade 5 Scaled Score
500 0 0.00 Participation
−0.5 Total Status Growth
450 450 2019: 49.0% Proficient
2021: 33.9% Proficient
Growth/Status Change Legend
2019 Grade 3 Scaled Score with Achievement Level Cuts Grade 5 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 5 Median SGPs by Quintile 2019 & 2021 Grade 5 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 5 Students 50.0 50.0 51.0 50.0 50.0 50.0 2019 Grade 5 Students 467 (−1.47) 488 (−0.49) 499 ( 0.03) 510 ( 0.54) 527 ( 1.35) 499 (0.00)
2021 Grade 5 Students 31.0 23.0 22.0 20.0 23.0 24.0 2021 Grade 5 Students 460 (−1.82) 478 (−0.95) 490 (−0.42) 502 ( 0.16) 522 ( 1.10) 490 (−0.39) Calculations suppressed
Academic Impact (Observed) −19.0 −27.0 −29.0 −30.0 −27.0 −26.0 Change (Observed) −8 (−0.36) −10 (−0.45) −10 (−0.45) −8 (−0.38) −5 (−0.25) −8 (−0.39)
Count Observed 2019 13,058 12,580 13,416 13,164 13,598 65,816 Count Observed 2019 13,638 15,155 13,281 14,753 14,193 71,020
due to small group N (< 50)
Count Observed 2021 11,819 12,706 10,979 11,823 12,990 60,317 Count Observed 2021 13,631 11,649 12,792 14,082 12,373 64,527
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.65 2021 to 2019 Grade 5 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) −0.52: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.98: Correlation SGP and Conditional Status Difference 0.50
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 3 Scaled Score with Decile & Achievement Level Cuts Grade 5 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS Mathematics Grade 6
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 4 2019 to Grade 6 2021 Status: Grade 6 2019 to Grade 6 2021 Summary
2019 Grade 4 Scaled Score Decile Cuts 2019 Grade 6 Scaled Score
Academic Impact: Overall and by Quintile
Grade 6 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2 2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
Severe
Observed
2019 to 2021 Growth Impact 2019 to 2021 Status Impact
2019 and 2021 Mean Scaled Scores
2021 Grade 6 Scaled Score Decile Cuts
90 Severe Severe Severe Severe Severe
2021 Grade 6 Scaled Score
Participation
Total Status Growth
450 450 2019: 52.3% Proficient
2021: 33.9% Proficient
−3 Growth/Status Change Legend
2019 Grade 4 Scaled Score with Achievement Level Cuts Grade 6 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 6 Median SGPs by Quintile 2019 & 2021 Grade 6 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 6 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 6 Students 468 (−1.40) 489 (−0.52) 501 (−0.00) 513 ( 0.53) 534 ( 1.43) 501 (0.00)
2021 Grade 6 Students 21.0 16.0 15.0 15.0 14.0 16.0 2021 Grade 6 Students 457 (−1.86) 476 (−1.07) 489 (−0.52) 502 ( 0.06) 524 ( 1.00) 490 (−0.46) Calculations suppressed
Academic Impact (Observed) −29.0 −34.0 −35.0 −35.0 −36.0 −34 Change (Observed) −11 (−0.46) −13 (−0.55) −12 (−0.51) −11 (−0.47) −10 (−0.43) −11 (−0.46)
Count Observed 2019 12,981 12,588 13,567 13,544 13,159 65,839 Count Observed 2019 14,172 14,590 13,890 14,980 13,631 71,263
due to small group N (< 50)
Count Observed 2021 11,988 12,927 12,472 11,570 12,188 61,145 Count Observed 2021 12,354 13,143 13,225 13,778 13,016 65,516
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.60 2021 to 2019 Grade 6 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) −0.25: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.91: Correlation SGP and Conditional Status Difference
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 4 Scaled Score with Decile & Achievement Level Cuts Grade 6 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS Mathematics Grade 7
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 5 2019 to Grade 7 2021 Status: Grade 7 2019 to Grade 7 2021 Summary
2019 Grade 5 Scaled Score Decile Cuts 2019 Grade 7 Scaled Score
Academic Impact: Overall and by Quintile
Grade 7 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2 2019 Percentiles (Observed)
Overall
Observed
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2019 to 2021 Growth Impact 2019 to 2021 Status Impact Large
2021 Grade 7 Scaled Score Decile Cuts
1.5 2019 and 2021 Mean Scaled Scores
1 Moderate Large Large Severe Large
2021 Grade 7 Scaled Score
0 0.00 Participation
40 −0.5 Total Status Growth
450 450 −2 2019: 48.3% Proficient
−2.5 2021: 35.2% Proficient
Growth/Status Change Legend
2019 Grade 5 Scaled Score with Achievement Level Cuts Grade 7 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 7 Median SGPs by Quintile 2019 & 2021 Grade 7 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 7 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 7 Students 464 (−1.39) 485 (−0.56) 498 ( 0.01) 512 ( 0.57) 532 ( 1.38) 498 (0.00)
2021 Grade 7 Students 38.0 33.0 28.0 24.0 27.0 29.0 2021 Grade 7 Students 458 (−1.63) 479 (−0.78) 492 (−0.27) 504 ( 0.25) 527 ( 1.15) 492 (−0.25) Calculations suppressed
Academic Impact (Observed) −12.0 −17.0 −22.0 −26.0 −23.0 −21.0 Change (Observed) −6 (−0.25) −5 (−0.22) −7 (−0.27) −8 (−0.32) −6 (−0.24) −6 (−0.25)
Count Observed 2019 12,546 13,268 12,666 13,238 12,708 64,426 Count Observed 2019 14,587 13,275 14,558 13,308 14,399 70,127
due to small group N (< 50)
Count Observed 2021 12,716 12,042 11,669 13,160 12,487 62,074 Count Observed 2021 13,294 13,052 13,792 12,945 13,551 66,634
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.55 2021 to 2019 Grade 7 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) 0.50 0.48: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.95: Correlation SGP and Conditional Status Difference 0.45
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 5 Scaled Score with Decile & Achievement Level Cuts Grade 7 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS Mathematics Grade 8
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 6 2019 to Grade 8 2021 Status: Grade 8 2019 to Grade 8 2021 Summary
2019 Grade 6 Scaled Score Decile Cuts 2019 Grade 8 Scaled Score
Academic Impact: Overall and by Quintile
Grade 8 Scaled/Standardized Score and Achievement Level Cuts
2017 to 2019 Mean Conditional Status
2 2019 Percentiles (Observed)
Overall
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2019 to 2021 Growth Impact 2019 to 2021 Status Impact Severe
Observed
1.5 2019 and 2021 Mean Scaled Scores
2021 Grade 8 Scaled Score Decile Cuts
1 Severe Severe Severe Severe Severe
2021 Grade 8 Scaled Score
500 0 0.00 Participation
−0.5 Total Status Growth
450 450 2019: 47.1% Proficient
2021: 32.5% Proficient
−3 Growth/Status Change Legend
2019 Grade 6 Scaled Score with Achievement Level Cuts Grade 8 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 8 Median SGPs by Quintile 2019 & 2021 Grade 8 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 8 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 8 Students 466 (−1.42) 486 (−0.57) 499 (−0.02) 511 ( 0.52) 532 ( 1.39) 499 (0.00)
2021 Grade 8 Students 22.0 19.0 16.0 14.0 14.0 17.0 2021 Grade 8 Students 456 (−1.84) 477 (−0.94) 490 (−0.40) 502 ( 0.13) 524 ( 1.05) 489 (−0.42) Calculations suppressed
Academic Impact (Observed) −28.0 −31.0 −34.0 −36.0 −36.0 −33.0 Change (Observed) −10 (−0.42) −9 (−0.37) −9 (−0.37) −9 (−0.38) −8 (−0.34) −10 (−0.42)
Count Observed 2019 12,554 12,329 13,387 13,374 12,840 64,484 Count Observed 2019 13,250 13,997 14,731 13,294 14,521 69,793
due to small group N (< 50)
Count Observed 2021 11,776 12,643 12,272 13,356 12,275 62,322 Count Observed 2021 13,723 13,422 13,549 12,920 13,145 66,759
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.60 2021 to 2019 Grade 8 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) −0.58: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.84: Correlation SGP and Conditional Status Difference
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 6 Scaled Score with Decile & Achievement Level Cuts Grade 8 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS Mathematics Grade 10
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact All Students
Growth: Grade 8 2019 to Grade 10 2021 Status: Grade 10 2019 to Grade 10 2021 Summary
2019 Grade 8 Scaled Score Decile Cuts 2019 Grade 10 Scaled Score
Grade 10 Scaled/Standardized Score and Achievement Level Cuts
Academic Impact: Overall and by Quintile
Observed
Overall
2021 Grade 10 Scaled Score Decile Cuts
2017 to 2019 Mean Conditional Status 2019 Percentiles (Observed)
2019 to 2021 Mean Conditional Status (Observed) 2021 Percentiles (Observed)
2019 to 2021 Growth Impact
2019 to 2021 Status Impact Large
2019 and 2021 Mean Scaled Scores
80 Large Large Large Large Moderate
2021 Grade 10 Scaled Score
Participation
30 Total Status Growth
450 450 2019: 59.4% Proficient
2021: 52.7% Proficient
Growth/Status Change Legend
2019 Grade 8 Scaled Score with Achievement Level Cuts Grade 10 Overall Percentile Ranks
Modest
Severe Large Moderate to Improvement
2019 & 2021 Grade 10 Median SGPs by Quintile 2019 & 2021 Grade 10 Mean Scaled (Standardized) Scores by Quintile None
Q1 Q2 Q3 Q4 Q5 Overall Q1 Q2 Q3 Q4 Q5 Overall
2019 Grade 10 Students 50.0 50.0 50.0 50.0 50.0 50.0 2019 Grade 10 Students 472 (−1.42) 493 (−0.51) 506 ( 0.05) 518 ( 0.56) 537 ( 1.36) 505 (0.00)
2021 Grade 10 Students 34.0 28.0 29.0 30.0 38.0 32.0 2021 Grade 10 Students 466 (−1.67) 487 (−0.76) 501 (−0.17) 514 ( 0.40) 535 ( 1.27) 501 (−0.19) Calculations suppressed
Academic Impact (Observed) −16.0 −22.0 −21.0 −20.0 −12.0 −18.0 Change (Observed) −6 (−0.25) −6 (−0.26) −5 (−0.21) −4 (−0.16) −2 (−0.09) −4 (−0.19)
Count Observed 2019 12,433 11,540 13,449 12,063 12,167 61,652 Count Observed 2019 14,238 13,958 14,062 12,853 14,353 69,464
due to small group N (< 50)
Count Observed 2021 11,537 11,682 11,374 11,512 11,326 57,431 Count Observed 2021 12,893 11,970 13,424 12,289 12,542 63,118
2021 to 2019 Scaled/Standardized Score Difference
2021 to 2019 SGP Difference (Observed) 0.60 2021 to 2019 Grade 10 Status Change (Observed)
2021 to 2019 Conditional Status Difference (Observed) 0.17: Correlation SGP and Status Percentile Change
Conditional Status/Growth Change
25 0.77: Correlation SGP and Conditional Status Difference
2019 to 2021
MA SGP Growth Calculations in 2021 & 2022
2019 Grade 8 Scaled Score with Decile & Achievement Level Cuts Grade 10 Percentile Ranks and Scaled Scores (2019 Norm)
MCAS ELA and Mathematics
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact Grade & Content Area
Impact Recovery
−40 −25 −15 −5 5 20 Growth Change
−0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change
Modest
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50)
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10
All Students Moderate Moderate Large Large Large Large Modest to None Severe Severe Severe Severe Large Severe Large
Economically Disadvantaged Large Moderate Large Large Large Large Improvement Severe Severe Severe Severe Large Severe Large
n−Economically Disadvantaged Moderate Moderate Large Large Large Large Modest to None Severe Severe Severe Severe Large Severe Large
Asian Students Moderate Moderate Large Large Large Severe Modest to None Large Severe Severe Severe Large Severe Large
African American Students Moderate Moderate Severe Large Large Large Modest to None Severe Severe Severe Severe Large Severe Large
Hispanic Students Large Large Severe Severe Severe Large Modest to None Severe Severe Severe Severe Large Severe Large
White Students Moderate Moderate Large Large Large Large Modest to None Large Large Large Severe Large Severe Large
ELL Students Moderate Moderate Large Large Large Large Improvement Severe Severe Severe Severe Large Severe Large
Female Students Moderate Moderate Severe Large Large Severe Modest to None Severe Severe Severe Severe Large Severe Large
Male Students Moderate Moderate Large Large Large
MA Large Improvement
SGP Growth Severe
Calculations in 2021 & 2022 Severe Severe Severe Large Severe Large
ELA And Mathematics
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact Grade, Content Area & Achievement Quintile
Impact Recovery
−40 −25 −15 −5 5 20 Growth Change
NOTE: Quintiles for each student
−0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change subgroup are based upon quintile
Modest
Calculations suppressed
cuts defined for All Students.
Severe Large Moderate to Improvement
None due to small group N (< 50) Box width indicates group proportion.
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10
Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile
All Students
Economically Disadvantaged
on−Economically Disadvantaged
Asian Students
African American Students
Hispanic Students
White Students
ELL Students
Female Students
Male Students MA SGP Growth Calculations in 2021 & 2022
MCAS ELA and Mathematics
Massachusetts 2019 to 2021 COVID⌧19 Academic Impact Grade & Content Area
Impact Recovery
−40 −25 −15 −5 5 20 Growth Change
−0.55 −0.4 −0.25 −0.1 0.05 0.2 Status Change
Modest
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50)
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10
All Students Moderate Moderate Moderate Moderate Moderate Moderate Modest to None Severe Severe Large Severe Large Severe Moderate
MA SGP Growth Calculations in 2021 & 2022
All Students
Multi⌧State 2019 to 2021 COVID⌧19 Academic Impact ELA And Mathematics by Grade
Growth/Status Change Legend
Modest
Calculations suppressed
Severe Large Moderate to Improvement
None due to small group N (< 50)
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10
Massachusetts Moderate Moderate Large Large Large Large Modest to None Severe Severe Severe Severe Large Severe Large
State A Moderate Moderate Large Moderate Moderate Moderate Large Large Large Severe Large Severe
State B Moderate Moderate Moderate Moderate Large Moderate
State C Moderate Moderate Modest to None Moderate Modest to None Moderate Large Large Large Large Large Large
State D Moderate Moderate Large Large Large Large Large Moderate Severe Severe Large Severe
State E Large Moderate Large Moderate Large Moderate Moderate Severe Large Large Severe Large Large
State F Moderate Moderate Moderate Moderate Moderate Moderate Moderate Large Large Large Large Large
State G Moderate Moderate Large Moderate Moderate Moderate Severe Large Severe Large Large Large
State H Large Large Large Moderate Large Moderate Large Severe Large Large Moderate Moderate
State I Moderate Large Moderate Moderate
MAModerate
Modest to None Moderate
SGP Growth Calculations in 2021 & 2022 Moderate Moderate Moderate Moderate Moderate
All Students
Multi⌧State 2019 to 2021 COVID⌧19 Academic Impact
ELA And Mathematics by Grade & Achievement Quintile
Growth/Status Change Legend
NOTE: Quintiles for each
state are based upon quintile
Modest
Calculations suppressed cuts for that state.
Severe Large Moderate to Improvement
None due to small group N (< 50)
ELA Mathematics
Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10 Grade 3 Grade 4 Grade 5 Grade 6 Grade 7 Grade 8 Grade 10
Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile Quintile
Massachusetts
State A
State B
State C
State D
State E
State F
State G
State H
State I MA SGP Growth Calculations in 2021 & 2022
Four Academic
Recovery
Scenarios with
MCAS: V-, U-, L-,
and No-recovery
MA SGP Growth Calculations in 2021 & 2022
Baseline SGP: What is Recovery
• Given the negative pandemic impacts, any recovery implies learning acceleration.
• However, not all acceleration can be considered recovery
• Acceleration versus 2021 versus acceleration versus 2019
V-Shaped Recovery (> 60)
60 U-Shaped Recovery (50 to 60)
Median 2021 Baseline SGP 50 Median 2022 Baseline SGP
L-Shaped “Recovery” (40 to 50)
Downward Spiral (< 40) Note: Any median SGP above 30
in 2022 would be considered
acceleration. But only values
10 above 50 would be su cient to
begin catching students up to
where they would have been
absent the pandemic.
ffi
Impact and Recovery: Questions for the TAC
• Does the TAC have any recommendations on how to communicate
academic recovery vis-a-vis academic impact?
• How should information regarding academic recovery/impact be
assembled/communicated alongside accountability?
MA SGP Growth Calculations in 2021 & 2022
Questions
CO SGP Growth Calculations in 2021
About this copy
Massachusetts SGP Growth Calculations in 2022 — Massachusetts Technical Advisory Committee, May 9, 2022.
This is an image-based copy of the original Keynote slides; builds and animations are flattened.