Colorado SGP Calculation 2021 Growth & Pandemic Academic Impact Damian Betebenner & Adam Van Iwaarden Center for Assessment Colorado Department of Education TAP Meeting September 30th, 2021

Scott

Catching Up with the Colorado TAP • Nice to see you all again. • What a difference two years make. • USED granted testing waivers in 2020 due to the onset of the pandemic in March 2020. • CMAS testing cancelled in spring 2020. • WIDA-ACCESS testing occurred in 2020 Colorado SGP Calculations 2021

Colorado Testing in 2021 • As you are all aware, the pandemic made for a complicated year of testing. • Accountability waivers were granted for states but testing waivers were not universally granted. • Colorado had reduced CMAS testing but had regular PSAT/SAT testing and regular WIDA-ACCESS testing. • CMAS ELA testing in grades 3, 5, 7 • CMAS Mathematics testing in grades 4, 6, 8 • PSAT Mathematics and ELA testing in grade 9 and 10 • SAT Mathematics and ELA testing in grades 11 • WIDA-ACCESS testing in grades Colorado SGP Calculations 2021

Colorado SGP Operational Considerations in 2021 • Colorado CMAS growth analyses are skip-year/gap year growth from 2019 to 2021: • ELA – Grade 3/2019 to Grade/5 2021; Grade 5/2019 to Grade 7/2021 • Mathematics – Grade 4/2019 to Grade 6/2021; Grade 6/2019 to Grade 8/2021. • Colorado WIDA-ACCESS growth analyses are consecutive year growth from 2020 to • In 2021, two types of SGP analyses were conducted for Colorado data: • Cohort referenced analyses: These analyses create growth norms from the 2019 to 2021 students. These growth norms yield cohort means/median SGPs of 50 and obscure COVID- 19 academic impact. • Baseline referenced analyses: Historical growth norms were created using 2019 and prior data. These growth growth analyses don’t have mean/median SGPs of 50 and can be used to investigate overall COVID-19 academic impact. • Projections (lagged and straight) were calculated for 2021 data using baseline growth norms in case they were needed. Colorado SGP Calculations 2021

SGP Summary of Cohort versus Baseline Referenced • Cohort referenced SGPs • Growth norms created from the current cohort of students. • Typical way that SGPs are calculated. • Mean/median will be 50 for all grade x content area analyses. • Cannot investigate overall impact of the pandemic on students. • Can investigate differential impact of the pandemic on students. • Does not require scale stability across years. • Baseline referenced SGPs. • Growth norms created from historical (i.e., pre-COVID) cohorts of students. • Mean/median 50 for historical cohort, not necessarily 50 for current cohort. • Extent of deviation from (usually below) 50 is indicative of less learning/pandemic related academic impact. • A mean SGP deviation of 5 corresponds to an effect size of 0.18. • Can investigate BOTH overall impact and differential impact • Requires scale stability across years. Colorado SGP Calculations 2021

SGP Calculations • SGP calculations were performed using the SGP package and R software environment based upon data supplied by CDE. • To facilitate the calculation of baseline SGPs across multiple states, we created an additional R package, SGPmatrices, that contains Colorado matrices, amongst others. • https://centerforassessment.github.io/SGPmatrices/ • Source code associated with calculations are available on GitHub: • Colorado: https://github.com/CenterForAssessment/Colorado Colorado SGP Calculations 2021

SGP Assumptions • SGP analyses (cohort and baseline referenced) presume valid scale scores • Students forming the growth norm group are presumed to have taken the same (or equivalent) test at the same time. Scores across students in that instance should mean the same thing. • SGPs, however, are often used as a post-hoc check of scale score validity/comparability via Reductio ad absurdum • In 2021, check, for example, form comparability, mode-of-administration comparability, etc. • Colorado has extensive experience (e.g., PARCC paper/pencil versus online) investigating and accommodating mode-effects. • If scores are not comparable then we either attempt to make them comparable or run separate analyses. Colorado SGP Calculations 2021

Scale Score Validity • Prior to the arrival of 2021 test results (across many states), there were pervasive concerns about ”comparability” of results to previous (e.g., 2019). • The term comparability is often used in two different ways: • Comparability of individual scale scores: Does the scale mean the same thing that it used to. • Comparability of aggregate scores (e.g., percent proficient). Is percent proficient (e.g., for a school) comparable to prior years. • Both issues are of relevance. Note that without comparability of individual scale scores, you lose comparability at the aggregate level. • We focus initially on comparability of individual scale scores as that it critical for the calculation of baseline referenced SGPs. Colorado SGP Calculations 2021

Scale Score Validity • Threats to comparability of individual level scores can occur due to numerous conditions including: • Different modes of administration (in person versus remote) • Differential motivation of test takers. • Equating anomalies (e.g., post-equating of results over the course of the pandemic) • Differential test taking conditions including altered/shortened test forms. • We note that lower participation rates in and of themselves are not sufficient to undermine scale score validity unless these conditions can be shown to somehow impact the meaning of student scores. Colorado SGP Calculations 2021

Scale Score Validity • Given plans to calculated baseline referenced SGPs in numerous states, the Center put in place several checks to ensure validity of scale scores. • A priori Checks: • Reviewed results from states/organizations using baseline SGPs • Ran sensitivity analyses to examine to what extent perturbed data impact baseline SGP analyses. • Examined equating and psychometric reports (e.g., person fit statistics) for 2021 to detect anomalous data. • Post-hoc Checks: • Compared results across states to see whether results conform to what is showing up in other states. • Inspected results within state looking for anomalous results which may indicate issues related to scale stability. Colorado SGP Calculations 2021

Baseline referenced SGPs • Baseline referenced SGPs have been calculated in several states as well as with interim assessments over the last decade. • The Georgia Department of Education calculated baseline SGPs and used them as part of their accountability system for 5 years in the early 2010s prior to the assessment transition in 2015. • Baseline SGPs demonstrated excellent stability for grade level assessments. • Goal of using baseline SGPs was to avoid zero-sum game associated with norm- referenced analyses each year. • Renaissance Learning uses baseline matrices to calculate SGPs in real time. • Quantile regression is equivariant to monotone transitions to scale so, in general, robust to minor perturbations of scale. Colorado SGP Calculations 2021

Baseline referenced SGPs • We are not aware of any psychometric concerns regarding the validity of scale scores reported by CDE. • Given that the state reported results to the public in early August, we presume that the psychometrics supported comparisons to 2019 results. • Baseline growth results are consistent with what has been observed in the dozen states we have examined nationally. • In the following slides we report the baseline referenced SGPs. • We also show 2019 SGPs (baseline/skip-year) to illustrate academic impact. Colorado SGP Calculations 2021

SGP Analyses and Academic Impact • Understanding pandemic related impact necessarily requires looking back to pre-pandemic results. • The impulse of stakeholders to want to compare 2021 results with 2019 results is the correct impulse at both the individual, school, district, and state level. • Wanting to look at 2019 to 2021 change is an attempt to investigate impact. • The challenge is making 2019 to 2021 comparisons apples-to-apples comparisons. • Supporting these comparisons requires having a complete understanding is who constitutes the missing data. • This is the second comparability issue discussed earlier. Colorado SGP Calculations 2021

SGP Analyses and Academic Impact • 2019 to 2021 Status and Growth comparisons get at the same thing: deceleration in student learning due to the COVID-19 pandemic “headwind”. • One of the best ”unread” papers on accountability system design and indicators is by Dale Carlson where he discusses the relationship between changes in status (i.e., improvement) and changes in growth (acceleration). https://www.nciea.org/sites/default/files/publications/Dale020 402.pdf • We present (briefly) status results in addition to growth results. Colorado SGP Calculations 2021

CMAS/PSAT/SAT Attainment: 2019 to 2021 Percent Proficient ELA Mathematics Grade % Proficient 2019 % Proficient Difference 2021 to % Proficient 2019 % Proficient 2021 Difference 2021 to (Count/Participation 2021 (Count/Participa 2019 (Count/Participation (Count/Participation 2019 Rate) tion Rate) Rate) Rate) PSAT 9 41.4% (63,043/90.3%) 68.5% (49,811/70.6%) 23.1% 45.6% (63,043/90.3%) 43.0% (49,811/70.6%) -2.6% PSAT 10 42.3% (60,724/88.6%) 69.3% (48,413/70.8%) 27.0% 39.1% (60,724/88.6%) 40.1% (48,413/70.8%) 1.0% SAT 39.0% (57,970/87.6%) 60.0% (51,211/76.0%) 21.0% 39.0% (57,970/87.6%) 36.4% (51,211/76.0%) -2.6% Colorado SGP Calculations 2021

Points of Clarification for Status Results • Decrease in attainment (as a decrease in percent proficient) between 2019 and 2021 is the most often reported statistic related to state testing in 2021. • This analysis & statistic (percent proficient) are problematic. • Using 2019 as a counterfactual for where students would have been had the pandemic not occurred is problematic for several reasons including: • Changes in student cohort composition is not accounted for. • Improvement between 2019 and 2021 that would have occurred is not accounted for. • Missing data in 2021 not accounted for. Colorado SGP Calculations 2021

Points of Clarification for Status Results • Drops in percent proficient are fairly modest compared to what has been observed in other states (ELA high single digit decreases/mathematics low double-digit decreases). • Based upon multiple imputation analyses, decreases observed in percent proficient almost certainly underestimate the true decrease in percent proficient had all students tested. • Participation rates (derived from decreases in observed test scores between 2019 and 2021) vary by grade and state/organization but suggest participation between 60% and 80% (mostly toward the lower end) • In general, current results based upon incomplete data likely represent a best-case scenario compared to what would appear given fuller participation. Colorado SGP Calculations 2021

CMAS/PSAT/SAT: 2019 to 2021 Median Baseline SGPs by Grade ELA Mathematics Grade Median SGP 2019 Median SGP Difference 2021 to Median SGP 2019 Median SGP 2021 Difference 2021 to 3 NA NA NA NA NA NA 4 NA NA NA NA NA NA PSAT 9 50.0 (51,120/73.2%) 44.0 (42,889/59.1%) -6.0 50.0 (48,727/69.8%) 36.0 (42,957/60.9%) -14.0 PSAT 10 50.0 (47,463/69.2%) 47.0 (35,513/60.8%) -3.0 50.0 (35,513/51.8%) 50.0 (40,434/59.1%) 0.0 SAT --- --- --- --- --- --- Colorado SGP Calculations 2021

Discussion • Impacts in mathematics exceeded those in ELA. • Decreases in median SGP in mathematics were, in general, in the lower teens. • Decreases in median SGP in ELA were in, in general, the upper single digits. ELA grade 5 is anomalous for being somewhat small. • The lack of impact in PSAT 10 math is likely due to the fact that the baseline matrices contained a subset of students (PSAT 10/2019 to Math/2017/Grade 8 excluded about 15,000 students who took Algebra I or Geometry in 2017 while in grade 8. • The results are broadly consistent with those found in the dozen other states we’ve analyzed. • Due to the fact that growth is uncorrelated with prior achievement, missing data impacts are much more muted with growth than with status. • In other states we’ve classified academic impacts as: • > -5: Modest to None • -15 to -5: Moderate • < -15: Large Colorado SGP Calculations 2021

WIDA-ACCESS Growth: 2020 to 2021 Median Baseline SGPs Composite Composite Grade Grade Median SGP 2020 Median SGP 2021 Difference 2021 to Median SGP 2020 Median SGP 2021 Difference 2021 to Colorado SGP Calculations 2021

Discussion • Impacts in lower grades much more severe than those in middle schools. • Impacts in high school grades are negligible to non-existent. • Same patterns seen in all other WIDA states we have looked at. • Based upon a presentation by WIDA at NCSA/CCSSO in June, drops are largely attributable to decreases in scores in speaking. • Lack of impact in high school grades likely indicates that typical, pre-pandemic growth represented impoverished rates of learning. Colorado SGP Calculations 2021

CMAS: 2019 to 2021 Median SGPs by Ethnicity ELA Mathematics Ethnicity Median SGP Median SGP Difference 2021 Median SGP Median SGP Difference 2021 2019 2021 to 2019 2019 2021 to 2019 American 45.0 (711) 37.0 (429) -8.0 49.0 (697) 33.0 (377) -16.0 Indian/Alaskan Native Asian 62.0 (3,440) 53.0 (2,382) -9.0 62.0 (3,535) 44.0 (2,335) -18.0 Black/African 44.0 (4,893) 40.0 (2,887) -4.0 45.0 (4,781) 29.0 (2,508) -16.0 American Hispanic/Latino 46.0 (39,279) 38.0 (27,099) -8.0 47.0 (39,720) 31.0 (26,766) -16.0 Pacific Islander 49.0 (240) 41.0 (161) -8.0 45.0 (260) 33.0 (152) -12.0 White 52.0 (58,685) 45.0 (44,028) -7.0 52.0 (55,464) 37.0 (41,139) -15.0 Two or More 51.0 (4,882) 44.0 (3,581) -7.0 49.0 (4,595) 36.0 (3,141) -13.0 Races Colorado SGP Calculations 2021

Discussion of Ethnicity Results • Broken out by ethnicity, 2021 baseline SGP results show similar rank ordering (i.e., growth gaps) as seen in normal years. • Student academic growth is lower in mathematics than in ELA for all ethnic subgroups. • Growth impacts by ethnicity are fairly uniform. Colorado SGP Calculations 2021

CMAS Growth: 2019 to 2021 Median SGPs by Disadvantaged Status ELA Mathematics Free/Reduced Median SGP Median SGP Difference 2021 Median SGP Median SGP Difference 2021 Lunch Status 2019 2021 to 2019 2019 2021 to 2019 No 53.0 (64,111) 46.0 (50,336) -7.0 53.0 (62,510) 38.0 (48,114) -15.0 Yes 46.0 (48,008) 38.0 (30,215) -8.0 46.0 (46,526) 30.0 (28,285) -16.0 Colorado SGP Calculations 2021

Discussion of disadvantaged status • Baseline SGP results show similar growth gaps in 2021 (students indicated as receiving free/reduced lunch have lower SGPs than students indicated as not receiving free/reduced lunch. • Academic impacts are uniform across the subgroups. Colorado SGP Calculations 2021

CMAS Growth: 2019 to 2021 Median SGPs by Gender ELA Mathematics Gender Median SGP Median SGP Difference 2021 Median SGP Median SGP Difference 2021 2019 2021 to 2019 2019 2021 to 2019 Female 55.0 (54,606) 45.0 (38,864) -10.0 52.0 (52,913) 36.0 (36,362) -16.0 Male 46.0 (57,534) 41.0 (41,706) -5.0 49.0 (56,143) 34.0 (40,060) -15.0 Colorado SGP Calculations 2021

Discussion of Gender Results • Growth gender gaps historically exist (favoring females) in both ELA and mathematics. • Growth gender gaps are historically larger in ELA than mathematics. • Gaps are similarly large in math, but smaller for males in ELA than for females. Colorado SGP Calculations 2021

CMAS Growth: 2019 to 2021 Median SGPs by IEP Status ELA Mathematics IEP Status Median SGP Median SGP Difference 2021 Median SGP Median SGP Difference 2021 2019 2021 to 2019 2019 2021 to 2019 IEP No 51.0 (100,268) 43.0 (71,454) -8.0 51.0 (98,272) 35.0 (68,240) -16.0 IEP Yes 41.0 (11,872) 39.0 (9,116) -2.0 43.0 (10,784) 34.0 (8,182) -9.0 Colorado SGP Calculations 2021

Discussion of IEP Status Results • IEP status gaps historically exist and favor non-IEP students in both ELA and mathematics. • Gaps in 2021 were substantially larger for non-IEP students than for IEP students. • Potential explanation include: • Concerted effort to educate IEP students during the pandemic thus minimizing the academic impact to that group of students. • Impoverished growth rates pre-pandemic such that pandemic impacts didn’t substantially change rates of learning. Colorado SGP Calculations 2021

Academic Impact by Prior Achievement • In examining results associated with SGP fit, we discovered that growth and associated impact varied considerably based upon the prior achievement of the student. • The following slides illustrate these differences. • The appendix contains additional figures looking at growth by prior score decile by ethnicity. Colorado SGP Calculations 2021

Colorado Median/Mean Skip-Year SGPs by Prior Achievement: Grade 5 ELA Colorado SGP Calculations 2021

Colorado Median/Mean Skip-Year SGPs by Prior Achievement: Grade 7 ELA Colorado SGP Calculations 2021

Colorado Median/Mean Skip-Year SGPs by Prior Achievement: Grade 6 Mathematics Colorado SGP Calculations 2021

Colorado Median/Mean Skip-Year SGPs by Prior Achievement: Grade 8 Mathematics Colorado SGP Calculations 2021

Academic Impact by School and District • Here we present some preliminary finding when examining academic impact at the school and district level. • Because of the reduced testing in Colorado, results are presented at the school x grade and district x grade level. • Growth is less impacted by missing data than status, but caution should be exercised in interpretations especially with substantial missing data for the school or district. • We are finalizing multiple imputation results that can be used to better understand the impact of missing data for schools and districts. Colorado SGP Calculations 2021

Participation Rates and Interpretation • An issue impacting the interpretation of growth (and status) results in 2021 is participation in the state assessment. • Low participation doesn’t impact calculation of cohort referenced growth norms nor use of baseline referenced growth norms. • Low participation does impact comparisons of group level results with historical (e.g., 2019) results based upon higher participation rates. • For example, how should one compare growth and status results for school in 2019 and 2021 with very different rates of participation. Colorado SGP Calculations 2021

Multiple Imputation • Given the rich historical data available for students missing in 2021, and the observed performance of comparable students from 2019 to 2021, it is possible to simulate what we think their performance might have been. • Combining multiple simulations can inform us about potential bias in what we observed at state/district/school levels in 2021, as well as inform us about levels of uncertainty around them. • Multiple imputation (MI) of missing data is widely adopted and well-developed statistical analysis technique used in many fields to deal with missing data problems. Colorado SGP Calculations 2021

Multiple Imputation • MI uses information from the observed data to generate parameter estimates in three steps: • Imputation: A prediction model generates a set of plausible values for the missing observations, resulting in M imputed data sets. • Analysis: The analysis (e.g., baseline student growth percentiles) is conducted on each of the M data sets. • Pooling: Parameter and (more importantly) uncertainty estimates are constructed by pooling across the M analyses. Colorado SGP Calculations 2021

Multiple Imputation • In the context of COVID impact analyses, we use the multiple (plausible) parameter estimates to inform us about the uncertainty around what was observed. That is, we are more interested in using MI to determine whether we trust the statistics calculated from the observed (with missing) data than to produce “corrected” parameter estimates. • Statistics of particular interest: • Mean/median scale scores • Mean/median baseline SGPs • Effect size estimates • Percent Proficient Colorado SGP Calculations 2021

Multiple Imputation • Before performing a MI analysis with Colorado data, missing data patterns were investigated. • Patterns suggest some relationship to factors such economic status and ethnicity. • The relationship with prior achievement is relatively small. • These relationships suggest that missingness in Colorado is non- ignorable, but does not preclude the use of MI. • Data can be considered “Missing-at-random” – relationships exist between missingness and the observed data (and so can not be considered “missing completely-at-random”) but the relationships are not systematic (e.g. all students below proficiency in 2019 were missing in 2021). Colorado SGP Calculations 2021

Missing Data Patterns Colorado SGP Calculations 2021

This plot shows patterns of missingness by the intersection of prior achievement levels and economic status. The blue bars represent students who were present in 2021 and the red bars are the students who were missing. This plot suggest that a (slightly) higher proportion of students with lower prior achievement are missing, and that students receiving free/reduced lunch are also more likely to be missing regardless of prior achievement.

Missing Data Patterns Colorado SGP Calculations 2021

This plot shows missingness for students who were enrolled, but did not test (on the left). This includes all grades and content areas combined. The blue bars are the prior scores for students who were present in the year of interest (2019 or 2021), and the red bars are the prior scores for students who were missing in the year of interest.

The top two histograms are 2019 missingness, provided for context. The first row is 2018 to 2019 missingness (a typical year), and the second row is for 2017 to 2019 (skip year). The bottom row, showing 2021, suggest that missingness was far more prevalent last year. It also shows that missing students tend to have slightly lower prior achievement, but this is not entirely systematic (i.e. it is not ONLY the lowest achieving students) – missingness basically follows the distribution of non-missing.

Missing Data Patterns Colorado SGP Calculations 2021

This plot is for Grade 5 ELA. The green line added in these plots is the proficiency cutpoint, which helps show that both observed and missingness are nearly equally distributed above and below proficiency, with slightly more below proficiency and near the LOSS.

Missing Data Patterns Colorado SGP Calculations 2021

This plot is for Grade 6 Mathematics. The green line added in these plots is the proficiency cutpoint, which helps show that both observed and missingness are concentrated below proficiency. However, the pattern of missingness generally follows the pattern of observed – there does not appear to be a strong systematic relationship between prior achievement and missingness in 2021.

Multiple Imputation • Given the 2021 missingness patterns and the good coverage of observed scores for students from all demographic groups and prior achievement levels, MI is a reasonable approach to dealing with CMAS missing data. • Imputation models included: • Student prior achievement • Student demographics • FRL Status • Disability status • English language proficiency status • Gender • Ethnicity dummy variables for White, African American, Hispanic and Asian students • School level clustering • 30 imputations (M = 30 with a maximum of 10 iterations per imputation) were conducted. Colorado SGP Calculations 2021

Multiple Imputation • Imputation models were restricted to include only students who were enrolled, but not tested. • Knowing school/district affiliation is critical for assessing the impact of missing data for subsequent analyses at these levels. • Excluding students who “disappeared” from the system may not give us a full account of the impact of missing data at the state level. However, a comparison of the enrolled vs. non-enrolled missing students does not lead us to believe their inclusion would meaningfully change inferences at the state level. Colorado SGP Calculations 2021

Multiple Imputation Density SCALE_SCORE.2021 Colorado SGP Calculations 2021

This is an example diagnostic plot from the MI of 5th grade ELA. It shows that the distribution of the imputations is shifted lower than the observed (blue) distribution, but that scores were imputed across the entire distribution. Furthermore there was general agreement from the imputation models about what the “plausible” distribution of missing scores would have been.

Multiple Imputation Density SCALE_SCORE.2021 Colorado SGP Calculations 2021

This is an example diagnostic plot from the MI of 6th grade mathematics. It shows that the distribution of the imputations is shifted lower than the observed (blue) distribution, but that scores were imputed across the entire distribution. The math imputation diagnostics suggest even greater impact in math than ELA than what was already observed. Again there was general agreement from the imputation models about what the “plausible” distribution of missing scores would have been.

7th grade ELA and 8th grade math suggest smaller “plausible” differences between observed and missing (MI distributions mirror the observed even more closely than 5th grade ELA and 6th grade math).

District & School Level Results • Due to larger fluctuations in participation rates at the district and school level, growth comparisons between 2019 and 2021 must be approached more cautiously. • In general, in other states we have had good success via multiple imputation that comparisons of status and growth results from 2019 to • Multiple imputation indicates both when inference is defensible based upon observed data and when such an inference appears problematic. • We have found that whether a school’s results support cross-year comparison depends more on the size of the school than on the participation rate/enrollment change. • With coming enrollment data to determine missingness, we will update results to include district and school level impact. Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 7 ELA 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 10.5% Higher Growth School Size 50 Students 100 Students 9.3% 16.5% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 7 ELA 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 22.8% Higher Growth School Size 50 Students 100 Students 25.6% 26.1% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 7 ELA 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 33.3% Higher Growth School Size 50 Students 100 Students 37.2% 33.9% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 7 ELA 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 27.6% Higher Growth School Size 50 Students 100 Students 25.6% 15.7% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 7 ELA 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 5.9% Higher Growth School Size 50 Students 100 Students 2.3% 7.8% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 8 Mathematics 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 10.8% Higher Growth School Size 50 Students 100 Students 13.3% 13% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 8 Mathematics 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 15.1% Higher Growth School Size 50 Students 100 Students 6.7% 24.1% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 8 Mathematics 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 30% Higher Growth School Size 50 Students 100 Students 46.7% 25.9% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 8 Mathematics 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 28.6% Higher Growth School Size 50 Students 100 Students 33.3% 22.2% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Grade by School Level COVID Academic Impact CMAS: Grade 8 Mathematics 2019 Growth by Achievement Higher Achievement Higher Achievement Lower Growth 15.4% Higher Growth School Size 50 Students 100 Students 0% 14.8% 250 Students 500 Students 2019 Percent Proficient COVID Impact 2021 SGP − 2019 SGP Improvement (> 5) 40 Modest to None (−5 to 5) Moderate (−15 to −5) Large (−25 to −15) Achievement Severe (< −25) Lower Growth Higher Growth Lower Achievement Lower Achievement Growth 2019 Median Student Growth Percentile Colorado SGP Calculations 2021

Communication of Results in 2021 • Technical challenges to the calculation of growth in 2021 are likely minor compared to communication challenges. • State reporting is, in general, highly aligned with accountability. • Even though analyses outlined herein deal with status/growth, they don’t necessarily align with accountability narratives. • It is critical for leadership (at the highest level) to map out a communication plan and then build analytics and reporting to support that plan. • Without a well considered, disciplined and coordinated communication plan, accountability narratives are likely to take over. Colorado SGP Calculations 2021

SGP Analysis Plans post 2021 (2022 and beyond) • Spring 2021 represented an ideal time to get a snapshot of student attainment as we are presumably/hopefully at or near the point of maximal impact on student attainment. • That is, recovery has not really begun for most students in earnest. • It’s impossible to talk about recovery sensibly without understanding how big the impact is. • Analytics in 2022 will be keenly interested about whether recovery is occurring: Who, what, how much. • Because of CMAS content x grade coverage in 2021, growth will be limited in 2022. • Monitoring recovery will be at least as critical as monitoring the impact of the pandemic on student achievement. • Beware the K-shaped recovery! Colorado SGP Calculations 2021

Summary of Findings • SGP analyses were successfully conducted for Colorado CMAS/PSAT/SAT/WIDA- ACCESS testing in spring 2021 • For the CMAS, results of the analyses suggest moderate academic impacts in ELA and large academic impacts in mathematics due to the pandemic. • For WIDA-ACCESS, academic impact was large in elementary grades, moderate in middle school grades, and no academic impact was indicated in the high school grades (likely due to the fact that pre-pandemic growth was already impoverished for high school students). • Though CMAS testing is half of what it usually is, results suggest uniform impactby content area across elementary, middle and high school. • Results show variation across academic subgroups (e.g., high versus low achievers in some content areas). • Recovery from impacts this large will likely take multiple years and require additional supports beyond that provided by normal schooling. Colorado SGP Calculations 2021

SGP Goodness of Fit Plots: Colorado ELA Student Growth Percentile Goodness−of−Fit Descriptives Student Growth Percentile Goodness−of−Fit Descriptives 2021 ELA SGP, Grade 7 (N = 39,035) 2021 ELA SGP, Grade 5 (N = 41,535) SGP Deciles by Prior Achievement Level (ELA) SGP Deciles by Prior Achievement Level (ELA) Level 5 (6.3%) Level 5 (4.7%) Prior Achievement Level Prior Achievement Level Level 4 (37.8%) Level 4 (43.5%) Level 3 (23.2%) Level 3 (25.4%) Level 2 (18%) Level 2 (16.3%) Level 1 (16.2%) Level 1 (8.6%) Median Student Growth Percentile Median Student Growth Percentile Ceiling / Floor Effects Test Ceiling / Floor Effects Test Student Growth Percentile Range Student Growth Percentile Range Current Observed Score Current Observed Score 5 9 to to to to to to to to to to 19 29 39 49 59 69 79 89 94 99 to to 10 20 30 40 50 60 70 80 90 95 5 9 to to to to to to to to to to 1 5 to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [ 650 ] 100.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 98 Extremes (Range) Lowest OSS: [ 650 ] 98.9 1.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 182 Extremes (Range) Highest OSS: [840,849) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 19.2 15.4 65.4 N = 26 Highest OSS: [ 850 ] 0.0 0.0 0.0 0.0 0.0 0.0 4.6 7.7 9.2 12.3 21.5 44.6 N = 65 [849,850] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 35.7 64.3 N = 28 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1 to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[650,702) 10.67 11.40 11.69 10.61 10.86 9.69 9.29 10.05 8.83 6.91 (9.5%) 100 1st/[650,688) 5.77 8.25 8.79 9.13 10.08 11.78 11.90 12.34 11.73 10.22 (9.9%) 100 2nd/[702,718) 10.97 11.36 10.92 11.96 10.79 10.84 10.82 9.00 8.12 5.21 (9.9%) 2nd/[688,706) 9.50 9.78 11.61 10.38 11.10 12.16 9.98 8.47 9.04 7.99 (10%) Prior Scale Score Decile/Range * Prior Scale Score Decile/Range * 3rd/[718,730) 10.30 11.98 12.50 12.50 11.70 10.14 9.96 7.99 7.37 5.55 (9.9%) 3rd/[706,719) 11.38 11.17 12.09 10.51 11.15 10.43 8.95 8.67 7.91 7.73 (9.4%) Empirical SGP Distribution Empirical SGP Distribution 4th/[730,740) 9.93 13.72 12.86 12.34 11.46 10.04 9.47 8.12 6.64 5.42 (9.9%) 4th/[719,731) 11.23 11.39 11.11 9.66 10.11 10.39 9.90 9.71 7.94 8.56 (10.1%) 5th/[740,749) 10.71 14.97 12.93 12.68 10.84 9.26 8.95 7.04 7.12 5.51 (10%) 5th/[731,742) 12.32 11.15 10.60 9.93 9.54 9.93 9.84 9.11 8.74 8.85 (10.5%) 6th/[749,758) 12.67 14.08 13.63 11.86 10.47 9.87 8.07 7.72 6.96 4.67 (10.2%) 6th/[742,752) 12.65 11.03 10.93 9.87 9.36 9.00 9.77 9.49 9.33 8.56 (9.4%) 7th/[758,767) 13.32 13.47 12.95 10.19 10.26 10.31 8.93 8.53 7.10 4.94 (10.2%) 7th/[752,763) 12.23 10.57 11.38 9.61 10.45 10.09 8.94 8.70 9.25 8.78 (10.1%) 8th/[767,777) 13.68 13.42 12.78 10.55 10.45 10.75 8.06 7.62 6.88 5.80 (10%) 8th/[763,776) 12.73 10.95 10.47 9.91 11.23 10.97 9.52 9.77 7.59 6.85 (10.4%) 9th/[777,791) 15.79 12.05 12.49 10.65 10.04 9.70 7.43 9.26 7.11 5.47 (10.5%) 9th/[776,793) 13.47 11.36 9.95 11.36 10.74 9.58 9.95 9.48 7.77 6.33 (9.7%) 10th/[791,850] 17.35 15.02 11.18 9.98 9.90 9.01 9.11 6.83 6.53 5.09 (10%) 10th/[793,850] 15.48 13.86 11.52 11.81 10.76 8.98 7.60 8.20 6.77 5.02 (10.5%) *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Colorado SGP Calculations 2021

SGP Goodness of Fit Plots: Colorado Mathematics Student Growth Percentile Goodness−of−Fit Descriptives Student Growth Percentile Goodness−of−Fit Descriptives 2021 Mathematics SGP, Grade 8 (N = 35,647) 2021 Mathematics SGP, Grade 6 (N = 40,775) SGP Deciles by Prior Achievement Level (Mathematics) SGP Deciles by Prior Achievement Level (Mathematics) Level 5 (4.5%) Level 5 (3.2%) Level 4 Prior Achievement Level Prior Achievement Level (27.5%) Level 4 (32.6%) Level 3 (28.4%) Level 3 (27.4%) Level 2 (26.4%) Level 2 (23.4%) Level 1 (13.1%) Level 1 (13.4%) Median Student Growth Percentile Median Student Growth Percentile Ceiling / Floor Effects Test Ceiling / Floor Effects Test Student Growth Percentile Range Student Growth Percentile Range Current Observed Score Current Observed Score 5 9 to to to to to to to to to to 19 29 39 49 59 69 79 89 94 99 to to 10 20 30 40 50 60 70 80 90 95 5 9 to to to to to to to to to to 1 5 to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [ 650 ] 100.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 407 Extremes (Range) Lowest OSS: [ 650 ] 80.7 16.8 2.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 322 Extremes (Range) Highest OSS: [832,840) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 20.8 25.0 54.2 N = 24 Highest OSS: [ 850 ] 0.0 0.0 0.0 0.0 0.0 0.0 4.9 3.9 10.8 16.7 15.7 48.0 N = 102 [840,850] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 7.4 18.5 74.1 N = 27 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1 to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[650,695) 7.20 8.06 11.81 10.95 12.19 10.25 11.54 11.28 9.21 7.50 (9.5%) 100 1st/[650,695) 21.57 13.91 11.33 10.05 9.84 9.14 7.53 6.50 5.12 5.00 (9.8%) 100 2nd/[695,707) 7.49 10.28 12.53 12.45 12.56 10.50 11.42 9.03 7.88 5.85 (10.1%) 2nd/[695,708) 23.89 14.80 11.16 10.39 8.59 7.17 6.69 6.45 5.68 5.17 (10.2%) Prior Scale Score Decile/Range * Prior Scale Score Decile/Range * 3rd/[707,716) 9.85 11.28 13.94 12.22 12.76 11.10 10.27 7.99 5.98 4.62 (9.5%) 3rd/[708,718) 21.00 15.26 10.86 9.88 8.78 7.77 8.01 6.59 6.07 5.77 (9.5%) Empirical SGP Distribution Empirical SGP Distribution 4th/[716,725) 11.97 13.44 15.23 12.48 12.24 10.66 7.35 7.00 5.29 4.33 (10.5%) 4th/[718,727) 19.99 13.17 11.79 9.74 8.53 8.61 8.28 7.07 7.10 5.72 (9.6%) 5th/[725,733) 13.37 16.45 14.40 11.84 11.39 9.19 7.23 7.02 5.21 3.92 (9.3%) 5th/[727,736) 18.82 12.73 11.74 10.15 9.39 9.66 8.49 6.88 6.29 5.84 (9.9%) 6th/[733,742) 16.94 16.41 14.09 11.18 10.19 9.47 6.70 6.50 4.29 4.23 (10.1%) 6th/[736,746) 18.93 13.32 11.54 10.29 9.62 8.46 8.53 7.57 6.28 5.46 (11%) 7th/[742,751) 18.83 18.50 14.30 10.30 9.66 7.04 6.90 5.57 4.73 4.17 (10%) 7th/[746,755) 19.18 13.88 12.07 10.11 9.44 9.00 6.77 7.34 5.89 6.31 (9.5%) 8th/[751,762) 20.46 15.74 12.91 10.77 8.93 7.31 6.89 6.73 4.86 5.39 (10.6%) 8th/[755,765) 21.66 15.18 11.90 10.49 8.35 8.80 7.06 6.18 4.99 5.37 (9.7%) 9th/[762,775) 18.97 15.06 12.26 11.46 9.99 8.46 7.13 6.19 5.44 5.05 (10.1%) 9th/[765,779) 21.32 15.04 11.20 9.64 8.39 7.88 7.36 6.51 6.06 6.60 (10.4%) 10th/[775,850] 19.17 15.47 10.02 10.95 8.80 8.22 7.57 7.60 6.54 5.66 (10.3%) 10th/[779,850] 22.50 13.98 11.32 9.09 8.45 7.34 7.37 6.21 7.51 6.21 (10.4%) *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Colorado SGP Calculations 2021

Colorado Covid Academic Impact Analyses: ELA Grade 5 Pre−Covid (2019) Results Covid (2021) Results Covid Impact (2021 − 2019) Results Growth by Prior Median SGP: 50 Median SGP: 46 Median SGP Difference: −4 Mean Scale Score: 748 Mean Scale Score: 747 Mean Scale Score Difference: −1 Percent Proficient: 49.7% SGP Count: 57083 Percent Proficient: 48.2% SGP Count: 41535 Percent Proficient Difference: −1.5% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Score Decile & 1st/[650,684) 9.46 10.09 9.96 10.24 9.87 10.02 9.89 9.94 9.89 10.65 9.4%/50 1st/[650,688) 5.77 8.25 8.79 9.13 10.08 11.78 11.90 12.34 11.73 10.22 9.9%/57 7 Full Population 2nd/[684,703) 9.34 9.90 10.70 9.59 10.60 10.22 10.19 9.64 10.10 9.71 10.3%/49 2nd/[688,706) 9.50 9.78 11.61 10.38 11.10 12.16 9.98 8.47 9.04 7.99 10%/48 −1 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[703,717) 9.62 9.82 9.44 9.91 9.24 10.29 10.12 10.18 10.27 11.11 10.2%/51 3rd/[706,719) 11.38 11.17 12.09 10.51 11.15 10.43 8.95 8.67 7.91 7.73 9.4%/44 −7 4th/[717,729) 9.60 10.34 9.81 10.33 10.42 9.47 10.21 9.70 9.79 10.33 9.2%/49 4th/[719,731) 11.23 11.39 11.11 9.66 10.11 10.39 9.90 9.71 7.94 8.56 10.1%/46 −3 5th/[729,740) 9.33 9.97 10.49 10.02 9.93 10.10 9.85 10.07 9.93 10.32 10.5%/50 5th/[731,742) 12.32 11.15 10.60 9.93 9.54 9.93 9.84 9.11 8.74 8.85 10.5%/46 −4 Ethnicity: 6th/[740,751) 9.82 10.46 9.72 9.57 10.17 10.39 9.84 9.55 9.89 10.58 10.2%/50 6th/[742,752) 12.65 11.03 10.93 9.87 9.36 9.00 9.77 9.49 9.33 8.56 9.4%/46 −4 7th/[751,761) 9.29 9.60 10.21 10.14 10.01 9.36 10.25 10.56 10.09 10.48 9.7%/50 7th/[752,763) 12.23 10.57 11.38 9.61 10.45 10.09 8.94 8.70 9.25 8.78 10.1%/45 −5 8th/[761,774) 9.65 10.15 9.86 10.09 10.16 10.04 9.79 9.93 10.04 10.29 9.8%/50 8th/[763,776) 12.73 10.95 10.47 9.91 11.23 10.97 9.52 9.77 7.59 6.85 10.4%/45 −5 9th/[774,791) 9.90 9.89 10.29 9.56 9.97 10.13 9.71 9.97 9.84 10.75 10.8%/50 9th/[776,793) 13.47 11.36 9.95 11.36 10.74 9.58 9.95 9.48 7.77 6.33 9.7%/43 −7 10th/[791,850] 9.25 9.97 9.88 10.39 9.97 9.70 10.14 10.19 10.09 10.42 10%/50 10th/[793,850] 15.48 13.86 11.52 11.81 10.76 8.98 7.60 8.20 6.77 5.02 10.5%/37 −13 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution ELA - Grade 5 Median SGP: 45 Median SGP: 39.5 Median SGP Difference: −5.5 Mean Scale Score: 734 Mean Scale Score: 734 Mean Scale Score Difference: 0 Percent Proficient: 32.1% SGP Count: 2554 Percent Proficient: 31.1% SGP Count: 1548 Percent Proficient Difference: −1% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to African American 1st/[650,684) 10.80 8.51 10.80 12.87 8.51 8.74 10.34 8.74 11.03 9.66 17%/49 1st/[650,688) 6.20 10.08 8.91 11.24 8.53 10.47 12.02 10.85 10.08 11.63 16.7%/55 6 2nd/[684,703) 11.01 12.65 10.77 8.90 9.37 8.90 8.43 8.90 11.94 9.13 16.7%/46 2nd/[688,706) 9.09 10.91 11.36 8.64 12.27 15.00 7.73 10.00 10.00 5.00 14.2%/48 2 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[703,717) 12.77 10.33 7.60 8.21 11.85 11.25 8.51 9.73 9.73 10.03 12.9%/49 3rd/[706,719) 16.84 14.74 10.53 7.37 11.05 9.47 9.47 7.37 4.74 8.42 12.3%/41 −8 4th/[717,729) 11.40 11.76 10.66 13.97 11.03 8.82 7.35 8.82 7.35 8.82 10.6%/41 4th/[719,731) 18.34 13.02 12.43 8.88 9.47 8.88 7.10 10.65 5.92 5.33 10.9%/37 −4 5th/[729,740) 9.50 13.22 7.02 9.50 12.40 9.92 12.40 9.92 8.26 7.85 9.5%/48.5 5th/[731,742) 19.53 14.20 11.83 8.28 9.47 9.47 11.83 4.73 6.51 4.14 10.9%/35 −13.5 6th/[740,751) 13.94 13.94 12.98 10.58 8.65 11.06 7.69 8.65 8.17 4.33 8.1%/37 6th/[742,752) 13.89 13.89 13.89 9.72 9.03 8.33 9.72 6.94 6.94 7.64 9.3%/38 1 7th/[751,761) 16.07 7.59 12.50 12.50 8.48 9.82 6.70 12.05 6.70 7.59 8.8%/42.5 7th/[752,763) 21.19 7.63 13.56 14.41 5.08 9.32 8.47 7.63 8.47 4.24 7.6%/33.5 −9 8th/[761,774) 10.13 15.19 13.29 7.59 5.70 10.13 7.59 12.66 9.49 8.23 6.2%/45 8th/[763,776) 21.67 14.17 10.83 10.83 11.67 9.17 5.00 11.67 1.67 3.33 7.8%/33 −12 9th/[774,791) 13.89 11.81 13.19 6.94 9.72 8.33 12.50 8.33 6.94 8.33 5.6%/43 9th/[776,793) 25.00 14.13 14.13 9.78 8.70 7.61 5.43 8.70 5.43 1.09 5.9%/26 −17 10th/[791,850] 18.26 16.52 10.43 11.30 7.83 11.30 8.70 4.35 4.35 6.96 4.5%/34 10th/[793,850] 32.35 20.59 10.29 10.29 5.88 4.41 8.82 1.47 1.47 4.41 4.4%/17 −17 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 60 Median SGP: 51 Median SGP Difference: −9 Mean Scale Score: 761 Mean Scale Score: 758 Mean Scale Score Difference: −3 Percent Proficient: 66.8% SGP Count: 1721 Percent Proficient: 62.7% SGP Count: 1226 Percent Proficient Difference: −4.09999999999999% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to 1st/[650,684) 10.38 6.60 6.60 9.43 7.55 14.15 14.15 9.43 6.60 15.09 6.2%/54 1st/[650,688) 1.16 5.81 9.30 15.12 8.14 12.79 15.12 12.79 10.47 9.30 7%/59 5 2nd/[684,703) 8.62 5.17 6.03 13.79 4.31 12.07 8.62 12.07 14.66 14.66 6.7%/59.5 2nd/[688,706) 10.20 8.16 7.14 6.12 14.29 9.18 8.16 9.18 13.27 14.29 8%/54.5 −5 Asian Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[703,717) 7.07 3.03 8.08 8.08 5.05 8.08 15.15 15.15 12.12 18.18 5.8%/67 3rd/[706,719) 5.15 7.22 8.25 12.37 12.37 7.22 5.15 10.31 16.49 15.46 7.9%/56 −11 4th/[717,729) 9.23 3.08 6.15 13.08 9.23 8.46 9.23 8.46 13.85 19.23 7.6%/61.5 4th/[719,731) 8.79 7.69 6.59 12.09 5.49 16.48 9.89 13.19 6.59 13.19 7.4%/56 −5.5 5th/[729,740) 6.25 7.50 6.25 8.12 10.62 7.50 13.75 9.38 13.75 16.88 9.3%/62 5th/[731,742) 8.65 15.38 13.46 6.73 4.81 9.62 5.77 10.58 10.58 14.42 8.5%/50.5 −11.5 6th/[740,751) 4.76 8.47 6.35 7.94 10.58 12.17 11.64 13.76 10.58 13.76 11%/59 6th/[742,752) 9.84 9.02 2.46 9.84 7.38 10.66 13.93 13.11 9.02 14.75 10%/63 4 7th/[751,761) 4.76 4.23 5.82 10.05 8.47 8.99 13.76 15.34 11.11 17.46 11%/66 7th/[752,763) 7.83 13.04 8.70 13.04 8.70 13.04 7.83 8.70 9.57 9.57 9.4%/48 −18 8th/[761,774) 5.05 9.09 8.59 11.11 9.60 12.63 10.10 7.58 12.12 14.14 11.5%/55 8th/[763,776) 8.27 9.02 11.28 8.27 12.78 17.29 7.52 9.02 9.77 6.77 10.8%/50 −5 9th/[774,791) 5.86 5.44 7.11 8.79 10.46 12.97 15.06 8.37 14.64 11.30 13.9%/58 9th/[776,793) 11.18 8.70 6.83 9.32 14.91 11.18 8.07 15.53 6.21 8.07 13.1%/49 −9 10th/[791,850] 6.78 8.14 11.53 11.53 7.12 8.14 8.81 12.20 14.24 11.53 17.1%/56 10th/[793,850] 10.50 12.79 11.42 10.96 12.79 10.05 9.59 8.68 7.76 5.48 17.9%/42 −14 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 45 Median SGP: 39 Median SGP Difference: −6 Mean Scale Score: 735 Mean Scale Score: 732 Mean Scale Score Difference: −3 Percent Proficient: 32.6% SGP Count: 19616 Percent Proficient: 28.4% SGP Count: 13525 Percent Proficient Difference: −4.2% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Hispanic or Latino 1st/[650,684) 9.32 10.41 9.88 10.68 10.25 10.25 9.72 10.28 10.15 9.06 15.5%/49 1st/[650,688) 6.85 8.71 9.06 9.19 10.83 12.00 12.18 12.65 10.75 7.80 17.1%/54 5 2nd/[684,703) 10.06 10.26 11.78 9.37 10.69 10.79 10.23 9.96 9.30 7.56 15.5%/48 2nd/[688,706) 10.95 11.73 13.49 11.59 11.10 12.41 10.56 6.91 6.04 5.21 15.2%/42 −6 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[703,717) 10.21 10.58 10.51 10.07 9.33 10.98 10.29 9.99 8.78 9.26 13.9%/49 3rd/[706,719) 13.42 13.24 13.42 11.28 11.10 10.82 8.10 7.92 6.30 4.40 12.8%/38 −11 4th/[717,729) 10.93 10.98 11.87 10.83 11.30 8.53 10.83 9.56 7.96 7.21 10.8%/44 4th/[719,731) 14.96 12.86 13.37 10.77 10.58 10.01 9.44 7.16 5.51 5.32 11.7%/37 −7 5th/[729,740) 10.71 10.90 12.14 10.85 10.48 9.38 9.06 9.38 9.24 7.86 11.1%/44 5th/[731,742) 16.34 13.50 12.49 10.87 9.39 9.72 8.64 7.36 6.41 5.27 11%/37 −7 6th/[740,751) 11.68 13.39 11.07 9.64 10.47 10.69 9.26 7.99 8.26 7.55 9.3%/43 6th/[742,752) 17.43 15.23 13.03 9.68 10.21 8.54 8.19 6.87 6.51 4.31 8.4%/33 −10 7th/[751,761) 12.28 11.80 12.49 9.72 10.55 10.20 8.67 9.65 7.56 7.08 7.3%/43 7th/[752,763) 18.74 14.40 12.17 11.50 11.88 8.89 7.05 5.60 6.28 3.48 7.7%/33 −10 8th/[761,774) 13.48 12.17 10.86 10.17 9.32 10.09 9.63 7.78 8.55 7.94 6.6%/44 8th/[763,776) 21.53 14.46 11.05 11.50 11.39 8.88 7.52 6.72 3.30 3.64 6.5%/32 −12 9th/[774,791) 13.75 12.32 11.40 10.65 9.72 9.56 8.21 8.89 7.04 8.47 6.1%/41 9th/[776,793) 21.56 15.69 11.60 10.50 9.55 7.91 7.50 6.55 5.87 3.27 5.4%/30 −11 10th/[791,850] 14.43 13.28 11.11 11.11 10.22 9.96 8.43 9.45 6.51 5.49 4%/40 10th/[793,850] 23.95 16.19 12.82 11.64 7.93 8.77 5.06 6.07 4.22 3.37 4.4%/27 −13 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 53 Median SGP: 49 Median SGP Difference: −4 Mean Scale Score: 757 Mean Scale Score: 756 Mean Scale Score Difference: −1 Percent Proficient: 61% SGP Count: 30076 Percent Proficient: 60% SGP Count: 22975 Percent Proficient Difference: −1% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to 1st/[650,684) 9.63 10.34 9.89 8.29 9.89 9.51 9.57 10.02 9.70 13.17 5.2%/52 1st/[650,688) 3.95 7.59 8.54 8.38 8.62 11.23 10.83 12.02 14.23 14.62 5.5%/62 10 2nd/[684,703) 7.72 9.06 9.26 9.51 11.35 9.51 10.21 9.56 11.01 12.80 6.7%/53 2nd/[688,706) 7.83 7.01 9.55 9.24 10.64 11.66 9.75 10.51 12.36 11.46 6.8%/54 1 White Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[703,717) 8.69 8.98 8.65 9.57 8.94 9.91 10.04 10.12 11.77 13.33 7.9%/55 3rd/[706,719) 8.82 8.76 11.11 9.82 11.29 10.23 9.94 9.70 9.70 10.64 7.4%/50 −5 4th/[717,729) 8.43 10.20 8.19 9.09 9.87 10.20 9.95 10.20 11.15 12.71 8.1%/54 4th/[719,731) 7.78 10.51 9.63 9.03 10.00 10.56 10.32 11.30 9.77 11.11 9.4%/52 −2 5th/[729,740) 8.31 9.02 9.51 9.83 9.51 10.84 10.16 10.55 10.16 12.11 10.2%/53 5th/[731,742) 9.22 9.56 9.48 9.48 10.07 10.24 10.74 10.32 9.98 10.91 10.3%/52 −1 6th/[740,751) 8.58 9.04 8.92 9.80 9.80 10.36 10.29 10.32 10.78 12.10 10.9%/54 6th/[742,752) 10.26 8.65 10.34 10.13 9.39 9.04 10.34 10.95 10.73 10.17 10%/51 −3 7th/[751,761) 7.85 9.09 9.24 10.16 10.04 9.00 11.23 10.79 11.11 11.47 11.2%/53 8th/[761,774) 8.43 8.92 9.39 10.25 10.55 10.08 10.08 10.80 10.44 11.05 12%/52 Colorado SGP Calculations 2021 7th/[752,763) 9.49 9.08 11.33 8.71 10.32 10.58 9.57 9.87 10.62 10.43 11.6%/51 8th/[763,776) 10.28 9.80 9.97 9.53 11.06 11.20 10.52 10.72 8.92 8.00 12.8%/49 9th/[774,791) 8.84 9.10 10.21 9.55 10.00 10.31 9.88 10.52 10.28 11.32 14%/52 9th/[776,793) 10.73 10.58 9.87 12.01 10.80 10.05 10.58 9.87 8.52 6.99 12.2%/46 −6 10th/[791,850] 8.23 9.26 9.50 10.25 10.22 9.69 10.65 10.37 10.65 11.18 13.8%/52 10th/[793,850] 13.80 13.49 11.24 11.83 11.24 8.86 8.11 8.83 7.42 5.20 13.9%/39 −13 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution

Colorado Covid Academic Impact Analyses: ELA Grade 7 Pre−Covid (2019) Results Covid (2021) Results Covid Impact (2021 − 2019) Results Growth by Prior Median SGP: 50 Median SGP: 40 Median SGP Difference: −10 Mean Scale Score: 746 Mean Scale Score: 743 Mean Scale Score Difference: −3 Percent Proficient: 47.1% SGP Count: 55057 Percent Proficient: 43.2% SGP Count: 39035 Percent Proficient Difference: −3.9% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Score Decile & 1st/[650,699) 9.58 10.00 9.54 10.38 9.92 9.82 10.20 9.94 9.96 10.68 9.1%/50 1st/[650,702) 10.67 11.40 11.69 10.61 10.86 9.69 9.29 10.05 8.83 6.91 9.5%/44 −6 Full Population 2nd/[699,716) 9.48 10.24 10.23 9.64 9.88 10.07 9.57 10.12 9.79 10.99 10.5%/50 2nd/[702,718) 10.97 11.36 10.92 11.96 10.79 10.84 10.82 9.00 8.12 5.21 9.9%/44 −6 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[716,728) 9.86 10.07 9.65 9.82 10.29 9.41 10.54 10.16 9.97 10.24 9.7%/50 3rd/[718,730) 10.30 11.98 12.50 12.50 11.70 10.14 9.96 7.99 7.37 5.55 9.9%/42 −8 4th/[728,738) 9.01 9.78 9.72 9.97 10.31 10.76 9.47 9.96 10.06 10.95 10.2%/51 4th/[730,740) 9.93 13.72 12.86 12.34 11.46 10.04 9.47 8.12 6.64 5.42 9.9%/40 −11 5th/[738,747) 9.51 10.11 10.36 10.33 9.38 9.34 10.20 10.11 10.20 10.46 10%/50 5th/[740,749) 10.71 14.97 12.93 12.68 10.84 9.26 8.95 7.04 7.12 5.51 10%/38 −12 Ethnicity: 6th/[747,755) 9.86 9.59 9.70 9.88 9.90 10.48 10.17 10.46 9.99 9.99 9.9%/51 6th/[749,758) 12.67 14.08 13.63 11.86 10.47 9.87 8.07 7.72 6.96 4.67 10.2%/37 −14 7th/[755,764) 9.03 9.97 10.35 10.09 10.40 9.55 10.16 9.73 9.71 11.01 10%/50 7th/[758,767) 13.32 13.47 12.95 10.19 10.26 10.31 8.93 8.53 7.10 4.94 10.2%/40 −10 8th/[764,774) 9.28 10.10 9.99 9.70 9.88 10.38 9.61 9.84 10.45 10.78 9.9%/51 8th/[767,777) 13.68 13.42 12.78 10.55 10.45 10.75 8.06 7.62 6.88 5.80 10%/39 −12 9th/[774,788) 9.71 9.95 9.91 9.93 10.14 9.69 10.16 10.03 10.16 10.33 10.5%/50 9th/[777,791) 15.79 12.05 12.49 10.65 10.04 9.70 7.43 9.26 7.11 5.47 10.5%/38 −12 10th/[788,850] 9.53 9.97 10.04 10.19 9.85 10.22 9.94 10.01 9.69 10.56 10.2%/50 10th/[791,850] 17.35 15.02 11.18 9.98 9.90 9.01 9.11 6.83 6.53 5.09 10%/36 −14 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution ELA - Grade 7 Median SGP: 44 Median SGP: 41 Median SGP Difference: −3 Mean Scale Score: 730 Mean Scale Score: 730 Mean Scale Score Difference: 0 Percent Proficient: 30.9% SGP Count: 2339 Percent Proficient: 29.9% SGP Count: 1339 Percent Proficient Difference: −1% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to African American 1st/[650,699) 12.14 9.30 10.59 12.66 11.63 9.56 6.46 11.37 8.53 7.75 16.5%/45 1st/[650,702) 12.17 8.70 10.87 8.70 10.87 10.43 10.87 10.00 11.74 5.65 17.2%/49 4 2nd/[699,716) 12.54 8.96 14.33 12.24 10.15 9.55 8.36 9.25 3.88 10.75 14.3%/42 2nd/[702,718) 10.24 16.27 9.04 13.25 12.65 5.42 13.25 9.64 7.23 3.01 12.4%/42 0 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[716,728) 13.93 10.36 10.36 10.00 13.21 6.79 12.14 6.79 8.57 7.86 12%/43 3rd/[718,730) 14.53 11.73 7.82 10.06 13.41 11.73 8.38 7.82 9.50 5.03 13.4%/44 1 4th/[728,738) 11.20 9.65 13.51 5.79 13.13 12.36 8.49 10.81 6.56 8.49 11.1%/47 4th/[730,740) 14.84 14.19 12.26 11.61 10.97 9.03 7.74 7.74 6.45 5.16 11.6%/38 −9 5th/[738,747) 11.27 13.45 10.91 10.91 9.82 6.55 10.91 8.00 8.73 9.45 11.8%/44 5th/[740,749) 12.59 20.28 11.89 5.59 16.08 4.90 8.39 9.79 5.59 4.90 10.7%/37 −7 6th/[747,755) 15.93 9.34 9.34 11.54 9.34 6.04 10.44 10.44 9.89 7.69 7.8%/43 6th/[749,758) 15.60 11.35 11.35 11.35 12.06 9.22 7.09 10.64 5.67 5.67 10.5%/40 −3 7th/[755,764) 13.21 15.09 6.60 12.74 10.85 8.96 7.08 9.43 7.55 8.49 9.1%/43 7th/[758,767) 15.09 10.38 10.38 14.15 5.66 8.49 16.04 11.32 5.66 2.83 7.9%/39.5 −3.5 8th/[764,774) 14.19 6.76 11.49 12.16 7.43 10.81 10.14 6.76 7.43 12.84 6.3%/47.5 8th/[767,777) 11.22 15.31 12.24 11.22 10.20 13.27 11.22 6.12 4.08 5.10 7.3%/39.5 −8 9th/[774,788) 12.84 10.81 14.19 10.81 6.76 6.76 11.49 11.49 4.73 10.14 6.3%/42.5 9th/[777,791) 15.07 10.96 13.70 5.48 6.85 10.96 9.59 10.96 9.59 6.85 5.5%/42 −0.5 10th/[788,850] 23.01 8.85 8.85 7.96 12.39 16.81 6.19 3.54 4.42 7.96 4.8%/41 10th/[791,850] 18.75 22.92 4.17 12.50 10.42 4.17 12.50 8.33 6.25 0.00 3.6%/35.5 −5.5 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 64 Median SGP: 56 Median SGP Difference: −8 Mean Scale Score: 766 Mean Scale Score: 762 Mean Scale Score Difference: −4 Percent Proficient: 67.1% SGP Count: 1719 Percent Proficient: 66.3% SGP Count: 1156 Percent Proficient Difference: −0.799999999999997% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to 1st/[650,699) 8.74 1.94 5.83 4.85 5.83 12.62 10.68 13.59 12.62 23.30 6%/69 1st/[650,702) 1.49 10.45 10.45 8.96 8.96 8.96 10.45 14.93 14.93 10.45 5.8%/60 −9 2nd/[699,716) 7.27 5.45 3.64 9.09 3.64 9.09 9.09 15.45 14.55 22.73 6.4%/70 2nd/[702,718) 10.81 2.70 9.46 6.76 9.46 12.16 10.81 10.81 6.76 20.27 6.4%/58 −12 Asian Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[716,728) 3.16 4.21 3.16 7.37 21.05 9.47 10.53 9.47 11.58 20.00 5.5%/62 3rd/[718,730) 6.06 1.52 10.61 1.52 10.61 3.03 19.70 16.67 13.64 16.67 5.7%/67 5 4th/[728,738) 3.03 7.58 6.06 10.61 9.85 13.64 6.06 8.33 17.42 17.42 7.7%/59 4th/[730,740) 6.02 10.84 8.43 13.25 4.82 4.82 10.84 18.07 10.84 12.05 7.2%/62 3 5th/[738,747) 5.13 8.97 6.41 8.97 7.69 12.18 7.69 9.62 14.74 18.59 9.1%/60 5th/[740,749) 7.29 9.38 8.33 11.46 8.33 6.25 13.54 7.29 14.58 13.54 8.3%/58.5 −1.5 6th/[747,755) 2.78 4.86 10.42 7.64 5.56 6.25 6.94 11.11 18.75 25.69 8.4%/74.5 6th/[749,758) 4.00 7.00 14.00 10.00 8.00 9.00 13.00 11.00 12.00 12.00 8.7%/59 −15.5 7th/[755,764) 6.45 6.45 8.06 5.38 9.14 9.14 10.22 10.22 12.90 22.04 10.8%/63 7th/[758,767) 7.75 7.75 10.85 5.43 9.30 7.75 13.18 14.73 13.18 10.08 11.2%/62 −1 8th/[764,774) 5.39 7.84 7.35 7.84 8.82 12.25 8.33 10.78 13.24 18.14 11.9%/60 8th/[767,777) 6.90 14.48 7.59 13.79 6.21 12.41 7.59 8.97 14.48 7.59 12.5%/51 −9 9th/[774,788) 4.91 6.42 7.17 6.42 7.17 10.57 11.32 15.09 13.58 17.36 15.4%/65 9th/[777,791) 6.35 8.99 10.05 6.88 11.64 10.05 9.52 16.40 11.11 8.99 16.3%/56 −9 10th/[788,850] 4.63 8.02 7.41 7.72 9.26 9.57 11.42 11.73 13.58 16.67 18.8%/62 10th/[791,850] 8.21 14.98 9.18 9.66 10.14 13.53 9.66 8.70 8.21 7.73 17.9%/47 −15 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 47 Median SGP: 37 Median SGP Difference: −10 Mean Scale Score: 731 Mean Scale Score: 728 Mean Scale Score Difference: −3 Percent Proficient: 30.3% SGP Count: 19663 Percent Proficient: 25.5% SGP Count: 13574 Percent Proficient Difference: −4.8% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Hispanic or Latino 1st/[650,699) 9.08 9.31 9.79 10.64 10.47 9.72 10.64 9.35 10.27 10.71 14.9%/50 1st/[650,702) 11.46 11.84 11.79 11.84 11.17 9.94 9.23 9.33 7.29 6.11 15.6%/42 −8 2nd/[699,716) 9.23 10.59 9.75 9.65 10.43 10.04 10.04 10.14 9.78 10.36 15.8%/50 2nd/[702,718) 12.27 11.54 11.78 12.81 10.17 11.44 10.46 7.48 7.82 4.21 15.1%/41 −9 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[716,728) 10.21 10.49 10.06 11.03 9.86 9.43 10.60 9.32 10.14 8.85 13%/48 3rd/[718,730) 11.19 14.05 13.40 12.33 11.89 10.28 9.53 7.10 6.57 3.66 13.7%/39 −9 4th/[728,738) 10.99 10.66 9.75 10.95 9.46 11.24 9.38 9.54 8.92 9.13 12.3%/47 4th/[730,740) 10.79 15.07 13.56 12.12 11.81 11.09 8.80 7.72 5.85 3.19 12.2%/38 −9 5th/[738,747) 11.30 11.11 11.11 10.59 8.84 9.17 10.45 9.79 9.13 8.51 10.8%/46 5th/[740,749) 13.14 15.57 14.76 13.14 9.97 8.76 8.76 6.27 5.66 3.98 10.9%/35 −11 6th/[747,755) 12.21 10.89 10.40 9.52 11.00 10.67 9.96 9.74 8.20 7.43 9.2%/46 6th/[749,758) 15.42 15.81 15.02 12.38 9.82 10.62 6.15 6.39 4.95 3.43 9.2%/33 −13 7th/[755,764) 10.97 10.90 11.37 10.77 9.88 9.14 10.36 9.28 8.80 8.53 7.5%/45 7th/[758,767) 15.72 15.72 13.49 10.23 10.42 8.65 7.72 8.65 6.14 3.26 7.9%/34 −11 8th/[764,774) 11.81 12.63 11.22 10.03 9.36 10.62 8.10 8.84 8.62 8.77 6.8%/44 8th/[767,777) 17.33 16.44 15.00 10.78 10.33 8.56 7.33 4.56 5.44 4.22 6.6%/30 −14 9th/[774,788) 13.00 11.84 10.22 10.31 9.87 8.97 9.06 9.42 9.06 8.25 5.7%/44 9th/[777,791) 18.72 13.90 13.90 10.64 9.36 8.65 5.11 8.79 6.52 4.40 5.2%/33 −11 10th/[788,850] 12.48 11.07 10.68 10.42 10.04 9.40 8.75 9.91 7.98 9.27 4%/45 10th/[791,850] 22.93 17.15 12.19 8.88 10.12 8.68 6.82 4.96 4.34 3.93 3.6%/27 −18 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 52 Median SGP: 41 Median SGP Difference: −11 Mean Scale Score: 755 Mean Scale Score: 752 Mean Scale Score Difference: −3 Percent Proficient: 58.4% SGP Count: 28609 Percent Proficient: 54% SGP Count: 21053 Percent Proficient Difference: −4.4% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to 1st/[650,699) 9.39 11.21 8.66 9.75 8.81 10.19 10.19 10.99 9.90 10.92 4.8%/52 1st/[650,702) 8.83 11.56 11.56 9.27 10.59 9.53 8.91 11.03 10.15 8.56 5.4%/48 −4 2nd/[699,716) 9.64 10.15 10.41 9.34 9.54 10.41 9.34 9.80 10.30 11.07 6.9%/50.5 2nd/[702,718) 8.78 10.54 10.12 10.76 11.54 10.76 11.39 10.69 8.92 6.51 6.7%/48 −2.5 White Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[716,728) 8.94 10.16 9.17 8.33 10.25 9.74 10.30 11.62 9.88 11.62 7.4%/53 3rd/[718,730) 9.07 10.26 11.76 13.08 11.39 10.20 10.26 8.82 8.01 7.13 7.6%/45 −8 4th/[728,738) 7.33 9.17 9.48 9.87 10.66 10.03 9.76 10.23 11.01 12.46 8.9%/53 4th/[730,740) 8.69 12.46 12.69 12.58 11.39 9.76 9.81 8.18 7.22 7.22 8.4%/42 −11 5th/[738,747) 8.13 8.95 10.00 9.93 10.04 9.63 10.19 10.67 10.71 11.76 9.3%/52 5th/[740,749) 9.05 14.73 11.96 12.51 11.07 9.84 9.00 7.46 7.81 6.57 9.6%/41 −11 6th/[747,755) 8.39 9.20 9.07 10.11 9.62 10.79 10.37 10.96 10.66 10.83 10.8%/53 6th/[749,758) 11.11 13.32 13.45 11.81 10.75 9.65 8.94 8.23 7.83 4.91 10.7%/40 −13 7th/[755,764) 7.97 9.63 10.34 9.84 10.70 9.81 10.34 9.87 9.96 11.53 11.8%/51 8th/[764,774) 8.56 9.43 9.49 9.46 10.09 10.47 10.09 9.98 11.02 11.42 12.1%/52 Colorado SGP Calculations 2021 7th/[758,767) 12.29 12.94 13.06 10.13 10.54 11.11 8.99 8.14 7.32 5.49 11.7%/41 8th/[767,777) 13.00 12.19 12.73 9.78 10.64 11.30 8.35 8.62 7.14 6.25 12.2%/41.5 9th/[774,788) 8.93 9.56 10.14 9.94 10.44 10.01 10.29 9.81 10.54 10.34 13.8%/50 9th/[777,791) 15.79 11.75 12.03 11.07 10.20 10.03 7.72 9.10 6.72 5.58 13.8%/39 −11 10th/[788,850] 9.10 9.97 10.09 10.65 9.89 10.46 9.94 10.06 9.72 10.11 14.2%/50 10th/[791,850] 16.86 14.67 11.17 9.97 10.08 8.64 9.53 7.09 6.92 5.07 13.9%/37 −13 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution

Colorado Covid Academic Impact Analyses: MATHEMATICS Grade 6 Pre−Covid (2019) Results Covid (2021) Results Covid Impact (2021 − 2019) Results Growth by Prior Median SGP: 50 Median SGP: 33 Median SGP Difference: −17 Mean Scale Score: 733 Mean Scale Score: 727 Mean Scale Score Difference: −6 Percent Proficient: 29.9% SGP Count: 57419 Percent Proficient: 24.4% SGP Count: 40775 Percent Proficient Difference: −5.5% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Score Decile & 1st/[650,693) 9.73 9.80 10.17 10.19 10.06 9.65 10.13 9.76 9.80 10.72 9.5%/50 1st/[650,695) 21.57 13.91 11.33 10.05 9.84 9.14 7.53 6.50 5.12 5.00 9.8%/33 −17 Full Population 2nd/[693,706) 9.61 10.02 9.94 10.27 9.45 10.60 9.69 10.09 10.09 10.25 9%/50 2nd/[695,708) 23.89 14.80 11.16 10.39 8.59 7.17 6.69 6.45 5.68 5.17 10.2%/30 −20 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[706,718) 9.15 10.02 10.04 9.58 10.22 9.59 10.53 10.15 9.99 10.73 11.4%/50 3rd/[708,718) 21.00 15.26 10.86 9.88 8.78 7.77 8.01 6.59 6.07 5.77 9.5%/33 −17 4th/[718,727) 9.49 9.83 9.81 9.64 10.27 10.42 9.62 9.96 10.18 10.77 9.4%/50 4th/[718,727) 19.99 13.17 11.79 9.74 8.53 8.61 8.28 7.07 7.10 5.72 9.6%/35 −15 5th/[727,736) 9.49 10.03 10.21 10.41 9.53 9.82 10.34 9.91 10.03 10.23 9.6%/50 5th/[727,736) 18.82 12.73 11.74 10.15 9.39 9.66 8.49 6.88 6.29 5.84 9.9%/36 −14 Ethnicity: 6th/[736,745) 9.83 10.18 9.73 10.40 10.19 9.67 9.83 10.02 9.52 10.64 11%/49 6th/[736,746) 18.93 13.32 11.54 10.29 9.62 8.46 8.53 7.57 6.28 5.46 11%/35 −14 7th/[745,754) 9.10 9.46 10.20 9.85 10.47 10.03 10.14 9.96 9.85 10.94 9.7%/50 7th/[746,755) 19.18 13.88 12.07 10.11 9.44 9.00 6.77 7.34 5.89 6.31 9.5%/34 −16 8th/[754,765) 9.31 9.96 10.07 9.63 9.29 10.49 9.86 10.33 10.84 10.22 10.4%/51 8th/[755,765) 21.66 15.18 11.90 10.49 8.35 8.80 7.06 6.18 4.99 5.37 9.7%/31 −20 9th/[765,779) 10.05 10.50 9.42 9.72 10.52 9.77 10.15 9.75 9.56 10.57 10%/49 9th/[765,779) 21.32 15.04 11.20 9.64 8.39 7.88 7.36 6.51 6.06 6.60 10.4%/32 −17 10th/[779,850] 9.19 9.89 10.20 10.32 9.84 9.86 10.04 10.13 10.16 10.37 10.1%/50 10th/[779,850] 22.50 13.98 11.32 9.09 8.45 7.34 7.37 6.21 7.51 6.21 10.4%/32 −18 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Mathematics - Median SGP: 44 Median SGP: 24 Median SGP Difference: −20 Mean Scale Score: 718 Mean Scale Score: 713 Mean Scale Score Difference: −5 Percent Proficient: 14% SGP Count: 2520 Percent Proficient: 11.5% SGP Count: 1393 Percent Proficient Difference: −2.5% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Grade 6 African American 1st/[650,693) 9.13 11.41 11.41 10.37 8.71 11.00 8.92 10.37 8.71 9.96 19.1%/48 1st/[650,695) 26.13 15.32 13.96 12.61 9.91 6.76 6.76 5.41 2.25 0.90 15.9%/24.5 −23.5 2nd/[693,706) 14.37 12.19 8.12 12.19 9.69 8.75 9.06 9.69 10.31 5.62 12.7%/43 2nd/[695,708) 30.05 15.02 12.21 12.68 8.45 7.04 6.57 2.82 2.35 2.82 15.3%/23 −20 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[706,718) 10.33 13.60 9.32 9.07 11.34 8.82 9.82 8.56 8.31 10.83 15.8%/46 3rd/[708,718) 26.24 19.15 5.67 9.93 7.80 9.22 7.09 4.96 5.67 4.26 10.1%/29 −17 4th/[718,727) 11.16 14.74 13.94 9.16 6.77 10.36 7.17 10.76 7.17 8.76 10%/40 4th/[718,727) 25.15 17.18 15.34 11.04 11.04 7.98 4.29 2.45 3.68 1.84 11.7%/24 −16 5th/[727,736) 12.89 9.77 12.89 9.38 8.98 7.81 10.55 8.98 9.77 8.98 10.2%/43.5 5th/[727,736) 21.32 14.71 17.65 12.50 11.03 7.35 7.35 3.68 2.21 2.21 9.8%/27 −16.5 6th/[736,745) 14.87 11.90 9.67 10.04 11.15 8.18 8.18 7.81 7.43 10.78 10.7%/43 6th/[736,746) 24.38 18.12 10.62 10.62 8.12 10.00 8.75 4.38 2.50 2.50 11.5%/26.5 −16.5 7th/[745,754) 13.40 13.92 9.28 11.34 8.76 11.86 13.92 3.61 7.22 6.70 7.7%/42 7th/[746,755) 30.10 12.62 13.59 13.59 5.83 6.80 3.88 9.71 0.97 2.91 7.4%/22 −20 8th/[754,765) 14.72 7.98 10.43 9.20 12.88 14.11 8.59 6.13 6.75 9.20 6.5%/46 8th/[755,765) 19.15 29.79 9.57 10.64 5.32 9.57 3.19 6.38 3.19 3.19 6.7%/20 −26 9th/[765,779) 14.52 16.94 11.29 8.87 8.06 6.45 5.65 11.29 7.26 9.68 4.9%/38 9th/[765,779) 30.59 20.00 14.12 7.06 7.06 2.35 7.06 4.71 4.71 2.35 6.1%/18 −20 10th/[779,850] 15.62 9.38 7.81 9.38 20.31 7.81 10.94 4.69 7.81 6.25 2.5%/44 10th/[779,850] 28.95 19.74 10.53 5.26 9.21 5.26 7.89 3.95 6.58 2.63 5.5%/20 −24 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 62 Median SGP: 44 Median SGP Difference: −18 Mean Scale Score: 752 Mean Scale Score: 748 Mean Scale Score Difference: −4 Percent Proficient: 55.7% SGP Count: 1745 Percent Proficient: 49.6% SGP Count: 1227 Percent Proficient Difference: −6.1% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to 1st/[650,693) 11.11 6.94 8.33 13.89 11.11 6.94 9.72 6.94 13.89 11.11 4.1%/49 1st/[650,695) 18.75 22.92 10.42 8.33 8.33 8.33 4.17 2.08 8.33 8.33 3.9%/27.5 −21.5 2nd/[693,706) 4.76 13.10 11.90 5.95 9.52 13.10 9.52 15.48 8.33 8.33 4.8%/52 2nd/[695,708) 21.54 15.38 6.15 10.77 6.15 7.69 6.15 9.23 6.15 10.77 5.3%/35 −17 Asian Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[706,718) 9.40 7.69 5.13 8.55 5.13 3.42 16.24 14.53 11.97 17.95 6.7%/67 3rd/[708,718) 9.52 17.46 6.35 12.70 14.29 9.52 6.35 7.94 6.35 9.52 5.1%/46 −21 4th/[718,727) 8.33 8.33 7.50 5.83 7.50 9.17 8.33 11.67 14.17 19.17 6.9%/61 4th/[718,727) 17.65 14.71 10.29 11.76 13.24 1.47 4.41 7.35 7.35 11.76 5.5%/35.5 −25.5 5th/[727,736) 2.56 8.55 6.84 6.84 7.69 12.82 13.68 8.55 13.68 18.80 6.7%/64 5th/[727,736) 17.78 11.11 12.22 6.67 6.67 11.11 8.89 3.33 10.00 12.22 7.3%/41 −23 6th/[736,745) 7.79 10.39 9.09 7.79 11.69 9.74 4.55 5.84 11.69 21.43 8.8%/52 6th/[736,746) 14.91 13.16 12.28 7.89 11.40 6.14 9.65 10.53 6.14 7.89 9.3%/40.5 −11.5 7th/[745,754) 3.33 6.67 7.22 7.78 14.44 8.33 7.22 11.67 13.89 19.44 10.3%/64 7th/[746,755) 13.21 3.77 16.04 9.43 10.38 11.32 7.55 7.55 8.49 12.26 8.6%/48 −16 8th/[754,765) 5.83 5.83 9.87 6.28 7.17 8.52 12.11 11.21 16.14 17.04 12.8%/66 8th/[755,765) 13.97 12.50 11.03 13.24 7.35 10.29 8.09 6.62 5.15 11.76 11.1%/38.5 −27.5 9th/[765,779) 4.44 5.24 5.65 8.87 8.06 11.69 9.68 12.10 12.90 21.37 14.2%/66 9th/[765,779) 13.33 15.24 7.14 8.57 9.52 6.67 10.00 9.52 7.62 12.38 17.1%/45 −21 10th/[779,850] 5.81 6.74 6.98 10.93 9.53 9.53 9.77 10.47 13.72 16.51 24.6%/60.5 10th/[779,850] 11.62 10.40 9.17 9.79 7.65 8.87 8.87 9.17 10.09 14.37 26.7%/51 −9.5 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 46 Median SGP: 27 Median SGP Difference: −19 Mean Scale Score: 720 Mean Scale Score: 713 Mean Scale Score Difference: −7 Percent Proficient: 14.9% SGP Count: 20905 Percent Proficient: 10.3% SGP Count: 14205 Percent Proficient Difference: −4.6% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Hispanic or Latino 1st/[650,693) 11.27 10.14 10.21 10.46 10.39 9.11 9.89 9.27 9.61 9.64 15.3%/47 1st/[650,695) 23.39 14.64 11.39 10.05 10.05 9.18 6.41 6.02 4.76 4.11 16.3%/30 −17 2nd/[693,706) 10.58 10.86 10.79 10.79 9.48 10.29 9.34 9.27 9.06 9.55 13.5%/47 2nd/[695,708) 26.41 15.55 12.12 11.22 8.29 6.64 6.24 5.43 4.68 3.43 15.8%/26 −21 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[706,718) 10.50 11.21 10.62 9.66 9.91 9.32 10.56 9.60 9.20 9.41 15.4%/48 3rd/[708,718) 24.47 16.68 11.92 8.58 9.00 7.79 7.26 5.24 5.14 3.92 13.3%/27 −21 4th/[718,727) 11.44 10.75 10.34 9.53 10.22 10.39 9.33 8.80 10.14 9.05 11.8%/48 4th/[718,727) 23.84 14.94 12.50 8.78 8.66 7.44 8.48 5.73 5.30 4.33 11.5%/28 −20 5th/[727,736) 11.61 10.51 10.51 10.28 9.51 10.10 9.46 10.37 8.73 8.91 10.5%/47 5th/[727,736) 23.60 13.57 12.77 10.29 9.29 8.62 7.49 6.22 4.75 3.41 10.5%/30 −17 6th/[736,745) 11.83 10.65 10.74 10.70 9.94 9.99 10.13 9.66 8.25 8.11 10.2%/46 6th/[736,746) 24.31 15.17 11.69 9.64 9.21 7.58 6.66 6.52 5.39 3.83 9.9%/28 −18 7th/[745,754) 11.52 10.89 11.21 10.08 12.15 9.01 10.39 8.88 8.82 7.05 7.6%/45 7th/[746,755) 24.85 16.96 12.72 9.76 8.58 7.69 6.71 5.03 4.24 3.45 7.1%/26 −19 8th/[754,765) 12.32 12.39 11.18 9.47 7.83 10.90 10.40 8.90 9.62 6.98 6.7%/45 8th/[755,765) 29.79 16.83 12.96 10.19 5.20 7.64 5.76 4.10 3.65 3.88 6.4%/22 −23 9th/[765,779) 15.20 11.62 11.97 8.73 10.74 10.83 9.78 8.21 6.72 6.20 5.5%/41 9th/[765,779) 30.86 15.36 8.87 9.27 8.87 5.96 7.28 4.37 4.50 4.64 5.3%/24 −17 10th/[779,850] 15.48 12.38 10.09 10.63 9.42 7.54 8.48 9.29 9.02 7.67 3.6%/41 10th/[779,850] 31.07 14.89 13.42 7.90 9.19 5.51 4.04 3.49 6.25 4.23 3.8%/22 −19 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 53 Median SGP: 37 Median SGP Difference: −16 Mean Scale Score: 742 Mean Scale Score: 736 Mean Scale Score Difference: −6 Percent Proficient: 40.4% SGP Count: 29220 Percent Proficient: 32.6% SGP Count: 21946 Percent Proficient Difference: −7.8% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to 1st/[650,693) 6.82 9.02 8.68 9.44 9.85 10.74 10.95 10.40 10.61 13.50 5%/56 1st/[650,695) 17.16 12.17 11.04 9.75 10.15 9.51 9.11 7.57 6.37 7.17 5.7%/39 −17 2nd/[693,706) 7.33 8.00 8.37 9.22 9.59 11.97 9.77 11.24 12.03 12.46 5.6%/56 2nd/[695,708) 19.17 13.38 9.52 9.10 9.45 7.86 7.45 8.41 7.72 7.93 6.6%/38 −18 White Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[706,718) 7.04 8.01 9.72 9.56 10.29 10.74 10.66 10.82 11.07 12.08 8.4%/55 3rd/[708,718) 17.23 12.87 10.39 11.38 8.27 7.71 9.02 8.21 7.09 7.84 7.3%/38 −17 4th/[718,727) 7.50 8.73 9.00 9.92 10.79 10.44 10.18 11.28 10.27 11.89 7.8%/53 4th/[718,727) 15.75 11.68 11.19 10.21 8.20 9.72 8.53 8.58 8.96 7.17 8.4%/41 −12 5th/[727,736) 7.82 9.76 9.80 10.59 9.50 9.39 10.62 9.95 11.15 11.41 9.1%/53 5th/[727,736) 15.50 11.68 10.88 10.13 9.33 10.27 9.42 7.96 7.44 7.40 9.7%/42 −11 6th/[736,745) 8.27 9.74 9.09 10.18 10.00 9.82 10.00 10.67 10.38 11.85 11.7%/52 6th/[736,746) 15.63 11.80 11.61 10.87 9.83 9.01 9.52 8.32 6.89 6.54 11.8%/40 −12 7th/[745,754) 7.86 8.71 9.93 9.87 9.26 10.60 10.39 10.63 10.05 12.68 11.2%/53 8th/[754,765) 8.22 9.18 9.49 9.96 9.70 10.50 9.70 11.13 11.13 11.00 13.2%/53 Colorado SGP Calculations 2021 7th/[746,755) 16.51 13.19 11.43 10.08 10.08 9.38 6.92 8.28 6.60 7.54 11.1%/39 8th/[755,765) 19.67 14.23 11.76 10.65 9.74 8.83 7.31 6.70 5.40 5.71 12%/33 9th/[765,779) 8.67 10.35 8.85 10.10 10.64 9.72 10.35 9.74 10.43 11.15 13.4%/51 9th/[765,779) 19.39 14.99 11.81 9.76 8.32 8.49 7.11 6.84 6.44 6.84 13.6%/33 −18 10th/[779,850] 8.51 9.92 10.47 10.35 9.90 10.18 10.14 10.30 10.09 10.14 14.6%/50 10th/[779,850] 22.08 13.78 11.42 9.38 8.53 7.61 7.45 6.69 7.28 5.77 13.9%/32 −18 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution

Colorado Covid Academic Impact Analyses: MATHEMATICS Grade 8 Pre−Covid (2019) Results Covid (2021) Results Covid Impact (2021 − 2019) Results Growth by Prior Median SGP: 50 Median SGP: 37 Median SGP Difference: −13 Mean Scale Score: 737 Mean Scale Score: 731 Mean Scale Score Difference: −6 Percent Proficient: 37.7% SGP Count: 51637 Percent Proficient: 30% SGP Count: 35647 Percent Proficient Difference: −7.7% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Score Decile & 1st/[650,692) 10.12 9.55 9.91 10.21 10.06 9.62 10.15 9.85 9.81 10.72 9.2%/50 1st/[650,695) 7.20 8.06 11.81 10.95 12.19 10.25 11.54 11.28 9.21 7.50 9.5%/49 −1 Full Population 2nd/[692,707) 9.27 9.98 9.95 9.63 10.26 10.51 9.81 10.06 10.25 10.28 10.3%/50 2nd/[695,707) 7.49 10.28 12.53 12.45 12.56 10.50 11.42 9.03 7.88 5.85 10.1%/46 −4 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[707,717) 9.35 10.09 10.17 10.07 9.72 9.59 10.13 10.23 9.72 10.93 9.9%/50 3rd/[707,716) 9.85 11.28 13.94 12.22 12.76 11.10 10.27 7.99 5.98 4.62 9.5%/42 −8 4th/[717,726) 9.45 9.54 10.21 9.75 10.43 9.86 9.71 9.69 10.64 10.71 10.4%/50 4th/[716,725) 11.97 13.44 15.23 12.48 12.24 10.66 7.35 7.00 5.29 4.33 10.5%/37 −13 5th/[726,734) 9.44 10.63 9.90 10.17 9.50 10.38 10.23 10.07 9.38 10.30 10.1%/50 5th/[725,733) 13.37 16.45 14.40 11.84 11.39 9.19 7.23 7.02 5.21 3.92 9.3%/34 −16 Ethnicity: 6th/[734,743) 9.83 9.15 9.59 10.01 10.19 9.43 9.89 10.69 10.57 10.65 9.7%/51 6th/[733,742) 16.94 16.41 14.09 11.18 10.19 9.47 6.70 6.50 4.29 4.23 10.1%/31 −20 7th/[743,752) 9.27 9.61 10.10 10.12 10.29 10.38 10.04 9.48 9.89 10.82 10.3%/50 7th/[742,751) 18.83 18.50 14.30 10.30 9.66 7.04 6.90 5.57 4.73 4.17 10%/29 −21 8th/[752,761) 9.63 11.03 10.13 9.89 9.78 9.76 9.22 9.98 9.74 10.82 9%/49 8th/[751,762) 20.46 15.74 12.91 10.77 8.93 7.31 6.89 6.73 4.86 5.39 10.6%/30 −19 9th/[761,776) 9.48 9.61 9.86 10.23 9.77 9.88 10.27 10.30 10.40 10.19 10.6%/51 9th/[762,775) 18.97 15.06 12.26 11.46 9.99 8.46 7.13 6.19 5.44 5.05 10.1%/32 −19 10th/[776,850] 9.52 9.74 10.02 9.93 10.09 10.15 10.07 10.13 9.83 10.52 10.5%/50 10th/[775,850] 19.17 15.47 10.02 10.95 8.80 8.22 7.57 7.60 6.54 5.66 10.3%/34 −16 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Mathematics - Median SGP: 46 Median SGP: 35 Median SGP Difference: −11 Mean Scale Score: 716 Mean Scale Score: 713 Mean Scale Score Difference: −3 Percent Proficient: 19.3% SGP Count: 2261 Percent Proficient: 14.5% SGP Count: 1115 Percent Proficient Difference: −4.8% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Grade 8 African American 1st/[650,692) 11.58 8.46 10.24 12.25 11.80 10.24 9.35 9.80 8.91 7.35 19.9%/46 1st/[650,695) 7.14 8.10 9.52 14.29 12.38 10.48 12.86 13.33 8.10 3.81 18.8%/48 2 2nd/[692,707) 12.98 9.67 12.98 10.77 12.98 8.29 9.12 8.84 8.84 5.52 16%/44 2nd/[695,707) 10.22 15.59 14.52 12.90 11.29 11.29 6.99 10.22 3.76 3.23 16.7%/37 −7 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[707,717) 11.88 9.57 12.54 8.91 12.54 6.60 6.93 7.59 10.23 13.20 13.4%/45 3rd/[707,716) 14.96 9.45 16.54 14.96 11.02 11.81 9.45 6.30 2.36 3.15 11.4%/34 −11 4th/[717,726) 12.97 7.85 13.65 9.22 7.85 12.29 11.95 8.53 6.83 8.87 13%/47 4th/[716,725) 18.18 19.70 13.64 11.36 12.88 9.85 5.30 4.55 0.76 3.79 11.8%/26 −21 5th/[726,734) 12.05 12.05 13.84 9.38 8.93 12.50 11.61 4.91 8.48 6.25 9.9%/42 5th/[725,733) 9.78 19.57 13.04 20.65 13.04 7.61 4.35 6.52 2.17 3.26 8.3%/32.5 −9.5 6th/[734,743) 10.66 5.58 9.64 9.64 7.11 11.68 12.18 11.17 10.66 11.68 8.7%/55 6th/[733,742) 20.75 16.04 15.09 9.43 10.38 11.32 7.55 3.77 1.89 3.77 9.5%/28.5 −26.5 7th/[743,752) 8.64 10.49 8.02 12.35 12.35 7.41 8.64 8.64 12.35 11.11 7.2%/47.5 7th/[742,751) 24.39 18.29 14.63 8.54 6.10 13.41 6.10 1.22 3.66 3.66 7.4%/22 −25.5 8th/[752,761) 11.21 4.67 9.35 12.15 7.48 9.35 7.48 14.95 7.48 15.89 4.7%/55 8th/[751,762) 24.10 22.89 10.84 8.43 7.23 3.61 3.61 10.84 3.61 4.82 7.4%/21 −34 9th/[761,776) 10.71 9.82 15.18 7.14 7.14 10.71 7.14 10.71 6.25 15.18 5%/49 9th/[762,775) 20.34 18.64 8.47 15.25 6.78 11.86 3.39 3.39 8.47 3.39 5.3%/30 −19 10th/[776,850] 9.62 9.62 11.54 13.46 5.77 11.54 9.62 11.54 7.69 9.62 2.3%/47 10th/[775,850] 18.42 23.68 7.89 7.89 2.63 15.79 5.26 7.89 5.26 5.26 3.4%/30.5 −16.5 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 63 Median SGP: 45 Median SGP Difference: −18 Mean Scale Score: 765 Mean Scale Score: 759 Mean Scale Score Difference: −6 Percent Proficient: 65.5% SGP Count: 1790 Percent Proficient: 58.6% SGP Count: 1108 Percent Proficient Difference: −6.9% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to 1st/[650,692) 6.41 8.97 10.26 7.69 12.82 6.41 8.97 7.69 12.82 17.95 4.4%/58 1st/[650,695) 0.00 11.54 17.31 5.77 9.62 9.62 7.69 7.69 9.62 21.15 4.7%/57 −1 2nd/[692,707) 8.33 12.50 4.17 11.11 9.72 8.33 9.72 5.56 11.11 19.44 4%/55 2nd/[695,707) 3.70 5.56 11.11 7.41 14.81 5.56 12.96 12.96 9.26 16.67 4.9%/60.5 5.5 Asian Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[707,717) 4.88 6.10 6.10 3.66 10.98 13.41 18.29 10.98 13.41 12.20 4.6%/62 3rd/[707,716) 4.65 16.28 18.60 9.30 9.30 6.98 6.98 6.98 13.95 6.98 3.9%/40 −22 4th/[717,726) 1.71 5.13 14.53 7.69 10.26 9.40 7.69 8.55 13.68 21.37 6.5%/60 4th/[716,725) 2.56 10.26 14.10 11.54 17.95 12.82 7.69 10.26 7.69 5.13 7%/46 −14 5th/[726,734) 4.72 5.51 3.94 7.87 11.81 11.02 9.45 17.32 11.81 16.54 7.1%/65 5th/[725,733) 8.77 8.77 10.53 10.53 12.28 15.79 14.04 12.28 3.51 3.51 5.1%/48 −17 6th/[734,743) 5.10 5.73 7.64 6.37 7.01 10.83 10.83 11.46 17.83 17.20 8.8%/66 6th/[733,742) 23.17 10.98 4.88 7.32 10.98 13.41 10.98 3.66 6.10 8.54 7.4%/45 −21 7th/[743,752) 6.40 11.33 5.91 6.90 8.37 12.81 6.40 13.30 8.87 19.70 11.3%/58 7th/[742,751) 9.89 19.78 10.99 15.38 10.99 5.49 7.69 7.69 6.59 5.49 8.2%/36 −22 8th/[752,761) 6.22 5.74 7.66 7.66 10.05 10.05 8.13 9.57 14.83 20.10 11.7%/63 8th/[751,762) 14.58 9.72 9.72 9.03 11.11 9.72 8.33 6.94 11.11 9.72 13%/46 −17 9th/[761,776) 5.50 5.84 7.22 11.34 9.28 11.00 9.62 8.93 17.18 14.09 16.3%/59 9th/[762,775) 10.10 18.69 9.09 10.61 16.16 9.09 6.06 6.06 5.05 9.09 17.9%/40 −19 10th/[776,850] 4.19 7.05 6.39 8.81 7.05 8.81 11.45 13.00 16.30 16.96 25.4%/66.5 10th/[775,850] 11.65 13.92 9.71 10.36 8.41 9.06 6.47 11.65 9.39 9.39 27.9%/43 −23.5 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 48 Median SGP: 34 Median SGP Difference: −14 Mean Scale Score: 720 Mean Scale Score: 714 Mean Scale Score Difference: −6 Percent Proficient: 20.6% SGP Count: 18815 Percent Proficient: 13.5% SGP Count: 12561 Percent Proficient Difference: −7.1% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to Hispanic or Latino 1st/[650,692) 10.83 9.67 10.48 10.27 10.24 9.67 10.13 10.20 9.04 9.46 15.1%/48 1st/[650,695) 7.55 7.93 12.84 11.04 13.03 10.19 11.18 10.29 9.39 6.56 16.9%/48 0 2nd/[692,707) 9.08 10.56 10.46 9.97 10.00 11.06 9.38 9.77 10.30 9.41 16.2%/49 2nd/[695,707) 7.34 11.43 12.68 13.21 12.95 10.74 10.69 9.28 7.13 4.56 15.2%/44 −5 Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[707,717) 10.29 11.33 10.06 11.10 9.25 9.52 10.48 9.40 8.97 9.59 13.7%/47 3rd/[707,716) 11.11 12.83 14.36 12.28 13.01 11.30 8.96 7.49 5.03 3.62 13%/39 −8 4th/[717,726) 10.85 10.12 10.57 10.08 10.93 9.91 9.42 9.26 9.87 8.98 13%/47 4th/[716,725) 15.40 14.77 17.74 11.98 11.66 9.51 6.65 4.94 4.37 2.98 12.6%/31 −16 5th/[726,734) 10.47 12.12 9.88 10.56 9.30 10.66 9.54 9.54 8.81 9.10 10.9%/47 5th/[725,733) 16.99 19.25 15.48 11.38 10.46 8.54 6.28 5.69 3.43 2.51 9.5%/28 −19 6th/[734,743) 10.27 10.68 10.74 9.98 10.21 7.82 9.63 10.56 9.80 10.33 9.1%/48 6th/[733,742) 21.85 18.43 15.10 10.34 9.34 8.01 6.59 4.17 3.17 3.00 9.5%/25 −23 7th/[743,752) 12.35 9.35 10.13 10.65 8.82 10.59 9.80 9.35 9.15 9.80 8.1%/48 7th/[742,751) 25.53 21.94 14.56 9.61 8.74 5.83 4.85 3.79 2.62 2.52 8.2%/21 −27 8th/[752,761) 10.64 12.20 11.28 11.28 10.00 9.91 7.98 8.90 9.08 8.72 5.8%/44 8th/[751,762) 28.08 16.45 12.57 11.16 7.76 6.46 4.11 5.64 4.00 3.76 6.8%/23 −21 9th/[761,776) 11.94 10.70 11.63 10.07 8.83 7.79 11.42 9.35 9.24 9.03 5.1%/45 9th/[762,775) 27.29 16.28 14.42 9.61 7.44 4.81 5.27 6.36 4.19 4.34 5.1%/24 −21 10th/[776,850] 13.55 10.62 10.99 8.97 10.99 8.97 8.61 9.16 7.88 10.26 2.9%/45 10th/[775,850] 27.03 15.97 9.34 10.81 7.62 8.85 6.63 5.16 5.16 3.44 3.2%/28 −17 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution Median SGP: 51 Median SGP: 38 Median SGP Difference: −13 Mean Scale Score: 749 Mean Scale Score: 741 Mean Scale Score Difference: −8 Percent Proficient: 49.4% SGP Count: 26244 Percent Proficient: 39.9% SGP Count: 19193 Percent Proficient Difference: −9.5% Student Growth Percentile Range Student Growth Percentile Range Median SGP Difference 19 29 39 49 59 69 79 89 99 by Prior Score Decile to to to to to to to to to to to to to to to to to to to to 1st/[650,692) 8.16 9.45 9.11 9.45 8.59 9.45 10.57 9.36 11.43 14.43 4.4%/55 1st/[650,695) 6.50 7.32 10.57 10.57 10.57 10.92 12.66 13.01 8.36 9.52 4.5%/54 −1 2nd/[692,707) 9.19 8.51 8.95 8.70 9.69 10.12 10.67 10.92 10.67 12.58 6.2%/54 2nd/[695,707) 7.39 7.85 11.89 11.81 11.81 10.06 12.96 8.77 9.76 7.70 6.8%/49 −5 White Prior Scale Score Decile/Range* Marginal Proportion/Median SGP Prior Scale Score Decile/Range* Marginal Proportion/Median SGP 3rd/[707,717) 7.28 8.64 9.99 9.26 10.15 10.15 9.68 11.65 10.61 12.59 7.3%/54 3rd/[707,716) 8.19 9.52 13.03 11.97 12.75 10.71 11.90 8.47 7.35 6.09 7.4%/45 −9 4th/[717,726) 7.60 9.19 9.23 9.54 10.11 9.71 9.89 10.55 11.82 12.35 8.7%/54 4th/[716,725) 8.97 11.84 12.86 13.42 12.52 11.68 7.95 8.80 6.37 5.58 9.2%/42 −12 5th/[726,734) 8.59 9.53 9.89 10.20 9.53 10.04 10.71 10.59 9.77 11.15 9.7%/52 5th/[725,733) 11.35 14.95 13.68 11.63 11.79 9.69 7.59 7.64 6.53 5.15 9.4%/38 −14 6th/[734,743) 9.56 8.75 8.97 10.23 10.41 10.00 9.78 10.85 11.00 10.45 10.3%/52 6th/[733,742) 14.04 15.65 13.90 11.66 10.64 10.16 6.41 7.87 4.96 4.71 10.7%/35 −17 7th/[743,752) 7.92 9.55 10.47 9.83 10.88 10.12 10.63 9.39 10.40 10.82 12%/51 8th/[752,761) 9.61 11.23 9.88 9.65 9.48 9.68 9.95 9.85 9.92 10.76 11.3%/50 Colorado SGP Calculations 2021 7th/[742,751) 15.67 16.77 14.39 10.55 10.23 7.45 7.95 6.72 5.62 4.66 11.4%/33 8th/[751,762) 18.02 15.68 13.43 10.85 9.15 7.49 7.88 6.89 4.83 5.78 13.2%/32 9th/[761,776) 9.14 9.59 9.56 10.19 10.08 10.37 10.03 10.61 10.27 10.16 14.5%/51 9th/[762,775) 17.41 14.18 11.89 11.89 10.40 9.53 7.76 6.22 5.71 5.00 13.2%/35 −16 10th/[776,850] 9.64 9.88 10.45 10.32 10.10 10.40 10.08 9.88 9.39 9.86 15.6%/49 10th/[775,850] 18.84 15.69 10.21 10.92 8.77 7.96 7.92 7.62 6.44 5.63 14.1%/34 −15 *Prior score deciles can be uneven depending upon the prior score distribution *Prior score deciles can be uneven depending upon the prior score distribution

About this copy

Colorado SGP Calculation 2021 — Colorado Department of Education, September 30, 2021.

This is an image-based copy of the original PowerPoint slides; builds and animations are flattened.

• Talk page
• Download PDF
• Original file
• All talks