ERB Growth Model Development

ERB · August 1, 2022

ERB Growth Model Development — ERB, August 1, 2022.
Published

August 1, 2022

Event
Invited talk
Slides
24
Format
Converted from Keynote

This deck is an image-based copy of the original slides. Builds and animations are flattened; the slide text is reproduced below for search and screen readers.

Slide text
  1. ERB Growth Model Development Analyses and Initial Results Damian Betebenner — Center for Assessment August 1st, 2022
  2. Data preparation • Reading Comprehension data was received from ERB: • Fall 2019-2020: 49,582 student records • Fall 2020-2021: 73,230 student records • Spring 2020-2021: 118,071 student records • Spring 2021-2022: 142,165 student records • Data including unique student identifiers, test level, grade enrolled, date student tested. • The data contained a minor number of students with more than a single record in the testing window: 370 cases • The students last test score in the testing window (season) was utilized as their valid scale score
  3. Data preparation • LONG formatted data was produced as the first step in SGP analyses. • The R script utilized or data preparation is available here:
  4. SGP Analyses • With data prepared, the next step is to run SGP analyses using this data. • Two sets of analyses were conducted based upon discussions of student test taking: • Fall 2019-2020 to Fall 2020-2021 • Spring 2020-2021 to Spring 2020-2021 • Specifying these analyses is done through configurations available here.
  5. SGP Analyses • As a first step we calculate SGPs for students based upon the configurations specified. • The SGP model utilized for ERB Reading Comprehension data takes account of: • The student’s prior score • The date in which the student took their test in the current window • The time span between when they took their current test and when they took their prior test
  6. SGP Analyses • As a first step we calculate SGPs for students based upon the configurations specified. • The SGP model utilized for ERB Reading Comprehension data takes account of: • The student’s prior score • The date in which the student took their test in the current window • The time span between when they took their current test and when they took their prior test • The R script utilized to run the SGP analyses is available here.
  7. SGP Analyses • Analyses ran with no errors and SGPs were produced for all cohorts. • NOTE: There was no Fall Grade 1 data in the files. • NOTE: There was no Grade 12 data in the files. • Goodness of fit results are presented on the following slides
  8. Student Growth Percentile Goodness−of−Fit Descriptives 2020−2021.1 Reading Comprehension SGP, Grade 3.1 (N = 1,785) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (21.6%) Prior Achievement Level 4th Quintile (23.4%) 3rd Quintile (17.5%) 2nd Quintile (20.5%) 1st Quintile (16.9%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [260,314) 56.0 12.0 32.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 25 Extremes (Range) Highest OSS: [ 701 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 11.4 22.9 65.7 N = 35 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[126,287) 8.57 10.86 9.14 10.29 11.43 10.29 11.43 10.86 8.00 9.14 (9.8%) 100 2nd/[287,333) 9.33 9.33 12.00 8.00 8.00 9.33 10.00 7.33 12.67 14.00 (8.4%) Prior Scale Score Decile/Range * 3rd/[333,367) 10.73 12.99 7.34 13.56 9.04 9.04 10.73 12.43 8.47 5.65 (9.9%) Empirical SGP Distribution 4th/[367,385) 10.24 7.23 13.86 10.24 11.45 9.64 6.02 11.45 7.83 12.05 (9.3%) 5th/[385,419) 9.78 10.87 8.70 5.98 9.24 12.50 9.78 10.33 10.87 11.96 (10.3%) 6th/[419,445) 7.55 11.32 10.38 13.68 8.96 10.85 11.79 5.66 11.79 8.02 (11.9%) 7th/[445,477) 13.10 11.90 10.12 7.14 13.10 6.55 8.93 10.71 7.14 11.31 (9.4%) 8th/[477,519) 11.38 8.38 5.39 10.18 8.38 11.38 7.78 15.57 10.18 11.38 (9.4%) 9th/[519,589) 6.29 11.43 13.71 8.57 10.29 9.71 13.14 5.71 12.00 9.14 (9.8%) 10th/[589,650] 10.90 9.48 9.00 9.95 9.95 10.43 9.95 9.95 9.95 10.43 (11.8%) *Prior score deciles can be uneven depending upon the prior score distribution
  9. Student Growth Percentile Goodness−of−Fit Descriptives 2020−2021.1 Reading Comprehension SGP, Grade 4.1 (N = 4,081) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (27.1%) Prior Achievement Level 4th Quintile (18%) 3rd Quintile (21.7%) 2nd Quintile (18.5%) 1st Quintile (14.8%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [310,354) 86.4 4.5 9.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 22 Extremes (Range) Highest OSS: [ 750 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.5 18.1 41.5 33.8 N = 260 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[260,406) 9.58 10.81 9.58 9.83 10.07 9.83 9.83 10.07 9.83 10.57 (10%) 100 2nd/[406,437) 8.88 8.58 11.24 11.24 10.95 10.65 10.36 9.17 10.06 8.88 (8.3%) Prior Scale Score Decile/Range * 3rd/[437,461) 11.38 9.52 9.52 8.73 7.41 8.99 10.32 10.85 10.05 13.23 (9.3%) Empirical SGP Distribution 4th/[461,489) 9.29 11.20 10.93 9.02 9.56 12.30 9.29 10.38 8.74 9.29 (9%) 5th/[489,512) 8.58 9.51 8.96 11.38 12.50 8.96 10.07 10.82 9.51 9.70 (13.1%) 6th/[512,525) 9.59 12.79 7.76 14.16 6.39 9.13 10.05 5.48 14.16 10.50 (5.4%) 7th/[525,550) 11.04 9.41 11.25 6.95 9.82 10.43 10.43 10.84 8.59 11.25 (12%) 8th/[550,586) 8.83 9.45 10.06 10.88 9.03 11.29 8.42 11.09 10.47 10.47 (11.9%) 9th/[586,632) 9.66 9.90 9.66 10.14 12.32 7.97 11.35 7.97 9.66 11.35 (10.1%) 10th/[632,710] 9.84 10.29 10.51 9.84 9.40 10.29 10.74 10.07 9.40 9.62 (11%) *Prior score deciles can be uneven depending upon the prior score distribution
  10. Student Growth Percentile Goodness−of−Fit Descriptives 2020−2021.1 Reading Comprehension SGP, Grade 5.1 (N = 5,129) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (21.4%) Prior Achievement Level 4th Quintile (22.4%) 3rd Quintile (22.6%) 2nd Quintile (15.3%) 1st Quintile (18.3%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [350,397) 95.0 5.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 20 Extremes (Range) Highest OSS: [ 790 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 21.8 24.9 51.1 N = 225 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[310,445) 11.02 9.22 9.42 9.42 11.62 9.42 9.02 9.62 10.82 10.42 (9.7%) 100 2nd/[445,484) 8.82 11.18 9.02 10.98 8.63 9.80 11.18 9.80 10.39 10.20 (9.9%) Prior Scale Score Decile/Range * 3rd/[484,513) 8.52 10.76 12.11 9.42 11.21 10.76 8.97 10.31 8.74 9.19 (8.7%) Empirical SGP Distribution 4th/[513,543) 10.49 7.78 9.95 9.04 9.40 9.40 11.75 9.95 9.40 12.84 (10.8%) 5th/[543,567) 8.04 11.40 10.65 10.47 9.91 10.09 8.22 9.53 13.08 8.60 (10.4%) 6th/[567,594) 11.20 10.41 10.61 10.02 10.22 10.41 10.61 10.22 7.07 9.23 (9.9%) 7th/[594,622) 8.04 8.87 8.66 11.55 9.28 8.25 10.72 9.90 12.16 12.58 (9.5%) 8th/[622,663) 11.36 12.78 8.52 8.92 10.95 11.36 9.33 11.16 6.90 8.72 (9.6%) 9th/[663,731) 8.19 8.58 11.31 9.94 11.31 8.19 10.92 9.16 11.31 11.11 (10%) 10th/[731,750] 10.07 11.09 8.70 10.07 9.73 10.24 9.39 10.24 10.58 9.90 (11.4%) *Prior score deciles can be uneven depending upon the prior score distribution
  11. Student Growth Percentile Goodness−of−Fit Descriptives 2020−2021.1 Reading Comprehension SGP, Grade 6.1 (N = 4,836) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (20.3%) Prior Achievement Level 4th Quintile (20.5%) 3rd Quintile (22.5%) 2nd Quintile (18.7%) 1st Quintile (18%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [380,455) 91.4 8.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 35 Extremes (Range) Highest OSS: [ 860 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 11.0 22.0 67.0 N = 91 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[350,498) 9.75 8.09 10.79 10.58 9.34 9.54 11.41 10.17 9.13 11.20 (10%) 100 2nd/[498,521) 8.74 11.83 8.74 10.54 10.28 10.03 9.00 10.28 10.80 9.77 (8%) Prior Scale Score Decile/Range * 3rd/[521,541) 9.92 10.97 11.18 9.49 9.07 12.03 8.44 9.49 9.92 9.49 (9.8%) Empirical SGP Distribution 4th/[541,564) 10.70 8.56 9.53 8.75 10.89 9.34 11.67 8.56 10.31 11.67 (10.6%) 5th/[564,577) 8.18 11.32 11.32 10.69 7.86 9.75 10.38 12.26 8.81 9.43 (6.6%) 6th/[577,606) 10.20 9.48 9.33 10.79 11.52 9.04 8.60 10.20 9.77 11.08 (14.2%) 7th/[606,623) 8.43 10.54 9.94 9.64 10.54 9.64 12.05 9.04 11.14 9.04 (6.9%) 8th/[623,667) 9.24 10.61 10.15 9.70 8.79 11.36 9.39 10.45 9.85 10.45 (13.6%) 9th/[667,720) 9.87 9.64 9.64 10.54 10.76 9.42 10.54 8.97 10.54 10.09 (9.2%) 10th/[720,790] 9.91 9.72 10.09 10.28 9.16 10.28 9.91 10.47 9.91 10.28 (11.1%) *Prior score deciles can be uneven depending upon the prior score distribution
  12. Student Growth Percentile Goodness−of−Fit Descriptives 2020−2021.1 Reading Comprehension SGP, Grade 7.1 (N = 5,382) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (21.5%) Prior Achievement Level 4th Quintile (21.3%) 3rd Quintile (19.7%) 2nd Quintile (19.1%) 1st Quintile (18.4%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [407,462) 100.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 24 Extremes (Range) Highest OSS: [ 900 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 6.4 14.5 19.8 59.3 N = 172 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[380,514) 10.32 10.32 9.57 10.13 9.76 10.69 9.76 9.76 9.38 10.32 (9.9%) 100 2nd/[514,549) 8.32 10.50 10.94 8.53 13.13 7.66 11.38 9.19 10.94 9.41 (8.5%) Prior Scale Score Decile/Range * 3rd/[549,574) 10.41 8.99 10.58 10.58 7.41 10.93 8.47 11.11 10.23 11.29 (10.5%) Empirical SGP Distribution 4th/[574,601) 10.34 11.25 8.35 11.25 9.44 9.98 10.53 8.89 9.98 9.98 (10.2%) 5th/[601,623) 7.79 9.06 10.69 8.70 10.33 9.96 10.51 10.87 11.23 10.87 (10.3%) 6th/[623,646) 10.82 9.62 11.54 10.10 11.54 9.13 10.10 10.10 7.45 9.62 (7.7%) 7th/[646,681) 10.42 10.42 8.86 9.95 10.11 9.95 11.20 9.49 9.49 10.11 (11.9%) 8th/[681,722) 8.13 10.38 10.03 10.73 8.48 9.69 10.03 10.03 11.42 11.07 (10.7%) 9th/[722,773) 11.07 11.25 9.41 9.78 11.44 9.96 8.49 9.96 8.30 10.33 (10.1%) 10th/[773,860] 8.29 9.39 9.94 9.58 9.58 11.05 10.68 9.76 11.60 10.13 (10.1%) *Prior score deciles can be uneven depending upon the prior score distribution
  13. Student Growth Percentile Goodness−of−Fit Descriptives 2020−2021.1 Reading Comprehension SGP, Grade 8.1 (N = 4,505) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (20.2%) Prior Achievement Level 4th Quintile (22.8%) 3rd Quintile (17.9%) 2nd Quintile (20.5%) 1st Quintile (18.5%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [400,505) 100.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 23 Extremes (Range) Highest OSS: [ 950 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.1 26.4 34.5 37.9 N = 87 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[400,552) 9.22 9.22 9.93 10.40 9.93 9.46 10.64 11.35 9.69 10.17 (9.4%) 100 2nd/[552,585) 9.79 11.06 11.06 9.15 9.57 10.64 8.94 9.36 10.00 10.43 (10.4%) Prior Scale Score Decile/Range * 3rd/[585,607) 9.79 10.05 9.26 10.32 10.32 9.79 11.11 9.26 10.58 9.52 (8.4%) Empirical SGP Distribution 4th/[607,631) 8.62 9.24 9.86 11.29 9.65 10.47 9.86 10.06 9.45 11.50 (10.8%) 5th/[631,651) 11.09 10.62 9.93 9.24 9.01 9.24 9.01 10.62 11.09 10.16 (9.6%) 6th/[651,672) 8.82 10.43 10.70 10.16 11.76 10.43 10.43 9.89 8.82 8.56 (8.3%) 7th/[672,705) 10.40 9.25 8.67 10.40 8.86 11.56 9.25 11.56 9.06 10.98 (11.5%) 8th/[705,746) 8.84 10.61 10.81 10.02 9.82 7.27 11.59 8.06 12.57 10.41 (11.3%) 9th/[746,806) 9.95 9.73 9.73 9.73 10.41 11.09 9.95 10.18 8.82 10.41 (9.8%) 10th/[806,900] 9.57 10.00 10.00 10.43 9.79 10.85 8.72 10.43 10.00 10.21 (10.4%) *Prior score deciles can be uneven depending upon the prior score distribution
  14. Student Growth Percentile Goodness−of−Fit Descriptives 2020−2021.1 Reading Comprehension SGP, Grade 9.1 (N = 566) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (17.1%) Prior Achievement Level 4th Quintile (20.7%) 3rd Quintile (20.7%) 2nd Quintile (19.6%) 1st Quintile (21.9%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [400,548) 61.5 11.5 19.2 3.8 3.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 26 Extremes (Range) Highest OSS: [851,911) 0.0 0.0 0.0 0.0 7.1 7.1 7.1 7.1 21.4 21.4 14.3 14.3 N = 28 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[453,578) 9.09 9.09 9.09 16.36 5.45 12.73 9.09 12.73 9.09 7.27 (9.7%) 100 2nd/[578,606) 16.98 7.55 5.66 9.43 11.32 7.55 11.32 11.32 7.55 11.32 (9.4%) Prior Scale Score Decile/Range * 3rd/[606,628) 10.17 10.17 11.86 10.17 13.56 8.47 8.47 6.78 11.86 8.47 (10.4%) Empirical SGP Distribution 4th/[628,649) 7.84 11.76 7.84 11.76 5.88 15.69 7.84 9.80 11.76 9.80 (9%) 5th/[649,674) 10.00 8.33 15.00 6.67 13.33 1.67 15.00 11.67 8.33 10.00 (10.6%) 6th/[674,691) 12.00 10.00 8.00 10.00 16.00 8.00 2.00 14.00 8.00 12.00 (8.8%) 7th/[691,723) 8.33 13.33 10.00 10.00 6.67 8.33 15.00 6.67 13.33 8.33 (10.6%) 8th/[723,746) 9.26 9.26 9.26 11.11 9.26 11.11 11.11 9.26 9.26 11.11 (9.5%) 9th/[746,810) 10.61 10.61 10.61 7.58 7.58 10.61 10.61 9.09 13.64 9.09 (11.7%) 10th/[810,950] 12.07 10.34 6.90 12.07 13.79 10.34 6.90 12.07 6.90 8.62 (10.2%) *Prior score deciles can be uneven depending upon the prior score distribution
  15. Student Growth Percentile Goodness−of−Fit Descriptives 2021−2022.2 Reading Comprehension SGP, Grade 2.2 (N = 3,615) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (22.9%) Prior Achievement Level 4th Quintile (23.4%) 3rd Quintile (19.5%) 2nd Quintile (19%) 1st Quintile (15.2%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [260,276) 85.7 7.1 7.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 28 Extremes (Range) Highest OSS: [ 710 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 7.8 92.2 N = 51 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[90,234) 9.76 10.65 8.88 9.76 9.76 10.36 10.95 9.47 9.76 10.65 (9.3%) 100 2nd/[234,285) 8.85 9.92 10.99 10.46 9.12 10.19 8.58 10.99 10.46 10.46 (10.3%) Prior Scale Score Decile/Range * 3rd/[285,316) 10.06 9.77 11.49 11.21 10.34 8.05 11.21 9.20 9.48 9.20 (9.6%) Empirical SGP Distribution 4th/[316,345) 10.37 9.15 9.15 8.84 9.45 9.76 9.45 11.59 10.67 11.59 (9.1%) 5th/[345,371) 11.01 10.14 10.72 8.70 11.01 11.59 9.28 9.57 8.41 9.57 (9.5%) 6th/[371,401) 7.35 9.48 9.00 9.24 9.95 12.32 8.53 10.19 11.37 12.56 (11.7%) 7th/[401,440) 11.76 10.43 11.50 10.96 9.09 9.09 10.70 9.36 9.09 8.02 (10.3%) 8th/[440,466) 12.02 9.30 7.75 11.63 9.69 12.02 8.91 8.91 9.30 10.47 (7.1%) 9th/[466,519) 8.25 10.05 10.82 9.54 11.08 10.31 11.60 6.96 10.82 10.57 (10.7%) 10th/[519,650] 10.43 9.75 11.11 8.16 9.52 11.34 7.94 12.02 9.07 10.66 (12.2%) *Prior score deciles can be uneven depending upon the prior score distribution
  16. Student Growth Percentile Goodness−of−Fit Descriptives 2021−2022.2 Reading Comprehension SGP, Grade 3.2 (N = 5,829) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (27%) Prior Achievement Level 4th Quintile (18%) 3rd Quintile (17.8%) 2nd Quintile (21.2%) 1st Quintile (16%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [310,331) 100.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 22 Extremes (Range) Highest OSS: [ 750 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.5 19.3 22.2 54.0 N = 176 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[260,367) 8.71 9.23 10.80 10.10 10.45 9.58 10.63 10.28 10.10 10.10 (9.8%) 100 2nd/[367,406) 11.49 10.34 7.47 10.92 9.77 9.96 10.15 11.30 8.24 10.34 (9%) Prior Scale Score Decile/Range * 3rd/[406,432) 8.94 10.91 13.24 7.69 10.02 11.63 8.77 7.51 11.45 9.84 (9.6%) Empirical SGP Distribution 4th/[432,460) 9.98 8.49 9.32 10.65 9.15 10.82 9.82 11.98 8.49 11.31 (10.3%) 5th/[460,475) 10.65 11.03 10.08 8.17 11.03 7.60 9.89 10.65 10.27 10.65 (9%) 6th/[475,493) 7.57 10.87 10.17 10.17 8.98 11.35 10.40 9.93 11.58 8.98 (7.3%) 7th/[493,525) 10.53 10.88 9.95 9.49 9.95 9.61 10.07 9.26 9.61 10.65 (14.8%) 8th/[525,550) 9.11 9.29 10.75 11.84 11.29 9.29 8.56 10.75 9.47 9.65 (9.4%) 9th/[550,589) 8.69 8.85 9.84 9.18 10.16 10.66 10.66 11.31 8.69 11.97 (10.5%) 10th/[589,710] 10.98 10.65 9.82 9.48 9.65 9.82 9.98 8.65 12.31 8.65 (10.3%) *Prior score deciles can be uneven depending upon the prior score distribution
  17. Student Growth Percentile Goodness−of−Fit Descriptives 2021−2022.2 Reading Comprehension SGP, Grade 4.2 (N = 11,142) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (21.6%) Prior Achievement Level 4th Quintile (19%) 3rd Quintile (20.4%) 2nd Quintile (23.3%) 1st Quintile (15.6%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [350,381) 96.9 3.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 32 Extremes (Range) Highest OSS: [ 790 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 22.2 22.6 55.1 N = 243 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[310,413) 9.88 11.09 9.97 9.88 9.60 10.44 8.95 10.44 9.88 9.88 (9.6%) 100 2nd/[413,445) 9.28 9.76 10.53 9.57 11.10 9.09 10.05 9.86 10.05 10.72 (9.4%) Prior Scale Score Decile/Range * 3rd/[445,471) 9.44 9.44 9.36 10.24 9.36 10.77 11.12 9.62 9.89 10.77 (10.2%) Empirical SGP Distribution 4th/[471,499) 9.73 9.30 10.69 10.51 9.47 10.60 9.38 10.60 9.64 10.08 (10.3%) 5th/[499,514) 9.31 11.03 8.89 8.89 11.99 8.03 8.57 11.03 10.81 11.46 (8.4%) 6th/[514,546) 8.84 10.41 10.49 9.86 9.94 11.74 9.47 9.94 9.39 9.94 (11.5%) 7th/[546,576) 11.54 9.02 9.74 11.00 8.48 9.29 10.64 9.65 10.91 9.74 (10%) 8th/[576,614) 8.03 10.80 10.70 9.22 12.29 10.11 10.60 8.23 9.12 10.90 (9.1%) 9th/[614,663) 11.07 9.92 9.92 11.34 9.39 8.68 9.03 10.89 10.01 9.74 (10.1%) 10th/[663,750] 8.90 9.76 10.23 9.84 9.52 10.15 10.62 9.84 9.99 11.16 (11.5%) *Prior score deciles can be uneven depending upon the prior score distribution
  18. Student Growth Percentile Goodness−of−Fit Descriptives 2021−2022.2 Reading Comprehension SGP, Grade 5.2 (N = 12,752) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (19.6%) Prior Achievement Level 4th Quintile (21.6%) 3rd Quintile (21.2%) 2nd Quintile (19.7%) 1st Quintile (18%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [380,413) 100.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 24 Extremes (Range) Highest OSS: [ 860 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.5 18.4 21.3 59.9 N = 207 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[350,470) 8.91 9.27 10.56 10.38 9.64 10.47 9.37 10.28 10.28 10.84 (8.5%) 100 2nd/[470,501) 10.47 11.36 9.17 9.17 9.99 10.13 10.34 10.20 9.31 9.86 (11.5%) Prior Scale Score Decile/Range * 3rd/[501,521) 8.33 9.86 9.26 10.45 10.11 10.03 10.88 9.01 11.13 10.96 (9.2%) Empirical SGP Distribution 4th/[521,538) 9.45 8.70 11.23 12.16 10.57 8.70 6.92 12.16 9.35 10.76 (8.4%) 5th/[538,560) 10.28 11.05 8.92 8.73 9.70 10.86 12.22 8.02 10.28 9.95 (12.1%) 6th/[560,577) 9.66 10.43 11.29 8.19 9.66 9.40 9.31 13.36 7.41 11.29 (9.1%) 7th/[577,600) 9.34 8.86 11.41 10.85 9.34 11.25 9.10 9.50 11.17 9.18 (9.8%) 8th/[600,623) 8.90 10.60 8.73 11.04 10.77 10.15 8.37 8.01 10.86 12.56 (8.8%) 9th/[623,686) 10.14 10.33 10.08 9.95 9.01 9.45 11.15 10.89 9.70 9.32 (12.5%) 10th/[686,790] 9.96 9.81 9.26 10.27 10.27 10.58 9.34 10.12 10.74 9.65 (10.1%) *Prior score deciles can be uneven depending upon the prior score distribution
  19. Student Growth Percentile Goodness−of−Fit Descriptives 2021−2022.2 Reading Comprehension SGP, Grade 6.2 (N = 12,434) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (20.8%) Prior Achievement Level 4th Quintile (19.6%) 3rd Quintile (19.7%) 2nd Quintile (20.2%) 1st Quintile (19.8%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [400,447) 100.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 28 Extremes (Range) Highest OSS: [ 900 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 11.3 24.3 60.7 N = 239 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[380,505) 9.39 9.67 10.12 10.03 10.39 10.21 9.67 10.39 10.03 10.12 (8.9%) 100 2nd/[505,536) 10.16 10.01 9.93 9.56 9.64 9.71 10.60 9.71 9.79 10.90 (10.8%) Prior Scale Score Decile/Range * 3rd/[536,561) 9.19 10.75 10.32 10.32 10.75 9.45 10.06 8.93 9.63 10.58 (9.3%) Empirical SGP Distribution 4th/[561,584) 8.90 9.93 10.44 9.78 9.19 10.07 9.19 12.13 10.22 10.15 (10.9%) 5th/[584,601) 10.38 10.19 9.99 9.11 10.38 12.24 10.87 8.42 8.33 10.09 (8.2%) 6th/[601,630) 9.91 9.21 8.50 11.03 10.40 9.14 9.14 9.70 11.74 11.24 (11.4%) 7th/[630,654) 8.96 10.12 10.38 10.20 8.96 10.38 9.14 11.18 10.74 9.94 (9.1%) 8th/[654,691) 9.01 10.38 11.07 9.54 10.76 9.69 12.21 9.39 7.48 10.46 (10.5%) 9th/[691,738) 9.45 10.31 9.97 11.43 7.47 10.31 9.28 9.88 11.68 10.22 (9.4%) 10th/[738,860] 10.42 9.51 9.86 10.85 10.00 9.65 9.79 10.28 9.15 10.49 (11.4%) *Prior score deciles can be uneven depending upon the prior score distribution
  20. Student Growth Percentile Goodness−of−Fit Descriptives 2021−2022.2 Reading Comprehension SGP, Grade 7.2 (N = 13,430) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (21.3%) Prior Achievement Level 4th Quintile (20.7%) 3rd Quintile (22.1%) 2nd Quintile (17.9%) 1st Quintile (18.1%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [422,473) 100.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 30 Extremes (Range) Highest OSS: [ 950 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.6 18.2 76.2 N = 143 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[400,540) 9.98 10.45 10.22 10.22 9.67 9.67 10.37 9.21 10.22 9.98 (9.6%) 100 2nd/[540,574) 8.70 9.14 9.65 10.75 10.23 10.09 10.31 10.38 10.09 10.67 (10.2%) Prior Scale Score Decile/Range * 3rd/[574,594) 10.28 10.19 10.36 10.10 9.15 10.54 9.15 9.67 10.10 10.45 (8.6%) Empirical SGP Distribution 4th/[594,616) 9.51 10.34 9.51 9.16 9.99 9.72 9.92 11.24 9.58 11.03 (10.7%) 5th/[616,631) 9.62 9.33 10.12 12.10 9.72 9.23 10.12 9.42 9.82 10.52 (7.5%) 6th/[631,657) 9.61 10.39 10.46 9.80 10.07 10.26 10.33 9.67 10.26 9.15 (11.4%) 7th/[657,687) 9.36 9.94 9.62 9.36 10.01 10.14 9.94 10.91 9.62 11.10 (11.5%) 8th/[687,711) 9.67 9.84 10.00 11.30 9.67 9.51 9.76 9.43 10.24 10.57 (9.2%) 9th/[711,773) 9.74 10.02 10.23 8.83 10.37 10.86 9.74 10.16 9.74 10.30 (10.6%) 10th/[773,900] 9.46 10.02 9.74 10.51 9.67 9.88 10.23 9.81 10.44 10.23 (10.6%) *Prior score deciles can be uneven depending upon the prior score distribution
  21. Student Growth Percentile Goodness−of−Fit Descriptives 2021−2022.2 Reading Comprehension SGP, Grade 8.2 (N = 10,768) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (21.5%) Prior Achievement Level 4th Quintile (21.2%) 3rd Quintile (18.7%) 2nd Quintile (20.6%) 1st Quintile (18.1%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [400,478) 96.0 0.0 4.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 25 Extremes (Range) Highest OSS: [ 1000 ] 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 26.6 69.1 N = 94 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[400,572) 10.00 10.20 10.31 8.88 10.51 10.10 10.00 10.31 9.49 10.20 (9.1%) 100 2nd/[572,602) 8.61 9.34 10.27 10.48 10.06 10.37 10.17 9.54 10.79 10.37 (9%) Prior Scale Score Decile/Range * 3rd/[602,626) 10.43 11.50 8.79 10.82 9.76 9.76 9.18 8.60 9.95 11.21 (9.6%) Empirical SGP Distribution 4th/[626,649) 9.48 9.23 9.91 9.65 10.33 9.82 11.35 10.75 9.40 10.08 (11%) 5th/[649,664) 10.13 9.94 10.22 9.85 8.47 11.14 9.39 9.94 10.59 10.31 (10.1%) 6th/[664,686) 8.32 11.46 10.16 10.27 12.22 9.73 8.54 9.62 9.30 10.38 (8.6%) 7th/[686,714) 9.92 9.33 9.92 10.08 10.25 9.17 10.83 10.50 8.83 11.17 (11.1%) 8th/[714,746) 9.95 9.40 10.41 10.05 8.29 9.86 10.14 10.88 10.97 10.05 (10.1%) 9th/[746,785) 10.04 10.94 9.34 10.74 10.44 10.74 9.94 8.63 10.04 9.14 (9.2%) 10th/[785,950] 8.74 9.88 10.03 9.35 10.26 9.73 10.03 11.09 9.27 11.63 (12.2%) *Prior score deciles can be uneven depending upon the prior score distribution
  22. Student Growth Percentile Goodness−of−Fit Descriptives 2021−2022.2 Reading Comprehension SGP, Grade 9.2 (N = 1,069) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (18%) Prior Achievement Level 4th Quintile (20.5%) 3rd Quintile (15.3%) 2nd Quintile (25%) 1st Quintile (21.2%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [400,472) 77.3 18.2 4.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 22 Extremes (Range) Highest OSS: [983,1080) 0.0 0.0 0.0 0.0 0.0 0.0 7.7 19.2 23.1 19.2 11.5 19.2 N = 26 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[473,577) 9.62 8.65 8.65 10.58 5.77 13.46 9.62 11.54 12.50 9.62 (9.7%) 100 2nd/[577,605) 16.28 12.79 12.79 11.63 12.79 5.81 10.47 6.98 2.33 8.14 (8%) Prior Scale Score Decile/Range * 3rd/[605,627) 6.20 6.98 8.53 9.30 10.08 10.85 6.20 15.50 13.95 12.40 (12.1%) Empirical SGP Distribution 4th/[627,648) 13.64 12.12 10.61 9.09 13.64 4.55 16.67 1.52 10.61 7.58 (6.2%) 5th/[648,672) 11.48 12.30 11.48 7.38 6.56 9.02 12.30 7.38 13.11 9.02 (11.4%) 6th/[672,697) 5.61 9.35 9.35 14.95 14.95 10.28 8.41 12.15 4.67 10.28 (10%) 7th/[697,725) 9.38 8.33 10.42 11.46 9.38 10.42 3.12 14.58 6.25 16.67 (9%) 8th/[725,759) 10.83 12.50 9.17 6.67 10.83 6.67 16.67 8.33 11.67 6.67 (11.2%) 9th/[759,831) 12.21 10.69 11.45 9.92 9.92 11.45 8.40 8.40 10.69 6.87 (12.3%) 10th/[831,1000] 7.41 9.26 9.26 9.26 12.96 6.48 9.26 13.89 12.04 10.19 (10.1%) *Prior score deciles can be uneven depending upon the prior score distribution
  23. Student Growth Percentile Goodness−of−Fit Descriptives 2021−2022.2 Reading Comprehension SGP, Grade 10.2 (N = 406) SGP Deciles by Prior Achievement Level (Reading Comprehension) 5th Quintile (15.5%) Prior Achievement Level 4th Quintile (21.7%) 3rd Quintile (19.7%) 2nd Quintile (20.9%) 1st Quintile (22.2%) Median Student Growth Percentile Ceiling / Floor Effects Test Student Growth Percentile Range Current Observed Score 5 9 to to to to to to to to to to to to 10 20 30 40 50 60 70 80 90 95 Lowest OSS: [400,487) 63.6 13.6 18.2 4.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N = 22 Extremes (Range) Highest OSS: [843,882) 0.0 5.9 5.9 11.8 0.0 17.6 5.9 11.8 5.9 29.4 5.9 0.0 N = 17 Student Growth Percentile Range QQ−Plot: Student Growth Percentiles 19 29 39 49 59 69 79 89 99 Theoretical SGP Distribution 9 to to to to to to to to to to 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 100 1st/[430,544.5) 9.76 9.76 9.76 17.07 7.32 4.88 9.76 9.76 12.20 9.76 (10.1%) 100 2nd/[544.5,584) 12.50 12.50 5.00 7.50 7.50 15.00 10.00 10.00 10.00 10.00 (9.9%) Prior Scale Score Decile/Range * 3rd/[584,629) 10.26 10.26 17.95 7.69 12.82 10.26 5.13 10.26 10.26 5.13 (9.6%) Empirical SGP Distribution 4th/[629,664) 8.82 8.82 8.82 8.82 5.88 8.82 17.65 8.82 11.76 11.76 (8.4%) 5th/[664,691) 14.29 9.52 9.52 11.90 7.14 14.29 7.14 11.90 7.14 7.14 (10.3%) 6th/[691,720) 10.00 12.50 10.00 7.50 12.50 7.50 7.50 12.50 7.50 12.50 (9.9%) 7th/[720,754) 8.70 2.17 8.70 15.22 6.52 13.04 13.04 10.87 17.39 4.35 (11.3%) 8th/[754,785) 12.20 14.63 12.20 7.32 12.20 7.32 7.32 9.76 2.44 14.63 (10.1%) 9th/[785,879) 9.52 9.52 7.14 9.52 4.76 11.90 14.29 11.90 9.52 11.90 (10.3%) 10th/[879,1100] 14.63 9.76 14.63 7.32 9.76 12.20 7.32 9.76 9.76 4.88 (10.1%) *Prior score deciles can be uneven depending upon the prior score distribution
  24. Questions