Dashboard Metric: STAAR EOC Advanced Performance

Background

The State of Texas Assessments of Academic Readiness (STAAR) program is designed to measure the Texas Essential Knowledge and Skill (TEKS) curriculum standards. In spring 2012, the STAAR assessment replaced the Texas Assessment of Knowledge and Skills (TAKS) assessment. The STAAR assessment includes grade-level assessments for grades 3-8 and end of course (EOC) assessments for high school level subjects. STAAR EOC exams are administered at the end of the fall, spring, and summer semesters. Students sit for EOC exams upon completion of the course. The EOC assessments will be administered in the following subjects:

English I, II, III
Algebra I, II
Biology
US History

The STAAR assessment is available in the following forms: paper, online (EOC only), braille, and Spanish.

There are four versions of the STAAR assessment:

STAAR replaces the TAKS assessment and includes assessments for grades 3-8 and End of Course exams for high school level subjects.
STAAR Alternate 2 meets the federal requirements mandated under the Elementary and Secondary Education Act (ESEA) and is designed for the purpose of assessing students in grades 3-8 and high school who have significant cognitive disabilities and are receiving special education services.
STAAR L is a linguistically accommodated English version of the STAAR for grades 3-8 and EOC mathematics, science, and social studies assessments. It is provided for English Language Learners (ELLs) who meet participation requirements for a substantial degree of linguistic accommodation in these subject areas. After the December 2016 administration, STAAR L will no longer be administered.

There are three levels of academic performance for the STAAR EOC assessment:

Level III: Advanced - student is well prepared and has a high likelihood of success in the next grade or course; student also demonstrates the ability to think critically and apply the assessed knowledge and skills in varied contexts both familiar and unfamiliar and will require little to no academic intervention.
Level II: Satisfactory– student is sufficiently prepared and has a reasonable likelihood of success in the next grade or course; student also demonstrates the ability to think critically and apply the assessed knowledge and skills in familiar contexts and may require short term, targeted academic intervention.
Level I: Unsatisfactory– student is inadequately prepared and unlikely to succeed in the next grade or course; student does not demonstrate a sufficient understanding of the assessed knowledge and skills and will require ongoing academic intervention.

For this metric, the dashboard will display the percent of students who are performing at or above Level III in any of the subject areas listed above.

Primary Metric

STAAR EOC Advanced Performance

User Interface

Dashboard Example

Figure 1 shows the STAAR EOC Advanced Performance metric as seen on the campus dashboard.

Figure 1 TSDS STAAR EOC Advanced Performance Metric

Status Definition on the Dashboards

This metric provides information regarding the advanced performance of students on a campus for the STAAR EOC Assessment. The Status Indicator is determined by the campus-specific thresholds (campus goals) which are set at the district level. The Texas Student Data Systems (TSDS) default threshold is 40% of students performing at or above Level III.

English I, II, III
Algebra I, II
Biology
US History

Table 2 Metric Indicators for TSDS STAAR EOC Performance Metric

Metric Indicators			Comparisons
Container Name	Granular Name	Metric Status Indicator (a)	Trend:	Campus Goal (Delta) (b)
STAAR EOC Advanced Performance	English I	Red = if the percentage of students meeting the standard (Level III) is less than the campus goal (40%) Green = if the percentage of students meeting the standard (Level III) is greater than or equal to the campus goal (40%)	Current and prior administration	Campus goal and the calculated percentage of students meeting the standard
	English II	Red = if the percentage of students meeting the standard (Level III) is less than the campus goal (40%) Green = if the percentage of students meeting the standard (Level III) is greater than or equal to the campus goal (40%)	Current and prior administration	Campus goal and the calculated percentage of students meeting the standard
	English III	Red = if the percentage of students meeting the standard (Level III) is less than the campus goal (40%) Green = if the percentage of students meeting the standard (Level III) is greater than or equal to the campus goal (40%)	Current and prior administration	Campus goal and the calculated percentage of students meeting the standard
	Algebra I	Red = if the percentage of students meeting the standard (Level III) is less than the campus goal (40%) Green = if the percentage of students meeting the standard (Level III) is greater than or equal to the campus goal (40%)	Current and prior administration	Campus goal and the calculated percentage of students meeting the standard
	Algebra II	Red = if the percentage of students meeting the standard (Level III) is less than the campus goal (40%) Green = if the percentage of students meeting the standard (Level III) is greater than or equal to the campus goal (40%)	Current and prior administration	Campus goal and the calculated percentage of students meeting the standard
	Biology	Red = if the percentage of students meeting the standard (Level III) is less than the campus goal (40%) Green = if the percentage of students meeting the standard (Level III) is greater than or equal to the campus goal (40%)	Current and prior administration	Campus goal and the calculated percentage of students meeting the standard
	US History	Red = if the percentage of students meeting the standard (Level III) is less than the campus goal (40%) Green = if the percentage of students meeting the standard (Level III) is greater than or equal to the campus goal (40%)	Current and prior administration	Campus goal and the calculated percentage of students meeting the standard

(a) The Metric Status Indicator column displays the percent of students who attained Level III on the most recent STAAR assessment.

(b) Campus Goal (Delta) directly relates to the “Difference from Goal” column on the campus dashboard.

Trends

Trend Indicators: Objective is to indicate STAAR EOC Advanced Performance
	Up Green	If the value for the current time frame is more than 10 percentage points higher than the prior time frame, then display a green arrow trending upward.
	Unchanged	If the value for the current time frame is less than or equal to 10 percentage points higher or is less than or equal to 10 percentage points lower than the prior time frame, then display two gray arrows pointing outward indicating no direction.
	Down Red	If the value for the current time frame is more than 10 percentage points less than the prior time frame, then display a red arrow trending downward.

The trend does not show for the first occurrence of a time frame since data is not available.

Delta Definition

The Delta column displays the absolute value of the difference between the campus percentage (Status column) and the campus goal percentage (Campus Goal column).

Table 4 Delta Indicators for STAAR EOC Advanced Performance Metric
Delta Indicators: Objective is to indicate STAAR EOC Advanced Performance
Metric Name	Sub-Metric Name	Campus Goal	Delta
STAAR EOC Adv Performance	English I	Set campus goal	Red (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is less than the campus goal Black (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is equal to or greater than the campus goal
	English II	Set campus goal	Red (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is less than the campus goal Black (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is equal to or greater than the campus goal
	English III	Set campus goal	Red (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is less than the campus goal Black (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is equal to or greater than the campus goal
	Algebra I	Set campus goal	Red (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is less than the campus goal Black (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is equal to or greater than the campus goal
	Algebra II	Set campus goal	Red (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is less than the campus goal Black (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is equal to or greater than the campus goal
	Biology	Set campus goal	Red (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is less than the campus goal Black (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is equal to or greater than the campus goal
	US History	Set campus goal	Red (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is less than the campus goal Black (Delta Percentage) = if the STAAR EOC Advanced Performance percentage is equal to or greater than the campus goal

Periodicity

Best practice is to load the data for this metric each time there are new assessment files.

Table 3 Recommended Load Characteristics for TSDS STAAR EOC Advanced Performance

Recommended Load Characteristics
Calendar	Following Spring, Summer, and Fall administrations
Frequency of data load	When new files are available
Latency	Yearly
TSDS Interchanges	InterchangeAssessmentMetadata InterchangeStudentAssessment

Tooltips

The standard tool tips for the metric definition, column headers, and help functions display for this metric.

The following are tooltips specific to the metric:

Green metric status: OK
Red metric status: Not Met
'More' indicates drill down views for this metric
“Getting better from prior period.”
“Getting worse from prior period.”
“No change from the prior period.”

Business Rules

STAAR EOC Advanced Performance metric contains data for the STAAR assessment. The subject areas will display as granular metrics.

This metric displays the percent of students who have achieved Level III for the most recent administration of the STAAR EOC Assessments in the following subject areas:

English I, II, III
Algebra I, II
Biology
US History

Middle and high school students are included in this metric. Students may begin taking End of Course Exams as early as 7^th grade, if they are enrolled in any of the courses listed above.

The status is determined by the calculation of how many students met the standard divided by how many students took the assessment.
If a student meets Level II requirements it is inferred that the student met Level I requirements.
If a student meets Level III requirements it is inferred that the student met Level II requirements.
All students who achieved Level III for STAAR will be included in the calculation of students who achieved advanced performance.

What to display:

The container metric will always display. Granular metrics will only be available when scores are available.

Computed Values

This campus metric is a roll-up for the cohort of current students, across all subject areas tested in the campus. It is computed from the last set of STAAR EOC scores loaded as follows:

For the majority of the year, the previous year’s STAAR EOC scores are reflected
Toward the end of the year, the current year’s STAAR EOC scores will be loaded

STAAR EOC Advanced Performance	Calculation	Excluded Students
Each subjects’ percentage	(Number of students in cohort who achieved Level III for the subject / total number of students in cohort who took the test in the subject) * 100	Absent or exempt students Transfer students with no STAAR data (previous or current year) available Students who took an alternate version of the STAAR assessment

Data Anomalies

Anomalies

Metrics are sensitive to when and how often the data is loaded
Early education and Pre-Kindergarten students and students in grades 1 and 2 are not included in the data.
Students receiving instruction in a grade higher than the grade in which they are enrolled will be assessed at the higher level if the content covers the entire curriculum for that subject.
Late enrollees may have taken the STAAR at their previous school.
Data will be loaded from multiple administration dates.
STAAR metric will display the most recent exam data.
Campus rollups of STAAR Performance will display the performance of students who took STAAR that are still enrolled on that campus. (Ex: when an 8^th grader moves to high school their data will no longer be reflected in their middle school’s campus STAAR Performance metric)

Footnotes

Students are excluded as a result of non-participation
Students are excluded as a result of alternate testing (STAAR-Alt or STAAR-M)
Exclusions and numbers are found at the bottom of the student list under the 'More' menu

Date of Refresh

Best practice is for the date of the last data refresh to appear next to the metric in the following format:

(Through April 2010)

Implementation Considerations

Incomplete Transcripts and Missing STAAR Scores

Transfer students may have incomplete transcripts that do not show prior STAAR participation.

Drill Downs

Drill Down View

This metric includes the option to drill down for information that is associated with this metric. Table 4 lists the drill down views that are defined for this metric.

Table 4 Metric Drill Down Views for STAAR EOC Advanced Performance Metrics

	Grade Level Chart	Graph of percent of students meeting the student threshold for the metric by grade level
	Student List	List of students who achieved Level III on the most recent STAAR EOC administration

The objective is to provide a measure of readiness for the next level within a subject area.

User Interface Notes

Dashboard Example

Figure 2 shows the STAAR EOC Advanced Performance Grade Level Chart drill down.

Figure 2 STAAR EOC Advanced Performance Grade Level Chart

Figure 3 shows the STAAR EOC Advanced Performance StudentList drill down, which links to the student dashboard.

Figure 3 STAAR EOC Advanced Performance Student List

Business Rules

The Grade Level Chart will display data for that subject area by grade level.
The chart will be a bar graph.
The chart will display

o Green bar = if that grade level met the standard

o Red bar = if that grade level did not meet the standard

The hover over the bar on the graph will display the percent of students who met the standard in that subject area in that grade level as well as the number of students who met the standard out of the number of students who took that assessment in that subject area.