ALCA Members PLC Domains Data Standards Map Plan Curriculum Assessment Strategies

Step-by-Step Guide for In-depth Analysis Copy

All examples in this tutorial will be generated using OCCT 5th Grade Mathematics demo data sets.

Step 1: Identify three lowest objectives and determine the rank order using Worksheet #1.
Step 2: Identify determining factors related to lowest objectives using Worksheet #2.
Step 3: Formulate suggested strategies to address concerns using Curriculum Resource guide and information recorded on Worksheets #1 and #2.

Required Resources

Steps

  1. Access Comprehend at ALCA

    1. Go to http://www.alcaweb.org.
    2. Navigate to your school district's PLC.
    3. Log into Comprehend.
    We will use Comprehend to analyze your student achievement data.

  2. Select Grade & Subject

    Locate the grade and subject you will be working with (example: OCCT 5th Mathematics) using the 1) Select Data Set option located on in the top left corner.

  3. Begin Worksheet #1

    On the In-depth Data Analysis - Worksheet #1, fill in the Grade Level, Subject, Year(s) Data Analyzed, and Teacher(s) Conducting Analysis

  4. All Filters Set to "ALL"

    Begin the data analysis process utilizing data collected with the 2) Filter Data options set at ALL.

    Later you can continue to analyze specific subgroup settings using these same steps.

  5. Analyze Trends

    To begin the SOPI Standards and Objectives Performance Index TREND Analysis, continue working in 3) Generate Reports.

    1. Click on the Aggregate SOPI % Correct report. This opens a very long menu selection.
    2. Click on the Compare Standards by Year report near the top of the menu. You should be comparing multiple years of data. This report allows you to examine trends in the data.

  6. Record Standards on Worksheet #1

    Examine the standards using the multi-year comparison. This will provide valuable evidence as you investigate patterns and the trends.

    On Worksheet #1:
    1. On the PASS Standards Description row, record each standard's description as given on the graph report.
    2. On the PASS Standard Number row, record the PASS Standard Number for each standard.
    3. Record your observations in the Trend Analysis section located just below the PASS Standard Number.
    4. Indicate fluctuating, decreasing, increasing, or flat line scores as a concern.

  7. Review Blueprint

    You will need a copy of your most current Blueprint to analyze the objectives. Fill out the Blueprint information on worksheet #1.

  8. Analyze Objectives using Worksheet #1

    Continue the SOPI Standards and Objectives Performance Index TREND Analysis by isolating the objectives for each standard. To begin the Objectives Performance Index TREND Analysis, continue working in 3) Generate Reports.
    1. Click on the Aggregate SOPI % Correct report.
    2. Click on the All Standards & Objectives report at the very top of the menu. You should look at the top of the report and determine what filters have been selected.

      * Note: Make sure that the filter selected for Test Year is for the most current year.

    3. Examine the Standards & Objectives report to identify the lowest objectives.
    4. Begin with the lowest objectives and enter the data on worksheet #1.
      Enter the objective number and SOPI % correct score in the area provided below its appropriate standard.

  9. Analyze Low Performing Objectives

    Working in 3) Generate Reports, continue the Objective TREND analysis.
    1. Click on the Aggregate SOPI % Correct report.
    2. Scroll down the menu and select the standard represented for the lowest objectives (refer to the example worksheet: for the example identified on worksheet #1 - 4.2 and 4.5, select SOPI 4.0 by Year; for 1.1, select SOPI 1.0 by Year; for 2.2, select SOPI 2.0 by Year; and for 5.1, select SOPI 5.0 by Year).
    3. Examine the report to discover trends provided in the data. Always examine multiple year data comparisons.
    4. Record any observations in the Comments and Observations section you believe will assist in prioritizing the objectives.
    5. Continue the Objective TREND analysis; follow the above step for all the identified low objectives. Continue to record any observations in the Comments section provided on Worksheet #1.

  10. Going Deeper with Data

    Before you begin this step you will need to clear some space in the student data records table.

    Hide the gender and ethnicity columns by clicking on the orange icon located at the top, middle of each column.

  11. Data for the Three Lowest Objectives

    We are now ready to add the three lowest objectives data for analysis to our student records data table.
    1. Scroll down the left side of the screen to locate the Add Columns option.
    2. Click on Add Columns, scroll down the menu to the lowest objective numbers you have isolated.

  12. Students with 0% Correct

    Move to the student record data table. Then:
    1. Click on the green box at the top of the first objective to rank the student information.
    2. Scrolling down the column, record how many students received a 0% correct score.
    3. Continue to record the data on worksheet #1 for the remaining two lowest objectives. This trend data will be valuable when prioritizing lowest to highest need.

    We will use the information collected through the TREND Analysis with worksheet #2.

  13. Working Together on Worksheet #2

    Working individually or in teams, follow the steps listed below to complete Worksheet #2.

  14. Strongest Standards

    You should be logged in to Comprehend to begin in-depth analysis worksheet #2.
    1. Fill in School Year, Grade Level, Subject, and Team Member(s).
    2. Using 1) Select Data Set, drop the menu, and select the grade and subject.
    3. Move to 3) Generate Reports, click on the Aggregate SOPI % Correct report. This opens a long menu selection.
    4. Click on the Compare Standards by Year report near the top of the menu. You should be comparing multiple years of data. This report allows you to examine trends in the data.
    5. Determine which Standard has the highest average for a three year period or has the strongest growth.
    6. Write the information in the Strength (Standards) box.
    7. Record the data to support your decision. An example is provided on the Example Worksheet #2.

  15. Identified Lowest Objectives

    Using the information from worksheet #1, record the objective number and descriptor for the identified lowest objectives in each of the three boxes provided.

  16. Lowest Objectives

    List the three lowest objectives in the order of priority as determined in Worksheet #1 data analysis. Include observations recorded in Worksheet #1.

  17. Resources

    Use the testing resource materials to determine areas of concern, lack of resources, or activities. List specific areas of concern for each identified objective listed above. Materials needed include, but are not limited to the appropriate Blueprint, PASS Standard, Performance Level Descriptor, DoK Descriptor, Sample Items, Content Vocabulary, and Essential DoK Words.

  18. Discussion

    Continue to investigate and discuss areas of concern on page 2 of worksheet #2. Follow the directions listed in each section.

  19. Monitoring Standards and DoK Usage

    Use the Standards Cluster Excel Files to monitor standards, objectives, and depth of knowledge (DoK) levels addressed during instruction.

    Strategies may include:
    1. As a daily review of material covered, have students identify the objectives and DoK levels addressed during the period.
    2. Using sticky notes, have students brainstorm pre-skills needed to accomplish "objectives" addressed that period. Have them "classify" them into groups.
    3. Have a standards table (Excel files will be added to folder soon) where students are held accountable for monitoring standards along with teacher.
    4. On a regular basis, have students compare their standards table with the teacher's Standards Cluster Excel file.
    5. Use your own imagination and enjoy the learning.

Please enter a Registration Key to continue.