How EOC Exams Adapt to Each Student
If we are measuring ability to achieve specific CCSS or HCPS III benchmarks, why is there a difference in difficulty attached to the items that are given to some students and not others?
The EOC exams are online adaptive exams, which means that students answer different sets of items. The online adaptive EOC Exam System selects items for each student that most accurately align with his or her performance on the exam based on the items that have been answered to that point. In general, students who are doing well on the exam will see more difficult items, and students who are struggling will see easier items. Regardless of the difficulty of the items, all students are tested on the breadth of the content for the course, and all students get an opportunity to demonstrate their higher-order thinking skills.
How is a student’s achievement for an EOC exam measured if there is the factor of difference in difficulty of items given to students?
Each item has a measured difficulty based on the field-test results, so the items can be arranged along a scale. Student scores lie along that same scale. Imagine two students, one getting difficult items and the other receiving easier items. Suppose they both answer half of their items correctly. The student with the more difficult items will receive a higher score. This is made possible through a statistical process known as equating, and it is used on virtually all contemporary tests.
The standard error of measurement (SEM) also needs to be considered when reviewing a student’s scores for an EOC exam.
The observed score on any exam is an estimate of the true score. If a student took a similar exam several times, the resulting scale score would vary across administrations, sometimes being a little higher, a little lower, or the same. The SEM represents the precision of the scale score, or the range in which the student would likely score if a similar exam was administered several times. The “+/–” next to the student’s scale score provides information about the certainty, or confidence, of the score’s interpretation. The boundaries of the score band are one standard error of measurement above and below the student’s observed score, representing a range of score values that is likely to contain the true score. For example, 310 ± 10 indicates that if a student was tested again, two out of three times the student’s true score would likely fall between 300 and 320.
Because students are administered different sets of items of varying item difficulties for an EOC exam, the SEM can be different for the same scale score, depending on how closely the administered items match the student’s ability.
A student’s scale score should be evaluated after the SEM is added to or subtracted from the scale score. This provides a score range that includes the student’s true score with 68 percent certainty (i.e., across repeated administrations, the student’s test score would fall in this range about 68 percent of the time).
The student’s true score can lie outside the score band. The score band contains a student’s true score with 68 percent certainty; therefore, the student’s true score can lie outside the score band.
How are the DOE and testing office informing teachers, parents, students, and the public about the way students are being tested, e.g., the adaptive construction for the EOC exams?
Teachers, parents, students, and the public are encouraged to visit the non-secure online EOC Exams Portal (alohahsap.org), where information about how the adaptive online EOC Exam System works is posted under the Resources section.
What is the purpose of making the EOC exams adaptive?
An adaptive exam gives a more precise estimate of ability for most students than a comparable fixed-form exam. This provides better instructional information, more accurate measures of growth, and a challenging but accessible testing experience for each student.
Does the adaptive nature of an EOC exam mean that items will include more difficult or less difficult knowledge and skills taught during the course?
No. Only the Common Core State Standards assigned to the Algebra I and Algebra II courses and the Hawai‘i Content and Performance Standards (HCPS III) assigned to the Biology I and U.S. History courses are assessed using the online adaptive EOC Exam System.
If teachers are going to be evaluated on the progress of their students on the EOC exams, how is the adaptive construct being factored in?
The adaptive design makes the EOC exams among the fairest ways to measure student growth because the design can accurately measure students along a broader range of the proficiency continuum. This is not always the case with traditional tests that administer the same items to every student.
How does marking an item for review during an exam affect the next item? Does it lower the level and value? Does it remain at the same difficulty level?
Marking an item for review does not in any way affect the selection of subsequent items. It is simply a way for a student to make a note to himself or herself to review the initial answer for an item. Only a student’s initial response to an item (independent of whether the item is marked for review), which is used to update the student’s ability estimate, will affect the selection of subsequent items. If a student changes the initial response to a marked or unmarked item, the change in response will result in an update of the student’s ability estimate, which will affect the selection of any additional items.
EOC Exam Format and Content
Which EOC exams must students take?
All students enrolled in a Biology I course are required to take the corresponding Biology I End-of-Course Exam. If students are enrolled in Algebra I, Algebra II, or U.S. History courses, their school may require students to take the optional EOC exam for each course in which they are enrolled. Applicable 2016-2017 EOC Exam testing window(s), are listed on the EOC Exams Portal at alohahsap.org. The EOC Exams are not grade-level specific and can be taken by any student enrolled in one or more of the four courses at their school of record, via an E-School course, or a summer school course.
Intermediate/middle schools that offer any of these courses, e.g., Algebra I, may also administer the optional EOC exams to students enrolled in these courses.
Students will be given one opportunity during the last two to four weeks of a course to take the corresponding EOC exam.
What is the purpose of an EOC exam?
The purpose of an EOC exam is to measure student proficiency based on the content standards assigned to the associated course, inform instruction, and standardize course expectations. The Algebra I and Algebra II exams measure identified Hawaii Common Core Standards; Biology I and U.S. History measure identified Hawaii Content and Performance Standards, Third Edition, benchmarks.
How and when will the EOC exams be administered?
The EOC exams will be administered online via the AIR Secure Browser used for the administration of the Hawai‘i Statewide Assessment Program (HSAP) during the last two to four weeks of the course.
Paper/pencil versions of the EOC exams will be available for students who are receiving services at alternative sites that do not have Internet access during the 2016-2017 testing windows. Further information about the paper/pencil EOC exams may be found in the Hawaii State Science Assessments and End-of-Course Exams Test Administration Manual located on the EOC Exams Portal at alohahsap.org.
What types of items are on the EOC exams?
Students will answer several types of items for the online EOC exams:
- Multiple-choice and multi-select items, in which students will select an answer option from a set of possible choices
- Constructed-response items that include the following:
- Natural language items, in which students will type a short answer in an answer space
- Interactive items, in which students will use the mouse or keyboard to move items or draw responses in an answer space (also called a “grid”)
- Equation editor items, in which students will input any mathematical expression or equation
- Simulation prompts, in which students will interact with data and provide answers in varied formats
Go to the EOC Exams Training Tests (with a Firefox web browser or the Secure Browser) and the Interactive Item Tutorial on the EOC Exams Portal at alohahsap.org to see some of these types of items.
Training and Communication Resources
What training and resources are available for the online EOC Exam System?
TA Certification Course
Anyone who will be administering an online EOC exam to students must first pass the online TA Certification Course. To access this course, Test Administrators will need their username and password. Test Administrators will not be able to log into the Test Administrator (TA) Live Site without passing this course. Please note that this requirement does NOT include proctors because they will not be using the online EOC Exam System. Proctors will only assist with monitoring students during EOC exams. Even if you were certified for the 2015-2016 administration, you must retake the online TA Certification Course because it has been updated for the 2016-2017 school year.
Training and Practice Tests
The Training and Practice Tests site can be used to access training tests and practice tests online to become familiar with the online EOC exams.
The short Training Tests are designed to provide students and teachers with opportunities to familiarize themselves with the software, user interfaces, and navigational tools that they will use on the respective online tests. The questions on the Training Tests were selected to provide students with an opportunity to practice a range of question types and may be the same for multiple grades.
The Practice Tests mirror the content of the various tests. The Practice Tests allows teachers, students, parents, and other interested parties to experience a full assessment or exam and gain insight into how the test will assess students’ mastery of the appropriate content standards.
The Department of Education recommends that the Practice Tests be accessed through the HSAP Secure Browser (which may be downloaded from the EOC Exams Portal at alohahsap.org) in order to replicate, as much as possible, actual testing conditions. The Test Administrator may create a training test session in the TA Training Site and have the students log in using their login information and the session ID generated in the TA Training Site.
Students may access the Training Tests through a web browser, such as Firefox; however, text-to-speech and other features may not be available. No password is needed to try out the Training Tests using a web browser.
Scores are not provided for the Training and Practice Tests. When students complete a Practice Test and click [End Test] and select “Yes” to continue to the next page, they should click “Review My Answers” to check their answer for each question while also reviewing the Scoring Guide or Answer. Once the student clicks “Submit Test,” all of their answers will be erased. Practice Test answers cannot be printed. Answer keys for the Training and Practice Tests can be accessed on the Student Training and Practice Tests login page. Students and others can print out the answer keys and refer to them as they proceed through the training tests.
Training Modules and General Resources
Training modules for individual testing systems are posted in the “Training and Webinars” resources section on alohahsap.org.
A number of manuals, user guides, and a list of Important Dates are also available to assist with the use of the online EOC Exam System. Go to the EOC Exams Resources page on alohahsap.org to view all available information. Additionally, the HSAP Help Desk is available from 7:30 a.m. to 4:00 p.m. HST, Monday–Friday (except holidays) at 1-866-648-3712 or email@example.com.
Can a Test Coordinator find out which Test Administrators have passed the Online TA Certification Course?
Yes. Test Coordinators will be able to use the TIDE system to verify which Test Administrators in the school have passed the online TA Certification Course. This information will be available in the “Trained User” column in the “View/Edit Users” tab in TIDE. This column will be set to “YES” (if the Test Administrator has passed the course) or “NO” (if the Test Administrator has not passed the course).
Are hardcopies of all the online user guides and manuals available?
No. If hardcopies are preferred, school-level personnel will need to download and print their own copies.
When should schools inform parents that a Parent Information Booklet for the EOC exams can be viewed online in English and 14 additional languages?
The Department of Education recommends that schools have students hand carry home an announcement about the testing window for each EOC exam during the first and second semesters of 2016-2017 depending on their block or traditional schedules, and the address of the website where families can view the Parent Information Booklet about three weeks before the students take one or more of the four EOC exams.
EOC Exam Administration and Results
When and where will the students take the EOC exams?
EOC exams may be administered at any time during school hours within the applicable testing window(s). Students can be tested in any room that provides a quiet environment where other students are not participating in learning activities and where there are enough computers for a group of students, plus one computer for the Test Administrator. Some schools will use computer labs, and others will use mobile computer carts brought into classrooms.
Students enrolled in E-School courses that have corresponding EOC exams must be administered the exam in a secure environment. In most situations, this will be at the student’s school of record. E-School teachers are to communicate with each E-School student’s school of record Test Coordinator to ensure that the E-School student is administered the EOC exam. E-School teachers may administer the EOC exams face-to-face with E-School students in a secure testing environment.
How much time is required to administer an EOC exam?
The administration of most EOC exams will require approximately 90 minutes. Students may be given as much time as needed to complete an exam and a student may pause his or her exam and complete it on a later date that is still within a particular EOC exam testing window.
Must all students be tested online?
With the exception of students who need to take the paper/pencil version of each EOC exam at an off-campus site that does not have Internet access, all students must be tested on a computer with an Internet connection. Ultimately, all student responses must be entered into the online system. The use of a scribe to record all responses online is allowed for students using approved and verified accommodations. Refer to the Hawaii State Science Assessments and End-of-Course Exams Test Administration Manual for details on accommodations.
How many times will a student be able to take an EOC exam?
Students will be given one opportunity during the last two to four weeks of the course to take an EOC exam within a particular testing window.
What happens if a student is unable to test during the regular testing window?
Students who are absent during their school’s scheduled test session(s) can be tested at any time during the testing window. Make-up testing should occur during the normal testing window.
Will text-to-speech and Braille be available for the EOC exams?
The Algebra I, Algebra II, Biology I, and U.S. History EOC Exams will have text-to-speech versions available for testing during 2016-2017 for students approved to use the text-to-speech embedded designated support. The text-to-speech feature, if required for a student, must be enabled in TIDE or the TA Live Site for each student before they are approved for testing.
An online Braille version will be available for the Biology I EOC Exam.
Will schools be responsible for the online administration of EOC exams to students who are receiving educational services off campus at alternative sites, at home, or at a hospital?
Yes, if the following criteria are met:
- Students are enrolled in a Biology I course.
- Students are enrolled in an Algebra I, Algebra II, or U.S. History course at a school that requires students to take the optional EOC exam for each course in which they are enrolled.
- Students must be able to cope with the EOC exam administration requirements based on their documented physical, mental, or emotional needs.
Refer to the Student Participation section in the Hawaii State Science Assessments and End-of-Course Exams Test Administration Manual for details.
What if students transfer during the testing window?
If students transfer from school to school during any EOC exam testing window, the system will keep a record of any complete or incomplete EOC exams. After students transfer, they can resume where they left off, including finishing any incomplete EOC exam before the end of the appropriate testing window. From the Plan and Manage Testing section available in the TIDE system, Test Coordinators will be able to see which students have or have not completed an EOC exam for a course in which they are currently enrolled. However, a transferring student’s enrollment information must be updated in Infinite Campus by the receiving school’s registrar before it can be included in the Department’s nightly upload to the TIDE system.
How will I know which students still need to take one or more of the online EOC exams before the testing window ends? Will I be able to print a master list of all students who did not finish the EOC exams so that I can schedule make-ups or completion sessions?
The online EOC Exam System automatically keeps track of which students have and have not completed their EOC exams for the courses in which they are currently enrolled. Test Coordinators will have access to this information through the Plan and Manage Testing section in the TIDE system. The Plan and Manage Testing section will show which students have completed one or more of the EOC exams for the course(s) in which they are currently enrolled. The HSAP TIDE User Guide, which explains how to access and read these reports, is available on the EOC Exams Resources page at alohahsap.org.
If a student logs in and realizes an error in his/her information (e.g., misspelled name), does the student have to wait 2–3 days to get that corrected, or should he/she go ahead and take the EOC exam?
If any of the student’s information in the student testing site is incorrect, the student should not proceed with testing. The student should log out, and the Test Coordinator should be notified. The student’s record must be updated in Infinite Campus before he or she can begin testing. The Department of Education uploads student information from Infinite Campus and eCSSS to the online TIDE system on a nightly basis. Student records should be updated within 48–72 hours. After a student’s record has been updated, he or she can begin testing.
How do students log into the HSAP Secure Browser to take an exam?
Students must use their legal first name (as it appears in Infinite Campus and TIDE), their 10-digit State Student ID Number (SSID), and the test session ID that will be generated by the Test Administrator in the TA Live Site. Student information will be pre-loaded from Infinite Campus and eCSSS into the online TIDE System. If inaccurate student information exists in the online TIDE system, it must be corrected by the school’s registrar in Infinite Campus. Information from Infinite Campus and eCSSS will be automatically updated each night into the online TIDE system. Test Administrators will be able to look up a 10-digit SSID number using a search feature.
Where do I find the 10-digit State Student ID Number (SSID) for a student? Can Infinite Campus export students’ 10-digit ID numbers?
The 10-digit SSID is available to schools through Infinite Campus. Your clerk or registrar should be able to provide a roster of 10-digit SSIDs and student names.
Can Test Administrators help students log in?
Students need to log into the system using their legal first name and 10-digit SSID number. Test Administrators may assist students with this if necessary. This information can also be provided to students on a card, or a test ticket generated in TIDE, before the test session begins to help them type the information in accurately. Please remember that 10-digit SSIDs are confidential information, and cards/test tickets must be collected and stored in a secure location or shredded after all testing for 2016-2017 has been completed.
Can a Test Coordinator create the EOC exam sessions for Test Administrators using their passwords prior to the day and time of an EOC exam?
No. Test Coordinators cannot create EOC exam sessions ahead of time for Test Administrators. Exam sessions can only be created on the day of an EOC Exam. As a reminder, Test Administrators should NOT give their passwords to anyone (even Test Coordinators). Test Administrators can create their exam session on the day of an EOC exam before the actual exam session if they wish. However, the Test Administrator must remain logged in to keep the EOC Exam session active. Once Test Administrators log out of the TA Live Site, the exam session will end and cannot be resumed.
What if I cannot see the whole session ID?
In the web browser toolbar, there is an option to change the text display size. For example, in Internet Explorer, you would click “View” and “Text Size” and then select “Smaller” or “Smallest.” Once the text display size has been reduced, you may need to restart your browser and navigate to the TA Live Site before the change takes effect. This change should allow you to see the whole session ID.
If a student needs more time for an EOC exam and has to continue later, can a different Test Administrator administer the rest of the exam?
The student can be assessed by anyone who is certified to administer the online EOC exams. The student can complete an exam that was begun in one session in a later session. The online EOC Exam System keeps track of which EOC exams students have started and completed and allows students to access an incomplete exam in a later session. The EOC exam belongs to the student, not to a session. The Test Administrator should start a new exam session and include the incomplete EOC exam (e.g., Algebra I), and the student should enter the new exam session. If the student has already started an EOC exam, he or she will be able to resume it (provided it is being resumed within the testing window for that exam).
If a Test Administrator is administering an EOC exam to some students in a class and another Test Administrator is in charge of administering the same EOC exam to the students needing accommodations from that class, do the groups need to use the same test session ID?
Students from the same class who take EOC exams at different times or with different Test Administrators do not need to use the same test session ID. In this example, the person managing the accommodations group can create a different test session with his or her login and administer the EOC exam to students that way. If each Test Administrator is in a different computer lab or setting, each needs to create his or her own test session. When the test session is created, a session ID is provided by the system, and that session ID is required as part of the student login process.
Why do the online Algebra I and Algebra II EOC Exams have two segments?
The online Algebra I and Algebra II EOC Exams are divided into two segments. The first segment provides students with access to an online pop-up scientific calculator and the second segment provides students with access to an online pop-up combined scientific/graphing/regression calculator. Students will not be allowed to review items in the first segment after advancing to the second segment.
What tools may students use during the EOC exams?
For the online Algebra I and Algebra II EOC Exams:
- Pop-up scientific and combined scientific/graphing/regression calculators will be available to students in the online EOC Exam System. Only the online scientific and combined scientific/graphing/regression calculators may be used by students for the online Algebra I and Algebra II EOC Exams. Handheld calculators may not be used for the online Algebra I and Algebra II EOC Exams.
- Students may also use a Mathematics Reference Sheet during the Algebra II EOC Exam. A pop-up Mathematics Reference Sheet will be available to students in the online EOC Exam System; this sheet may also be copied and handed out to students. A Mathematics Reference Sheet for Algebra II is available on the EOC Exams Resources page at alohahsap.org. Keep in mind that all paper copies must be collected at the end of the exam session. Any paper copy with a student’s writing on it must be shredded immediately after each exam session.
- Students may use scratch paper and printed copies of keyboard shortcuts during any of the exams. Students taking the Algebra I and/or Algebra II EOC Exams may use graph paper for scratch paper. Sample graph paper is available at alohahsap.org. Again, all paper copies must be collected at the end of the exam session. Any paper copy with student writing on it must be shredded immediately.
Electronic and bilingual dictionaries cannot be used for any online EOC exams. Further information can be found in the Universal Tools, Designated Supports, and Accommodations section of the Hawaii State Science Assessments and End-of-Course Exams Test Administration Manual.
Can a poster of the keyboard shortcuts be displayed during an EOC exam?
Yes, posters of keyboard shortcuts may be displayed.
What if students are absent during an EOC exam administration?
Students can take an EOC exam any time during the appropriate testing window. Because of the adaptive nature of the online EOC Exam System, different students may see different items in a different order, making test security less of a concern and therefore making it easier to test students at different times.
What Universal Tools, Designated Supports, and Accommodations are available for ELL, IDEA-eligible, and Section 504 students?
The full list of available Universal Tools, Designated Supports, and Accommodations for the online EOC exams can be found in the Hawaii State Science Assessments and End-of-Course Exams Test Administration Manual.
What if students cannot use a mouse?
Students can navigate the online EOC exams using a mouse or the keyboard. A list of keyboard shortcuts is provided for students within the online EOC Exam System.
Can Test Administrators help students with the constructed-response items? For example, if students have difficulty placing objects on a grid or typing their response, can the Test Administrator assist them?
Test Administrators need to have students pause their exams if they cannot use the online tools independently to answer constructed-response items, so they can receive more practice using these tools while answering the Training Test or Practice Test items for each EOC exam. If a student still cannot use the online tools independently, even after additional practice, he or she must be tested in an individual setting. A Test Administrator must serve as a scribe in an individual setting where the student can answer each constructed-response item verbally so the Test Administrator can enter it online.
What if it takes students more than 30 minutes to answer one test item? Will they be timed out?
If it has been 30 minutes since a student last answered a test item, the following message window will appear on the student’s screen: “Are you still there? Click OK to continue or you will be logged out in 30 seconds.” In order to keep the student’s test session active and enable the student to review items answered earlier in the session, the student must click “OK” and answer the item on which he or she is currently working. If the student does not respond, the student will be logged out in order to protect test security and privacy. If the student is logged out, he or she will not be allowed to go back and review his or her answers. You can also instruct students to raise their hands and ask for help if they see a message on the screen that they are not sure how to handle.
Can a Test Administrator be logged out of a session after 30 minutes of inactivity? What must a Test Administrator do to prevent being logged out?
Yes, as a security measure, TAs are automatically logged out after 30 minutes of user inactivity and student inactivity in the session, which results in closing the test session. To prevent being logged out of the system the TA, or any student who is testing in the active Session ID, must click on their screen at least once every 30 minutes.
If a TA is automatically logged out, the status of the test session will change to “closed” and all in-progress tests in the session will be paused. The TA will need to log back into the TA Site, start a new session, and provide the new Session ID to students who need to resume testing.
What should a student do if an item or graphic fails to load properly during an online EOC exam? For example, if the item’s graphics or multiple-choice response options do not entirely or correctly display on the student’s screen?
If an item or graphic does not load, the student will need to pause the EOC exam and log back in. If the item or graphic still fails to load, the Test Administrator will need to contact the HSAP Help Desk (firstname.lastname@example.org or 1-866-648-3712) and provide the agent with the following information: the student’s 10-digit SSID number and grade level, the name of the EOC exam, the opportunity number, and the corresponding item number in that student’s exam. Additionally, it is important that the student NOT click on an answer option for this partially loaded item or graphic in order to complete the test and submit it for scoring before this item can be correctly displayed or replaced with another online item. It is recommended that additional computers be available for testing in case a student’s computer freezes or shuts down unexpectedly.
How does a Test Coordinator request a grace period extension (GPE) or an EOC exam reset for a student whose test session was affected by a testing incident?
If a student’s exam has been paused for more than 30 minutes due to a major disruption, such as a fire drill, a school-wide power or Internet outage, or a natural disaster, the student will not be allowed to review his or her answers to the items answered before the disruption. The Test Coordinator may submit a request in TIDE to allow a student to revisit a paused exam (Grace Period Extension [GPE]), which will allow the student to review his or her answers. However, the student’s exam should be immediately paused, and he or she should NOT be allowed to continue answering any additional items. In the “Test Impropriety” tab of TIDE, the Test Coordinator will need to submit the student’s 10-digit SSID number, the result ID located in the Plan and Manage Testing section in TIDE, or the session ID, along with the reason for making the request. The Assessment Section will review and approve or disapprove the request in TIDE. Then the Test Coordinator will receive an email response regarding the decision. The student should not continue to be tested until the Test Coordinator has received a decision from the Assessment Section.
Requests to reset an EOC exam will be granted only in extreme circumstances. The Test Coordinator may submit an exam reset request in TIDE. In the “Test Impropriety” tab in TIDE, the Test Coordinator should enter either the student’s 10-digit SSID number, the result ID located in the Plan and Manage Testing section in TIDE, or the session ID, along with the reason for requesting that the exam be reset. The Assessment Section will review and approve or disapprove the request in TIDE. Then the Test Coordinator will receive an email response regarding the decision. The student should not continue to be tested until the Test Coordinator has received a decision from the Assessment Section.
What should I do if a student starts one of the EOC exams by mistake?
A student who has been approved by the Test Administrator to start the wrong EOC exam cannot be the basis for resetting an exam. The exam should be treated as an incomplete exam opportunity and the student must complete the exam by the end of the appropriate testing window if he or she is currently enrolled in the course that is related to the wrong exam. If the student is not enrolled in the course, the Test Coordinator needs to enter a request to invalidate the exam in the Test Impropriety tab in TIDE.
How can we ensure that students do not cheat when they are taking an EOC exam on a computer?
The Hawaii State Science Assessments and End-of-Course Exams Test Administration Manual describes the online assessment security procedures in detail.
- A Test Administrator will be responsible for administering a test session and ensuring that the students taking an EOC exam are who they say they are.
- Students will take an EOC exam using a special browser that prevents them from doing anything on the computer except taking the exam. This browser will not allow students to copy items or look up answers online.
- While taking an EOC exam, students will see different items in different sequences, so copying from one another will not help them.
- If a student ends an EOC exam session before answering all the items, the student will not be able to review previously answered items when finishing this exam during a subsequent session, if more than 30 minutes have elapsed.
What should I do if something goes wrong during an EOC exam?
Testing incidents should be reported to your Test Coordinator, who will then report the testing incidents to the Department’s Assessment Section at 808-733-4100. In addition, the Test Administrator or Test Coordinator must complete the Testing Incident Report Form, found an Appendix of the Hawaii State Science Assessments and End-of-Course Exams Test Administration Manual. The form should be faxed to the Assessment Section at 808-733-4483.
How will students and teachers get EOC Exam results?
Student results are available in the Online Reporting System (ORS). Users with the appropriate roles will be able to view results for their schools, classes, and students. If Teachers are entered in TIDE with their employee ID number, their class rosters that have been entered in Infinite Campus by their school clerk or registrar will be available in ORS. Results will be available immediately after each EOC exam has been submitted for electronic scoring. Teachers can log on to ORS to see how their students performed. Students taking the Algebra I, Algebra II, Biology I, and/or U.S. History EOC Exam(s) will also receive their three-digit scale score on the computer screen immediately after they complete and submit their exam (the TA Live Site does not display students’ scores).
For E-School teachers only, the E-School testing coordinator will assist AIR in distributing student scores to all E-School teachers after the close of each testing window. E-School teachers will receive from the E-School testing coordinator a list with their students’ scale scores, performance levels, and reporting categories, within seven days of the closing of the testing window. For more immediate access to their students’ scores, E-School teachers will need to be added as a Teacher (TE) in TIDE by the Test Coordinator at each student’s home school. Once their Teacher role has been activated in TIDE, school Test Coordinators need to create a custom roster in TIDE in order to grant E-School teachers access to their students’ scores at each home school in the Online Reporting System. To request access to ORS, E-School teachers should contact the E-School test coordinator, who will then contact the Test Coordinator at each student’s home school to request that the E-School teacher be added to TIDE.
Note: E-School teachers who have been granted access must use the “Search Students” feature in ORS to immediately access students’ scores. They can search students’ scores using their names or SSIDs. E-School teachers can access students’ scores from the home page 24 hours after they have been granted access to ORS.
Parents will receive a printed family score report that displays their child’s score for each EOC exam taken at the beginning of the next school year.
What types of results will be available?
EOC exam scale scores and related performance levels, i.e., well below, approaches, meets, and exceeds proficiency, are available for students in the Online Reporting System.
Scores are also available for each of the four EOC exams within a school in the Online Reporting System.
Current students’ EOC exam scores from 2015-2016 are also available for teachers in the Online Reporting System. For details, please refer to the HSAP Online Reporting System User Guide, available on the EOC Exams Resources page at alohahsap.org.
What do schools need to do technology-wise to get ready for the online assessments?
Each year, schools MUST install the correct, updated secure browser on each computer that students will use to access the EOC Exams based on the operating system. These browsers prevent students from accessing other computer applications while they are taking an assessment. Secure browsers from previous HSAP administrations (e.g., 2015–2016) will not work. Click here for information about installing the updated secure browsers and how to remove the previous browser(s).
Please refer to the HSAP Technical Specifications Manual for specific information about hardware, software, and operating system requirements and secure browser installation.
How many computers will we need to conduct the administration of the EOC Exams?
The Department of Education recommends that each school has approximately one computer for every five to ten students; however, even fewer will work since not all students will have to access the online testing sites at the same time.
Appendix C of the HSAP Technical Specifications Manual includes a worksheet that can be used to determine the number of days needed for completing online assessments in your school. We strongly encourage you to use this worksheet to help develop your assessment schedules.
Note: When counting computers, you should only count computers in settings where groups of students can be assessed together. At least one computer in this setting should be reserved for the Test Administrator. Classroom settings where some students will be taking the online assessments and other students will be participating in learning activities are not appropriate for the administration of EOC Exams.
What is the maximum number of students in a school who can connect to the EOC Exam Assessment System at one time?
In general, the performance of the online testing system will depend on a number of factors including bandwidth, total number of students simultaneously testing, size of test content, secure browser installation, proxy server (if used), and wireless networking solution (if used). As the number of students testing increases, competition for network bandwidth increases. Network bandwidth resembles highway traffic; as the number of cars traveling on a given road increases, the speed of traffic flow decreases.
The optimal number of student workstations supported by a single wireless connection will depend on the type of networking standard being used for the connection. The two most common networking standards are 802.11g (54M bits per second) and the newer and faster standard, 802.11n (300M bits per second). Both the access point, which emits the wireless signal, and the computer’s wireless card, which receives the signal, will use one of these two standards. The recommendations below are based on the standard in use:
- Wireless connections using an 802.11g access point can reliably support a maximum of 20 PC and/or Mac workstations that use wireless cards with either the 802.11g or the 802.11n standard.
- Wireless connections using an 802.11n access point can reliably support a greater number of workstations; however, the make and model of the 802.11n access point will affect the number of additional workstations that the access point can support. Thus, the manufacturer’s documentation should be consulted for verification.
Typically, when all workstations are using an 802.11n wireless card, the 802.11n access point can support approximately 40 computers. In cases where the workstation wireless cards are a mix of both 802.11n and 802.11g, supported connections should not exceed 50 workstations.
How do I download and install the secure browser?
The updated secure browsers, along with installation instructions, are available on the Secure Browsers page. This page also includes information on how to uninstall/remove the previous secure browsers.
Additional information, including guidelines for installing the secure browsers over a school network, is available in the HSAP Technical Specifications Manual.
How do I disable pop-up blockers?
Pop-up blockers must be disabled to access TIDE, the Test Administrator Training Site, the TA Live Site, and the Online Reporting System. To allow pop-up windows, go to the menu option shown here for each browser:
- Firefox: Tools > Options > Content > uncheck “Block pop-up windows”
- Google Chrome: Menu > Settings > Show advanced settings > Privacy > Content settings > Pop-ups > select “Allow all sites to show pop-ups”
- Internet Explorer: Tools > Pop-up Blocker > Turn off pop-up blocker
- Safari: Application Menu (Safari) > Block Pop-up Windows (make sure this is unchecked)
What should I do if Internet access to the EOC Exam testing site is slow and student computers are stalling or timing out from testing?
If a student’s computer is slow or non-responsive, the student may be moved to another computer that was previously set up as a backup. If all student computers are slow or non-responsive for an extended period of time (more than several minutes), the Test Administrator may pause testing and work with the school’s Technology Coordinator to troubleshoot the school’s network. If the school’s network is stable, the Test Coordinator should reschedule the testing session and contact the HSAP Help Desk (email@example.com or 1-866-648-3712) to report the issue.
Note: The Department of Education recommends that the Assessment System Status (found at alohahsap.org) be checked prior to administering a test session. If the status for all systems is “fully operable” then testing may commence. The Department of Education also recommends that a school’s bandwidth be checked prior to testing and that access to all bandwidth-intensive websites (e.g., Achieve 3000’s KidBiz and TeenBiz) be limited on the school’s network during the administration of EOC Exams.
What happens if the power goes out, a student accidentally switches off the computer, or we have another technology or power problem?
The EOC Exam Assessment System will not lose data if a student’s Internet connection is interrupted or the computer crashes or experiences a power loss. After the Internet connection and/or power source is re-established, a student may resume testing where he or she left off. The student may access previously answered questions during the current test session, as long as the connection was re-established within 30 minutes. Similarly, if classroom-wide access to the Internet goes down or the power goes out, students will have to resume their assessments when the Internet connection and/or power source is fully restored and consistent.
Note: Students will not be able to review previously answered questions, including marked (flagged) questions, if they resume the assessment more than 30 minutes after the last question was answered. There are two exceptions to this grace period rule:
- When a student was last on a reading passage that contained multiple questions and not all the questions displayed on the screen had been answered; the student will be presented with that reading passage and all associated items and will be able to review the previously answered questions on that page.
If a student’s assessment or exam has been paused for more than 30 minutes due to a major disruption, such as a fire drill, a school-wide power or Internet outage, or a natural disaster, the Test Coordinator may submit a Grace Period Extension (GPE) request in TIDE that will allow the student to review his or her answers to previously answered questions. However, the Test Administrator must immediately pause the student’s exam and NOT allow the student to continue answering any further questions. The Student Assessment Section will review the GPE request, and the Test Coordinator will be notified via email of the Student Assessment Section’s decision. The student should not resume testing in the particular content area until the Test Coordinator has received the Student Assessment Section’s decision.
Why are online assessments paused when automatic updates start running?
The secure browser and Test Delivery System ensure the security of the testing environment at all times. When the secure browser detects applications that are triggered, such as Internet Explorer, the Test Delivery System will pause the student’s assessment. A number of software programs, including antivirus software, have automatic updates enabled, and these often trigger the Internet Explorer process (or other application processes).
To prevent students’ tests from being paused, check software settings and determine whether auto-updates are enabled. If they are enabled, you are encouraged to either disable them or schedule them to run outside of school hours.
May iPads and/or other mobile devices be used for testing?
Yes. Mobile secure browsers are now available for iPads and certain Android tablets. Further information is available in the HSAP Technical Specifications Manual and on the Secure Browsers page on the EOC Exams portal website.
Additionally, AIR has worked with Google to develop a secure testing environment using Chromebooks. As a result, no secure browser is required on Chromebooks. Instead, students must log into a Chromebook using a specific computer login profile. Further information is available in the HSAP Technical Specifications Manual and on the Secure Browsers page on the EOC Exams portal website.
What will happen if Test Administrators and students use netbooks that have screens smaller than 10 inches? (Note: The minimum recommended screen size is 10 inches and the minimum supported resolution is 1024 x 600.)
Individuals using netbooks with smaller screen sizes will still be able to access the EOC Exam Assessment System but may need to scroll down or across to see the complete screen. Students can also use the zoom tool in the Student Training Test and in the HSAP secure browser during assessments to enlarge the content on the screen.
Do we need audio devices for the assessments?
Schools need to provide headphones for students who use the text-to-speech (TTS) embedded designated support feature. No microphones are needed. Only students who are approved to use the TTS designated support may use the text-to-speech feature for the End-of-Course Exams.
Prior to student testing, the headphones and audio should be checked to ensure that the sound quality and volume settings are appropriate. To check that test audio can be heard, plug in the headphones and then launch the secure browser. On the login screen, click the link to navigate to the Practice and Training Tests. The audio settings can be made by clicking the [Run Diagnostics] link on the Practice and Training Tests login page, then navigating to [Text-to-Speech Check]. Follow the prompts to complete the TTS check. If your audio settings need to be adjusted, make the appropriate changes in the computer’s user interface, and then run the TTS check again.
Students who have TTS enabled for a test can adjust audio settings during the sound check. Students encounter the TTS sound check after they have been approved by the Test Administrator. Only those students who have TTS enabled for their test will see the TTS sound check. The sound check contains a sample audio clip that the student can play. An audio wizard on this page allows the student to adjust both the volume and the speed of the TTS sample. After adjusting the audio settings to his or her needs, the student is able to start the test.
The Text-to-Speech designated support for EOC Exams can be enabled or disabled in the TA Live Site prior to approving a student’s test session. The TTS designated support setting can also be enabled or disabled prior to testing via TIDE. Students who need to practice taking online assessments using TTS must use the secure browser to access the Student Training Site. TTS is not supported when using web browsers.
Can Principals, Test Coordinators, Test Administrators and Teachers use the same passwords for 2016-2017 that they used for 2015-2016?
No. In order to preserve assessment security and student privacy, all passwords for the online Hawai‘i Statewide Assessment Program (HSAP) systems must be reset each year. Previous users remain active in the system, but they will need to obtain new passwords. To obtain a new password, users should go to the TIDE homepage and click the “Forgot Password” link below the username and password login boxes. The user will need to enter his or her email address on the subsequent screen. The user will then receive an email with a secure link that will direct the user to TIDE. Here he or she will be prompted to change his or her password (a password must contain a minimum of six characters, including one number) and select and answer a security question. The secure link that is emailed to a user is unique and expires after 72 hours. The user will need to change his or her password and create a security question and answer in TIDE before he or she can log into other online HSAP systems.
Note: All users will need to activate their account in TIDE for the 2016-2017 test administration by creating a new password and security question and answer before they can log into other online HSAP systems. All users must understand that using another person’s username and password is prohibited, unless the user is given explicit permission to do so to resolve a reported problem. The user is responsible for keeping his or her username and password for all electronic applications confidential. Other users are not allowed to enter a user’s active test sessions other than to resolve specific problems. Sharing or transferring this information to any other person is not allowed.
What is my username?
Your username is the email address associated with your TIDE account. For most public school staff members, the username is their Lotus Notes email address: FirstName_LastName@notes.k12.hi.us. Public charter school staff members who do not use the Department of Education’s Lotus Notes email system will need to enter their unique email addresses as their usernames in TIDE.
What should I do if I have forgotten my password?
If a user forgets his or her password, the user must go to the TIDE homepage, click the “Forgot Password” link, and enter his or her email address on the subsequent screen. The user will then need to answer his or her security question. He or she will then receive an email with a secure web link that the user must click in order to change his or her password. A password must be at least eight (8) characters in length and must contain three (3) of the following:
- One (1) lowercase alphabet character
- One (1) uppercase alphabet character
- One (1) number
- One (1) special character
- The new password cannot be the same as your current or previous password.
If a user cannot recall the answer to the security question that he or she initially set, the user must contact the HSAP Help Desk at 1-866-648-3712 or firstname.lastname@example.org for further assistance.
Can a Principal enter more than one Test Coordinator for his or her school in TIDE?
Yes, a Principal may enter more than one Test Coordinator (TC) for his or her school in TIDE. However, a Principal will need to verify or update only one TC who will receive printed materials for the school for the Smarter Balanced, HSA Science, HSA-Alt, or EOC Exam administrations on the “Verify Contact Information” page. This TC will need to distribute any printed materials that are needed for each assessment or exam to the appropriate TC. A Principal must also enter that TC, and any additional TCs for the school, using the “Add Users” feature in the “Manage Users” tab. All TCs who are entered using the “Add Users” feature in the “Manage Users” tab will receive email communications about the online systems from AIR. The Department of Education’s Assessment Section will use its school contact file to send email communications to all TCs about HSAP testing information.
What is the role of a Teacher versus the role of a Test Administrator? How does a Test Coordinator give a staff member dual roles?
The Test Administrator (TA) role allows users access to the TA Live Site for administering assessments. In the TIDE system, TAs will have access to “Plan and Manage Testing” under “Administering Tests,” which allows users to generate customized reports in order to monitor their students’ activity and progress in the online assessment system. However, TAs do not have access to score reports. Teachers (TEs), on the other hand, cannot administer assessments but have access to their students’ score reports in the Online Reporting System (ORS).
To assign a staff member both the TA and the TE roles, Test Coordinators (TCs) will need to enter that person in the TIDE system twice; first with one role, then with the second role. The “Upload Users” task, which allows TCs to upload a spreadsheet, may be helpful for uploading multiple users who need multiple role associations. Please refer to the Upload Users section in the HSAP TIDE User Guide for more detailed information on how to upload the spreadsheet to TIDE.
Can a long-term substitute Teacher be added in TIDE as a Test Administrator?
Table 4 (Personnel Who May Serve as Test Administrators) in the Hawaii State Science Assessments and End-of-Course Exams Test Administration Manual identifies the school-level personnel who may administer the online EOC Exams. If a long-term substitute Teacher (TE) meets the specified requirements for serving as a Test Administrator (TA), then the Test Coordinator (TC) may add him or her to TIDE with the TA designation, using the “Add User” or “Upload Users” feature in the “Manage Users” tab in TIDE. Long term substitute teachers who do not use the Department of Education’s Lotus Notes system will need to have their unique email addresses entered as their usernames in TIDE by the Test Coordinator.
What is the eight-digit employee ID number that is needed when entering Teacher users in TIDE? Why is this needed?
This number can be found on an employee’s HIDOE ID badge or in the employee’s detailed Lotus Notes information. This number is needed to associate the class roster(s) assigned to each teacher in Infinite Campus by his/her office clerk or registrar that is included in the nightly upload to TIDE with these same teachers whose roles as TEs have been created by the Test Coordinator in TIDE. These TEs will then have access to the student score reports for their associated class rosters in the Online Reporting System.
What should a Test Coordinator do if he or she enters incorrect information (name, phone number, email address, employee ID) for a Test Administrator or Teacher in TIDE?
If a Test Coordinator (TC) enters an incorrect email address for a Test Administrator (TA) or Teacher (TE) in TIDE, the TC should delete the TA or TE’s record from TIDE and add the record again with the correct email address.
However, the TC may edit a TA or TE’s name, phone number, employee ID, or role if it has changed since it was initially entered correctly by selecting the “View/Edit User” function and editing the information in the appropriate field(s); the TC does not have to delete and then add the TA or TE to TIDE again to edit this information.
How does student information get into the online HSAP system? Does a Test Coordinator need to enter it?
Student information is uploaded nightly from the Hawai‘i Department of Education’s electronic Infinite Campus and Comprehensive Student Support System (eCSSS) into the online HSAP system. Test Coordinators (TCs) and Test Administrators (TAs) do not need to enter any student information. Student information will appear in TIDE about 48–72 hours after it has been entered by the identified school staff members in Infinite Campus and eCSSS.
If, during an assessment, a TA or TC notices that student information is incorrect, he or she will need to ask the office clerk (for elementary schools) or registrar (for secondary schools) to make the change in Infinite Campus; the updated information will then be uploaded in the TIDE system within 48–72 hours after it has been entered in Infinite Campus.
A student who transfers from one Hawai‘i public or public charter school to another Hawai‘i public or public charter school will appear in TIDE about 48–72 hours after his or her information is updated in Infinite Campus, if the student has been removed from the previous school’s Infinite Campus file. The student must be removed from the previous school’s Infinite Campus file and his or her information must be associated with the new school’s Infinite Campus file before the student will appear in TIDE and can be tested at his or her new school.
How is student eligibility to take an EOC Exam determined?
Student eligibility for each EOC Exam testing window will be automatically loaded into TIDE prior to the opening of each testing window. These dates may be found under the “Important Dates” section of the EOC Exams portal at alohahsap.org. Test Coordinator (TCs) should also enter TIDE prior to the opening of each testing window and ensure that all students who are eligible to take the EOC Exams have been selected. If a student is eligible to take one of the EOC Exams and the eligibility feature has not been selected, the TC will need to go to the “View/Edit Students” tab of TIDE and check a box next to the exam(s) that the student is eligible to take.
Can a Test Coordinator set a designated support or accommodation for a student after the student has begun a test opportunity?
Yes, a designated support or accommodation may be set for a student after he or she has already begun a test opportunity. The Test Administrator (TA) should have the student pause his or her test. If the designated support or accommodation can be set in the TA Live Site, the TA may set the accommodation in the TA Live Site and have the student log back in to his or her test session. The designated support or accommodation will be in effect once the student logs back into the test session. If the designated support or accommodation cannot be set in the TA Live Site, then the Test Coordinator (TC) must set the designated support or accommodation in TIDE, and the revised designated support or accommodation setting will be in effect the next time the student logs back in to the test session.
Note: The Language selection, i.e., English or Braille, may not be changed after a student has begun a test opportunity. Once a student has started a test in English, the setting cannot be changed. If a student has started a test opportunity with the incorrect Language feature, the student’s test should be immediately paused, and the Test Coordinator should call (1-866-648-3712) or email (email@example.com) the HSAP Help Desk staff for further assistance. The HSAP Help Desk hours are 7:30 a.m.–4:00 p.m. Hawaii Standard Time, Mondays through Fridays (except on holidays).
How can a student’s score be suppressed in TIDE?
By default, a student sees his or her test score when the student completes and submits his or her HSA Science Assessment or EOC Exam for scoring. Test Coordinators (TCs) have the ability to suppress a student’s score from being displayed on his or her screen when a test is completed, if the staff members who provide services for the student think that displaying the score will be upsetting.
Only TCs may suppress a student’s score by changing the “Suppress Score” attribute in a student’s record using the “View/Edit Students” task in TIDE. Test Administrators (TAs) cannot change this setting during testing. A TC should inform a TA in advance if a student’s score will be suppressed for any of his or her test opportunities.
This feature is configurable by subject and must be edited for each individual student record.
Note: Students will not see their Smarter Balanced ELA/Literacy or Mathematics Assessment score because their typed answers must be hand scored before their scores can be posted in the Online Reporting System.
How do I submit a test impropriety request for a student?
The Test Coordinator (TC) is the only user able to submit a test impropriety request in TIDE. The HSAP TIDE User Guide lists the various types of requests that may be submitted via the “Test Impropriety” task tab in TIDE.
Using the “Create Test Impropriety” task in TIDE, a TC can submit a test impropriety request for one student at a time. You can submit each request based on the student’s SSID, result ID, or test session ID. You must enter a reason for the test impropriety request for each student in the “Reason” field.
A TC can use the “Upload Test Impropriety” task to submit test impropriety requests for more than one student at a time. Please refer to the HSAP TIDE User Guide for instructions on how to upload a test impropriety file in TIDE. As with the “Create Test Impropriety” task, you will need to provide the student’s SSID, result ID, or test session ID, along with a reason for the request, in the file to be uploaded.
The Assessment Section will decide the action that will be taken for each test impropriety request submitted. Every effort will be made to review each request in a timely manner. Once the Assessment Section has taken action on a request, a TIDE notification email is sent to the TC who submitted the request. The TC can then view the Assessment Section’s action on the request using the “View Test Impropriety” tab in TIDE.
Students for whom test impropriety requests have been submitted should NOT resume testing until the TC has received the Assessment Section’s decision regarding each request.
Please contact the HSAP Help Desk at 1-866-648-3712 or firstname.lastname@example.org for further assistance with submitting or viewing test impropriety requests.