This free survey is powered by QUESTIONPRO.COM
  1. Surveys
  2. 2011
  3. January
  4. M
  5. Metrica Standard Settng: Checkset 1

Metrica Standard Settng: Checkset 1

0%
 

Welcome!


This site will collect your responses to Angoff Check Set #1.

On the pages that follow, you will have to opportunity to enter information that helps us check your understanding of the standard setting process.

The check set will take up to 10 minutes to complete. You will need to complete the check set in one online session.

The information collected will be completely confidential, and all responses will be deleted when the training is complete.


When you are ready to begin, start
by clicking the Continue button below.

 
 
 
 

** NOTE **

It is important to know that this site does NOT support the use of the 'BACK' button on your web browser.

Each time you click the button at the bottom of the page to continue, your answers are immediately sent to the database.

Click the checkbox below to acknowledge and proceed.

 
 
 
 
* Your first name:
   
* Your last name:
   
* Your email address:
   
 
 
* Standard setting language(s) for which you will be a participant (check all that apply):
 
French
 
Spanish
 
Persian
 
Chinese
 
Korean
 
Iraqi
 
N/A (I am an Observer only, not a participant.)

 
 
Directions: Please indicate your answers to the following set of questions.


Suppose that you are making your Angoff Yes/No rating for Item A. You think the borderline Level 0+ candidate can answer the item correctly.

* Question 1:
For Item A, what do you indicate on the Excel rating sheet under the 0+ column?
 
A. Yes
 
B. No
 
C. Leave Blank
 
 
* Question 2:
For Item A, what should be marked on the Excel rating sheet under the 1 column?
 
A. Yes
 
B. No
 
 
Suppose that you are now making your ratings for Item B. You believe that the borderline Level 0+ candidate does NOT have the knowledge or abilities to get this item correct.


* Question 3.
What do you indicate on the Excel sheet under the 0+ column for Item B?
 
A. Yes
 
B. No
 
C. Leave Blank
 
 
For item B, you now consider whether the borderline Level 1 candidate has the knowledge or abilities to get the item correct. You decide that the borderline Level 1 candidate does NOT have the necessary knowledge or abilities, but also that the borderline Level 1+ candidate would get the item correct.

* Question 4.
What should be the rating sheet entries under columns 1 and 1+ for item B?
 
A. Yes in column 1 and No in column 1+
 
B. Yes in 1 and Blank in column 1+
 
C. No in column 1 and Yes in column 1+
 
 
 
* Question 5.
Which of the following best completes the sentence?

The borderline Level 1 candidate _____
 
A. represents a typical Level 1 person.
 
B. has the minimum knowledge, skills, and abilities to be considered Level 1.
 
C. would always get the Level 1 items correct.
 
 
 
* Question 6.
A panelist made the following ratings for Item C.



What is one conclusion that can be made about what this panelist thinks?
 
A. She thinks that only people at Level 2 or higher can be expected to answer item C correctly.
 
B. She thinks that people at Level 1+ will always get the item correct.
 
C. She thinks that the borderline Level 1+ candidate has the knowledge, skills, and abilities to get the item correct.
 
D. She thinks that the borderline Level 0+ candidate and the borderline Level 1 candidate have the same chance of getting the item correct.
 
 
 
* Question 7.
A panelist made the following ratings for Item D.



What is one conclusion that can be made about this panelist?
 
A. The panelist is confusing the Angoff rating task with expert judgments about the ILR level of an item.
 
B. The panelist thinks that Item D is very easy for anyone who might take the VLR.
 
C. The panelist thinks that all three borderline VLR candidates lack the requisite knowledge or skills to answer Item D.
 
 
 
* Question 8.
A panelist made the following ratings for Item D.



Which of the following best completes the sentence?

According to this panelist, ________
 
A. Item D is very difficult, even for the borderline Level 1+ candidate.
 
B. Item D is an item that a monolingual English speaker would likely get correct.
 
C. Item D would likely be answered correctly by anyone at Level 0+ or above.
 
 
 
* Question 9.
Do you agree with this statement?

I understand the background information relating to the standard setting process, and I am ready to begin.
 
A. Yes
 
B. No
 
 
* Question 10.
Do you agree with this statement?

I feel confident about this task and I am ready to proceed. I have no more questions at this time.
 
A. Yes
 
B. No
 
 
 
If you answered "No" to Question 9 or Question 10, please review the YouTube video for Checkset #1.

If you still have questions, please contact us. We can be reached either by email or toll-free phone:


Email: [email protected]
Phone: 888-502-1105


Please include your name, language group, and best way to contact you.

Click the button below to finish this check set.
 
Questions? Contact [email protected] about this check set.

















































Provided by Center Point Assessment Solutions, Inc.
 
Survey Software Powered by QuestionPro Survey Software