J Educ Eval Health Prof.  2006;3:4.

Estimation of an Examinee's Ability in the Web-Based Computerized Adaptive Testing Program IRT-CAT

• Lee YH
• Park JH
• Park IY

Abstract

We developed a program to estimate an examinee s ability in order to provide freely available access to a web-based computerized adaptive testing (CAT) program. We used PHP and Java Script as the program languages, PostgresSQL as the database management system on an Apache web server and Linux as the operating system. A system which allows for user input and searching within inputted items and creates tests was constructed. We performed an ability estimation on each test based on a Rasch model and 2- or 3-parametric logistic models. Our system provides an algorithm for a web-based CAT, replacing previous personal computer-based ones, and makes it possible to estimate an examinee's ability immediately at the end of test.

Keyword

Item Response Theory; Computerized Adaptive Testing; Examinee's Ability; Estimation

MeSH Terms

Animals
APACHE
Cats
Database Management Systems
Humans
Indonesia
Logistic Models

Figure

• 

  Fig. 1. Screen shot of the characteristics of inputted items.

• 

  Fig. 2. Screen shot of the input for the item stem and answer options.

• 

  Fig. 3. Table structure for item information.

• 

  Fig. 4. Screen shot of an item search.

• 

  Fig. 5. Screen shot of an item function.

• 

  Fig. 6. Screen shot of the creation of an examination.

• 

  Fig. 7. Flow chart of the ability estimation in the IRT-CAT. SE; standard error

• 

  Fig. 8. Screen shot of the examinee’s ability.

• 

  Fig. 9. Screen shot of example of the response to an item.

Reference

1. Baker FB. Item response theory: Parameter estimation techniques. New York: Marcel Dekker;1992.

2. Kim YH, Sohn M, Chung HT. Practice of the computerized adaptive testing. Seoul (KR): Munumsa;2002. Korean.

3. Kim MY, Lee YH, Huh S. Correlations between the scores of computerized adaptive testing, paper and pencil tests, and the Korean Medical Licensing Examination. J Educ Eval Health Prof. 2005; 2:113–8.

4. Wise SL, Kingsbury GG. Practical issues in developing and maintaining a computerized adaptive testing program. Psycologica. 2000; 21:135–55.