PURPOSE: To objectively evaluate examiner's performance in abdominal ultrasonography using body phantom and adjustment of an equipment. MATERIALS AND METHODS: Twenty four radiology residents (six per year of training) independently performed upper abdominal ultrasonography of an ABDFAN phantom, which is similar to human anatomy. Duration of each examination was measured. By consensus, three experienced abdominal radiologists evaluated the management of ultrasonographic equipment (annotation of scan area, depth control, gain and time-gain compensation control, focus control, and occurrence of artifact) and the acquisition of 15 standard images. They scored 5 points per item, for a total of 100 points. RESULTS: The mean score for management of ultrasonographic equipment was 19.17, and 62.50 for acquisition of standard images. The total mean score was 81.67. A significant difference in the total mean score was observed between first grade residents, with a score of 64.17, and other residents, with a score over 85. Mean examination time was 10.9 minutes. In management of ultrasonographic equipment, annotation of the scan area received a lower score of 1.04 points. In the acquisition of standard images, the mean score for an intercostal scan of the right hepatic lobe, including the right hepatic vein, was lowest, at 1.88, whereas those for transverse scan of the right hepatic lobe and of the pancreas were highest, at 5 points. CONCLUSION: As the total mean score by residents, except for first grade residents, was over 85, the assessment items presented in this study can be used as objective criteria in the test for accreditation of ultrasound practices.