?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rft.title=Sources+of+Measurement+Error+in+an+ECG+Examination%3A+Implications+for+Performance-Based+Assessments&rft.creator=Solomon%2C+David+J&rft.creator=Frerenchick%2C+Gary&rft.subject=Cognitive+Psychology&rft.description=Objective%3A+To+assess+the+sources+of+measurement+error+in+an+electrocardiogram+(ECG)+interpretation+examination+given+in+a+third-year+internal+medicine+clerkship.%0ADesign%3A+Three+successive+generalizability+studies+were+conducted.+1)+Multiple+faculty+rated+student+responses+to+a+previously+administered+exam.+2)+The+rating+criteria+were+revised+and+study+1+was+repeated.++3)+The+examination+was+converted+into+an+extended+matching+format+including+multiple+cases+with+the+same+underlying+cardiac+problem.%0AResults%3A++The+discrepancies+among+raters+(main+effects+and+interactions)+were+dwarfed+by+the+error+associated+with+case+specificity.+The+largest+source+of+the+differences+among+raters+was+in+rating+student+errors+of+commission+rather+than+student+errors+of+omission.+Revisions+in+the+rating+criteria+may+have+helped+increase+inter-rater+reliability+slightly+however%2C+due+to+case+specificity%2C+it+had+little+impact+on+the+overall+reliability+of+the+exam.+The+third+study+indicated+the+majority+of+the+variability+in+student+performance+across+cases+was+in+performance+across+cases+within+the+same+type+of+cardiac+problem+rather+than+between+different+types+of+cardiac+problems.%0AConclusions%3A+Case+specificity+was+the+overwhelming+source+of+measurement+error.+The+variation+among+cases+came+mainly+from+discrepancies+in+performance+between+examples+of+the+same+cardiac+problem+rather+than+from+differences+in+performance+across+different+types+of+cardiac+problems.+This+suggests+it+is+necessary+to+include+a+large+number+of+cases+even+if+the+goal+is+to+assess+performance+on+only+a+few+types+of+cardiac+problems.%0A&rft.publisher=Kluwer+Academic+Publishers.&rft.date=2004-12&rft.type=Journal+(Paginated)&rft.type=PeerReviewed&rft.format=application%2Fpdf&rft.identifier=http%3A%2F%2Fcogprints.org%2F4671%2F1%2FECG_ARticle.pdf&rft.identifier=++Solomon%2C+David+J+and+Frerenchick%2C+Gary++(2004)+Sources+of+Measurement+Error+in+an+ECG+Examination%3A+Implications+for+Performance-Based+Assessments.++%5BJournal+(Paginated)%5D+++++&rft.relation=http%3A%2F%2Fcogprints.org%2F4671%2F