Saturday, July 20, 2019

Patient reported outcomes - does a proprietary computerized adaptive testing system (CAT) reduce the burden on the patient ?

A concise shoulder outcome measure: application of computerized adaptive testing to the American Shoulder and Elbow Surgeons Shoulder Assessment

These authors point out that patient-reported outcome measures enable quantitative and patient-centric assessment of orthopedic interventions, but they can also be a burden for patients and practices.

They examined the utility of a computerized adaptive testing (CAT) method to in an attempt to reduce the number of questions on the American Shoulder and Elbow Surgeons (ASES) questionnaire.

They applied a previously developed ASES CAT system to the responses of 2763 patients who underwent shoulder evaluation and treatment and had answered all questions on the full ASES instrument. 

They found that by tailoring questions according to prior responses, CAT might reduce the number of questions by 40%.

The mean difference between CAT and full ASES scores was 0.14, and the scores were within 5 points in 95% of cases (a 12-point difference is considered the threshold for clinical significance) and were clustered around zero. The correlation coefficients were 0.99, and the frequency distributions of the CAT and full ASES scores were nearly identical. 

Comment: 
This article uses a proprietary CAT system, OBERED (http://www.oberd.com). The cost/time burden of implementing this system is not mentioned. The first author of this paper is the Chief Scientific Officer of Universal Research Solutions–OBERD and two of the other authors disclosed a financial conflict of interest with OBERED (employee and shareholder).



This article concluded that "the ASES CAT system lessens respondent burden with a negligible effect on score integrity". Actually, they did not measure the "respondent burden"; their primary outcome variable was the number of questions answered.  The "respondent burden" includes need to find access to the OBERED system, gaining working familiarity with the system, and understanding the results of the test.  Theses aspects of the burden were not evaluated in this study.

This article reports that a new CAT method has been developed to lessen the burden of obtaining patient reported outcomes. It shows that application of the CAT to the ASES questionnaire has a negligible impact on the outcome score while reducing the number of questions the patient needs to answer from 11 to 7. The total difference in time to complete the ASES with the two methods (signing into a terminal vs. on paper) was not reported.

The goals of capturing validated patient reported outcome data are (1) to optimize the chances that the largest percent of patients being followed will continue to participate in the followup over time (minimizing loss to followup), (2) enabling surgeons to assess their outcomes in a cost-effective way, and (3) providing prospective patients with understandable diagnosis- and procedure-specific data on their likely outcomes with the treatments available in the hands of their surgeon. If the outcomes can be easily assessed by the great majority of patients from their home, these goals can be met.

We continue to find that the non-proprietary and extensively validated Simple Shoulder Test greatly facilitates longitudinal capture of patient-reported data and helps greatly in sharing the results with the patients in terms of abilities to perform 12 important shoulder functions rather than by a number that is difficult for most to interpret.


=====
We have a new set of shoulder youtubes about the shoulder, check them out at this link.

Be sure to visit "Ream and Run - the state of the art" regarding this radically conservative approach to shoulder arthritis at this link and this link

Use the "Search" box to the right to find other topics of interest to you.