Original article
Measuring the accuracy of prognostic judgments in oncology

https://doi.org/10.1016/S0895-4356(96)00316-2Get rights and content

Abstract

The purpose of this study was to describe the accuracy of prognostic judgments in the day-to-day practice of cancer medicine. Oncologists' initial estimates of the probability of cure of 98 cancer patients, and of the duration of survival of 39 incurable cancer patients, were compared with the observed outcome at five years. Estimates of probability of cure were well calibrated and also relatively accurate (Mean Brier Accuracy Score [AS] = 0.11 ± 0.02 [SE]). Oncologists' ability to discriminate between curable and incurable patients compared favorably with the discrimination of prognostic judgments in acute care medicine (area under the receiver operating characteristic curve, AROC = 0.91 ± 0.09). Estimates of the duration of survival of incurable patients were well calibrated, but individual predictions were imprecise. Discrimination between patients who would survive for three months, and those who would not, was only fair (AROC = 0.75 ± 0.04), and discrimination between patients who would survive for one year and those who would not was very poor (AROC = 0.57 ± 0.01). It was concluded that oncologists' estimates of probability of cure are surprisingly accurate, but estimates of the duration of survival of incurable patients are much less accurate, and subject to a “horizon effect” similar to that recognized in weather forecasting.

References (31)

  • WJ Mackillop et al.

    Cancer patients' perceptions of their disease and its treatment

    Br J Cancer

    (1988)
  • J Hilden et al.

    Prognosis in medicine: An analysis of its meaning and roles

    Theor Med

    (1987)
  • RR Sokal et al.
  • S Lichtenstein et al.

    Calibration of probabilities: The state of the art in 1980

  • RM Poses et al.

    Evaluating of physicians' probabilistic judgments

    Med Decis Making

    (1988)
  • Cited by (151)

    • Care in the last days of life

      2021, FMC Formacion Medica Continuada en Atencion Primaria
    • Financial Toxicity in Patients with Brain and Spine Metastases

      2021, World Neurosurgery
      Citation Excerpt :

      In the year preceding SRS, more than half of patients were admitted to the hospital and 30% of patients visited the emergency room. Nonetheless, a third of these patients reported that it was “likely” or “very likely” that they would be cured of their cancer, in line with previous reports of patients with metastatic cancer treated with systemic therapy.33,34 A previous study showed that 33% of patients being treated for palliation believed that their disease would be cured.

    • Predicting Survival for Patients With Metastatic Disease

      2020, International Journal of Radiation Oncology Biology Physics
    View all citing articles on Scopus
    View full text