Comparison of chest CT severity scoring systems for COVID-19

Ali H Elmokadem 1 2, Ahmad M Mounir 3, Zainab A Ramadan 3, Mahmoud Elsedeiq 4, Gehad A Saleh 3


 

Affiliations

01 May 2022

-

doi: 10.1007/s00330-021-08432-5

Abstract

Purpose: To compare the diagnostic performance and inter-observer agreement of five different CT chest severity scoring systems for COVID-19 to find the most precise one with the least interpretation time.

Methods and materials: This retrospective study included 85 patients (54 male and 31 female) with PCR-confirmed COVID-19. They underwent CT to assess the severity of pulmonary involvement. Three readers were asked to assess the pulmonary abnormalities and score the severity using five different systems, including chest CT severity score (CT-SS), chest CT score, total severity score (TSS), modified total severity score (m-TSS), and 3-level chest CT severity score. Time consumption on reporting of each system was calculated.

Results: Two hundred fifty-five observations were reported for each system. There was a statistically significant inter-observer agreement in assessing qualitative lung involvement using the m-TSS and the other four quantitative systems. The ROC curves revealed excellent and very good diagnostic accuracy for all systems when cutoff values for detection severe cases were > 22, > 17, > 12, and > 26 for CT-SS, chest CT score, TSS, and 3-level CT severity score. The AUC was very good (0.86), excellent (0.90), very good (0.89), and very good (0.86), respectively. Chest CT score showed the highest specificity (95.2%) in discrimination of severe cases. Time consumption on reporting was significantly different (< 0.001): CT-SS > 3L-CT-SS > chest CT score > TSS.

Conclusion: All chest CT severity scoring systems in this study demonstrated excellent inter-observer agreement and reasonable performance to assess COVID-19 in relation to the clinical severity. CT-SS and TSS had the highest specificity and least time for interpretation.

Key points: • All chest CT severity scoring systems discussed in this study revealed excellent inter-observer agreement and reasonable performance to assess COVID-19 in relation to the clinical severity. • Chest CT scoring system and TSS had the highest specificity. • Both TSS and m-TSS consumed the least time compared to the other three scoring systems.

Keywords: COVID-19; Computed tomography, X-ray; Coronavirus; Lung; SARS-COV-2.

Conflict of interest statement

The authors of this manuscript declare no relationships with any companies, whose products or services may be related to the subject matter of the article.

References

 

  1. Zhu N, Zhang D, Wang W et al (2020) A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med 382(8):727–733 - PMC - PubMed
  2. Mahase E (2020) Covid-19: WHO declares pandemic because of “alarming levels” of spread, severity, and inaction. BMJ 368:m1036 - PubMed
  3. Grasselli G, Pesenti A, Cecconi M. Critical care utilization for the COVID-19 outbreak in Lombardy, Italy: early experience and forecast during an emergency response. JAMA. 2020;323(16):1545–1546. doi: 10.1001/jama.2020.4031. - DOI - PubMed
  4. Chen N, Zhou M, Dong X, et al. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study. Lancet. 2020;395(10223):507–513. doi: 10.1016/S0140-6736(20)30211-7. - DOI - PMC - PubMed
  5. Xu Y-H, Dong J-H, An W-M, et al. Clinical and computed tomographic imaging features of novel coronavirus pneumonia caused by SARS-CoV-2. J Infect. 2020;80(4):394–400. doi: 10.1016/j.jinf.2020.02.017. - DOI - PMC - PubMed
  6. Guzik TJ, Mohiddin SA, Dimarco A et al (2020) COVID-19 and the cardiovascular system: implications for risk assessment, diagnosis, and treatment options. Cardiovasc Res 116(10):1666–1687 - PMC - PubMed
  7. Li K, Fang Y, Li W et al (2020) CT image visual quantitative evaluation and clinical classification of coronavirus disease (COVID-19). Eur Radiol 30(8):4407–4416 - PMC - PubMed
  8. Salaffi F, Carotti M, Tardella M et al (2020) The role of a chest computed tomography severity score in coronavirus disease 2019 pneumonia. Medicine (Baltimore) 99(42):e22433 - PMC - PubMed
  9. Li K, Wu J, Wu F et al (2020) The clinical and chest CT features associated with severe and critical COVID-19 pneumonia. Invest Radiol 55(6):327–331 - PMC - PubMed
  10. Yang R, Li X, Liu H, Zhen Y, Zhang X, Xiong Q, et al. Chest CT severity score: an imaging tool for assessing severe COVID-19. Radiol Cardiothorac Imaging. 2020;2(2):e200047. doi: 10.1148/ryct.2020200047. - DOI - PMC - PubMed
  11. Francone M, Iafrate F, Masci GM, Coco S, Cilia F, Manganaro L, et al. Chest CT score in COVID-19 patients: correlation with disease severity and short-term prognosis. Eur Radiol. 2020;30(12):6808–6817. doi: 10.1007/s00330-020-07033-y. - DOI - PMC - PubMed
  12. Wong HYF, Lam HYS, Fong AH et al (2020) Frequency and distribution of chest radiographic findings in patients positive for COVID-19. Radiology 296(2):E72–E78 - PMC - PubMed
  13. Bai HX, Hsieh B, Xiong Z, Halsey K, Choi JW, Tran TML, et al. Performance of radiologists in differentiating COVID-19 from non-COVID-19 viral pneumonia at chest CT. Radiology. 2020;296(2):E46–54. doi: 10.1148/radiol.2020200823. - DOI - PMC - PubMed
  14. Fang Y, Zhang H, Xie J, Lin M, Ying L, Pang P, et al. Sensitivity of chest CT for COVID-19: comparison to RT-PCR. Radiology. 2020;296(2):E115–E117. doi: 10.1148/radiol.2020200432. - DOI - PMC - PubMed
  15. Kanne JP, Little BP, Chung JH, Elicker BM, Ketai LH (2020) Essentials for radiologists on COVID-19: an update-radiology scientific expert panel. Radiology 296(2):E113–E114 - PMC - PubMed
  16. Xie X, Zhong Z, Zhao W, Zheng C, Wang F, Liu J. Chest CT for typical coronavirus disease 2019 (COVID-19) pneumonia: relationship to negative RT-PCR testing. Radiology. 2020;296(2):E41–E45. doi: 10.1148/radiol.2020200343. - DOI - PMC - PubMed
  17. Wasilewski PG, Mruk B, Mazur S, Półtorak-Szymczak G, Sklinda K, Walecki J. COVID-19 severity scoring systems in radiological imaging–a review. Pol J Radiol. 2020;85:e361. doi: 10.5114/pjr.2020.98009. - DOI - PMC - PubMed
  18. Ai T, Yang Z, Hou H et al (2020) Correlation of chest CT and RT-PCR testing for coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology 296(2):E32–E40 - PMC - PubMed
  19. Bernheim A, Mei X, Huang M et al (2020) Chest CT findings in coronavirus disease-19 (COVID-19): relationship to duration of infection. Radiology 295(3):200463 - PMC - PubMed
  20. Elmokadem AH, Batouty NM, Bayoumi D, Gadelhak BN, Abdel-Wahab RM, Zaky M et al (2021) Mimickers of novel coronavirus disease 2019 (COVID-19) on chest CT: spectrum of CT and clinical features. Insights Imaging [Internet] 12(1):12. Available from: 10.1186/s13244-020-00956-6 - PMC - PubMed
  21. Elmokadem AH, Bayoumi D, Abo-Hedibah SA, El-Morsy A. Diagnostic performance of chest CT in differentiating COVID-19 from other causes of ground-glass opacities. Egypt J Radiol Nucl Med. 2021;52(1):1–10. doi: 10.1186/s43055-020-00398-6. - DOI
  22. Chung M, Bernheim A, Mei X, Zhang N, Huang M, Zeng X, et al. CT imaging features of 2019 novel coronavirus (2019-nCoV) Radiology. 2020;295(1):202–207. doi: 10.1148/radiol.2020200230. - DOI - PMC - PubMed
  23. Wang C, Horby PW, Hayden FG, Gao GF. A novel coronavirus outbreak of global health concern. Lancet. 2020;395(10223):470–473. doi: 10.1016/S0140-6736(20)30185-9. - DOI - PMC - PubMed
  24. Ye Z, Zhang Y, Wang Y, Huang Z, Song B (2020) Chest CT manifestations of new coronavirus disease 2019 (COVID-19): a pictorial review. Eur Radiol 30(8):4381–4389 - PMC - PubMed
  25. Hansell DM, Bankier AA, MacMahon H, McLoud TC, Muller NL, Remy J. Fleischner Society: glossary of terms for thoracic imaging. Radiology. 2008;246(3):697–722. doi: 10.1148/radiol.2462070712. - DOI - PubMed
  26. Inui S, Kurokawa R, Nakai Y, Watanabe Y, Kurokawa M, Sakurai K, et al. Comparison of chest CT grading systems in coronavirus disease 2019 (COVID-19) pneumonia. Radiol Cardiothorac Imaging. 2020;2(6):e200492. doi: 10.1148/ryct.2020200492. - DOI - PMC - PubMed
  27. Abo-Hedibah SA, Tharwat N, Elmokadem AH. Is chest X-ray severity scoring for COVID-19 pneumonia reliable? Pol J Radiol. 2021;86:e432–e439. doi: 10.5114/pjr.2021.108172. - DOI - PMC - PubMed
  28. Salehi S, Abedi A, Balakrishnan S, Gholamrezanezhad A. Coronavirus disease 2019 (COVID-19): a systematic review of imaging findings in 919 patients. AJR Am J Roentgenol. 2020;215(1):87–93. doi: 10.2214/AJR.20.23034. - DOI - PubMed
  29. Wong HYF, Lam HYS, Fong AH-T, Leung ST, Chin TW-Y, Lo CSY, et al. Frequency and distribution of chest radiographic findings in patients positive for COVID-19. Radiology. 2020;296(2):E72–8. doi: 10.1148/radiol.2020201160. - DOI - PMC - PubMed
  30. Pan F, Ye T, Sun P et al (2020) Time course of lung changes at chest CT during recovery from coronavirus disease 2019 (COVID-19). Radiology 295(3):715–721 - PMC - PubMed
  31. Xiong Y, Sun D, Liu Y et al (2020) Clinical and high-resolution CT features of the COVID-19 infection: comparison of the initial and follow-up changes. Invest Radiol 55(6):332–339 - PMC - PubMed
  32. Shi H, Han X, Jiang N, Cao Y, Alwalid O, Gu J, et al. Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study. Lancet Infect Dis. 2020;20(4):425–434. doi: 10.1016/S1473-3099(20)30086-4. - DOI - PMC - PubMed
  33. Li X, Geng M, Peng Y, Meng L, Lu S. Molecular immune pathogenesis and diagnosis of COVID-19. J Pharm Anal. 2020;10(2):102–108. doi: 10.1016/j.jpha.2020.03.001. - DOI - PMC - PubMed
  34. Koo HJ, Lim S, Choe J, Choi S-H, Sung H, Do K-H. Radiographic and CT features of viral pneumonia. Radiographics. 2018;38(3):719–739. doi: 10.1148/rg.2018170048. - DOI - PubMed
  35. Tian S, Xiong Y, Liu H, Niu L, Guo J, Liao M, et al. Pathological study of the 2019 novel coronavirus disease (COVID-19) through postmortem core biopsies. Mod Pathol. 2020;33(6):1007–1014. doi: 10.1038/s41379-020-0536-x. - DOI - PMC - PubMed

Page Navigation