5,557

A Comparison of Cobb Angle Measurement on Digitized Radiographs Using A Computer Pointing Device (Mouse): Without Endplate Extrapolation Versus With Endplate Extrapolation

Nakulan Nantha Kumar1, Peter Alex Gilmer Torrie2, Dylan Thomas3, Hui Ling Kerr2, Ian J. Harding3

1 University of Bristol (Medical School), Senate House, Tyndall Ave, Bristol BS8 1TH, UK;
2 Department of Spinal Surgery, Gloucestershire Hospitals NHS Trust, Gloucestershire Royal Hospital, Great Western Rd, Gloucester GL1 3NN, UK;
3 Department of Spinal Surgery, North Bristol NHS Trust, Southmead hospital, Southmead Rd, Bristol BS10 5NB, UK.

Conflict-of-interest statement: The author(s) declare(s) that there is no conflict of interest regarding the publication of this paper.

Open-Access: This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http: //creativecommons.org/licenses/by-nc/4.0/

Correspondence to: Nakulan Nantha Kumar, University of Bristol (Medical School), Senate House, Tyndall Ave, Bristol BS8 1TH, UK.
Email: nn16311@bristol.ac.uk

Received: January 20, 2021
Revised: February 10, 2021
Accepted: February 13 2021
Published online: February 28, 2021

ABSTRACT

AIM: Advancements in technology have improved the reliability of Cobb angle measurements. Precision of new measurement techniques have to be quantified and established for their valid clinical application. In this study, we investigated the reliability and precision of commonly utilised semi-automatic techniques of Cobb angle measurement, with and without endplate extrapolation using PACS Synapse V4.

METHODS: 53 spinal curves on digitised radiographs, were measured without and with endplate extrapolation, by three assessors independently on two separate occasions. Reliability testing using Cronbach’s Alpha test was conducted for intra-observer reliability. ANOVA assessed the inter-observer correlate. All datasets were assessed for normality using D’Agostino and Pearson. Cobb angle techniques without and with extrapolation were compared using a two-way unpaired Students’ T-test. P < 0.05 was accepted as significant.

RESULTS: All datasets passed normality testing. All intra-observer reliability was excellent (>0.9). The mean Cobb for all assessors, across both datasets, without extrapolation was 48.2° (95%CI 46.5-50.0) and with extrapolation was 48.1° (95%CI 46.4-49.8).

CONCLUSION: No significance (P=0.968) was observed in Cobb values measured between these semi-automatic techniques. Both Cobb angle measurement techniques produces results that are not significantly different, highly reliable, precise and thus could be utilised interchangeably in clinical practice.

Key words: Cobb angle; Computer-assisted measurement; Scoliosis

© 2021 The Author(s). Published by ACT Publishing Group Ltd. All rights reserved.

Nantha Kumar N, Torrie PAG, Thomas D, Kerr HL, Harding IJ. A Comparison of Cobb Angle Measurement on Digitized Radiographs Using A Computer Pointing Device (Mouse): Without Endplate Extrapolation Versus With Endplate Extrapolation. International Journal of Orthopaedics 2021; 8(1): 1431-1435 Available from: URL: http://www.ghrnet.org/index.php/ijo/article/view/3079

INTRODUCTION

Scoliosis is a spinal disorder that affects 2-4% adolescents[1-4]. The management of life-long and debilitating scoliosis involves serial full-length PA radiographs over time to quantify the curve magnitude and progression via the Cobb method[5]; change in Cobb readings is reported to be a risk factor for scoliotic progression[6]. Although Cobb angles are an objective 2-dimensional measure of a 3D spinal deformity[5-7], and despite its high intra and inter-observer errors[4, 8-11], it is still considered the “gold standard” radiographic parameter to quantify scoliotic curves due to its inherent simplicity. Given the multidisciplinary management of scoliosis, many different observers will be interpreting these radiographs. Decisions regarding surgical interventions and physiotherapeutic or orthotic options will be made based on scoliotic curve progression denoted by the Cobb angle[5]. Hence an accurate, precise and reliable method is of paramount clinical importance, especially considering even a 5° degree curve progression is potentially clinically important[12,13]. Several new cost-effective technological advancements have made the measurement of Cobb angles more efficient and reliable. However a paucity of evidence exists with regards to some of the technical intricacies that have yet to be fully investigated[14].

Many factors increase the error in Cobb angle measurement and pose limitations to its assessment: diameter of radiographic markers, varying observer experience and technical competence, subjects under investigation (biological variance), selection of varying end-vertebrae and errors in construction technique[11,15-17]. Recent technical advancements have given rise to several new digital methods that have been developed to measure the Cobb angle including smart phone app assisted, semiautomatic and automatic computer assisted techniques. Several studies have attempted to quantify the intra- and inter-observer reliability of several techniques used to quantify scoliosis progression and assessment. Most techniques have a high reliability, albeit a hierachy of reproducibility exists between techniques. Multiple studies have established that digital methods of measuring Cobb angles are more reliable and accurate when compared to manual techniques[11,18].

Currently, 2 semi-automatic methods of Cobb angle measurement are predominantly utilised; without (Figure 1) and with (Figure 2) end-plate extrapolation. Reliability (reproducibility) and precision (consistency) of Cobb angle measurements between these differing semi-automatic techniques has yet to be extablished. The aim of this study was to assess both the reliability of Cobb angle measurements for each semi-automatic digital technique and the precision of measurements obtained between these semi-automatic techniques on digitized radiographs.

METHODS

Methodology

Using the search term ‘whole spine scoliosis’ on our Patient Archiving and Communication System (PACS), we identified a cohort of patients with spinal radiographs retrospectively. The technical quality of each whole spine radiograph was assessed ensuring compliance with the minimum standards as detailed by the Scoliosis Research Society (SRS)[19]. 43 scoliosis patient radiographs, above the SRS radiographic quality threshold, were identified and anonymised into a separate file on the archive. 10 of the posterior-anterior (PA) radiographs had two apparent structural curves, giving a total of 53 curves for assessment. Curves included were that of the thoracic, thoracolumbar and lumbar spine from the original preoperative digitized PA radiographs. Given that the aim was to assess the reliability and precision of measurement techniques in isolation, we considered gender and upper limit of curve magnitude not to be significant baseline patient factors. Patients with curves above 20 degrees (°) were included as these are the potentially clinically significant (6). Exclusion criteria included; curves of magnitude of less than 20°, patients with spinal instrumentation or evidence of previous surgery, radiographs failing to meet SRS radiographic quality standards and patients older than 30 years to avoid the presence of significant degenerative changes which may confound the measurement techniques.

Three assessors included a medical student (NNK), spinal surgical fellow (DT) and a senior consultant spinal surgeon (IJH). All assessors underwent training in the precise methodology, using both semi-automatic techniques, for Cobb angle measurement as originally described[5]. Most cranially and caudally tilted endplate vertebrae were identified and recorded by the senior assessor (IJH) to eliminate this as a potential source of measurement error[12]. Each assessor independently measured the Cobb angles on the same set of 53 curves in a random order generated by the random function of Microsoft Excel version 16.33 (2010). On each occasion all assessors were blinded to patient details, previous measurements and the measurements of other assessors. Assessors completed Cobb angle measurements using the digitized technique without extrapolation first, then repeated them using the technique with extrapolation. After a measurement was made, the software reset the radiograph to its original form without saving the previous measurement or technical alteration i.e. magnification and contrast. Readings were repeated by each assessor at a 4-week interval to allow assessment of intra-observer reliability. The primary measurement of Cobb angle was labelled ‘dataset 1’ and the secondary as ‘dataset 2’.

Radiographic measurement technique

All the assessors used the same angle measuring software on PACS Synapse V4 (Synapse, London) to measure Cobb angles on each radiograph using both techniques. Both techniques involved measuring the Cobb angle in a 2D plane by drawing a superimposed cursor line along the upper and lower vertebral endplates, of the most cranially and caudally tilted vertebrae respectively, as described by Cobb JR[5]. For the non-extrapolated technique, the cursor lines solely spanned the width of the vertebral body (Figure 1) and for the extrapolated technique the cursor lines were drawn up until their point of intersection (Figure 2). The digital angle displayed on screen by Synapse, for both techniques, was then recorded.

Figure 1 Technique of measuring Cobb angle without endplate extrapolation.

Figure 2 Technique of measuring Cobb angle with endplate extrapolation.

Statistical Methods

Graphed Prism Version 7 was used to analyse the data. Normality testing of all datasets using D’Agostino and Pearson was initially performed. Cronbach’s Alpha test was used to measure intra-observer reliability between datasets 1 and 2 for each of the assessors (Table 1). A 2-tailed paired Students’ T-test was used to compare measurements between datasets 1 and 2, for each assessor, both without and with extrapolation (Table 1). Analysis Of Variance (ANOVA) was then used to assess the inter-observer correlate within each of the datasets, of all three assessors (Table 2). Finally a 2-tailed unpaired Students’ T-test was then used to compare techniques without and with extrapolation, to test for variability in measured Cobb values between the techniques. P < 0.05 was accepted as significant.

Table 1 Cobb angle measurement without extrapolation.
Assessor Mean Cobb (95%CI) [Dataset 1] Mean Cobb (95%CI) [Dataset 2]Cronbach AlphaP Value
149.0° (45.1-52.8)48.6° (44.2-53.0)0.9680.588
245.6° (41.5-49.7)45.3° (41.3-49.2)0.9750.59
350.7° (45.6-55.5)50.3° (45.7-54.9)0.9970.206
Cobb angle measurement with extrapolation
Assessor Mean Cobb (95% CI) [Dataset 1] Mean Cobb (95% CI) [Dataset 2]Cronbach AlphaP Value
147.5° (43.8-51.2)47.4° (43.3-51.6)0.9730.954
245.3° (41.1-49.6)45.4° (41.6-49.3)0.9750.882
351.5° (46.8-56.1)51.5° (47.0-56.0)0.9961

Table 2 Cobb angle measurement without extrapolation.
  Mean Cobb (95%CI)R2P
Dataset 1 all assessors48.4° (46.0-50.9)0.899<0.0001
Dataset 2 all assessors48.0° (45.6-50.5)0.912<0.0001
Cobb angle measurement with extrapolation
 Mean Cobb (95%CI)R2P
Dataset 1 all assessors48.1° (45.7-50.5)0.88<0.0001
Dataset 2 all assessors48.1° (45.7-50.5)0.899<0.0001

RESULTS

Study population included 30 females and 13 males with a mean age of 15.9 years (10-30) at the time the radiograph was taken. All the datasets passed normality testing. Intra-observer reliability between datasets 1 and 2, for all assessors both without and with extrapolation, was excellent or better (> 0.9) (Table 1).

The mean Cobb angle in dataset 1 (all assessors) without extrapolation was 48.4° (95%CI 46.0-50.9) and with extrapolation was 48.1° (95%CI 45.7-50.5). The mean Cobb angle in dataset 2 (all assessors) without extrapolation was 48.0° (95%CI 45.6-50.5) and with extrapolation 48.1° (95%CI 45.7-50.5). No signifance was observed in the Cobb values measured for any assessor (intra-observer reliability), either with or without extrapolation, between all datasets (Table 1) .

Analysis of Variance (ANOVA) identified a significant high interobserver correlate in both datasets, with and without extrapolation. All R2 values were >0.880 confirming precision of Cobb measurements between assessors (Table 2). The overall mean Cobb measurement (all assessors, both datasets) without extrapolation was 48.2°(95%CI 46.5-50.0) and with extrapolation was 48.1° (95%CI 46.4-49.8). Overall comparison of Cobb angle measurements obtained between these semi-automatic techniques, with and without extrapolation, was not significant (p = 0.913).

DISCUSSION

Since its conception in 1948[5], Cobb measurement techniques have changed with technology however its’ principles have remained the same. Multiple studies have investigated the most reliable technique for Cobb measurement with S.Langensiepen et al[14] reporting in a systematic review that digital techniques were more reliable than manual methods, albeit reporting significant variability in the reliability between automatic methods. Therefore establishing the difference in Cobb measurement reliability, inparticular the unreported precision between commonly utilised semi-automatic techniques, helps guide clinicians to accurately and safely determine the optimal management decision for every patient with spinal deformity. Furthermore potential exists to reduce additional unnecessary follow-up radiographs with the well documented harmful effects particularly observed in younger patient subgroups[20].

Conflicting findings of the importance of the seniority of the surgeon taking the Cobb measurement have been reported, with the level of experience of the surgeon being both identified as a potential source of error[11,21], and also not relevant[12] when measuring the Cobb. In this study, the assessors intra-observer reliability both without and with extrapolation between datasets 1 and 2, showed a tendency towards improved levels of reliability (increasing Cronbach Alpha scores) with the seniority of the reporting surgeon (Table 1), albeit these were not significant. Our study supports the importance of observer training to improve the reliability of Cobb measurement with both semi-automatic techniques, and shows excellent reliability of Cobb measurement regardless of the seniority of the reporting surgeon.

Advancements in technology and the use of standard digital archives in most institutions enable both these semi-automatic techniques to continue to be widely used at a low cost. Both techniques are rapid, user-friendly and cost effective, as all it involves is the cursor or a computer screen pointing device (mouse) and a monitor with access to the digital radiograph archive. Overall our study has established no significant difference between the Cobb measurements obtained using either of the described semi-automatic techniques, and thus both techniques can be used interchangeably to measure Cobb angles on digitized radiographs.

Strengths and limitations

There are several strengths to our study: (1) We used radiographs of patients from a young cohort (< 30 years) largely excluding the presence of degenerative changes (i.e. wedging, osteophyte, distortion and collapse) affecting vertebral endplates. (2) We used curves of a potential clinical significant magnitude (>20°). (3) Standardised equipment was used throughout the study to reduce measurement error and maintain digital consistency (i.e. computer screen size, computer screen pointing device(mouse), monitor screen display and resolution). The same software, Synapse V4, was used to reduce variability in terms of number of landmarks and/or positioning of the digitized radiograph (e.g. horizontal rotation). (4) Synapse V4 includes enhanced software options that enable the contrast, brightness and magnification to be altered. This improved the precision for assessors identifying and marking the superimposed lines on the vertebral endplates. (5) Preselection of endplates for measurement, by the senior author (IJH), reduced further measurement variability between assessors (6) All assessors underwent Cobb measurement training to comply with the international SRS standards. Study limitations included; (i) While using the extrapolated endplate technique in the angle measurement assessors faced a limitation, whereby the screen was not large enough for the lower and upper endplates to intersect. In such cases, endplate lines were just drawn till the limits of the screen as illustrated (Figure 3).

Figure 3 Limitation faced with endplate extrapolation technique.

CONCLUSION

Both semi-automatic techniques (without and with endplate extrapolation) described and assessed in this study remain convenient, cost effective and widely utilised methods for quantifying the severity and progression of scoliosis. This study demonstrates that both techniques utilising PACS Synapse V4 software are highly reliable and precise. Furthermore results between these semi-automatic techniques are not significantly different and are expected to produce similar results, thus could be used interchangeably.

REFERENCES

1. Konieczny MR, Senyurt H, Krauspe R. Epidemiology of adolescent idiopathic scoliosis. J Child Orthop 2013; 7: 3-9. [DOI: 10.1007/s11832-012-0457-4]; [PMID: 24432052]

2. Rogala EJ, Drummond DS, Gurr J. Scoliosis: incidence and natural history. A prospective epidemiological study. J Bone Joint Surg Am 1978; 60: 173-176. [PMID: 641080]

3. Yawn BP, Yawn RA, Hodge D, Kurland M, Shaughnessy WJ, Ilstrup D, Jacobsen SJ. A population-based study of school scoliosis screening. JAMA 1999; 282: 1427-1432. [DOI: 10.1001/jama.282.15.1427]; [PMID: 10535432]

4. Zhang J, Lou E, Hill DL, Raso JV, Wang Y, Le LH, Shi X. Computer-aided assessment of scoliosis on posteroanterior radiographs. Med Biol Eng Comput 2010; 48: 185-195. [DOI: 10.1007/s11517-009-0556-7]; [PMID: 20012376]

5. Cobb J. Outline for the study of scoliosis. Am Acad Orthop Surg Instr Course Lecture 1948; 5: 261-275

6. Prowse A, Pope R, Gerdhem P, Abbott A. Reliability and validity of inexpensive and easily administered anthropometric clinical evaluation methods of postural asymmetry measurement in adolescent idiopathic scoliosis: a systematic review. Eur Spine J 2016; 25: 450-466. [DOI: 10.1007/s00586-015-3961-7]; [PMID: 25917824]

7. Cowell HR. Radiographic measurements and clinical decisions. J Bone Joint Surg Am. 1990 Mar; 72(3): 319. [PMID: 2312526]

8. Ricarda L, David P, Dietmar D, Michael L, Christian B, Martin T. Comparison of two- and three-dimensional measurement of the Cobb angle in scoliosis. International Orthopaedics (SICOT) 2017; 41: 957-962 [DOI: 10.1007/s00264-016-3359-0]; [PMID: 27921155]

9. Geijer H, Beckman K, Jonsson B, Andersson T, Persliden J. Digital radiography of scoliosis with a scanning method: initial evaluation. Radiology 2001; 218: 402-410. [DOI: 10.1148/radiology.218.2.r01ja32402]; [PMID: 11161153]

10. Gstoettner M, Sekyra K, Walochnik N, Winter P, Wachter R, Bach CM. Inter- and intraobserver reliability assessment of the Cobb angle: manual versus digital measurement tools. Eur Spine J 2007; 16: 1587-1592. [DOI: 10.1007/s00586-007-0401-3]; [PMID: 17549526]

11. Langensiepen S, Semler O, Sobottke R, Fricke O, Franklin J, Schönau E, Eysel P. Measuring procedures to determine the Cobb angle in idiopathic scoliosis: a systematic review. Eur Spine J 2013; 22: 2360-2371. [DOI: 10.1007/s00586-013-2693-9]; [PMID: 23443679]

12. Morrissy RTG, G. S.; Hall, E. C.; Kehl, D.; Cowie, G. H. Measurement of the Cobb angle on radiographs of patients who have scoliosis. Evaluation of intrinsic error. J Bone Joint Surg Am 1990; 72: 320-327. [PMID: 2312527]

13. Lonstein J, Carlson J. The prediction of curve pro- gression in untreated idiopathic scoliosis during growth. In. J Bone Joint Surg Am 1984; 66(7): 1061-71. [PMID: 6480635]

14. Langensiepen SS, O.; Sobottke, R.; Fricke, O.; Franklin, J.; Schönau, E.; Eysel, P. Measuring procedures to determine the Cobb angle in idiopathic scoliosis: a systematic review. Eur Spine J 2013; 22(11): 2360-71. [DOI: 10.1007/s00586-013-2693-9]; [PMID: 23443679]

15. Facanha-Filho FA, Winter RB, Lonstein JE, Koop S, Novacheck T, L’Heureux EA, Noren CA. Measurement accuracy in congenital scoliosis. J Bone Joint Surg Am 2001; 83-A: 42-45. [DOI: 10.2106/00004623-200101000-00006]; [PMID: 11205857]

16. Morrissy RT, Goldsmith GS, Hall EC, Kehl D, Cowie GH. Measurement of the Cobb angle on radiographs of patients who have scoliosis. Evaluation of intrinsic error. J Bone Joint Surg Am 1990; 72: 320-327. [PMID: 2312527]

17. Carman DL, Browne RH, Birch JG. Measurement of scoliosis and kyphosis radiographs. Intraobserver and interobserver variation. J Bone Joint Surg Am 1990; 72: 328-333. [PMID: 2312528]

18. Rosenfeldt MP, Harding IJ, Hauptfleisch JT, Fairbank JT. A comparison of traditional protractor versus Oxford Cobbometer radiographic measurement: intraobserver measurement variability for Cobb angles. Spine (Phila Pa 1976) 2005 Feb 15; 30(4): 440-3. [DOI: 10.1097/01.brs.0000153401.78638.cb] [PMID: 15706342]

19. O’Brien M, Kuklo T, Blank K, Lenke L. Radiographic Measurement Manual In Spinal Deformity Study Group. [https://www.oref.org/docs/default-source/default-document-library/sdsg-radiographic-measuremnt-manual.pdf]

20. Lee MC, Solomito M, Patel A. Supine magnetic resonance imaging Cobb measurements for idiopathic scoliosis are linearly related to measurements from standing plain radiographs. Spine (Phila Pa 1976). 2013 May 15; 38(11): E656-61. [DOI: 10.1097/BRS.0b013e31828d255d]; [PMID: 23429689]

21. Facanha-Filho FA, Winter RB, Lonstein JE, Koop S, Novacheck T, L’Heureux EA Jr, Noren CA. Measurement accuracy in congenital scoliosis. J Bone Joint Surg Am. 2001 Jan; 83(1): 42-5. [DOI: 10.2106/00004623-200101000-00006]; [PMID: 11205857]

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.