PREVALENCE OF MRI FINDINGS IN THE CERVICAL SPINE IN PATIENTS WITH PERSISTENT NECK PAIN BASED ON QUANTIFICATION OF NARRATIVE MRI REPORTS
 
   

Prevalence of MRI Findings in the Cervical Spine
in Patients with Persistent Neck Pain Based on
Quantification of Narrative MRI Reports

This section was compiled by Frank M. Painter, D.C.
Send all comments or additions to:
   Frankp@chiro.org
 
   

FROM:   Chiropractic & Manual Therapies 2019 (Mar 6); 27: 13 ~ FULL TEXT

  OPEN ACCESS   


Rikke Krüger Jensen, Tue Secher Jensen, Søren Grøn, Erik Frafjord, Uffe Bundgaard, Anders Lynge Damsgaard, Jeppe Mølgaard Mathiasen and Per Kjaer

Nordic Institute of Chiropractic and Clinical Biomechanics,
Odense, Denmark



BACKGROUND   Previous studies of patients with neck pain have reported a high variability in prevalence of MRI findings of disc degeneration, disc herniation etc. This is most likely due to small and heterogenous study populations. Reasons for only including small study samples could be the high cost and time-consuming procedures of having radiologists coding the MRIs. Other methods for extracting reliable imaging data should therefore be explored.

The objectives of this study were

1)   to examine inter-rater reliability among a group of chiropractic master students in extracting information
about cervical MRI-findings from radiologists´ narrative reports, and

2)   to describe the prevalence of MRI findings in the cervical spine among different age groups in patients above
age 18 with neck pain.

METHOD   Adult patients with neck pain (with or without arm pain) seen in a public hospital department between 2011 and 2014 who had an MRI of the cervical spine were identified in the patient registry ‘SpineData’. MRI-findings were extracted and quantified from radiologists’ narrative reports by second-year chiropractic master students based on a set of coding rules for the process.

The inter-rater reliability was quantified with Kappa statistics and the prevalence of the MRI findings were calculated.

RESULTS   In total, narrative MRI reports from 611 patients were included. The patients had a mean age of 52 years (SD 13; range 19–87) and 63% were women. The inter-observer agreement in coding MRI findings ranged from substantial (κ = 0.78, CI: 0.33–1.00) to almost perfect (κ = 0.98, CI: 0.95–1.00).

The most prevalent MRI findings were foraminal stenosis (77%), uncovertebral arthrosis (74%) and disc degeneration (67%) while the least prevalent findings were nerve root compromise (2%) and Modic changes type 2 (6%). Modic type 1 was mentioned in 25% of the radiologists’ reports. The prevalence of all findings increased with age, except disc herniation which was most prevalent for patients in their forties.

There are more articles like this @ our:

RADIOLOGY Section

CONCLUSION   MRI-findings from radiologists’ narrative reports can reliably be extracted by chiropractic master students with a minimum of training. Degenerative findings in the cervical spine were most commonly found at levels C5/C6 and C6/C7 and increased with age.

KEYWORDS:   MRI, Cervical spine, Prevalence



From the FULL TEXT Article:

Background

Globally, neck pain is ranked as the fourth cause of years lived with disability in reports from both 1990 and 2013. [1] In 2013, neck pain was the second leading cause of years lived with disability in Denmark, only exceeded by low back pain. Neck pain is a very common condition with an estimated mean one year prevalence of 25%. [2]

The use of Magnetic Resonance Imaging (MRI) in the search for biological causes of neck pain remains controversial as studies have shown that pathoanatomical changes in the cervical spine are also common in healthy volunteers [3], even though certain MRI findings appear more prevalent in people with pain compared to people without pain. [4–7] In addition, there is no available evidence supporting MRI findings as predictive for treatment effect in people with neck pain, although one study has reported that neck pain related activity limitations could be related to MRI findings. [8]

There is a wide variability in the reported prevalence of different MRI findings such as for example disc degeneration [7, 9–11] and Modic changes [4–7] and only limited knowledge is available to inform the clinician about what should be expected of MRI findings at a certain age and how this relates to neck pain in different populations. There are several potential reasons for the variability in the prevalence of MRI findings such as differences in patient populations and age groups, sampling methods, as well as rating criteria for the images. Using a large sample of patients from the same treatment setting who have a wide age span to cover age related degenerative findings will enable us to establishing consistent prevalence rates of a broad range of MRI findings in the cervical spine.

The use of quantitative coding of images is a way to ensure high quality and reliability of the MRI data and is the preferred method applied in research projects. [12–15] However, using a direct coding of image finding is not always applicable because it is time consuming and there are only few research radiologists.

As an alternative to this procedure, Kent et al. [16] investigated if physiotherapy students could extract and quantify MRI data from narrative radiologists’ reports of the lumbar spine and found the method valid and with high reliability. However, it remains uncertain how this method will perform in other groups of students and in other anatomical areas.

For these reasons, the objectives of this study were to

1)   to examine inter-rater reliability among a group of chiropractic master students in extracting and quantifying information from radiologist-generated MRI narrative reports, and

2)   to describe the prevalence of MRI findings in the cervical spine in different age groups of patients above age 18 with neck pain.



Method

      Study design

This study was a retrospective cross-sectional observational study.

      Patient population

All participants were above the age of 18 and had neck pain with or without arm pain. They had all attended the same publicly funded outpatient spine clinic (The Spine Centre of Southern Denmark) where they had been referred to from the primary care chiropractors and general practitioners for a multidisciplinary evaluation.

      Data collection

Figure 1

Clinical data are routinely collected at the spine clinic using an electronically based standardised questionnaire ‘SpineData’ which is an internet-based, multiuser registry designed to capture patient data electronically at the point of clinical contact. [17] A list of patients > 18 years with neck and with or without arm pain, who had attended the spine clinic between January 1, 2011 and December 31, 2014, was extracted from the SpineData registry and the listed patients were assessed for eligibility. Patients who had filled out the questionnaire at the first visit and at 12–months follow-up, and also had an MRI of the cervical spine from the radiology department of the hospitals in either Middelfart or Vejle, were included. The narrative radiologists’ reports were collected and evaluated. Patients were excluded if one or more of the following pathoanatomies were identified: recent acute vertebral fractures, surgical fusions, spinal infections, tumors, inflammatory spondyloarthropathy or other serious pathology. A summary of the data collection is presented in Figure 1.

      Imaging

Only MRIs from the hospital’s radiology departments of Middelfart and Vejle were included in order to ensure homogeneity in the MRI scan and MRI evaluation protocols. The MRI protocol included the following sequences: one localiser, a sagittal short-tau inversion recovery (STIR), a sagittal T1-weighted turbo spin-echo (TSE), a sagittal T2-weighted Volume Isotropic Turbo spin echo Acquisition (VISTA) and axial T2 weighted TSE of the three lower cervical segmental levels with supplement of segmental levels suspicious of pathology. In addition, the radiologists use reconstructed semi-coronal series from the VISTA sequence, as part of their standardised evaluation, for visualisation of the neural foramina. The majority of MRIs were performed with a 1.0 Tesla (Philips Panorama, Best, The Netherlands) or 1.5 Tesla unit (Philips Achieva and Philips Ingenia, Best, The Netherlands) MRI system or, although rarely, with a 0.2 Tesla unit.

The narrative reports were retrieved from this hospitals Picture Archiving and Communication System (PACS) EasyViz archive (Medical Insight, Valby, Denmark).

      Variables of interest

Ten MRI findings were chosen for this study as they were considered relatively common and relevant to the research context of this study; Modic changes type 1 and type 2, disc degeneration, disc herniation, disc bulge, nerve root compromise, foraminal stenosis, central stenosis, facet joint arthrosis and uncovertebral arthrosis.

Descriptive clinical data on age, sex, sick leave, neck and arm pain as measured on an 11–point numeric rating scale [18] and physical function measured with the Neck Disability Index (NDI) [19] were available from the SpineData registry.

      Coding of MRI narrative reports

Coding of the narrative reports was modified for the cervical spine from the process previously described by Kent et al. [13] A set of coding rules was developed to record the presence or absence of an MRI finding on each of the cervical segmental levels from C2/C3 to C7/Th1. A segmental level was defined as the inferior endplate of the top vertebra to the superior endplate of the vertebra below including the inter-vertebral space (e.g. inferior endplate of C2 to the superior endplate of C3).

The reviewers of the narrative reports were six second-year chiropractic master students who had finished their imaging course of 16 ECTS points (European Credit Transfer and Accumulation System). The data collection was part of their pre-graduate Master Thesis project which they had chosen from a catalogue of research projects suitable for a Master Thesis. The subject was chosen out of availability and interest. The students described the coding rules for identifying each of the MRI findings based on

i)   previous work in the department [16],

ii)   a consensus document from the radiological department and

iii)   by consulting senior researchers.

In-person meetings were conducted first between the groups of students and later with the attendance of a senior researcher to review and refine the final set of coding rules. An additional file shows the final set of coding rules (see Additional File 1).

      Reliability testing

The reliability study was done in two steps. One study was performed to test the inter-rater reliability between four of the six chiropractic master students for data extraction of disc degeneration, disc herniation, disc bulge, nerve root compromise, foraminal stenosis, central stenosis, facet joint arthrosis and uncovertebral arthrosis. The study was based on six cervical segmental levels in 59 patients (354 levels). Another study investigated the reliability of the data extraction of Modic changes type 1 and type 2 on six levels in 50 patients (300 segmental levels) between the remaining two students. Each finding from the MRI radiologists’ reports was registered in spread sheets developed for this purpose (Microsoft Excel 2010, Microsoft Corp, Redmond, WA, USA). To ensure blinding the observers were allocated to different rooms and filled in the spread sheets independently. Each observer then delivered the data to one of the senior researchers who merged the data and performed the analysis.

      Statistics

Unweighted Kappa statistics including 95% confidence intervals (CI) were used to quantify the inter-rater reliability. The interpretation of the Kappa coefficient (κ) was based on Landis and Koch for strength of agreement: values lower than 0.20 indicated slight agreement; 0.21–0.40, fair agreement; 0.41–0.60 moderate agreement; 0.61–0.80 substantial agreement; and 0.81–1.00 almost perfect agreement [20]. The prevalence of the MRI findings for each segmental level and per person was calculated in percentage. The age of the participants was divided into decades. The minimum and maximum age group were merged with nearest age group if < 10 per group. STATA 14 (Stata Corp, College Station, Texas, USA) was used for all data management. The prevalence of MRI findings was calculated by disc level (C2/C3 to C7/Th1), by patient level and by age (18–30, 31–40, 41–50, 51–60, 61–70 and 70+ years of age).



Results

A total of 1527 patients with neck pain and baseline questionnaire were identified in the SpineData registry within the predefined time period. After excluding duplicate patient episodes, patients without MRI and patients without follow-up data, 611 narrative MRI reports were included in the final sample. Of these, none had severe pathology on MRI. Figure 1 illustrates the inclusion of patients.
Table 1

Table 2

Table 3


Figure 2

The patients had a mean age of 52 years (SD 13; range 19–87) and 63% were women. Baseline demographics and clinical characteristics are shown in Table 1.

The inter-observer agreement ranged from substantial (κ = 0.78, 95% CI 0.33–1.0) to almost perfect (κ = 0.98, CI 0.95–1.00). For nine out of ten of the MRI variables the kappa values were above 0.9. Only ‘nerve root compromise’ was below 0.9 with κ = 0.78 (95% CI 0.33–1.0). Kappa values with 95% confidence intervals for each of the variables are shown in Table 2.

Inter-rater reliability was estimated with two readers for Modic changes type 1 and type 2 (six segmental levels from 50 patients) and with four readers for the rest of the variables (six segmental levels from 59 patients).

The most prevalent reported finding was foraminal stenosis (77%), uncovertebral arthrosis (74%) and disc degeneration (67%) while the least prevalent finding was nerve root compromise (2%) and Modic changes type 2 (6%). Modic changes type 1 was mentioned in 25% of the reports. All variables had the highest prevalence at level C5/C6 and C6/C7 except from facet joint arthrosis which was mostly present at level C3/C4 and C4/C5. Thirteen percent of patients did not have any findings on the MRI and 73% had the presence of any MRI finding on more than one level. The prevalence of findings in total and per level is presented in Table 3.

Figure 2 displays the prevalence of MRI findings by age categories. The figure indicates that MRI findings such as disc degeneration, disc bulge, uncovertebral arthrosis and foraminal stenosis starts to increase in the twenties while central stenosis, facet joint arthrosis and Modic changes type 1 increases for patients in their thirties and disc herniation is almost evenly distributed across the age groups with a small peak in patients in their forties.



Discussion

To our knowledge this is the first study to apply this data extraction method from radiology reports of the cervical spine. The results show that chiropractic students at a master’s level can, with a minimum of training, extract reliable data from narrative reports, as the intra-observer agreement ranged from substantial to almost perfect. The prevalence study showed that degenerative MRI-findings are common in patients with neck pain. Three quarters of the patients had foraminal stenosis, uncovertebral arthrosis or disc degeneration, half of them had disc bulges, one quarter to one third had Modic changes type 1, facet joint arthrosis or central stenosis and very few (2–6%) had nerve root compromise or Modic changes type 2.

      Inter-rater reliability

Kent et al. [16] have previously developed and tested the method on data extraction from MRI reports of the lumbar spine and found similar results. In that study, three physiotherapy students evaluated four sets of 20 MRI reports across 14 pathoanatomical categories and found kappa values ranging from substantial to almost perfect agreement. As in the present study nerve root compromise was the only variable not exceeding an inter-rater kappa value above 0.9. This might be explained by the variety in the language used in the narrative reports to describe this finding. At the same time, nerve root compromise was found to be the least prevalent MRI finding (2%) in the cervical spine which gives the readers less training material.

The method of extracting data from narrative radiology reports has previously been investigated using computer-assisted categorisation of human language. Although the technique is quite advanced compared to students extracting the data it is based on the same recognition of predefined words or phrases. This area of research called natural language processing has proven to be useful in detecting the presence of a finding or disease from unstructured reports. In a systematic review Pons et al. [21] identified 67 publications describing information extraction and conclude that the performance of natural language processing applications in radiology is generally high.

      Prevalence

In a study by Karki et al. [10] with 750 patients with neck pain the reported prevalence of foraminal stenosis was only 41% compared to 77% in our population. For disc degeneration Karki et al. [10] reported the prevalence to be 76% versus 67% in our population which is comparable. The difference in prevalence of foraminal stenosis could be that the study by Karki et al. used a low field MRI system (0.35 T) and did not use semi-coronal sequences for the visualisation of the neural foramina. Also, there was a difference in mean age of the populations with our population being on average seven years older and as degenerative findings increases with age this could also influence the difference in prevalence.

The prevalence seems to be less in non-clinical populations as Matsumoto et al. [22] found the prevalence of foraminal stenosis to be present in only 5.9% of cervical disc levels in 497 asymptomatic volunteers and Arnbak et al. found a prevalence of disc degeneration in the cervical spine to be only 24% [5] in a population of 1037 patients between 18 and 40 years of age seeking care for low back pain. However, as the mean age of this study sample was 52 years the prevalence would be expected to be higher due to age alone.

Peterson et al. reported Modic changes type 1 in 16% and type 2 in 3.5% in patients with neck pain. [6] This is almost in line with our prevalence of 25% for type 1 and 6% for type 2. Another study by Mann et al. [7] investigating 500 patients over the age of 50 with neck pain also found a comparable prevalence of type 1 (15%) while type 2 was as high as 28%.

Modic changes also seem to be more prevalent in the cervical spine in people with neck pain (8.8%) when compared to people without (3.3%). [4] Also, in the study by Arnbak et al. [5] the prevalence of Modic changes type 1 was reported to be only 2% and type 2 1.7%, however, as this was a young population and as the prevalence of Modic changes seems to increase with age, the numbers are not directly comparable. In a study by Bendix et al. [23] comparing low-field and high-field MRI machines when investigating Modic changes in the lumbar spine the authors found that type 1 was detected three times more often using a low field MRI while type 2 was detected two times more often when using high field MRI. In the present study the high field systems (1.0 Tesla and 1.5 Tesla) were primarily used and only rarely was the low field system (0.2 Tesla) used.

Although some MRI findings seem to be more prevalent in symptomatic people compared to those without neck pain, the limitations of the studies described above prevent a clear conclusion. Also, as this is a cross sectional study of a population with neck pain, the data cannot inform the association between MRI findings and the presence of symptoms, e.g. neck pain.

Strengths and limitations

The strength of this study is the size of the study sample, which provides us with enough data to report on even less frequent findings such as nerve root compromise. Also, the high agreement found in the data extraction process showed that the reporting of the radiologist is sufficiently quantified in this dataset. However, we do not know the agreement between radiologists describing the original MRIs which is a major limitation of the quality of the data. On the other hand, this is the material on which clinician’s make decisions in everyday practice in the meeting with the patient. Also, the radiology departments have a consensus document describing the content of a radiologist report on an MRI recording of the spine (document in Danish is available on request). The consensus document describes the most common MRI pathologies such as disc degeneration, disc herniation, central and foraminal stenosis and are based on international classifications. [24, 25] For example, disc degeneration is evaluated as four categories:

1)   ‘normal’ (normal disc height and disc signal intensity),

2)   ‘mild disc degeneration’ (slightly reduced disc height and decreased disc signal intensity),

3)   ‘moderate disc degeneration’ (moderate reduced disc height) and

4)   ‘severe disc degeneration’ (collapsed disc space).

Although the present study has high internal validity, it is questionable to what extent the results from this study can be applied more generally as the variability in the interpretation of MRI scans is far from standardised. In a recent study [26] from the US, one 63–year old patient with low back pain had lumbar spine MRIs performed at ten different MRI centres over a period of 3 weeks. Comparison of the 10 narrative reports revealed considerable variability; none of the 49 described findings occurred in all 10 reports and only one finding occurred in nine reports. In order to use the method of extracting data from narrative reports, as described in the present study, one must make sure that the reporting is standardised.

      Perspectives

The method presented in this study of using inexperienced people to reliably extract data from narrative reports is a relatively simple way to collect large amounts of imaging data that can be used for research and quality assurance purposes. The prevalence estimates that we have reported for different segmental levels and age categories can provide clinicians and researchers with information on the expected prevalence for specific spinal pathoanatomical findings in patients with neck pain. Overdiagnosis may occur when a medical diagnosis is based on age-related MRI findings. It is therefore important for clinicians to know and communicate to the patient exactly how ‘normal’ these findings are in a patient population in order to avoid incorrect interpretation of MRI findings to be the cause of a patient’s symptoms. Further studies are needed to clarify the clinical relevance of these findings. Also, as spinal MRI findings obviously increase with age researchers should be conscious to report on prevalence according to age categories.



Conclusion

Narrative radiologists’ reports can reliably be quantified by chiropractic master students with a minimum of training. Degenerative findings in the cervical spine were very common and mentioned in approximately 70% of the radiologists’ reports while nerve root compromise was a rare finding.


Abbreviations

CI: = Confidence Interval
ECTS: = European credit transfer and accumulation system
MRI: = Magnetic resonance imaging
NDI: = Neck disability index
NRS: = Numerical rating scale
SD: = Standard deviation
STIR: = sagittal short-tau inversion recovery
TSE: = turbo spin-echo
VISTA: = Volume isotropic turbo spin echo acquisition
κ: = Kappa coefficient


Acknowledgements

The authors would like to acknowledge Lasse Rasmussen (LR), chiropractor, MSc, for participating in the data collection.


Funding

RKJ and TSJ’s positions were funded by The Danish Foundation for Chiropractic Research and Postgraduate Education. PK’s position is funded by University College Lillebaelt, Odense, Denmark.


Authors’ contributions

All authors were involved in the design of the study, analysis and interpretation of data and revision of the manuscript. SG, EF, UB, ALD and JMM collected the data. RKJ wrote the initial draft of the manuscript. All authors have read, improved draft manuscripts and approved the final manuscript.


Competing interests

The authors declare that they have no competing interests.



References:

  1. Global Burden of Disease Study Collaborators.
    Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic
    diseases and injuries in 188 countries, 1990-2013: a systematic analysis for the global burden of disease
    study 2013.
    Lancet. 2015;386(9995):743–800.

  2. Hoy DG, Protani M, De R, Buchbinder R.
    The epidemiology of neck pain.
    Best Pract Res Clin Rheumatol. 2010;24(6):783–92.

  3. Nakashima H, Yukawa Y, Suda K, Yamagata M, Ueta T, Kato F.
    Abnormal findings on magnetic resonance images of the cervical spines in 1211 asymptomatic subjects.
    Spine (Phila Pa 1976). 2015;40(6):392–8.

  4. Sheng-yun L, Letu S, Jian C, Mamuti M, Jun-hui L, Zhi S, et al.
    Comparison of modic changes in the lumbar and cervical spine, in 3167 patients with and without spinal pain.
    PLoS One. 2014;9(12):e114993.

  5. Arnbak B, Jensen T, Egund N, Zejden A, Horslev-Petersen K, Manniche C, et al.
    Prevalence of degenerative and spondyloarthritis-related magnetic resonance imaging findings in the spine
    and sacroiliac joints in patients with persistent low back pain.
    Eur Radiol. 2016;26(4):1191–203.

  6. Peterson CK, Humphreys BK, Pringle TC.
    Prevalence of modic degenerative marrow changes in the cervical spine.
    J Manip Physiol Ther. 2007;30(1):5–10.

  7. Mann E, Peterson CK, Hodler J.
    Degenerative marrow (modic) changes on cervical spine magnetic resonance imaging scans: prevalence,
    inter- and intra-examiner reliability and link to disc herniation.
    Spine (Phila Pa 1976). 2011;36(14):1081–5.

  8. Kressig M, Peterson CK, McChurch K, Schmid C, Leemann S, Anklin B, et al.
    Relationship of Modic changes, disk herniation morphology, and axial location to outcomes in symptomatic
    cervical disk herniation patients treated with high-velocity, low-amplitude spinal manipulation:
    a prospective study.
    J Manip Physiol Ther. 2016;39(8):565–75.

  9. Okada E, Matsumoto M, Fujiwara H, Toyama Y.
    Disc degeneration of cervical spine on MRI in patients with lumbar disc herniation:
    comparison study with asymptomatic volunteers.
    European spine journal : official publication of the European Spine Society,
    the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society.
    2011;20(4):585–91.

  10. Karki DB, Gurung G, Adhikary KP, Ghimire RK.
    Magnetic resonance imaging findings in degenerative disc disease of cervical spine in symptomatic patients.
    J Nepal Health Res Counc. 2015;13(31):196–200.

  11. Nakashima H, Yukawa Y, Suda K, Yamagata M, Ueta T, Kato F.
    Cervical disc protrusion correlates with the severity of cervical disc degeneration:
    a cross-sectional study of 1211 relatively healthy volunteers.
    Spine (Phila Pa 1976). 2015;40(13):E774–9.

  12. Solgaard SJ, Kjaer P, Jensen ST, Andersen P.
    Low-field magnetic resonance imaging of the lumbar spine: reliability of qualitative evaluation of disc
    and muscle parameters.
    Acta Radiol. 2006;47(9):947–53.

  13. Jensen TS, Sorensen JS, Kjaer P.
    Intra- and interobserver reproducibility of vertebral endplate signal (modic) changes in the lumbar spine:
    the Nordic Modic consensus group classification.
    Acta Radiol. 2007;48(7):748–54.

  14. Arnbak B, Jensen TS, Manniche C, Zejden A, Egund N, Jurik AG.
    Spondyloarthritis-related and degenerative MRI changes in the axial skeleton -
    an inter- and intra-observer agreement study.
    BMC Musculoskelet Disord. 2013;14:274.

  15. Fu MC, Webb ML, Buerba RA, Neway WE, Brown JE, Trivedi M, et al.
    Comparison of agreement of cervical spine degenerative pathology findings in magnetic resonance imaging studies.
    Spine J. 2016;16(1):42–8.

  16. Kent P, Briggs AM, Albert HB, Byrhagen A, Hansen C, Kjaergaard K, et al.
    Inexperienced clinicians can extract pathoanatomic information from MRI narrative reports with
    high reproducibility for use in research/quality assurance.
    Chiropr Man Therap. 2011;19(1):16.

  17. Kent P, Kongsted A, Jensen TS, Albert HB, Schiottz-Christensen B, Manniche C.
    SpineData - a Danish clinical registry of people with chronic back pain.
    Clin Epidemiol. 2015;7:369–80.

  18. Cleland JA, Childs JD, Whitman JM.
    Psychometric properties of the neck disability index and numeric pain rating scale in patients with
    mechanical neck pain.
    Arch Phys Med Rehabil. 2008;89(1):69–74.

  19. Vernon H.
    The neck disability index: state-of-the-art, 1991-2008.
    J Manip Physiol Ther. 2008;31(7):491–502.

  20. Landis JR, Koch GG.
    The measurement of observer agreement for categorical data.
    Biometrics. 1977;33(1):159–74.

  21. Pons E, Braun LM, Hunink MG, Kors JA.
    Natural language processing in radiology: a systematic review.
    Radiology. 2016;279(2):329–43.

  22. Matsumoto M, Fujimura Y, Suzuki N, Nishi Y, Nakamura M, Yabe Y, et al.
    MRI of cervical intervertebral discs in asymptomatic subjects.
    J Bone Joint Surg Br. 1998;80(1):19–24.

  23. Bendix T, Sorensen JS, Henriksson GA, Bolstad JE, Narvestad EK, Jensen TS.
    Lumbar modic changes-a comparison between findings at low- and high-field magnetic resonance imaging.
    Spine (Phila Pa 1976). 2012;37(20):1756–62.

  24. Fardon DF, Williams AL, Dohring EJ, Murtagh FR, Gabriel Rothman SL, Sze GK.
    Lumbar disc nomenclature: version 2.0. Recommendations of the combined task forces of the North American
    Spine Society, the American Society of Spine Radiology and the American Society of Neuroradiology
    Spine J. 2014;14(11):2525–45.

  25. Pfirrmann CW, Metzdorf A, Zanetti M, Hodler J, Boos N.
    Magnetic resonance classification of lumbar intervertebral disc degeneration.
    Spine (Phila Pa 1976). 2001;26(17):1873–8.

  26. Herzog R, Elgort DR, Flanders AE, Moley PJ.
    Variability in diagnostic error rates of 10 MRI centers performing lumbar spine MRI examinations on the
    same patient within a 3-week period.
    Spine J. 2017;17(4):554–61.

Return to RADIOLOGY

Since 3-07-2019

                  © 1995–2024 ~ The Chiropractic Resource Organization ~ All Rights Reserved