Skip to main content
Intended for healthcare professionals
Restricted access
Research article
First published online January 24, 2020

Automated Skeletal Classification with Lateral Cephalometry Based on Artificial Intelligence

Abstract

Lateral cephalometry has been widely used for skeletal classification in orthodontic diagnosis and treatment planning. However, this conventional system, requiring manual tracing of individual landmarks, contains possible errors of inter- and intravariability and is highly time-consuming. This study aims to provide an accurate and robust skeletal diagnostic system by incorporating a convolutional neural network (CNN) into a 1-step, end-to-end diagnostic system with lateral cephalograms. A multimodal CNN model was constructed on the basis of 5,890 lateral cephalograms and demographic data as an input. The model was optimized with transfer learning and data augmentation techniques. Diagnostic performance was evaluated with statistical analysis. The proposed system exhibited >90% sensitivity, specificity, and accuracy for vertical and sagittal skeletal diagnosis. Clinical performance of the vertical classification showed the highest accuracy at 96.40 (95% CI, 93.06 to 98.39; model III). The receiver operating characteristic curve and the area under the curve both demonstrated the excellent performance of the system, with a mean area under the curve >95%. The heat maps of cephalograms were also provided for deeper understanding of the quality of the learned model by visually representing the region of the cephalogram that is most informative in distinguishing skeletal classes. In addition, we present broad applicability of this system through subtasks. The proposed CNN-incorporated system showed potential for skeletal orthodontic diagnosis without the need for intermediary steps requiring complicated diagnostic procedures.

Get full access to this article

View all access and purchase options for this article.

References

Arık SÖ, Ibragimov B, Xing L. 2017. Fully automated quantitative cephalometry using convolutional neural networks. J Med Imaging (Bellingham). 4(1):014501.
Bishara SE, Fahl JA, Peterson LC. 1983. Longitudinal changes in the ANB angle and wits appraisal: clinical implications. Am J Orthod. 84(2):133–139.
Björk A. 1969. Prediction of mandibular growth rotation. Am J Orthod. 55(6):585–599.
Casalegno F, Newton T, Daher R, Abdelaziz M, Lodi-Rizzini A, Schürmann F, Krejci I, Markram H. 2019. Caries detection with near-infrared transillumination using deep learning. J Dent Res. 98(11):1227–1233.
da Fontoura CS, Miller SF, Wehby GL, Amendt BA, Holton NE, Southard TE, Allareddy V, Moreno Uribe LM. 2015. Candidate gene analyses of skeletal variation in malocclusion. J Dent Res. 94(7):913–920.
da Silveira HL, Silveira HE. 2006. Reproducibility of cephalometric measurements made by three radiology clinics. Angle Orthod. 76(3):394–399.
Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L. 2009. Imagenet: a large-scale hierarchical image database. Miami (FL): 2009 IEEE Conference on Computer Vision and Pattern Recognition. p. 248–255.
Doff M, Hoekema A, Pruim G, Slater JH, Stegenga B. 2010. Long-term oral-appliance therapy in obstructive sleep apnea: a cephalometric study of craniofacial changes. J Dent. 38(12):1010–1018.
Durão AR, Pittayapat P, Rockenbach MIB, Olszewski R, Ng S, Ferreira AP, Jacobs R. 2013. Validity of 2D lateral cephalometry in orthodontics: a systematic review. Prog Orthod. 14(1):31.
Ekert T, Krois J, Meinhold L, Elhennawy K, Emara R, Golla T, Schwendicke F. 2019. Deep learning for the radiographic detection of apical lesions.J Endod. 45(7):917–922.e5.
Fleiss J. 1971. Measuring nominal scale agreement among many raters. Psychol Bull. 76(5):378–382.
Gravely J, Benzies PM. 1974. The clinical significance of tracing error in cephalometry. Br J Orthod. 1(3):95–101.
He H, Garcia EA. 2008. Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering. 21(9):1263–1284.
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. 2017. Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. p. 4700–4708. https://arxiv.org/abs/1608.06993
Jacobson A. 1975. The “wits” appraisal of jaw disharmony. Am J Orthod. 67(2):125–138.
Jarabak JA, Fizzel JR. 1972. Technique and treatment with light wire appliances. Am J Orthod Dentofacial Orthop. 64(3):317–318.
Kamoen A, Dermaut L, Verbeeck R. 2001. The clinical significance of error measurement in the interpretation of treatment results. Eur J Orthod. 23(5):569–578.
Krois J, Ekert T, Meinhold L, Golla T, Kharbot B, Wittemeier A, Dörfer C, Schwendicke F. 2019. Deep learning for the radiographic detection of periodontal bone loss. Sci Rep. 9(1):8495.
Lee H, Park M, Kim J. 2017. Cephalometric landmark detection in dental x-ray images using convolutional neural networks. Proceedings of the SPIE: Medical Imaging 2017: Computer-Aided Diagnosis. 10134:101341W.
Nishimoto S, Sotsuka Y, Kawai K, Ishise H, Kakibuchi M. 2019. Personal computer-based cephalometric landmark detection with deep learning, using cephalograms on the internet. J Craniofac Surg. 30(1):91–95.
Perez L, Wang J. 2017. The effectiveness of data augmentation in image classification using deep learning. https://arxiv.org/abs/1712.04621.
Steiner CC. 1953. Cephalometrics for you and me. Am J Orthod. 39(10):729–755.
Steiner CC. 1959. Cephalometrics in clinical practice. Angle Orthod. 29(1):8–29.
Tiulpin A, Thevenot J, Rahtu E, Lehenkari P, Saarakkala S. 2018. Automatic knee osteoarthritis diagnosis from plain radiographs: a deep learning-based approach. Sci Rep. 8:1727.
Torosdagli N, Liberton DK, Verma P, Sincan M, Lee JS, Bagci U. 2018. Deep geodesic learning for segmentation and anatomical landmarking. IEEE Trans Med Imaging. 38(4):919–931.
Trpkova B, Major P, Prasad N, Nebbe B. 1997. Cephalometric landmarks identification and reproducibility: a meta analysis. Am J Orthod Dentofacial Orthop. 112(2):165–170.
Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. 2017. ChestX-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. Honolulu (HI): 2017 IEEE Conference on Computer Vision and Pattern Recognition. p. 2097–2106.
Yamaguchi S, Lee C, Karaer O, Ban S, Mine A, Imazato S. 2019. Predicting the debonding of CAD/CAM composite resin crowns with AI. J Dent Res. 98(11):1234–1238.
Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. 2016. Learning deep features for discriminative localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 2921–2929.
Zhu W, Lou Q, Vang YS, Xie X. 2017. Deep multi-instance networks with sparse label assignment for whole mammogram classification. Quebec City (Canada): International Conference on Medical Image Computing and Computer-Assisted Intervention. p. 603–611.

Supplementary Material

Supplemental Material

Please find the following supplemental material visualised and available to download via Figshare in the display box below. Where there are more than one item, you can scroll through each tab to see each separate item.

Please note all supplemental material carries the same license as the article it is here associated with

Summary

A supplemental appendix to this article is available online.

Resources

File (ds_10.1177_0022034520901519.pdf)

Cite article

Cite article

Cite article

OR

Download to reference manager

If you have citation software installed, you can download article citation data to the citation manager of your choice

Share options

Share

Share this article

Share with email
EMAIL ARTICLE LINK
Share on social media

Share access to this article

Sharing links are not relevant where the article is open access and not available if you do not have a subscription.

For more information view the Sage Journals article sharing page.

Information, rights and permissions

Information

Published In

Article first published online: January 24, 2020
Issue published: March 2020

Keywords

  1. deep learning
  2. orthodontics
  3. diagnosis
  4. orthognathic surgery
  5. diagnostic imaging
  6. neural networks

Rights and permissions

© International & American Associations for Dental Research 2020.
Request permissions for this article.
PubMed: 31977286

Authors

Affiliations

H.J. Yu
School of Mechanical Engineering, Yonsei University, Seoul, Republic of Korea
S.R. Cho
Department of Oral and Maxillofacial Surgery, School of Medicine, Ewha Womans University, Seoul, Republic of Korea
M.J. Kim
Department of Orthodontics, School of Medicine, Ewha Womans University, Seoul, Republic of Korea
W.H. Kim
Department of Orthodontics, School of Medicine, Ewha Womans University, Seoul, Republic of Korea
J.W. Kim
Department of Oral and Maxillofacial Surgery, School of Medicine, Ewha Womans University, Seoul, Republic of Korea
J. Choi
School of Mechanical Engineering, Yonsei University, Seoul, Republic of Korea

Notes

J. Choi, School of Mechanical Engineering, Yonsei University, 50 Yonsei Ro, Seodaemun Gu, Seoul, 03722, Republic of Korea. Email: [email protected]
J.W. Kim, Department of Oral and Maxillofacial Surgery, School of Medicine, Ewha Womans University, Anyangcheon-ro 1071, Yangcheon-gu, Seoul, 158-710, Republic of Korea. Emails: [email protected], [email protected]

Metrics and citations

Metrics

Journals metrics

This article was published in Journal of Dental Research.

VIEW ALL JOURNAL METRICS

Article usage*

Total views and downloads: 2630

*Article usage tracking started in December 2016


Altmetric

See the impact this article is making through the number of times it’s been read, and the Altmetric Score.
Learn more about the Altmetric Scores



Articles citing this one

Receive email alerts when this article is cited

Web of Science: 78 view articles Opens in new tab

Crossref: 101

  1. State of the art and prospects for artificial intelligence in orthogna...
    Go to citation Crossref Google Scholar
  2. Machine learning-based decision support system for orthognathic diagno...
    Go to citation Crossref Google Scholar
  3. Deep Learning in Dental Radiographic Imaging
    Go to citation Crossref Google Scholar
  4. An Automatic Grading System for Orthodontically Induced External Root ...
    Go to citation Crossref Google Scholar
  5. Accuracy of artificial intelligence‐assisted growth prediction in skel...
    Go to citation Crossref Google Scholar
  6. AI-based dental caries and tooth number detection in intraoral photos:...
    Go to citation Crossref Google Scholar
  7. Machine Learning Effectively Diagnoses Mandibular Deformity Using Thre...
    Go to citation Crossref Google Scholar
  8. Accuracy of posteroanterior cephalogram landmarks and measurements ide...
    Go to citation Crossref Google Scholar
  9. AI in Orthodontics: Revolutionizing Diagnostics and Treatment Planning...
    Go to citation Crossref Google Scholar
  10. Artificial Intelligence Applications in Orthodontics
    Go to citation Crossref Google Scholar
  11. Artificial Intelligence in Orthognathic Surgery – A Narrative Review o...
    Go to citation Crossref Google Scholar
  12. Evaluation of artificial intelligence model for crowding categorizatio...
    Go to citation Crossref Google Scholar
  13. Deep learning-based prediction of mandibular growth trend in children ...
    Go to citation Crossref Google Scholar
  14. Influence of growth structures and fixed appliances on automated cepha...
    Go to citation Crossref Google Scholar
  15. Intra-oral scan segmentation using deep learning
    Go to citation Crossref Google Scholar
  16. Current Progress and Challenges of Using Artificial Intelligence in Cl...
    Go to citation Crossref Google Scholar
  17. Abnormal maxillary sinus diagnosing on CBCT ...
    Go to citation Crossref Google Scholar
  18. Orthodontic craniofacial pattern diagnosis: cephalometric geometry and...
    Go to citation Crossref Google Scholar
  19. Evaluation of AI Model for Cephalometric Landmark Classification (TG D...
    Go to citation Crossref Google Scholar
  20. Ceph-Net: automatic detection of cephalometric landmarks on scanned la...
    Go to citation Crossref Google Scholar
  21. Revealing the representative facial traits of different sagittal skele...
    Go to citation Crossref Google Scholar
  22. Identification of Dental Implants with the Development of an Artificia...
    Go to citation Crossref Google Scholar
  23. The knowledge, experience, and attitude on artificial intelligence-ass...
    Go to citation Crossref Google Scholar
  24. Application of Artificial Intelligence in Orthodontics: Current State ...
    Go to citation Crossref Google Scholar
  25. Evaluation of automated detection of head position on lateral cephalom...
    Go to citation Crossref Google Scholar
  26. Accuracy in Teeth Structures Segmentation on MRI and CT Images
    Go to citation Crossref Google Scholar
  27. Artificial intelligence‐assisted determination of available sites for ...
    Go to citation Crossref Google Scholar
  28. A Comprehensive Review of Recent Advances in Artificial Intelligence f...
    Go to citation Crossref Google Scholar
  29. Three-Dimensional Enlow’s Counterpart Analysis: Neutral Track
    Go to citation Crossref Google Scholar
  30. Artificial Intelligence and Machine Learning for Automated Cephalometr...
    Go to citation Crossref Google Scholar
  31. Exploring the Intersection of Artificial Intelligence and Clinical Hea...
    Go to citation Crossref Google Scholar
  32. Automated Sagittal Skeletal Classification of Children Based on Deep L...
    Go to citation Crossref Google Scholar
  33. Explainable deep learning-based clinical decision support engine for M...
    Go to citation Crossref Google Scholar
  34. Automatic detection of adenoid hypertrophy on cone-beam computed tomog...
    Go to citation Crossref Google Scholar
  35. A brief overview of artificial intelligence in dentistry: Current scop...
    Go to citation Crossref Google Scholar
  36. Inteligencia artificial en diagnóstico, pronóstico y planificación del...
    Go to citation Crossref Google Scholar
  37. Preciseness of artificial intelligence for lateral cephalometric measu...
    Go to citation Crossref Google Scholar
  38. Artificial Intelligence Systems Assisting in the Assessment of the Cou...
    Go to citation Crossref Google Scholar
  39. Artificial Intelligence Splint in Orthognathic Surgery for Skeletal Cl...
    Go to citation Crossref Google Scholar
  40. Artificial intelligence in dentistry—A review
    Go to citation Crossref Google Scholar
  41. Automated Evaluation of Upper Airway Obstruction Based on Deep Learnin...
    Go to citation Crossref Google Scholar
  42. Hyper Automation and Augmented Intelligence
    Go to citation Crossref Google Scholar
  43. Personalized dental medicine, artificial intelligence, and their relev...
    Go to citation Crossref Google Scholar
  44. Artificial Intelligence Applicability in Orthodontics: Quo Vadis Ortho...
    Go to citation Crossref Google Scholar
  45. Machine Learning Predictive Model as Clinical Decision Support System ...
    Go to citation Crossref Google Scholar
  46. Applications of Artificial Intelligence in Dentistry
    Go to citation Crossref Google Scholar
  47. Effect of prior knowledge about treatment on cephalometric measurement...
    Go to citation Crossref Google ScholarPub Med
  48. Artificial intelligence in medico-dental diagnostics of the face: a na...
    Go to citation Crossref Google Scholar
  49. Deep convolutional neural network-based skeletal classification of cep...
    Go to citation Crossref Google Scholar
  50. Effectiveness of cone-beam computed tomography-generated cephalograms ...
    Go to citation Crossref Google Scholar
  51. Development, Application, and Performance of Artificial Intelligence i...
    Go to citation Crossref Google Scholar
  52. Construction of an end‐to‐end regression neural network for the determ...
    Go to citation Crossref Google Scholar
  53. Estado del arte de inteligencia artificial en ortodoncia. Revisión nar...
    Go to citation Crossref Google Scholar
  54. Automated calibration system for length measurement of lateral cephalo...
    Go to citation Crossref Google Scholar
  55. Trends and Application of Artificial Intelligence Technology in Orthod...
    Go to citation Crossref Google Scholar
  56. Advancements in Dentistry with Artificial Intelligence: Current Clinic...
    Go to citation Crossref Google Scholar
  57. Dental Lesion Segmentation Using an Improved ICNet Network with Attent...
    Go to citation Crossref Google Scholar
  58. Applications of artificial intelligence and machine learning in orthog...
    Go to citation Crossref Google Scholar
  59. Deep Learning–Based Prediction of the 3D Postorthodontic Facial Change...
    Go to citation Crossref Google ScholarPub Med
  60. Potential and impact of artificial intelligence algorithms in dento-ma...
    Go to citation Crossref Google Scholar
  61. Cephalometric Skeletal Structure Classification Using Convolutional Ne...
    Go to citation Crossref Google Scholar
  62. Convolutional neural network-based automatic cervical vertebral matura...
    Go to citation Crossref Google Scholar
  63. Predicting patient experience of Invisalign treatment: An analysis usi...
    Go to citation Crossref Google Scholar
  64. DİŞ HEKİMLİĞİ UYGULAMALARINDA YAPAY ZEKÂ KULLANIMI
    Go to citation Crossref Google Scholar
  65. Artificial intelligence for caries and periapical periodontitis detect...
    Go to citation Crossref Google Scholar
  66. Caries Detection from Dental Images using Novel Maximum Directional Pa...
    Go to citation Crossref Google Scholar
  67. Cephalometric Analysis in Orthodontics Using Artificial Intelligence—A...
    Go to citation Crossref Google Scholar
  68. Automatic Classification for Sagittal Craniofacial Patterns Based on D...
    Go to citation Crossref Google Scholar
  69. Deep learning for the classification of cervical maturation degree and...
    Go to citation Crossref Google Scholar
  70. Automatic detection of anteriorly displaced temporomandibular joint di...
    Go to citation Crossref Google Scholar
  71. Artificial Intelligence for Classifying and Archiving Orthodontic Imag...
    Go to citation Crossref Google Scholar
  72. Fully automated identification of cephalometric landmarks for upper ai...
    Go to citation Crossref Google Scholar
  73. Accuracy of one-step automated orthodontic diagnosis model using a con...
    Go to citation Crossref Google Scholar
  74. AIM in Dentistry
    Go to citation Crossref Google Scholar
  75. Deep learning for categorization of endodontic lesion based on radiogr...
    Go to citation Crossref Google Scholar
  76. Deep learning-based evaluation of the relationship between mandibular ...
    Go to citation Crossref Google Scholar
  77. A machine learning approach to determine the prognosis of patients wit...
    Go to citation Crossref Google Scholar
  78. Current applications and development of artificial intelligence for di...
    Go to citation Crossref Google Scholar
  79. Comparison between cephalometric measurements using digital manual and...
    Go to citation Crossref Google Scholar
  80. Evaluation of Lip Morphology and Nasolabial Angle in Non-Syndromic Cle...
    Go to citation Crossref Google Scholar
  81. Review of the role of Artificial Intelligence in dentistry: Current ap...
    Go to citation Crossref Google Scholar
  82. Artificial Intelligence and Ethics in Dentistry: A Scoping Review
    Go to citation Crossref Google ScholarPub Med
  83. Deep learning based prediction of extraction difficulty for mandibular...
    Go to citation Crossref Google Scholar
  84. Realistic high-resolution lateral cephalometric radiography generated ...
    Go to citation Crossref Google Scholar
  85. A deep learning approach to automatic gingivitis screening based on cl...
    Go to citation Crossref Google Scholar
  86. Deep learning based prediction of necessity for orthognathic surgery o...
    Go to citation Crossref Google Scholar
  87. Applications of artificial intelligence and machine learning in orthod...
    Go to citation Crossref Google Scholar
  88. Clinical applicability of automated cephalometric landmark identificat...
    Go to citation Crossref Google Scholar
  89. Automated Radiographic Evaluation of Adenoid Hypertrophy Based on VGG-...
    Go to citation Crossref Google ScholarPub Med
  90. Three-Dimensional Facial Soft Tissue Changes After Orthognathic Surger...
    Go to citation Crossref Google Scholar
  91. Localization of cementoenamel junction in intraoral ultrasonographs wi...
    Go to citation Crossref Google Scholar
  92. Machine learning and orthodontics, current trends and the future oppor...
    Go to citation Crossref Google Scholar
  93. Automated Adenoid Hypertrophy Assessment with Lateral Cephalometry in ...
    Go to citation Crossref Google Scholar
  94. Promises and perils of artificial intelligence in dentistry
    Go to citation Crossref Google Scholar
  95. Artificial intelligence-driven novel tool for tooth detection and segm...
    Go to citation Crossref Google Scholar
  96. AIM in Dentistry
    Go to citation Crossref Google Scholar
  97. A Novel Method for Cephalometric Landmark Regression Using Convolution...
    Go to citation Crossref Google Scholar
  98. A scoping review of transfer learning research on medical image analys...
    Go to citation Crossref Google Scholar
  99. Developments, application, and performance of artificial intelligence ...
    Go to citation Crossref Google Scholar
  100. Artificial Intelligence in dentistry: Concepts, Applications and Resea...
    Go to citation Crossref Google Scholar
  101. Automated cephalometric landmark detection with confidence regions usi...
    Go to citation Crossref Google Scholar

Figures and tables

Figures & Media

Tables

View Options

Get access

Access options

If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:


Alternatively, view purchase options below:

Purchase 24 hour online access to view and download content.

Access journal content via a DeepDyve subscription or find out more about this option.

View options

PDF/ePub

View PDF/ePub

Full Text

View Full Text