AviBERT: Transformer-based Aircraft Text Classification AviBERT: Transformer Tabanli Hava Araci Metni Siniflandirma

Unal M. C., Yurtalan G., Karatas Y. B., Karamanlioglu A., Demirel B.

33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025, İstanbul, Turkey, 25 - 28 June 2025, (Full Text) identifier

  • Publication Type: Conference Paper / Full Text
  • Doi Number: 10.1109/siu66497.2025.11112276
  • City: İstanbul
  • Country: Turkey
  • Middle East Technical University Affiliated: Yes

Abstract

In recent years, transformer-based models pre-trained on extensive corpora have played a critical role in the advancement of Natural Language Processing methodologies. Particularly, methods based on BERT have demonstrated remarkable performance across various tasks by offering robust capabilities in deeply understanding texts semantically. However, despite these advancements, there is a notable scarcity of studies applying these technologies in the aviation sector. This paper develops a multi-class classification model for aviation-specific texts using variants of BERT. The study encompasses the processes of collecting web content related to aircraft, labeling and model training. The details of the dataset are explained and the outcomes of the study are assessed based on the macro F1-score and accuracy of different models.