REAL

Automated research methodology classification using machine learning

Kosztyán, Zsolt Tibor and Király, Tünde and Csizmadia, Tibor and Katona, Attila Imre and Vathy-Fogarassy, Ágnes (2025) Automated research methodology classification using machine learning. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 156 (C). no.-111039. ISSN 0952-1976

[img]
Preview
Text (Publikáció)
Automated research methodology classification using machine learning.pdf - Published Version
Available under License Creative Commons Attribution.

Download (3MB) | Preview
[img]
Preview
Text (Corrigendum)
1-s2.0-S0952197625018871-main.pdf - Published Version
Available under License Creative Commons Attribution.

Download (271kB) | Preview

Abstract

Scientific papers have become the primary means for disseminating scientific research, and thus, the ability to classify research papers based on different aspects has become essential. Therefore, many works have developed classification approaches; however, they focused solely on research topic-based classification. In addition, no solution has been developed to classify papers based on the applied methodology, and finally, the accuracy of the existing paper classification methods is not satisfactory. In this study, a novel automated classification methodology using a refined Extreme Gradient boosting (XGBoost) model is presented to classify the research methods employed in scientific papers. Three article sets, including quantitative and qualitative research methods, were collected from the topics of tourism, medical science and information systems, consisting of 229, 557 and 787 papers, respectively. The classification problem was considered a binary classification task to maintain interpretability. The developed model was trained and tested on article set 1 (tourism) and 2 (medical science), and then, the proposed model was applied to article set 3, (information systems and tourism). The high accuracy achieved in different research fields (90%–95% accuracies on average) indicates that the proposed classification model is generalizable because it can be successfully applied in many disciplines. The automated classifier enables the rapid acquisition of vital information and the identification of significant differences among the applied methodologies in various research domains. A future development direction will be to increase the scalability of the proposed model to achieve efficient operations on large volumes of research papers.

Item Type: Article
Uncontrolled Keywords: Machine learning, Classification, Applied research methods, Extreme Gradient Boosting, Large language models
Subjects: H Social Sciences / társadalomtudományok > H Social Sciences (General) / társadalomtudomány általában
H Social Sciences / társadalomtudományok > HA Statistics / statisztika
Depositing User: Dr Bernadett Gaál
Date Deposited: 17 Nov 2026 18:26
Last Modified: 17 Nov 2026 18:26
URI: https://real.mtak.hu/id/eprint/250264

Actions (login required)

View Item View Item