Akademik Veri Yönetim Sistemi
19th International Conference on Persuasive Technology, PERSUASIVE 2024, Wollongong, Avustralya, 10 - 12 Nisan 2024, cilt.14636 LNCS, ss.1-14
Mobile applications have seen a growing prevalence in the healthcare sector, yet the absence of comprehensive regulations and preliminary assessments can lead to significant frustration and time loss for users. To address this, Persuasive System Design (PSD) principles and the Mobile App Rating Scale (MARS) have emerged as popular tools for gauging application quality and user engagement. However, their manual assessment requirements hinder scalability, especially given the high volume of mobile health applications in the market. This study introduces a novel automatic evaluation approach designed to enhance the assessment of mobile health applications, leveraging PSD and MARS. The proposed method mainly relies on large language models to filter user reviews and generate sentence embeddings for classifying the PSD principles implemented in these applications. The results, calculated using performance metrics that compare the model’s predictions with expert evaluations, demonstrate the feasibility of predicting the application’s implementation of PSD principles based on user reviews while also highlighting the limitations of using application descriptions alone for successful prediction. Furthermore, the study augments the predicted classification probabilities of PSD principles with supplementary descriptive data, such as installation counts and user ratings, to predict MARS scores. Regression models, trained using these techniques, consistently outperform basic models, with feature importance scores showing the significant contribution of predicted classification probabilities of PSD principles to the models. In summary, this study suggests that automatic evaluation techniques can effectively assess the quality and user engagement of mobile health applications, offering a viable alternative to manual assessments.