武汉大学计算机学院, 湖北武汉 430072
[ "李雪莹 女, 1993年12月出生于河南省南阳市. 2021年毕业于武汉大学计算机学院. 主要研究方向包括需求工程、软件体系结构和机器学习.E-mail: xueyingli@whu.edu.cn" ]
[ "王田路 女, 1995年6月出生于河北省邢台市. 本硕毕业于武汉大学计算机学院. 现在中国银行总行信息科技部工作. 主要研究方向为软件体系结构和需求工程.E-mail: wangtianlu@whu.edu.cn" ]
[ "梁 鹏(通讯作者) 男, 1978年10月出生于湖北省荆门市. 现任武汉大学计算机学院教授. 主要研究方向为软件体系结构和需求工程." ]
[ "王 翀 女, 1981年3月出生于湖北省武汉市. 现任武汉大学计算机学院讲师. 主要研究方向为面向服务软件工程和需求工程.E-mail: cwang@whu.edu.cn" ]
收稿:2021-04-09,
修回:2021-12-20,
纸质出版:2022-09-25
移动端阅览
李雪莹,王田路,梁鹏等.基于系统模型的用户评论中非功能需求的自动分类[J].电子学报,2022,50(09):2079-2089.
LI Xue-ying,WANG Tian-lu,LIANG Peng,et al.Automatic Classification of Non-Functional Requirements in App User Reviews Based on System Model[J].ACTA ELECTRONICA SINICA,2022,50(09):2079-2089.
李雪莹,王田路,梁鹏等.基于系统模型的用户评论中非功能需求的自动分类[J].电子学报,2022,50(09):2079-2089. DOI: 10.12263/DZXB.20210454.
LI Xue-ying,WANG Tian-lu,LIANG Peng,et al.Automatic Classification of Non-Functional Requirements in App User Reviews Based on System Model[J].ACTA ELECTRONICA SINICA,2022,50(09):2079-2089. DOI: 10.12263/DZXB.20210454.
移动应用程序中的用户评论是获取用户需求的重要来源. 从用户评论中获取的用户需求,不仅可以帮助开发人员维护现有系统,还可以快速、准确地定位新的用户需求. 本文主要关注移动应用用户评论中的非功能需求,并基于系统模型、采用机器学习和深度学习算法将其自动分类为行为型需求和表示型需求. 在使用机器学习方法分类时,将2种特征提取技术与5种机器学习算法进行组合. 在使用深度学习方法分类时,使用了2种基于词嵌入的深度学习算法和1种基于字符嵌入的深度学习算法. 从性能和时间消耗2个维度比较了机器学习模型和深度学习模型,结果表明,机器学习模型比深度学习模型表现更好. 此外,支持向量机(Support Vector Machine,SVM)与词频-逆文档频率(Term Frequency⁃Inverse Document Frequency,TF⁃IDF)组合获得了最好的分类性能,精确率为0.941,召回率为0.990,F1-score为0.965.
App user reviews are an important source of user requirements. The requirements obtained from user reviews can not only help developers maintain the existing systems
but also quickly and accurately locate new user requirements. This work focuses on non-functional requirements in App user reviews
and further classifies them into behavioral requirements and representational requirements based on system model with machine learning and deep learning algorithms. When using machine learning to classify non-functional requirements
we combined two feature extraction techniques with five machine learning algorithms. When applying deep learning to classify non-functional requirements
we used two deep learning algorithms based on word embedding and one deep learning algorithm based on character embedding. We compared machine learning models and deep learning models from the performance and time consumption perspectives. The results show that
machine learning models perform better than the deep learning models. In addition
the combination of SVM(Support Vector Machine) and TF-IDF(Term Frequency⁃Inverse Document Frequency) achieves the best performance of classification
with a precision of 0.941
a recall of 0.990
and an F1-score of 0.965.
FERNÁNDEZ D M . Supporting requirements-engineering research that industry needs: The NaPiRE initiative [J]. IEEE Software , 2018 , 35 ( 1 ): 112 - 116 .
BROY M . Rethinking Functional Requirements: A Novel Approach Categorizing System and Software Requirements [M]// Software Technology: 10 Years of Innovation in IEEE Computer . Hoboken, NJ, USA : John Wiley & Sons, Inc , 2018 : 155 - 187 .
BROY M . Rethinking nonfunctional software requirements [J]. Computer , 2015 , 48 ( 5 ): 96 - 99 .
ECKHARDT J . Categorizations of Product-related Requirements in Practice [D]. München : Technische Universität München , 2017 .
LU M M , LIANG P . Automatic classification of non-functional requirements from augmented app user reviews [C]// EASE'17: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering . New York : ACM , 2017 : 344 - 353 .
Joint Technical Committee ISO/IEC JTC 1. ISO/IEC 25010: 2011 [S/OL].[ 2021-04-07 ]. https://www.iso.org/standard/35733.html https://www.iso.org/standard/35733.html .
李雪莹 , 王田路 , 梁鹏 , 王翀 . 基于系统模型的用户评论中非功能需求的自动分类 [EB/OL]. [ 2021-04-07 ] http://doi.org/10.5281/zenodo.4399602 http://doi.org/10.5281/zenodo.4399602 .
GLINZ M . On non-functional requirements [C]// 15th IEEE International Requirements Engineering Conference . Piscataway : IEEE , 2007 : 21 - 26 .
ABAD Z S H , KARRAS O , GHAZI P , et al . What works better? A study of classifying requirements [C]// 2017 IEEE 25th International Requirements Engineering Conference . Piscataway : IEEE , 2017 : 496 - 501 .
LI C Y , HUANG L G , GE J D , et al . Automatically classifying user requests in crowdsourcing requirements engineering [J]. Journal of Systems and Software , 2018 , 138 : 108 - 123 .
STANIK C , HAERING M , MAALEJ W . Classifying multilingual user feedback using traditional machine learning and deep learning [C]// 2019 IEEE 27th International Requirements Engineering Conference Workshops . Piscataway : IEEE , 2019 : 220 - 226 .
JHA N , MAHMOUD A . Mining non-functional requirements from App store reviews [J]. Empirical Software Engineering , 2019 , 24 ( 6 ): 3659 - 3695 .
WANG T L , LIANG P , LU M M . What aspects do non-functional requirements in app user reviews describe? an exploratory and comparative study [C]// 2018 25th Asia-Pacific Software Engineering Conference(APSEC) . Piscataway : IEEE , 2018 : 494 - 503 .
MIKOLOV T , CHEN K , CORRADO G , et al . Efficient estimation of word representations in vector space [EB/OL]. ( 2013-01-16 ). https://arxiv.org/abs/1301.3781 https://arxiv.org/abs/1301.3781 .
BOJANOWSKI P , GRAVE E , JOULIN A , et al . Enriching word vectors with subword information [J]. Transactions of the Association for Computational Linguistics , 2017 , 5 : 135 - 146 .
KIM Y . Convolutional neural networks for sentence classification [C]// Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) . Stroudsburg, PA, USA : Association for Computational Linguistics , 2014 : 1746 - 1751 .
LAI S W , XU L H , LIU K , et al . Recurrent convolutional neural networks for text classification [C]// AAAI'15: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence . Menlo Park, CA : AAAI , 2015 : 2267 - 2273 .
ZHANG X , ZHAO J , LECUN Y . Character-level convolutional networks for text classification [C]// Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 1 . Cambridge, MA : MIT Press , 2015 : 649 - 657 .
COHEN J . A coefficient of agreement for nominal scales [J]. Educational and Psychological Measurement , 1960 , 20 ( 1 ): 37 - 46 .
SHULL F , SINGER J , SJØBERG D . I . Guide to Advanced Empirical Software Engineering [M]. Berlin, German : Springer , 2008 .
0
浏览量
10
下载量
1
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621