Machine Learning Based QoE Estimation Model for Video Streaming over UMTS Network
No Thumbnail Available
Date
2020-02
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Addis Ababa University
Abstract
The advent of data-intensive services needs quality Internet services. This in turn, makes Quality
of Experience (QoE) gain prominent recognition in the telecommunications industry. Ethio telecom
uses network Quality of Service (QoS) monitoring data obtained from Network Management
Systems (NMS) tools to comprehend its network performances. However, as QoS measurement
refers to network performances, this method does not generally give QoE data as perceived
by the user. Therefore, QoE estimation models are proposed as solutions in the literature,
recently.
This study focuses on developing QoE estimation models using QoS features of round-trip time
(RTT), jitter, loss rate (LR) and throughput, and QoE scores collected using Application for prediCting
QUality of experience at Interne Access (ACQUA)-based crowdsourcing in Universal
Mobile Telecommunication Systems (UMTS) networks in a real-time basis. Data preparations
techniques such as data cleaning and dataset imbalance corrections have been applied to the
collected datasets. Machine Learning (ML) algorithms of Arti cial Neural Network (ANN), KNearest
Neighbor (KNN) and Random Forest (RF) are selected based on their suitability for multilabel
problems. After training these models developed, they are evaluated using commonly used
performance metrics such as accuracy, Root Mean Square Error (RMSE) and Receiver Operating
Characteristics (ROC).
Experimentation results exhibit that RF with an accuracy of 98.39%, is the best model while
KNN and ANN achieve 87.47% and 77.59% overall accuracy, respectively. As a conclusion, all
three models achieve acceptable performances. As a conclusion, our QoE estimation models if
implemented can help Telecommunications Service Providers (TSP) in estimating user QoE in
real-time.
Description
Keywords
Universal Mobile Telecommunication Systems, Quality of Service, Quality of Experience, Supervised Machine Learning, Quality of Experience Estimation Models