Paper Title : Edge Server Deployment Based on Reinforcement Learning in Mobile Edge Computing

ISSN : 2394-2231
Year of Publication : 2022

10.5281/zenodo.6409981

Authors: Zixiang Wang, Jipeng Zhou

         



MLA Style: Edge Server Deployment Based on Reinforcement Learning in Mobile Edge Computing " Zixiang Wang, Jipeng Zhou " Volume 9 - Issue 2 International Journal of Computer Techniques (IJCT) ,ISSN:2394-2231 , www.ijctjournal.org

APA Style: Edge Server Deployment Based on Reinforcement Learning in Mobile Edge Computing " Zixiang Wang, Jipeng Zhou " Volume 9 - Issue 2 International Journal of Computer Techniques (IJCT) ,ISSN:2394-2231 , www.ijctjournal.org

Abstract
Mobile Edge Computing (MEC) is to sink the resource of remote cloud computing center to the edge network to provide users with better services. Distinct from cloud computing, mobile edge computing is under the constraint of edge server computing resources, deployment location, wireless transmission bandwidth and etc. Although there has been significant research in the field of mobile edge computing, little attention has been given to understanding the placement of edge servers to optimize the mobile edge computing network performance. In this paper, we propose a server deployment scheme based on reinforcement learning. Firstly, we propose the MEC three-tier architecture, which takes the latency of the base station as the optimization goal. Then, we formulate the edge server deployment problem as a single-objective optimization problem, and propose the edge server deployment (Q-ESD) algorithm in this paper based on the Q-Learning algorithm. Finally, experimental results show that our approach outperforms several representative approaches in terms of access delay and workload balancing.

Reference
[1] Taleb, T., Dutta, S., Ksentini, A., Iqbal, M., & Flinck, H. (2017). Mobile edge computing potential in making cities smarter. IEEE Communications Magazine, 55(3), 38-43. [2] Fan, J., Wang, Z., Xie, Y., & Yang, Z. (2020, July). A theoretical analysis of deep Q-learning. In Learning for Dynamics and Control (pp. 486-489). PMLR. [3] Hu, Y. C., Patel, M., Sabella, D., Sprecher, N., & Young, V. (2015). Mobile edge computing—A key technology towards 5G. ETSI white paper, 11(11), 1-16. [4] Abbas, N., Zhang, Y., Taherkordi, A., & Skeie, T. (2017). Mobile edge computing: A survey. IEEE Internet of Things Journal, 5(1), 450-465. [5] Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016). Edge computing: Vision and challenges. IEEE internet of things journal, 3(5), 637-646. [6] Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., & Satyanarayanan, M. (2014, June). Towards wearable cognitive assistance. In Proceedings of the 12th annual international conference on Mobile systems, applications, and services (pp. 68- 81). [7] Li, D., Salonidis, T., Desai, N. V., & Chuah, M. C. (2016, October). Deepcham: Collaborative edge-mediated adaptive deep learning for mobile object recognition. In 2016 IEEE/ACM Symposium on Edge Computing (SEC) (pp. 64-76). IEEE. [8] Tang, B., Chen, Z., Hefferman, G., Wei, T., He, H., & Yang, Q. (2015). A hierarchical distributed fog computing architecture for big data analysis in smart cities. In Proceedings of the ASE BigData & SocialInformatics 2015 (pp. 1-6). [9] Jia, M., Cao, J., & Liang, W. (2015). Optimal cloudlet placement and user to cloudlet allocation in wireless metropolitan area networks. IEEE Transactions on Cloud Computing, 5(4), 725-737. [10] Xu, Z., Liang, W., Xu, W., Jia, M., & Guo, S. (2015). Efficient algorithms for capacitated cloudlet placements. IEEE Transactions on Parallel and Distributed Systems, 27(10), 2866-2880. [11] Ren, Y., Zeng, F., Li, W., & Meng, L. (2018, July). A low-cost edge server placement strategy in wireless metropolitan area networks. In 2018 27th International Conference on Computer Communication and Networks (ICCCN) (pp. 1-6). IEEE. [12] Li, Y., & Wang, S. (2018, July). An energy-aware edge server placement algorithm in mobile edge computing. In 2018 IEEE International Conference on Edge Computing (EDGE) (pp. 66-73). IEEE. [13] Wang, S., Zhao, Y., Xu, J., Yuan, J., & Hsu, C. H. (2019). Edge server placement in mobile edge computing. Journal of Parallel and Distributed Computing, 127, 160-168. [14] Shah, S. M., & Borkar, V. S. (2018). Q-learning for Markov decision processes with a satisfiability criterion. Systems & Control Letters, 113, 45-51. [15] Clifton, J., & Laber, E. (2020). Q-learning: theory and applications. Annual Review of Statistics and Its Application, 7, 279-301. [16] Albert, R., Jeong, H., & Barabási, A. L. (1999). Diameter of the world-wide web. nature, 401(6749), 130-131. [17] Barabási, A. L., & Albert, R. (1999). Emergence of scaling in random networks. science, 286(5439), 509-512

Keywords
— Mobile edge computing, Reinforcement learning, Server deployment, Load balancing.