UAV assisted cooperative caching on network edge using multi agent Actor critic reinforcement learning
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2020.
Huvudupphovsmän: | , , |
---|---|
Övriga upphovsmän: | |
Materialtyp: | Lärdomsprov |
Språk: | English |
Publicerad: |
Brac University
2021
|
Ämnen: | |
Länkar: | http://hdl.handle.net/10361/15469 |
id |
10361-15469 |
---|---|
record_format |
dspace |
spelling |
10361-154692022-01-26T10:13:15Z UAV assisted cooperative caching on network edge using multi agent Actor critic reinforcement learning Araf, Sadman Saha, Adittya Soukarjya Eunus, Salman Ibne Kazi, Sadia Hamid Alam, Md. Golam Rabiul Department of Computer Science and Engineering, Brac University Unmanned aerial vehicle(UAV) Cooperative Edge Caching signal-tonoise ratio multi-agent deep deterministic policy gradient K-means clustering Reinforcement learning This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2020. Cataloged from PDF version of thesis. Includes bibliographical references (pages 58-59). In recent times, Multi-access edge computing (MEC) has been introduced to assist cloud servers by bringing the computation closer to the edge. This is a well-known replacement to deal with the strict latency faced by users while retrieving contents from long-distance data centers. To cope up with this latency while simultaneously improving users’ QOS poses a limitation which can be handled through caching at edge nodes. However, where to cache and what to cache so that a higher cache hit rate is achieved also poses another significant issue which is addressed in this research. In this paper we have approached the problem of dynamic caching along with the selection of edge node that leads to better cache hit rate. We have also proposed the use of UAVs as aerial Base Station(BS) to assist in peak hours where a ground base station is not enough to support the surge in user requests.It also elaborates the optimal relocation of UAVs to e↵ectively support user mobility, which then caters a cluster of users by the K-means clustering algorithm. In addition, to maximize the cache hit ratio we have proposed a cooperative deep reinforcement learning algorithm which ensured a global increase in cache hit ratio and also an ecient allocation of storage. We have shown simulations on UAV reallocation based on user mobility patterns and also achieved higher global cache hit ratio using our proposed multi-agent actor-critic algorithm. In this paper, emphasis was given on how to cache and where to cache based on the cooperation of UAV and GBS which open doors for further research. Sadman Araf Adittya Soukarjya Saha Salman Ibne Eunus B. Computer Science 2021-10-19T09:57:44Z 2021-10-19T09:57:44Z 2020 2020-12 Thesis ID 17101354 ID 17101148 ID 17101051 http://hdl.handle.net/10361/15469 en Brac University theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. 59 pages application/pdf Brac University |
institution |
Brac University |
collection |
Institutional Repository |
language |
English |
topic |
Unmanned aerial vehicle(UAV) Cooperative Edge Caching signal-tonoise ratio multi-agent deep deterministic policy gradient K-means clustering Reinforcement learning |
spellingShingle |
Unmanned aerial vehicle(UAV) Cooperative Edge Caching signal-tonoise ratio multi-agent deep deterministic policy gradient K-means clustering Reinforcement learning Araf, Sadman Saha, Adittya Soukarjya Eunus, Salman Ibne UAV assisted cooperative caching on network edge using multi agent Actor critic reinforcement learning |
description |
This thesis is submitted in partial fulfillment of the requirements for the degree of Bachelor of Science in Computer Science and Engineering, 2020. |
author2 |
Kazi, Sadia Hamid |
author_facet |
Kazi, Sadia Hamid Araf, Sadman Saha, Adittya Soukarjya Eunus, Salman Ibne |
format |
Thesis |
author |
Araf, Sadman Saha, Adittya Soukarjya Eunus, Salman Ibne |
author_sort |
Araf, Sadman |
title |
UAV assisted cooperative caching on network edge using multi agent Actor critic reinforcement learning |
title_short |
UAV assisted cooperative caching on network edge using multi agent Actor critic reinforcement learning |
title_full |
UAV assisted cooperative caching on network edge using multi agent Actor critic reinforcement learning |
title_fullStr |
UAV assisted cooperative caching on network edge using multi agent Actor critic reinforcement learning |
title_full_unstemmed |
UAV assisted cooperative caching on network edge using multi agent Actor critic reinforcement learning |
title_sort |
uav assisted cooperative caching on network edge using multi agent actor critic reinforcement learning |
publisher |
Brac University |
publishDate |
2021 |
url |
http://hdl.handle.net/10361/15469 |
work_keys_str_mv |
AT arafsadman uavassistedcooperativecachingonnetworkedgeusingmultiagentactorcriticreinforcementlearning AT sahaadittyasoukarjya uavassistedcooperativecachingonnetworkedgeusingmultiagentactorcriticreinforcementlearning AT eunussalmanibne uavassistedcooperativecachingonnetworkedgeusingmultiagentactorcriticreinforcementlearning |
_version_ |
1814308070635864064 |