Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning

Abstract: 

In this work, we study the optimal trajectory of an unmanned aerial vehicle (UAV) acting as a base station (BS) to serve multiple users. Considering multiple flying epochs, we leverage the tools of reinforcement learning (RL) with the UAV acting as an autonomous agent in the environment to learn the trajectory that maximizes the sum rate of the transmission during flying time. By applying Q-learning, a model-free RL technique, an agent is trained to make movement decisions for the UAV. We compare table-based and neural network (NN) approximations of the Q-function and analyze the results. In contrast to previous works, movement decisions are directly made by the neural network and the algorithm requires no explicit information about the environment and is able to learn the topology of the network to improve the system-wide performance.

up
0 users have voted:

Paper Details

Authors:
Harald Bayerlein, Paul de Kerret, David Gesbert
Submitted On:
3 July 2018 - 10:13am
Short Link:
Type:
Poster
Event:
Presenter's Name:
Harald Bayerlein
Document Year:
2018
Cite

Document Files

Poster_SPAWC2018_final.pdf

(126)

Subscribe

[1] Harald Bayerlein, Paul de Kerret, David Gesbert, "Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning", IEEE SigPort, 2018. [Online]. Available: http://sigport.org/3299. Accessed: Jul. 23, 2019.
@article{3299-18,
url = {http://sigport.org/3299},
author = {Harald Bayerlein; Paul de Kerret; David Gesbert },
publisher = {IEEE SigPort},
title = {Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning},
year = {2018} }
TY - EJOUR
T1 - Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning
AU - Harald Bayerlein; Paul de Kerret; David Gesbert
PY - 2018
PB - IEEE SigPort
UR - http://sigport.org/3299
ER -
Harald Bayerlein, Paul de Kerret, David Gesbert. (2018). Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning. IEEE SigPort. http://sigport.org/3299
Harald Bayerlein, Paul de Kerret, David Gesbert, 2018. Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning. Available at: http://sigport.org/3299.
Harald Bayerlein, Paul de Kerret, David Gesbert. (2018). "Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning." Web.
1. Harald Bayerlein, Paul de Kerret, David Gesbert. Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning [Internet]. IEEE SigPort; 2018. Available from : http://sigport.org/3299