Energy-Efficient Trajectory Planning With Joint Device Selection and Power Splitting for mmWaves-Enabled UAV-NOMA Networks
-
- ジェンディ, アハマド
- 九州大学大学院システム情報科学府
-
- 牟田, 修
- 九州大学大学院システム情報科学研究院
-
- ハシマ, シエリフ
- 特定国立研究開発法人理化学研究所革新知能統合研究センター計算論的学習理論チーム
-
- 畑埜, 晃平
- 特定国立研究開発法人理化学研究所革新知能統合研究センター計算論的学習理論チーム 九州大学大学院システム情報科学研究院情報学部門
説明
This paper proposes two energy-efficient reinforcement learning (RL)-based algorithms for millimeter wave (mmWave)-enabled unmanned aerial vehicle (UAV) communications toward beyond-5G (B5G). This can be especially useful in ad-hoc communication scenarios within a neighborhood with main-network connectivity problems such as in areas affected by natural disasters. To improve the system’s overall sum-rate performance, the UAV-operated mobile base station (UAV-MBS) can harness non-orthogonal multiple access (NOMA) as an efficient protocol to grant ground devices access to fast downlink connections. Dynamic selection of suitable hovering spots within the target zone where the battery-constrained UAV needs to be positioned as well as calibrated NOMA power control with proper device pairing are critical for optimized performance. We propose cost-subsidized multiarmed bandit (CS-MAB) and double deep Q-network (DDQN)-based solutions to jointly address the problems of dynamic UAV path design, device pairing, and power splitting for downlink data transmission in NOMA-based systems. To verify that the proposed RL-based solutions support high sum-rates, numerical simulations are presented. In addition, exhaustive and random search benchmarks are provided as baselines for the achievable upper and lower sum-rate levels, respectively. The proposed DDQN agent achieves 96% of the sum-rate provided by the optimal exhaustive scanning whereas CS-MAB reaches 91.5%. By contrast, a conventional channel state sorting pairing (CSSP) solver achieves about 89.3%.
収録刊行物
-
- IEEE Transactions on Machine Learning in Communications and Networking
-
IEEE Transactions on Machine Learning in Communications and Networking 2 617-632, 2024-05-02
Institute of Electrical and Electronics Engineers (IEEE)
- Tweet
キーワード
詳細情報 詳細情報について
-
- CRID
- 1050020519548313856
-
- ISSN
- 2831316X
-
- HANDLE
- 2324/7238753
-
- 本文言語コード
- en
-
- 資料種別
- journal article
-
- データソース種別
-
- IRDB
- Crossref
- KAKEN
- OpenAIRE