Quadcopter neural controller for take-off and landing in windy environments
| dc.contributor.author | Olaz Moratinos, Xabier | |
| dc.contributor.author | Aláez Gómez, Daniel | |
| dc.contributor.author | Prieto Míguez, Manuel | |
| dc.contributor.author | Villadangos Alonso, Jesús | |
| dc.contributor.author | Astrain Escola, José Javier | |
| dc.contributor.department | Estadística, Informática y Matemáticas | es_ES |
| dc.contributor.department | Estatistika, Informatika eta Matematika | eu |
| dc.contributor.department | Institute of Smart Cities - ISC | en |
| dc.date.accessioned | 2023-06-16T16:04:59Z | |
| dc.date.issued | 2023-09-01 | |
| dc.date.updated | 2023-06-16T15:58:48Z | |
| dc.description.abstract | This paper proposes the design of a quadcopter neural controller based on Reinforcement Learning (RL) for controlling the complete maneuvers of landing and take-off, even in variable windy conditions. To facilitate RL training, a wind model is designed, and two RL algorithms, Deep Deterministic Policy Gradient (DDPG) and Proximal Policy Optimization (PPO), are adapted and compared. The first phases of the learning process consider extended exploration states as a warm-up, and a novel neural network controller architecture is proposed with the addition of an adaptation layer. The neural network’s output is defined as the forces and momentum desired for the UAV, and the adaptation layer transforms forces and momentum into motor velocities. By decoupling attitude from motor velocities, the adaptation layer enhances a more straightforward interpretation of the neural network output and helps refine the rewards. The successful neural controller training has been tested up to 36 km/h wind speed. | en |
| dc.description.sponsorship | This work has been supported in part by the Ministerio de Ciencia e Innovación (Spain) and European Union NextGenerationEU, Spain under the research grant TED2021-131716B-C21 SARA (Data processing by superresolution algorithms); in part by Agencia Estatal de Investigación (AEI), Spain and European Union NextGenerationEU/PRTR, Spain PLEC2021-007997: Holistic power lines predictive maintenance system; and in part by the Government of Navarre (Departamento de Desarrollo Económico), Spain under the research grants 0011-1411-2021-000021 EMERAL: Emergency UAVs for long range operations, 0011-1365-2020-000078 DIVA, and 0011-1411-2021-000025 MOSIC: Plataforma logística de largo alcance, eléctrica y conectada. | en |
| dc.format.mimetype | application/pdf | en |
| dc.identifier.citation | Olaz, X., Alaez, D., Prieto, M., Villadangos, J., Astrain, J. J. (2023) Quadcopter neural controller for take-off and landing in windy environments. Expert Systems with Applications, 225, 1-15. https://doi.org/10.1016/j.eswa.2023.120146. | en |
| dc.identifier.doi | 10.1016/j.eswa.2023.120146 | |
| dc.identifier.issn | 0957-4174 | |
| dc.identifier.uri | https://academica-e.unavarra.es/handle/2454/45521 | |
| dc.language.iso | eng | en |
| dc.publisher | Elsevier | en |
| dc.relation.ispartof | Expert Systems with Applications 225 (2023) 120146 | en |
| dc.relation.projectID | info:eu-repo/grantAgreement/AEI//TED2021-131716B-C21/ | |
| dc.relation.projectID | info:eu-repo/grantAgreement/AEI/Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020/PLEC2021-007997/ES/ | |
| dc.relation.projectID | info:eu-repo/grantAgreement/Gobierno de Navarra//0011-1411-2021-000021/ | |
| dc.relation.projectID | info:eu-repo/grantAgreement/Gobierno de Navarra//0011-1365-2020-000078/ | |
| dc.relation.projectID | info:eu-repo/grantAgreement/Gobierno de Navarra//0011-1411-2021-000025/ | |
| dc.relation.publisherversion | https://doi.org/10.1016/j.eswa.2023.120146 | |
| dc.rights | © 2023 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license. | en |
| dc.rights.accessRights | info:eu-repo/semantics/openAccess | |
| dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/4.0/ | |
| dc.subject | Quadcopter | en |
| dc.subject | Take-off | en |
| dc.subject | Landing | en |
| dc.subject | Deep reinforcement learning | en |
| dc.subject | Wind | en |
| dc.subject | PPO | en |
| dc.subject | DDPG | en |
| dc.title | Quadcopter neural controller for take-off and landing in windy environments | en |
| dc.type | info:eu-repo/semantics/article | |
| dc.type.version | info:eu-repo/semantics/publishedVersion | |
| dspace.entity.type | Publication | |
| relation.isAuthorOfPublication | 7b630e93-8e7d-4a6a-b5b9-2a6228f1ba49 | |
| relation.isAuthorOfPublication | b271d878-81b4-4aea-918a-e708bf967544 | |
| relation.isAuthorOfPublication | 70e13a05-bb1f-4321-ad39-49810754d6df | |
| relation.isAuthorOfPublication | bbc8cfd2-e8ad-4eec-bf0e-ad22acb246ac | |
| relation.isAuthorOfPublication | f02194ce-06af-4673-82b3-9b96137a08d3 | |
| relation.isAuthorOfPublication.latestForDiscovery | 7b630e93-8e7d-4a6a-b5b9-2a6228f1ba49 |