Academic Journal
Formation planning for multiple USVs with PFCL-MADDPG deep reinforcement learning: theory and experiment.
| Τίτλος: | Formation planning for multiple USVs with PFCL-MADDPG deep reinforcement learning: theory and experiment. |
|---|---|
| Συγγραφείς: | Zhou, Jiahao1 (AUTHOR), Wang, Hao1,2 (AUTHOR) wanghao@mail.neu.edu.cn, Fu, Jun1 (AUTHOR), Xu, Hongli1 (AUTHOR) |
| Πηγή: | International Journal of Systems Science. Oct2026, Vol. 57 Issue 14, p4641-4655. 15p. |
| Θεματικοί όροι: | *Risk assessment, Robotic path planning, Reinforcement learning, Scientific experimentation, Autonomous robots, Machine learning, Maritime management |
| Περίληψη: | In this paper, we propose a novel algorithm called Potential Field and Curriculum Learning-based Multi-Agent Deep Deterministic Policy Gradient (PFCL-MADDPG), which is based on curriculum learning and collision risk assessment model. This algorithm excels in handling complex path planning and sparse reward scenarios. By incorporating curriculum learning, we mitigate the challenges posed by sparse rewards, thereby enhancing learning efficiency. Additionally, we introduce Artificial Potential Field (APF) to establish a collision risk assessment model that computes reward values, significantly improving the safety of USVs. We conducted experiments with multiple USVs in both simulated and real-world environments. The results demonstrate that our algorithm exhibits remarkable robustness and effectiveness when executing tasks in complex maritime environments. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Systems Science is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Βάση Δεδομένων: | Business Source Index |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://resolver.ebsco.com/c/fiv2js/result?sid=EBSCO:bsx&genre=article&issn=00207721&ISBN=&volume=57&issue=14&date=20261015&spage=4641&pages=4641-4655&title=International Journal of Systems Science&atitle=Formation%20planning%20for%20multiple%20USVs%20with%20PFCL-MADDPG%20deep%20reinforcement%20learning%3A%20theory%20and%20experiment.&aulast=Zhou%2C%20Jiahao&id=DOI:10.1080/00207721.2025.2602079 Name: Full Text Finder (for New FTF UI) (ns324271) Category: fullText Text: Full Text Finder MouseOverText: Full Text Finder |
|---|---|
| Header | DbId: bsx DbLabel: Business Source Index An: 197136608 RelevancyScore: 1435 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 1435 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Formation planning for multiple USVs with PFCL-MADDPG deep reinforcement learning: theory and experiment. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Zhou%2C+Jiahao%22">Zhou, Jiahao</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Wang%2C+Hao%22">Wang, Hao</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> wanghao@mail.neu.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Fu%2C+Jun%22">Fu, Jun</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Xu%2C+Hongli%22">Xu, Hongli</searchLink><relatesTo>1</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Systems+Science%22">International Journal of Systems Science</searchLink>. Oct2026, Vol. 57 Issue 14, p4641-4655. 15p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Risk+assessment%22">Risk assessment</searchLink><br /><searchLink fieldCode="DE" term="%22Robotic+path+planning%22">Robotic path planning</searchLink><br /><searchLink fieldCode="DE" term="%22Reinforcement+learning%22">Reinforcement learning</searchLink><br /><searchLink fieldCode="DE" term="%22Scientific+experimentation%22">Scientific experimentation</searchLink><br /><searchLink fieldCode="DE" term="%22Autonomous+robots%22">Autonomous robots</searchLink><br /><searchLink fieldCode="DE" term="%22Machine+learning%22">Machine learning</searchLink><br /><searchLink fieldCode="DE" term="%22Maritime+management%22">Maritime management</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: In this paper, we propose a novel algorithm called Potential Field and Curriculum Learning-based Multi-Agent Deep Deterministic Policy Gradient (PFCL-MADDPG), which is based on curriculum learning and collision risk assessment model. This algorithm excels in handling complex path planning and sparse reward scenarios. By incorporating curriculum learning, we mitigate the challenges posed by sparse rewards, thereby enhancing learning efficiency. Additionally, we introduce Artificial Potential Field (APF) to establish a collision risk assessment model that computes reward values, significantly improving the safety of USVs. We conducted experiments with multiple USVs in both simulated and real-world environments. The results demonstrate that our algorithm exhibits remarkable robustness and effectiveness when executing tasks in complex maritime environments. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Journal of Systems Science is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=bsx&AN=197136608 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1080/00207721.2025.2602079 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 15 StartPage: 4641 Subjects: – SubjectFull: Risk assessment Type: general – SubjectFull: Robotic path planning Type: general – SubjectFull: Reinforcement learning Type: general – SubjectFull: Scientific experimentation Type: general – SubjectFull: Autonomous robots Type: general – SubjectFull: Machine learning Type: general – SubjectFull: Maritime management Type: general Titles: – TitleFull: Formation planning for multiple USVs with PFCL-MADDPG deep reinforcement learning: theory and experiment. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Zhou, Jiahao – PersonEntity: Name: NameFull: Wang, Hao – PersonEntity: Name: NameFull: Fu, Jun – PersonEntity: Name: NameFull: Xu, Hongli IsPartOfRelationships: – BibEntity: Dates: – D: 15 M: 10 Text: Oct2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 00207721 Numbering: – Type: volume Value: 57 – Type: issue Value: 14 Titles: – TitleFull: International Journal of Systems Science Type: main |
| ResultId | 1 |