Conference
Learning circuit placement techniques through reinforcement learning with adaptive rewards
| Τίτλος: | Learning circuit placement techniques through reinforcement learning with adaptive rewards |
|---|---|
| Συγγραφείς: | Vassallo, Luke, Bajada, Josef, Design, Automation & Test in Europe Conference & Exhibition (DATE) 2024 |
| Στοιχεία εκδότη: | Institute of Electrical and Electronics Engineers |
| Έτος έκδοσης: | 2024 |
| Συλλογή: | University of Malta: OAR@UM / L-Università ta' Malta |
| Θεματικοί όροι: | Printed circuits -- Design and construction, Reinforcement learning -- Mathematical models, Simulated annealing (Mathematics), Electronic circuit design -- Automation, Markov processes |
| Περιγραφή: | Placement is the initial step of Printed Circuit Board (PCB) physical design and demands considerable time and domain expertise. Placement quality impacts the performance of subsequent tasks, and the generation of an optimal placement is known to be, at the very least, NP-complete. While stochastic optimisation and analytic techniques have had some success, they often lack the intuitive understanding of human engineers. In this study, we propose a novel end-to-end Machine Learning (ML) approach to learn fundamental placement techniques and use experience to optimise PCB layouts efficiently. To achieve this, we formulate the PCB placement problem as a Markov Decision Process (MDP) and use Reinforcement Learning (RL) to learn general placement techniques. The agent-driven data collection process generates highly diverse and consistent data points sufficient for learning general policies without expert knowledge under the guidance of an adaptive reward signal. Compared to state-of-the-art simulated annealing approaches on unseen circuits, the resulting policies trained with TD3 and SAC, on average, yield 17% and 21% reduction in post-routing wirelength. Qualitative analysis shows that the policies learn fundamental placement techniques and demonstrate an understanding of the underlying problem dynamics. Collectively, they demonstrate emergent collaborative or competitive behaviours and faster placement convergence, sometimes exceeding an order of magnitude. ; peer-reviewed |
| Τύπος εγγράφου: | conference object |
| Γλώσσα: | English |
| Relation: | https://www.um.edu.mt/library/oar/handle/123456789/131782 |
| DOI: | 10.23919/DATE58400.2024.10546526 |
| Διαθεσιμότητα: | https://www.um.edu.mt/library/oar/handle/123456789/131782 https://doi.org/10.23919/DATE58400.2024.10546526 |
| Rights: | info:eu-repo/semantics/restrictedAccess ; The copyright of this work belongs to the author(s)/publisher. The rights of this work are as defined by the appropriate Copyright Legislation or as modified by any successive legislation. Users may access this work and can make use of the information contained in accordance with the Copyright Legislation provided that the author must be properly acknowledged. Further distribution or reproduction in any format is prohibited without the prior permission of the copyright holder. |
| Αριθμός Καταχώρησης: | edsbas.E527AA44 |
| Βάση Δεδομένων: | BASE |
καταχωρήστε σχόλιο πρώτοι!