BehAVE : behaviour alignment of video game encodings

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: BehAVE : behaviour alignment of video game encodings
Συγγραφείς: Rašajski, Nemanja, Trivedi, Chintan, Makantasis, Konstantinos, Liapis, Antonios, Yannakakis, Georgios N., ECCV Workshop on Computer Vision For Videogames
Στοιχεία εκδότη: ECCV
Έτος έκδοσης: 2024
Συλλογή: University of Malta: OAR@UM / L-Università ta' Malta
Θεματικοί όροι: Artificial intelligence, Computer games -- Design, Computer games -- Programming
Περιγραφή: Domain randomisation enhances the transferability of vision models across visually distinct domains with similar content. However, current methods heavily depend on intricate simulation engines, hampering feasibility and scalability. This paper introduces BehAVE , a video understanding framework that utilises existing commercial video games for domain randomisation without accessing their simulation engines. BehAVE taps into the visual diversity of video games for randomisation and uses textual descriptions of player actions to align videos with similar content. We evaluate BehAVE across 25 first-person shooter (FPS) games using various video and text foundation models, demonstrating its robustness in domain randomisation. BehAVE effectively aligns player behavioural patterns and achieves zero-shot transfer to multiple unseen FPS games when trained on just one game. In a more challenging scenario, BehAVE enhances the zero-shot transferability of foundation models to unseen FPS games, even when trained on a game of a different genre, with improvements of up to 22%. BehAVE is available online ; peer-reviewed
Τύπος εγγράφου: conference object
Γλώσσα: English
Relation: https://www.um.edu.mt/library/oar/handle/123456789/135806
Διαθεσιμότητα: https://www.um.edu.mt/library/oar/handle/123456789/135806
Rights: info:eu-repo/semantics/openAccess ; The copyright of this work belongs to the author(s)/publisher. The rights of this work are as defined by the appropriate Copyright Legislation or as modified by any successive legislation. Users may access this work and can make use of the information contained in accordance with the Copyright Legislation provided that the author must be properly acknowledged. Further distribution or reproduction in any format is prohibited without the prior permission of the copyright holder.
Αριθμός Καταχώρησης: edsbas.AEAD343F
Βάση Δεδομένων: BASE
Περιγραφή
Η περιγραφή δεν είναι διαθέσιμη