Bibliographic Details
| Title: |
BehAVE : behaviour alignment of video game encodings |
| Authors: |
Rašajski, Nemanja, Trivedi, Chintan, Makantasis, Konstantinos, Liapis, Antonios, Yannakakis, Georgios N., ECCV Workshop on Computer Vision For Videogames |
| Publisher Information: |
ECCV |
| Publication Year: |
2024 |
| Collection: |
University of Malta: OAR@UM / L-Università ta' Malta |
| Subject Terms: |
Artificial intelligence, Computer games -- Design, Computer games -- Programming |
| Description: |
Domain randomisation enhances the transferability of vision models across visually distinct domains with similar content. However, current methods heavily depend on intricate simulation engines, hampering feasibility and scalability. This paper introduces BehAVE , a video understanding framework that utilises existing commercial video games for domain randomisation without accessing their simulation engines. BehAVE taps into the visual diversity of video games for randomisation and uses textual descriptions of player actions to align videos with similar content. We evaluate BehAVE across 25 first-person shooter (FPS) games using various video and text foundation models, demonstrating its robustness in domain randomisation. BehAVE effectively aligns player behavioural patterns and achieves zero-shot transfer to multiple unseen FPS games when trained on just one game. In a more challenging scenario, BehAVE enhances the zero-shot transferability of foundation models to unseen FPS games, even when trained on a game of a different genre, with improvements of up to 22%. BehAVE is available online ; peer-reviewed |
| Document Type: |
conference object |
| Language: |
English |
| Relation: |
https://www.um.edu.mt/library/oar/handle/123456789/135806 |
| Availability: |
https://www.um.edu.mt/library/oar/handle/123456789/135806 |
| Rights: |
info:eu-repo/semantics/openAccess ; The copyright of this work belongs to the author(s)/publisher. The rights of this work are as defined by the appropriate Copyright Legislation or as modified by any successive legislation. Users may access this work and can make use of the information contained in accordance with the Copyright Legislation provided that the author must be properly acknowledged. Further distribution or reproduction in any format is prohibited without the prior permission of the copyright holder. |
| Accession Number: |
edsbas.AEAD343F |
| Database: |
BASE |