Λεπτομέρειες βιβλιογραφικής εγγραφής
| Τίτλος: |
Zero-shot learning of human-object interactions through common-sense knowledge |
| Συγγραφείς: |
Sarullo, Alessio |
| Συνεισφορές: |
Brown, Gavin, Mu, Tingting |
| Στοιχεία εκδότη: |
University of Manchester, 2021. |
| Έτος έκδοσης: |
2021 |
| Θεματικοί όροι: |
006.4, Human-Object Interactions, Zero-Shot Learning, Visual Relationship Detection |
| Περιγραφή: |
Recognising Human-Object Interactions is a fundamental step for an automated system to understand human-centric images. However, the number of interactions to be recognised increases multiplicatively in the number of actions and objects, which makes exhaustive labelling of datasets extremely expensive. Zero-Shot Learning provides a solution to this problem by allowing models to make predictions about classes that lack training instances (they are unseen). Inspired by works in Psychology and Neurobiology, in this thesis we focus on actions, addressing a challenging and understudied zero-shot setting that involves interactions with unseen actions as opposed to just unseen combinations of seen actions and objects. We propose two ways of characterising actions relying on common-sense knowledge, i.e., information that is available to the system prior to training. The first approach is based on affordances: action-object relations that specify which actions can be performed on a given object. In the second approach we consider body part information, identifying dependencies between actions and body part states and defining actions according to such dependencies. Both characterisations are distilled into the model by carefully designed training objectives, and we empirically show that they are effective and complementary to each other for the task of Zero-Shot Human-Object Interaction Recognition. |
| Τύπος εγγράφου: |
Thesis Or Dissertation |
| Γλώσσα: |
English |
| Σύνδεσμος πρόσβασης: |
https://ethos.blethoshyku.com/concern/thesis_or_dissertations/859455 |
| Αριθμός Καταχώρησης: |
edsble.859455 |
| Βάση Δεδομένων: |
British Library EThOS |