Stop, children what's that sound? Multi-modal inference through mental simulation

This repository contains all materials for the paper "Stop, children what's that sound? Multi-modal inference through mental simulation" by Joseph Outa, Xi Jia Zhou, Hyowon Gweon and Tobias Gerstenberg. If you have any questions about this repository, please feel free to email me at [email protected]

Repository structure

.
├── code
│   └── R
│       ├── cache
│       └── data
├── data
├── docs
├── figures
│   ├── diagrams
│   ├── ground_truth
│   ├── plots
│   └── stimuli_images
└── stimuli

code

R

Analysis and plotting script. You can view a rendered html file of the analysis here

data

Raw data files of the experiment reported in the paper.

figures

diagrams

Diagrams used to explain model and procedure.

ground truth

Stimuli images used to generate model prediction plots.

plots

Results plots as shown in the paper.

stimuli_images

Stimuli images used to generate results plots.

stimuli

Stimuli slides and script used to run the experiment.