Skip to content

Latest commit

 

History

History
25 lines (22 loc) · 809 Bytes

benchmark_babi.md

File metadata and controls

25 lines (22 loc) · 809 Bytes

Facebook bAbI dataset 10k

Model Failed Tasks (>5%error): Mean Error:
NTM[1] 16 20.1
D-NTM[2] 9 12.8
MemN2N[3] 3 4.2
DNC[4] 2 3.8
DMN+[5] 1 2.8
GMemN2N[6] 3 3.7
EntNet[7] 0 0.5
QRN[8] 0 0.3
RelNet[9] 0 0.3
  • [1] Neural Turing Machines
  • [2] Dynamic Neural Turing Machine with Soft and Hard Addressing Schemes
  • [3] End-To-End Memory Networks
  • [4] Differentiable neural computers
  • [5] Dynamic Memory Networks for Visual and Textual Question Answering
  • [6] Gated End-to-End Memory Networks
  • [7] Tracking the World State with Recurrent Entity Networks
  • [8] Query-Reduction Networks for Question Answering
  • [9] RelNet: End-to-end Modeling of Entities & Relations