BERTnesia: Investigating the capture and forgetting of knowledge in BERT

Published in BLACKBOXNLP 2020, 2020

Recommended citation: Wallat, Jonas et al. “BERTnesia: Investigating the capture and forgetting of knowledge in BERT.” BLACKBOXNLP (2020).

In this paper, we probe BERT specifically to understand and measure the relational knowledge it captures.

Download paper here

Recommended citation: Wallat, Jonas et al. “BERTnesia: Investigating the capture and forgetting of knowledge in BERT.” BLACKBOXNLP (2020).