BERTnesia: Investigating the capture and forgetting of knowledge in BERT
Wallat, Jonas et al. “BERTnesia: Investigating the capture and forgetting of knowledge in BERT.” BLACKBOXNLP (2020).
CV
Education
- B.S. in Computer Science, Leibniz University Hannover, 2017
- M.S. in Computer Science, Leibniz University Hannover, 2020
- Ph.D in Interpretable AI, Leibniz University Hannover, 2024 (expected)
Work experience
- Summer 2019: Software Development Intern
- OpenMarket, London
- Duties included: Enterprise Java and Javascript development (AWS/Terraform)
- Supervisor: Geeta Kholia
- 2018-2019 (13 months, part-time): Student Trainee - Software Development
- PPI AG, Hannover
- Duties included: Enterprise Java Development
- Supervisor: Dr. Karl-Ingo Friese
- 2016-2018 (18 months, part-time): Research Assistant
- Department of Software Engineering, Leibniz University Hannover
- Duties included: Investigating communication behavior and its effects on project success
- Supervisor: Dr. Jil Klünder
Skills
- Python
- Pytorch
- Pytorch Lightning
- Transformers
- Weights and Biases
- Java
- Flutter & Dart