Papers Read on AI

Papers Read on AI header image 1
May 5, 2022  

LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models

May 5, 2022

In this work, we introduce LM-Debugger, an interactive debugger tool for transformer-based LMs, which provides a fine-grained interpretation of the model’s internal prediction process, as well as a powerful framework for intervening in LM behavior. For its backbone, LM-Debugger relies on a recent method that interprets the inner token representations and their updates by the feed-forward layers in the vocabulary space.

2022: Mor Geva, Avi Caciularu, Guy Dar, Paul Roit, Shoval Sadde, Micah Shlain, Bar Tamir, Yoav Goldberg

https://arxiv.org/pdf/2204.12130v1.pdf