Consecutive Model Editing with Batch alongside HooK Layers

arXiv:2403.05330v1 Announce Type: new
Abstract: As the typical retraining paradigm is unacceptably time- and resource-consuming, researchers are turning to model editing in order to seek an effective, consecutive, and batch-supportive way to edit the model behavior directly. Despite all these practical expectations, existing model editing methods fail to realize all of them. Furthermore, the memory demands for such succession-supportive model editing approaches tend to be prohibitive, frequently necessitating an external memory that grows incrementally over time. To cope with these …

abstract arxiv behavior cs.cl edit editing hook model behavior paradigm practical researchers retraining them type