PVeRA

PVeRA adapter improves parameter-efficient model adaptation with probabilistic matrices

Researchers have introduced PVeRA, a novel probabilistic adaptation method for large foundation models that enhances parameter-efficient fine-tuning. PVeRA modifies the low-rank matrices used in the VeRA adapter by inco…