PEFT method comparison

Find more information on the PEFT GitHub repo

Choose the task and base model

*forgetting: This is the reduction in CE loss on a sample of Wikipedia data and reflects how much the model 'forgot' during training. The lower the number, the better.

Pareto plot

Select 2 criteria to plot the Pareto frontier. This will show the best PEFT methods along this axis and the trade-offs with the other axis. The PEFT methods that Pareto-dominate are shown in colors. All other methods are inferior with regard to these two metrics. Hover over a point to show details.

Export data