Description:

sinkhornrebasin 0.0.2

Re-basin via implicit Sinkhorn differentiation
Implementation of paper Re-basin via implicit Sinkhorn differentiation (Accepted at CVPR 2023).
Installation
pip install sinkhorn-rebasin

Running the examples









Basics



Models alignment



Linear mode connectivity




Models alignment
cd examples
python main_alignment_{mlp|cnn|resnet}.py




Example
Layer from θA
Layer from πP(θA)
Layer from θB




MLP





VGG





ResNet18






Linear mode connectivity
cd examples
python main_lmc_{mlp|cnn|resnet}.py




Dataset
Model
Accuracy LMC
Cross Entropy Loss LMC




Mnist
MLP




Mnist
VGG




Imagenette-320
ResNet18

License

For personal and professional use. You cannot resell or redistribute these repositories in their original state.

Share

• Share on Facebook
• Share on Twitter