🏆 Rank-sum Leaderboard
Lower Rank-sum = better overall performance
Model |
Domain |
Type |
KNN ↑ |
Lin. prob. ↑ |
Few-shot ↑ |
Calib. ↓ |
Adv. attack ↓ |
Seg.↑ |
Rank sum ↓ |
HIBOU-B | Histopathology | VM | 75.8 (10) | 78.0 (14) | 74.2 (6) | 3.7 (2) | 52.8 (14) | 61.5 (10) | 56 (8) |
HIBOU-L | Histopathology | VM | 75.2 (12) | 81.2 (7) | 70.4 (12) | 5.5 (21) | 40.0 (5) | 62.2 (7) | 64 (10) |
H-OPTIMUS-0 | Histopathology | VM | 79.2 (5) | 81.4 (5) | 73.4 (7) | 4.7 (12) | 44.2 (9) | 59.0 (13) | 51 (7) |
H-OPTIMUS-1 | Histopathology | VM | 80.5 (3) | 83.3 (2) | 74.8 (4) | 4.1 (4) | 58.0 (17) | 58.4 (14) | 44 (5) |
MIDNIGHT | Histopathology | VM | 78.2 (8) | 82.9 (3) | 70.6 (11) | 3.2 (1) | 36.3 (4) | 62.9 (2) | 29 (3) |
PHIKON | Histopathology | VM | 72.8 (14) | 78.5 (13) | 72.2 (10) | 6.4 (22) | 34.4 (3) | 61.7 (9) | 71 (13) |
PHIKON2 | Histopathology | VM | 70.1 (15) | 76.5 (15) | 70.1 (13) | 4.6 (10) | 45.6 (11) | 62.0 (8) | 72 (14) |
UNI | Histopathology | VM | 78.8 (6) | 81.3 (6) | 76.4 (2) | 4.3 (7) | 42.8 (7) | 62.2 (6) | 34 (4) |
UNI2-H | Histopathology | VM | 81.7 (1) | 83.9 (1) | 78.4 (1) | 4.5 (8) | 34.3 (2) | 62.8 (4) | 17 (1) |
VIRCHOW | Histopathology | VM | 74.2 (13) | 80.2 (11) | 68.5 (15) | 5.5 (19) | 41.0 (6) | 62.7 (5) | 69 (11) |
VIRCHOW2 | Histopathology | VM | 81.2 (2) | 82.7 (4) | 72.5 (9) | 4.6 (11) | 33.6 (1) | 63.4 (1) | 28 (2) |
CONCH | Histopathology | VLM | 77.3 (9) | 80.2 (10) | 73.1 (8) | 4.3 (6) | 55.0 (15) | 42.0 (23) | 71 (12) |
CONCH 1.5 | Histopathology | VLM | 78.6 (7) | 80.8 (9) | 74.6 (5) | 4.9 (15) | 75.3 (23) | 62.8 (3) | 62 (9) |
KEEP | Histopathology | VLM | 79.7 (4) | 81.1 (8) | 75.8 (3) | 4.7 (13) | 44.7 (10) | 61.3 (11) | 49 (6) |
MUSK | Histopathology | VLM | 75.6 (11) | 79.0 (12) | 70.0 (14) | 4.5 (9) | 69.3 (22) | 59.7 (12) | 80 (15) |
PLIP | Histopathology | VLM | 67.8 (19) | 71.0 (21) | 63.4 (17) | 4.9 (14) | 56.9 (16) | 54.0 (21) | 108 (20) |
QUILTNET | Histopathology | VLM | 68.3 (17) | 71.0 (22) | 65.7 (16) | 7.0 (23) | 52.7 (13) | 54.3 (20) | 111 (21) |
DINOv2-B | Natural-image | VM | 67.9 (18) | 74.8 (17) | 61.0 (18) | 5.5 (20) | 65.8 (20) | 54.7 (18) | 111 (22) |
DINOv2-L | Natural-image | VM | 69.5 (16) | 75.3 (16) | 59.2 (19) | 5.3 (17) | 64.5 (19) | 54.4 (19) | 106 (19) |
ViT-B/16 | Natural-image | VM | 64.4 (21) | 71.9 (19) | 57.8 (21) | 3.9 (3) | 46.8 (12) | 57.9 (15) | 93 (16) |
ViT-L/16 | Natural-image | VM | 67.5 (20) | 72.8 (18) | 56.5 (22) | 5.0 (16) | 44.1 (8) | 51.9 (22) | 99 (17) |
CLIP-B/32 | Natural-image | VLM | 61.9 (23) | 65.8 (23) | 53.3 (23) | 5.5 (18) | 60.4 (18) | 55.9 (16) | 127 (23) |
CLIP-L/14 | Natural-image | VLM | 64.2 (22) | 71.3 (20) | 58.2 (20) | 4.2 (5) | 67.8 (21) | 55.5 (17) | 104 (18) |