mia-evals leaderboard

Model predictions scored on volumetric segmentation benchmarks. Select a benchmark below; click any column header to sort.

cellmap_organelle_semantic

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • jrc_cos7-1a_crop236 400x400x400
  • jrc_cos7-1a_crop243 400x400x400
  • jrc_cos7-1b_crop235 400x400x400
  • jrc_cos7-1b_crop241 400x400x400
  • jrc_ctl-id8-1_crop119 400x400x400
  • jrc_fly-mb-1a_crop123 400x400x400
  • jrc_fly-vnc-1_crop174 400x400x400
  • jrc_hela-2_crop14 130x300x300
  • jrc_hela-2_crop23 500x500x500
  • jrc_hela-2_crop3 500x800x800
  • jrc_hela-2_crop57 400x400x400
  • jrc_hela-2_crop9 106x200x200
  • jrc_hela-3_crop33 400x400x400
  • jrc_hela-3_crop34 400x400x400
  • jrc_hela-3_crop61 400x400x400
  • jrc_jurkat-1_crop112 1000x500x1000
  • jrc_jurkat-1_crop66 400x400x400
  • jrc_jurkat-1_crop68 400x400x400
  • jrc_macrophage-2_crop39 400x400x400
  • jrc_macrophage-2_crop40 400x400x400
  • jrc_macrophage-2_crop73 400x400x400
  • jrc_mus-kidney_crop129 300x300x300
  • jrc_mus-kidney_crop159 200x200x200
  • jrc_mus-kidney_crop161 200x200x200
  • jrc_mus-liver-zon-1_crop267 400x400x400
  • jrc_mus-liver-zon-1_crop274 400x400x400
  • jrc_mus-liver-zon-1_crop279 400x400x400
  • jrc_mus-liver-zon-1_crop313 400x400x400
  • jrc_mus-liver-zon-1_crop323 400x400x400
  • jrc_mus-liver-zon-2_crop342 400x400x400
  • jrc_mus-liver-zon-2_crop370 400x400x400
  • jrc_mus-liver_crop138 400x400x400
  • jrc_mus-liver_crop139 200x200x200
  • jrc_mus-liver_crop145 360x750x750
  • jrc_sum159-1_crop20 170x400x400
  • jrc_sum159-1_crop81 400x400x400
  • jrc_sum159-4_crop188 400x400x400
  • jrc_sum159-4_crop209 400x400x400
  • jrc_sum159-4_crop217 400x400x400
  • jrc_ut21-1413-003_crop191 400x400x400
  • jrc_ut21-1413-003_crop224 400x400x400
  • jrc_ut21-1413-003_crop225 400x400x400
  • jrc_ut21-1413-003_crop226 400x400x400
#modellinkssemantic.mean_iou (higher is better)postprocesssemantic.mean_dicesemantic.pixel_accuracysemantic.classes_present
1lmd2cm__1c_simmim_lvd_20261028_211227.step25000.identityartifactscheckpoint0.4151Identity0.52710.889848.0000
2lmd2cm__1c_simmim_lvd_20261028_211227.step50000.identityartifactscheckpoint0.3984Identity0.51700.872548.0000
3lmd2cm__2c_affinity_simmim_lvd_seed1_20261031_013819.step25000.identityartifactscheckpoint0.3900Identity0.49510.877948.0000
4lmd2cm__1b_lvd_20261028_204534.step25000.identityartifactscheckpoint0.3688Identity0.47950.875548.0000
5lmd2cm__2a_affinity_simmim_lvd_native_20261029_221401.step25000.identityartifactscheckpoint0.3658Identity0.48490.844748.0000
6lmd2cm__1e_affinity_simmim_lvd_20261029_204759.step25000.identityartifactscheckpoint0.3347Identity0.43890.855748.0000
7lmd2cm__2a_affinity_simmim_lvd_native_20261029_221401.step50000.identityartifactscheckpoint0.3324Identity0.44450.801548.0000
8lmd2cm__2b_affinity_simmim_lvd_dice_20261030_165448.step25000.identityartifactscheckpoint0.3277Identity0.44230.818348.0000
9lmd2cm__1c_simmim_lvd_20261028_211227.step75000.identityartifactscheckpoint0.3265Identity0.43770.820748.0000
10lmd2cm__1d_simmim_scratch_20261029_144643.step50000.identityartifactscheckpoint0.3238Identity0.42890.850448.0000
11lmd2cm__1d_simmim_scratch_20261029_144643.step25000.identityartifactscheckpoint0.3227Identity0.41930.847148.0000
12lmd2cm__2c_affinity_simmim_lvd_seed1_20261031_013819.step50000.identityartifactscheckpoint0.3214Identity0.43270.820448.0000
13lmd2cm__2a_affinity_simmim_lvd_native_20261029_221401.step75000.identityartifactscheckpoint0.3100Identity0.41930.743748.0000
14lmd2cm__1b_lvd_20261028_204534.step50000.identityartifactscheckpoint0.2997Identity0.40170.827248.0000
15lmd2cm__1c_simmim_lvd_20261028_211227.step100000.identityartifactscheckpoint0.2840Identity0.38560.785848.0000
16lmd2cm__1d_simmim_scratch_20261029_144643.step75000.identityartifactscheckpoint0.2665Identity0.37020.779148.0000
17lmd2cm__2a_affinity_simmim_lvd_native_20261029_221401.step100000.identityartifactscheckpoint0.2509Identity0.34580.610648.0000
18lmd2cm__1d_simmim_scratch_20261029_144643.step100000.identityartifactscheckpoint0.2466Identity0.35030.743148.0000
19lmd2cm__1e_affinity_simmim_lvd_20261029_204759.step50000.identityartifactscheckpoint0.2319Identity0.31930.687348.0000
20lmd2cm__2b_affinity_simmim_lvd_dice_20261030_165448.step50000.identityartifactscheckpoint0.2261Identity0.32580.654048.0000
21lmd2cm__2c_affinity_simmim_lvd_seed1_20261031_013819.step75000.identityartifactscheckpoint0.2241Identity0.32490.694348.0000
22lmd2cm__1b_lvd_20261028_204534.step75000.identityartifactscheckpoint0.2174Identity0.30950.703448.0000
23lmd2cm__1b_lvd_20261028_204534.step100000.identityartifactscheckpoint0.1820Identity0.26080.649448.0000
24lmd2cm__2b_affinity_simmim_lvd_dice_20261030_165448.step75000.identityartifactscheckpoint0.1816Identity0.26600.566348.0000
25lmd2cm__1a_scratch_20261028_192039.step100000.identityartifactscheckpoint0.1794Identity0.25490.713248.0000
26lmd2cm__2c_affinity_simmim_lvd_seed1_20261031_013819.step100000.identityartifactscheckpoint0.1776Identity0.26320.591448.0000
27lmd2cm__1a_scratch_20261028_192039.step75000.identityartifactscheckpoint0.1548Identity0.22210.697748.0000
28lmd2cm__1e_affinity_simmim_lvd_20261029_204759.step100000.identityartifactscheckpoint0.1453Identity0.20890.537948.0000
29lmd2cm__2b_affinity_simmim_lvd_dice_20261030_165448.step100000.identityartifactscheckpoint0.1408Identity0.20700.488248.0000
30lmd2cm__1e_affinity_simmim_lvd_20261029_204759.step75000.identityartifactscheckpoint0.1348Identity0.20030.481948.0000
31lmd2cm__1a_scratch_20261028_192039.step50000.identityartifactscheckpoint0.1139Identity0.17010.609848.0000
32lmd2cm__1a_scratch_20261028_192039.step25000.identityartifactscheckpoint0.0717Identity0.10260.612348.0000
↑ mean_iou
Mean intersection-over-union over the classes present.
↑ mean_dice
Mean Dice coefficient over the classes present.
↑ pixel_accuracy
Fraction of voxels given the correct class.
classes_present
Number of classes present in the ground truth.

gary_comparison_neuron_instance

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • hemibrain_eb_test 896x896x896 (sub-region)
#modellinksvoxel_instance.pq (higher is better)postprocessvoxel_instance.voi_mergevoxel_instance.voi_splitvoxel_instance.sqvoxel_instance.rqvoxel_instance.adapted_rand_error
1gary__4b_dinov3sat_axial_subpixel_p8_20260923_173431.step450000.mws_size_filterartifactscheckpoint0.1711mws(repulsive_stride=1, min_size=20000)0.38700.93320.85600.19990.2174
2gary__5a_dinov3_axial_unetr_20260924_001902.step500000.mws_size_filterartifactscheckpoint0.1682mws(repulsive_stride=1, min_size=20000)0.39810.91150.84980.19800.2061
3gary__1c_dinov3_axial_subpixel_1m_20260919_124840.step1000000.mws_size_filterartifactscheckpoint0.1665mws(repulsive_stride=1, min_size=20000)0.43300.92380.85420.19490.2165
4gary__1a_dinov3_axial_subpixel_20260916_215544.step500000.mws_size_filterartifactscheckpoint0.1636mws(repulsive_stride=1, min_size=20000)0.42090.95440.84630.19340.2219
5gary__3b_simmim85_axial_subpixel_20260922_163950.step500000.mws_size_filterartifactscheckpoint0.1608mws(repulsive_stride=1, min_size=20000)0.43940.95780.85260.18860.2287
6gary__1a_dinov3_axial_subpixel_20260916_215544.step300000.mws_size_filterartifactscheckpoint0.1570mws(repulsive_stride=1, min_size=20000)0.45540.97070.84580.18560.2288
7gary__6a_dinov3_axial_subpixel_erode1_20260926_212744.step200000.mws_size_filter_fillartifactscheckpoint0.1569mws(repulsive_stride=1, min_size=20000, fill=1)0.50941.02590.84630.18530.2536
8gary__6a_dinov3_axial_subpixel_erode1_20260926_212744.step500000.mws_size_filter_fillartifactscheckpoint0.1560mws(repulsive_stride=1, min_size=20000, fill=1)0.46980.99680.85000.18360.2399
9gary__3d_simmim90_hemibrain_500k_axial_subpixel_20260928_185741.step200000.mws_size_filterartifactscheckpoint0.1553mws(repulsive_stride=1, min_size=20000)0.48590.96770.84780.18320.2377
10gary__1b_scratch_axial_subpixel_20260917_093923.step500000.mws_size_filterartifactscheckpoint0.1531mws(repulsive_stride=1, min_size=20000)0.48000.96460.85600.17890.2370
11gary__1b_scratch_axial_subpixel_20260917_093923.step300000.mws_size_filterartifactscheckpoint0.1511mws(repulsive_stride=1, min_size=20000)0.51190.96310.84880.17800.2376
12gary__1a_dinov3_axial_subpixel_20260916_215544.step100000.mws_size_filterartifactscheckpoint0.1489mws(repulsive_stride=1, min_size=20000)0.53070.97180.84900.17530.2389
13gary__6a_dinov3_axial_subpixel_erode1_20260926_212744.step500000.mws_size_filterartifactscheckpoint0.1445mws(repulsive_stride=1, min_size=20000)0.79021.07870.80720.17900.4039
14gary__6a_dinov3_axial_subpixel_erode1_20260926_212744.step200000.mws_size_filterartifactscheckpoint0.1433mws(repulsive_stride=1, min_size=20000)0.83321.10050.80800.17740.4249
15gary__1b_scratch_axial_subpixel_20260917_093923.step100000.mws_size_filterartifactscheckpoint0.1400mws(repulsive_stride=1, min_size=20000)0.66220.98030.83670.16730.2465
16gary__1c_dinov3_axial_subpixel_1m_20260919_124840.step1000000.cc_threshold_size_filterartifactscheckpoint0.1295cc_threshold(logit=+3, thr=0.6457, min_size=500)3.31580.75590.74910.17280.8852
17gary__1a_dinov3_axial_subpixel_20260916_215544.step500000.cc_threshold_size_filterartifactscheckpoint0.1184cc_threshold(logit=+6, thr=0.7685, min_size=5000)1.52511.20430.76030.15580.7282
18gary__3b_simmim85_axial_subpixel_20260922_163950.step500000.cc_threshold_size_filterartifactscheckpoint0.1162cc_threshold(logit=+6, thr=0.7685, min_size=5000)1.55001.18940.75880.15310.7279
19gary__1b_scratch_axial_subpixel_20260917_093923.step500000.cc_threshold_size_filterartifactscheckpoint0.1137cc_threshold(logit=+6, thr=0.7685, min_size=5000)1.61861.20730.74960.15170.7479
20gary__1a_dinov3_axial_subpixel_20260916_215544.step300000.cc_threshold_size_filterartifactscheckpoint0.1116cc_threshold(logit=+6, thr=0.7685, min_size=5000)1.65461.21270.74070.15070.7552
21gary__1a_dinov3_axial_subpixel_20260916_215544.step100000.cc_threshold_size_filterartifactscheckpoint0.1098cc_threshold(logit=+6, thr=0.7685, min_size=5000)1.70381.22500.73710.14900.7683
22gary__1b_scratch_axial_subpixel_20260917_093923.step300000.cc_threshold_size_filterartifactscheckpoint0.1008cc_threshold(logit=+6, thr=0.7685, min_size=5000)1.88071.29160.72380.13930.8159
23gary__1b_scratch_axial_subpixel_20260917_093923.step100000.cc_threshold_size_filterartifactscheckpoint0.0806cc_threshold(logit=+6, thr=0.7685, min_size=20000)2.22051.29620.68140.11820.8518
↑ pq
Panoptic quality, sq * rq: how well predicted objects match true ones at IoU > 0.5.
↓ voi_merge
Variation of information, merge term H(truth | prediction): under-segmentation.
↓ voi_split
Variation of information, split term H(prediction | truth): over-segmentation.
↑ sq
Segmentation quality: mean IoU of the matched object pairs.
↑ rq
Recognition quality: F1 of object matching, balancing missed and spurious objects.
↓ adapted_rand_error
Adapted Rand error, 1 - Rand F-score of the voxel pairing.

hemibrain_eb_neurite_tracing

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • hemibrain_eb_roi_1 1475x1475x1475
  • hemibrain_eb_roi_2 2725x2725x2725
  • hemibrain_eb_roi_3 2100x2100x2100
#modellinksskeleton_erl.nerl (higher is better)postprocessskeleton_erl.erl_umskeleton_erl.voi_sumskeleton_erl.voi_splitskeleton_erl.voi_mergeskeleton_erl.n_non0_mergersskeleton_erl.n_splits
1ffn_januszewski2018.identityartifacts0.8253Identity64.88430.28030.24750.032813.6667125.0000
↑ nerl
Normalised expected run length: ERL along the traced skeletons divided by the maximum possible.
↑ erl_um
Expected run length in micrometres.
↓ voi_sum
voi_split + voi_merge.
↓ voi_split
Variation of information on the skeleton nodes, split term H(prediction | truth): over-segmentation.
↓ voi_merge
Variation of information on the skeleton nodes, merge term H(truth | prediction): under-segmentation.
↓ n_non0_mergers
Number of (merging segment, skeleton) pairs where one segment spans several skeletons.
↓ n_splits
Number of skeleton edges the segmentation cuts.

lm_zebrafish_cell_instance

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • lm_zebrafish_t10 152x508x1466
#modellinksvoxel_instance.pq (higher is better)postprocessvoxel_instance.voi_mergevoxel_instance.voi_splitvoxel_instance.sqvoxel_instance.rqvoxel_instance.adapted_rand_error
1cellpose-sam_ft_t1-t25.step0.identityartifacts0.6275Identity0.48690.59660.83530.75120.2124
2cellpose-sam_ft_t25.step0.identityartifacts0.6265Identity0.45920.61610.82770.75690.1908
3cellpose-sam_ft_t1.step0.identityartifacts0.6012Identity0.57860.63610.83950.71620.2671
4lsd-deep4wide_ft_t1-t25.step0.identity_size_filter_fillartifacts0.5918identity(min_size=50000, fill_distance=3)0.93330.73560.81770.72370.4362
5lsd-deep4wide_ft_t1-t25.step0.identity_size_filterartifacts0.5274identity(min_size=75000)2.21140.85670.74690.70610.9137
6cellpose-sam_zeroshot.step0.identityartifacts0.4952Identity1.07950.93930.77560.63850.4797
↑ pq
Panoptic quality, sq * rq: how well predicted objects match true ones at IoU > 0.5.
↓ voi_merge
Variation of information, merge term H(truth | prediction): under-segmentation.
↓ voi_split
Variation of information, split term H(prediction | truth): over-segmentation.
↑ sq
Segmentation quality: mean IoU of the matched object pairs.
↑ rq
Recognition quality: F1 of object matching, balancing missed and spurious objects.
↓ adapted_rand_error
Adapted Rand error, 1 - Rand F-score of the voxel pairing.

lmd_ssl_v1_neuron_instance

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • kasthuri15_ac4 256x640x640 (sub-region)
  • liconn_expid82 768x1152x1152 (sub-region)
  • liconn_mouse_hippocampus 512x512x512 (sub-region)
  • zebrafish_fish2_doublecube1 1920x1920x1920 (sub-region)
#modellinksvoxel_instance.pq (higher is better)postprocessvoxel_instance.voi_mergevoxel_instance.voi_splitvoxel_instance.sqvoxel_instance.rqvoxel_instance.adapted_rand_error
1sam1__arm8_8nm_gb16_musam128_r0_20260916_223719.step200000.identity_size_filterartifactscheckpoint0.2786identity(min_size=5000)2.01731.18580.68670.39510.5714
2sam1__arm12_8nm_gb16_musam128_sat493m_r0_20260923_110837.step200000.identity_size_filterartifactscheckpoint0.2775identity(min_size=5000)2.20021.09690.69030.38800.5500
3sam1__arm7_8nm_gb16_musam64_r0_20260916_105148.step200000.identity_size_filterartifactscheckpoint0.2591identity(min_size=5000)3.32980.86700.68930.36150.6418
4lmd1__1c_dinov3_simmim_ft_subpixel_20260827_231846.step50000.identity_size_filterartifactscheckpoint0.2369identity(min_size=50000)2.07551.31250.70780.32410.5426
5lmd1__2c_dinov3_lvd_ft_subpixel_20260824_183919.step50000.identity_size_filterartifactscheckpoint0.2287identity(min_size=50000)1.85651.30230.70720.31550.5380
6sam1__arm11_8nm_gb16_musam128_scratch_r0_20260923_110902.step200000.identity_size_filterartifactscheckpoint0.2254identity(min_size=5000)3.60990.87980.69470.31290.6648
7sam1__arm6_8nm_gb16_musam_r0_20260915_124216.step200000.identity_size_filterartifactscheckpoint0.2244identity(min_size=5000)3.53740.91530.69720.31110.6831
8sam1__arm4_8nm_gb16_r0_20260913_221637.step200000.identity_size_filterartifactscheckpoint0.2094identity(min_size=5000)3.44920.97090.69090.29450.6829
9sam1__arm5_8nm_gb32_r0_20260913_223406.step200000.identity_size_filterartifactscheckpoint0.2038identity(min_size=5000)3.93970.70630.72210.27750.6845
10sam1__arm9_8nm_gb64_musam32_c128_r0_20260921_004737.step200000.identity_size_filterartifactscheckpoint0.2017identity(min_size=5000)3.33400.97790.69430.28210.6261
11sam1__arm3_p8_r0_20260913_200809.step200000.identity_size_filterartifactscheckpoint0.1734identity(min_size=5000)4.16160.94270.71120.23910.7769
12lmd1__2c_dinov3_lvd_ft_subpixel_20260824_183919.step50000.cc_threshold_size_filterartifactscheckpoint0.1420cc_threshold(logit=+3, thr=0.6457, min_size=50000)3.70741.06750.65070.21100.7435
13lmd1__2c_dinov3_lvd_ft_subpixel_20260824_183919.step50000.cc_thresholdartifactscheckpoint0.0031cc_threshold(logit=+0, thr=0.5000)6.74410.43060.50480.00440.8968
↑ pq
Panoptic quality, sq * rq: how well predicted objects match true ones at IoU > 0.5.
↓ voi_merge
Variation of information, merge term H(truth | prediction): under-segmentation.
↓ voi_split
Variation of information, split term H(prediction | truth): over-segmentation.
↑ sq
Segmentation quality: mean IoU of the matched object pairs.
↑ rq
Recognition quality: F1 of object matching, balancing missed and spurious objects.
↓ adapted_rand_error
Adapted Rand error, 1 - Rand F-score of the voxel pairing.

lmd_ssl_v1_zebrafish_instance

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • zebrafish_fish2_doublecube1 1920x1920x1920 (sub-region)
#modellinksvoxel_instance.pq (higher is better)postprocessvoxel_instance.voi_mergevoxel_instance.voi_splitvoxel_instance.sqvoxel_instance.rqvoxel_instance.adapted_rand_error
1lmd1__1c_dinov3_simmim_ft_subpixel_20260827_231846.step50000.identity_size_filterartifactscheckpoint0.0876identity(min_size=50000)3.65542.06530.71730.12210.9370
2lmd1__2c_dinov3_lvd_ft_subpixel_20260824_183919.step50000.identity_size_filterartifactscheckpoint0.0862identity(min_size=50000)3.13832.02740.69780.12360.9317
3lmd1__3c_muvit_mae_ft_subpixel_20260905_074206.step50000.identity_size_filterartifactscheckpoint0.0719identity(min_size=50000)4.64632.29500.74000.09720.9593
↑ pq
Panoptic quality, sq * rq: how well predicted objects match true ones at IoU > 0.5.
↓ voi_merge
Variation of information, merge term H(truth | prediction): under-segmentation.
↓ voi_split
Variation of information, split term H(prediction | truth): over-segmentation.
↑ sq
Segmentation quality: mean IoU of the matched object pairs.
↑ rq
Recognition quality: F1 of object matching, balancing missed and spurious objects.
↓ adapted_rand_error
Adapted Rand error, 1 - Rand F-score of the voxel pairing.

lmd_ssl_v2_neuron_instance

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • cns_mito_crop164 1152x1152x1792
  • cremi_sample_c 512x512x512 (sub-region)
  • flyid49_40xw006 640x256x256 (sub-region)
  • kasthuri15_ac4 256x640x640 (sub-region)
  • liconn_expid82 768x1152x1152 (sub-region)
  • liconn_mouse_hippocampus 512x512x512 (sub-region)
  • zebrafish_fish2_doublecube1 1920x1920x1920 (sub-region)
#modellinksvoxel_instance.pq (higher is better)postprocessvoxel_instance.voi_mergevoxel_instance.voi_splitvoxel_instance.sqvoxel_instance.rqvoxel_instance.adapted_rand_error
1lmd2__2f_affinity_unetr_simmim_lvd_20261020_200659.step100000.mws_size_filterartifactscheckpoint0.2771mws(repulsive_stride=1, min_size=20000)1.15340.91450.74630.36300.3370
2lmd2__2d_sam_musam128_lvd_20261018_231122.step100000.identity_size_filterartifactscheckpoint0.2663identity(min_size=5000)1.84801.02930.70190.37100.5322
3lmd2__2h_affinity_unetr_simmim_lvd_mask60_g2_20261021_071125.step100000.mws_size_filterartifactscheckpoint0.2640mws(repulsive_stride=1, min_size=20000)1.18690.94120.74790.34490.3534
4lmd2__2e_mtlsd_unetr_lvd_w10_20261019_004951.step100000.mws_size_filterartifactscheckpoint0.2551mws(repulsive_stride=1, min_size=20000)1.42731.03290.74350.33130.4154
5lmd2__2a_affinity_unetr_lvd_20261018_215936.step100000.mws_size_filterartifactscheckpoint0.2455mws(repulsive_stride=1, min_size=20000)1.36201.02640.74340.32110.3894
6lmd2__2g_affinity_unetr_simmim_scratch_20261020_124554.step100000.mws_size_filterartifactscheckpoint0.2410mws(repulsive_stride=1, min_size=20000)1.27201.05440.74150.31620.3834
7lmd2__2b_affinity_unetr_scratch_20261018_215937.step100000.mws_size_filterartifactscheckpoint0.2240mws(repulsive_stride=1, min_size=20000)1.60181.17640.73360.30020.4938
8lmd2__2c_mtlsd_unetr_lvd_20261018_215102.step100000.mws_size_filterartifactscheckpoint0.2043mws(repulsive_stride=1, min_size=20000)1.63731.27360.72650.26400.4526
↑ pq
Panoptic quality, sq * rq: how well predicted objects match true ones at IoU > 0.5.
↓ voi_merge
Variation of information, merge term H(truth | prediction): under-segmentation.
↓ voi_split
Variation of information, split term H(prediction | truth): over-segmentation.
↑ sq
Segmentation quality: mean IoU of the matched object pairs.
↑ rq
Recognition quality: F1 of object matching, balancing missed and spurious objects.
↓ adapted_rand_error
Adapted Rand error, 1 - Rand F-score of the voxel pairing.

lmd_ssl_v2_neuron_instance_crop512

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • cns_mito_crop164_crop512 512x512x512
  • cremi_sample_c_crop512 512x256x256 (sub-region)
  • flyid49_40xw006_crop512 640x256x256 (sub-region)
  • kasthuri15_ac4_crop512 256x256x256 (sub-region)
  • liconn_expid82_crop512 768x512x512 (sub-region)
  • liconn_mouse_hippocampus_crop512 512x512x512 (sub-region)
  • zebrafish_fish2_doublecube1_crop512 512x512x384 (sub-region)
#modellinksvoxel_instance.pq (higher is better)postprocessvoxel_instance.voi_mergevoxel_instance.voi_splitvoxel_instance.sqvoxel_instance.rqvoxel_instance.adapted_rand_error
1lmd2__2f_affinity_unetr_simmim_lvd_20261020_200659.step100000.mws_size_filterartifactscheckpoint0.2998mws(repulsive_stride=1, min_size=20000)1.08130.74770.75230.39300.2974
2lmd2__2d_sam_musam128_lvd_20261018_231122.step75000.identity_size_filterartifactscheckpoint0.2933identity(min_size=500)1.64660.85470.71080.40640.5013
3lmd2__2h_affinity_unetr_simmim_lvd_mask60_g2_20261021_071125.step100000.mws_size_filterartifactscheckpoint0.2891mws(repulsive_stride=1, min_size=20000)1.08670.73030.76130.37450.3013
4lmd2__2g_affinity_unetr_simmim_scratch_20261020_124554.step75000.mws_size_filterartifactscheckpoint0.2811mws(repulsive_stride=1, min_size=20000)1.13690.83120.74800.36890.3265
5lmd2__2e_mtlsd_unetr_lvd_w10_20261019_004951.step100000.mws_size_filterartifactscheckpoint0.2767mws(repulsive_stride=1, min_size=20000)1.25450.78810.75060.35850.3263
6lmd2__2a_affinity_unetr_lvd_20261018_215936.step100000.mws_size_filterartifactscheckpoint0.2711mws(repulsive_stride=1, min_size=20000)1.22430.81790.75270.35260.3347
7lmd2__2b_affinity_unetr_scratch_20261018_215937.step100000.mws_size_filterartifactscheckpoint0.2508mws(repulsive_stride=1, min_size=20000)1.41370.90180.73600.33600.4033
8lmd2__2c_mtlsd_unetr_lvd_20261018_215102.step100000.mws_size_filterartifactscheckpoint0.2185mws(repulsive_stride=1, min_size=20000)1.49941.03590.72970.28090.4160
↑ pq
Panoptic quality, sq * rq: how well predicted objects match true ones at IoU > 0.5.
↓ voi_merge
Variation of information, merge term H(truth | prediction): under-segmentation.
↓ voi_split
Variation of information, split term H(prediction | truth): over-segmentation.
↑ sq
Segmentation quality: mean IoU of the matched object pairs.
↑ rq
Recognition quality: F1 of object matching, balancing missed and spurious objects.
↓ adapted_rand_error
Adapted Rand error, 1 - Rand F-score of the voxel pairing.

nisb_base_neurite_tracing

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • nisb_base_seed101 3000x3000x1350
#modellinksskeleton_erl.nerl (higher is better)postprocessskeleton_erl.erl_umskeleton_erl.voi_sumskeleton_erl.voi_splitskeleton_erl.voi_mergeskeleton_erl.n_non0_mergersskeleton_erl.n_splits
1large_inputs_nisb__w512_5cube_20261003_141342.step500000.cc_thresholdartifactscheckpoint0.5639cc_threshold(logit=+7, thr=0.8022)144.68942.02051.33750.682979.00003417.0000
2large_inputs_nisb__w512_5cube_20261003_141342.step300000.cc_thresholdartifacts (missing)checkpoint0.5453cc_threshold(logit=+6, thr=0.7685)139.90301.96721.30200.665298.00003262.0000
3large_inputs_nisb__w512_5cube_20261003_141342.step400000.cc_thresholdartifacts (missing)checkpoint0.5364cc_threshold(logit=+6, thr=0.7685)137.61681.85841.26680.5917138.00003181.0000
4large_inputs_nisb__w512_5cube_20261003_141342.step200000.cc_thresholdartifacts (missing)checkpoint0.5296cc_threshold(logit=+6, thr=0.7685)135.89332.19701.38860.808474.00003324.0000
5large_inputs_nisb__w512_3cube_20261003_141341.step200000.cc_thresholdartifacts (missing)checkpoint0.5125cc_threshold(logit=+7, thr=0.8022)131.49102.39571.45500.940779.00003560.0000
6large_inputs_nisb__w512_3cube_20261003_141341.step300000.cc_thresholdartifacts (missing)checkpoint0.4879cc_threshold(logit=+8, thr=0.8320)125.19292.30831.44130.8671138.00004007.0000
7large_inputs_nisb__w256_5cube_20261003_141051.step500000.cc_thresholdartifacts (missing)checkpoint0.4840cc_threshold(logit=+6, thr=0.7685)124.18102.35471.44820.9066121.00002787.0000
8large_inputs_nisb__w512_3cube_20261003_141341.step100000.cc_thresholdartifacts (missing)checkpoint0.4703cc_threshold(logit=+6, thr=0.7685)120.65682.50001.47701.0230109.00003548.0000
9large_inputs_nisb__w512_5cube_20261003_141342.step100000.cc_thresholdartifacts (missing)checkpoint0.4692cc_threshold(logit=+6, thr=0.7685)120.37842.46301.48590.9770121.00003770.0000
10large_inputs_nisb__w256_1cube_20261003_141051.step500000.cc_thresholdartifacts (missing)checkpoint0.4654cc_threshold(logit=+7, thr=0.8022)119.39782.60831.51221.096183.00003155.0000
11large_inputs_nisb__w512_3cube_20261003_141341.step400000.cc_thresholdartifacts (missing)checkpoint0.4605cc_threshold(logit=+9, thr=0.8581)118.16302.58871.55111.0376122.00004213.0000
12large_inputs_nisb__w256_1cube_20261003_141051.step400000.cc_thresholdartifacts (missing)checkpoint0.4511cc_threshold(logit=+6, thr=0.7685)115.74322.53331.50111.0321117.00002982.0000
13ds__1cube_subpixel_20260822_001229.step100000.cc_thresholdartifactscheckpoint0.4421cc_threshold(logit=+6, thr=0.7685)113.44102.83301.63731.195792.00004443.0000
14large_inputs_nisb__w256_5cube_20261003_141051.step400000.cc_thresholdartifacts (missing)checkpoint0.4420cc_threshold(logit=+6, thr=0.7685)113.40452.40241.47700.9254166.00002764.0000
15large_inputs_nisb__w512_3cube_20261003_141341.step500000.cc_thresholdartifacts (missing)checkpoint0.4353cc_threshold(logit=+9, thr=0.8581)111.69462.59301.54551.0475170.00004453.0000
16large_inputs_nisb__w256_1cube_20261003_141051.step300000.cc_thresholdartifacts (missing)checkpoint0.4293cc_threshold(logit=+7, thr=0.8022)110.15612.90411.62241.2817102.00003553.0000
17large_inputs_nisb__w256_5cube_20261003_141051.step300000.cc_thresholdartifacts (missing)checkpoint0.4092cc_threshold(logit=+6, thr=0.7685)104.99562.44171.52060.9210219.00003080.0000
18large_inputs_nisb__w256_3cube_20261003_141055.step500000.cc_thresholdartifacts (missing)checkpoint0.4003cc_threshold(logit=+6, thr=0.7685)102.70662.51331.53750.9758209.00003413.0000
19large_inputs_nisb__w512_1cube_20261003_141329.step100000.cc_thresholdartifacts (missing)checkpoint0.3946cc_threshold(logit=+8, thr=0.8320)101.23802.72831.63201.0963186.00005963.0000
20large_inputs_nisb__w256_1cube_20261003_141051.step200000.cc_thresholdartifacts (missing)checkpoint0.3730cc_threshold(logit=+6, thr=0.7685)95.69572.92941.63211.2973170.00003147.0000
21large_inputs_nisb__w256_3cube_20261003_141055.step400000.cc_thresholdartifacts (missing)checkpoint0.3720cc_threshold(logit=+7, thr=0.8022)95.44443.37021.81551.554797.00005038.0000
22large_inputs_nisb__w256_5cube_20261003_141051.step200000.cc_thresholdartifacts (missing)checkpoint0.3673cc_threshold(logit=+6, thr=0.7685)94.24053.09491.71171.3833161.00003594.0000
23large_inputs_nisb__w256_3cube_20261003_141055.step300000.cc_thresholdartifacts (missing)checkpoint0.3005cc_threshold(logit=+7, thr=0.8022)77.10893.71711.97541.7417158.00005788.0000
24large_inputs_nisb__w256_1cube_20261003_141051.step100000.cc_thresholdartifacts (missing)checkpoint0.2910cc_threshold(logit=+7, thr=0.8022)74.67483.90921.97081.9383135.00005186.0000
25large_inputs_nisb__w512_1cube_20261003_141329.step200000.cc_thresholdartifacts (missing)checkpoint0.2857cc_threshold(logit=+9, thr=0.8581)73.30523.06461.79401.2706366.00008088.0000
26large_inputs_nisb__w256_5cube_20261003_141051.step100000.cc_thresholdartifacts (missing)checkpoint0.2816cc_threshold(logit=+7, thr=0.8022)72.24854.02192.06391.9580132.00005649.0000
27large_inputs_nisb__w512_1cube_20261003_141329.step300000.cc_thresholdartifacts (missing)checkpoint0.2635cc_threshold(logit=+10, thr=0.8808)67.60674.00092.04691.9540222.000011209.0000
28large_inputs_nisb__w512_1cube_20261003_141329.step500000.cc_thresholdartifacts (missing)checkpoint0.2521cc_threshold(logit=+11, thr=0.9002)64.67714.15902.34131.8177228.000019999.0000
29large_inputs_nisb__w512_1cube_20261003_141329.step400000.cc_thresholdartifacts (missing)checkpoint0.2440cc_threshold(logit=+10, thr=0.8808)62.61023.14041.80151.3389464.00008427.0000
30large_inputs_nisb__w256_3cube_20261003_141055.step200000.cc_thresholdartifacts (missing)checkpoint0.2400cc_threshold(logit=+6, thr=0.7685)61.58063.86212.10611.7560252.00006565.0000
31large_inputs_nisb__w256_3cube_20261003_141055.step100000.cc_thresholdartifacts (missing)checkpoint0.0584cc_threshold(logit=+6, thr=0.7685)14.98396.68373.08973.5940272.000012181.0000
32ds__1cube_subpixel_20260822_001229.step100000.mws_blockwiseartifactscheckpoint0.0099mws_blockwise(repulsive_stride=1, block=[512, 512, 256])2.53682.19122.08820.10304630.000035886.0000
33large_inputs_nisb__w256_1cube_20261003_141051.step100000.mws_blockwiseartifacts (missing)checkpoint0.0069mws_blockwise(repulsive_stride=1, block=[512, 512, 256])1.76002.21472.05910.15565541.000037546.0000
34large_inputs_nisb__w512_1cube_20261003_141329.step100000.mws_blockwiseartifacts (missing)checkpoint0.0063mws_blockwise(repulsive_stride=1, block=[512, 512, 256])1.61431.98801.84500.14304316.000029873.0000
35large_inputs_nisb__w256_1cube_20261003_141051.step100000.mws_blockwise_1024artifacts (missing)checkpoint0.0035mws_blockwise(repulsive_stride=1, block=[1024, 1024, 1350])0.90171.75111.61300.13805182.000033771.0000
36large_inputs_nisb__w512_1cube_20261003_141329.step100000.mws_blockwise_1024artifacts (missing)checkpoint0.0028mws_blockwise(repulsive_stride=1, block=[1024, 1024, 1350])0.70731.54091.40250.13854046.000026030.0000
↑ nerl
Normalised expected run length: ERL along the traced skeletons divided by the maximum possible.
↑ erl_um
Expected run length in micrometres.
↓ voi_sum
voi_split + voi_merge.
↓ voi_split
Variation of information on the skeleton nodes, split term H(prediction | truth): over-segmentation.
↓ voi_merge
Variation of information on the skeleton nodes, merge term H(truth | prediction): under-segmentation.
↓ n_non0_mergers
Number of (merging segment, skeleton) pairs where one segment spans several skeletons.
↓ n_splits
Number of skeleton edges the segmentation cuts.

zebrafinch_neurite_tracing

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • zebrafinch_benchmark_test 5300x9300x9700
#modellinksskeleton_erl.nerl (higher is better)postprocessskeleton_erl.erl_umskeleton_erl.voi_sumskeleton_erl.voi_splitskeleton_erl.voi_mergeskeleton_erl.n_non0_mergersskeleton_erl.n_splits
1ffn_januszewski2018.identityartifacts0.0696Identity16.74712.25581.06791.18793064.00006472.0000
↑ nerl
Normalised expected run length: ERL along the traced skeletons divided by the maximum possible.
↑ erl_um
Expected run length in micrometres.
↓ voi_sum
voi_split + voi_merge.
↓ voi_split
Variation of information on the skeleton nodes, split term H(prediction | truth): over-segmentation.
↓ voi_merge
Variation of information on the skeleton nodes, merge term H(truth | prediction): under-segmentation.
↓ n_non0_mergers
Number of (merging segment, skeleton) pairs where one segment spans several skeletons.
↓ n_splits
Number of skeleton edges the segmentation cuts.

zebrafinch_neurite_tracing_11um

The artifact/checkpoint/view links below point to locations on the Janelia cluster and will only work on the Janelia network.

Views: neuroglancer views for every row below

Region:
  • zebrafinch_11um_test 540x1200x1200
#modellinksskeleton_erl.nerl (higher is better)postprocessskeleton_erl.erl_umskeleton_erl.voi_sumskeleton_erl.voi_splitskeleton_erl.voi_mergeskeleton_erl.n_non0_mergersskeleton_erl.n_splits
1lmd2__2f_affinity_unetr_simmim_lvd_20261020_200659.step100000.identity_8nmartifactscheckpoint0.7860Identity14.08080.25330.15100.102321.000062.0000
2lmd2__2g_affinity_unetr_simmim_scratch_20261020_124554.step100000.identity_8nmartifactscheckpoint0.7791Identity13.95730.26410.16180.102321.000055.0000
3lmd2__2a_affinity_unetr_lvd_20261018_215936.step100000.identity_8nmartifactscheckpoint0.7784Identity13.94400.27380.17150.102421.000055.0000
4lmd2__2h_affinity_unetr_simmim_lvd_mask60_g2_20261021_071125.step100000.identity_8nmartifactscheckpoint0.7742Identity13.86920.29090.18870.102221.000070.0000
5ffn_januszewski2018.identityartifacts0.7585Identity13.58760.40190.22370.178321.000018.0000
6lmd2__2b_affinity_unetr_scratch_20261018_215937.step100000.identity_8nmartifactscheckpoint0.7432Identity13.31350.33540.23300.102421.000062.0000
7lmd2__2f_affinity_unetr_simmim_lvd_20261020_200659.step100000.mws_blockwiseartifactscheckpoint0.6030mws_blockwise(repulsive_stride=1, block=[1024, 2048, 2048])10.80160.81170.73850.073219.0000176.0000
8lmd2__2a_affinity_unetr_lvd_20261018_215936.step100000.mws_blockwiseartifactscheckpoint0.5508mws_blockwise(repulsive_stride=1, block=[1024, 2048, 2048])9.86731.08901.03100.058019.0000243.0000
9lmd2__2h_affinity_unetr_simmim_lvd_mask60_g2_20261021_071125.step100000.mws_blockwiseartifactscheckpoint0.5431mws_blockwise(repulsive_stride=1, block=[1024, 2048, 2048])9.72861.07541.00900.066419.0000242.0000
10lmd2__2e_mtlsd_unetr_lvd_w10_20261019_004951.step100000.identity_8nmartifactscheckpoint0.4721Identity8.45661.20441.13610.068323.0000232.0000
11lmd2__2g_affinity_unetr_simmim_scratch_20261020_124554.step100000.mws_blockwiseartifactscheckpoint0.4621mws_blockwise(repulsive_stride=1, block=[1024, 2048, 2048])8.27901.49021.43490.055421.0000360.0000
12lmd2__2b_affinity_unetr_scratch_20261018_215937.step100000.mws_blockwiseartifactscheckpoint0.4150mws_blockwise(repulsive_stride=1, block=[1024, 2048, 2048])7.43471.85911.80680.052319.0000462.0000
13lmd2__2e_mtlsd_unetr_lvd_w10_20261019_004951.step100000.mws_blockwiseartifactscheckpoint0.2368mws_blockwise(repulsive_stride=1, block=[1024, 2048, 2048])4.24172.63492.60060.034216.0000791.0000
14lmd2__2d_sam_musam128_lvd_20261018_231122.step100000.identityartifactscheckpoint0.1715Identity3.07293.59920.97342.625845.00009.0000
15lmd2__2c_mtlsd_unetr_lvd_20261018_215102.step100000.identity_8nmartifactscheckpoint0.1465Identity2.62393.45073.41230.038417.0000987.0000
16lmd2__2d_sam_musam128_lvd_20261018_231122.step100000.identity_8nmartifactscheckpoint0.0587Identity1.05083.91270.58223.330552.00009.0000
17lmd2__2c_mtlsd_unetr_lvd_20261018_215102.step100000.mws_blockwiseartifactscheckpoint0.0347mws_blockwise(repulsive_stride=1, block=[1024, 2048, 2048])0.62225.09785.09190.006014.00001984.0000
↑ nerl
Normalised expected run length: ERL along the traced skeletons divided by the maximum possible.
↑ erl_um
Expected run length in micrometres.
↓ voi_sum
voi_split + voi_merge.
↓ voi_split
Variation of information on the skeleton nodes, split term H(prediction | truth): over-segmentation.
↓ voi_merge
Variation of information on the skeleton nodes, merge term H(truth | prediction): under-segmentation.
↓ n_non0_mergers
Number of (merging segment, skeleton) pairs where one segment spans several skeletons.
↓ n_splits
Number of skeleton edges the segmentation cuts.

Generated from the records under leaderboard/ by mia-evals leaderboard, from the same tables as each task's README.md.