zxcvb6958 commited on
Commit
a3792df
·
1 Parent(s): c2c803b

Add pt_neurostorm_mae_5ds: NeuroSTORM MAE pretrained on 5 datasets

Browse files

Pretrained checkpoint for NeuroSTORM with masked autoencoder objective
on 5 fMRI datasets (HCP1200, HCPA, HCPD, ABCD, UKB) using hard_random
reweighting (topk=100 subjects/dataset/epoch).

- Architecture: 4D Swin Transformer + Mamba (embed_dim=36, depths=[2,2,6,2])
- MAE settings: spatial_mask=window, time_mask=random, mask_ratio=0.5
- Trained 20 epochs, best epoch 18, valid_loss=0.50, test_loss=0.46
- Split: 8/1/1 train/val/test

pretraining/pt_neurostorm_mae_5ds.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de3cbda81064bd2f72641b393d0940a599e6d17307cbb4a8ae195a7ea5a568e2
3
+ size 93061240