OpenRaiser/fwe_transformer_340m_soap_pdim2048_pfreq10_lr3e_3_b1_0_9_b2_0_95_eps_1e_15
0.4B • Updated
OpenRaiser
community
AI & ML interests
None defined yet.
Recent Activity
OpenRaiser/fwe_transformer_1b_soap_pdim2048_pfreq10_lr3e_3_b1_0_9_b2_0_95_eps_1e_15
1B • Updated
OpenRaiser/fwe_transformer_340m_conda_scale0_25_rank256_gap2000_lr1e_2_b1_0_9_b2_0_99_eps_1e_12
0.4B • Updated
OpenRaiser/fwe_transformer_340m_lion_lr3e_4_b1_0_9_b2_0_99
0.4B • Updated
OpenRaiser/fwe_transformer_340m_mars_lion_lr2e_4_b1_0_9_b2_0_98_eps_1e_12
0.4B • Updated
OpenRaiser/fwe_transformer_340m_mars_shampoo_lr1e_2_b1_0_95_b2_0_99_eps_1e_12
0.4B • Updated
OpenRaiser/fwe_transformer_340m_marsadamw_lr3e_3_b1_0_95_b2_0_99_eps_1e_8
0.4B • Updated
OpenRaiser/fwe_transformer_340m_muon_lr5e_3_b1_0_9_b2_0_95_eps_1e_15
0.4B • Updated
OpenRaiser/fwe_transformer_340m_rmnp_lr3e_3_adamlr1e_3_b1_0_9_b2_0_99_eps_1e_15
0.4B • Updated
OpenRaiser/fwe_transformer_1b_rmnp_lr3e_3_adamlr1e_3_b1_0_9_b2_0_99_eps_1e_15
1B • Updated
OpenRaiser/fwe_transformer_1b_muon_lr3e_3_b1_0_9_b2_0_95_eps_1e_15
1B • Updated
OpenRaiser/fwe_transformer_340m_adan_lr3e_3_b1_0_9_b2_0_92_b3_0_99_eps_1e_8
0.4B • Updated
OpenRaiser/fwe_transformer_340m_apollo_rank512_scale2_channel_std_gap200_lr3e_3_b1_0_9_b2_0_99_eps_1e_12
0.4B • Updated
OpenRaiser/fwe_transformer_340m_adamw_lr1e_3_b1_0_9_b2_0_99_eps_1e_15
0.4B • Updated
OpenRaiser/fwe_transformer_340m_adamp_lr1e_3_b1_0_9_b2_0_98_eps_1e_15
0.4B • Updated
OpenRaiser/fwe_transformer_1b_marsadamw_lr3e_3_b1_0_95_b2_0_99_eps_1e_8
1B • Updated
OpenRaiser/fwe_transformer_1b_mars_lion_lr1e_4_b1_0_9_b2_0_98_eps_1e_12
1B • Updated
OpenRaiser/fwe_transformer_1b_mars_shampoo_lr5e_3_b1_0_95_b2_0_99_eps_1e_12
1B • Updated
OpenRaiser/fwe_transformer_1b_lion_lr3e_4_b1_0_9_b2_0_99
1B • Updated
OpenRaiser/fwe_transformer_1b_conda_scale0_25_rank256_gap2000_lr5e_3_b1_0_9_b2_0_99_eps_1e_12
1B • Updated
OpenRaiser/fwe_transformer_1b_apollo_rank512_scale2_channel_std_gap200_lr3e_3_b1_0_9_b2_0_99_eps_1e_12
1B • Updated
OpenRaiser/fwe_transformer_1b_adan_lr3e_3_b1_0_9_b2_0_92_b3_0_99_eps_1e_8
1B • Updated
OpenRaiser/fwe_transformer_1b_adamw_lr1e_3_b1_0_9_b2_0_99_eps_1e_15
1B • Updated
OpenRaiser/fwe_transformer_1b_adamp_lr1e_3_b1_0_9_b2_0_98_eps_1e_15
1B • Updated
OpenRaiser/fwe_gla_340m_soap_pdim2048_pfreq10_lr3e_3_b1_0_9_b2_0_95_eps_1e_15
0.4B • Updated
OpenRaiser/fwe_gla_340m_muon_lr5e_3_b1_0_9_b2_0_95_eps_1e_15
0.4B • Updated
OpenRaiser/fwe_gla_340m_rmnp_lr3e_3_adamlr1e_3_b1_0_9_b2_0_99_eps_1e_15
0.4B • Updated
OpenRaiser/fwe_gla_340m_marsadamw_lr3e_3_b1_0_95_b2_0_99_eps_1e_8
0.4B • Updated
OpenRaiser/fwe_gla_340m_mars_shampoo_lr1e_2_b1_0_95_b2_0_99_eps_1e_12
0.4B • Updated
OpenRaiser/fwe_gla_340m_mars_lion_lr2e_4_b1_0_9_b2_0_98_eps_1e_12
0.4B • Updated