Deqing Fu PRO
deqing
AI & ML interests
None yet
Recent Activity
updated a model 12 days ago
deqing/convergent-llama-300M-muon-6digit-addition_6digit_custom6 upvoted a paper 14 days ago
Value-Aware Stochastic KV Cache Eviction for Reasoning Models submitted a paper 14 days ago
Value-Aware Stochastic KV Cache Eviction for Reasoning ModelsOrganizations
Convergent Evolution (Addition)
-
deqing/convergent-llama-300M-muon-addition_3digit
Text Generation • 0.3B • Updated • 4 -
deqing/convergent-llama-300M-muon-addition_3digit_seed123
0.3B • Updated • 2 -
deqing/convergent-llama-300M-muon-addition
Text Generation • 0.3B • Updated • 4 -
deqing/convergent-llama-300M-adamw-addition_3digit
Text Generation • 0.3B • Updated • 4
Convergent Evolution (Data)
-
deqing/convergent-llama-300M-muon-original
Text Generation • 0.3B • Updated • 67 -
deqing/convergent-llama-300M-muon-unigram
Text Generation • 0.3B • Updated • 13 -
deqing/convergent-llama-300M-muon-isolate-1
Text Generation • 0.3B • Updated • 10 -
deqing/convergent-llama-300M-muon-swap_numbers
Text Generation • 0.3B • Updated • 5
Convergent Evolution
Convergent Evolution (Architecture and Optimizer)
-
deqing/convergent-llama-300M-muon-original
Text Generation • 0.3B • Updated • 67 -
deqing/convergent-gdn-300M-muon-original
Text Generation • 0.3B • Updated • 42 -
deqing/convergent-mamba2-300M-muon-original
Text Generation • 0.3B • Updated • 23 -
deqing/convergent-lstm-4layer-muon-original
Text Generation • 0.2B • Updated • 4
Fourier Language Model
Convergent Evolution
Convergent Evolution (Addition)
-
deqing/convergent-llama-300M-muon-addition_3digit
Text Generation • 0.3B • Updated • 4 -
deqing/convergent-llama-300M-muon-addition_3digit_seed123
0.3B • Updated • 2 -
deqing/convergent-llama-300M-muon-addition
Text Generation • 0.3B • Updated • 4 -
deqing/convergent-llama-300M-adamw-addition_3digit
Text Generation • 0.3B • Updated • 4
Convergent Evolution (Architecture and Optimizer)
-
deqing/convergent-llama-300M-muon-original
Text Generation • 0.3B • Updated • 67 -
deqing/convergent-gdn-300M-muon-original
Text Generation • 0.3B • Updated • 42 -
deqing/convergent-mamba2-300M-muon-original
Text Generation • 0.3B • Updated • 23 -
deqing/convergent-lstm-4layer-muon-original
Text Generation • 0.2B • Updated • 4
Convergent Evolution (Data)
-
deqing/convergent-llama-300M-muon-original
Text Generation • 0.3B • Updated • 67 -
deqing/convergent-llama-300M-muon-unigram
Text Generation • 0.3B • Updated • 13 -
deqing/convergent-llama-300M-muon-isolate-1
Text Generation • 0.3B • Updated • 10 -
deqing/convergent-llama-300M-muon-swap_numbers
Text Generation • 0.3B • Updated • 5