Aqarion Finite Dynamical Systems
👁
2
Finite dynamical systems research
James Aqarion
Quantarion9
AI & ML interests
None yet
Recent Activity
updated a Space 1 day ago
Quantarion9/Aqarion new activity 3 days ago
Quantarion9/Aqarion:Create DR-ATLAS/ARTIFACT.TXT liked a Space 3 days ago
Aqarion/Phi-377-spectral-geometryOrganizations
None yet
updated a
Space 1 day ago
Create DR-ATLAS/ARTIFACT.TXT
#2 opened 3 days ago
by Quantarion9
liked a
Space 3 days ago
liked a
Space 4 days ago
updated a
Space 4 days ago
liked a
model 4 days ago
liked a
Space 4 days ago
reacted to sergiopaniego's post with 👍 4 days ago
Post
7507
Frontier models use distillation as a step of their post-training pipelines.
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL!
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL!
- 3 replies
liked a
model 4 days ago
updated a
bucket 4 days ago
published a
bucket 4 days ago
Create AQARION-ARTIFACTS/V22.TXT
#1 opened 4 days ago
by Quantarion9
liked a
model 7 days ago
Create CHANGELOG/AQARION/FORGOTTEN_FALLS-FLOW.TXT
#1 opened 7 days ago
by Quantarion9
liked a
model 7 days ago
liked a
Space 9 days ago
published a
Space 9 days ago
published a
bucket 9 days ago
published a
Space 9 days ago