IMU-1: Sample-Efficient Pre-training of Small Language Models
Paper • 2602.02522 • Published • 7
Urro PRO
urroxyz
AI & ML interests
computational linguistics major 🤖🔎🔠i am autistic. if i come off rude, i probably didn't mean to. please feel free to ask me for clarification.
Recent Activity
updated a collection about 10 hours ago
WTF GENIUS PAPERS commentedon a paper 2 days ago
Embarrassingly Simple Self-Distillation Improves Code Generation updated a collection 3 days ago
WTF GENIUS PAPERSOrganizations
upvoted a paper 3 days ago
upvoted 4
papers 5 days ago
COSMOS: Predictable and Cost-Effective Adaptation of LLMs
Paper • 2505.01449 • Published • 4
SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models
Paper • 2403.07384 • Published • 3
Less is More: Improving LLM Alignment via Preference Data Selection
Paper • 2502.14560 • Published • 1
What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning
Paper • 2312.15685 • Published • 17
upvoted 2
papers 6 days ago
upvoted 2
collections 7 days ago
upvoted a changelog 8 days ago
Hugging Face Changelog
Storage Buckets for Spaces
• 109
upvoted 9
papers 14 days ago
A Neuroscience-Inspired Dual-Process Model of Compositional Generalization
Paper • 2507.18868 • Published • 1
LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers
Paper • 2310.15164 • Published • 4
JEPA-Reasoner: Decoupling Latent Reasoning from Token Generation
Paper • 2512.19171 • Published • 2
Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformers
Paper • 2210.11265 • Published • 1
The Dual-Stream Transformer: Channelized Architecture for Interpretable Language Modeling
Paper • 2603.07461 • Published • 1
Interpretable-by-Design Transformers via Architectural Stream Independence
Paper • 2603.07482 • Published • 1
Mixture of Cognitive Reasoners: Modular Reasoning with Brain-Like Specialization
Paper • 2506.13331 • Published • 1
When Less Language is More: Language-Reasoning Disentanglement Makes LLMs Better Multilingual Reasoners
Paper • 2505.15257 • Published • 1
Are formal and functional linguistic mechanisms dissociated in language models?
Paper • 2503.11302 • Published • 1
upvoted a paper 15 days ago