Javed Alam PRO

Javedalam

AI & ML interests

Ai user, tester, and developer of open source ai based applications.

Recent Activity

reacted to OzTianlu's post with 🔥 about 2 hours ago
🔥 Just dropped a new reasoning-optimized model on Hugging Face: Kai-0.35B-Instruct (Q8_0 GGUF also live)! https://huggingface.co/NoesisLab/Kai-0.35B-Instruct-Q8_0-GGUF At just 360M parameters, this is a hardcore exploration into pushing the limits of extreme micro-models, powered by our new ADS (Adaptive Distillation Search) technique. But here is the most radical part: I explicitly stripped out the <think> tags and completely killed the think block. The current trend of LLMs generating pages of verbose Chain of Thought (CoT) just to "show their work" is exhausting. Efficient reasoning shouldn't require endless rambling. Thanks to the deep distillation of ADS, Kai-0.35B bypasses those bloated intermediate states. It doesn't write essays to solve a problem—it just gives you the precise, concise, and direct answers you actually want. 📊 Punching Above Its Weight Class: Despite its tiny footprint, ADS allows Kai-0.35B to consistently beat models 3x its size (like TinyLlama 1.1B) across core reasoning and code tasks: 🧠 ARC-Challenge: 37.80% (Crushing TinyLlama 1.1B's ~30.1% and Mamba 370M) 💡 PIQA: 71.82% (With 1/3 the params, it trails the 1B-class Llama-3.2 by less than 3pp) 💻 MBPP (pass@1): 22.20% (Outperforming TinyLlama 1.1B in code generation) If you're tired of scrolling through 500-token CoT monologues and want a lightning-fast, highly capable micro-model for edge deployment, give it a spin! 🔗 Weights & GGUF here: https://huggingface.co/NoesisLab/Kai-0.35B-Instruct-Q8_0-GGUF #NoesisLab #SmallLanguageModels #HuggingFace #MachineLearning #LLM #GGUF
liked a model about 2 hours ago
NoesisLab/Kai-0.35B-Instruct-Q8_0-GGUF
View all activity

Organizations

Blog-explorers's profile picture ONNX Community's profile picture Hugging Face Discord Community's profile picture LiteRT Community (FKA TFLite)'s profile picture nanochat students's profile picture