qwp4w3hyb/Meta-Llama-3.1-70B-Instruct-iMat-GGUF
Text Generation
•
71B
•
Updated
•
3.02k
•
8
Joseph Robert Turcotte PRO
Fishtiks
AI & ML interests
Roleplaying, lorabration, abliteration, smol models, extensive filtering, unusual datasets, home usage, HPCs for AI, distributed training/federated learning, and sentience.
AI should find and label AI hallucinations with GANs so we can give them context and use.
Recent Activity
liked
a model
about 5 hours ago
qwp4w3hyb/Meta-Llama-3.1-70B-Instruct-iMat-GGUF
upvoted
a
paper
about 16 hours ago
BM25S: Orders of magnitude faster lexical search via eager sparse
scoring
upvoted
a
paper
about 16 hours ago
Multi-Task GRPO: Reliable LLM Reasoning Across Tasks
Organizations
liked
a
model
about 5 hours ago
upvoted
4
papers
about 16 hours ago
BM25S: Orders of magnitude faster lexical search via eager sparse scoring
Paper
•
2407.03618
•
Published
•
14
Multi-Task GRPO: Reliable LLM Reasoning Across Tasks
Paper
•
2602.05547
•
Published
•
11
DASH: Faster Shampoo via Batched Block Preconditioning and Efficient Inverse-Root Solvers
Paper
•
2602.02016
•
Published
•
11
BABE: Biology Arena BEnchmark
Paper
•
2602.05857
•
Published
•
10
upvoted
a
collection
about 16 hours ago
liked
a
Space
about 16 hours ago
reacted to
mitkox's
post with 👍
about 16 hours ago
Post
3178
I just pushed Claude Code Agent Swarm with 20 coding agents on my desktop GPU workstation.
With local AI, I don’t have /fast CC switch, but I have /absurdlyfast:
- 100’499 tokens/second read, yeah 100k, not a typo | 811 tok/sec generation
- KV cache: 707’200 tokens
- Hardware: 5+ year old GPUs 4xA6K gen1; It’s not the car. It’s the driver.
Qwen3 Coder Next AWQ with cache at BF16. Scores 82.1% in C# on 29-years-in-dev codebase vs Opus 4.5 at only 57.5%. When your codebase predates Stack Overflow, you don't need the biggest model; you need the one that actually remembers Windows 95.
My current bottleneck is my 27" monitor. Can't fit all 20 Theos on screen without squinting.
With local AI, I don’t have /fast CC switch, but I have /absurdlyfast:
- 100’499 tokens/second read, yeah 100k, not a typo | 811 tok/sec generation
- KV cache: 707’200 tokens
- Hardware: 5+ year old GPUs 4xA6K gen1; It’s not the car. It’s the driver.
Qwen3 Coder Next AWQ with cache at BF16. Scores 82.1% in C# on 29-years-in-dev codebase vs Opus 4.5 at only 57.5%. When your codebase predates Stack Overflow, you don't need the biggest model; you need the one that actually remembers Windows 95.
My current bottleneck is my 27" monitor. Can't fit all 20 Theos on screen without squinting.
- 1 reply
upvoted
a
paper
about 16 hours ago
reacted to
MikeDoes's
post with 🔥🚀
about 16 hours ago
Post
1822
You don't need a massive research lab to build a privacy-preserving AI tool thanks to open datasets. With the right ingredients, anyone can.
A fantastic new guide shows how the democratization of AI is helping to advance safety. It walks through how to use Google's new fine-tuning API to turn Gemini into a powerful tool for PII anonymization.
This project was powered by two key components:
An accessible platform from Google.
High-quality, open-source training data.
We are honored that the author chose the Ai4Privacy pii-masking-200k dataset to provide the crucial data foundation. Our dataset delivered the volume and structure needed to successfully teach a state-of-the-art model how to perform a critical privacy function.
This is the future we're working towards: powerful platforms combined with open, safety-focused data to create tools that benefit everyone. Kudos to the author for showcasing what's possible!
🔗 Read the full step-by-step guide: https://www.analyticsvidhya.com/blog/2024/03/guide-to-fine-tuning-gemini-for-masking-pii-data/
🚀 Stay updated on the latest in privacy-preserving AI—follow us on LinkedIn: https://www.linkedin.com/company/ai4privacy/posts/
#AIforGood #DemocratizeAI #DataPrivacy #Anonymization #OpenSource #LLM #Ai4Privacy
A fantastic new guide shows how the democratization of AI is helping to advance safety. It walks through how to use Google's new fine-tuning API to turn Gemini into a powerful tool for PII anonymization.
This project was powered by two key components:
An accessible platform from Google.
High-quality, open-source training data.
We are honored that the author chose the Ai4Privacy pii-masking-200k dataset to provide the crucial data foundation. Our dataset delivered the volume and structure needed to successfully teach a state-of-the-art model how to perform a critical privacy function.
This is the future we're working towards: powerful platforms combined with open, safety-focused data to create tools that benefit everyone. Kudos to the author for showcasing what's possible!
🔗 Read the full step-by-step guide: https://www.analyticsvidhya.com/blog/2024/03/guide-to-fine-tuning-gemini-for-masking-pii-data/
🚀 Stay updated on the latest in privacy-preserving AI—follow us on LinkedIn: https://www.linkedin.com/company/ai4privacy/posts/
#AIforGood #DemocratizeAI #DataPrivacy #Anonymization #OpenSource #LLM #Ai4Privacy
- 1 reply
upvoted
a
paper
about 17 hours ago
commented
a
paper
about 17 hours ago
liked
a
model
about 17 hours ago
upvoted
a
paper
about 17 hours ago
reacted to
melvindave's
post with 🔥
about 17 hours ago
Post
1811
I made my own avatar banner maker
https://avatar.donvitocodes.com/
Using Claude Code and Opus 4.6 in a day
I use it in my HF profile too
https://avatar.donvitocodes.com/
Using Claude Code and Opus 4.6 in a day
I use it in my HF profile too
liked
2
Spaces
7 days ago
liked
2
models
7 days ago
