Pretraining Context Compressor for Large Language Models with Embedding-Based Memory
Yuhong Dai
BroAlanTaps
AI & ML interests
CV(2D-Object Detection), NLP(Infer Accelerate)
Recent Activity
upvoted a paper 3 days ago
GEditBench v2: A Human-Aligned Benchmark for General Image Editing upvoted a paper 11 days ago
PEARL: Personalized Streaming Video Understanding Model commentedon a paper 14 days ago
Proact-VL: A Proactive VideoLLM for Real-Time AI CompanionsOrganizations
None yet
models 68
BroAlanTaps/Stage2-PCC-Large-16x
Updated
BroAlanTaps/Stage2-PCC-Large-128x
Updated
BroAlanTaps/Stage2-PCC-Large-4x
Updated
BroAlanTaps/PCC-Large-Encoder-Llama3-8B-Instruct
8B • Updated • 1
BroAlanTaps/Stage1-PCC-Large-128x
Updated
BroAlanTaps/Stage2-PCC-Lite-256x
0.8B • Updated
BroAlanTaps/Stage2-PCC-Lite-128x
0.8B • Updated • 2
BroAlanTaps/Stage2-PCC-Lite-64x
0.8B • Updated
BroAlanTaps/Stage2-PCC-Lite-16x
0.8B • Updated • 3
BroAlanTaps/Stage2-PCC-Lite-4x
0.8B • Updated
datasets 8
BroAlanTaps/WebVR
Viewer • Updated • 1.51k • 1.3k • 1
BroAlanTaps/Warmup-GPT2-Large-Llama3-8B-Redpajama
Viewer • Updated • 1.55M • 45 • 1
BroAlanTaps/pretrain-corpus-test
Viewer • Updated • 576 • 21
BroAlanTaps/GPT2-Large-Llama3-8B-fineweb-256-5Btokens
Viewer • Updated • 19.2M • 86 • 1
BroAlanTaps/efficiency_samples_8k
Viewer • Updated • 1k • 8
BroAlanTaps/Stage2-PCC-Large-SFT-Squad
Viewer • Updated • 92.7k • 16
BroAlanTaps/Stage2-PCC-SFT-HotpotQA
Viewer • Updated • 90.4k • 53
BroAlanTaps/Stage2-PCC-Lite-SFT-Squad
Viewer • Updated • 92.7k • 99