Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
Paper
•
2408.04093
•
Published
•
4
Quentin Anthony
qanthony
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
23 days ago
Compressed Convolutional Attention: Efficient Attention in a Compressed
Latent Space
liked
a model
9 months ago
Zyphra/Zonos-v0.1-hybrid
liked
a model
9 months ago
Zyphra/Zonos-v0.1-transformer
Organizations
authored
a
paper
about 1 year ago
authored
4
papers
over 1 year ago
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Paper
•
2404.05892
•
Published
•
39
Zyda: A 1.3T Dataset for Open Language Modeling
Paper
•
2406.01981
•
Published
•
4
Comparative Study of Large Language Model Architectures on Frontier
Paper
•
2402.00691
•
Published
Simple and Scalable Strategies to Continually Pre-train Large Language Models
Paper
•
2403.08763
•
Published
•
51
authored
a
paper
over 2 years ago