MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models
Paper
•
2508.17467
•
Published
Krishna Teja Chitty-Venkata
krishnateja95
AI & ML interests
LLM Optimization, Neural Architecture Search, Quantization, Pruning
Recent Activity
updated
a model
4 days ago
nm-testing/granite-4.0-h-small-FP8-block
updated
a model
4 days ago
nm-testing/granite-4.0-h-small-FP8-block
updated
a model
4 days ago
nm-testing/granite-4.0-h-small-FP8-block
Organizations
authored
4
papers
20 days ago
PagedEviction: Structured Block-wise KV Cache Pruning for Efficient Large Language Model Inference
Paper
•
2509.04377
•
Published
LExI: Layer-Adaptive Active Experts for Efficient MoE Model Inference
Paper
•
2509.02753
•
Published
ImageNet-Think-250K: A Large-Scale Synthetic Dataset for Multimodal Reasoning for Vision Language Models
Paper
•
2510.01582
•
Published
authored
a
paper
about 1 year ago