Efficient LLMs · 2025
Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decoding
ICML 2025 · International Conference on Machine Learning (ICML)
Links
BibTeX
@inproceedings{yazdanbakhsh2025learning,
title = {{Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decoding}},
author = {Yazdanbakhsh, Amir and others},
booktitle = {International Conference on Machine Learning (ICML)},
year = {2025}
}