Conference
The Impact of Hyperparameters on Large Language Model Inference Performance: An Evaluation of vLLM and HuggingFace Pipelines
| Τίτλος: | The Impact of Hyperparameters on Large Language Model Inference Performance: An Evaluation of vLLM and HuggingFace Pipelines |
|---|---|
| Συγγραφείς: | Martinez, Matias |
| Πηγή: | Proceedings of the 33rd ACM International Conference on the Foundations of Software Engineering. :1672-1678 |
| Διαθεσιμότητα: | http://dl.acm.org/doi/10.1145/3696630.3728704 |
| Βάση Δεδομένων: | ACM Full-Text Collection |
| DOI: | 10.1145/3696630.3728704 |
|---|