Svelte Hacker News logo
  • top
  • new
  • show
  • ask
  • jobs
  • about

Efficient Memory Management for Large Language Model Serving with PagedAttention

arxiv.org

1 points by sonabinu 7 hours ago