How much ram is used when the 128k context length is filled on Llama 3.1 8b?

by /u/Rectangularbox23 in /r/LocalLLaMA

Upvotes: 39

Favorite this post:

Mark as read:

Your rating:

Add this post to a custom list