Meaning of "K" and "M" in models name: "llama3.1:70b-instruct-q5_K_M"

by /u/mnatmnatmant in /r/LocalLLaMA

Upvotes: 1

Favorite this post:

Mark as read:

Your rating:

Add this post to a custom list