I'm curious if it's possible to run llama-3.1-405b-4bit on tesla K80?

by /u/Dr_Karminski in /r/LocalLLaMA

Upvotes: 1

Favorite this post:

Mark as read:

Your rating:

Add this post to a custom list