Quantize 123B Mistral-Large-Instruct-2407 to 35 GB with only 4% accuracy degeneration.

by /u/Educational_Ice151 in /r/aipromptprogramming

Upvotes: 1

Favorite this post:

Mark as read:

Your rating:

Add this post to a custom list