Could model pruning (like for the 405b) be guided by the perplexity value in quantizing?

by /u/I_can_see_threw_time in /r/LocalLLaMA

Upvotes: 3

Favorite this post:

Mark as read:

Your rating:

Add this post to a custom list