StoryNote logo

Probability outputs appear "quantized" using non-quantized model (but not with quantized model)

by /u/Due-Issue-4433 in /r/LocalLLaMA

Upvotes: 1

Favorite this post:
Mark as read:
Your rating:
Add this post to a custom list

StoryNote©

Reddit is a registered trademark of Reddit, Inc. Use of this trademark on our website does not imply any affiliation with or endorsement by Reddit, Inc.