Snapdragon G3 NPU prompt ingestion @ >1000 t/s for 1.5B W8A8

by /u/Aaaaaaaaaeeeee in /r/LocalLLaMA

Upvotes: 20

Favorite this post:

Mark as read:

Your rating:

Add this post to a custom list