StoryNote logo

/r/LocalLLaMA

Incredible Florence2 + SAM2 demo on HF

26 upvotes • Barry_Jumps
Mark as read:
Add to a list

For Gemma-2-2b, You can Extend the Windows Context to 32K+

26 upvotes • Iory1998
Mark as read:
Add to a list

I run Gemma2 2b on a free OCI ARM VM with 24GB ram in CPU only mode and I’m impressed

24 upvotes • TheProtector0034
Mark as read:
Add to a list

Did Kyutai ever released their models as promised?

24 upvotes • keepthepace
Mark as read:
Add to a list

Automatic P40 power management with nvidia-pstated

23 upvotes • No-Statement-0001
Mark as read:
Add to a list

Large language model inference optimizations on AMD GPUs

21 upvotes • FoxInTheRedBox
Mark as read:
Add to a list

27-35B vs 70-72B models in RP

21 upvotes • Tough-Aioli-1685
Mark as read:
Add to a list

Tool to create synthetic datasets using PDF files!

21 upvotes • SuccessIsHardWork
Mark as read:
Add to a list

I’ve got a MBP with 128 GB of VRAM. What would you run to draft, revise, etc, non-fiction/business documents?

21 upvotes • Hinged31
Mark as read:
Add to a list

Snapdragon G3 NPU prompt ingestion @ >1000 t/s for 1.5B W8A8

20 upvotes • Aaaaaaaaaeeeee
Mark as read:
Add to a list
« < > »
Page of 68

StoryNote©

About Contact Terms Privacy Cookie

Reddit is a registered trademark of Reddit, Inc. Use of this trademark on our website does not imply any affiliation with or endorsement by Reddit, Inc.