/r/LocalLLaMA

Year:

Only show posts with narrations

My First attempt at LLM local chat web app- Looking for feedback

7 upvotes • Inevitable-Pie-8294

Mark as read: Add to a list

Spiking in LLM, looking ahead to the future

6 upvotes • CoqueTornado

Mark as read: Add to a list

LLM-speed-benchmark, easy to use tool to directly measure performance of models through their API

6 upvotes • coder543

Mark as read: Add to a list

Has anyone gotten Gemma Scope running locally?

6 upvotes • Mescallan

Mark as read: Add to a list

Build a custom smart assistant on NVIDIA Jetson through ollama and anything LLM

6 upvotes • Sea-Reality8725

Mark as read: Add to a list

Did something break? Horrible Training Performance in Last Couple Days, even with configs that worked before...

6 upvotes • Heralax_Tekran

Mark as read: Add to a list

Beyond Self-Attention: Seeking Ways to Attend to Non-Technical Audiences

6 upvotes • peace-of-me

Mark as read: Add to a list

Is there any way to run OpenGVLab/InternVL2-Llama3-76B-AWQ on cpu only

6 upvotes • Elemental_Ray

Mark as read: Add to a list

Thoughts on the Nvidia A16?

6 upvotes • jarblewc

Mark as read: Add to a list

Best LLMs for RP and creative writing?

6 upvotes • Educational_Grab_473

Mark as read: Add to a list

Title	Upvotes	Author	Mark as read	Favorited	Rating	Add to a list
My First attempt at LLM local chat web app- Looking for feedback	7	Inevitable-Pie-8294
Spiking in LLM, looking ahead to the future	6	CoqueTornado
LLM-speed-benchmark, easy to use tool to directly measure performance of models through their API	6	coder543
Has anyone gotten Gemma Scope running locally?	6	Mescallan
Build a custom smart assistant on NVIDIA Jetson through ollama and anything LLM	6	Sea-Reality8725
Did something break? Horrible Training Performance in Last Couple Days, even with configs that worked before...	6	Heralax_Tekran
Beyond Self-Attention: Seeking Ways to Attend to Non-Technical Audiences	6	peace-of-me
Is there any way to run OpenGVLab/InternVL2-Llama3-76B-AWQ on cpu only	6	Elemental_Ray
Thoughts on the Nvidia A16?	6	jarblewc
Best LLMs for RP and creative writing?	6	Educational_Grab_473