/r/LocalLLaMA

Year:

Only show posts with narrations

Big Tech Fails to Convince Wall Street That AI Is Paying Off

274 upvotes • itsmekalisyn

Mark as read: Add to a list

PyTorch just released their own llm solution - torchchat

274 upvotes • Vegetable_Sun_9225

Mark as read: Add to a list

Why is nobody taking about InternLM 2.5 20B?

270 upvotes • Tobiaseins

Mark as read: Add to a list

Gemmasutra Mini 2B v1 by TheDrummer - The best model under 7B! A model that packs an unbelievable punch. NSFW

269 upvotes • TheLocalDrummer

Mark as read: Add to a list

How are you earning money using LLM?

261 upvotes • chatsgpt

Mark as read: Add to a list

Quantize 123B Mistral-Large-Instruct-2407 to 35 GB with only 4% accuracy degeneration.

259 upvotes • RelationshipWeekly78

Mark as read: Add to a list

Rate my new Janky setup + what does one do with 96GB ram + 96GB VRAM to automate yhe business?

258 upvotes • ChobPT

Mark as read: Add to a list

Altman threatening OpenAI ex employees to void their shares if bad PR appears. Is this a joke?

253 upvotes • selmano

Mark as read: Add to a list

Microsoft launches Hugging Face competitor (wait-list signup)

248 upvotes • pfffffftttfftt

Mark as read: Add to a list

The software-pain of running local LLM finally got to me - so I made my own inferencing server that you don't need to compile or update anytime a new model/tokenizer drops; you don't need to quantize or even download your LLMs - just give it a name & run LLMs the moment they're posted on HuggingFace

219 upvotes • AbheekG

Mark as read: Add to a list

Title	Upvotes	Author	Mark as read	Favorited	Rating	Add to a list
Big Tech Fails to Convince Wall Street That AI Is Paying Off	274	itsmekalisyn
PyTorch just released their own llm solution - torchchat	274	Vegetable_Sun_9225
Why is nobody taking about InternLM 2.5 20B?	270	Tobiaseins
Gemmasutra Mini 2B v1 by TheDrummer - The best model under 7B! A model that packs an unbelievable punch. NSFW	269	TheLocalDrummer
How are you earning money using LLM?	261	chatsgpt
Quantize 123B Mistral-Large-Instruct-2407 to 35 GB with only 4% accuracy degeneration.	259	RelationshipWeekly78
Rate my new Janky setup + what does one do with 96GB ram + 96GB VRAM to automate yhe business?	258	ChobPT
Altman threatening OpenAI ex employees to void their shares if bad PR appears. Is this a joke?	253	selmano
Microsoft launches Hugging Face competitor (wait-list signup)	248	pfffffftttfftt
The software-pain of running local LLM finally got to me - so I made my own inferencing server that you don't need to compile or update anytime a new model/tokenizer drops; you don't need to quantize or even download your LLMs - just give it a name & run LLMs the moment they're posted on HuggingFace	219	AbheekG