/r/LocalLLaMA

Year:

Only show posts with narrations

What best I can run on my macbook m3 36gb ram ?

1 upvotes • Lessff4703

Mark as read: Add to a list

Is there a difference between knowledge graph-based RAG and GraphRAG?

1 upvotes • Jeff_1987

Mark as read: Add to a list

LM Studio Problem - Won't use more than half of RAM

1 upvotes • Thrumpwart

Mark as read: Add to a list

Want to have local TTS accompanying LLM, but seems the popular ones all use pickle, is that community just not caught up to safetensors yet?

1 upvotes • sweetsunnyside

Mark as read: Add to a list

What kind of contextual window is possible on locally run LLMs on iOS? Also, how slow can it be on iOS?

1 upvotes • dptgreg

Mark as read: Add to a list

2X3090 Peeps, whatcha running nowadays?

1 upvotes • Rollingsound514

Mark as read: Add to a list

Coding fine-tune of LLaMa 3.1

1 upvotes • e-e-peel

Mark as read: Add to a list

I call bs on gemini's elo

1 upvotes • lordchickenburger

Mark as read: Add to a list

Arcee AI Released DistillKit: An Open Source, Easy-to-Use Tool Transforming Model Distillation for Creating Efficient, High-Performance Small Language Models

1 upvotes • ai-lover

Mark as read: Add to a list

Arcee AI Released DistillKit: An Open Source, Easy-to-Use Tool Transforming Model Distillation for Creating Efficient, High-Performance Small Language Models

1 upvotes • ai-lover

Mark as read: Add to a list

Title	Upvotes	Author	Mark as read	Favorited	Rating	Add to a list
What best I can run on my macbook m3 36gb ram ?	1	Lessff4703
Is there a difference between knowledge graph-based RAG and GraphRAG?	1	Jeff_1987
LM Studio Problem - Won't use more than half of RAM	1	Thrumpwart
Want to have local TTS accompanying LLM, but seems the popular ones all use pickle, is that community just not caught up to safetensors yet?	1	sweetsunnyside
What kind of contextual window is possible on locally run LLMs on iOS? Also, how slow can it be on iOS?	1	dptgreg
2X3090 Peeps, whatcha running nowadays?	1	Rollingsound514
Coding fine-tune of LLaMa 3.1	1	e-e-peel
I call bs on gemini's elo	1	lordchickenburger
Arcee AI Released DistillKit: An Open Source, Easy-to-Use Tool Transforming Model Distillation for Creating Efficient, High-Performance Small Language Models	1	ai-lover
Arcee AI Released DistillKit: An Open Source, Easy-to-Use Tool Transforming Model Distillation for Creating Efficient, High-Performance Small Language Models	1	ai-lover