/r/LocalLLaMA

Year:

Only show posts with narrations

My adapter model dominating the entire base model

1 upvotes • AcademicHedgehog4562

Mark as read: Add to a list

QLoRA / RAG / Embeddings w Llama 3.1

1 upvotes • clash_clan_throw

Mark as read: Add to a list

Prototype procedural chat interface (works with 6+ LLM chat APIs).

1 upvotes • kleer001

Mark as read: Add to a list

Using cached 20k context with cheap used 4th Gen Epyc for CPU and 4x3090 GPU inference? Please review my build plans and alternative API costs.

1 upvotes • jakub37

Mark as read: Add to a list

Seeking Help with Embedding Errors in 'gemma2' Using llama-cpp-python

1 upvotes • dewijones92

Mark as read: Add to a list

Most usefull AI discords/communities on discord

1 upvotes • Rombodawg

Mark as read: Add to a list

Building AI home lab

1 upvotes • PristineBoat6992

Mark as read: Add to a list

Passage Retrieval in Commercial Setting

1 upvotes • Albertommm

Mark as read: Add to a list

Semantic Router For Multiple Documents

1 upvotes • AsideRepresentative3

Mark as read: Add to a list

How to make parallel llama calls fast locally?

1 upvotes • giobirkelund

Mark as read: Add to a list

Title	Upvotes	Author	Mark as read	Favorited	Rating	Add to a list
My adapter model dominating the entire base model	1	AcademicHedgehog4562
QLoRA / RAG / Embeddings w Llama 3.1	1	clash_clan_throw
Prototype procedural chat interface (works with 6+ LLM chat APIs).	1	kleer001
Using cached 20k context with cheap used 4th Gen Epyc for CPU and 4x3090 GPU inference? Please review my build plans and alternative API costs.	1	jakub37
Seeking Help with Embedding Errors in 'gemma2' Using llama-cpp-python	1	dewijones92
Most usefull AI discords/communities on discord	1	Rombodawg
Building AI home lab	1	PristineBoat6992
Passage Retrieval in Commercial Setting	1	Albertommm
Semantic Router For Multiple Documents	1	AsideRepresentative3
How to make parallel llama calls fast locally?	1	giobirkelund