/r/LocalLLaMA

Year:

Only show posts with narrations

Why Llamma3.1 on llama.cpp repeatedly output a large amount of text that does not comply with the instructs. The results of my personal use cases are even worse than the ordinary 2B models.

1 upvotes • zen_in_box

Mark as read: Add to a list

Why Llamma3.1 on llama.cpp repeatedly output a large amount of text that does not comply with the instructs. The results of my personal use cases are even worse than the ordinary 2B models.

1 upvotes • zen_in_box

Mark as read: Add to a list

Need recommendation

1 upvotes • compiler-fucker69

Mark as read: Add to a list

Llama3.1:8b Create new method to create new universe on Linux that is reverse of “endless inflation” use python3

1 upvotes • Worldly_Evidence9113

Mark as read: Add to a list

Which LLM can answer this math correctly?

1 upvotes • balianone

Mark as read: Add to a list

How do I use openai chat completion client compatible correctly?

1 upvotes • Opening-Paramedic567

Mark as read: Add to a list

Fine-Tune Phi-3-mini on my dataset (Not instruction fine-tuning)

1 upvotes • Agician

Mark as read: Add to a list

How can I batch Tag images using Ollama/Llava?

1 upvotes • apatheticnoise

Mark as read: Add to a list

How can i queue the request to llm , currently if llama is processing a prompt and i give it another, it starts with a newer one and discards last one , how to overcome such issue

1 upvotes • GAMION64

Mark as read: Add to a list

Need to get upto date news

1 upvotes • sahan_dilshan2

Mark as read: Add to a list

Title	Upvotes	Author	Mark as read	Favorited	Rating	Add to a list
Why Llamma3.1 on llama.cpp repeatedly output a large amount of text that does not comply with the instructs. The results of my personal use cases are even worse than the ordinary 2B models.	1	zen_in_box
Why Llamma3.1 on llama.cpp repeatedly output a large amount of text that does not comply with the instructs. The results of my personal use cases are even worse than the ordinary 2B models.	1	zen_in_box
Need recommendation	1	compiler-fucker69
Llama3.1:8b Create new method to create new universe on Linux that is reverse of “endless inflation” use python3	1	Worldly_Evidence9113
Which LLM can answer this math correctly?	1	balianone
How do I use openai chat completion client compatible correctly?	1	Opening-Paramedic567
Fine-Tune Phi-3-mini on my dataset (Not instruction fine-tuning)	1	Agician
How can I batch Tag images using Ollama/Llava?	1	apatheticnoise
How can i queue the request to llm , currently if llama is processing a prompt and i give it another, it starts with a newer one and discards last one , how to overcome such issue	1	GAMION64
Need to get upto date news	1	sahan_dilshan2