/r/Oobabooga

Year:

Only show posts with narrations

Benchmark update: I have added every Phi & Gemma llama.cpp quant (215 different models), added the size in GB for every model, added a Pareto frontier.

29 upvotes • oobabooga4

Mark as read: Add to a list

Prototype procedural chat interface (works with 6+ LLM chat APIs).

9 upvotes • kleer001

Mark as read: Add to a list

Given these small models, how are people running them on their Android phones?

7 upvotes • Waterbottles_solve

Mark as read: Add to a list

I kinda need help here... I'm new to this and ran to this problem ive been tryna solve this for days!

3 upvotes • ZookeepergameGood664

Mark as read: Add to a list

Scrolling in chat mode is broken

3 upvotes • Delta_Adams

Mark as read: Add to a list

Newbie question: when I use models that load with the "transformers model loader", can I use both CPU and GPU, or is it recommended to use only one of them?

2 upvotes • Fine_Awareness5291

Mark as read: Add to a list

Please help a newbie

2 upvotes • Prudent-Rutabaga5666

Mark as read: Add to a list

Help!

1 upvotes • Hello-world_07

Mark as read: Add to a list

Help needed with KeyError when using v1/chat/completions API with silero_tts enabled

1 upvotes • IntelligentTrick2899

Mark as read: Add to a list

I don't know how to set this model (lack of information I think) NSFW

1 upvotes • Important-Product759

Mark as read: Add to a list

Title	Upvotes	Author	Mark as read	Favorited	Rating	Add to a list
Benchmark update: I have added every Phi & Gemma llama.cpp quant (215 different models), added the size in GB for every model, added a Pareto frontier.	29	oobabooga4
Prototype procedural chat interface (works with 6+ LLM chat APIs).	9	kleer001
Given these small models, how are people running them on their Android phones?	7	Waterbottles_solve
I kinda need help here... I'm new to this and ran to this problem ive been tryna solve this for days!	3	ZookeepergameGood664
Scrolling in chat mode is broken	3	Delta_Adams
Newbie question: when I use models that load with the "transformers model loader", can I use both CPU and GPU, or is it recommended to use only one of them?	2	Fine_Awareness5291
Please help a newbie	2	Prudent-Rutabaga5666
Help!	1	Hello-world_07
Help needed with KeyError when using v1/chat/completions API with silero_tts enabled	1	IntelligentTrick2899
I don't know how to set this model (lack of information I think) NSFW	1	Important-Product759