On the server screen on the right side under GPU Settings. Its not hard to find.

Just wanted to say a quick thanks to Pixyy! This script has been a lot of fun to play with, both as a user and messing around with the LLM side of things.

I'd also recommend checking out Kuro-Lotus-10.7B-Q5_K_M as a model for lower spec systems, I've been very impressed with the quality and performance on my basic laptop GPU

Very neat. Definantly looking forward to playing with it. One minor request would be to make the URL of the lmstudio server configurable. I setup mine running on a separate computer to get faster responses than my laptop could produce. Not that editing the script manually is particuarly difficult.

Thank you . Yeah I was trying some new models with this its mind blowing and gives new opportunities.

One thing I've noticed is that most functions tend to return a value of 5. I suspect it might be because in the definition of EDGE(X) (in systemStrings) there is a (max 5), which the Model might be taking as a global instruction and not letting the code adjust for function specific maxima and minima. I don't know if others have noticed this as well.

True you can change those strings. With newer models it works really well it seems.

Try Triple Moist Theia if your pc can handle it