For the life of me can’t remember the scores I was getting on gpt4all. But given that you tried it I’m guessing you’ll most likely take a liking to LM studio or perhaps jan.ai. both GUI tools. If the lack open source bothers you go for Jan.ai, if not then go LM studio. LM studio in particular allows for full and partial GPU offloading. So if you have a semi capable but not quite enough vram on it you can load part of the model on the GPU to speed up inference. As a side note pure CPU on my old ryzen 1600 I was looking at 6/it. Which isn’t all that much but glass half full its still faster than the average typing speed and takes the load off of having to think about how to creatively word things
For the life of me can’t remember the scores I was getting on gpt4all. But given that you tried it I’m guessing you’ll most likely take a liking to LM studio or perhaps jan.ai. both GUI tools. If the lack open source bothers you go for Jan.ai, if not then go LM studio. LM studio in particular allows for full and partial GPU offloading. So if you have a semi capable but not quite enough vram on it you can load part of the model on the GPU to speed up inference. As a side note pure CPU on my old ryzen 1600 I was looking at 6/it. Which isn’t all that much but glass half full its still faster than the average typing speed and takes the load off of having to think about how to creatively word things