services.tabby.enable = true;
services.tabby.acceleration = "cuda";

? Could be another way.

Quite some AI questions coming up in selfhosted in the last few days…

Here’s some more communities I’m subscribed to:

• !localllama@sh.itjust.works
• !fosai@lemmy.world
• !stable_diffusion@lemmy.dbzer0.com

And a few inactive ones on lemmy.intai.tech

I’m using koboldcpp and ollama. KoboldCpp is really awesome. In terms of hardware it’s an old PC with lots of RAM but no graphics card, so it’s quite slow for me. I occasionally rent a cloud GPU instance on runpod.io Not doing anything fancy, mainly role play, recreational stuff and I occasionally ask it to give me creative ideas for something, translate something or re-word or draft an unimportant text / email.

Have tried coding, summarizing and other stuff, but the performance of current AI isn’t enough for my everyday tasks.

Make it 63 (31?) to align with what C99 can distinguish.

Also: I really like unicode in identifiers. So if at all possible don’t just have a random string of letters and numbers, make sure to include greek letters and all the funny emojis. (I just forgot which languages and compilers etc allow that.)

does dave know he’s a zero?

I suppose the license only counts after you aquired the program. Not before.

Free software means that the software’s users have freedom. (The issue is not about price.)

Specifically, free software means users have the four essential freedoms: (0) to run the program, (1) to study and change the program in source code form, (2) to redistribute exact copies, and (3) to distribute modified versions.

https://www.gnu.org/philosophy/free-sw.html#selling

( https://www.gnu.org/philosophy/philosophy.html )

Agree. Not sure if I’d use the word “tool” to describe him… But he’s certainly “special”. Glad I found one of the few discussions where it’s not just his fans praising him for his " visions" despite him not delivering on the last 50 promises he made. Or the latest edgy memelord thing he read somewhere or came up with… Usually I just shut my mouth and don’t comment on that because it’s just so many people following the hype.

No? I left out the detailed info here as I thought it’s of no concern. I provided it with pretty much the same info I’d write to the Linux Kernel Mailing List. With computer bugs that’s usually steps to reproduce the issue, exact versions of everything, exact error messages and my findings from googling and looking at the code…

That was one of the issues I had that only gave me one or two search results and it’s unlikely that someone comes up with a solution since the hardware is outdated and not many people have that specific board lying around and also the expertise to understand the low level hardware coding involved.

I mean it kind of fits the rest of the picture I have from using ChatGPT and similar stuff. It can do easy stuff. And write boilerplate code pretty alright. With the Arduino code I’m tinkering around as a hobby… not so much. I once asked it to do the inverse kinematics for a small robotics project. And the AI can tell me about what I just read on the Wikipedia article about that topic. But that’s it. Not an idea how to apply that info. And that the complicated part is to come up with the specific Jacobian matrix. And not just tell me that using one is one of the few approaches to that problem. That’s obvious from reading the Wikipedia article or reading any textbook. And it did silly things like write code like equation.solve(parameter1, parameter2, parameter3) … Sure. I mean if I already had a framework that did that and was available on an embedded platform, I wouldn’t have had that problem in the first place…

So my attempts at using AI for the issues I have with computers regularly fail. I can see how that’s not the experience everyone has, but still… It doesn’t really help me with specific problems or rare issues.

And I still have a few I can try to question some AI about… An slow Wireguard VPN tunnel inside if another tunnel that I already fixed the MTU and it’s still unbearably slow… A few obscure webframeworks that don’t tie into things… But I’m pretty sure I’ll get the same results.

Have you ever been lucky with AI and issues that didn’t get you any search results because no one ever did it before? I mean I’d be happy to learn how to use AI properly as a tool. It’s just I’ve tried and I don’t think I’m too stupid to prompt it. It’s just that I’ve given up since it doesn’t seem nowhere near intelligent enough to tackle the real issues I have. I’m not opposed to AI. I use it and it helps me get small stuff done easier/faster.

I’ve tried. And usually the questions I ask are too specific. I mean I can answer the basic questions myself and often I get several result when it’s just that. The AI just mumbles general advice and is always wrong if it’s too specific. Like for example: Why does the graphics driver crap out on any OpenGL ES instruction on the old single board computer I have lying around, despite the SoC being supported?

I don’t get it. Where does he say “algorithm”? Does Google Gemini do PAC learning?

AFAIK “AI” means “machine learning” and machines with “intelligent” behaviour, whatever that means. It includes everything from expert systems, statistics, markov chains to LLMs. And people nowadays slap it on every product out there.

“Algorithm” means a (finite) sequence of (rigorous) instructions. At least that’s what Wikipedia says. It’s well defined and doesn’t talk about where the instructions come from or if it includes statistics.

And one of them is Java?

Free Software, proprietary, open-weight models, source-available, FLOSS, copyleft, permissive license.

I think “open source” should mean what the OSI wants it to say, since they coined that term. But not all people agree and since they use it for different things and marketing, it’s lost some of its intended meaning. I don’t want to confuse people. And I also don’t like to use terms that can be (mis)used by the source-available people or people who add the commons clause, so I always try to include “free” as in freedom or “libre”.

Make a request per the GDPR.

Can we get a bit more info? Does it run locally? What specs does it need? Which technology does it use, something open-ended like Whisper? Or something faster with a prefefined set of sentences like VOSK? Which TTS engine does it use? Does it do other languages than just English?

Do these private computers run a properly licensed version of Windows? What’s the cost for a license? Same as in other countries?

And another thing I wodered: Is there more Linux expertise available than in other countries? I guess the average person from India isn’t in IT. But there’s lots of IT, lots of companies from my country have outsourced parts of their IT. I occasionally watch tutorial videos or university lectures on Youtube either in english with a heavy accent or for domestic use and not in english. Some of them discuss some crazy niche Linux topics or software development, which is also oftentimes deployed on Linux infrastructure. Or is it just because India is a big country and it’s just a matter of scale that I get to see some videos from over there?

I think with the ‘32’ in your error message, the issue is probably running old 32bit software on a modern 64bit system?

Have you enabled multilib?

There is a bit more info on that on the Steam page in the arch wiki.

True. Sadly the article is over 2 years old and not much has changed since.

I think an LLM integrated into the IDE would be better suited when it comes to projects that aren’t backed by a company like Microsoft who have a large amount of GPU compute to spare for their users.

Or it’d be bart of a CI pipeline. AFAIK that is theoretically already possible. You could configure the existing CI to feed the code through some form of AI code check.

HDMI 1.4 has a less than half the bitrate of the oldest DisplayPort standard. And regarding the newer HDMI standard: read the article. The forum are being jerks…

Hmm, I mean there is also publication bias. You’re more likely to edit a Wiki page if you found a solution… But you’re also likely to rant and ask for questions if it’s really bad… There is a bit in the middle where it doesn’t work that well. What I find super annoying if I find my question already posted 2 years ago and there isn’t a solution posted underneath. That means someone either got it working and didn’t update their post… or they moved on and it’s impossible. But you’re right, this really mostly happens to obscure and niche problems. Not if it’s a ThinkPad or Dell laptop midel that has already sold millions of times. But somewhat likely if it’s a newer high-end gaming mainboard or niche server that isn’t common amongst the Linux-folks.