Sims

I have a few super old phones/tablets I didn’t threw out for some reason. IF termux can be installed, does the Android version mean anything for the running services ? My latest Android device is version 7.

If you are posting satire, then be kind and mark it as such. Otherwise you just waste other peoples time, and I assume that were not the purpose ?

Just label things broadly with ‘Capitalist Slop’ - and have a set of standard tools to get rid of that harmful religion. Sponsorblock, dearrow, ublock, most privacy tools, and all other attempts at un-shittifying the net, are just working against that infantile belief system and its natural consequences.

This is all just Capitalist slop. Has nothing to do with AI or llms, just the kind of society it exists in and the type of psychopath corporations that delivers. We seem to forget that all other tool we use to de-shittify the net, ALL fight capitalist tendencies, but when AI comes along and gives the Capitalist believers a new tool for scamming people, then it is suddenly the tools fault !!

People hate Capitalism, not the tool…

I have not tested it, but Zluda are are drop-in cuda replacement for non-nvidia gpus. The speed should be great. You could check if your goto card is supported…

A backup drive ? dotfiles (.config) ? /tmp /var/log /boot ? map it into your home for something temporary - Downloads ? Slow audio files ? If you like to tinker for fun: btrfs / bcachefs could perhaps utilize it for something, like automatically offloading unused/slow files to the slow usb ? Raid ? ;) Create a partition and let zram swap compressed unused memory pages to the usb partition (I think it keeps pages compressed now ?). You can also run ‘usb over ethernet’, so another machine can use it directly - not sure why tho ;)

On a side note. I still use one of my first usb 1.? drives with 32mb in my old router. 32mb is still 12mb more than my first hard drive, and it fits well with the small openwrt packages. It even has a little slide button to select ‘floppy drive’ mode and a physical ‘readonly’ mode. I wonder what the smallest/oldest usb stick people still use, are ?

Looks cool and simple. Here’s for convenience: https://www.youtube.com/watch?v=IkriZGyjoeU

Agree. “Are you perhaps too angry?”, “The HELL I’m not! F*ck off !”, “alrighty then”…

“\C-x(”: “s/\([[:space:]]\)\(\(\([[({]\(\([[({]\(\([[({]\([^{][(){}]\{0,1\}\)*[]})]\)\{0,1\}[}][(){}]\{0,1\}\)[]})]\)\{0,1\}[^{][(){}]\{0,1\}\)*[]})]\)\{0,1\}[}][(){}]\{0,1\}\)*\)/\1(\2)/n”

YES! Finally something with a manly learning curve ! Enough with all this baby high level programming languages and UI’s. ALL computer interaction should preferably be in a random mix of brainfuck and ed(2) ! Maybe with a little regex expressions randomly inserted here and there to keep us sharp ;-)

Compute prices are not going down. If you want a budget friendly compute, then you may need to look for NPU’s. They are slower, and is unfortunately also getting more expensive pr TOPS. Electricity prices in the West are going up as a low output gets bought up by datacenters instead. The newest GPU’s are more efficient in re. to power pr Top, but they are not budget friendly.

I have not seen a recent comparison of GPU vs Npu; TOPS vs price vs power consumption, but @ aliexpress, I saw a small 40 TOPS Npu as a nvme stick with 16gb ram that draws 10 watts, or so (search for ‘ai accelerator nvme’). This little thing can scan files 24/7 and your i5 can help out in peaks. Afaik you can run a distributed model that also runs in, and uses your i5 memory/compute, so if you max out i5 memory, perhaps the combined compute is enough for a larger model ? Maybe a few Npu sticks can work together on the same model ?

Alternatively, you could look for the next version of a Huawei gpu card (first had baby kinks afaik), or one of the other upcoming producers from China. They’ll come faster and faster, but are earmarked for local consumption first.

Another suggestion is to buy one of the old P40/80 (from the ‘pascal’ chipset, I think) (or was it k40/80 ??). They should still support a descent range of modern quantization needs and often have 24gb ram. A refurbished miner card cost around 50-70$+ - cant remember exactly tho.

Lastly, you could try something different. If the i5, with enough memory, can run a large model slowly, you could add a dedicated KV cache, so most of the tokens won’t need to be recalculated. Memory and bandwidth are the most important here, but any old server could be upgraded to be a dedicated KV cache server (might need a network upgrade tho!).

Anyway, Ideas are easy and cheap. If I were you, I would ask an AI for a little python app where you can add a product and it returns a graph where it compares with other products and show optimality over time given prices/power and Tops - Gpu vs Npu. Good hunting…

Neat. I had to think about the purpose of running a kernel in a browser, and couldn’t find any at first, but if we just see wasm as a browserless container environment, then it makes more sense than running a linux kernel in a browser. I could see a minimal linux spinning up specialized kernels in different wasm containers, much like vm’s. Not sure what hardware/software roadblocks exist in a modern wasm container environment tho.

Removed by mod

Removed by mod

I haven’t tried it but Radicle sounds cool ? Radicle is an open source, peer-to-peer code collaboration stack built on Git. Unlike centralized code hosting platforms, there is no single entity controlling the network. Repositories are replicated across peers in a decentralized manner, and users are in full control of their data and workflow.

There are some dev/repo tools, but I don’t know how they compare with commercial platforms.

I think its difficult to get away from an usb converter for you hdd and that seem to be the only reason for not choosing RP ? RP’s are overpriced, but you can probably find a HAT for the sata connection in the rp ecosystem.

Alternatively, you could look for usb connectors for both hdd and gpio, an old usb-hub, and choose a small orangepi 2 …ish usb-stick (with hdmi, i think) as a base. It shouldn’t cost that much, and power usage is extremely low on the first clones while still having a little power for video etc. The stick should oc be able to power down the hdd via usb.

Alternatively *2, maybe you can repurpose your laptop, let it hibernate but enable power/wakeup on a usb port, plug in the cheapest gpio unit you can find, and when the tech-illerates try the remote, the stick wakes up the laptop via usb, and your laptop plays the video ? Not sure when to let the laptop power down, but that seems doable. RP2 had a ridiculously low power usage afair, so it can be on always. Not sure what a sleeping laptop draws beside the usb power draw. Oh, and an old laptop might not be able to keep your usb port on while sleeping.

Cheap, but definitely more clunky…

MSP’s ??

Thanks for Lemonade hint. For Ryzen AI: https://github.com/lemonade-sdk/lemonade (linux=cpu for now)

Sounds more like Nato and the western elite want to get in to Iran’s information sphere, than to let Iranians access western internet and be ‘free’. Iranians are during external attacks against their nation, protected from the information war - just like borders protect from attacks. I’m not assisting the Western elite. I’m out…

I slept in my first computer - and worked as verbal RAM (first VRAM!) 28 hours a day !

“…and when you tell this to young people today, they won’t believe you !” - Monty Python.

I don’t know, but allow me a soft rant about the ‘distributed’ part;

Couldn’t selfhosters try to ‘organize’ and share these burdens ? Why pay for external cloud backup, or anything, when selfhosters can just help each other storing parts of others backup. Then everyone have an automatic back-up.

The tools seem to be there, but Its like there are all these super-skilled infra-structure selfhosters that know everything about self-hosting solutions, but they lack the self-organizing ability to sollve these typical - and a bit trivial, lets be honest - problems in a full p2p style. The result looks to be that all self-hostings solution above the threshold of an average individual selhoster, have to be done in the cloud, and everyone is ‘siloed’ in their own mini data center.

But, with existing tools, AI and a little imagination, it shouldn’t be too hard to ‘organize’ a little (though here) design a self-hosting p2p backup solution from existing tools. …or a solution for most of the other cloud services we still rely on…

But maybe its something else ? …to me, it just seems unnecessary for a high expertise self-hoster community that - when combined - are an absolute gargantuan cloud-service infrastructure …to still have such basic capacity issues (no offense meant to op, or anyone!), and still have so high reliance on cloud services. Seems odd to me…