• 1 Post
  • 499 Comments
Joined 2 years ago
cake
Cake day: March 22nd, 2024

help-circle




  • The title is pure clickbait, but the article is nuanced and reasonably well written, IMO.

    No one wants a freaking Ubuntu chatbot on their desktop, but code submission is an entirely different issue, and I think “the submitter is entirely responsible for their code” is a very reasonable position.

    And obviously, LLM-generated code policy needs to be tuned to each project and their contributor community. As an example not cited in the article, vibe-coded PRs are an ongoing plague for llama.cpp, an LLM inference engine itself, so they blanket ban them. Ironic, and perfectly reasonable. But Linus researching that Intel bug with a little help, but using his brain for the legwork and actual submission, is also reasonable.







  • The closest to what you want is probably the Nvidia Nemotron series, which uses an open dataset. It used a sizable GPU cluster to train, but nothing on the scale of what OpenAI/Anthropic are guzzling. That, and Nvidia makes a point to advertise high utilization/efficiency.

    There are smaller scale truly open LLMs like the Olmo series, but Nemotron is the most practical to use.

    Then there are the Chinese “open weights” LLMs, which tend to be trained on more modest Huawei ASICs instead of GPUs, and probably with a good chunk of renewables. The dataset is closed, and who knows what is in there, but at least the training scale is much smaller

    They are Apache licensed.

    Another thing is that both these group pitch LLMs as modular tools to customize, not magic black boxes to rent.







  • I mean Google can identify you with stuff like your resolution, cpu and gpu, measured execution speed, extensions, APIs, software versions. Browsers expose all that.

    Check this site out. Its a great explainer: https://amiunique.org/


    Now, if you run amiunique in Cromite, the results are interesting.

    It may identify some stuff, but if you actually look at the readouts, you can see Cromite is spoofing data. It intenionally lies about your hardware and configurations to throw off fingerprinting, amongst other things.

    This means it can actually mess up some sites that rely on the data: thats what I mean by “draconian.” Tons of features are disabled or stripped out. Cromite is a very extreme browser to daily drive, because its purpose built to defeat fingerprinting at any cost.



  • Okay, well, what about Nvidia Nemotron’s series as a counter example?

    It’s built on an open dataset; its training regime isn’t secret, it’s reproducible. It’s Apache licensed. It’s not published to manipulate anyone; it’s mostly presented as a research tool, or a starting point for users to customize for mundane text processing tasks. It runs reasonably efficiently on a large variety of software and hardware, with a standardized architecture.


    Of course AI, as it is mostly presented to the public, is an existential problem.

    But you’re trying to fundamentally tie text-based machine learning to the tech bros as a root for its ethical issues. It’s not that simple. Even if Sam Altman and all his kind keel over tomorrow, the complications the existence of LLMs and other generative models present is not going away, and we will have to deal with models that can do unethical things without anything unethical in their training regime.