I think part of the problem is Microslop’s Github Copilot in the web, which makes it possible for non developers to quickly and easily create PRs without understanding a single thing about programming, let alone software development.
It wouldn’t surprise me of people genuinely think they are helping.
Let’s deal with the mountain of AI slop garbage in the same way as what worked before:
We need some kind of reputation system for open source contributors. If you push slop, I don’t want to see your PR. If you consistently make worthwhile contributions, I’ll check out your PR.
How has that worked before? I’ve never encountered the system in practice. Can you give an example and explain how it works?
My fear is that newcomers will be locked out because of the assumption their code is LLM code but it genuinely is theirs. Or that they used an LLM, are willing to learn, think the code is genuinely good, but don’t know why it’s bad.
You mean reputation systems for filtering out low quality submissions? That’s why they exist. Spam filters, reddit, stack overflow, Lemmy, whatever. And people say “what about newcomers who start with no reputation” but it always seems to work out somehow.
My point was that “was this made by AI” is the wrong question. Not everything made using AI is dogshit, nor is everything made by real people always good. And you won’t always be able to tell the difference at all. Rather, let’s focus on the spam problem
Binary reputation systems aren’t good. I can say something that right and it can be downvoted because it goes against a person’s beliefs, because I’m unpopular, because a certain group doesn’t like it, because, because, because. Popularity is not a good measure of quality. Just look at the “publish or die” system. Just because you’ve been cited multiple times doesn’t make your paper right.
Imagine a trans contributor being downvoted just because they’re trans. How is that a good system? Do you expect trans people should only contribute in software projects where trans people are accepted? How are you going to prevent brigading?
So kind of like a personalised learning assistant? I realise it’s different but this inverted instruct approach puts me in mind of Doctorow’s reverse centaur!
Don’t you find that the links you get are hallucinated though? Even if they’re not now you can imagine this collapsing into slop echoes…
I’ve tended to ask for examples to help me bootstrap new projects. A bit like getting customised docs. I certainly haven’t had enough success with generated code to think about automatically adopting it.
I can see the benefit of this kind of use case, because LLM‘s are good at summarizing large data sets. It can be a good starting point for learning about something new or rubber ducking. But, if that’s your use case, why would you even need or want an agent hooked up to your environment to allow it to commit or create PRs?
deleted by creator
I think part of the problem is Microslop’s Github Copilot in the web, which makes it possible for non developers to quickly and easily create PRs without understanding a single thing about programming, let alone software development.
It wouldn’t surprise me of people genuinely think they are helping.
Let’s deal with the mountain of AI slop garbage in the same way as what worked before:
We need some kind of reputation system for open source contributors. If you push slop, I don’t want to see your PR. If you consistently make worthwhile contributions, I’ll check out your PR.
How has that worked before? I’ve never encountered the system in practice. Can you give an example and explain how it works?
My fear is that newcomers will be locked out because of the assumption their code is LLM code but it genuinely is theirs. Or that they used an LLM, are willing to learn, think the code is genuinely good, but don’t know why it’s bad.
Very curious how the existing system works.
You mean reputation systems for filtering out low quality submissions? That’s why they exist. Spam filters, reddit, stack overflow, Lemmy, whatever. And people say “what about newcomers who start with no reputation” but it always seems to work out somehow.
My point was that “was this made by AI” is the wrong question. Not everything made using AI is dogshit, nor is everything made by real people always good. And you won’t always be able to tell the difference at all. Rather, let’s focus on the spam problem
Binary reputation systems aren’t good. I can say something that right and it can be downvoted because it goes against a person’s beliefs, because I’m unpopular, because a certain group doesn’t like it, because, because, because. Popularity is not a good measure of quality. Just look at the “publish or die” system. Just because you’ve been cited multiple times doesn’t make your paper right.
Imagine a trans contributor being downvoted just because they’re trans. How is that a good system? Do you expect trans people should only contribute in software projects where trans people are accepted? How are you going to prevent brigading?
I’m not here to debate you. I think it’s clear by now what I think should be done. If you disagree, that’s fine. No system is going to be perfect.
This is interesting and sounds like how I’ve been using it - basically like customised stack overflow answers.
Would you mind elaborating a little on your approach? Are you saying you provide it with guidance and links or are you asking it for those?
deleted by creator
So kind of like a personalised learning assistant? I realise it’s different but this inverted instruct approach puts me in mind of Doctorow’s reverse centaur!
Don’t you find that the links you get are hallucinated though? Even if they’re not now you can imagine this collapsing into slop echoes…
I’ve tended to ask for examples to help me bootstrap new projects. A bit like getting customised docs. I certainly haven’t had enough success with generated code to think about automatically adopting it.
deleted by creator
I can see the benefit of this kind of use case, because LLM‘s are good at summarizing large data sets. It can be a good starting point for learning about something new or rubber ducking. But, if that’s your use case, why would you even need or want an agent hooked up to your environment to allow it to commit or create PRs?
deleted by creator