Oh it learned enough from code that it has developed some basic, and hear me out of this, artificial verbal intelligence. I know I know, not just pattern matching, but actual artificial intelligence at a low level.
Please don’t downvote me (sorry don’t remember if this is fuckai or not) but I’m just saying it’s one possible explanation to this phenomenon you describe.
Don’t get me wrong, the models are really impressive, and something I would have called impossible two years ago. From an information theory point of view, it is super cool how they manage to compress so much knowledge and connections in so little size (relatively speaking).
Itelligence is very ill defined, as someone else pointed out. It still has a very weird model of the world (if at all).
My point is however, it sometimes seems to be too good at guessing facts that should not be guessable from the inputs and publically available information alone.
I mean even if it did train on the proprietary code it can’t memorize it. It has to “learn what code like this looks like”. It has to figure out what the function is. That can I think only be called verbal intelligence. The ability to understand what is meant behind words. Not very good yet but having to pretend it’s not there is just denialism. Denialism exactly like climate change denial. And of course some AI fans do have AI psychosis, different side of the same coin.
The whole dancing around LLMs clearly being able to reason (which can be shown in scientific experiments) and therefor clearly having some sort intelligence is so stupid. Because meanwhile 90% of lemmy users are too brainwashed to accept basic reality any more.
Because you know, this isn’t just funny. There are real danger as the technology progresses. But it’s politically incorrect and gets you massive downvotes in the wrong community if you talk about those dangers. You can’t talk about facts any more.
It’s not just about the historical facts about e.g. the coup in Ukraine that you can’t talk objectively about any more. Facts in general become anathema. Only the feeling of correctness and manufacturing social consent matters. Collectively we are becoming more and more stupid animals. We are trained to become less sentient or sapient. Less able to perceive and react to reality and more and more act on trained and instinctual impulses. But I see little difference between the MAGA fascists and like 90% of lemmy users now. And if you don’t want to offend (or get fired) you have to mask and that seemed funny in your post.
That line of thinking is directly leading to “you cannot say anything any more” and “facts before feelings”, and before you know it, you confuse some loud people disliking your edgy opinions with you and your “facts” being oppressed. It’s human interaction, get over it, stop being butthurt and either engage in constructive discussion, willing to occasionally accept being wrong, or block and move on. Most of us live in a world where we have more freedom of speech than most of recorded history. Stop perpetuating that bullshit play by people who hate people haveing civil discussions, because they profit from screaming matches and endless polarization. Someone disagreeing with you, even someone calling you an idiot, is just exercising their free speech, same as you do.
With that out of the way, several things can be true at once: intelligence and reasoning can be ill-defined terms, an LLM can be able to match inputs to outputs with impressive accuracy, it can have an internal model of the world that is very weird and surprisingly lacking, and it can be a dangerous technology for humanity. Does that make it intelligent? Probably, for some definition of intelligence. But I am still much more worried about people with/behind AI than about AI itself. I’m not afraid of a gun, I am afraid of an egoisitic moron with a gun.
There are studies and tools like LiCoEval and others that investigate LLM memorization. It does happen but it’s not all the time, and it’s very infrequent for real world (complex) examples. Mostly this concerns textbook examples or standard boilerplate code - from what I read. And I obviously don’t know the specific example mentioned. This is also a problem that can be fixed.
But I’m really just half mocking the very careful language used by the comment I replied to.
Oh it learned enough from code that it has developed some basic, and hear me out of this, artificial verbal intelligence. I know I know, not just pattern matching, but actual artificial intelligence at a low level.
Please don’t downvote me (sorry don’t remember if this is fuckai or not) but I’m just saying it’s one possible explanation to this phenomenon you describe.
Don’t get me wrong, the models are really impressive, and something I would have called impossible two years ago. From an information theory point of view, it is super cool how they manage to compress so much knowledge and connections in so little size (relatively speaking).
Itelligence is very ill defined, as someone else pointed out. It still has a very weird model of the world (if at all).
My point is however, it sometimes seems to be too good at guessing facts that should not be guessable from the inputs and publically available information alone.
I mean even if it did train on the proprietary code it can’t memorize it. It has to “learn what code like this looks like”. It has to figure out what the function is. That can I think only be called verbal intelligence. The ability to understand what is meant behind words. Not very good yet but having to pretend it’s not there is just denialism. Denialism exactly like climate change denial. And of course some AI fans do have AI psychosis, different side of the same coin.
The whole dancing around LLMs clearly being able to reason (which can be shown in scientific experiments) and therefor clearly having some sort intelligence is so stupid. Because meanwhile 90% of lemmy users are too brainwashed to accept basic reality any more.
Because you know, this isn’t just funny. There are real danger as the technology progresses. But it’s politically incorrect and gets you massive downvotes in the wrong community if you talk about those dangers. You can’t talk about facts any more.
It’s not just about the historical facts about e.g. the coup in Ukraine that you can’t talk objectively about any more. Facts in general become anathema. Only the feeling of correctness and manufacturing social consent matters. Collectively we are becoming more and more stupid animals. We are trained to become less sentient or sapient. Less able to perceive and react to reality and more and more act on trained and instinctual impulses. But I see little difference between the MAGA fascists and like 90% of lemmy users now. And if you don’t want to offend (or get fired) you have to mask and that seemed funny in your post.
Anyway, sorry just rambling lol
That line of thinking is directly leading to “you cannot say anything any more” and “facts before feelings”, and before you know it, you confuse some loud people disliking your edgy opinions with you and your “facts” being oppressed. It’s human interaction, get over it, stop being butthurt and either engage in constructive discussion, willing to occasionally accept being wrong, or block and move on. Most of us live in a world where we have more freedom of speech than most of recorded history. Stop perpetuating that bullshit play by people who hate people haveing civil discussions, because they profit from screaming matches and endless polarization. Someone disagreeing with you, even someone calling you an idiot, is just exercising their free speech, same as you do.
With that out of the way, several things can be true at once: intelligence and reasoning can be ill-defined terms, an LLM can be able to match inputs to outputs with impressive accuracy, it can have an internal model of the world that is very weird and surprisingly lacking, and it can be a dangerous technology for humanity. Does that make it intelligent? Probably, for some definition of intelligence. But I am still much more worried about people with/behind AI than about AI itself. I’m not afraid of a gun, I am afraid of an egoisitic moron with a gun.
i would err towards it ingesting proprietary code before this, it’s not wrong but AI spits out copyrighted and should-be private stuff all the time.
There are studies and tools like LiCoEval and others that investigate LLM memorization. It does happen but it’s not all the time, and it’s very infrequent for real world (complex) examples. Mostly this concerns textbook examples or standard boilerplate code - from what I read. And I obviously don’t know the specific example mentioned. This is also a problem that can be fixed.
But I’m really just half mocking the very careful language used by the comment I replied to.