On the day of Anthropic's IPO a group of people gathered to protest at their offices. These people are concerned that Anthropic is implementing "recursive self improvement" recklessly. And, I'm annoyed at them. Since most people don't pay much attention to the details of technical news about software... their complaint blends in with those who think LLMs are being implemented recklessly for less exotic reasons. It almost feels like deliberate misinformation designed to muddle the debate.
Similar posts
3 posts close in meaning, closest first
I was sharing with my wife my (current) preferred approach to AI produced code by engineers. It's borrowed from her PhD - thesis defence. If an engineer can defend their code in a thesis defence, I have no concern about how it was produced. What is thesis defence for software changes? They should be able to explain, without using an llm: * What is the objective for the code change * Why did they choose this approach * What other approaches they considered * What unrelated/unexpected things they found along the way * What are the limitations of chosen approach * What is the wider/longer term impact of choosing this approach
Show more of this post
* Who else did they collaborate with, or who else understands their chosen approach to be able to answer these questions if needed Notice I don't want them to explain their work. I can read the code and understand it. I want to understand how well researched this approach is, and how well they understand it. I also want to ensure that they have put in at least as much effort (to produce the code or to prepare for the theses defence) as the reviewer will put in. #ai #softwareengineering
And I'm not coming at this from a "I'll never use AI, it's evil" stance. I use AI at work a fair bit. But I use it in a way that I still own, deeply understand, and am able to explain and modify anything that I produce - whether I built it with or without AI. Around me I see work being pushed where the author can't answer a few questions about it, it is clearly beyond their usual ability, and has no chance of being maintainable workout AI. This is just lazy folks using AI lazily. I can handle this (at a cost). They don't understand it but I can, and I can make it simpler and maintainable. What really has me reconsidering my approach is the Software Factory approach I am seeing being adopted by some of the smarter people I know. They are actively making a choice that they don't need to know how the system being produced works in details. As long as it produces desired behaviour/output, it is all that matters. #ai #softwareengineering
Sitting idle drinking tea and thinking about the thing rocking my profession. I'm kind of down to this question: > Is it important that a human is able to understand, modify and explain the behaviour of a system/software without the aid of an LLM? I'm on the side of yes, in a profession that's increasingly behaving like it's not. I've always needed to understand why before making a choice. I'm not yet getting a strong answer to why we're moving from yes to no. #ai #llm #softwareengineering