跳到正文
DEV Community· Dan Walsh·· 9 天前AI 評分40

AI 智能體時代軟件工程的未來:驗證與治理

Future directions of travel

AI 導讀

作者預測,隨着 AI 智能體參與軟件工程,驗證工程將成為重要專業範疇,並逐步成為整個行業的新標準。組織應為重大決策指定具名負責人,要求其毋須詢問模型也能解釋決策,並記錄接納建議的原因,以應對過度依賴帶來的失能風險。

正文

I already put this in the log, but whatever. Free will n all that, I'm double posting.

Been thinking about the future of SWE and agentic use in general (shocker, who working in SW hasn't?)

In my eyes: verification and governance.

My prediction on SWE directions: verification engineering becoming a massive discipline/the new standard for software engineering at large.

We're no longer hand crafting pieces of curated, artisanal code to try and solve problems.

Aside: people sometimes seem to forget solving problems was the point of the job in the end - writing code in and of itself was not the full job, but many people seem to have made it their personality or their measure of value/impact as an engineer, and are now struggling with their identity as a result, but that's a different thread.

I understand the tension here. Hand writing code gave many of us the level of scrutiny that allowed for an ongoing understanding and verification in terms of the code produced, but as the be all and end all of a given engineer's identity, it's now far too limiting.

We're now at the factory's production line, and our job is to assess which of the different experiments and approaches output by an agentic session best address a given problem, which is most extensible and/or maintainable for the future and its problems to address, and to provide a level of confidence and rigour to how we arrived at that decision.

How do we do that? With the necessary guardrails, assessments, and verification practices in place.

Zoom out, same problem appears at a bigger scale. Verification is governance at the scale of a PR; governance is verification at the scale of an organisation.

Governance.

Not the sexiest option by a mile, but it feels like the right route, because we're slowly (or quickly depending on your personal perceptions and p(doom)) offloading our cognitive capabilities to a subscription service.

Intelligence and aptitude on demand, where we need to pay a given value each month to be in with a fighting chance in the ongoing arms race of individual capability.

I'm convinced that, of all the AI safety risks we need to guard against, gradual disempowerment and over-reliance are far too easily overlooked in favour of misuse, for example. Misuse / CBRN applications are obviously terrifying, and real problems, but the insidiousness of disempowerment is the killer to me.

In X industry, Y organisation is so much further ahead than us! We need to use AI to catch up. We don't have time to spend dwelling on these decisions and problems - DecisionBot 9000, what's your suggestion here? Ok great, implement that.

Fast forward Z months/weeks/days later - I don't understand any of this. Where are we? Let's ask AI - it's best informed and capable to consume the information we have here, get its assessment and then we'll go with its recommendations.

At what point do we recognise the problem that's developed? How do we even begin to pull ourselves out of that hole? Do we even recognise we're boiling along with the other frogs?

We need governance in place to try and offset these situations at the earliest possible points. In practice: named human(s) owning each significant decision, with the ability to explain it without asking a model, and recording why a given recommendation was accepted, not just that it was.

I don't wanna be a dang frog.

來源:DEV Community · dev.to