DeepLearning.AI · The Batch · 实时热榜

The Batch News & Insights: The gulf between LLM performance on verifiable tasks vs. unverifiable tasks that require judgement is larger than... Dear friends, The gulf between LLM performance on verifiable tasks vs. unverifiable tasks that require judgement is larger than most people realize. Verifiable tasks, like coding or solving math problems, have a right answer that can be checked automatically. Judgement tasks — like how to respond to a customer complaint, how to organize data collection f

The Batch News & Insights: I think most people still underestimate the data center build-outs that will be required to meet demand. Dear friends,I think most people still underestimate the data center build-outs that will be required to meet demand. In 2024, I predicted that we would need more compute infrastructure for inference because of the large number of tokens consumed by agentic workflows. This remains true today. But many people still underestimate the compute infrastructure that will b

The Batch News & Insights: Anthropic recently released an encouraging analysis of the cyber capabilities of open weight model GLM-5.3. Dear friends,Anthropic recently released an encouraging analysis of the cyber capabilities of open weight model GLM-5.3. The study shows that GLM-5.3 approaches the cyber capabilities of Claude's closed weight Mythos. For example, the diagram below shows that, using a comparable number of tokens, GLM-5.3 succeeded in 12% of attempts to exploit vulnerabilities on

The Batch News & Insights: Moving forward on early stage, 0-to-1 projects and mature projects requires very different tactics. Dear friends,Moving forward on early stage, 0-to-1 projects and mature projects requires very different tactics. For those who aspire to be skilled at AI Engineering, I've found that selecting the right tactic based on stage of project is one of the hardest but most important things to learn.In the 5 letters on the AI Engineering Skills Map, you may have noticed calibrat

The Batch News & Insights: The loudest voices stoking fears about AI dangers have made tremendous headway in the past two weeks. Dear friends,The loudest voices stoking fears about AI dangers have made tremendous headway in the past two weeks. AI technology has not taken some unexpected, dangerous turn, but the hype around it — propelled by what appears to be a well orchestrated PR campaign — has drummed up considerable fear. I worry that it represents a setback for our field.I have written freq

The Batch News & Insights: When you’re skilled at AI Engineering, your best work won’t be merely implementing a product that someone else... Dear friends,When you’re skilled at AI Engineering, your best work won’t be merely implementing a product that someone else spec’ed out. Instead, you will actively shape the build.Before modern AI tools accelerated and expanded what a single developer could do, tech companies established the practice of having product managers (PMs) and designers specify wh

The Batch News & Insights: A key AI engineering skill is using coding agents. Dear friends,A key AI engineering skill is using coding agents. Your skill at steering them both to write code and to carry out non-code tasks, such as analyzing data or managing system operations, allows you to get a lot more done.The rapid pace of evolution for coding agents means this skill, too, is evolving rapidly — faster than other top-level AI engineering skills. Proprietary agents (like Claude Code, Codex, and

The Batch News & Insights: How have software engineering fundamentals changed with agentic coding? Dear friends, How have software engineering fundamentals changed with agentic coding? Even when you use a coding agent to write all your code, understanding software fundamentals is important for steering your agent to make the tradeoffs you want — or to even know what tradeoffs exist to be made. Additionally, when you’re building an AI application, the AI core is often expressed through a broader

The Batch News & Insights: I previously wrote about our AI Engineering Skills Map, with the highest level skills being (i) Building and... Dear friends,I previously wrote about our AI Engineering Skills Map, with the highest level skills being (i) Building and deploying AI applications, (ii) Software engineering fundamentals, (iii) Using coding agents, and (iv) Shaping the build. In this letter, I will flesh out the first of them. Being skilled at building and deploying AI applications means kno

The Batch News & Insights: I am delighted to present The AI Engineering Skills Map. Dear friends,I am delighted to present The AI Engineering Skills Map. AI allows us to build software very differently today than in 2022, and everyone with the skills to take advantage of this shift has numerous exciting project and job opportunities. But with the noisy, hype-filled, information environment around AI, what are the most valuable skills for you to learn? I have been working with my team to synthesi

The Batch News & Insights: I’m glad the idea of “tokenmaxxing” — that individuals and companies should use as many tokens as possible to boost... Dear friends,I’m glad the idea of “tokenmaxxing” — that individuals and companies should use as many tokens as possible to boost productivity — is finally dying out. As much as I encourage everyone to make ample use of AI, the practical reality is that increasing token usage beyond a certain point gives diminishing returns because there are still bottl

The Batch News & Insights: My team recently had our own version of Hugging Face’s experience when closed models failed to defend the company... Dear friends, My team recently had our own version of Hugging Face’s experience when closed models failed to defend the company following an accidental cyberattack from OpenAI, leading Hugging Face to use the open weight GLM 5.2 instead. When we tried using Claude Code (with Fable 5) and OpenAI’s Codex harness (with GPT-5.6 Sol) to conduct a security rev

The Batch News & Insights: A few frontier labs have tried to tell a story of open models being dangerous because they can be used to launch... Dear friends, A few frontier labs have tried to tell a story of open models being dangerous because they can be used to launch cyberattacks, and of their “safe” proprietary models with strong guardrails being there to defend us. This week, the opposite happened: Users of a closed model unintentionally launched a significant cyberattack; other closed model

The Batch News & Insights: As AI increasingly automates coding, it frees up developers to spend time on high-level software development tasks... Dear friends,As AI increasingly automates coding, it frees up developers to spend time on high-level software development tasks traditionally reserved for senior engineers, like deciding on technical architecture and participating in scoping product requirements. Demand for this type of work is growing, since it is an economic complement to coding, whic

The Batch News & Insights: The key idea of agentic coding loops is to have an agent keep working until it satisfies a condition, such as achieving... Dear friends,The key idea of agentic coding loops is to have an agent keep working until it satisfies a condition, such as achieving a product specification. Coming up with the spec, the evals, or test set is one of the hardest tasks for many AI systems, and a key place to inject human knowledge. Once you have a clear spec, the paths to fulfilling

The Batch News & Insights: The AI world has become incredibly noisy. Social media, traditional media, and an army of marketers produce a cacophony... Dear friends,The AI world has become incredibly noisy. Social media, traditional media, and an army of marketers produce a cacophony of hype and content that are often secretly sales pitches for their products. Good ideas are buried in the noise, but it is hard to figure out what’s worth your time to learn. I want to explain plainly how we decide w