KNOWLEDGE NOTES

Knowledge Notes

Explore curated knowledge, course notes and methods, with their existing content and sources preserved.

This index lists complete English editions. Additional Chinese notes and bilingual updates remain available in the Chinese index.

350knowledge notes
AI Engineering / Anthropic and Claude

AI Agent Evaluation Methodology (A Deep Dive into Anthropic Engineering Team's demystifying-evals)

A systematic framework for agent evaluation released by the Anthropic engineering team in 2026. It covers an 8-entry concept glossary, a 3-type grader matrix, the dual-track Capability vs Regression evaluation design, 4 sets of evaluation playbooks for different agent categories (coding / conversational / research / computer use), an 8-step roadmap for building evaluations from scratch, the mathematical intuition behind pass@k vs pass^k, the evaluation framework ecosystem, and common anti-patterns. Phase A anchors the wiki, and sets the density and bilingual style baseline for the anthropic-* series of content.

Agent EvaluationEvaluation methodsQuality assuranceEnglish edition
AI Engineering / Newtype

AI Agent Technology Architecture Evolution 2025 (In-Depth Research Report)

A research report on the evolution of AI Agent technology architecture compiled by newtype in January 2026. It is based on papers published from October 2024 to January 2026, official blogs from Anthropic/OpenAI/Google/Microsoft, open-source projects, and real-world deployment cases. It covers 6 major evolution trends / 4 multi-Agent orchestration patterns / Google's 8 foundational patterns / memory management (MemoryOS 3-layer architecture + vector database selection) / tool calling + MCP standardization / reasoning frameworks (ReAct → ToT → GoT → WoT evolution) / Large Reasoning Models (LRM) / 7-layer production architecture / comparison of mainstream frameworks (LangGraph/CrewAI/MAF/AutoGen/LlamaIndex/ADK) / real deployment cases from Morgan Stanley + Klarna + BBVA + Rakuten / 2026 trend forecasts / compliance and governance / production checklist. It serves as a "research report-level" supplement to [[newtype-agent-architecture]] (Huang Yihe's post-level judgments).

AI EngineeringAgent WorkflowsModels and EvaluationEnglish edition
AI Engineering / AI Builders

AI Builders · Frontier Model Research and the Path to AGI (Podcast Digest)

13 episodes of frontier research podcasts reorganized by "debates": LeCun bashing LLMs (dead end vs. the scaling camp) / three camps on world models: JEPA vs. linguistic symbols vs. renderers / whether continual learning is overhyped / whether RL can succeed outside the coding domain / recursive self-improvement via AI building AI / frontier risks and alignment / Hassabis's endgame for AGI / three non-mainstream architectures: EBM, Mistral, Leanstral. Speakers include LeCun, Pachocki, Dubois, Kolter, Manning, Dehghani, Vinyals, Hassabis, Brockman

Frontier modelsAGIModel ResearchEnglish edition
AI Engineering / 42 Chapters Cross-Episode Thematic Compilation / 42 Zhangjing podcast synthesis

AI Industry and Infrastructure: Capabilities, Delivery, Capital and Value Allocation / AI Industry and Infrastructure

Drawing on interviews spanning 2023–2026, this piece separately examines model capabilities, real demand, delivery, operating returns and capital pricing, while preserving historical disagreements. A cross-interview synthesis separating model capability, demand, delivery, business returns and valuation, with historical disagreements preserved.

AI IndustryInfrastructureComputing powerBusiness modelsAI InfrastructureEnglish edition
AI Engineering / 42 Zhangjing · Episode notes

AI Infrastructure Starts with Choosing Which Bill to Optimize

Listen: 01:07–07:11; 08:40–11:20. Zhu reduces the underlying problems to computation, communication, and storage. GPUs need networks, switches, storage, operations, resource scheduling, and training and inference frameworks. His comparison with cloud service layers is an explanatory framework, not the only possible industry taxonomy.

42 ZhangjingEpisode analysisAI EngineeringEnglish edition
AI Engineering / 42 Zhangjing · Episode notes

An Agent Must Handle the Consequences of Action: Pokee’s RL and Language-Model Approach

A business trip can appear to require only an itinerary. Across cities, days and meetings, however, hotels, transport and timing constrain one another. An early choice can make the eleventh step impossible. Bill uses this example to explain why an agent needs to consider consequences, search alternatives and recover when a path fails.

42 ZhangjingEpisode analysisAI EngineeringEnglish edition
AI Engineering / Anthropic and Claude

Anthropic · Claude Managed Agents Platform + 2026 Product/Security Updates (Official Blog Condensed)

Themed condensation of 13 official 2026 blog posts. The core is Claude Managed Agents — a set of APIs for "renting Anthropic's cloud infrastructure to run long-horizon agents": memory (cross-session memory) + dreaming (sleep-time self-improvement) + outcomes (scored self-correction) + multiagent (lead-worker collaboration) + self-hosted sandboxes (bring-your-own sandbox) + MCP tunnels (private network tunnels), underpinned by a decoupled meta-harness design of three components: "brain (Claude + harness) / hands (sandbox) / session logs". Additional content covers the Claude Code desktop app rebuild (parallel agents) + harness design philosophy (use tools Claude already knows / keep asking "what can I turn off") + enterprise deployment data + containment security architecture for three products + a security checklist for AI-accelerated offense and defense + chart visualization / frontend Skills / lifestyle connectors.

Hosted AgentsAgent ArchitectureSecurity updatesEnglish edition
AI Engineering / Anthropic and Claude

Anthropic AI Safety / Alignment / Policy Research Complete Collection (Constitutional AI + RSP + Welfare + Policy)

Hub of 11 entries from the Anthropic research section: Constitutional AI (2022 foundational) + Automated Alignment Researchers (2026 scalable oversight) + Petri open source (donating-open-source-petri) + deprecation commitments (models not deleted) + end-subset-conversations (Claude welfare) + Teaching Claude Why (follow-up to agentic misalignment) + Project Vend Phase 2 (failed Claudius red team experiment) + 2028 AI Leadership (US-China) + Anthropic Institute 4 major research agendas + Core Views on AI Safety + full ASL3 overview. The 5 pillars of Anthropic's safety stance: Constitutional + RSP/ASL / Transparency / Welfare / Red Team

AI SafetyModel AlignmentGovernanceEnglish edition
AI Engineering / Anthropic and Claude

Anthropic Interpretability + Claude Behavior Research (Natural Language Autoencoders + User Usage Insights)

5 hub articles from the Anthropic research section: Natural Language Autoencoders (decoding Claude's internal activations into natural language, a major breakthrough in May 2026) + How people ask Claude for personal guidance (sampling of 1 million conversations / 6% are seeking life advice) + BioMysteryBench (bioinformatics evaluation) + Why do AI models hallucinate? + What is sycophancy? + 4 research team pages (Alignment / Economic Research / Interpretability / Societal Impacts). Covers three areas of research: "how AI thinks internally + how users use it + what bugs it is prone to"

Model InterpretabilityAI BehaviorSecurity researchEnglish edition
AI Engineering / Newtype

AWS Agent Lecture Series 2025 (Compilation of 4 Talks)

Compilation of 4 talks from the 2025 Amazon Web Services Agent lecture series. Wang Qixiang (Reasoning Model + Agent Brain + Multi-Agent Orchestrator + Framework Comparison) / Wang Xiaoyan (4 Elements of Agentic AI: Planning/Memory/Tool/Action + 3-tier Capability Ladder + RL + Product Pricing) / Chang Gaowei (ANP Protocol: email for agents, USB-C counterpart to MCP, W3C DID + P2P architecture) / idoubi (Independent development practice + AI Wrapper SOP + ProductHunt launch + programmatic SEO + all-in direction). Serves as the "industry practical perspective" supplement to the [[newtype-agent-architecture-research-2025]] research report.

Agent architectureMulti-Agent systemsAI Product PricingEnglish edition
AI Engineering / 42 Zhangjing · Episode notes

Building Environments for Agents: Feedback, Boundaries and Resuming After an Interruption

An agent performing tasks needs more than a capable model. It must run code, browse websites, preserve login, wait for confirmation and return to its previous position. Lei calls the supporting environments Agent Infra, or agent infrastructure. He wants Grasp to handle common browser engineering so application developers can concentrate on industry tasks.

42 ZhangjingEpisode analysisAI EngineeringEnglish edition
AI Engineering / 42 Zhangjing · Episode notes

Character.AI’s Post-Training: More Conversation Does Not Necessarily Mean Better Understanding

Open conversation has no single correct answer. A user may enjoy a response, rewrite it, delete it or request another. Reflecting on approximately a year at Character.AI, Ted discusses turning such behavior into data, training and experiments. The central subject is a system that continually discovers mistakes.

42 ZhangjingEpisode analysisAI EngineeringAI CompanionshipEnglish edition
AI Engineering / Cross-source synthesis

Claude Code Insider Discoveries (Telemetry / Codenames / Undercover Mode / Remote Kill Switch / Roadmap)

"Non-public" details dug out from the leaked source code of CC v2.1.88: what the dual-layer telemetry collects and that you cannot opt out / model animal codenames (Tengu · Capybara · Fennec · Numbat) + behavioral bugs in Capybara v8 / differential treatment between internal and external users / Undercover mode that hides AI identity / hourly-polling remote killswitch / unreleased features such as the KAIROS autonomous agent. Read this if you want to know "what CC hides inside"

Telemetry and PrivacyProduct SecurityFeature flagsEnglish edition