I completely ignored Anthropic’s advice and wrote a more elaborate test prompt based on a use case I’m familiar with and therefore can audit the agent’s code quality. In 2021, I wrote a script to scrape YouTube video metadata from videos on a given channel using YouTube’s Data API, but the API is poorly and counterintuitively documented and my Python scripts aren’t great. I subscribe to the SiIvagunner YouTube account which, as a part of the channel’s gimmick (musical swaps with different melodies than the ones expected), posts hundreds of videos per month with nondescript thumbnails and titles, making it nonobvious which videos are the best other than the view counts. The video metadata could be used to surface good videos I missed, so I had a fun idea to test Opus 4.5:
// ⚠️ 易错点4：循环条件写right = 0（会导致right-1越界），或把<=写成<（漏判相等的有序情况）
，这一点在快连下载安装中也有详细论述
After realizing that re-creating the entire continent was too lofty a goal, the group decided to instead focus on the rest of the Morrowind province alone—but that didn’t last long.
This analysis should be able to be extended to any arbitrary input `channel_id`.