Revealing the mysteries of ChatGPT

The Scene

OpenAI’s industry-leading large language model has been a black box. That’s why research and consulting firm SemiAnalysis’ exhaustive deep dive into the technical details of GPT-4 caught the attention of many in the industry. Its paper, revealing new details about the LLM, was a bombshell in the small but growing world of people who obsess about the technology.

SemiAnalysis covers the semiconductor and AI industries, and has five analysts across Asia, Europe, and the U.S. We talked to the company’s chief analyst Dylan Patel about its findings in an edited conversation…