Jensen Huang states that NVIDIA started as an accelerator company, but the problem with accelerators is that the application domain is too narrow.

Jensen Huang states the odds of 100,000 such AI agents building a company like NVIDIA are 0%.

Jensen Huang predicts that the core purpose of a software engineer's job, such as solving problems, teamwork, diagnosing, evaluating, innovating, and connecting dots, will not go away.

Jensen Huang states that the reason for extreme co-design is to distribute the workload to exceed the benefit of just increasing the number of computers.

Jensen Huang states that NVIDIA had NVLink 72 instead of NVLink 8 when mixtures of experts came out, allowing a 4-10 trillion parameter model to run in one computing domain.

Jensen Huang states that in distributed computing at NVIDIA's scale, the CPU, GPU, networking, switching, and distributing the workload across computers are all problems.