Jensen Huang states that in distributed computing at NVIDIA's scale, the CPU, GPU, networking, switching, and distributing the workload across computers are all problems.

Jensen Huang, CEO of Nvidia, stated he would be alarmed if a top engineer was not burning 250,000 a year in AI compute.

Jensen Huang predicts that the core purpose of a software engineer's job, such as solving problems, teamwork, diagnosing, evaluating, innovating, and connecting dots, will not go away.

Jensen Huang states that NVIDIA started as an accelerator company, but the problem with accelerators is that the application domain is too narrow.

Jensen Huang states that the reason for extreme co-design is to distribute the workload to exceed the benefit of just increasing the number of computers.

Jensen Huang states that NVIDIA had NVLink 72 instead of NVLink 8 when mixtures of experts came out, allowing a 4-10 trillion parameter model to run in one computing domain.