Jensen Huang states that if computation represents 50% of a problem and is sped up infinitely, the total workload is only sped up by a factor of two due to Amdahl's Law.

Jensen Huang, CEO of Nvidia, stated he would be alarmed if a top engineer was not burning 250,000 a year in AI compute.

Jensen Huang states that the reason for extreme co-design is to distribute the workload to exceed the benefit of just increasing the number of computers.

Jensen Huang states that in distributed computing at NVIDIA's scale, the CPU, GPU, networking, switching, and distributing the workload across computers are all problems.

Jensen Huang states that Moore's Law has largely slowed because Dennard scaling has slowed.