Jensen Huang states that people initially thought the amount of high-quality data would limit AI intelligence, but this pre-training scaling law showed larger models with more data result in smarter AI.

Jensen Huang, CEO of Nvidia, stated he would be alarmed if a top engineer was not burning 250,000 a year in AI compute.

Jensen Huang states the odds of 100,000 such AI agents building a company like NVIDIA are 0%.

Jensen Huang states that the reason for extreme co-design is to distribute the workload to exceed the benefit of just increasing the number of computers.

Jensen Huang states that NVIDIA had NVLink 72 instead of NVLink 8 when mixtures of experts came out, allowing a 4-10 trillion parameter model to run in one computing domain.

Jensen Huang states that people in China are currently teaching AI agents to look for jobs, do work, and make money.