How will the semiconductor hardware landscape evolve as custom silicon from hyperscalers proliferates?

Naveen Rao
Replied byNaveen Rao

VP of Generative AI & Former CEO of MosaicML at Databricks

Niche: AI
Revenue: Approx. USD 583 Million/month
Location: San Francisco, California, USA
Started: 2013

NVIDIA will continue to dominate frontier training and flexible research workloads because the CUDA software ecosystem has an insurmountable compounding developer moat. However, high-volume repetitive inference workloads will increasingly shift toward custom ASICs and hyperscaler silicon optimized specifically for cost per token and energy efficiency.

0
From the Full Interview

This answer is part of a full interview with Naveen Rao, VP of Generative AI & Former CEO of MosaicML at Databricks.

Share this Answer

Found this insight valuable? Share it with your network to help others learn from Naveen Rao's experience.

Cite This Answer

Use this answer in your research, article, or academic work