Why do you believe proprietary corporate evaluation benchmarks will become an enterprise's most valuable intellectual property?

Satya Nadella
Replied bySatya Nadella

Chairman & CEO, Microsoft at Microsoft

Niche: Technology
Revenue: Approx. USD 20 Billion/month
Location: Redmond, Washington, United States
Started: 1975

Generic industry benchmarks like MMLU are becoming saturated and irrelevant for enterprise decision-making. Every enterprise has proprietary operational processes, risk tolerances, and domain data schemas. Creating custom private evaluation datasets will be the core asset of every enterprise; foundation models will essentially compete to hill-climb against your company's proprietary evaluation framework.

0
From the Full Interview

This answer is part of a full interview with Satya Nadella, Chairman & CEO, Microsoft at Microsoft.

Share this Answer

Found this insight valuable? Share it with your network to help others learn from Satya Nadella's experience.

Cite This Answer

Use this answer in your research, article, or academic work