From synthetic enterprise data evaluations to real Microsoft Copilot AI confidence

Microsoft describes its Industry Evaluation Data Generation Platform, which builds fully synthetic enterprise environments grounded in public sources such as O*NET occupational data, job postings and SEC filings to evaluate Microsoft Copilot without using customer data. The platform combines synthetic tenants across pharmaceutical, capital markets and IT/software industries with an automated six-stage query generation pipeline and quality frameworks covering structural fidelity, contextual relevance, behavioral realism and content safety. Microsoft reports a 39% improvement on its composite synthetic data quality metric versus its initial approach, some industry environments scoring above 0.9 out of 1.0, and estimated savings of about $100,000 per evaluation dataset and $300,000 in total project savings.