Announcing Artificial Analysis for Government: benchmarking, advisory and data to help public sector clients design AI policy and select AI technologies
Our services help public sector clients to:
➤ Design AI policy and support decision-making: Our benchmarking and expertise can inform the urgent decisions governments must make in navigating AI - for example, how to secure critical infrastructure, safeguard employment and growth, and balance national priorities including innovation, competition, and security. We recently signed an MOU with the Korean Government as an independent evaluator supporting Korea’s efforts to develop globally competitive frontier AI models and strengthen its domestic AI ecosystem.
➤ Select AI Technologies: We are the go-to resource for millions of users navigating AI. We can support governments to deploy the most effective agents at the lowest cost, empower public sector workers, and plan for future use cases.
Our topic expertise includes:
➤ Capability, cost and performance: We are the global standard in measuring capabilities, accuracy, hallucination, cost, speed and latency of models and agents. Our benchmarking is widely referenced by top AI labs and news outlets.
➤ Cybersecurity and safety: The Artificial Analysis Cyber Index Alliance brings together partners including NVIDIA, IBM, Vercel and Collinear to set a new standard for evaluating AI cyber defense. This launched alongside the Artificial Analysis Cyber Index, which evaluates how well agents find and fix vulnerabilities. On safety, we evaluate models on a broad spectrum of harms across escalating levels of adversarial pressure. We recently partnered with NVIDIA to benchmark guardrail models for safety and refusal.
Get in touch at the link below
