Page Inspect

Snorkel AI – Expert Data





**Snorkel helps build Terminal-Bench 2.0.** Learn more

- Product

- - SNORKEL AI DATA DEVELOPMENT PLATFORM
- Snorkel Expert Data-as-a-Service
- Platform Overview
- Snorkel Evaluate
- Snorkel Develop
- Snorkel Predictive ML
- Expert Data
- CUSTOM EXPERT-LEVEL DATA
- Expert Data-as-a-Service
- Use Cases
- Leaderboard
- Expert Network
- Leaderboards
- Solutions

- - SERVICES
- Snorkel Expert Data-as-a-Service – Learn more about Snorkel’s white-glove service for creating expert training and evaluation data.
- - INDUSTRIES
- Banking & Finance
- Healthcare
- Insurance
- Public Sector
- - Customers
- Customer Stories – See how Snorkel is powering innovation in the Fortune 500 and beyond.
- Research
- Resources

- - LEARN
- Customer Stories
- Blog
- Resource Library
- Docs
- - ENGAGE
- Webinars
- - AI PRIMERS
- Data-centric AI
- Data Labeling
- Generative AI
- Large Language Models
- LLM evaluation
- Company
- About Us
- Careers
- Partners
- Press & News
- Contact Us
- Docs
- Welcome to Snorkel
- Installation Overview
- SDK Reference
- Glossary
- Full Documentation
- Talk to an AI expert

Close

Talk to an AI expert

Get a demo

Search result for:

SearchSubmitClear

# **Expert data.
**Unparalleled quality.

Snorkel delivers the highest quality specialized datasets for frontier LLMs and enterprise models.

Learn more

Talk to an AI expert

## Proud to partner with leading AI companies

“Anthropic is committed to working with innovators like Snorkel to ensure AI systems are refined, reliable, and aligned to enterprise needs.”

Kate Jensen

Head of Revenue, Anthropic

## Snorkel AI services and technology

Helping model providers and AI development teams push the boundaries of AI

Expert Data-as-a-Service

## Expert training and evaluation data

Snorkel AI researchers and expert contributors curate and deliver specialized, high-quality datasets based on customer specifications and goals.

Learn more

AI/ML Solution Services

## Custom models and evaluations

Snorkel applied AI engineers and researchers curate training and evaluation data, and use it to provide you with specialized LLMs and evaluations.

Contact us

AI Data Development Platform

## AI data curation technology

Snorkel will deploy its AI data development platform on your infrastructure, enabling your AI/ML teams to curate AI data themselves.

Learn more

## Expert data, specialized AI

Learn how to turn expert knowledge into specialized AI at scale using Snorkel Expert Data-as-a-Service and Snorkel Evaluate.

## Trusted by Leading AI Teams

Snorkel supports cutting-edge research labs and model development teams building the next generation of AI models.

Text Generation

### A PhD-level benchmark for frontier LLMs

A leading LLM developer sought a dataset of multiple-choice Q&A questions that stretched beyond the limits of frontier LLMs. Snorkel AI developed a dataset that probed for PhD-level understanding, covering thousands of topics across humanities, STEM, and professional domains.

* * *

### <20%

Pass rate by two frontier LLMs

### 1,000+

PhD-level sub-domains

Agentic

### The frontiers of multi-turn math reasoning

Snorkel provided a frontier LLM team with a dataset to assess LLM math reasoning skills on high school to graduate-level challenges. Our data development approach saw experts correct responses and reasoning traces and allowed the customer to control distribution across topics, skills, and complexity.

* * *

### 0%

Pass rate for frontier LLMs

### 900

Mathematical skills

Coding

### Alignment for better code generation

A frontier model developer sought to improve code generation outputs using human feedback. Snorkel rapidly assembled a team of qualified engineers to assess, review, and grade multiple candidate code responses to user queries, resulting in a rich training set to better align the model.

* * *

### 8

Assessment criteria per code generation

### 21

Coding languages assessed

Agentic

Text Generation

### Multi-step, multi-turn, and multi-tool Deep Research data

A leading LLM provider hired Snorkel AI to create a dataset to enhance its models’ deep research capabilities. Snorkel researchers assembled a dataset where each data point included a complex user query, a high-quality research plan, and a fine-grained response quality evaluation rubric.

* * *

### 10+

Average interactions between model and user

### 30+

Evaluation criteria developed per task on average

## Featured Benchmarks

Exclusive to Snorkel, these benchmarks are meticulously designed and validated by subject matter experts to probe frontier AI models on demanding, specialized tasks.

These are just a few of our featured benchmarks — new ones are added regularly, so check back often to see the latest from our research team.

### SnorkelUnderwrite

An expert-verified frontier benchmark with multi-turn conversations, focused on agentic reasoning and tool use in commercial underwriting settings.

View All Results

### Finance Reasoning

A benchmark co-created with Snorkel's financial expert network, to test agents on financial reasoning questions, through tool-calling and planning.

View All Results

### SnorkelSequences

A procedurally-generated and expert-verified benchmark for evaluating mathematical reasoning and compositional capabilities in LLMs.

View All Results

View all benchmarks

Born at the Stanford AI lab

## Research with real-world impact

* * *

Snorkel began in 2015 as the Snorkel Research project at the Stanford AI lab in collaboration with Google, Intel, DARPA, and other leading organizations.

The Snorkel AI team and affiliated researchers have been at the cutting edge of AI with over 170 published peer-reviewed research papers with special recognition at events such as NeurIPS, ICML, and ICLR.

Learn about Snorkel research

See how Snorkel can help you get up to:

100x

Faster Data Curation

40x

Faster Model Delivery

99%

Model Accuracy

Let’s talk

### Product

- Platform Overview
- Snorkel Evaluate
- Snorkel Develop
- Snorkel Expert Data-as-a-Service
- Predictive ML

### Expert Data

- Expert Data-as-a-Service
- Use Cases
- Leaderboard
- Expert Network

### Solutions
### Services

- Snorkel Expert Data-as-a-Service

### Industries

- Banking & finance
- Healthcare
- Insurance
- Public sector

### Customers

- Customer stories

### Resources
### Learn

- Blog
- Resource library
- Docs

### Engage

- Webinars

### AI Primers

- Data-centric AI
- Data labeling
- Generative AI
- Large language models
- LLM evaluation

### Docs

- Welcome to Snorkel
- Installation overview
- SDK reference
- Glossary
- Full documentation

### AI Research

- Snorkel research
- Research papers

### Company

- About
- Careers
- Partners
- Press & news
- Security

### Contact

- Contact us
- Talk to an AI expert

### Compliance

* * *

Copyright © 2025 Snorkel AI, Inc. All rights reserved.

Terms of Use Privacy Cookie Policy