VoxPolyBench Research preview

A BENCHMARK FOR MULTI-PARTY SPOKEN MEMORY

Remember the conversation.
Remember who.

VoxPolyBench tests long-term memory in spoken histories where the same people return, facts change, and the answer depends on who said what to whom.

Explore the benchmark View dataset statistics

Controlled, synthesized speech across recurring participants and sessions.

MULTI-SESSION HISTORYSESSIONS ACROSS TIME
SESSION 01
A00:12
B00:28
C00:46
Persistent people. Evolving facts.
SESSION 08
B18:34
A18:51
?What changed, and who should know?
18longitudinal scenarios
176conversation sessions
9,599spoken dialogue turns
1,527question–answer instances
18.9hdialogue audio

01 / THE BENCHMARK

Memory is social.
Speech makes it harder.

Each scenario follows a recurring group through 8 to 12 sessions. A system must connect voices and participants over time, track changing information, and answer questions grounded in the shared history.

01

Recurring speakers

Participants return across sessions with stable voices, creating an identity thread through the history.

02

Evolving memory

Plans, preferences, and facts are updated, contradicted, and resolved over multiple conversations.

03

Directed interaction

Questions may depend on the source speaker, the addressee, or who should receive a response.

04

Personalized answers

The same shared history can support different answers for different participants.

02 / DATASET PROFILE

Built as histories,
measured as histories.

These figures describe the accepted 18-scenario catalog. The speech is synthesized from fixed participant reference voices; the benchmark evaluates controlled spoken-memory conditions.

Duration and number of dialogue turns across 18 histories
01 / HISTORY SCALEDuration and turn count across the 18 case histories.
Nested taxonomy of 1,527 QA instances across four task families and nine fine-grained types
02 / QUESTION TAXONOMYFour task families, nine fine-grained question types.
Word cloud of dialogue terms across the dataset
03 / DIALOGUE DOMAINSCase-balanced terms from dialogue turns only.
Retrieval & reasoning
443
Evolving memory
324
Interaction attribution
326
Personalized memory
434

03 / CASE STUDIES

Two histories,
closer up.

These examples are drawn from two accepted histories. Questions and reference answers are reproduced from the benchmark, not written as illustrative prompts.

FEATURED AUDIO STORY8 sessions · 480 turns · 75 questions

Family city break

A family and travel contacts coordinate trains, hotel rooms and activities as plans evolve across the trip.

Family coordinationSpeaker & addresseePersonalization

Example questions

AddresseeWho was Nora Patel speaking to when she said she’d really like a quiet room away from the elevator?

Reference answerTessa Kim

Multi-hopWhere can you stay to avoid elevator noise and what time is the walking tour that keeps you dry?

Reference answera quiet room away from the elevator; a 3 p.m. walking tour

Memory updateWhat is the later plan after the earlier 11:30 entry slot?

Reference answera 3 p.m. walking tour

PersonalizedWhat kind of update did I say I prefer?

Reference answera written itinerary

LISTEN TO THE HISTORY

Family-trip dialogue

Session-level MP3

Checking the audio package…

CASE STUDY8 sessions · 480 turns · 75 questions

Kitchen renovation

A shared renovation history where decisions, dates and responsibilities change across conversations.

Fact updatesMulti-hop retrievalInteraction attributionPersonalization

Example questions

Memory updateWhat was the previous and current outlet count for the kitchen island?

Reference answerThe kitchen island outlet count was changed from six to eight outlets.

Multi-hopWhat is the current outlet count for the kitchen island and the order ID for the change order?

Reference answerThe kitchen island has eight outlets, and the change order ID is CO-17.

InteractionWhen Diego Alvarez asked if the access card could be handed off to subcontractors or had to stay with them, who were they speaking to?

Reference answerCarla Rossi

PersonalizedWhat did I agree to take care of after the resident complained about the work?

Reference answerI said I would handle the notifications.

The complete benchmark has 18 histories. This page highlights two; the family-trip history is the selected audio example with dialogue and ten synthesized personalized queries.

04 / DATA ACCESS

A clear path from
history to evidence.

This project repository hosts the selected audio demo. For dataset files and release updates, visit VoxPolyBench on Hugging Face. The Arrow release separates dialogue content and QA samples by case, with audio embedded in the dataset files.

Hugging Face dataset ↗
ILLUSTRATIVE RELEASE STRUCTURE
GitHub Pages /
├─ index.html
├─ assets / figures
└─ assets / audio / selected-story
   ├─ demo_manifest.json
   ├─ S1–S8.mp3
   └─ q01–q10.mp3

Full dataset release /
└─ cases / 18 case directories
   ├─ full_case.json
   ├─ audio / turn-level WAV
   └─ audio_persona / QA WAV

The compressed case demo does not replace the canonical turn-level audio.