MemPABench Anonymization Protocol

Goal

Convert a source persona into an anonymized benchmark persona without changing its behavioral evidence, preference setting, or evaluation meaning. The protocol separates identity replacement from preference extraction and requires human approval before promotion.

Rules

  • Replace names, locations, employers, dates, and uniquely identifying details consistently across persona, world, script, and evidence artifacts.
  • Preserve evidence meaning and provenance. Do not invent evidence to make a replacement smoother.
  • Keep source identity, replacement mapping, and approval material outside the published benchmark bundle.
  • Avoid collisions: a replacement identity must be distinct from every already approved persona.

Acceptance

Generation produces a candidate bundle and mapping record. A human owner approves or rejects each ambiguous decision. Deterministic validation checks required fields, mapping consistency, dangling source identifiers, and cross-file references. Archetype review then checks that the replacement still supports the intended role and interaction setting. Only a fully approved, validated bundle is promoted.

Audit

The approval record, validation output, source digest, and promoted artifact digest are retained with the run materials. A failed check blocks promotion; no partial persona enters runtime.