LLM-PBE: Assessing Data Privacy in Large Language Models

A toolkit crafted specifically for the systematic evaluation of data privacy risks in LLMs, incorporating diverse attack and defense strategies, and handling various data types and metrics.

SIGMOD 2024
(Best paper nomination)