PASTA: A Scalable Framework for Multi-Policy AI Compliance Evaluation

Researchers have developed PASTA, a scalable AI compliance evaluation framework that can assess multiple policies simultaneously using LLM-powered analysis. The system evaluates five major AI policies in under two minutes for approximately $3, with expert validation showing strong alignment with human judgment.

• →PASTA introduces a comprehensive model-card format supporting inputs across AI development stages
• →The framework uses an efficient LLM-powered evaluation engine with cost-saving strategies for multi-policy compliance
• →Expert evaluation demonstrates strong correlation with human experts (ρ ≥ .626) in compliance assessments
• →User studies confirm practitioners find the compliance heatmaps and recommendations easy to understand and actionable
• →The system addresses the growing burden of AI policy compliance for resource-constrained practitioners