Affording Process Auditability with QualAnalyzer: An Atomistic LLM Analysis Tool for Qualitative Research

Researchers have developed QualAnalyzer, an open-source Chrome extension that makes AI-assisted qualitative research more transparent by preserving detailed audit trails of LLM analysis processes. The tool processes data segments independently and maintains records of prompts, inputs, and outputs to enable systematic comparison between AI and human judgments.

• →QualAnalyzer is an open-source Chrome extension for Google Workspace that enhances transparency in LLM-based qualitative research.
• →The tool processes each data segment independently while preserving complete prompt, input, and output records.
• →Case studies demonstrated the tool's effectiveness in essay scoring and thematic coding of interview transcripts.
• →The approach creates legible audit trails that help researchers identify systematic differences between LLM and human analysis.
• →Process auditability is positioned as essential for making AI-assisted qualitative research more methodologically robust.