archy/aiui/.claude/skills/audit-prompts/SKILL.md at 6f1efcbf7e03e6ed1a4580835fb138fa7133eefa

Files

T

git-subtree-dir: aiui
git-subtree-mainline: 0c4826f8cc
git-subtree-split: e30ac1d106

2026-08-03 15:07:11 -04:00

name, description, allowed-tools

name	description	allowed-tools
audit-prompts	Deep audit of AI system prompts — find gaps, test extraction coverage, verify tag formats	Bash(*), Read, Glob, Grep, Agent

Perform a comprehensive audit of AIUI's AI prompt system. Do NOT make changes — report findings only.

Steps

Read the full system prompt: Read packages/app/src/composables/useAI.ts and reconstruct the complete system prompt including all dynamic sections (persona, Wavlake, memory, web search, Archy context, code context).
Catalog all tag formats: List every [[type:...]] and [[type_ext:...]] format defined in the prompt. Cross-reference with regexes in contentExtraction.ts.
Check for gaps: For each content type in ContentTab (contentFiltering.ts), verify:
- Is there a tag format in the system prompt?
- Is there a matching extraction regex?
- Is there a query classifier?
- Is there a grid + detail component?
- Is the tab wired in ContentPanel.vue and ContentGridView.vue?
Test extraction coverage: Read the seed prompts in src/__tests__/fixtures/seedPrompts.ts. For each seed, verify:
- Does the extraction function find the expected number of items?
- Are there edge cases that would break extraction?
Analyze prompt quality: Check for:
- Conflicting instructions
- Missing edge case handling (e.g., "what if the AI can't find a match?")
- Overly vague instructions
- Missing content types that should have tag formats
Check proxy tools: Read server/claude-proxy.ts and verify tool definitions match what the prompt claims.
Report: Create a structured summary with:
- Content type coverage matrix (tag/extraction/grid/detail/prompt)
- Identified gaps and inconsistencies
- Priority recommendations