vibe.review.services.analytics_service

Analytics and accuracy tracking for VIBE Review.

Calculates AI accuracy based on human override patterns and identifies requirements where the AI is consistently underperforming.

ReviewAnalyticsService

Service for calculating review accuracy and analytics.

Extracted from ReviewService to follow single-responsibility principle.

get_accuracy_stats 

get_accuracy_stats(template_id: str | None = None, requirement_id: str | None = None) -> AccuracyStats

Calculate AI classification accuracy based on human overrides.

Parameters:
  • template_id (str | None, default: None ) –

    Optional filter by template.

  • requirement_id (str | None, default: None ) –

    Optional filter by requirement.
Returns:

get_problematic_requirements 

get_problematic_requirements(template_id: str, min_override_rate: float = 0.2, min_samples: int = 5) -> list[RequirementAccuracyStats]

Find requirements where AI frequently gets it wrong.

Parameters:
  • template_id (str) –

    Template to analyze.

  • min_override_rate (float, default: 0.2 ) –

    Minimum override rate to flag (0.0-1.0).

  • min_samples (int, default: 5 ) –

    Minimum sample size to include.
Returns: