Project archive
SYS-02 / Data quality · analytics product

AI Data Quality Checker

Analyze CSV files repeatably, reveal quality issues and generate practical cleaning recommendations.

STATUSPublished on GitHub
ROLEQuality engine, API, dashboard and reports
FLOW / SYS-02
  1. 01CSV
  2. 02Validação
  3. 03Regras
  4. 04Score
  5. 05Persistência
  6. 06Relatório
  7. 07Dashboard
EXECUTIVE SUMMARY

A full-stack application combining FastAPI, Pandas, SQLite, Markdown/HTML reports and a Vue 3 dashboard. The system scores datasets, evaluates columns and turns quality rules into a professional visualization.

  • FastAPI
  • Pandas
  • SQLite
  • Vue 3
  • TypeScript
  • Vitest
  • Docker
SYS-02.01

Context and problem #

Data teams need a quick reliability read before modelling, integrating or exposing datasets. The project automates that triage without hiding the applied rules.

SYS-02.02

My contribution #

The case highlights API design, a Pandas engine, persistence, tests and a decision-oriented interface with exports for technical documentation.

SYS-02.03

Architecture #

The Vue frontend sends the dataset to FastAPI, which runs quality rules, calculates scores, saves history in SQLite and generates HTML/Markdown reports.

  • Rule-based engine
  • Dataset and column scores
  • Markdown/HTML export
  • Optional LLM summary
SYS-02.04

Evaluation and quality #

Evaluation is oriented around observable problems: missing values, divergent types, distribution, duplication and actionable recommendations.

SYS-02.05

Limitations #

The system analyzes CSV files and aggregate metrics; it does not replace business validation or formal data contracts.

SYS-02.06

Next steps #

Add Excel, relational connections, run comparisons, quality alerts and PDF export.