perf: optimize API queries and add database indexes #347

Merged

review.bot merged 1 commit from fix/338-ui-performance into develop

2026-03-02 14:15:53 +00:00

jack commented

2026-03-02 14:15:46 +00:00

Owner

Summary

getProjectStats(): Replace list() with count() for session/observation/summary counts, use small sample (100) for token estimation instead of loading all records
getAnalyticsTypes(): Reduce limit from 100K to 5K — only needed for type distribution counts
getAnalyticsProjects(): Remove 1K observation load per project for token sums (was causing N+1-like overhead)
getProjectFiles(): Reduce limit from 10K to 500 — only top 50 files are returned anyway
Add composite indexes: Task(status, created_at), Session(project, status), Observation(project, type) for faster filtered queries

Closes #338

## Summary - **`getProjectStats()`**: Replace `list()` with `count()` for session/observation/summary counts, use small sample (100) for token estimation instead of loading all records - **`getAnalyticsTypes()`**: Reduce limit from 100K to 5K — only needed for type distribution counts - **`getAnalyticsProjects()`**: Remove 1K observation load per project for token sums (was causing N+1-like overhead) - **`getProjectFiles()`**: Reduce limit from 10K to 500 — only top 50 files are returned anyway - **Add composite indexes**: `Task(status, created_at)`, `Session(project, status)`, `Observation(project, type)` for faster filtered queries Closes #338

jack added 1 commit

2026-03-02 14:15:46 +00:00

perf: optimize API queries and add database indexes (#338 ) da8389ffe6

- Replace list() with count() in getProjectStats() (was loading 10K+ records)
- Reduce getAnalyticsTypes() limit from 100K to 5K (cached anyway)
- Remove N+1 token loading in getAnalyticsProjects() (3 queries per project)
- Reduce getProjectFiles() limit from 10K to 500 (only returns top 50)
- Add composite indexes: Task(status, created_at), Session(project, status),
  Observation(project, type)

review.bot

2026-03-02 14:15:48 +00:00

added the
component
api

priority
medium

type
enhancement
labels
requested review from review.bot

review.bot reviewed

2026-03-02 14:15:52 +00:00

review.bot left a comment

Owner

AI Code Review (Devstral)

The PR implements performance optimizations for API queries and adds database indexes. The changes align well with the linked issue #338, addressing excessive load times by reducing query limits and using count() instead of list() where appropriate. The added indexes will improve query performance on filtered data.

Automated review by pr-reviewer

## AI Code Review (Devstral) The PR implements performance optimizations for API queries and adds database indexes. The changes align well with the linked issue #338, addressing excessive load times by reducing query limits and using count() instead of list() where appropriate. The added indexes will improve query performance on filtered data. --- *Automated review by [pr-reviewer](https://github.com/customable/pr-reviewer)*

review.bot added

and removed

labels

2026-03-02 14:15:52 +00:00