* fix(dashboard): cache org stats in Redis with versioned invalidation Replace the never-expiring process-local cache in the org dashboard page load with API-side Redis caching keyed per org. A version stamp prevents slow reads from writing pre-purge data back into the cache. Invalidate on course create/update/delete, student enroll/remove, certificate claim, and progress reset. Remove the dashboard SSR module cache so every page load reads through the API cache layer. Fixes #852 Co-authored-by: Rotimi Best <[email protected]> * fix(dashboard): address PR review on stats cache invalidation - Validate bust via ZDashStats instead of raw query access - Use import type for OrganisationAnalytics - Resolve orgId before course delete so invalidation is reliable - Invalidate immediately after persisted writes, before fallible side effects - Invalidate on member role changes and program course access enrollment Co-authored-by: Rotimi Best <[email protected]> * fix(dashboard): complete stats cache invalidation coverage Wire org stats cache purge on lesson completion (manual toggle and video-watch auto-complete) so topCourses completion percentages stay fresh. Harden bulk member adds with sequential inserts and a finally invalidation boundary, and only purge org invite enrollments when new group memberships were actually inserted. Co-authored-by: Rotimi Best <[email protected]> * fix(core): make lesson completion stats purge best-effort Wrap org stats cache invalidation in try/catch so a lookup or Redis failure cannot turn a successful lesson completion into a 500. Co-authored-by: Rotimi Best <[email protected]> * fix(dashboard): keep org stats cache through lesson completion Lesson complete is a high-frequency event and usually does not change the rounded dashboard percentages. Rely on a 10 minute TTL instead of purging the snapshot on every completion. Co-authored-by: Rotimi Best <[email protected]> * docs: explain how admin dashboard numbers are calculated Add a user-facing guide covering headline counts, top courses, certificates, login activity, and when the 10 minute snapshot refreshes. Co-authored-by: Rotimi Best <[email protected]> ---------
@cio/db
This package handles everything related to the database, schema, migrations and connection.
Stack
- Postgres - We use postgres for the database
- Drizzle ORM - For managing and querying the database
- Better Auth - For managing the auth tables (users, account, session).
Workflow
We used Supabase in the past for managing the supabase but have now moved on to use postgres directly and auth managed by our backend. This means the workflow is a mix of the Database First approach (Option 1) and the Codebase First approach (Option 2). Learn more about each approach from the drizzle migration docs.
Here is how I do it:
1. Local DB to Drizzle Schema TS file
I have a postgres tool where I can make changes to the db as I want. I am not so familiar with drizzle that much so I am sticking with this for now.
```bash
pnpm db pull # this does sql -> drizzle ts code
```
2. Drizzle Schema file to Prod SQL
Now when I am ready to deploy the feature, I can use option 2 which is makes the typescript schema the source of truth. This command will only run on CI on every merge on a condition that there was a change to the schema file packages/db/src/schema.ts
```bash
pnpm db push # this does drizzle ts code to prod db
```
OR
I can make changes directly to the schema file and run pnpm db push to push the changes to the source db.
Setting up a new DB on Railway
Once you setup a Postgres DB on Railway, you should copyt the DATABASE_PUBLIC_URL and paste into your .env. In the .env we expect DATABASE_URL:
```.env
DATABASE_URL=what-you-copied-from-railway
```
Commands
db:setup
Prepares the database so the application can run. Run this for new databases or after provisioning Postgres.
pnpm db:setup
It performs three steps in order:
- Schema sync – Runs
drizzle-kit pushto apply the TypeScript schema to the database (creates/updates tables, enums, etc.). - PostgreSQL roles – Creates the
authenticatedandanonroles if missing (used by RLS policies). - Essential seed data – Inserts required reference data: roles (ADMIN, TUTOR, STUDENT), submission statuses, and question types.
Optional: Add --seed (or -s) to run the full seed, including demo users, organizations, courses, and other example data.
Requires DATABASE_URL or PRIVATE_DATABASE_URL in the environment. The scripts load .env from this package directory, so bootstrap it once from the template:
cp .env.example .env # then set DATABASE_URL for your DB
db:backfill-profile-email-verification
Repairs stale profile.is_email_verified rows where the auth user is already verified (user.email_verified = true) or has a linked OAuth/SSO account, but the profile flag was never synced. Use after the auth/profile verification mismatch fix, or when users are blocked by the verify-email modal while send-verification-email returns EMAIL_IS_ALREADY_VERIFIED.
Dry run (lists affected count and a sample; makes no changes):
pnpm db:backfill-profile-email-verification
# or from repo root:
pnpm --filter @cio/db db:backfill-profile-email-verification
Apply updates:
pnpm db:backfill-profile-email-verification -- --execute
The script prints how many profiles were updated and verifies zero mismatches remain.
Seeding
The seed script populates the database with demo data for local development. It is idempotent — running it multiple times is safe; existing records are skipped.
Run all seeds
pnpm seed
# or explicitly
pnpm seed --all
Run individual seeds
Pass one or more flags to run only specific steps:
pnpm seed --users --profiles
pnpm seed --organizations --organization-members --organization-plan
| Flag | What it seeds |
|---|---|
--roles |
ADMIN, TUTOR, STUDENT roles |
--submissions |
Submission statuses |
--question-types |
Question types |
--users |
Auth users (from users.json) |
--profiles |
User profiles |
--accounts |
User accounts |
--organizations |
Demo organizations |
--organization-members |
Org membership records |
--organization-plan |
Organization plan records (enterprise + early adopter) |
--groups |
Course groups |
--group-members |
Group membership records |
--courses |
Demo courses |
--sections |
Course sections |
--lessons |
Lessons |
--exercises |
Exercises |
--questions |
Questions |
--templates |
Exercise templates |
Demo accounts
| Password | Role | Plan | |
|---|---|---|---|
[email protected] |
123456 |
Admin | Basic (free) |
[email protected] |
123456 |
Student | Basic (free) |
[email protected] |
123456 |
Admin | Enterprise |
[email protected] |
123456 |
Student | Enterprise |
[email protected] |
123456 |
Admin | Early Adopter |
[email protected] |
123456 |
Student | Early Adopter |
Mock user credentials are defined in users.json. The demo accounts above use the password 123456.