Project Atlas AetherDev project hub
Atlas view

Canonical Storage

Canonical Storage is where raw truth becomes durable truth. These projects normalize schemas, preserve history, and create stable identifiers so data can be reused across tools without re-deriving meaning every time. Storage is where drift is detected, not disguised.
Stage guide

How this stage works

What this stage is

Canonical Storage turns raw truth into stable, reusable datasets. It preserves history and identifiers so downstream systems can trust the boundary.

Inputs

  • Raw extracts and snapshots
  • CSV and JSON feeds
  • Normalized tables or sheets
  • Mapping tables and reference data

Outputs

  • Versioned datasets and snapshots
  • Query-ready tables or sheets
  • Data quality reports
  • Stable identifiers for joins

What good looks like

  • Schemas are documented and stable.
  • History is preserved or versioned.
  • Data quality checks run on ingest.
  • Downstream systems depend on a single source of truth.

Common failure modes

  • Overwrites without history or provenance.
  • Multiple competing sources of truth.
  • Unvalidated data with silent drift.
  • Access controls too broad or too narrow.

Patterns commonly used here

Csv Transform Extract Export Mapping Layer Synchronization Local First Definition of Truth

Representative projects

Results 23 projects
System · Prototyping

Aether Integrator Platform

Centralize integration workflows in a single web app so connectors share authentication, scheduling, and audit controls instead of bespoke scripts. It ingests …

Automation Engines Canonical Storage Operational Adoption Human Interfaces
Open project
System · Active

ASCIP Sync Engine

Provide a deterministic, auditable way to keep district staff data aligned with ASCIP LMS by turning CSV extracts into a repeatable diff-and-apply workflow. …

Reality Ingestion Canonical Storage Automation Engines Operational Adoption
Open project
Experiment · Idea

Email Corpus Ingestion Pipeline (EML)

Transform raw email archives into a structured, searchable knowledge system with strict privacy controls. It ingests EML files export; attachment metadata …

Reality Ingestion Canonical Storage Automation Engines
Open project
Component · Deprecated

camcott

Development and production setup steps for a Laravel application with MySQL. Optional FreeTDS configuration for MSSQL date formatting. It ingests Configuration …

Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Deprecated

clasp

Enable local development, version control, and deployment workflows for Google Apps Script projects. Authenticates a local developer against Google APIs. Syncs …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Active

Data Warehouse

Centralize canonical datasets in a durable storage layer so dashboards, reports, and data-driven systems can depend on consistent truth.

Reality Ingestion Canonical Storage Operational Adoption
Open project
Component · Maintenance

Database-Ingester

Enable safe, repeatable CSV ingestion into SQL Server tables with backups and dry-run visibility. Load config, optionally back up the target table, compare CSV …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Active

District Transfer Tracking

Automates BOUSD transfer intake, normalization, review workflows, Aeries SIS write-back, and enrollment/class-load planning from one governed Google Sheets hub.

Reality Ingestion Canonical Storage Automation Engines Human Interfaces Operational Adoption
Open project
Field Tool · Active

email_template_mailer

Send personalized email campaigns from a CSV-driven dataset while keeping an audit trail of what was sent. Load template + CSV, expand variables, optionally …

Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Active

google-sheet-sync

Provide a consistent, modern CLI with subcommands and config support Support download, upload, and sync with predictable, auditable outcomes Ensure CLI options …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Active

gpt_kit

Scripts transform ticket EML exports into a normalized knowledge base with tagging and optional redaction. Make scripts executable, then run them with input EML …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Field Tool · Maintenance

mssql_query_to_csv

The **MSSQL Query to CSV** program is a command-line tool written in Rust that connects to a Microsoft SQL Server database, executes a SQL query, and exports …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Field Tool · Maintenance

mssql_to_csv

Run SQL files against MSSQL and export results to CSV, optionally through an SSH tunnel. It ingests TOML config, SQL file, MSSQL database and produces CSV …

Canonical Storage
Open project
System · Active

openhab-git-sync

Automated two-way Git synchronisation for openHAB deployments that keeps /etc/openhab and selected /var/lib/openhab subtrees version-controlled without …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Active

Perpetual Data Reports Portal

Turn recurring district report requests into stable, owned, self-service reporting products with visible refresh and ownership discipline.

Reality Ingestion Canonical Storage Human Interfaces Operational Adoption
Open project
System · Maintenance

privateGPT

Expose a private, extensible RAG platform that works offline and keeps data inside the execution environment. Ingest documents from a local folder, splitting …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Field Tool · Prototyping

PrivateGPTConf

Package the steps and configuration needed to get a local PrivateGPT instance running with custom documents. Install prerequisites and clone PrivateGPT to a …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Prototyping

PrivateGPTConf/env/default

Ship a known-good PrivateGPT configuration snapshot that the setup scripts can copy into a local installation. Provide default settings.yaml profiles and …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Experiment · Maintenance

SamsungTVSettings

Exported clone directories used to standardize Samsung TV configuration. It ingests exported clone files and produces clone archives for TV setup.

Canonical Storage
Open project
Experiment · Active

SQL

Centralize operational queries for reporting, audits, and data movement workflows. It ingests Database tables (Aeries and related systems) and produces Query …

Canonical Storage
Open project
Field Tool · Maintenance

sql_to_csv

DB Query to CSV** is a flexible command-line tool written in Rust that connects to SQL databases (such as MSSQL, PostgreSQL, or MySQL) using SQLx, executes a …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project