Atlas view

Reality Ingestion

Reality Ingestion is where truth enters the system. These projects pull from messy, real sources (SIS, HR, vendors, logs, manual exports) with minimal disruption. The goal is capture, not interpretation, so downstream systems can trust the boundary and repeat the process.
Stage guide

How this stage works

What this stage is

Reality Ingestion captures raw truth from messy sources with minimal transformation. The goal is repeatable extraction that preserves fidelity and produces trustworthy run artifacts.

Inputs

  • Vendor APIs and exports
  • SIS/HR extracts
  • Logs and telemetry streams
  • Manual CSVs and spreadsheets
  • Filesystem drops or inboxes

Outputs

  • Raw extracts and snapshots
  • Normalized CSVs with stable headers
  • Ingestion logs and error reports
  • Source metadata (timestamps, run IDs)

What good looks like

  • Sources can be re-pulled without manual cleanup.
  • Schema drift is detected and logged.
  • Runs are scheduled or triggerable on demand.
  • Failures surface with clear retry guidance.

Common failure modes

  • Credential expiry or API throttling blocks pulls.
  • Schema drift breaks parsers silently.
  • Manual exports become stale or undocumented.
  • Runs succeed without producing artifacts.
Results 49 projects
System · Active

ASCIP Sync Engine

Provide a deterministic, auditable way to keep district staff data aligned with ASCIP LMS by turning CSV extracts into a repeatable diff-and-apply workflow. …

Reality Ingestion Canonical Storage Automation Engines Operational Adoption
Open project
System · Active

Staff Device Refresh Operations Portal

Give technicians a clear, role-filtered view of refresh work without manual reconciliation. It ingests SQL extracts of staff/devices; role/site access config …

Reality Ingestion Canonical Storage Human Interfaces Operational Adoption
Open project
Component · Active

Aeries Staff Extract SQL Generator

Extract operationally meaningful staff datasets that reflect reality across schools and roles. It ingests Aeries tables (staff, sections, TCH/MST, etc.); date …

Reality Ingestion Canonical Storage
Open project
Field Tool · Active

Google Group Expansion + 2SV Status Reporter

Turn nested group membership into a security-ready roster with 2SV status. It ingests master group name; directory/group memberships; user 2SV status and …

Reality Ingestion Human Interfaces Operational Adoption
Open project
System · Active

Perpetual Data Reports Portal

Turn recurring report requests into stable, owned, self-service operational reporting. It ingests recurring extracts; scheduled refreshes; report definitions …

Reality Ingestion Canonical Storage Human Interfaces Operational Adoption
Open project
Component · Deprecated

Rust SQLx Tooling (Integrated SSH Tunnel)

Make remote data extraction reproducible by managing SSH tunnel setup and teardown in the tool. It ingests SSH target; DB creds; query definitions and produces …

Reality Ingestion Automation Engines Operational Adoption
Open project
System · Active

Rust Streaming Tool (Web Playback)

Provide a low-latency, self-hosted screen/audio streaming tool that plays directly in a browser via WebRTC. Capture a selected monitor and audio source. Encode …

Reality Ingestion Automation Engines Human Interfaces Operational Adoption
Open project
Field Tool · Active

Snipe-IT Asset Ops Automation

Provide a reliable CLI layer for Snipe-IT so asset operations can be scripted, audited, and repeated across imports and cleanups. Load a TOML config with API …

Reality Ingestion Human Interfaces Operational Adoption
Open project
System · Idea

TitanHST Integration Connector

Prove the Aether Integrator architecture with a connector that matters operationally. It ingests Aeries + HR 2.0 source truth; TitanHST API (details pending) …

Reality Ingestion Automation Engines Operational Adoption
Open project
Field Tool · Active

Workspace Permission Audit Pipeline (GAM)

Detect, document, and remediate risky Drive sharing states at scale without manual inspection. It ingests target user/email; workspace drive ACL data; shared …

Reality Ingestion Automation Engines Operational Adoption
Open project
Component · Idea

Calendar Agenda Endpoint

Expose a fast agenda view that can be embedded in dashboards or CLIs. It ingests calendar time window; auth context and produces clean agenda summary payload.

Reality Ingestion Human Interfaces
Open project
Experiment · Idea

Email Corpus Ingestion Pipeline (EML)

Transform raw email archives into a structured, searchable knowledge system with strict privacy controls. It ingests EML files export; attachment metadata …

Reality Ingestion Canonical Storage Automation Engines
Open project
Component · Deprecated

MDM Integration Automation (Mosyle)

Unify device inventory and compliance signals so operations can act on a single source of truth. Authenticate with Mosyle using access token, email, and …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Experiment · Active

aether

Multi-workflow script toolbox spanning SIS, directory, and asset operations. It ingests configuration files, database tables, CSV files, and service-account …

Reality Ingestion Human Interfaces Operational Adoption
Open project
Field Tool · Active

apache-git-sync

A small Rust daemon that keeps /etc/apache2 bidirectionally synced with a Git remote. Local edits are autocommitted and pushed. Remote changes are safely …

Reality Ingestion Human Interfaces Operational Adoption
Open project
Field Tool · Active

BOUSD-ClassSize-Extract

Uses UnixODBC + Microsoft ODBC driver to query Aeries SQL Server. Uses a Google service account to update reporting sheets after each extract. It ingests …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Field Tool · Active

BOUSD-DataConfDocs-Extract

Uses UnixODBC + Microsoft ODBC driver to query Aeries SQL Server. Uses a Google service account to update reporting sheets after each extract. It ingests …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Field Tool · Maintenance

BOUSD-Enrollment-Extract

Uses UnixODBC + Microsoft ODBC driver to query Aeries SQL Server. Uses a Google service account to update reporting sheets after each extract. It ingests …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Active

BOUSD-MonthlyAttendance-Dashboard

This project powers the Brea Olinda USD monthly attendance dashboard that school and district leaders use to monitor attendance and chronic absenteeism trends …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Field Tool · Active

BOUSD-MonthlyAttendance-Extract

Uses UnixODBC + Microsoft ODBC driver to query Aeries SQL Server. Uses a Google service account to update reporting sheets after each extract. Produces …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Field Tool · Maintenance

BOUSD-PADC-Extract

Uses UnixODBC + Microsoft ODBC driver to query Aeries SQL Server. Uses a Google service account to update reporting sheets after each extract. It ingests …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Active

BOUSD-Staff-Technology-Dashboard

This project powers the Brea Olinda USD staff technology dashboard that the Technology Services department uses to manage technology needs and plan device …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Deprecated

CertManager

Automate certificate issuance and renewal via ACME with hooks for DNS/web validation and post-deploy workflows. Read dehydrated config and domains.txt for …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption
Open project
Component · Deprecated

clasp

Enable local development, version control, and deployment workflows for Google Apps Script projects. Authenticates a local developer against Google APIs. Syncs …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Active

cloudflare-ddns-rs

Production-ready, self-hosted **Cloudflare DDNS** agent written in Rust. The binary discovers your current public IPv4/IPv6 address, compares it with Cloudflare …

Reality Ingestion Human Interfaces Operational Adoption
Open project
Component · Active

csv_mapper

CSV Mapper and Transformer is a robust command-line tool written in Rust that allows you to map, transform, and filter CSV files using flexible, user-defined …

Reality Ingestion Human Interfaces Operational Adoption
Open project
Component · Maintenance

Database-Ingester

Enable safe, repeatable CSV ingestion into SQL Server tables with backups and dry-run visibility. Load config, optionally back up the target table, compare CSV …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Active

District Transfer Tracking

Centralizes, normalizes, and syncs district transfer data into a single Google Sheet for review and downstream reporting.

Reality Ingestion Canonical Storage Human Interfaces
Open project
Field Tool · Active

git-tools

Ensure every bare repo in a directory mirrors reliably without manual per-repo setup. Scans a directory for bare repos and normalizes repo names. Ensures each …

Reality Ingestion Human Interfaces Operational Adoption
Open project
System · Deprecated

google-groups-guard

google-groups-guard** replaces imperative GAM scripts with a deterministic Rust CLI for reconciling Google Workspace group memberships and enforcing group …

Reality Ingestion Human Interfaces Operational Adoption
Open project
Component · Maintenance

google-sheet-download

This program allows users to download a specified range from a Google Sheet and save it as a CSV file. Additionally, users can upload data from a CSV file to a …

Reality Ingestion Human Interfaces Operational Adoption
Open project
Component · Active

google-sheet-sync

Provide a consistent, modern CLI with subcommands and config support Support download, upload, and sync with predictable, auditable outcomes Ensure CLI options …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Active

gpt_kit

Scripts transform ticket EML exports into a normalized knowledge base with tagging and optional redaction. Make scripts executable, then run them with input EML …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Field Tool · Active

informedk12-sync

Supports response exports (JSONL/CSV) with configurable field expansion and column selection. Data-source uploads include optional CSV header validation and a …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption
Open project
Component · Active

Integr8r

Provide a shared PowerShell framework for district integrations, so each vendor flow follows a consistent pattern for config loading, data transforms, and …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Active

Integr8r-rebase

Provide a rebase of Integr8r with consistent config-loading and reporting conventions for vendor integrations. Load PowerShell config files and module settings. …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Deprecated

migrated-repos/gitlist

Offer a simple web interface for browsing repository files, commits, and diffs. Scan configured repository paths and render them in a web UI. Provide views for …

Reality Ingestion Human Interfaces Operational Adoption
Open project
Field Tool · Maintenance

mssql_query_to_csv

The **MSSQL Query to CSV** program is a command-line tool written in Rust that connects to a Microsoft SQL Server database, executes a SQL query, and exports …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Active

munki_client_configurator

munki-client-configurator is a login-time automation layer that keeps every managed Mac aligned with district policy. It inspects the signed-in users Active …

Reality Ingestion Human Interfaces Operational Adoption
Open project
System · Active

openhab-git-sync

Automated two-way Git synchronisation for openHAB deployments that keeps /etc/openhab and selected /var/lib/openhab subtrees version-controlled without …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Maintenance

privateGPT

Expose a private, extensible RAG platform that works offline and keeps data inside the execution environment. Ingest documents from a local folder, splitting …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Field Tool · Prototyping

PrivateGPTConf

Package the steps and configuration needed to get a local PrivateGPT instance running with custom documents. Install prerequisites and clone PrivateGPT to a …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Prototyping

PrivateGPTConf/env/default

Ship a known-good PrivateGPT configuration snapshot that the setup scripts can copy into a local installation. Provide default settings.yaml profiles and …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
System · Active

Project Atlas

Project Atlas is the documentation hub for AetherDev systems. Atlas and Showcase sections with canonical project schema. Taxonomy views for pipeline, domains, …

Automation Engines Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Experiment · Active

SEIS-Aeries-Examples

A PowerShell workflow updates Aeries CSE records from SEIS Student.csv and emails a detailed summary. A SQL query exports Aeries student data in the SEIS …

Reality Ingestion Automation Engines Operational Adoption
Open project
Field Tool · Maintenance

sql_to_csv

DB Query to CSV** is a flexible command-line tool written in Rust that connects to SQL databases (such as MSSQL, PostgreSQL, or MySQL) using SQLx, executes a …

Reality Ingestion Human Interfaces Operational Adoption Canonical Storage
Open project
Component · Active

titanhst_sync

A fast, safe, and auditable commandline tool written in Rust to synchronize users from a CSV file into Titan HST. It creates and updates users, manages site …

Reality Ingestion Human Interfaces Operational Adoption
Open project