EMu data web

EMu data for the web

(Updated November 5, 2024)

This page documents EMu infrastructure for the web. It's meant to present a clear diagram of data flow from our public instance of EMu to Elasticsearch.

EMu (Ross EMu, only publically available records)

• EMu to MongoDB uses emuout - Go CLI to export data (texql and texexport on the command line)

MongoDB (internally hosted on the cluster)

• MongoDB to Elasticsearch uses Pat's Python syncing script; ask Pat for more info

Elasticsearch (managed at Elastic Cloud)

---

graph TD;
    EMu-->MongoDB;
    MongoDB-->Elasticsearch;

Loading

Elasticsearch

Elasticsearch is the primary source for our data served to the web. Especially for our Vercel hosted websites.