A complex data processing pipeline


  • Powers the front-end admin dashboard and overall client-side application.


  • Provides durable queues that allow the front-end website to accept events and turn them into jobs for the background workers to process.


  • Hosts the main Sweat Shop application as well as all worker applications (deployed on their own instances)


  • MongoDB provider for persistent data related to events and job data and metadata.


  • Hosts the unstructured data for each event that comes into the system. Also maps the event to each individual job or pipeline that gets spun off. All relevant persistent data is currently stored here.


  • Powers the web interface for events API as well as the admin dashboard.


1076168

Favorite
Views
39
1076168
Favorite
Views
39