Hosting

We are going to host our MVP app on Heroku. Heroku is developer-friendly and provides generous services on their free tier. Additionally, there are many tutorials on how to deploy to Heroku.

We are planning to use AWS Lambda for ML inference. In our MVP workflow, we spin up a server, load model weights from S3, read data from our database, perform inference, write those predictions into the database, and close the server. This is a perfect use case for AWS lambda.

S3 is our service of choice for storage. We are going to store model weights (or models stored as pickles).