DigitalOcean
Django is great if you're new to web development. It'll handle all the annoying things like user authentication and data migrations that you really won't want to manage yourself.
Since you're quite new to web development, you might not want to jump into React right away. Django provides a good templating language that'll let you customize the front end of your app without having to worry about state too much. Once your needs get more complex, you can add React into your project one component at a time.
As for databases, PostgreSQL is a great choice. I wouldn't go with AWS for hosting though; DigitalOcean has all the functionality you need at the same price, but with a much more user-friendly interface for beginners. You'll probably be using Droplets for server hosting, DigitalOcean Spaces for file storage, and DigitalOcean Managed Databases to host your database.
You also mentioned generating charts. Chart.js is quite popular and easy to use, and should have all the functionality you need for an accounting app.