Seems that it is more of a personal or business decision that you need to make. If SEO is important to the project then your SPA react site might not meet the project's needs. Using Next or Gatsby will probably give the GoogleBot more to index than create-react-app.
I choose to use Gatsby to make my personal site as a new developer back in 2019. But since then most of my projects have used Next because of my interest in making apps and APIs.
If I were you, I'd dive into the issues around SEO and React and figure out what the GoogleBot needs. From some quick reading it seems possible to get some SEO coverage without using Next. And it's a good way to prep for using Next in your project.
https://www.bacancytechnology.com/blog/react-seo-for-web-applications https://www.shareitsolutions.com/blog/seo-problems-react