It's a good idea to do it, but you've gotta do it correctly.
I wouldn't bother if you only get 10 visits from France (for example) daily and don't ever see yourself getting more than 100.
If it's a site with a decent amount of traffic (~100k+), though, then it's worth considering - especially if a good portion of that traffic comes from non-English regions.
This is a pretty good post about it:
https://ahrefs.com/blog/multilingual-seo/