Qobuz has a streaming plan, and you can buy and download drm-free music. It’s a good option if you want to just stream (the app has added some nice improvements lately). Even better if you’re also looking to build your collection and looking to go the whole non-streaming route.

Purchases tend to be pricey, and there’s a slightly more expensive plan with a discount on drm-free that might make sense, depending on how often you plan to make purchases.

Edit: this currently doesn’t fall into the < $10 category but is comparable to the old Apple Music price.

I didn’t really have a need for Audiobookshelf until I discovered libro.fm where I found you can get drm-free audiobooks. After I discovered a need, I found the Plappa app on iOS is actually a pretty nice player to connect to audiobookshelf. I still need to use the web app to manage the library. But Plappa provides the listening part, and it also does CarPlay (which is my main requirement for media).

Audiobookshelf also has a podcast feature you can use as a podcast fetcher - and then play them through Plappa.

For audio media I use Jellyfin and the Manet iOS app (the only CarPlay media player I could find). It keeps things in separate apps, but that’s what’s working for me.