If you're using an iPhone 15 or newer ... use wireless earphones like Apple's AirPods (and if you want to turn the volume up ...
You may be turning up the volume with the buttons along the ... and it may activate even when you aren't looking at the iPhone. Here's how you can turn off Attention Aware if you so choose.