So, you've discovered that you can't control wanting to control your breath. Good for you. The breath does its own thing. So does the mind. What you see is that the mind is immediatly trying to control things as soon as it becomes aware of them. What you see is basically the minds habit to take ownership of things.
Realise that this 'how can I avoid this or that' also falls under trying to control. See how deep this controlling thing goes? The mind tries to control everything. If it's not the breath, then it is the way it relates to the breath, the surroundings, other conditions, persons, or something else and so forth. The habit of trying to do, trying to control needs to be seen and understood deeply.
I'd say your practice is fine. Keep seeing and studying what's happening in the mind as reaction of becoming aware of things.