Note the anxiety and any emotion arising until they go away. Ignoring everything else and focusing on the breath is a Samatha meditation. That is fine if your goal is mostly to feel calm and blissful. But that is not enough to take you towards freedom from suffering. You many pick the style of meditation you want depending on your end goal.