I never have that problem as I always empty my special randomly firing at places I think a combatant might appear. Then spend the next 3 minutes looking for a green box. Thankfully shoulder charges reload automatically!