Shrinking the Long-Tail Glitches in Image Models