After you create or select an annotation, a plain click anywhere that isn’t an annotation deselects it and removes its resize handles. Esc does the same. A shape annotation can be selected with a click even when nothing else is selected (#5933).