take gloves off
take one's gloves off
Fig. to stop being calm or civil and show an intention of winning a dispute by any means. (As if boxers were to remove their gloves in order to inflict more damage. See also The gloves are off.) Both of them took their gloves off and really began arguing.