take gloves off

take one's gloves off

Fig. to stop being calm or civil and show an intention of winning a dispute by any means. (As if boxers were to remove their gloves in order to inflict more damage. See also The gloves are off.) Both of them took their gloves off and really began arguing.
See also: glove, off, take