make yourself scarce
make (oneself) scarce
To leave, hide, or make oneself less visible, typically to avoid something. Lisa's fuming about your text message, so you better make yourself scarce until she calms down. Why is it that when there are chores to do, the kids somehow know to make themselves scarce?