skeleton in closet

skeleton in (one's) closet

A source of shame or disgrace, as in a family, that is kept secret.
See also: closet, skeleton