your heart is in the right place

your heart is in the right place

If someone's heart is in the right place, they are kind, although there are things about them that you do not like. Note: The heart is traditionally regarded as the centre of the emotions. Whether Johnson's professional judgement was good or not, I decided that his heart was in the right place. They've probably got their hearts in the right place but they just haven't got any common sense.
See also: heart, place, right