on your conscience
on (one's) conscience
Causing persistent, nagging guilt for something one has done or failed to do. It's because of your cruelty that your brother died. I hope you have it on your conscience for the rest of your days! I really regret the way I treated her in high school. It's still on my conscience to this day.