be not to know

be not to ˈknow

have no way of realizing or being aware that you have done something wrong: ‘I’m sorry I called when you were asleep.’ ‘Don’t worry — you weren’t to know.’
See also: know, not
Full browser ?