keep to, stay on, etc. the straight and narrow

keep to, stay on, etc. the ˌstraight and ˈnarrow

(informal) live your life according to strict moral principles: She’s stopped drinking and now she’s trying to stay on the straight and narrow.This phrase comes from the Bible, describing the path to Heaven.
See also: and, keep, narrow, stay, straight