get off case

get off somebody's case

to stop criticizing and annoying someone They think he was trying to cheat them, so they're not going to get off his case.
Related vocabulary: get somebody off your back
See also: case, get, off