go as far as (doing something)

To reach the point of doing something extreme, risky, or controversial. Often used in the negative. Although I wouldn't go as far as calling him a coward, he definitely likes to avoid confrontation when he can. They went as far as threatening us with legal action if we didn't delete the video in question.