go so far as (doing something)

To reach the point of doing something extreme, risky, or controversial. Often used in the negative. Although I wouldn't go so far as calling him a coward, he definitely likes to avoid confrontation when he can. They went so far as threatening us with legal action if we didn't delete the video in question. I wouldn't go as far as calling it a riot—I think it was just a bunch of rowdy kids causing trouble.