leave to it

leave someone to it

to withdraw and allow someone to finish something alone. I hate to leave before the job is finished, but I'll have to leave you to it. I will leave them to it. I have to go home now.
See also: leave