The dice are loaded against somebody - Idioms by The Free Dictionary
the dice are loaded against somebody
the dice are loaded against (one)
A positive outcome for one is unlikely due to circumstances perceived as unfortunate or unlucky. I have a record, so when it comes to finding employment, the dice are loaded against me.
the ˌdice are loaded aˈgainst somebody a person has little chance of succeeding in something, perhaps for unfair reasons: If you apply for a job when you’re over 40, the dice are loaded against you.This phrase refers to putting a piece of lead (= a heavy metal) inside a dice so that it always falls in a particular way.