have one's cross to bear

Add

• have a difficult problem or responsibility one has to deal with.

• "as a smoker, I can tell you it's a horrible habit, but that's my cross to bear"