go hard with
• turn out to (someone's) disadvantage.
• "it would go hard with the poor"
be hard on
• treat or criticize (someone) severely.
• "you're being too hard on her"
• be difficult for or unfair to.
• "it was hard on her, because she had to walk nearly a mile out of her way"
• be likely to hurt or damage.
• "the monitor flickers, which is hard on the eyes"