so much the worse for —
• used to suggest that an unfortunate event or situation is the fault of the person specified and that the speaker does not feel any great concern about it.
• "if they were daft enough to believe it, so much the worse for them"