so much the worse for
(+object) Used to indicate that an unfortunate event, outcome, etc. is of the subject's own doing; and that the speaker feels no great concern for it.
If he cannot realize the error of his ways, then so much the worse for him.