pick up one's marbles and go home

Add

• withdraw petulantly from an activity after having suffered a setback.

• "he's now picking up his marbles and going home because his political career is in tatters"