hold against

Add

• allow past actions or circumstances to have a negative influence on one's present attitude towards someone.

• "he knew that if he failed her, she would hold it against him forever"