Definition of to hold against in English English dictionary
If you hold something against someone, you let their actions in the past influence your present attitude towards them and cause you to deal severely or unfairly with them. Bernstein lost the case, but never held it against Grundy