Followed by a pronoun or personal name(s), expresses disapproval or anger about something done or said by the referred person(s).
This store charged me twice the price for this item! The nerve of them!
Used other than figuratively or idiomatically: see the, nerve, of.
Source: en.wiktionary.org