It gets under his skin largely because Tony is guilty of the same. It's one thing when Tony never points out his reckless behavior. The second he does, Steve considers it permission to finally nail him for it. He returns that sharp look with one of his own though he doesn't sound angry. He's annoyed if anything since Tony's follow up softened the blow. He really does appreciate that Tony is taking him on word.

"Look who's talking. When it came down to it, you did the exact same thing I did back in New York."