"Could I see your driver's license, please?" the notary asked.
I said, "You don't need it," as I produced my passport.
He started to insist that he had to see a driver's license, "Because I need to verify your address."
I pointed out that my address [in Nevada, but it's perfectly valid; technically right now, it's my second home as I'm still a California resident] is on the document he's witnessing and that I'm signing under penalty of perjury. Grudgingly, he agreed to notarize it, and indeed, his notary book has "passport" as one of the check-boxes for methods of verifying ID.
I assume that people are so used to one and only one way of checking ID that any of the other valid methods make their brains start to melt.
Addendum, 11 PM: Several of the people in the comments are talking about what's a proof of residency. Y'all are missing the point in this story. Despite what the notary said, he didn't need to verify residency. He has to write down an address in his notary book, but he doesn't have to independently verify any of the information on the form I was signing, just the fact that the person who appeared to match the ID (my passport, in this case) signed the form.
Had I needed to prove my residency in California, I think I would have produced my voter registration card to go with my passport. Had I needed to prove an address in Nevada, I would have produced the bill of sale for Fernley House. I'm aware of the distinctions here, thank you.