The other point is that many more of us have perfect pitch than are aware of it; the difference seems to be that those who name notes out of thin air learned to do so at a fairly early age - even if they developed and extended that ability later on.

An interesting experiment is to ask people to sing well known songs in comfortable keys (the Beatles provide good examples). Very often they will nail the pitch almost exactly from nothing.