No indeed, that's too costly. With this approach you can only receive messages from someone after you have added the corresponding public key in your client. This is an extra step to start messaging, but does eliminate spam.