This is exactly what happens in the Mail app on macOS when two people exchange mails and both signs them. Once the public key of someone is known, mails are automatically encrypted from now on while the certificate is valid. It’s excessively convenient and I loathe the certificate industry for making the acquisition of certificate such a painful and expensive process, otherwise we could have encrypted communication with emails easily.