Since I don't want to pay for a ssl certificate, I have signed my server's certificate fingerprints using GnuPG. I have also compiled a small list of RSA key fingerprints to hosts I connect to often (useful when connecting from a doubtful network).
Today, I have received my OpenPGP smartcard (serial #00000E26). I have also generated new keys on the card and I have updated my public key.
I am therefore ready to use the card to receive OpenPGP encrypted email using the card's subkeys. The card can also be used to login via ssh, with no special configuration on the server. The card is a nifty gadget, but probably overkill for a good number of setups.