I had this at one point. If I remember correctly, I reapplied my ssh client and server keys for the failover pair and that cleared it up.