Barkley was already married to Maureen Blumhardt. The rumors put their relationship to the test, although they also affected family members.