It is not unusual for dogs to be more afraid of men, if they're going to be afraid of people. It's also not unusual for the man to take offense. But it's not personal. There are things he can do, and the main thing is to ignore the dog. Any interaction that causes the dog to feel fear just reaffirms for the dog that men are scary. Do not force the dog to interact with people or things that scare it. You can learn about triggers, thresholds, counter conditioning and desensitization at this site
Working with a fearful, scared or shy dog
it takes time, patience and training to change how these dogs feel. But when you change how the dog feels you'll change the behavior. You want the dog to have positive associations with your husband. It's a project, I've been living with a fearful dog for over 2 years, who is still afraid of men, including my husband. He's made great improvements, but many of these dogs don't just 'snap out' of being afraid.