My best advice is never to address any woman as Madam unless she holds a high position in government or you happen to find yourself in a brothel speaking to its owner.

In England I am always madam; I arrived too late to ever be a miss. In New York I have only been madamed once, by the doorman at the Carlyle Hotel.