This is irrelevant to me. There will always be people with inconvenient or backward ways of thinking. As far as I'm concerned, that some are born serfs and others are born masters is not a fair system, and that view holds regardless of who does or does not "work" for their money.
In any event, wealth gained through the exploitation of those who create it (the workers) is not wealth anyone has a right to. It is unarguable that capitalism makes it impossible for anyone to be paid a fair price for their work.