Yes and no. I have been very confused by this. I have read many Nietzsche apologists like Kauffman who try to make him out to sound like some sort of secular humanist. But then you read him directly, and you realize that's not what he was saying at all, no matter how much you try to see him as a secular humanist.
When he talks of leaving behind feelings of guilt, pity, etc... as slave morality, and pursue the individual interests, what are we to make of the impacts of those private pursuits to those around us: our family, friends, community, etc... We don't live in a vacuum. Sometimes the pursuit of power must be tempered or balanced against the needs and potential hurt it may cause to those around us. For example, what would Nietzsche say to a promising surgeon, artist, scientist, etc... who decides to put aside their work because their children are being hurt by how much time they are spending at work? Are they succumbing to slave morality by having pity on their own kids? His complete absence of any sort of social/political philosophy while just concentrating on the individual self is a huge hole in a coherent philosophy of life.
There was a very, very dark side to Nietzsche that you really have to twist to try to overlook. You get the feel that he makes empathy to be the foundation of his scorned slave morality. It is not. It is hard-wired into biological organisms. Without it, without self-sacrifice, love, loyalty, empathy, species do not do well. Without it in humans, there is a pathologic condition known as antisocial personality disorder, more commonly called being a psychopath.
I have really tried to be sympathetic to Nietzsche and understand Kaufmanns apologist positions on him, and I just don't see it. This is not an ad hominem attack on Nietzsche. He had some very valuable insights. But he was no secular humanist. I can definitely see how the Nazis could quote him and justify some of the horrific things they did. I don't think it was quite as big a misreading as Kaufmann and other apologists try to make out.