That's like saying you either agree with gravity or you don't. If you don't like gravity, you're still bound by it. Therefore, either natural law is a true postion, at which point everyone is bound by it like it or not, or it's a false position, at which point no one is bound by it like it or not. But in either case, it needs to be a defensible position, not one that you simply embrace because it appeals to you emotionally and you want it to be true.
So far, that's all you libertarians have done. It's a religious faith to you, nothing more.