As long as people are being consistent in their use of the word, and they are not using it equivocally, there's no problem with it. It's only a problem when it's used equivocally.
Your understanding of the word doesn't dictate whether another person's use of the word is correct or incorrect. If they are using it in the non-legal sense, and you take it to mean that they are using it in the legal sense, then the error is yours, not theirs. If they use it in the legal sense when it doesn't actually apply, then the error is theirs.