Libby was charged with obstructing the investigation. It was not for not remembering minor details.
And, the testimony would not have cleared Libby. You just want to believe it would. You don't know why it was objected to, or if it really spoke to the actual point f the charge.