Its worth considering IMHO. I think we'd also need a runoff system so the President has at least 50% plus 1 vote. And since US citizenship will become the new prerequisite to vote for President and not state citizenship; Puerto Ricans, Virgin Islanders, Guam citizens and American Samoans would get the right to vote for POTUS, something they've wanted for a while.
On the downside, we'd still have "irrelevant" parts of the country as nearly all the focus could be on reaching major metropolitan areas who's values and concerns are often sharply different than rural America.
Direct elections does seem for fair however; one man, one vote.