Loving regardless of physical appearance doesn't follow from loving for more than just physical appearance.
(I suspect that "don't be shallow" is the sort of advice that people often feel good giving but don't sincerely believe, but even the most sincerely non-shallow person generally can't simply ignore sexual orientation. Once you allow for sexual orientation, then you're already at the point where certain details of a person's physical appearance are absolutely critical for romantic love.)