Hues of Habitability: Characterizing Pale Blue Dots Around Other Stars