Alicia Keys, who just returned to the stage after a short bout with a vocal injury, promoted her “As I Am” Tour with a performance on the Late Show With David Letterman on Tuesday night.