Records shared with The Telegraph reveal anguish over defecting to Moscow, a wife’s deceit and the Queen’s response to her aide’s treachery ...