In 1900, Lucy Muir (Gene Tierney), widowed for one year, decides to move out of her controlling in-laws' London home to the English seaside with her adolescent daughter Anna (Natalie Wood) and their long-devoted maid Martha (Edna Best). Despite the rental agent trying to dissuade her, Lucy decides to rent Gull Cottage at Whitecliff-by-the-Sea. She learns firsthand before she makes the decision the rental agent's hesitance is because the cottage is haunted, supposedly by its now deceased former owner, seaman Captain Daniel Gregg (Sir Rex Harrison). After she moves in, she does meet the spirit of Captain Gregg face-to-face. Because she refuses to be scared away by his presence, the two come to an understanding, including that he will not make his presence known to Anna. As time progresses, the two develop a friendship and a bond. Despite his statements to her that she needs to live her life including finding another husband, Daniel seems not to approve of any of the men that enter her life, including the most serious, children's author Miles Fairley (George Sanders). Because of his feelings for her, Daniel eventually has to decide if being a part of her life is more a benefit or hindrance to her in carrying on with the living, regardless of perhaps not being able to carry out his initial goal of realizing his vision for Gull Cottage if he leaves.