George Lyttleton Upshur was a descendant of Martha Washington through her second granddaughter, Martha Parke Custis Peter. His mother, Katharine A. Williams (1834-1864) was a cousin of both General and Mrs. Robert E. Lee. (She was the daughter of William George Williams and America Pickney Peter.) His father, Rear Admiral John Upshur of the U.S. Navy (1823-1917), served in Commodore Perry’s expedition to Japan. George Lyttleton Upshur wrote a memoir of his life, AS I RECALL THEM: MEMORIES OF CROWDED YEARS, which was published in 1936, and details not only his extended family, but his association with the Rockefellers, Morgans, and other prominent families of the late 19th and early 20th century.