James Spencer Pippen was born in Tarboro, Edgecombe County on June 2, 1835. The son of a wealthy merchant and planter family, he promised to keep a secret with Margaret Eliza Cotten, which she later recorded in her diary. He served in the Confederate army during the Civil War died in Tarboro on February 20, 1896.