Ivey Lewis was born in Tarboro, Edgecombe County on February 4, 1833. He attended the University of North Carolina in the early 1850s, where he interacted in the same social circles as Margaret Eliza Cotten. After graduation he moved to Alabama where he owned and managed several plantations. He died in Hale County, Alabama on July 4, 1884.