Eutaxia, or The Presbyterian Liturgies: Historical Sketches (1855)
The Discourses and Essays of the Rev. J.H. Merle D'Aubigné (1855)
A Chapter on Liturgies: Historical Sketches (1856)
Chronicle of a Border Town: History of Rye, Westchester County, New York, 1660-1870 (1871)
History of Bedford Church (1882)
History of the Huguenot Emigration to America, Vol. 1 (1885)
History of the Huguenot Emigration to America, Vol. 2 (1885)