Celebration of the Three Hundredth Anniversary of the Landing of the De Vries Colony at Lewes, Delaware, September 22d, A.D. 1909; Addresses delivered by Rt. Rev. F.J. Kinsman and Hon. George Gray.
Wilmington, Delaware: Historical Society of Delaware, 1909.

Address Delivered before the One Hundred and Twenty-third Annual Convention of the Diocese of Delaware in St. Peter's Church, Smyrna, on the second of June, 1909.
Wilmington, Delaware: Mercantile Printing Co., 1909.

The Principles of Anglicanism.
New York: Longmans, Green, 1910.

The Spirit of Churchmanship: A Sermon Preached in Trinity Church, New York, by the Right Reverend Frederick J. Kinsman, D.D. Bishop of Delaware, at the Centennial Service in Commemoration of the One Hundre[d]th Anniversary of the Consecration of John Henry Hobart, D.D. and of Alexander Viets Griswold, D.D. which was held on Wednesday, May 31, 1911.
No place: no publisher, 1911.

Catholic and Protestant.
New York, London, etc.: Longmans, Green and Co., 1913.

The Issues before the Church: A Letter to the Clergy of the Diocese of Delaware.
New York: Edwin S. Gorham, 1915.

Prayers for the Dead: Part of a Charge Delivered to the Clergy of the Diocese of Delaware on the Festival of St. Simon and St. Jude, October 28, 1914.
Milwaukee: Young Churchman Co., 1915.

The Old and the New at Holy Trinity (Old Swedes) Church, Wilmington, Delaware. Being a Report of the 217th Anniversary Service Held Trinity Sunday, June 18th, 1916, including the Presentation of the Endowment Fund and Sermon by the Right Reverend Frederick J. Kinsman, Bishop of Delaware. With a brief Historical Introduction, and an appended Report of the Endowment Fund.
Wilmington, Delaware: Star Pub. Co., 1916.

Outlines of the History of the Church.
Milwaukee: Published for the New York Sunday School Commission, Inc., by the Morehouse Pub. Co., 1916.

Salve Mater.
New York: Longmans, Green, 1920. [External link]

Bishop Kinsman's Salve Mater: An Address given before the Catholic Club, New York City, April 27, 1920.
By Francis J. Hall.

Trent: Four Lectures on Practical Aspects of the Council of Trent.
New York: Longmans, Green, 1921.

Americanism and Catholicism.
New York: Longmans, Green, 1924.

The Failure of Anglicanism.
London: Catholic Truth Society, 1929. [External link]

Reveries of A Hermit.
New York, Toronto: Longmans, Green and Co., 1936.

Project Canterbury