Episcopal Church, Second Street Presque Isle Yesterday & Today The Episcopal Church on Second Street was built and dedicated in 1876. It is the oldest church in town but also the oldest known building still standing within the city limits.