St Paul's Cathedral was built on the current site when the original building in Raymond Street became too small for the congregation. The land was purchased in 1882 for £1,150.
The cathedral opened in 1884. Designed by Nathaniel Billing, it is a double storey height building constructed of red brick with slate roofing. The interior is decorated in a Gothic style of architecture, characterised by the pointed arches and has rendered plaster walls and oregon roof butressing.
The marble pulpit with brass railings was installed in 1929. The marble was quarried at Buchan in Gippsland, Victoria. The pulpit incorporates a Memorial stone commemorating the first Bishop of Gippsland, the Right Reverend A. W. Pain D.D.
The pipe organ was built by George Fincham in 1882 for music teacher Dr. Joseph S. Summers and purchased from him for £290 in 1884. It was restored in 1981 and is one of the oldest pipe organs still in use in Australia.
The tapestry kneelers remind us that the Cathedral is the Mother Church for many parishes in the Diocese of Gippsland. Each kneeler is inscribed with the name of a parish or Church centre in fine needlepoint. They were made by people from across the Diocese in a project led by Elizabeth McKenzie to commemorate the 75th anniversary of the Diocese in 1977.