Medieval Hirschhorn Castle occupies a mountain ridge above the town. In the castle, which is fortified by walls and towers, a keep, a great hall, stables and several gates and outbuildings can still be seen.
The Carmelite Monastery Church of the Annunciation, consecrated in 1406, with its St Anne's chapel from 1513 is situated below the castle. A large number of gravestones of the Lords of Hirschhorn and also a Gothic sandstone rood screen can be seen there. Next to the church there is the monastery building, nowadays the vicarage and also the home of a small group of Carmelite monks.
The parish church of the Immaculate Conception was built as a Lutheran church from 1628 to 1630. In the course of the Counter-Reformation it was closed in 1636, and in 1730/31 it was re-opened as a Catholic parish church. The far older gate tower Mitteltor from 1392 serves as its belfry. The medieval town centre is still surrounded by its original town wall.
The Protestant church, near Grabengasse, was consecrated in 1892.
Ersheim Church on the left bank of the river, on a sort of peninsula within its horseshoe bend, was first mentioned in 773 (in the Lorsch codex) and is said to be the oldest church in the Neckar valley. It also contains some frescoes from the 14th and 15th centuries.
Numerous half-timbered buildings have been preserved in the old part of Hirschhorn
