The site was orginally occupied by
Ballyvaughan Castle, which stood right at the edge of the harbour.It was owned and occupied by the
O'Loghlen family, except for a period in the 16th century when the O'Brians
held it. In 1540, a stolen cow was found at the castle, and heavy fines were
levied on the O'Loghlens - loss of cattle, goats, sheep and the town of
Ballyvaughan. In 1569 the castle was attacked by SirHenry Sidney