The motte is possibly the site of a former Welsh border castle but there is no evidence for such a building other than a vague historical reference in 1213 to William de Cantelope being ordered to "arm the castle at Hordisland". Some commentators have suggested it was the site of a Saxon stronghold, although there is no evidence for this either.
The motte is best viewed from St Mary's Walk (turn left when walking from the village car park to the Church)