What survives upstanding now amounts to a short stub at each end: a corner of the south-east, a corner of the north-east, the latter still showing its block and start quoins, the dressed corner-stones that give a wall its structural grip. The rest is a grassed-over ridge of rubble that traces the width of the main block to roughly 8.7 metres.

The building is known locally as Mortimoore's house, a name recorded by the historian Carrigan in 1905, who noted that it took its name from a Mr Mortimer, an occupant who was murdered in Freshford as the outcome of an agrarian dispute around 1820. Carrigan placed its construction at about 1700, and the structure may have a slightly longer history still: a house with a chimney appears on the Down Survey barony map of Ballilurkan dated 1655 to 1656, the great mid-seventeenth-century cadastral mapping of Ireland carried out under Cromwellian administration. By the time of the first Ordnance Survey six-inch map in 1839, it was recorded as an L-plan house facing east, with a projecting wing at the south end and a range of outbuildings to its south-west and west. By the 1946 to 1947 revision, all of that had vanished from the maps except for a single line marking the east façade. The walls are of roughly coursed limestone rubble, but scattered through them are reused medieval stones, almost certainly robbed from the castle that stands roughly thirty metres to the north-west. That proximity is significant: the house appears to sit within the south-east quadrant of a rectangular enclosure that may have been the castle's bawn, the walled courtyard that typically surrounded an Irish tower house for protection and storage. The relationship between the castle, the enclosure, the house, and the church some sixty metres to the north-east suggests a small but layered settlement, accumulated across several centuries on this gently sloping ground.