The castle once commanded panoramic views across the surrounding countryside from its strategic hilltop position, though today's visitor would find those vistas obscured by coniferous plantation. While the 1912 Ordnance Survey map marks only a 'Castle (Site of)', the 1838 edition intriguingly shows the outline of a rectangular castle structure just south of the townland boundary between Castletown and Glinsk, and Pigeonstown.

The precise origins of this upland fortress remain unknown, though its location suggests it may have been built to control an ancient mountain pass through the Slieve Blooms. The castle stood within the historic territory of Éile, which was ruled by the O'Carroll clan. A low sandstone wall running east to west immediately south of the castle site still marks the old townland boundary, serving as one of the few tangible reminders of the area's medieval past.

Archaeological surveys have found no substantial remains above ground, leaving historians to rely on early cartographic evidence and the site's strategic positioning to piece together its story. The discrepancy between the 1838 and 1912 maps raises interesting questions about whether the castle was originally located in Castletown and Glinsk rather than Pigeonstown proper, adding another layer of mystery to this vanished mountain stronghold.