The castle first appears in historical records in 1569 when it surrendered, presumably during one of the Tudor campaigns in Munster. By 1583, it was in the hands of J. O'Lacy during the Desmond Rebellion, one of the most significant uprisings against English rule in 16th century Ireland.

The castle's ownership shifted dramatically in the early 17th century as part of the plantation of Munster. In 1612, it was granted to W. Lasie, who maintained possession through the tumultuous period of the 1641 Rebellion and the Cromwellian conquest, still holding it in 1655. However, by 1667, during the Act of Settlement that redistributed Irish lands following the restoration of Charles II, the castle was confirmed to J. Odell, with the property recorded under various spellings including Ballyteigmill and Ballygelitaglee.

Today, what remains of this once formidable structure is a truncated tower, partially obscured by farm buildings that have replaced portions of the ancient fabric. These agricultural additions, noted by both Westropp in 1906 and O'Molony in 1905, speak to the castle's transformation from a military stronghold to a working farm, a common fate for many Irish tower houses that survived into the modern era.