Castle House is possibly one of the finest medieval buildings in the South West and forms an integral part of the Inner Ward of Taunton Castle. The House was built by the Bishops of Winchester in the 12/13th century. The earliest part of Castle House was built into part of the Castle wall in the 13th century. The main building of the House was in the 16th century. Judge Jefferys -
Castle House