The original gardens to the Manor House occupied just over 4 acres stretching up to Barton Terrace and comprised tennis and croquet lawns as well as grassy areas intersected by the Brook. The mill race flowed through the land near Barton Terrace and the owners of the Manor had to pay 15 shillings a year to each of the owners of Town Mills in Church St and Strand Mills in Brunswick Place for the use of the water.
On the other side of Manor Row (Brook St) next to the Manor House was the Kitchen Garden with fruit trees and several glasshouses for peaches and vines etc.