Found it - The Buccaneer! It was a cool property. There were two graves in the concrete by the pool. The old caretaker explained they were his parents who had been granted the land after slavery. The land was passed down to him and with no heirs, he sold it to the (then) present owner with rights to live and work for the property until he died. He was pretty old - I took over the pool duties while there as he was struggling a bit. Saw my first mongoose there!
We were there when Portia took over as PM in 2012 - one of the caretakers got pretty angry when the vuvuzelas started to blow - that's how he found out he lost his public sector job as a rubbish collector - government changed from JLP to PNP and he was JLP.