Contractors have now been on site for three weeks as the listed building is gradually knocked down.