The Great British Bake Off presenter commented on the actor for the first time after Brand was jailed for rape and sexual assault