Water coming out even when purifier is switched off

Hi I am facing problem of water coming out from the outlet even when the purifier is switched off. Also the water quality also seems to be not good