Unauthorized deductions from checking

I have cancelled the order three times and this is the fourth month they have deducted from my account.  Obviously, they ignore the cancellations and even returns.  I spent over $20 returning products that I had cancelled....now they don't even send the product, they just take the money!  I even cancelled my ATM card (which is what I used to order the product initially) and got a new one with an entirely different number and somehow they STILL got the money!  I am going to take my money out of that bank today because this is the only way I know to be sure they can no longer take my money!!!!!