It ALWAYS comes up with off (of) -- how do you turn off the tap/TV/radio/computer? Pull the plug from the wall? Deactivate it? Just losing 'off', in many instances, does not work. When it is a redundancy -- it does work, but when it's not, it doesn't and I can't think of a viable alternative.
The cliches are cliches but out of context you can't judge them as valid or not.
