My polarizer stays on my lens all the time except when I am shooting indoors. I feel it adds a positive improvement to my photos.
I use it a lot on my 18-35mm but when light gets lower I take it off. But I do like what it does to colors. I ordered a step-down ring to try the CP on my macro. I'm curious if it will have an effect on the reflection many bugs have.