I am having a similar problem. I shoot with the D600 and the 70-200mm f2.8. I mostly shoot in manual.
I find I am having to put my ISO up way too high, for example I was shooting yesterday, it was a slightly cloudy/overcast day but still plenty of light and I had to get my ISO up to about 1000...