Full disclosure, I'm primarily a wildlife and macro shooter, so I don't have a lot of experience with street photography, although I have done some in downtown Charleston, which I live near.
Compared to the 40mm the 35mm will give you a little wider view, and a little more light gathering...