I tried this very quickly, selected the background away into its own layer, feathered a bit, applied a field blur and then mixed it back in, opacity at about 65% and then a soft mask to smooth the transition. I think it helps diffuse the shadows a bit. Maybe with a little more time spent, care...