It sounds like your spending a lot of effort on estimating. I'd
guess (I'm not there so probably incorrectly :-) that you've got some combination of:
a) stories being too big
b) stories having to much variation in size
c) doing time based estimation rather that relative estimates or story counting.