as a followup, I don't see large latency with huge pages, but I have kernel samepage merging disabled.
I would be interested if this also decreases latency for you:
echo 2 > /sys/kernel/mm/ksm/run
Also check stats here:
/sys/kernel/mm/ksm/*
And some documentation here:
https://www.kernel.org/doc/Documentation/vm/ksm.txt