That's the one. The entire plot is just two fuzzy red people fucking their way across the ring. Not great.
Also he fell into the trap that many science fiction authors do of listening to the critics who complained about the math not working. Pretty much every book after the first in that series was just a way for him to try to make his made up world work in real life. Not great.
Neutron Star is phenomenal though.