Yeah, that's the downside of carrying stuff that you can't decrypt. They won't believe you, and won't stop until you decrypt it. Better is not to have anything sensitive with you.
Encrypted volumes look random. There's no way of proving whether or not you have something you can't decrypt. Hence the need to have some innocent volume to decrypt as a tool in the argument to convince an interrogator that you have nothing left to hide.