I would encourage that you not bend to the will of those who would impose upon you what your brand might be or might be associated with. If you make a meaningful product in your space and the origins of the name are easily explained through 1: your aforementioned wordplay and 2: the GoT reference (likely more common), then I think you should fight to keep a name you love and find meaning in.
As one of your potential customers / users, I would not base any judgement of your company or product based on some a shared name with a small fringe organization that some people find unsavory which uses a pretty common term or combination of terms.