If you’ve already got it then it makes sense to use it, but this doesn’t remove the cost of building and maintaining separate infrastructure at all.
In some cases it might be worth it or necessary, in others I think the process of processing & delivering potable water could be made (or is already) so efficient that building & maintaining separate infrastructure for non-potable water would be a net negative both in terms of cost and environmental impact.