> Our court system is already constitutionally violatingly too slow
Might be caused by this type of thinking:
> I can't imagine every po-dunk jurisdiction that can barely justify 1 judge having 15.
Perhaps funding the court system to properly meet your first point would ease your concerns there?