The wiki page I linked quotes an L/D ratio for Concorde (in cruise mode) of 7 to 7.5 and for Boeing 747 of 15.3 to 17.7. Taking the mid-points of 7.25 and 16.5 we get that the L/D ratio for Boeing is 2.275 higher than of Concorde. But Concorde's speed was 2.41 times higher than Boeing's (Mach 2.05 vs 0.85).
There are 2 things to go from here to actual fuel per passenger*mile. How much fuel do you need to produce the same thrust, and how much aircraft do you need to carry a passenger. On both counts, supersonic airplanes have a problem: supersonic engines have a lower bypass ratio, so they are inherently less efficient, and supersonic planes need to be sturdier, and therefore heavier than subsonic ones.
These problems are hard.
But the difficulty of building a supersonic aircraft does not come from the air resistance being the square of the speed.
By the way, the L/D ratio decreases with the speed, but it does not tend to zero in the limit. This fact is actually stunning, if you think of it. As the speed goes up, at some point the L/D ratio stops decreasing, so you end up burning significantly less fuel per mile. That's the reason some militarizes invest in hypersonic missiles: they have much longer range than their size alone would make you think.