We tried that. It was called the Articles of Confederation[0]. It was an unmitigated disaster, and the reason we have our current Constitution with power actually consolidated under a Federal government.
[0] https://en.wikipedia.org/wiki/Articles_of_Confederation