Well I don't see why not set up the UI part first if that's what currently possible. There's no shortage of LLM frontends right now but practically all of them are very meh (if I see another overused default theme Gradio app I will stab my eyes out).

When Zuck releases Llama 3 in July or whenever we might have something to plug this into.