Thanks for this feedback. I hear what you are saying. If I understand correctly its like LLMs are a black box doctors dont understand and while it talks back in a friendly voice it can cause harm if it says something awful. While this is not likely due to our prompting it is not impossible either.
Junru and I will discuss the approach with pediatric care based on this. And I agree having domain expertise/advisors to guide us in the right direction is important