The previous challenges were too time consuming. That's why we switched to this approach.
We intentionally left the prompt ambiguous in terms of what a meaningful contribution is. A meaningful contribution can be anything that the candidate justifies as meaningful. A single, really well thought out method contributed to a library that the candidate uses often can be all it takes.
When we assess the candidate we take into account the full package. Senior engineers with an extensive portfolio and multiple open source contributions aren't help to the same volume as someone who's fresh out of school with little experience.