As a woodworker I'm surprised you didn't have that idea :D
(Like, c'mon, toothpicks aren't immutable objects that fall out of question just because they're a bit too large)
What also works (and funnily enough is also called a "toothpick") is the flat plastic thing some "swiss" pocket knives/tools (Victorinox brand) have.
