I think it's a somewhat unfair (though who cares if it's unfair) comparison because you aren't using the database/sql interface and mattn does.
If you drop that interface, you get much better performance.
See: https://github.com/eatonphil/gosqlite for example.
Edit: Nevermind, you did include crawshaw (which doesn't use database/sql) in your benchmark!