Updated benchmark: capnproto-rust vs. c++ (opens in new tab)

(dwrensha.github.io)

77 pointsdwrensha12y ago18 comments

18 comments

13 comments · 3 top-level

steveklabnik12y ago· 8 in thread

I wonder if it'd be instructive to have a Ruby or Python benchmark too, just to show how much you gain by using a lower-level language.

dwrenshaOP12y ago

See this thread on the Cap'n Proto mailing list for some idea of how well Python does on this benchmark:

https://groups.google.com/forum/#!topic/capnproto/BDpV6WEG5B...

jparyani12y ago

Author of pycapnp here. For those too lazy to click through, pycapnp is tremendously slower than C++/Rust. The equivalent benchmarks take about 20-50x as long.

What's more interesting to me is comparing it to other Python serialization libraries. I've been meaning to update the benchmarks with some popular ones (msgpack, thrift, and the built-in json module are at the top of my list). If there's some interest, I'll go ahead and post it to HN when I'm done.

2 more replies

steveklabnik12y ago

Thank you!

1 more reply

pjmlp12y ago

> I wonder if it'd be instructive to have a Ruby or Python benchmark too, just to show how much you gain by using a lower-level language.

It depends which implementation get compared.

If the standard implementations get used, that any strong typed language with ahead of time compilation to native code will win hands down.

Now if RubyMotion or PyPy are part of the benchmark, maybe they can achieve good enough performance.

ksec12y ago

Love that. I am still hoping for a Ruby Implementation in Rust once Rust hit 1.0

samnardoni12y ago

Why? (Genuinely curious...)

codygman12y ago

I wish we could compare the old Haskell version to the C++ and Rust versions as well.

dwrenshaOP12y ago

You're probably thinking of the original version of Cap'n Proto's schema parser, which was written in Haskell. The code generation step that it helped to handle is not a part of this benchmark.

As far as I know, nobody has written a Cap'n Proto serialization runtime for Haskell yet.

See http://kentonv.github.io/capnproto/otherlang.html .

pjmlp12y ago· 2 in thread

Quite good results, given that Rust is still quite a young language.

annnnd12y ago

Agreed. Also, less (/no?) memory related bugs counts for something too.

rjzzleep12y ago

i'd be surprised if there wasn't a decent amount of bugs still in the standard library

1 more reply

benth12y ago

For the "catrank" case, could you use std::str::raw::from_utf8 to skip the utf-8 validity check?

j / k navigate · click thread line to collapse

18 comments

13 comments · 3 top-level

steveklabnik12y ago· 8 in thread

I wonder if it'd be instructive to have a Ruby or Python benchmark too, just to show how much you gain by using a lower-level language.

dwrenshaOP12y ago

See this thread on the Cap'n Proto mailing list for some idea of how well Python does on this benchmark:

https://groups.google.com/forum/#!topic/capnproto/BDpV6WEG5B...

jparyani12y ago

Author of pycapnp here. For those too lazy to click through, pycapnp is tremendously slower than C++/Rust. The equivalent benchmarks take about 20-50x as long.

2 more replies

steveklabnik12y ago

Thank you!

1 more reply

pjmlp12y ago

> I wonder if it'd be instructive to have a Ruby or Python benchmark too, just to show how much you gain by using a lower-level language.

It depends which implementation get compared.

If the standard implementations get used, that any strong typed language with ahead of time compilation to native code will win hands down.

Now if RubyMotion or PyPy are part of the benchmark, maybe they can achieve good enough performance.

ksec12y ago

Love that. I am still hoping for a Ruby Implementation in Rust once Rust hit 1.0

samnardoni12y ago

Why? (Genuinely curious...)

codygman12y ago

I wish we could compare the old Haskell version to the C++ and Rust versions as well.

dwrenshaOP12y ago

You're probably thinking of the original version of Cap'n Proto's schema parser, which was written in Haskell. The code generation step that it helped to handle is not a part of this benchmark.

As far as I know, nobody has written a Cap'n Proto serialization runtime for Haskell yet.

See http://kentonv.github.io/capnproto/otherlang.html .

pjmlp12y ago· 2 in thread

Quite good results, given that Rust is still quite a young language.

annnnd12y ago

Agreed. Also, less (/no?) memory related bugs counts for something too.

rjzzleep12y ago

i'd be surprised if there wasn't a decent amount of bugs still in the standard library

1 more reply

benth12y ago

For the "catrank" case, could you use std::str::raw::from_utf8 to skip the utf-8 validity check?

j / k navigate · click thread line to collapse