Kafka-on-Pulsar: bring native Kafka protocol support to Apache Pulsar (opens in new tab)

(streamnative.io)

19 pointslmsp6y ago7 comments

7 comments

Does anyone know what is happening with Pulsar since Splunk brought them out?

It looks to of stagnated since the announcement was made.

Architecture wise Pulsar is a far better piece of engineering than Kafka but with Confluent's funding and aggressive marketing it looks like Kafka has cornered the market for better or worse.

adamfeldman6y ago

Splunk bought a company called Streamlio [1].

StreamNative is the company behind the linked blog post and project.

My (outsider) understanding is that both Streamlio and Splunk employ(ed) active members of the Pulsar community.

[1]: https://www.splunk.com/en_us/blog/leadership/splunk-to-expan...

oweiler6y ago

I always hear it's better architecture-wise but what are the real life implications of difference?

Also, Kafka has:

* ksql * ksqlDB * Kafka Connect * Kafka Streams

Does Pulsar has something comparable?

thenaturalist6y ago

Yes, you can run SQL using Presto [1], and by connecting. Not sure about ksqlDB as I am not familiar with it, but my understanding is Apache Flink would give you analog capabilities. Pulsar has IO capabilities analog to Kafka Connect [2]. Analogous to Kafka Streams, Pulsar offers Functions [3].

[1] http://pulsar.apache.org/docs/en/sql-overview/

[2] http://pulsar.apache.org/docs/en/io-overview/

[3] http://pulsar.apache.org/docs/en/functions-overview/

Anonymitaet6y ago

KoP GitHub repo: https://github.com/streamnative/kop

Anonymitaet6y ago

More details about KoP: https://streamnative.io/blog/tech/2020-03-24-bring-native-ka...

Anonymitaet6y ago

KoP Webinar: https://zoom.us/webinar/register/6515842602644/WN_l_i-3ekDSg...

j / k navigate · click thread line to collapse

7 comments

tiew9Vii6y ago

Does anyone know what is happening with Pulsar since Splunk brought them out?

It looks to of stagnated since the announcement was made.

Architecture wise Pulsar is a far better piece of engineering than Kafka but with Confluent's funding and aggressive marketing it looks like Kafka has cornered the market for better or worse.

adamfeldman6y ago

Splunk bought a company called Streamlio [1].

StreamNative is the company behind the linked blog post and project.

My (outsider) understanding is that both Streamlio and Splunk employ(ed) active members of the Pulsar community.

[1]: https://www.splunk.com/en_us/blog/leadership/splunk-to-expan...

oweiler6y ago

I always hear it's better architecture-wise but what are the real life implications of difference?

Also, Kafka has:

* ksql * ksqlDB * Kafka Connect * Kafka Streams

Does Pulsar has something comparable?

thenaturalist6y ago

[1] http://pulsar.apache.org/docs/en/sql-overview/