Streaming data from Kafka into Cassandra in real time -


what's best way write date kafka cassandra? expect solved problem, there doesn't seem standard adapter. lot of people seem using storm read kafka , write cassandra, storm seems of overkill simple etl operations.

we heavily using kafka , cassandra through storm

we rely on storm because:

  • there lot of distributed processing (inter-node) steps before result of original message hit cassandra (storm bolt topologies)

  • we don't need maintain consumer state of kafka (offset) ourselves - storm-kafka connector doing when products of original message acked within storm

  • message processing distributed across nodes storm natively

otherwise if simple case, might read messages kafka , write result cassandra without of storm


Comments

Popular posts from this blog

css - SVG using textPath a symbol not rendering in Firefox -

Java 8 + Maven Javadoc plugin: Error fetching URL -

datatable - Matlab struct computations -