Shiny new objects are easy to find in the big data space. So when the industry’s attention shifted towards processing streams of data in real time–as opposed to batch-style processing that was popular ...

Organizations building real-time stream processing systems on Apache Kafka will be able to trust the platform to deliver each messages exactly once when they adopt new Kafka technology planned to be ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Ramya Krishnamoorthy shares a detailed case ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

The digital world is becoming ever more visual. From webcams and drones to closed-circuit television and high-resolution satellites, the number of images created on a daily basis is increasing and in ...

These days, massively scalable pub/sub messaging is virtually synonymous with Apache Kafka. Apache Kafka continues to be the rock-solid, open-source, go-to choice for distributed streaming ...

Kafka wasn’t the first open source project I was involved in at LinkedIn. We’d also built a key-value store, a workflow system, and a number of other things. The biggest difference with Kafka was that ...

The open-source technology behind hot startup Confluent, which allows companies to stream vast amounts of data for near-instant use, has earned it supporters at a who’s who of tech companies (think ...

In this section, we will examine the architectural components and related terminology in Kafka. Basically, Kafka consists of the following components: Kafka Cluster—a collection of one or more servers ...

Confluent, the commercial company built on top of the open source Apache Kafka streaming database project, announced today that it has closed a $50 million investment. The round was led by Sequoia ...