The Quix blog

The main difference between Spark and Beam is that the former enables you to both write and run data processing pipelines, while the latter allows you to write data processing pipelines, and then run them on various external execution environments (runners). But what are the other differences between Spark and Beam, and how are they similar?

Explore the characteristics, challenges, and benefits of machine learning pipelines, and read about the steps involved in training and deploying ML models to production.

An in-depth comparison of Apache Kafka and Pulsar, covering criteria such as architectural differences, operational attributes, developer experience, ecosystems, deployment options, and security.

Teams can now build AI applications on Confluent’s data in motion, with Quix, the AI-ready event streaming application framework.

Explore the AI applications that you can build when connecting Quix with Confluent.

What is real-time machine learning? How is it different from batch ML? What are common real-time ML use cases? What are the challenges of building real-time ML capabilities? All these questions and more are answered in this article.

Explore the evolution of new tools for real-time pipelines that aim to solve the ongoing problem of data scientists' need for more infrastructure expertise.

Should data scientists know Java? Java and Scala underpin many real-time, ML-based applications—yet data scientists usually work in Python. Someone has to port the Python into Java or adapt it to use a Python wrapper. Neither of these options is ideal, so what are some better solutions?

Explore the fundamentals of time series analysis in this comprehensive article. Learn about key concepts, use cases, and types of time series analysis, and discover models, techniques, and methods to analyze time series data.

Gain a thorough understanding of telemetry data and how it works, learn about its benefits, challenges, and applications across different industries, and discover technologies you can use to operationalize telemetry.

A look at the most common causes of Kafka's "unknown topic or partition" error along with practical steps and solutions to help you fix it.

Explore the unique features and limitations of Apache Kafka and Apache Flink and learn how these open source streaming titans can either join forces or operate independently.

A monthly round-up of the most interesting news coming out of the stream processing ecosystem

Moving code from prototype to production can be tricky—especially for data scientists. There are many challenges in deploying code that needs to calculate features for ML models in real-time. I look at potential solutions to ease the friction.

Using ksqlDB for real-time feature transformations isn't as easy as it looks. I revisit the strategy to democratize stream processing and examine what's still missing.

A monthly round-up of the most interesting news coming out of the stream processing ecosystem

Learn how to reprocess a stream of data with the Quix Streams Python library and Apache Kafka. You'll ingest some GPS telemetry data into a topic and replay the stream to try out different distance calculation methods.

Explore the differences between Quix and Apache Flink and find out when it's better to use Quix as a Flink alternative. If you’re searching for Apache Flink alternatives, this guide offers a detailed, fair comparison to help you make an informed decision.

A detailed comparison of Apache Kafka and Amazon Kinesis that covers categories such as operational attributes, pricing model, and time to production while highlighting their key differences and use cases that they typically address.

A monthly round-up of the most interesting news coming out of the stream processing ecosystem

How Brompton's experiments with Quix and AWS technology are paving the way for an enhanced e-bike riding experience.

Learn why data compression is vital and how use it with Kafka and kafka-python, focussing on gzip—one of the strongest compression tools that Kafka supports.

Lightweight, powerful, no JVM and no need for separate clusters of orchestrators. Here’s a look at our next-gen streaming library for C# and Python developers including feature summaries, code samples, and a sneak peek into our roadmap.

Build a simple event-driven system to get ML predictions with Python and Apache Kafka