Maxwell

Maxwell: Open-Source Database Data Streaming Tool

Extract data from databases and stream it into Kafka or other streaming platforms with Maxwell, an always-on service for real-time applications.

What is Maxwell?

Maxwell is an open-source change data capture (CDC) tool that extracts row-level changes from MySQL, MariaDB, and PostgreSQL databases and publishes those changes to other systems in real-time. It captures insert, update, and delete operations and produces a JSON representation of those changes that includes the primary key(s) and data for each changed row.

Some key capabilities and benefits of Maxwell include:

• Real-time replication of database changes to Kafka, Kinesis, or other streaming platforms
• Blazing fast performance with native database binlogs
• Replays historical changes from a database for initial integration
• Filters to specify which databases and tables to replicate
• Integrates seamlessly with streaming ecosystems like Kafka, Spark, Flink etc.
• Battle-tested reliability and recovery from failures

Maxwell provides an always-on CDC pipeline from databases to streaming platforms. It handles all the complexity of database change extraction, transformation, replication, and recovery. It's a simple yet powerful enabling technology for building real-time applications and data pipelines.

Maxwell Features

Official Links