Home

Welcome to Flume!

Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. The system is centrally managed and allows for intelligent dynamic management. It uses a simple extensible data model that allows for online analytic application

Flume is open-sourced under the Apache Software Foundation License v2.0.

It is written primarily in Java and has been tested on unix-like systems:

• Ubuntu 9.4+ (DEB compatible)
• Centos 5.3+ (RPM compatible)
• Mac OS X

System Documentation

Flume Installation Instructions

Flume User Guide

Flume Cookbook

FAQ

Flume plugins

• Cassandra Sink
• Elastic Search Sink
• Voldemort (in progress)
• Hive (in progress)
• HBase (in progress)

Contact us!

User resources

• User mailing list
• Cloudera.org issue tracker
• Flume Bug Tracker
• IRC channel #flume on irc.freenode.net

Developer resources

• Developer mailing list
• Development documentation
• HowToContribute

Thanks!

YourKit is kindly supporting open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of innovative and intelligent tools for profiling Java and .NET applications. Take a look at YourKit’s leading software products: YourKit Java Profiler and YourKit .NET Profiler.