Skip to content

Entry

Fluentd

Appears in 5 awesome lists

Set Up Once, Collect More. Fluentd is an open source data collector designed for processing data streams. 150+ plugins instantly enable you to store the data for Log Management, Big Data Analytics, etc

Open fluentd.org

Found in these lists

Awesome Data Engineering

Section: Data Ingestion · An open source data collector for unified logging layer.

FreshScore 87

Awesome Sysadmin

Section: Log Management · Data collector for unified logging layer. (Source Code) Apache-2.0 Ruby

FreshScore 92

Table of Contents

Section: Log Management · Log Collector and Shipper.

SlowScore 61

Hacker News Tools of the Trade

Section: Log Monitoring · Set Up Once, Collect More. Fluentd is an open source data collector designed for processing data streams. 150+ plugins instantly enable you to store the data for Log Management, Big Data Analytics, etc

ActiveScore 78

Awesome DevOps

Section: Observability & Monitoring · Data collector for unified logging layer.

FreshScore 87

ingestr

CLI tool to copy data from any source to any destination with a single command. Load data into your warehouse before dbt transforms it. Supports 50+ sources including Postgres, MongoDB, Salesforce, Shopify.

In 6 listsDetails

Xquik

Real-time X (Twitter) data platform for tweet search, user lookup, follower/following extraction, engagement metrics, account monitoring, reply/retweet/quote extraction, community & Space data, and mutual follow checks.

In 4 listsDetails

Duckle

Local-first, open-source desktop ETL/ELT studio: drag a pipeline onto a canvas (or describe it to a built-in on-device AI assistant) and run it at native speed through DuckDB. 290+ connectors, a scheduler, and an MCP server for driving pipelines from an LLM. No cloud, no servers.

In 3 lists

Flume

Distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. (Source Code) Apache-2.0 Java

In 3 lists

AWS Data Wrangler

An open-source Python package that extends the power of Pandas library to AWS connecting DataFrames and AWS data related services (Amazon Redshift, AWS Glue, Amazon Athena, Amazon EMR, etc).

In 3 lists

Kafka

Publish-subscribe messaging rethought as a distributed commit log.

In 3 lists

DataRaven

managed cloud object storage transfers for data ingestion workflows.

In 3 lists

RabbitMQ

Open source Erlang-based message broker that just works.

In 3 lists