# Fluentd

> Mediated Wiki article. Canonical URL: https://mediated.wiki/source/Fluentd
> Markdown URL: https://mediated.wiki/source/Fluentd.md
> Source: https://en.wikipedia.org/wiki/Fluentd
> Source revision: 1340446440
> License: Creative Commons Attribution-ShareAlike 4.0 International (https://creativecommons.org/licenses/by-sa/4.0/)

{{Short description|Open-source software project}}
{{Infobox software
| name = Fluentd
| logo = 
| screenshot = 
| caption = 
| developer = [Treasure Data](/source/Treasure_Data)
| released = {{Start date and age|df=yes|2011|10|10|br=yes}}
| latest release version = 1.16.6
| latest release date = {{start date and age|2024|08|20}}<ref name="github-release">{{cite web|url=https://github.com/fluent/fluentd/releases|via=[GitHub](/source/GitHub)|title=Releases - fluent/fluentd}}</ref>
| latest preview version = 
| latest preview date = 
| operating system = [Linux](/source/Linux) ([Amazon Linux](/source/Amazon_Linux), [CentOS](/source/CentOS), [RHEL](/source/RHEL)), [macOS](/source/macOS) (10.9 and above), [Windows](/source/Windows) (7 and above)
| programming language = [C](/source/C_(programming_language)), [Ruby](/source/Ruby_(programming_language))
| genre = Logging tool
| license = [Apache 2.0](/source/Apache_License)
| website = {{official URL}}
}}
{{Portal|Free and open-source software}}
'''Fluentd''' is a [cross-platform](/source/cross_platform) [open-source](/source/open-source_software) [data collection](/source/data_collection) software project originally developed at [Treasure Data](/source/Treasure_Data). It is written primarily in the [C](/source/C_(Programming_Language)) programming language with a thin-[Ruby](/source/Ruby_(programming_language)) wrapper that gives users flexibility.<ref>{{cite web | url=https://docs.fluentd.org/quickstart | title=Overview &#124; Fluentd }}</ref>

== Overview ==
Fluentd was positioned for "[big data](/source/big_data)," semi- or un-structured data sets. It analyzes [event log](/source/Logfile)s, [application](/source/Application_software) logs, and [clickstream](/source/clickstream)s.<ref>Pasupuleti, Pradeep and Purra, Beulah Salome (2015). [https://books.google.com/books?id=evioCwAAQBAJ&pg=PA48 ''Data Lake Development with Big Data'']. pp. 44–45; 48. [Packt](/source/Packt). {{ISBN|1785881663}}</ref> According to Suonsyrjä and Mikkonen, the "core idea of Fluentd is to be the unifying layer between different types of log inputs and outputs.",<ref>Suonsyrjä, Sampo and Mikkonen, Tommi [https://books.google.com/books?id=TRWcCgAAQBAJ&pg=PA170 "Designing an Unobtrusive Analytics Framework for Monitoring Java Applications"], pp. 170–173 in ''Software Measurement''. Springer. {{ISBN|3319242857}}</ref> Fluentd is available on [Linux](/source/Linux), [macOS](/source/macOS), and [Windows](/source/Microsoft_Windows).<ref>Fluentd.org. [http://www.fluentd.org/download "Download Fluentd"]. Retrieved 10 March 2016.</ref>

== History ==
{{Update|date=May 2024}}
Fluentd was created by Sadayuki Furuhashi as a project of the [Mountain View](/source/Mountain_View%2C_California)-based firm Treasure Data. Written primarily in [Ruby](/source/Ruby_(programming_language)), its source code was released as [open-source software](/source/open-source_software) in October 2011.<ref>Mayer, Chris (30 October 2013). [https://jaxenter.com/treasure-data-breaking-down-the-hadoop-barrier-2-107032.html "Treasure Data: Breaking down the Hadoop barrier"]. ''JAXenter''</ref><ref name="fluentd-architecture">Fluentd.org. [http://www.fluentd.org/architecture "What is Fluentd?"]. Retrieved 10 March 2016.</ref> The company announced $5 million of funding in 2013.<ref>{{Cite news |title= Treasure Data raises $5M, fuses Hadoop and data warehouse in Amazon's cloud |author= Derrick Harris |work= GigaOm |date= July 23, 2013 }}</ref>
Treasure Data was then sold to [Arm Ltd.](/source/Arm_Ltd.) in 2018.<ref>{{Cite web |title= Arm unit Treasure Data to seek buyer or IPO before Nvidia sale |work= Nikkei Asia |date= November 19, 2020 |access-date= August 2, 2021 |url= https://asia.nikkei.com/Business/Technology/Arm-unit-Treasure-Data-to-seek-buyer-or-IPO-before-Nvidia-sale }}</ref>

== Users ==

Fluentd was one of the data collection tools recommended by [Amazon Web Services](/source/Amazon_Web_Services) in 2013, when it was said to be similar to [Apache Flume](/source/Apache_Flume) or [Scribe](/source/Scribe_(log_server)).<ref>{{Cite web |title= Best Practices for Amazon EMR |author= Parviz Deyhim |date= August 2013 |publisher= Amazon Web Services |url= http://media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf |page= 12 |access-date= March 24, 2017 |archive-url= https://web.archive.org/web/20160326193947/http://media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf |archive-date= 2016-03-26 |url-status= dead }}</ref> [Google Cloud Platform](/source/Google_Cloud_Platform)'s [BigQuery](/source/BigQuery) recommends Fluentd as the default real-time data-ingestion tool, and uses Google's customized version of Fluentd, called google-fluent, as a default logging agent.<ref>[Google Cloud Platform](/source/Google_Cloud_Platform) (2016). [https://cloud.google.com/solutions/real-time/fluentd-bigquery "Real-time logs analysis using Fluentd and BigQuery"]. Retrieved 10 March 2016.</ref><ref>Google Cloud Platform (2016). [https://cloud.google.com/logging/docs/agent/ "The Logging Agent"]. Retrieved 10 March 2016.</ref>

== Fluent Bit ==
Fluent Bit is a log processor and log forwarder that is being developed as a [CNCF](/source/Cloud_Native_Computing_Foundation) sub-project under the umbrella of Fluent project.<ref>{{cite web |title=Fluent Bit|url=https://fluentbit.io/ |work=fluentbit.io |access-date=2021-12-05}}</ref> Fluentd is written in [C](/source/C_(programming_language)) and [Ruby](/source/Ruby_(programming_language)) and consumes at least 60 [megabyte](/source/megabyte)s of memory. [Fluent Bit](/source/Fluent_Bit) is written only in C, with no dependencies, and consumes approximately one megabyte of memory, making it easier to run under [embedded Linux](/source/Linux_on_embedded_systems) and in [container](/source/containerization_(computing))s.<ref>{{cite web |title=Fluentd & Fluent Bit - Fluent Bit: Official Manual |url=https://docs.fluentbit.io/manual/about/fluentd-and-fluent-bit |access-date=2021-12-05}}</ref>

== References ==
{{Reflist}}

==Further reading==
*Goasguen, Sébastien (2014). ''60 Recipes for Apache CloudStack: Using the CloudStack Ecosystem'', [https://books.google.com/books?id=S76uBAAAQBAJ&pg=PA109 "Chapter 6: Advanced Recipes"]. [O'Reilly Media](/source/O'Reilly_Media). {{ISBN|1491910127}}
*Wilkins, Phil (2022). ''Logging in Action, With Fluentd, Kubernetes and more.'' [Manning](/source/Manning_Publications). {{ISBN|9781617298356}}

==External links==
* {{Official website}}
* {{GitHub|fluent/fluentd}}

Category:Computer logging
Category:Data warehousing products
Category:Data security
Category:Data mining and machine learning software
Category:Free artificial intelligence applications
Category:Free science software
Category:Free data analysis software
Category:Free software programmed in Ruby
Category:Software using the Apache license
Category:System administration

---
Adapted from the Wikipedia article [Fluentd](https://en.wikipedia.org/wiki/Fluentd) by Wikipedia contributors ([contributor history](https://en.wikipedia.org/wiki/Fluentd?action=history)). Available under [Creative Commons Attribution-ShareAlike 4.0 International](https://creativecommons.org/licenses/by-sa/4.0/). Changes may have been made.