Skip to content

Apache NiFI

https://nifi.apache.org/

What is for

Apache NiFi is an integrated data logistics platform for automating the movement of data between disparate systems.

Apache NiFi supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic. Some of the high-level capabilities and objectives of Apache NiFi include:

  • Web-based user interface
    • Seamless experience between design, control, feedback, and monitoring
  • Highly configurable
    • Loss tolerant vs guaranteed delivery
    • Low latency vs high throughput
    • Dynamic prioritization
    • Flow can be modified at runtime
    • Back pressure
  • Data Provenance
    • Track dataflow from beginning to end
  • Designed for extension
    • Build your own processors and more
  • Enables rapid development and effective testing
  • Secure
    • SSL, SSH, HTTPS, encrypted content, etc...
    • Multi-tenant authorization and internal authorization/policy management

What is NOT for

  • Data Storage
  • Not for Aggregations
  • Not an ETL Tool (but can be part of a ETL solution)

Get Apache NiFi

  • Binaries

    https://nifi.apache.org/download.html
    

  • Docker

    https://hub.docker.com/r/apache/nifi/
    

User Guide

https://nifi.apache.org/docs/nifi-docs/html/user-guide.html