Data ingest using Apache NiFi

Course date duration: August 8th, 2020, 9:30 – 14:00, 30 min break included
Trainer: Lucian Neghina
Location: Online (using Zoom)
Price: 150 RON (including VAT)
Number of places: 10 3 places left
When you need to design a data solution one of the earliest questions is where your data is coming from and how you will make it available to the solution/solutions that processes/stores the data. Especially since data we might deal with IoT data, thus various sources, and data will be as well processed and stored by several components of your solution. Even more nowadays that we work mainly with streams not with static data such a solution that is able to design and run the flow of events from the source/sources to the processing/storage stage it’s extremely important. Apache NiFi has been built to automate that data flow from one system to another. Apache NiFi is a data flow management system that comes with a web UI that helps to build data flows in real time. It supports flow-based programming.

This workshop will be an introductory hands-on class to learn basic concepts of data flow, which will allow you to collect and transport data from numerous sources including real-time events, data from external sources, structured and unstructured data. The workshop is addressed mainly to developers and data engineers.

Agenda:

Introduction

Data flow & Data pipeline
ETL vs ELT
Data at rest & Data in motion
Data ingest patterns

Basic Concepts

User Interface
FlowFile
Processor
Connector

In depth

Expression Language
Templates
Data Provenance
Version Control
Custom Processor

Requirements for the participants:

Basic knowledge of Java & Maven
Database experience (PostgreSQL or MySQL)
Installing Docker for the hands-on

Requirements for the systems: minimum 16GB RAM

The price for the workshop is 150 RON (including VAT). In order to register for this workshop it is required to complete the registration form and the payment step.

1. Complete registration form:

Full name(required)

Email(required)

Company

If you need an invoice, after the payment step, please send an email to contact@bigdata.ro with the invoicing details. Based on your data we will send you back the invoice.

For the training practical part it is required that you have your laptop with you .

Terms and Conditions: the fee you pay is nonrefundable, unless the event is canceled/re-scheduled by the organizer. The ticket is possible to be transferred to another person, but is mandatory that you announce the organizer the new name minimum 2 days before the event. The organizer can re-schedule the event, if a minimum of 10 participants is not met. In these circumstances a new date will be provided for the event and the option to refund your money.

2. Complete payment here.

Data ingest using Apache NiFi

Agenda:

Requirements for the participants:

Share this:

Like this: