Saturday, March 26, 2022

Apache NiFi: Avoid these common pitfalls

›
Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data. It has a powerful UI which can be used for both...
Sunday, February 27, 2022

Vagrant and Hyper-V: Don't do it!

›
I've used Vagrant since 2015 in combination with Virtualbox for creating development machines. Recently however I'm experiencing mor...
Sunday, February 6, 2022

Merge AVRO schema and generate random data or Java classes

›
Previously I wrote about generating random data which conforms to an AVRO schema ( here ). In a recent use-case, I encountered the situation...
Thursday, January 27, 2022

Java: Validating JSON against an AVRO schema

›
AVRO schema are often used to serialize JSON data into a compact binary format in order to for example transport it efficiently over Kafka. ...
Monday, January 24, 2022

Generating random JSON data from an AVRO schema in Java

›
Recently I was designing an AVRO schema and wanted to test how data would look like which conformed to this schema. I developed some Java co...
Monday, January 10, 2022

Apache NiFi: Forwarding HTTP headers

›
Apache NiFi can be used to expose various flavors of webservices. Using NiFi in such a way provides benefits like quick development using a ...
Wednesday, December 29, 2021

Apache NiFi: Reading COVID data from a REST API and producing it to a Kafka topic

›
Apache NiFi can be used to accelerate big data projects by allowing easy integration between various data sources. Using Apache NiFi it is e...