by Markus Breuer | Jul 7, 2019 | Big Data
Apache Maven java build tool? Maven is a widely used build management tool. Apache Software Foundation maintains maven in java programming language. So a lot of java projects use maven as build management tool. Maven follows the paradigm convention over configuration....
by Markus Breuer | Jun 30, 2019 | Big Data
How to store large amount of files in file system? by Markus Breuer | Jun 30, 2019 | Big Data | 0 comments Storing large amounts of files become a challenge. Modern file systems are powerful. But when filling them up with many files they reach limits. The smaller file...
by Markus Breuer | Jun 19, 2019 | Big Data
create custom ssl certificate In theory it is easy to create self-signed host certificates. But in practice there are some stumbling blocks when creating certificates. This example creates a root CA by using open-oource tool openssl. This are the basic steps: create...
by Markus Breuer | Apr 8, 2019 | Big Data, Docker
Docker is a lightweight framework for virtualizing application processes. Instead of emulating a computer hardware that still needs an operating system to run applications, Docker takes a different approach. Docker is able to pretend an operating system environment to...
by Markus Breuer | Jul 20, 2018 | Big Data
Hadoop sequence files are applicable for apache spark Hadoop sequence files are key-value containers and offer efficient access to apache spark analytics engine. A nearly random access to sections of a sequence files allows spark to split sequence files in parallel...
by Markus Breuer | Jul 8, 2018 | Big Data
Type-safe arguments help to make the code more maintainable. With an increasing number of optional parameters, the number of method signatures often increases. The attempt to cover all important combinations often ends in a multitude of similar methods. This article...
by Markus Breuer | Jun 10, 2017 | Big Data
Apache Spark is a powerful tool to process large amounts of data. The docs show many examples to analyze csv-like data, which is already covered by spark csv. But how to analyze more complex data, e.g. an accesslog file? At first sight it looks quite simple because...
by Markus Breuer | Apr 17, 2016 | Big Data
This image was created with blender for the Weekly CG Challenge. I participated for the very first time. Colors ar sculpted. https://www.bytefusion.de/
Recent Comments