by Markus Breuer | Jun 11, 2022 | Big Data
Here are some Apache Spark and Delta Lake examples. Actually, they are always the same problems. But searching and finding the solutions on the internet costs a lot of time. Is something still missing? Then just let me know! Preparations The Apache Spark distribution...
by Markus Breuer | Jun 7, 2022 | Big Data
Running Apache Spark from the Docker image causes problems with autocomplete in the shell. In that way, the apache spark-shell autocomplete is broken. Suspicion falls on the terminal settings and the JLine configuration. In fact, the cause lies in a completely...
by Markus Breuer | Apr 9, 2022 | DevOps, Docker
Setting up the workstation with small auxiliary tools is done quickly for the individual. In a growing team, the setup quickly becomes a challenge. Containers can help and bring everything ready configured to each individual’s workplace. Setting up the new...
by Markus Breuer | Aug 12, 2021 | Security
Many applications are vulnerable to attacks. Application development is becoming increasingly complex. At the same time, security requirements are gaining in importance. In this article, I show the challenges and offer solutions. Focusing on the principle of secure...
by Markus Breuer | Aug 7, 2021 | Big Data
A list of common Docker Topics (more): The Haskell Dockerfile Linter helps to build best practice Docker images. The Dockerfile Lint allows the building of custom policies to build best practice Docker images. Use Makefiles for Docker building Docker Images. How...
by Markus Breuer | Apr 30, 2021 | Docker
Openshift and also OKD Docker image is stuck when loading. A severe bug in the CRI-O engine causes stuck the OKD Docker images in an invalid and unusable state. There are discussions about timeouts while loading the images from the docker registry or too long...
by Markus Breuer | Mar 14, 2021 | DevOps, Docker
The Windows Subsystem for Linux is the seamless integration of Linux into Windows. Use Windows natively and quickly issue a Linux command. Apply a Linux command to the Windows file system without having to start a virtual machine. As a result, Linux is always...
by Markus Breuer | Jan 8, 2021 | Docker
The POD fails to start, and referrers to the image layer not known. The “layer not known” issue may affect one or more cluster nodes. In effect, there is a corrupt docker image on the local disk cache. The layer not known problem still exists, even after a...
by Markus Breuer | Nov 28, 2020 | Docker
Where are the Docker daemon configuration files located? How to restart the Docker daemon after applying changes to the configuration? How to change and activate the Docker configuration? These are frequently asked questions. But changes to the Docker configuration...
by Markus Breuer | Aug 5, 2020 | Big Data
Regular Expressions are a powerful tool to split texts into fragments. Furthermore, Apache Spark is an analytics engine and capable of processing large amounts of data sets. The feature of naming capturing groups makes the usage of regular expressions more accessible....
Recent Comments