Tidyverse is a collection of R packages, primarily for data engineering and analytics. These packages are ggplot2, purrr, tibble, dplyr, tidyr, stringr, readr, and forcats. And all combine the same language, design and “grammar” structures. 1. Use pipe “%__%” for…Read more ›

How does the conversion between decimal to binary or from binary to decimal behave? With another useless function, I have plotted the points (x = decimal number, y = converted binary number) on a scatter plot. Just to find out…Read more ›

From the previous blogpost:– CSV or alternatives? Exporting data from SQL Server data to ORC, AVRO, Parquet, Feather files and store them into Azure data lake we have created Azure blob storage, connected secure connection using Python and started uploading files…Read more ›

When it comes to O(N log(N)) time complexity functions, this is the right section. 🙂 Given an array of natural numbers (later, you will see, it can be real, or any other less complex system (rational, irrational)) and you create…Read more ›

Merge statement in R language is a powerful, simple, straightforward method for joining data frames. Nevertheless, it also serves with some neat features that give R users fast data wrangling. I will be comparing this feature with T-SQL language, to…Read more ›

Many of you have already used any programming or scripting language. And you can tell that, there are some functionalities that are intuitive (for loops, enumerations, collections, …), data types and also short-hands. One of these data types is a…Read more ›

The famous algorithm of contiguous subarray within a one-dimensional array of numbers that has the largest sum is called Kadane's algorithm. It looks for global maximum of positive sum on any sub-array, regardless of it's starting position or it's length. Numbers must be next or together in a sequence (without ...

After an interesting conversation on using data. frames or strings (as a vector), I have decided to put this to a simple benchmark test. The problem is straightforward and simple: a MapReduce or Count with GroupBy. Problem Given a simple…Read more ›

Jupyter notebook offers also the use of developers or prerelease versions of Jupyter notebooks. What you need to do is simply run: And with this prerelease version of the Jupyter notebook, you have in addition several options to enhance your…Read more ›

Data come in variety of form, at different pace, and at different volume. And if all three criteria define the difference between SQL and NoSQL and there, all three are still irrelevant for data science. My theorem is, that no matter what shape, size, frequeny, value and trustworthiness, SQL type ...

Generating violin boxplots from image. Yes, why not. 🙂 We create a raster image from a picture and calculating the ratio of the pixels on the scale of grayscale. The more the darker colour is represented in the pixels, the…Read more ›

Playing a simple guessing game with R. It’s called Mastermind game! This game was originally created for two people, but R version will be for single-player mode, when an R developer or R data scientists need a break. The gameplay…Read more ›

With October 2021 version of R Studio (2021.09.1 Preview) a great and – in my personal opinion – long awaited features is now available – multi windows or multi panes for viewing the R code. On R studio home page,…Read more ›

Series of Apache Spark posts: Dec 01: What is Apache Spark Dec 02: Installing Apache Spark Dec 03: Getting around CLI and WEB UI in Apache Spark Dec 04: Spark Architecture – Local and cluster mode Dec 05: Setting up Spark Cluster Dec 06: Setting up IDE Dec…Read more ›

Series of Apache Spark posts: Dec 01: What is Apache Spark Dec 02: Installing Apache Spark Dec 03: Getting around CLI and WEB UI in Apache Spark Dec 04: Spark Architecture – Local and cluster mode Dec 05: Setting up Spark Cluster Dec 06: Setting up IDE Dec…Read more ›

Series of Apache Spark posts: Dec 01: What is Apache Spark Dec 02: Installing Apache Spark Dec 03: Getting around CLI and WEB UI in Apache Spark Dec 04: Spark Architecture – Local and cluster mode Dec 05: Setting up Spark Cluster Dec 06: Setting up IDE Dec…Read more ›

Series of Apache Spark posts: Dec 01: What is Apache Spark Dec 02: Installing Apache Spark Dec 03: Getting around CLI and WEB UI in Apache Spark Dec 04: Spark Architecture – Local and cluster mode Dec 05: Setting up Spark Cluster Dec 06: Setting up IDE Dec…Read more ›

Series of Apache Spark posts: Dec 01: What is Apache Spark Dec 02: Installing Apache Spark Dec 03: Getting around CLI and WEB UI in Apache Spark Dec 04: Spark Architecture – Local and cluster mode Dec 05: Setting up Spark Cluster Dec 06: Setting up IDE Dec…Read more ›