Apache Superset logo, https://superset.apache.org

Apache Superset is a modern data exploration and visualization platform that is supported and maintained by the open-source community. I can honestly say that this is a must-have service for all companies and I’m sure it’ll be helpful in data exploration and visualization with almost no cost.

Since Superset is free-to-use open-source software, we will start exploring its functionality with you right now.

The first step is to have Docker installed in your system. There are versions of Docker for macOS, Windows, and Linux. Unfortunately, Superset is not currently officially supported on the Windows platform, but you could use it…

Photo by Jeroen den Otter on Unsplash

Amazon provides two different managed services for querying data located in your data lake. The titles are AWS Athena and AWS Redshift Spectrum. These services both provide similar tools for managing data with SQL queries at the same price but have some distinctive features. I have prepared this article to cross the t’s and help you decide what to use in your data projects.

Both services provide full support of AWS Glue Data Catalog (and external Hive Metastore which is actually laid under Glue Data Catalog). …

Adult companies think today about how to increase the value of data stored in their data warehouses (DWH) and data lakes (DL), but to cut the costs for maintenance and support. New companies, at the same time, face big doubts on what should they plan to deploy first to get maximum advantage from their data — DWH or DL.

Many people, who look into the future, would say that nowadays is the best time to combine both approaches and to get a double benefit. But let’s firstly briefly look at two already known concepts.

Photo by janer zhang on Unsplash

According to Wikipedia, data warehouses are…

Photo by Jozsef Hocza on Unsplash

Many programmers use public code repositories like GitHub.com, to host their code. Moreover, it is great to have your code published on GitHub when you are creating a portfolio for your future employers. But what to do with passwords from your projects? How to work on a project with your small but inspired team and easily but safely share credentials like database accounts, API tokens? Saving passwords inside of your code is a way to lose your money. But enterprise-level key-pair managers, e.g. AWS Secrets Manager, are too complicated and expensive for small teams, right?

Well, the answer is no…

Earlier, we developed a process of creating a SOAP web service for interacting with SAP Business Warehouse (BW) ETL processes (aka process chains). Web services could really help integrate functionality across the systems in your company’s landscape. Moreover, we can benefit from integration between web services and some front end tools, let’s say, Telegram messenger.

Telegram Botfather Logo

Telegram is a simple and free messaging app. You can use Telegram on all your devices at the same time — your messages sync seamlessly across any number of your phones, tablets, or computers. …

SAP ABAP is a high-level programming language created by the German software company SAP SE. ABAP is widely used for programming in a variety of systems based on SAP NetWeaver Application Server including SAP Business Warehouse (BW). SAP BW is software for corporate data warehouses (DWH), it is one of the most popular solutions across Europe.

SAP Business Warehouse Logo

A significant part of SAP BW supports daily work time is usually spend in planning, starting, and analyzing process chains. Process chains are used for organizing data manipulation processes like extraction, transformation, and loading (ETL). …

How often did you dream about a native iOS tool that provides an ability to visualize essential data of your company in a simple and rapid way?

If you ask me, the answer is — every day before I had found the Numerics app from Cynapse. But first things first.

Let’s talk about the real tasks. I have had a request from a client for creating a new dashboard with data gathered from open API. It must provide information about prices of Top 8 world tradable currencies, prices must be shown in Russian Rubles. Source data hosted here: https://exchangeratesapi.io. Our…

We used to deploy our software on physical or virtual servers with pre-installed environments. It is easy to copy your Python script to that machine and run it via the command line. But what if you need this operation to be done once a month within a specific environment. Do we need to prepare a whole computing instance for this small operation? Another example. We need our code executed each time it triggered, but we cannot predict how often it will happen.

Thanks to AWS we have a simple solution. There is a service called AWS Lambda. Based on the…

Photo by Kyle Sung on Unsplash

Amazon is a widely-known leader in many areas, especially famous for its flexible superfast cloud web services. Amazon Web Services (AWS) offers more than 200 services for different purposes, such as computing nodes, database instances, file storage, and so on.

The purpose of this article is to provide you with easy step-by-step information on how to set up AWS Relational Database Service for your studies or for your new work project. It is assumed that you already have a working AWS billing account.

  1. Set up a new VPC or use one that you already have. VPC stands for Virtual Private…

Let’s decompose a simple query and see what’s it consists of:

SQL Query Example

This particular query consist of 7 elements we could distinguish:

SELECT — keyword that answers the question “what we are going to do with data?”. – currency — here we list column names that we are going to select, we must separate them by commas. It is possible to retrieve all columns, in this way asterisk “*” must be put here instead of column names. – FROM — obligatory keyword pointing to the data array we will look into. – cct — name of the database table that…

Aleksandr Gordienko

Data Engineer | Helping increase the value of your data

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store