In this tutorial, we will learn about Python Virtual Environment (also referred to as virtualenv). We will cover installation of required packages as well as how to use virtual environments for development process. 1. What is Virtual Environment? A python virtual environment is an isolated working copy of Python. It allows us to work on a specific project without worry of affecting other projects...
Today, we are dealing with a lot of data from multiple sources and it is becoming complex to manage data. Different types of data, structured, unstructured, pictures, audios etc along with the creation of new sources of data with an increase in adoption of mobile devices and IOT. Data management is becoming a complex issue. When we are dealing with so much information in so many different forms...
Companies that collect any kind of personal data on citizens in European Union (EU) countries will need to comply with new rules regarding the protection of customer personal data as per the guidelines of the new standard called General Data Protection Regulation also known as GDPR in short. Organizations are in the process of understanding the new regulations and planning the actions that need...
With the rise of data and the introduction of “Big Data” into the businesses over the recent years, it had become evident for the organizations that they need to understand the data better and make use of it in business growth. In the last couple of decades, with the influx of technology use in organizations, we saw the emergence of CTO and CIO roles and with the recent advancements...
Big Data had been around as a buzz word for some time now but still, there are confusions about what exactly it is, especially for people who are not involved directly in technical departments. It can be due to lack of leadership sophistication around the concept and its associated possibilities. Big Data: A Beginner’s Guide for Non-Technical People is a guide to address that. We will go...
In this article, we will look at Apache NiFi Interview Questions. Questions are of varying complexity but all are very important and you should know the answer to all these questions before going to an interview. Apache NiFi Interview Questions and Answers 1. What is Apache NiFi? Apache NiFi is enterprise integration and dataflow automation tool that allows sending, receiving, routing...
As we learned in the article Apache NiFi Sensitive Properties: All you need to know about how the sensitive properties are stored and how they are encrypted/decrypted. We came to understand that the encryption key is stored in nifi.properties file. This is not a very good and secure setup to have. In this article, we will learn how to secure the encryption key/password in the properties file...
[one_two_first] In Apache NiFi, Sensitive Properties as the name indicates are the processor specific properties which should not be available/visible to everyone. In this article, we will see how Apache NiFi caters to these values, how they are stored, what we can do to make it even more secure and all other things we need to know about sensitive properties in Apache NiFi...
In this articles, we will understand what Apache NiFi is, how we can use it and where it fits in the whole big data ecosystem. [two_first] 1. Apache NiFi Apache NiFi is a data pipeline in the most simple words. It is built to automate the flow of data from one system to another. When we need a continuous flow of data from a system to another, this is where Apache NiFi comes in handy, we can...
Ramaninder is working as a Big Data Engineer and is an avid follower of latest technologies, especially in Big Data Ecosystem. He graduated from Georg-August University, German and holds M.Sc in Applied Computer Science with specialisation in Applied Systems Engineering and minor in Business Informatics. He is also a Microsoft Certified Professional with more than 7 years of experience in Java, C#, Big Data, Web development and related technologies.