Arth

     Back in 2008, Netflix was majorly working on DVD-by-mail service. Due to the above mentioned database corruption incident, DVD shipping was disrupted for days. Netflix management decided to move to the cloud, away from relational systems in their data centers. The shift happened from vertical scaling of particular failure points to horizontal scaling of distributed systems which were highly reliable. The cloud was that of AWS (Amazon Web Services) which offered the company the ability to scale as much as they needed. Previously, Netflix team had to sit with their IT team to implement the scale up whenever their demand increased. Scalability was a huge issue with physical data warehousing. After shifting to AWS, scaling became seamless as petabytes of data could be used to stream videos within minutes, thanks to elasticity of the cloud. Based on user demand and with the help of AWS, Netflix could scale-up or down their data warehousing. Netflix itself admitted that it...

  Before we talk about serious issues like top big data challenges, it is logical that we first understand what big data is. So, What Is Big Data? The majority of experts define data using three ‘V’ terms. Therefore, your organization has big data, if your data stores bear the below characteristics. Volume – your data is so large that your company faces challenges linked to processing, monitoring, and storage. With trends such as mobility, Internet of Things (IoT), social media and eCommerce in place, a lot of information is being generated. As a result, almost every organization satisfies this criterion.   Velocity – does your firm generate new data at a high speed and you are required to respond in real-time? If yes, then your organization has the velocity associated with big data. The majority of companies involved with technologies such as social media, the Internet of Things and eCommerce meet this criterion.  Big data challenges and how you can solve them. ...

  #Day 1 GCP workshop  Summary :- 1. Cloud computing is the on-demand availability of computer system resources, especially data storage (cloud storage) and computing power, without direct active management by the user. The term is generally used to describe data centers available to many users over the Internet. Cloud computing uses remote resources, saving organizations the cost of servers and other equipment.  2. Google Cloud projects are the basis for creating, enabling, and using all Google Cloud services including managing APIs, enabling billing, adding and removing collaborators, and managing permissions for Google Cloud resources. We can create projects from web also(on GCP dashboard there is option to create project) and from cloud cli using this command we can create  gcloud projects create PROJECT_ID Where PROJECT_ID is the ID for the project you want to create .  3. Cloud Shell comes with Cloud SDK pre-installed. This means you can run gc...