AI News, Machine Learning Netflix Style with Xavier Amatriain Recorded at:
- On Friday, June 8, 2018
- By Read More
Machine Learning Netflix Style with Xavier Amatriain Recorded at:
mean Hadoop is going to be helpful in one set of problems and of course at Netflix we do use Hadoop and we work on some of our solutions are based on using Hive or Pig Scripts that runs Hadoop, but one important thing to remember at Hadoop is that it provides solutions for sort of like Data Distribution problem or Distributed Data Computing and in an offline or batch mode setting, and that it’s just one part of the problem, which is an interesting one because some of your Big Data problems can be addressed that way and think about the kind of processes that you can run over night, I like to use the metaphor like, when your people are sleeping and you can crunch some numbers and run to Map Reduce job from Hadoop and the next day when they wake up you have something ready for them, that is a good thing to do on the Hadoop side of things.
If the user starts watching a movie or TV show, you know we have usually half an hour or two hours, you could be doing, you could update things, they don’t need to happen online in a few milliseconds, they could happen in a few minutes, but you can recompute and rebuild your models and you can recompute your Recommendations in a different way that would happen through sort of like the Big Data offline Hadoop pipeline that is going to be happening over night and it’s going to be Big Data crunching.
- On Monday, March 25, 2019
Big Ideas: Simplifying Big Data Loading
Watch all the Big Ideas videos at Well run companies take pride in their ability to have an accurate and current understanding of the "state ..
What is Data Replication?
Businesses want real time updates to their data, but they don't want to tie up the application systems that create that data, because it slows down the ...
Open source data processing on Google Cloud Platform (Google Cloud Next '17)
The great power provided by open source data processing tools has often come with the burden of great responsibility. The open source data processing ...
DATA & ANALYTICS - Data Processing & OSS: The NEXT Generation
Recorded on Mar 23 2016 at GCP NEXT 2016 in San Francisco. Open-source data tools allow you to process data in volumes not possible a few years ago, but ...
Serverless computing options with Google Cloud Platform (Google Cloud Next '17)
From Functions-as-a-Service to Backend-as-a-Service, even Big Data-as-a-Service, Serverless is taking many different shapes. Learn what these mean and ...
Big Business: Unlocking Value from Big Data with Analytics
Executives and data scientists from Baidu, LinkedIn, and Foursquare discuss how to generate real value from Big Data, and the importance of business leaders ...
Images & Video: The Killer Use Case for Cloud Storage
Storing media files has become a 'killer use case' for cloud storage. Learn how media files have unique requirements ideally met by the cloud, how Google ...
Apache Beam: Portable and Parallel Data Processing (Google Cloud Next '17)
Apache Beam provides a portable standard for expressing robust, out-of-order data processing pipelines in a variety of languages across a variety of platforms.
Real Time Big Data Analytical Architecture for Remote Sensing Application
Title: Real Time Big Data Analytical Architecture for Remote Sensing Application Domain: Cloud Computing Key Features: 1. The data stored in the underlying ...
GTAC 2011: Automating Hadoop Stack Deployment and Testing
6th Annual Google Test Automation Conference 2011 (GTAC 2011) "Cloudy With A Chance Of Tests" Computer History Museum Mountain View, CA USA ...