Главная
Study mode:
on
1
Amazon Web Services - Sign up and Regions
2
Amazon Web Services - Networking
3
Amazon Web Services - Key Pair (authentication) and Security Groups (firewalls)
4
Amazon Web Services - Storage
5
Amazon Web Services - EC2 Pricing (Very Important)
6
Amazon Web Services - Provision EC2 Instance Demo
7
Amazon Web Services - Setup SSH forwarding (Bastion)
8
Amazon Web Services - Mac - Setup SSH Forwarding (Bastion)
9
Amazon Web Services - Setup SSH Tunneling and Foxyproxy
10
Big Data Introduction
11
Hadoop Introduction and brief comparison with Oracle
12
Hadoop Administration - CDH5 on AWS - Introduction
13
Setup CDH on AWS - Provision EC2 Instances
14
Setup CDH on AWS - Setup parallel ssh
15
Setup CDH on AWS - Setup http server on master01 or gateway node
16
Setup CDH on AWS - Setup local yum repository server for Cloudera Manager and Hadoop
17
Setup CDH5 on AWS - Setup pre-requisites using parallel-ssh
18
Setup CDH5 on AWS - Install Cloudera Manager
19
Setup CDH on AWS - Review Cloudera Management Service Components
20
Setup CDH on AWS - Setup HDFS
21
HDFS - Files and blocks - dfs.blocksize (Block Size)
22
HDFS - Replication Factor - Fault Tolerance
23
HDFS - Metadata, Datanode, Namenode and Secondary Namenode
24
HDFS - Heartbeat, Block report and Checksum
25
HDFS - Namenode Recovery (role of editlogs, fsimage and secondary namenode)
26
Setup CDH on AWS - Setup HDFS High Availability Introduction
27
Setup CDH on AWS - Setup HDFS High Availability using Cloudera Manager
28
HDFS - High Availability - Setup using Cloudera Manager
29
HDFS - High Availability - Review components and parameter files
30
HDFS Commands - hadoop fs command overview, help and appendToFile
31
HDFS Commands - cat, checksum, chgrp, chmod, chown
32
HDFS Commands - copyFromLocal or put, copyToLocal or get and cp
33
HDFS Commands - count, df, du and expunge
34
HDFS Commands - find, getmerge and ls
35
Hadoop Certification - HDPCA - Recover a snapshot
36
Hadoop Certification - HDPCA - Create a snapshot of an HDFS directory
37
Hadoop Certification - HDPCA - Configure ACLs
38
HDFS Commands - mkdir, moveFromLocal, moveToLocal, mv
39
HDFS Commands - stat, tail, test, text, touchz and usage
40
Setup Map Reduce v1 (MRv1) or Classic using Cloudera Distribution
41
Setup Map Reduce v1 (MRv1) or Classic using Cloudera Distribution - Review
42
Setup Map Reduce v1 (MRv1) or Classic using Cloudera Distribution - JobLifeCycle
43
Setup Map Reduce v1 (MRv1) - Heartbeat, Fault Tolerance and Speculative Execution
44
Setup Map Reduce v1 (MRv1) - Challenges
45
Setup CDH on AWS - Configure MRv2 + YARN
46
Setup CDH on AWS - Configure MRv2 + YARN - Review
47
Setup CDH on AWS - Configure MRv2 + YARN - Validate
48
Setup CDH on AWS - Configure MRv2 + YARN - Map Reduce Job Life Cycle
49
Setup CDH on AWS - Configure MRv2 + YARN - Fault Tolerance
50
Hadoop Certification - CCAH - Principal points to consider hardware and OS for Hadoop cluster
51
Hadoop Certification - CCAH - Cluster planning
52
Hadoop Certification - CCAH - Logging Configuration (log4j.properties)
53
Hadoop Certification - CCAH - Setup Hadoop eco system tools - Introduction
54
Hadoop Certification - CCAH - Hadoop metrics and cluster health monitoring
55
Setup CDH on AWS - Setup mysql for hive, oozie, sqoop etc.
56
Setup CDH - Setup Pig using Cloudera Manager
57
Setup CDH on AWS - Setup Hive using Cloudera Manager
58
Setup CDH on AWS - Setup Hive using Cloudera Manager - Review
59
Setup CDH on AWS - Setup Hive using Cloudera Manager - Validate
60
Setup CDH on AWS - Setup Sqoop using Cloudera Manager
61
Setup CDH - Schedulers Overview
62
Setup CDH - FIFO Scheduler
63
Setup CDH - Fair Scheduler
64
Setup CDH - Capacity Scheduler
Description:
Learn to set up and administer Cloudera Hadoop on Amazon Web Services (AWS) in this comprehensive 18-hour course. Explore AWS fundamentals, including networking, security, storage, and EC2 pricing. Master the process of provisioning EC2 instances and configuring SSH forwarding and tunneling. Dive into Big Data concepts and Hadoop administration, focusing on CDH5 deployment on AWS. Gain hands-on experience setting up HDFS, including high availability configurations, and learn essential HDFS commands. Explore MapReduce v1 and v2 with YARN, understanding job lifecycles and fault tolerance. Cover important Hadoop certification topics, including cluster planning, logging configuration, and metrics monitoring. Set up and configure various Hadoop ecosystem tools such as Pig, Hive, and Sqoop using Cloudera Manager. Conclude with an overview of Hadoop schedulers, including FIFO, Fair, and Capacity schedulers.

Hadoop Administration - Cloudera Hadoop on AWS

Add to list
#Data Science #Big Data #Cloudera #Programming #Cloud Computing #Amazon Web Services (AWS) #Hadoop
0:00 / 0:00
1 of 64

Amazon Web Services - Sign up and Regions