cca131 · Hadoop

Execute file system commands via HTTPFS

HttpFS is a service that provides HTTP access to HDFS. i.e we can access the HDFS from other filesystems from browsers, and using programming languages. HttpFS has a REST HTTP API supporting all HDFS filesystem operations (both read and write). Using HttpFS, we can Read and write data in HDFS using HTTP utilities (such as… Continue reading Execute file system commands via HTTPFS

cca131 · Hadoop

Set up alerting for excessive disk fill

Alert Publisher, one of the Cloudera’s management services, used to send alert notifications by email or by SNMP. Service instances of type HDFS, MapReduce can generate alerts if so configured. Alerts can also be configured for the monitoring roles that are a part of the Cloudera Management Service. Go to CM – Cloudera Management Service… Continue reading Set up alerting for excessive disk fill

cca131 · Hadoop

Configure a service using Cloudera Manager

Configuring a service is one of the hardest tasks in Apache Hadoop, but Cloudera Manager has made our lives easier. For any configurations, you only have to give the values for the property, then Cloudera Manager will take care of updating the dependent services configuration, updating all the conf files (hdfs-site, yarn-site, core-site,etc) and deploy… Continue reading Configure a service using Cloudera Manager

cca131 · Hadoop

Add a new node to an existing cluster

This task’s steps are as same as the steps involved in installing CDH but the scenario is different, as we’re adding hosts to an existing cluster. Once the cluster is setup and running, you may have the requirement for adding new nodes to the cluster. To do that, ensure initial OS configurations/prechecks are complete. Go… Continue reading Add a new node to an existing cluster

cca131 · Hadoop

Install Cloudera Manager server and agents

There are three ways to install the Cloudera Manager(server, agents), CDH and services. Automated installation by Cloudera Manager Install using Cloudera Manager parcels/packages Manual installation using Cloudera Manager Tarballs   Automated installation by Cloudera Manager: This is the most preferred way to install Cloudera Manager in non-production/test environments. This is not recommended for production deployments.… Continue reading Install Cloudera Manager server and agents