Resolve performance problems/errors in cluster operation

This is again another scenario based topic. Some of the common performance problems are jobs running slowly, services crash due to out of memory, etc., Example: When I’m adding Yarn roles, one of the node managers failed to start. In this case, we have to identify the cause for the failure. Select Log files dropdown … Continue reading Resolve performance problems/errors in cluster operation

Resolve errors/warnings in Cloudera Manager

This is a typical scenario based question and the solution is solely depend upon the errors/warnings appears in the Cloudera Manager. Some examples: The warnings could be space issue, service health status, low resources allocations, etc., The errors could be log directories are full, services down and other critical events.     In these scenarios, … Continue reading Resolve errors/warnings in Cloudera Manager

Set up alerting for excessive disk fill

Alert Publisher, one of the Cloudera’s management services, used to send alert notifications by email or by SNMP. Service instances of type HDFS, MapReduce can generate alerts if so configured. Alerts can also be configured for the monitoring roles that are a part of the Cloudera Management Service. Go to CM – Cloudera Management Service … Continue reading Set up alerting for excessive disk fill

Configure a service using Cloudera Manager

Configuring a service is one of the hardest tasks in Apache Hadoop, but Cloudera Manager has made our lives easier. For any configurations, you only have to give the values for the property, then Cloudera Manager will take care of updating the dependent services configuration, updating all the conf files (hdfs-site, yarn-site, core-site,etc) and deploy … Continue reading Configure a service using Cloudera Manager

Install Cloudera Manager server and agents

There are three ways to install the Cloudera Manager(server, agents), CDH and services. Automated installation by Cloudera Manager Install using Cloudera Manager parcels/packages Manual installation using Cloudera Manager Tarballs Automated installation by Cloudera Manager: This is the most preferred way to install Cloudera Manager in non-production/test environments. This is not recommended for production deployments. Cloudera … Continue reading Install Cloudera Manager server and agents