Configure a service using Cloudera Manager

Configuring a service is one of the hardest tasks in Apache Hadoop, but Cloudera Manager has made our lives easier.

For any configurations, you only have to give the values for the property, then Cloudera Manager will take care of updating the dependent services configuration, updating all the conf files (hdfs-site, yarn-site, core-site,etc) and deploy the client configuration.

For configuring a service, go to CM – Service – Configuration section – using search option you can find the relevant property.

Ex, to configure the datanode to reserve 5 GB for non-dfs usage (mapreduce temp output, log files) of their total disk capacity,

Go to HDFS – configuration – search ‘space or reserved or disk’

As you see , the property is listed first, configure/modify it to 5 GB – save changes – deploy Client Config.

Similarly, to change job history log location

Go to Yarn – configuration – search ‘log’

This is very simple to do, only thing is you have to know which service the given configuration is referring to.

You can also search using the search bar in the right top corner of the CM page and look for the relevant properties.

Problem Scenarios:

· Configure datanodes to tolerate 1 failed volumes.

· Change the datanodes log dir to /hadoop/logs

· Configure Yarn to retain only last 5 days logs.

Thus we covered how to Configure a service using Cloudera Manager

Use the comments section below to post your doubts, questions and feedback.

Please follow my blog to get notified of more certification related posts, exam tips, etc.

 


 

Leave a Reply

%d bloggers like this: