Hadoop

How your resume shouldn’t be – observations on screening profiles for Hadoop Admin role

I've screened around 50 profiles/resume in recent months for the technical round of Hadoop Admin/Engineer position and it's shocking to see how terrible the candidates resumes are. All the resumes came through Consultancies and they do have major share for the poor quality of those resumes. I'm listing the below points I observed during screening… Continue reading How your resume shouldn’t be – observations on screening profiles for Hadoop Admin role

AWS

AWS Certified Solutions Architect – Associate exam feedback

In this post I'm going to share my feedback on AWS Certified Solutions Architect Associate exam, preparation strategy and the exam tips. I passed all 3 AWS certifications in recent months and I took them in the order of CSA first, followed by Developer associate and finally Sysops Associate. You can find my feedback on… Continue reading AWS Certified Solutions Architect – Associate exam feedback

AWS

AWS Certified SysOps Administrator – Associate exam feedback

  I passed AWS Certified SysOps Administrator exam last week, thus completing the trifecta of AWS associate certifications. I took AWS Solutions Architect associate 3 months back, Developer associate 2 months back which really helped me in increasing my expertise in AWS and my confidence, which is key for this certification. As expected, Sysops is… Continue reading AWS Certified SysOps Administrator – Associate exam feedback

cca131

Multinode hadoop cluster configuration for CCA131 preparation

CCA131 exam is a fully hands on exam and one should have a practical experience of working in a hadoop cluster to pass the exam. If you don't have practical experience, then I'd recommend you to practice through Cloudera quickstart VM or build a multi node cluster in your laptop using VMs or in AWS.… Continue reading Multinode hadoop cluster configuration for CCA131 preparation

Hadoop

Hadoop Cluster – Pre Maintenance procedure

In IT, it's inevitable that all the servers will go for monthly security, vulnerability patching and hadoop servers are no exception. There'd be a separate Systems team to perform OS related patching, security updates, etc and your role is to bring down/up the cluster, ensure the application is good post patching. You've have to schedule… Continue reading Hadoop Cluster – Pre Maintenance procedure

Hadoop

Configure the Fair Scheduler to resolve application delays

Fair scheduling is a method of assigning resources to applications such that all apps get, on average, an equal share of resources over time. Using fair scheduler we can separate pools(queues) for each team and configure the resources for the pool which will help in overcoming application delays. In the exam you may be asked… Continue reading Configure the Fair Scheduler to resolve application delays

Hadoop

Determine reason for application failure

There are many possible causes for a job/application failure varying from code error, environments, files availability, permissions, mapreduce/yarn configuration, resources allocation and even due to server i/o, network issue etc., So the first thing you’ve to do when a job fails is, to look at the error message and correlate with your job. If an… Continue reading Determine reason for application failure