How your resume shouldn’t be – observations on screening profiles for Hadoop Admin role

I've screened around 50 profiles/resume in recent months for the technical round of Hadoop Admin/Engineer position and it's shocking to see how terrible the candidates resumes are. All the resumes came through Consultancies and they do have major share for the poor quality of those resumes. I'm listing the below points I observed during screening … Continue reading How your resume shouldn’t be – observations on screening profiles for Hadoop Admin role

Hadoop Cluster – Pre Maintenance procedure

In IT, it's inevitable that all the servers will go for monthly security, vulnerability patching and hadoop servers are no exception. There'd be a separate Systems team to perform OS related patching, security updates, etc and your role is to bring down/up the cluster, ensure the application is good post patching. You've have to schedule … Continue reading Hadoop Cluster – Pre Maintenance procedure

Configure the Fair Scheduler to resolve application delays

Fair scheduling is a method of assigning resources to applications such that all apps get, on average, an equal share of resources over time. Using fair scheduler we can separate pools(queues) for each team and configure the resources for the pool which will help in overcoming application delays. In the exam you may be asked … Continue reading Configure the Fair Scheduler to resolve application delays

Determine reason for application failure

There are many possible causes for a job/application failure varying from code error, environments, files availability, permissions, mapreduce/yarn configuration, resources allocation and even due to server i/o, network issue etc., So the first thing you’ve to do when a job fails is, to look at the error message and correlate with your job. If an … Continue reading Determine reason for application failure