Hadoop general interview questions

1. architecture component of Hadoop
2. os level optimisation
3. prerequisites before installing
4. how to bring data
5. what all we need to make sure in order to copy data from one cluster
6. scenarios and use of the scheduler
7. I want to implement department wise access level on hdfs and yarn
8. job flow in yarn
9. how resource allocation happens in yarn
10. what is the file read/write flow
11. how different nodes in a cluster communicate with each other
12. how the request flows through zookeepers
13. please tell something about read/write pipeline on Hadoop
14. how do you do deployments on many servers at once

What the functions of a scheduling algorithm?

• Reduce the total amount of computation necessary to complete a job
• Allow multiple users to share clusters in a predictable, policy-guided manner.
• Run jobs at periodic times of the day.
• Reduce job latencies in an environment with multiple jobs of different sizes.