Job Description :
1. Very thorough understanding of Python programming language
a) Understand Python standard library
b) Able to implement basic data structures
c) Able to program with Python in different programming paradigms; e.g. Objective oriented, functional and a combination of two
2. Very good knowledge of Hadoop based big data tech stack
a) Need to be able to write complex Python UDFs for Spark
b) Need to understand how to write efficient queries
c) Be able to explore datasets efficiently and develop methods to work with huge datasets
3. Solid understanding of Linux OS
a) Be able to perform rudimentary sysadmin tasks- relaunch daemons, schedule cronjobs