Job Description :
Position: QA Tester with Hadoop and Python.
Location: Louisville, Kentucky
Duration: 6 Months +

Big data tester with Phython scripting experience
Should be good hands-on in Hive, Sqoop , Pig, Shell Scripting, Scala, Spark(Core, Spark SQL,Pyspark) .
Designed and developed Sqoop scripts to import the data from various.
We used shell-scripting, Scala, Python, Spark, Pyspark, MySql.
Proposed Design solutions to process the Ingested data in Hadoop Data Lake in varying file formats like Text, JSON and Sequence Files
Interacting with customer to get the requirements and prepare the requirement analysis documents and design and development.Understand business requirement and Build framework that load data from the source to Data lake. Integrate transition and processing with the ingestion framework. To build end to end solution from getting data to make it available for the reporting and dashboard. Worked for Data Ingestion program involved in Requirements gathering, Analysis, Design, Development, Testing and Deployment phases of the project life cycle.