Job Description :
Title: Bigdata QA engineer
Location: New Jersey
Duration: 6 months+
Start Date: ASAP
Rate: DOE
Education: BS in Computer Science/Engineering Stream or related areas
Required Experience/SKills:
- At least 5+ years software development/automation experience
- At least 2 Years experience on Big Data Platform
-Recent experience with Scala/Java/Python, Oracle, HBase, Hive
- Hands on experience on Big Data Quality Engineering Automation process
- Understanding of various Visualization platform
- Experience in Cloud providers like AWS
- Good Understanding of database, schema, data model, how to bring efficiency in big data related life cycle
- Develop / explore the multiple technical tools/utilities and scripts to generate the test data and test data virtualization capabilities
- Perform data analysis on larger data sets in order to explore and generate the test data
Other Skills:
- Ability to design, develop and implement automation test framework for big data agile projects
- Ability to test conceptual/Predictive/Probability models
Able to execute manual and automated, functional and regression test cases
- Experience in validating data loads and transformations ensuring data integrity and proper data manipulation and following of business rules
Expert on Java, Python, Scala, Unix, SQL Scripting knowledge to develop Automation suites
* Expert on Oracle/PL SQL, complex SQL queries, performance tuning concepts, AWS RDS, AWS Aurora
- Must understand Hadoop Ecosystem
- Working knowledge of Spark, Solr, Hive, HBase, Cassandra etc.
* Knowledge of test data generation tools and techniques including data masking
* Experience in testing streaming technologies Spark streaming, Confluent Kafka
* Familiar with Code/Build/Deployment git, svn, maven, sbt, jenkins, bamboo:

Client : Confidential