Job Description:
Role : Data Engineer
Location : Scottsdale AZ (100% Onsite)
Must have :
10-12 years of experience
Strong Experience in Scala, Spark, hive SQL, Hadoop and Kafka
Proficiency in Hive and SQL optimization.
Understanding of distributed systems and big data architecture.
Knowledge of streaming frameworks (Spark Streaming, Kafka Streams).
Good to have Aerospike experience
Skills required:
1. Experience : 6-9 Years
2. Must have Primary skills required Cloudera (Hadoop), Spark + Scala or Spark + Java and SQL
3. The resources should also have good understanding of Hive, Aerospike.
4. The resources should have strong analytical skills.
5. Should have worked on large scale ETL and DW projects and pipelines.
6. Real time data streaming experience and batch orchestration, data quality and reconciliation, understanding of concepts like Data Governance is a must.
7. Strong communication skills and ability to independently work and troubleshoot problems and come up with solutions.
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.