Job Description :
HI
Hope you are doing fine!
Please note we have the following role(s) available for 12 Months+ contract position with direct client in Sunnyvale, CA USA.
Please send your consultants resumes with: full-name, contact details (phone # and e-mail address), availability, current location (city and state) and hourly rate on C2C.
Job Title: Senior Data Engineer.
Location: Sunnyvale, CA USA.
Type of hire: Contract.
Duration: 12+ months.
Description:
Position Summary
Very Strong engineering skills. Should have an analytical approach and have good programming skills.
Provide business insights, while leveraging internal tools and systems, databases and industry data
Minimum of 05+ years’ experience. Experience in retail business will be a plus.
Excellent written and verbal communication skills for varied audiences on engineering subject matter
Ability to document requirements, data lineage, subject matter in both business and technical terminology.
Guide and learn from other team members.
Demonstrated ability to transform business requirements to code, specific analytical reports and tools
This role will involve coding, analytical modeling, root cause analysis, investigation, debugging, testing and collaboration with the business partners, product managers other engineering team.
Must Have
Strong analytical background
Self-starter
Must be able to reach out to others and thrive in a fast-paced environment.
Strong background in transforming big data into business insights
Technical Requirements
Knowledge/experience on Teradata Physical Design and Implementation, Teradata SQL Performance Optimization
Experience with Teradata Tools and Utilities (FastLoad, MultiLoad, BTEQ, FastExport)
Advanced SQL (preferably Teradata)
Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spark, etc.
Strong Hadoop scripting skills to process petabytes of data
Experience in Unix/Linux shell scripting or similar programming/scripting knowledge
Experience in ETL/ processes
Real time data ingestion (Kafka)
Nice to Have
Development experience with Java, Scala, Flume, Python
Cassandra
Automic scheduler
R/R studio, SAS experience a plus
Presto
Hbase
Tableau or similar reporting/dash boarding tool
Modeling and Data Science background
Retail industry background
Education
BS degree in specific technical fields like computer science, math, statistics preferred
Must Haves
Excellent knowledge and experience with Hive and SQL
Experience with Spark SQL
Proficient with one programming language Java/Scala/Python
General understanding of how to build end to end data pipelines
Good to Have
Experience n architecting data pipelines – from Data model to the jobs and the sequence of jobs
Ability to build dashboards with Tableau or ThoughtSpot
Software Engineering knowledge – ability to build web applications using Java and AngularJS or ReactJS tech stacks