Job Description :
Role : Data Engineer Location : Englewood Colorado Contract Onsite Position Client is not accepting opt/cpt/h1b for this role. Please note: On selection, candidate should be willing to work from customer location in a month time. Skills - Experience and Requirements A successful Data Engineer will have the following: Must be from Data warehouse/Big data background. Experience working with external job schedulers such as autosys, aws data pipeline, airflow etc. Experience working in Key/Value data store such as Hbase Experience in AWS services such as EMR, Glue (server less architecture), S3, Athena, IAM, Lambda and Cloud watch is required. Experience in advanced Apache Spark processing framework, spark programming languages such as Scala/Python/Advanced Java with sound knowledge in shell scripting. Experience in working with Core Spark, Spark Streaming, Dataframe API, Data set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data. Specifically, this experience must be in writing "Big Data" data engineering jobs for large scale data integration in AWS. Advanced SQL experience using Hive/Impala framework including SQL performance tuning Experience in writing spark streaming jobs integrating with streaming frameworks such as Apache Kafka or AWS Kinesis. Create and maintain automated ETL processes with special focus on data flow, error recovery, and exception handling and reporting Gather and understand data requirements, work in the team to achieve high quality data ingestion and build systems that can process the data, transform the data Knowledge of using, setting up and tuning resource management framework such as standalone spark, Yarn or Mesos. Experience in physical table design in Big Data environment Thanks & Regards Kumar Sri Bharath