Job Description :
Data Engineer

Location: McLean, VA
Duration: 7 months with possible extension

Description:
- Collaborating as part of a cross-functional Agile team to create and enhance software that enables state of the art, next generation Big Data & Fast Data applications
- Building efficient storage for structured and unstructured data
- Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Nifi, Storm and Kafka on AWS Cloud
- Utilizing programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift
- Utilizing Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, Pig, and Cassandra
- Leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Maven, Nexus, Chef, Terraform, Ruby, Git and Docker
- Performing unit tests and conducting reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Additional Information:
Data engineering and Data Science experience is preferable
Senior level Data position- expects candidate will have knowledge of most of the below
Must have: Spark, Python, Kafka, AWS

Reason For Request: Req already approved from Sr leadership.

Following are the areas that were primarily evaluated for the candidates:
- Java/J2EE
- CICD
- Hadoop
- Spark
- AWS
- Data Science concepts
- NoSQL Databases

The following are some of the observations in the profiles:
- Lacked clarity on fundamental concepts in Spark.
- Not strong on the programming language that the candidate is familiar with.
- Lacks experience in large production implementations especially with Big data tools.
- Not able to design systems involving streaming data, microservices, Kafka
             

Similar Jobs you may be interested in ..