Job Description :
Third Eye is looking for an experienced Data Engineer who has a passion to build search related data products and develop data pipelines accordingly.
The candidate would be working with Third Eye''s direct client at a very visible and highly regarded role.
This is a full time position based in Washington DC.


Build and maintain code to populate HDFS, Hadoop with data loaded from various sources including SQL production systems.
Design, build and support pipelines of data transformations, conversions, validations into cloud based platforms.
Design and support effective storage and retrieval of Big Data.
Assess the impact of external production system changes to Big Data systems and implement changes to the ETL to ensure consistent and accurate data flows.
Design and implement best practices for cloud based cluster deployments of Hadoop, Spark, and other BigData eco-system tools.
Work with business stake holders, evangelize possible solutions and ensure all parties are on the same page.
Liaison between various technical and management groups.


Minimum of 10 years experience in Information Technology
Experience with Hadoop stack (Hive, Pig and MapReduce) and Apache Spark
Working experience with ElasticSearch, Solr or other such search related technologies.
Experience with Impala or HBase or any comparable NoSQL databases.
Strong grasp of algorithms and data structures.
Database experience with IBM DB2.
Proficient in two of the languages: Java, Python/Jython, Scala, Clojure, Ruby, C++.
Experience with the IBM BlueMix Cloud platform, including IBM Data Stage & IBM DataWorks.
Good familiarity with in Linux/Unix, scripting and administration.
Development of products using multithreaded, distributed computing & big data products will be a huge plus.
Experience in high concurrency platforms, graph databases, applied mathematics - a plus.
B.S. or MS degree in Computer Science or related fields.
Highly focused and disciplined work ethics.
Quick learner & team player.
Strong communication skills.

Third Eye offers lucrative compensation including stock options and unlimited holidays.