Job Description :
Role: BigData Developer

Location: McLean, VA

Full Time

Job Description:


Proficient experience working on Horton works

Good experience working on Hadoop platform components like: Spark, Pyspark, Kafka, Hive , Nifi, Sqoop , oozie

Proficiency with Hadoop, Map Reduce using Python, HDFS

Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala

Experience with Spark

Experience in scripting languages like Batch, Shell

Experience with integration of data from multiple data sources like DB2, Sybase, Oracle, SQL server

Experience with NoSQL databases, such as HBase, Cassandra, MongoDB

Knowledge of various ETL techniques and frameworks, such as Flume

Experience with various messaging systems, such as Kafka

Experience in Python is mandatory.

Secondary Skills

Data Robot , Blockchain, hyper Ledger , Ethereum, PDF xstream , PDF Box, Microstrategy, Tableau, HBase

Responsible for delivery in the areas of: big data engineering/ data science/machine learning, including technology implementations and algorithm development

Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes.

Construct data staging layers and fast real-time systems to feed BI applications and machine learning algorithms

Review and independently test the effectiveness and accuracy of Image Analytics, NLP and machine learning models

Utilize expertise in models that leverage the newest data sources, technologies, and tools, such as machine learning, Python, Hadoop, Spark, Azure/AWS, as well as other cutting-edge tools and applications for Big Data.

Investigate the impact of new technologies, applications, and data sources on the future secondary mortgage business

Demonstrated ability to quickly learn new tools and paradigms to deploy cutting edge solutions.

Develop both deployment architecture and scripts for automated system deployment in Azure/AWS

Create large scale deployments using newly researched methodologies.

Work in Agile environment

Experience mentoring junior engineers.

Experience in Python is mandatory.