Apply Now

International Millennium Consultants Inc. (IMC)
Northbrook, IL
Post Resume to
View Contact Details &
Apply for Job
Job Description :
Role: Big Data Engineer
Client Location: Princeton, NJ- REMOTE
Duration : 1 Year Contract to Hire

The ideal candidate will come with hands-on experience as a Data Engineer with experience in Big Data technologies who will interact with Business users to get the requirements and translate the same into technical specs. This person will have a proven track record of delivering successful technology solutions to business clients in financial services.

Requirements
8-12 years of experience in a Data Engineer role with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
In-depth knowledge of Big Data technologies - Spark, HDFS, Hive, Kudu, Impala
Solid programming experience in Python, Java, Scala, or other statically typed programming language
Production experience in core Hadoop technologies including HDFS, Hive and YARN
Strong working knowledge of SQL and the ability to write, debug, and optimize distributed SQL queries
Having advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases including NOSQL.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Having experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Excellent attention to detail and communication/presentation skills
Experience in working in a highly collaborative environment with heavy emphasis on teamwork
Experience in working in Agile scrum methodology
Experience working through all phases of SDLC including Project Management, Business Analysis, Data Analysis, Architecture Design, Development, Testing and Implementation
Having strong project management and organizational skills.
Proficient in process modeling, business process flow and data flow diagrams
Extensive experience working in a data warehouse environment.
Excellent understanding of data warehouse concepts, data marts, Extraction Transformation and Loading (ETL),Autosys, feed processing, batch processing and data modeling - ER diagrams, RDBMS
Expert inSQL for data analysis, data integrity, data accuracy, data mining and data mapping across various database platforms like Oracle and SQL Server
Proficient in System IntegrationTesting (SIT), Functional Testing and User Acceptance Testing (UAT
Good to have understanding of various financial products like Repos, Stock Loan and Borrows (SLB), Fixed Income, Credit Derivatives, Swaps, Futures, Options, and Cash Securities