Job Description :
Role: Big Data Engineer
Duration : REMOTE (client in Danville, PA)
Location : Danville PA

Data Engineer, Hive, HiveQL (HQL, Hive QL), SQL, MySQL, T-SQL
Ability to build out complex queries from various data sources for data pipelines.
Must have experience with LARGE data sets, enterprise data, high transaction.

Job Description

Interview Process: 2 Skype I/V''s that will require heavy SQL, MySQL and HQL (HiveQL) coding exercises
Start Date: 1 week from offer

The Day-to-Day
Create solutions to transform data from various sources and load it into platforms such as SQL Server, Oracle and Hadoop.
Develop and maintain standards for administration and operation including the scheduling, running, monitoring, logging, management of errors, recovery from failures, and validation of outputs
Contribute to the project planning process by estimating tasks and deliverables
Work closely with Analytics team members to understand user requirements
Be at the cutting edge of utilizing data conversions and transformations.
The Essentials
Expert level knowledge of SQL and its variants such as HiveQL, T-SQL and/or MySQL Scripting.
Understanding of ETL processes
Experience with techniques of performance tuning/optimization for both data loading and data retrieval.
Expertise in database platforms such as RDBMS (Oracle and SQL Server) as well as Big Data (Hadoop
Experience automating scripts using Shell or PowerShell scripting.
BS/MS in Computer Science, MIS, business, or equivalent education/training/experience


If you are qualified, available, interested, planning to make a change, or know of a friend who might have the required qualifications and interest, please call me ASAP at Ext 2540., even if we have spoken recently about a different position. If you do respond via e-mail, please include a daytime phone number so I can reach you. In considering candidates, time is of the essence, so please respond ASAP. Thank you.