Job Description :
We have an urgent Recruitment: 17-00160 - Big Data Spark Developer @ New Jersey, NJ 12+ Month Contract
Skill Matrix
Big Data
Spark
Hadoop
HDFS
Hbase
Phoenix
Hive
Pig
SQL
PL/SQL
ETL
NoSQL
J2EE
REST
Webservices
GIT
MAVEN
XML
JavaScript
React.Js
HTML5
Python
Job #: 17-00160
Job Title: Big Data Spark Developer
Job Location: New Jersey, NJ
Travel Required: No
Overtime Required: No
Position Type: Full Time/Contract
Remote: No
Job Description:
Big Data Engineer
- Custody & Fund Services Technology have a requirement for a versatile, experienced hands on Data Engineer to play a key part in the development of a new data analytics platform which has Python backend services.
- Exposure to Global Custody or the Fund Services business or like areas is a plus.
Duties and responsibilities
- Collaboration with our Quants and global technology teams to create data pipelines for a new data analytics platform and build interfaces for data to be extracted and analyzed.
- Development and management of bringing in various data sources into a global Data Lake.
- Collaborating with Quants to convert their models into strategic software whilst enabling the quants to adjust and adapt their models at will. Working with IT to align as closely as possible with the rest of the business, whilst still ensuring that the quants are able to innovate, research, and act with agility is essential.
- Data Warehousing, ETL development and testing experience in Big Data technologies is essential whilst experience working with relational databases such as Oracle 11g or higher will be beneficial.
- Define and manage best practice in configuration and management of the data lake.
Essential skills
- Strong technical skills across the Hadoop stack (HDFS, Hbase, Phoenix, Hive, Pig) and SQL
- Familiarity with web, ftp, api, sql and related ETL technologies
- Databases knowledge should extend to PL SQL,SQL and Transact-SQL. Oracle is a plus
- A knowledge of modern NoSQL data stores
- Hands on experience with J2EE(JDBC, JNDI, JMS), Tomcat a plus
- Experience with Spring Framework Development (Spring Core and Spring Batch in particular. Spring Integration a plus)
- Strong knowledge of REST web services
- Experience with Git and MAVEN
- Experience of handling data in various file types; flat files, XML, Parquet, data frames etc
- Experience in resolving maintenance issues, data issues and bug fixes.
- Performance tuning and optimization techniques
- Production support and application maintenance knowledge
- Experience working directly on the command line / shell scripting experience
Desirable
- Experience in Web UI/ visualization technologies such as JavaScript, React.js, HTML5 and Angular.js. Haskell for portraying large and complex data sets will be very useful
- Working knowledge of QlikView or other BI tools
- Worked with Atlassian tools such as Jira, Confluence, Fisheye, Crucible and Stash
- Python programming
Andy – 4 0 7 5 4 5 5 1 8 0 – andy AT keylent DOT com