Job Description :

Job Title: Big Data Engineer

Location: Remote

Duration: 12+ Months Contract

Job Description : 

    10+ years of total experience preferably in BigData space
    Creating spark applications using Scala to process data.
    Experience in scheduling and troubleshooting/debugging Spark jobs in steps.
    Experience in spark job performance tuning and optimizations
    Should have experience in processing data using Kafka.
    Individual should have experience and understanding in configuring Kafka topics to optimize the performance.
    Should be proficient in writing SQL queries to process data in Data Warehouse.
    Experience in Vertica (Nice to have)
    hands on experience in working with Linux commands to troubleshoot/debug issues and creating shell scripts to automate tasks.
    Experience on AWS services like EMR



Similar Jobs you may be interested in ..