Position: Big Data Developer with Python
Location: San Ramon, CA
Job Description:
Big Data, Python
Big Data skills - AWS, Spark, Python, Hbase, Kafka, HDFS etc.
• Experience building data pipelines for enterprise-grade data and analytics platforms that are highly scalable, compliant and secure with robust data quality, data governance, data discovery, catalog and visualization capabilities.
• Experience in all facets of software development life cycle like analysis, design, development, data conversion, data security, system integration and implementation.
• Relational SQL and NoSQL databases, including Postgres and Cassandra
• Data Engineer with experience in handling data pipelines.
• Knowledge in both structured and unstructured data.
• Understand the business requirements working with the team and the business stakeholders as identified
• Knowledge on best practices to construct data pipelines native to cloud and from On prem to cloud.
• Recommend ingestion frameworks for future data streams high level