Job Description :

Role : Lead Data Engineer

Location : US~Texas~Plano (-Remote)

Exp. : 10+years

Who are we looking for?

A Lead Data Engineer to Collaborate with client business and technology leadership to provide data strategy and architecture thought leadership (big picture thinking), trusted consultant to develop need and respective data solutions across the enterprise

Skills:

Create and maintain optimal data pipeline architecture,

Assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure data technologies.

Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

Work with data and analytics experts to strive for greater functionality in our data systems.

Extract data from identified databases. Perform initial data quality check on extracted data. Build data pipelines that automate the data flow and transformation of data in the ecosystem.

Strong understanding of data architecture, modeling and infrastructure

Experience with distributed data technologies (e.g. Spark) and NoSQL databases (e.g. Cassandra, Cosmos DB, etc.)

Create reports and dashboards that make complex data easily consumable by the users.

Debugging and optimizing performance of queries, data pipelines, reports and dashboards.

Knowledge of Azure based data processing technologies like EventHub, ADF, Synapse, ADLS, Azure Databricks or their equivalent.

Experience with build systems such as Jenkins or Azure DevOps and source control systems.

Experience with Python, PySpark/Scala, SQL, PowerBI.

Behavioral Skills :

Align and interface with CxOs across business & IT to ensure data solutions are relevant to clients' enterprise architecture

Provide data architect expertise to solution, delivery, and portfolio enablement team during development of PoCs and prototypes

Consultative approach to building client relationship and trust

Strong self-starter with the leadership abilities to effectively build, develop and manage relationships with internal and client stakeholders.

Experience of working with waterfall, agile and hybrid development teams

Ability to handle a fast-paced environment and challenging workload

Qualification:

Any Degree from a reputed college - B.Tech, BE, BCA, MCA, M. Tech or equivalent technical degree is preferred.

10+ years overall IT experience.

,

Aditya Sharma

1603, Capitol Ave, Suite 310 A461, Cheyenne Wyoming 82001

Direct:

Email

             

Similar Jobs you may be interested in ..