Job Description :
*Title:* Data Engineer
New Req: data engineer (2)
Need candidates who are local to Austin or in and around Austin/Texas.
Location: Austin, tx
Must be W2 US citizen
Interview and start right away
Six months
candidates need to have experience with discovering relationships in
poorly structured/defined data. Solid experience with SSIS, Master data
services (MDS), Data quality service (DQS) & SQL functions*
Looking for two people- maybe one Sr. one Jr. but open to both being Sr.
level.
Worksite Address: Austin, TX 78759
Looking for *two* Data Resource Engineers with at least 4-5+ years in Data
Discovery/Data Wrangling. Candidates can either be in SQL Server or Oracle
(the Government Database is Oracle, dumped into a SQL database Candidates
would need to have Data Warehouse experience as well. There is no specific
BI tools needed for this role. Candidate will be taking & dumping data,
putting on CIPS so the other team can work with it. Candidates will doing
data discovery and putting it into data warehouse. Candidates need to have
experience taking data and modeling / moving data into a data warehouse
that has rue dimension and fact tables. There is a deliverable in March
that is due as well.
Description:
We are looking for a versatile Data Engineer enthusiastic about working
with the latest technologies to streamline, automate and optimize large
scale data solutions. You are a designer, builder, and manager of
information. You have a deep understanding of both software development and
database technologies allowing you to select and integrate tools,
frameworks and database systems into corporate products and other
initiatives. You keep abreast of new tools and techniques to get the job
done. You are self-motivated and can effectively work both independently or
as part of a team.
Essential Duties and Responsibilities
As a Data Engineer you will:
- Select, develop, and integrate tools, frameworks, and database
technologies supporting highly scalable data processing focusing on
reliability, performance, and data quality
- Install, configure, maintain databases
- Backup/Restore
- Maintenance patches
- Security Administration
- Optimization/Performance tuning
- Define and implement data retention policies and disaster recovery
systems
- Model data for various data stores
- Understanding of normalization, warehouse, distributed databases,
column store
- Understanding of Relational, non-Relational NoSQL, Data Stream and
Time Series data
- Design, develop and implement ETL/ELT processes
- Working with different file formats both on import & export
- understanding of Bulk import/export, BCP, data link and
virtualization techniques
- Knowledge and Ability to use scripting and/or tools (SSIS,
Informatica, Kettle, ODI etc)
- Data Analysis
- Analyze data quality and integrity
- Using SQL, PL/SQL, TSQL and other scripting techniques, find matching
pattern and data points across distributed system
- Identify entities and attributes for facts/dimensions in
datastore/data warehouse
Required Skills/Experience
- Bachelor''s degree in a related field with 7-10 years'' relevant work
experience( at least 4-5 years of exp. Of Data Resource Discovery)
- Good at Data Discovery & Data Wrangling
- Experience taking data and modeling/moving data into a data warehouse
that has true dimension and fact tables.
- Data Warehouse experience
- Advanced SQL skills and database experience in Oracle, SQL Server, or
Postgres
- Advanced experience with scripting languages like Python, JavaScript,
PHP, or Perl
- Understanding of Data Storage techniques, Data Lake, XML, JSON,
Parquet, Column Store, row store, horizontal/vertical partitioned,
distributed etc
- Ability to multi-task in a fast-paced environment with accelerating
priorities
- Ability to diagnose performance issues and address them
Preferred Skills/Experience (Any of these is a plus)
- Hands on experience with NoSQL database technologies like Mongo,
DynamicDB, Hbase
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Experience working with cloud ecosystem such as GCP, AWS, Azure
*