Job Description :

Job Description


Role : Cloud Data Engineer

Location : San Antonio, TX  / {Remote until COVID policies are in place}

Duration 12 Plus Months Contract  

Key skills: Datawarehouse, SQL, Unix, Python/Java, Devops (exp. with CI/CD with Helm, Terraform or Talon Batch), Cloud

Plus Skills : Snowflake , AWS

Visa Status : All Visa Accepted


We are seeking a 2-5 Years Exp. Candidate  with Cloud Engineer skilled in AWS DevOps to expand our team. Lightspeed uses its novel technology to produce massive terabyte-sized imaging datasets that produce novel biological insights. The most pressing and immediate task for this role will be to transform our existing solutions for image alignment, stitching, fusion, and analysis to a parallelized, cloud-based pipeline, which can handle large datasets. Additional responsibilities include optimizing our algorithms for parallelization and implementing cloud data monitoring and security processes.


  • Transform existing data processing and analysis pipelines to parallelized cloud-based pipelines
  • Implement best practices for AWS data monitoring and security
  • Optimize big-data algorithms for parallelization
  • Develop, deploy, and maintain a large-scale database of 3D imaging datasets amenable to massively parallel (e.g. “in the cloud”) computational methods
  • Demonstrate good software engineering practices, and apply these across the research pipeline, from prototypes of new methods to mature and validated methods
  • Maintain AWS data storage and prepare monthly cost reports
  • Maintain awareness of latest developments in relevant fields, evaluate and apply as warranted
  • Identify bottlenecks in data workflows
  • Generate IP and participate in the drafting of patent filings

Preferred Qualifications and Skills

  • Python (required)
  • AWS S3 / EC2 / Lambda / IAM (required)
  • Experience with big data, cloud computing, and parallel computing
  • Proficiency in machine learning and algorithmic analysis of data
  • Understanding of microscopy and 3D imaging is a plus
  • Experience with C# / Java is a plus
  • Applicants of any higher education level (undergraduate, masters, PhD) will be considered, with preference given to those with substantial, real-world experience in parallelization of high-throughput computational frameworks

** Excellent Communication is a MUST**


eDataForce consulting LLC is an Equal Opportunity Employer





Similar Jobs you may be interested in ..