Lead Data Engineer - Remote must be in USA Job at Rootshell Inc, United States

  • Rootshell Inc
  • United States

Job Description

Lead Data Engineer Remote Must Be In USA

Skill Set: Pyspark, Python, AWS, GIS, Palantir Foundry

Need a SME in Python coding (Data structures and algorithms)

Responsibilities

  • Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
  • Collaborate with product and technology teams to design and validate the capabilities of the data platform
  • Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
  • Provide technical support and usage guidance to the users of our platform’s services.
  • Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
  • Qualifications

    • Experience building and optimizing data pipelines in a distributed environment
    • Experience supporting and working with cross-functional teams
    • Proficiency working in Linux environment
    • 5+ years of advanced working knowledge of SQL, Python, and PySpark
    • Knowledge on Palantir
    • Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline

Job Tags

Similar Jobs

Hueman People Solutions

Nurse Recruiter Job at Hueman People Solutions

Role: Nurse RecruiterLife at HuemanWe're a team of people-people: relationship builders, problem solvers, encouragers, teammates, and helpers...  ...for partnership contacts as requiredMay require occasional travel to client sites, conferences, or recruiting eventsWhat We... 

Sodexo Group

Dishwasher Job at Sodexo Group

 ...holidays. More details will be provided during the interview process.Employment Type: Full-timePay Range: $17.50 - $18Working with Sodexo is more than a job; it's a chance to be part of something greater because we believe our everyday actions have a big impact. You... 

Moat Mountain Smokehouse & Brewing Co.

Executive Sous Chef Job at Moat Mountain Smokehouse & Brewing Co.

 ...Executive Sous Chef Moat Mountain Brewing Co--- Executive Chef Moat Mountain Brewing Co. Location: North Conway, NH Live, Work & Play in the Mount Washington Valley Moat Mountain Brewing Co., a long-standing staple in North Conway, NH, is... 

Maid Right of North Charlotte

House Cleaner Job at Maid Right of North Charlotte

 ...Job Description Job Description Benefits: Free uniforms Paid time off Competitive salary Maid Right is currently...  ...Benefits: Compensation: Hourly pay, including tips, paid weekly with direct deposit. Additional Compensation: Generous bonus... 

First Leap

Online English Teacher Job at First Leap

 ...webinars, training etc. provided by the company Observe and understand students' behavior and psyche Collaborate with other teachers, parents,and stakeholders Requirements Completed bachelor's degree Language: Native Speaker in English Obtained a teaching...