AWS Sr Data Engineer.

Company: Diverse Lynx
Location: Remote
Posted on: March 18, 2023

Job Description:

Must-Have

• Designing and implementing highly performant data ingestion pipelines from distributed systems using Apache Spark and Databricks
  
• Highly proficient with Python, Spark and PL/SQL
  
• Experience in building ETL / data warehouse transformation processes
  
• Strong experience with Big Data, Data analysis with excellent analytical and problem-solving abilities
  
• Experience in Big Data components such as Spark SQL, Data frames, HIVE etc implemented using Data Bricks would be preferred.
  
• Hands on experience on Cloud based environments - AWS preferred
  
• Hands on experience on AWS S3, EMR, EC2, Lambda, Redshift, Redshift Spectrum, Athena
  
• Excellent understanding of the full SDLC - agile and DevOps methodologies
  
• Should be flexible to quickly learn new technology and do POCs.
  
• Should be self-motivated and good team player
  
• Effective communication and interpersonal skills along with the ability to provide support to technical teams and business users.
  
  
  
  
  Good-to-Have
  
  

• 
  
• Any AWS Cloud or Bigdata certification has advantage.
  
• Exposure to data architecture principles and practices
  
• Experience with Databricks Delta live tables and Autoloader
  
• Experience with building data pipeline on Databricks
  
  
  
  
  
  
  
  
  
  
  
  Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
  
  
  

Keywords: Diverse Lynx, Eugene , AWS Sr Data Engineer., Engineering , Remote, Oregon