Senior Data Engineer : SiriusXM Radio Inc

Company: Shiftcode Analytics, Inc
Location: Remote
Posted on: November 24, 2022

Job Description:

Interview : Phone and skype

Visa: USC, GC, GC EAD, H4, L2

Candidate must have 9+ years of experience and 4+ as a Sr. Engineer

Description :

The main skills that are a must are
AWS
Streaming Kafka Exp
Python
Has to have worked with a minimum of a terabyte of data.


Responsibilities
What you'll do:
You will be working with your team, peers, partners, cross-functional teams and vendors to:
Migrate and re-engineer data products from on-prem to cloud.
Gather and process all types of data including raw, structured, semi-structured, and unstructured data.
Coding in Java, Scala or Python
Build and deploy data pipelines and database processes, including SQL and NoSQL databases for enterprise data management applications .
Analyze requirements and technical specifications, and implement assigned development tasks using various technologies.
Mentor and lead junior data engineers by providing technical guidance and oversight.
Provide ongoing support, monitoring, and maintenance of deployed products.
Respond to data and product related inquiries in real-time to support business and technical teams.
Drive and maintain a culture of quality, innovation and experimentation.
Functional areas: master data management , 2nd & 3rd Party Data Management, Data Quality, Data Controls.

Edit Responsibilities
Qualifications
What you'll need:

• 
  
• BS/MS or above in computer science or data science programs.
  
• 7+ years professional experience with Development, R&D or Information Technology preferably
  
  • 
    
  • Highly proficient in one of the programming language Scala or Python or Java.
    
  • Highly proficient in writing shell scripts.
    
  • Experience with data warehouse technologies: MapReduce, HDFS, Hive, Tez, Spark, Sqoop
    
  • Experience with streaming technologies - Kafka, Kafka Connect, KStreams, KSQL, Beam, Flink, Spark
    
  • Experience developing for Linux-based deployment platforms, developing scalable, multithreaded server-side software for deployment
    
  • Experience with cloud computing - Google Cloud Platform, Amazon Web Services
    
  • Experience with API design/development - RPC, REST, JSON
    
  • Experience with CI/CD, build and deployment technologies such as Jenkins
    
  • Experience with Data Visualization or Data Notebook tools (i.e Zeppelin, Tableau, etc.)
    
  • Experience developing SQL applications of significant complexity
    
    
    
    
    
    • 
      
    • Experience MDM and Data Catalog will be added advantage.
      
    • Familiarity with BI reporting tools (Qlikview, Tableau)
      
    • Experience in machine learning process will be a plus.
      
    • Core understanding and proficiency in
      
      • 
        
      • Multiple programming languages such as Scala and/or Python
        
      • Cloud platform offerings and capabilities - especially AWS : S3, Aurora, Redshift, Lambda, Glue
        
      • SQL based data storage systems such as Postgrsql, Teradata
        
        
        
        
        
        • 
          
        • Some experience with:
          
          
          • 
            
          • Big Data OLAP datastore such as Singlestore
            
          • Jupyter notebook
            
          • Any ETL tool - Talend will be a plus
            
            
            
            
            
            • 
              
            • Any experience with the following is bonus:
              
              
              • 
                
              • NoSQL based storage systems such as Neo4j
                
              • Containerization technologies such as Docker, Kubernates
                
              • Machine Learning algorithms
                
              • Data Catalogs for technical metadata
                
                
                
                
                
                • 
                  
                • Appreciation of agile software processes, data-driven development, reliability, and responsible experimentation.
                  
                • Familiar with metadata management, data catalog, data lineage, and principles of data governance.
                  
                • Passion about data and be able to excite and lead by example and mentoring others.
                  
                • Hungry and eager to learn new systems and technologies.
                  
                • Self-directed and enjoys the challenge and freedom of deciding what is the most impactful thing to work on next.
                  
                • Ability to deliver exceptional results through iterative improvement rather than initial perfection.
                  
                • Excellent communication and presentation skills and ability to interact appropriately with all levels of the organization, including business users, technical staff, senior level colleagues, vendors, and partners.
                  
                • An extensive track record that demonstrates effectiveness in driving business results through data and analytics.
                  
                • The ability to develop and articulate a compelling vision and generate necessary consensus.
                  
                • A successful history of translating business objectives and problems into analytic problems, and analytic solutions into actionable business solutions.
                  
                  

Keywords: Shiftcode Analytics, Inc, Eugene , Senior Data Engineer : SiriusXM Radio Inc, Engineering , Remote, Oregon