Lead AWS Data Bricks Spark/Scala Engineer

Job Title : Lead AWS Data Bricks Spark/Scala Engineer

Job ID:

Job Location: Remote

Job Travel Location(s):

# Positions: 1

Employment Type: W2

Candidate Constraints:

Duration:Long Term

# of Layers:0

Work Eligibility:US Permanent Eligibility to Work Required

Key Technology: DataBricks, AWS, Spark

Job Responsibilities

• Data Bricks Architect profile with AWS combination.
• Data Management, Solutioning, Data Engineering and ETL proficiency using Data Bricks tool / framework which includes programming with Spark/Scala
• Data Management, Migration experience from other platforms to AWS
• Drive mentality of building well architected applications for AWS Cloud
• Drive the mentality of quality being owned by the entire team
• Identify code defects and work with developers to address quality issues in product code.
• Finding bottlenecks and thresholds in existing code through the use of automation tools.
• Articulate clear business objectives aligned to technical specifications and work in an iterative agile pattern daily.
• Ownership over your work task, and are comfortable interacting with all levels of the team and raise challenges when necessary

Skills and Experience Required

Required:

• 10+ years of experience in architecture, design, implementation, and analytics solutions
• Hands on development Design and Develop applications using Databricks
• Experience with Solutioning on AWS
• Data Migration experience from other platforms to AWS
• In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.

Desired:

• Any programming language experience with SQL, Store procedures, Spark/Scala.
• Strong understanding of Data Modeling and defining conceptual logical and physical data models.
• Ability to design and demonstrate system Architecture with different environments
• Ability to deal with both On-Premises and Cloud systems