Data Engineer-Databricks Job at Technokraft Consultancy Services LLC, Massachusetts

UFZBNS9oTXZ4U1lLTHV1OXNwVU1xa091TkE9PQ==
  • Technokraft Consultancy Services LLC
  • Massachusetts

Job Description

Role : Databricks Engineer

Location : Princeton, NJ and Boston MA - Hybrid

Contract : 12+ months- W2 Contract

Job Description :

Education and experience Qualification

Bachelor's degree in Computer Science, Information Systems, or equivalent education or work experience

Around 5+ years of experience as a developer on cloud technologies

Any AWS and/or Databricks certification will be a plus

Roles & Responsibilities

Recognize the current application infrastructure and suggest new concepts to improve performance

Document the best practices and strategies associated with application deployment and infrastructure support

Produce reusable, efficient, and scalable programs, and also cost-effective migration strategies

Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka and Lambda to build serverless applications

Work jointly with the IT team and other departments to migrate data engineering and ML applications to Databricks/AWS

Comfortable to work on tight timelines, when required.

Skill Sets Required

Good decision-making and problem solving skills

Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).

Knowledge on medallion architecture, DLT and unity catalog within Databricks.

Experience in migrating data from on-prem Hadoop to Databricks/AWS

Understanding of core AWS services, uses, and AWS architecture best practices

Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.

Solid knowledge on Airflow

Solid knowledge on CI/CD pipeline in AWS technologies

Application migration of RDBMS, java/python applications, model code, elastic etc.

Solid programming background on scala, python

Experience with Docker and Kubernetes is a plus

Job Tags

Contract work, Work experience placement,

Similar Jobs

Action Behavior Centers

BCBA Clinical Director Job at Action Behavior Centers

 ...Wylie, TX Rowlett, TX Jersey Village, TX Murphy, TX #LI-AG1#LI-Onsit Keywords: BCBA, Clinical Director, ABA therapy, Autism Spectrum Disorder, behavior analysis, community health, leadership, mental health, healthcare services, children's therapy... 

Paired

Short-Form Video Editor for DTC Company (US-Based, Remote) Job at Paired

 ...and recruiting agency that pairs remote work with top-tier talent. We help individuals...  ...aesthetic and messaging. Stay up-to-date with social media trends, platform updates, and best...  ...a plus. Benefits Competitive salary in USD Work From Home Flexible Hours... 

Johns Hopkins Medicine

OPERATING ROOM ASSISTANT I Job at Johns Hopkins Medicine

 ...contributing to cutting-edge medicine. Be part of a healthcare community that values your expertise. You Belong Here! Operating Room Assistant I Day Shift/ No Call or Weekends Knowledge of sterile environment, preferred, HS Diploma or equivalent Minimum of... 

Gartner, Inc.

Principal Client Executive, Mid-Size Enterprise, GTS/AHT Job at Gartner, Inc.

 ...primarily the CEO and CMO/CPO office. Drive account retention and growth by impacting their most critical priorities and demonstrate Gartners value. Drive new business with new logos, through networking, events, and your own prospecting. Collaborate across teams,... 

Spenga

Energenic Fitness Instructor Job at Spenga

 ...want to hear from you!**About Spenga:**Spenga is not just a gym; it's a revolutionary fitness experience that combines three essential...  ...environment.**How to Apply:**If you're ready to be a part of a fitness revolution and inspire positive change in the lives...