Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TkZNLytCc2d3eWNPTGVpNXRKUU5xMFduTVE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

300 2ND AVE

Advanced Practice Nurse Job at 300 2ND AVE

 ...Job Title: Advanced Practice Nurse Location: Rutgers University Medical Grp Department Name: RWJMS Neonatology Req #: 0000207461 Status: Salaried Shift: Day Pay Range: $108,000.00 - $171,000.00 per year Pay Transparency: The above reflects the anticipated... 

MMA Chiropractors

Associate Chiropractor needed in Will County, IL Job at MMA Chiropractors

Searching for a DC who is down to earth with leadership qualities that wants to grow with the practice and serve the community. Ideal candidate is someone who is passionate and looking to deliver high-quality care to patients. You'll be offered a positive work environment...

Onsite Women's Health

Lead Mammography Technologist (1125 - KMC Breast Center) Job at Onsite Women's Health

 ...quickly. She must also be able to manage conflicting priorities efficiently under pressure. Key Responsibilities: Mammography Services: Perform screening and diagnostic imaging, ensuring high-quality imaging and patient care. Practice radiation safety... 

PIH Health

Epic Cadence & Prelude Application Analyst I, II, III-(Open to experienced remote in ID, NE, MO, OK, TX) Job at PIH Health

 ...Determination for the Epic Application Analyst (I, II or III), Cadence & Prelude roles will be based on experience and qualifications. Not currently working with 3rd party recruitment agencies. For immediate consideration email resume to ****@*****.***... 

Brookhaven National Lab

Experimental Safety Coordinator Job at Brookhaven National Lab

 ...advantage of its high brightness and resolution in pursuit of their scientific goals.The candidate will serve as the Experimental Safety Coordinator to advocate and provide technical resources on matters of health and safety. Primary responsibilities include providing...