Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

TVFuU0JxUUVTR0JySGpKdDhtejZQRHVXM0E9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Levi Hunter

Recruitment/Staffing Coordinator Job at Levi Hunter

 ...Coordinator Location: Overland Park, KS (Onsite) Potential temp to perm with the right candidate Pay: $25 - $28/hr US Citizenship...  ...internal and external relationships with candidates and hiring managers May be responsible for generating routine and ad hoc... 

kay search group

Litigation Administrative Assistant/Paralegal Job at kay search group

 ...Position: Litigation Administrative Assistant/Paralegal Location: Mineola, New York Summary: The Long Island Office of a Multinational Law Firm currently has an opening for a Litigation Administrative Assistant/Paralegal to Partners and Associates Comp Package... 

Doctors Hospital of Laredo

TECH - MONITOR Job at Doctors Hospital of Laredo

 ...Responsibilities Doctors Hospital of Laredo, in Laredo, TX, is a 183-bed acute care facility that offers a range of medical services. You'll feel a difference when you walk in our doors. There's pride in the care we deliver and a commitment to serving Laredo's growing... 

Flourish Culture

ESL teacher in coastal cities Job at Flourish Culture

High salary&Free exquiste apartment! Limited ESL jobs in coastal cities!Job details:3-8 yrs old students 25hrs weekly teaching...  ...housing allowance Paid vacationsFree airticket Airfare bonusFree visa help15days paid professional training20 days free hotel

Amazon Data Services, Inc.

Logistics Specialist, Data Center Operations Job at Amazon Data Services, Inc.

 ...DESCRIPTION Amazon is seeking a logistics professional for our Amazon Web Services Team in the Aurora, CO area. Logistics Specialists will perform operations across three key areas: Warehousing, Transportation, and Data Centers. This role involves monitoring inventory...