Lead Data Engineer - Pyspark, AWS/ Azure - 6+ Years

Location: India
Discipline: Data Engineering, Analytics
Job type: Permanent
Contact name: Isha Joshi

Contact email: isha.joshi@crescendogroup.in
Job ref: 37751
Published: 1 day ago

Lead Data Engineer– PySpark, AWS (5+ Years)

 

An excellent opportunity for an individual holding an overall 5+ years of experience in the designing, development, testing, maintenance, and support data assets including; BigQuery, Dataflow, Dataproc, Cloud Data Fusion, Dataprep, SQL script creation, stored procedure development, integration services. The profile is ideal for a person holding an extensive experience in Python, PySpakrk, SQL and AWS.

Location –Pune/ Noida/ Gurgaon

 

Your Future Employer: One of the largest Global analytics and digital solutions company serving industries including insurance, healthcare, banking, and financial services, media, retail, and others

Responsibilities:

  • Writing code in programming language & working experience in Python, PySpakrk, Scala or Similar

  • Designing, building, operationalizing, securing, and monitoring data processing systems on Google Cloud Platform

  • Acting as a SME in data engineering and GCP data technologies

  • Writing requirement, functional & technical documentation & working experience in Integration design document, architecture documentation, data testing plans or Similar

  • Reading Data Formats & working experience in JSON, XML or Similar

  •  

 

Requirements:

  • Hands on experience with GCP Data Products (e.g. BigQuery, Dataflow, Dataproc, Cloud Data Fusion, Dataprep, etc.)

  • SQL queries & working experience in SQL code or Stored Procedures or Functions or Views or Similar

  • Database & working experience in any of the database like MS SQL, Oracle or Similar

  • Analytical Problem Solving skills & working experience in resolving complex problems or Similar

  • Architecture and data modelling for Data Lake on cloud & working experience in Amazon WebServices (AWS), Microsoft Azure, Google Cloud Platform (GCP)

  • Basic understanding of Build and Release management & working experience in Azure DevOps, AWS CodeCommitt or Similar

 

What is in it for you?

  • Grow in culture focused on training and mentoring

  • Work in a fast-paced environment in an established brand

 

Reach Us:

If you think you are perfect fit for this role, kindly drop me an email along with your updated CV at isha.joshi@crescendogroup.in.

Crescendo Global is an ISO 9001:2015 certified Leadership Hiring consulting arm of Crescendo Group with expertise in mid to senior level niche recruitment. We are passionate about empowering job seekers and employers with an engaging memorable job search and leadership hiring experience. Crescendo Global does not discriminate on the basis of race, religion, color, origin, gender, sexual orientation, age, marital status, veteran status or disability status.