Lead Data Engineer – Pyspark, AWS – 6+ Years - Pune/Noida/Gurgaon

Location: Gurgaon
Discipline: Data Engineering, Analytics
Job type: Permanent
Contact name: Crescendo Global

Contact email: india@crescendogroup.in
Job ref: 37751
Published: 8 months ago

Lead Data Engineer– PySpark, AWS (5+ Years)


An excellent opportunity for an individual holding an overall 5+ years of experience in the designing, development, testing, maintenance, and support data assets including; BigQuery, Dataflow, Dataproc, Cloud Data Fusion, Dataprep, SQL script creation, stored procedure development, integration services. The profile is ideal for a person holding an extensive experience in Python, PySpakrk, SQL and AWS.

Location –Pune/ Noida/ Gurgaon


Your Future Employer: One of the largest Global analytics and digital solutions company serving industries including insurance, healthcare, banking, and financial services, media, retail, and others


  • Writing code in programming language & working experience in Python, PySpakrk, Scala or Similar

  • Designing, building, operationalizing, securing, and monitoring data processing systems on Google Cloud Platform

  • Acting as a SME in data engineering and GCP data technologies

  • Writing requirement, functional & technical documentation & working experience in Integration design document, architecture documentation, data testing plans or Similar

  • Reading Data Formats & working experience in JSON, XML or Similar




  • Hands on experience with GCP Data Products (e.g. BigQuery, Dataflow, Dataproc, Cloud Data Fusion, Dataprep, etc.)

  • SQL queries & working experience in SQL code or Stored Procedures or Functions or Views or Similar

  • Database & working experience in any of the database like MS SQL, Oracle or Similar

  • Analytical Problem Solving skills & working experience in resolving complex problems or Similar

  • Architecture and data modelling for Data Lake on cloud & working experience in Amazon WebServices (AWS), Microsoft Azure, Google Cloud Platform (GCP)

  • Basic understanding of Build and Release management & working experience in Azure DevOps, AWS CodeCommitt or Similar


What is in it for you?

  • Grow in culture focused on training and mentoring

  • Work in a fast-paced environment in an established brand


Reach Us:

If you think you are perfect fit for this role, kindly drop me an email along with your updated CV at india@crescendogroup.in.

Crescendo Global is an ISO 9001:2015 certified Leadership Hiring consulting arm of Crescendo Group with expertise in mid to senior level niche recruitment. We are passionate about empowering job seekers and employers with an engaging memorable job search and leadership hiring experience. Crescendo Global does not discriminate on the basis of race, religion, color, origin, gender, sexual orientation, age, marital status, veteran status or disability status.


Profile Keywords- Data engineer, Data engineering, Python, Pyspark, SQL, Azure, Data warehousing, Data modelling, IT Services & Consulting