Lead Data Engineer– PySpark, AWS (5+ Years)
An excellent opportunity for an individual holding an overall 5+ years of experience in the designing, development, testing, maintenance, and support data assets including; BigQuery, Dataflow, Dataproc, Cloud Data Fusion, Dataprep, SQL script creation, stored procedure development, integration services. The profile is ideal for a person holding an extensive experience in Python, PySpakrk, SQL and AWS.
Location –Pune/ Noida/ Gurgaon
Your Future Employer: One of the largest Global analytics and digital solutions company serving industries including insurance, healthcare, banking, and financial services, media, retail, and others
Responsibilities:
Writing code in programming language & working experience in Python, PySpakrk, Scala or Similar
Designing, building, operationalizing, securing, and monitoring data processing systems on Google Cloud Platform
Acting as a SME in data engineering and GCP data technologies
Writing requirement, functional & technical documentation & working experience in Integration design document, architecture documentation, data testing plans or Similar
Reading Data Formats & working experience in JSON, XML or Similar
Requirements:
Hands on experience with GCP Data Products (e.g. BigQuery, Dataflow, Dataproc, Cloud Data Fusion, Dataprep, etc.)
SQL queries & working experience in SQL code or Stored Procedures or Functions or Views or Similar
Database & working experience in any of the database like MS SQL, Oracle or Similar
Analytical Problem Solving skills & working experience in resolving complex problems or Similar
Architecture and data modelling for Data Lake on cloud & working experience in Amazon WebServices (AWS), Microsoft Azure, Google Cloud Platform (GCP)
Basic understanding of Build and Release management & working experience in Azure DevOps, AWS CodeCommitt or Similar
What is in it for you?
Grow in culture focused on training and mentoring
Work in a fast-paced environment in an established brand
Reach Us:
If you think you are perfect fit for this role, kindly drop me an email along with your updated CV at india@crescendogroup.in.
Crescendo Global is an ISO 9001:2015 certified Leadership Hiring consulting arm of Crescendo Group with expertise in mid to senior level niche recruitment. We are passionate about empowering job seekers and employers with an engaging memorable job search and leadership hiring experience. Crescendo Global does not discriminate on the basis of race, religion, color, origin, gender, sexual orientation, age, marital status, veteran status or disability status.
Profile Keywords- Data engineer, Data engineering, Python, Pyspark, SQL, Azure, Data warehousing, Data modelling, IT Services & Consulting