Senior Data Engineer - (On Premises - Hadoop, Spark, Python, SQL) Job Listing at Mastercard in Pune, MH (Job ID R-263702)

Description

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Senior Data Engineer - (On Premises - Hadoop, Spark, Python, SQL) Who is Mastercard?
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.
Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.

Role: As the Senior Data Engineer for Mastercard's Internal Workplace intelligence platform data lake, you will be the driving force behind the development and execution of cutting-edge data governance strategies and data environment frameworks.
Your expertise will ensure the effective utilization of data, enabling the delivery of dependable Data & Analytics Services. You will collaborate with cross-functional teams, and establish data-related best practices in alignment with Mastercard standards.
Qualifications:
• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
• Proven experience as a Lead/Senior Data Engineer or similar role.
• Deep understanding of data governance principles and data lifecycle management.
• Proficiency in designing and implementing data tools, technologies, and processes.
• Expertise in data engineering, ETL/ELT processes, data warehousing, and data modeling.
• Strong command of data integration techniques and data quality management.
• Hands-on experience with data technologies such as Hadoop, Spark, Python, SQL, alteryx, Nifi, SSIS, etc.
• Familiarity with cloud platforms and services, such as AWS, GCP, or Azure.
• Excellent problem-solving skills and ability to provide innovative data solutions.
• Strong leadership skills with a proven track record of guiding and mentoring a team.
All About You:
• 5-8 years of experience in Data Warehouse related projects in product or service-based organization
• Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data Hadoop environment
• Experience of building data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage
• Experience of working with Databases like MS SQL Server, Oracle and have strong SQL knowledge
• Experience of working on Alteryx, SSIS, NiFi added advantage
• Experience of working on automation in data flow process in a Big Data environment.
• Experience of working in Agile teams
• Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
• Strong communication skills - both verbal and written – and strong relationship, collaboration skills and organizational skills
• Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members
• Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
• Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement
• Flexibility to work as a member of a matrix based diverse and geographically distributed project teams
• Create and maintain a robust data environment that adheres to Mastercard standards and best practices.
• Oversee the management and optimization of data warehouses and data lakes.
Attributes:
• Strong communication skills with the ability to convey complex technical concepts to non-technical stakeholders.
• Detail-oriented and committed to maintaining high data quality and integrity.
• Proactive attitude towards problem-solving and continuous improvement.
• Results-driven with a focus on delivering reliable and valuable Data & Analytics Services.
• Ability to lead and inspire a team to achieve exceptional results.
• Collaborative and adaptable, thriving in a dynamic and fast-paced environment.
• Abide by Mastercard's security policies and practices;
• Ensure the confidentiality and integrity of the information being accessed;
• Report any suspected information security violation or breach
• Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
Responsibilities:

• Participate in team prioritization discussions with Product/Business stakeholders
• Estimate and own delivery tasks (design, dev, test, deployment, configuration, documentation) to meet the business requirements
• Automate build, operate, and run aspects of software
• Drive code/design/process trade-off discussions within their team when required
• Report status and manage risks within their primary application/service
• Drive integration of services focusing on customer journey and experience
• Perform demos/acceptance discussions in interacting with Product owners
• Understands operational and engineering experience, actively works to improve experience and metrics in ownership area
• Develop complete understanding of end-to-end technical architecture and dependency systems
• Drive adoption of technology standards and opinionated frameworks, and review coding, test, and automation work of team members
• Mentor and guide new and less-experienced team members
• Identify opportunities to improve an overall process and trim waste
• Share and seek knowledge within their Guild/Program to drive reuse of patterns/libraries/practices and enhance productivity

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard's security policies and practices;

• Ensure the confidentiality and integrity of the information being accessed;

• Report any suspected information security violation or breach, and

• Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

 Apply on company website