Job Details

Join to apply for the Data Engineering Lead - S&P Global role at Jobs via eFinancialCareers

9 hours ago Be among the first 25 applicants

About the Role:

Title: Lead Data Engineer - Big Data

The Team: You will be an expert contributor and part of the Rating Organization's Ingestion Pipelines Engineering Team. This team has broad and expert knowledge of Ratings organization's critical data domains, technology stacks, and architectural patterns. It fosters knowledge sharing and collaboration to develop a unified strategy. All Data Services team members provide leadership, innovation, timely delivery, and articulate business value. Be part of a unique opportunity to build and evolve S&P Ratings' next-generation Ingestion pipelines platform.

Responsibilities and Impact:

• Design & build ingestion pipelines using ELT and schema-on-read in Databricks Delta Lake.
• Develop data transformations using ELT frameworks to modernize ingestion pipelines and build data transformations at scale.
• Provide technical expertise in designing and implementing Ratings Data Ingestion pipelines using AWS cloud and technologies such as S3, Hive, Databricks, Scala, Python, and large-scale analytics tools.
• Build and maintain a data environment optimized for speed, accuracy, consistency, and uptime.
• Collaborate closely with data teams & Data Science teams to develop ingestion pipelines.
• Implement data governance principles, data quality checks, and data lineage at each data hop.
• Stay updated with emerging trends in Big Data and cloud technologies and evaluate new technologies.
• Ensure compliance with enterprise standards and promote best practices aligned with organizational principles.

Qualifications:

• BE, MCA, or MS in Computer Science or IT.
• 10+ years of experience as a Data Engineer in an innovative organization.
• 5+ years of hands-on experience with AWS/Azure cloud tech such as S3, Databricks, Hive, Scala, Python, etc.
• 3+ years of experience building data ingestion pipelines with streaming tools like Golden Gate for bulk and incremental loads.
• Strong expertise in SDLC, stakeholder management, risk management, and team leadership.
• Proficiency in development frameworks and data technologies like Python, Scala, Java, RDBMS, and data streaming tools.
• Experience with microservices, API design, CI/CD tools like Jenkins, and UNIX/Linux shell scripting.
• Deep understanding of cloud-native architectures, design patterns, and agile practices.
• Excellent communication skills and ability to influence stakeholders.

Additional Preferences:

• Experience with Machine Learning libraries (TensorFlow, MLlib) is a plus.
• Industry experience in finance is advantageous.
• Ability to prioritize in a fast-paced environment.

Other Details:

This position is limited to candidates with the right to work in the United States. We support return-to-work candidates and promote diversity and inclusion. For more details on benefits and policies, visit our website and review our policies on fraud prevention, equal opportunity employment, and accommodations.

Job ID: 298427

Posted on: 2025-06-26

Location: Virtual, Nevada, United States

J-18808-Ljbffr