Data Engineer, Data Quality and Governance(VP)

We are looking for a Data engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications, and exposure to Cloud based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects and business leadership to develop and execute the technology product roadmap in driving Data Governance policy implementation.

The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud based engineering platforms.

What you will be responsible for

  • End to end Cloud Data Lake design & development including data ingestion, data modeling and data distribution.
  • Build data integrations, hand-offs between on-prem/cloud-based systems.
  • Responsible for developing/implementing cloud infrastructure to support current and future business needs.
  • Participating in technical design, application build, configuration, unit testing, and production deployment.
  • Ensuring all cloud solutions exhibit higher level of cost efficiency, performance, security, scalability, and reliability
  • Experience with managing offshore and onshore teams spread globally.

What we value

These skills will help you succeed in this role

  • Full stack cloud developer : Data (delta lake/data bricks), PL/SQL, Java/J2EE, React, CI/CD pipeline and release management.
  • Strong skill-set, experience in Python, Scala/PySpark, PL/SQL, PERL/scripting .
  • Skilled Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in building enterprise Cloud applications, based on high-volume data processing frameworks, ETL development using distributed computing frameworks as Apache Spark, Hadoop, Hive.
  • Experience with optimizing database performance, scalability, ensuring data security and compliance.
  • Experience with event based, micro-batch and batched high volume and high velocity transaction and data processing system.
  • Proficiency with CICD and DevOps

Education & Preferred Qualifications

  • Bachelor’s/Master's Degree in a Computer Science, Engineering or Math or equivalent experience
  • 12+ years' experience in professional software design and development.
  • Strong analytical skills, with ability to collect, absorb, and analyze information quickly and independently
  • Proven ability to develop and work with cross functional processes and project timelines
  • Excellent follow-through, attention to detail and time management skills                                               
  • Adapt and excel at managing multiple simultaneous tasks in a high pressure, deadline environment.

State Street's Speak Up Line

Related vacancies