Cybersecurity Developer - Assistant Vice President 2

Databricks Engineer:

Mandatory Skills:  Databricks, Hadoop, Python, Spark, Spark SQL, PySpark, AirFlow and IBM StreamSet

Required Skills & Experience:

4+ years of Databricks Experience

1+ years of AirFlow Experience

1+ years of IBM StreamSet Experience

Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka and Lambda to build serverless applications

Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).

Knowledge on medallion architecture, DLT and unity catalog within Databricks.

Experience in migrating data from on-prem Hadoop to Databricks/AWS

Understanding of core AWS services, uses, and AWS architecture best practices

Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.

Solid knowledge on Airflow

Solid knowledge on CI/CD pipeline in AWS technologies

Application migration of RDBMS, java/python applications, model code, elastic etc.

Solid programming background on scala, python, sql

Bachelor’s Degree level qualification in a computer or IT related subject

4+ years of experience in AWS/Azure development is must.

4+ years of overall Bigdata data pipeline experience

7+ years of experience in Core Java 11, J2EE, Tomcat, Spring Boot framework like Spring Core, Spring REST, Spring MS,Spring AOP,Apache Quartz

3+ years of experience on ReactJS, frontend tools like Babel, Webpack, npm, jQuery, etc

5+ years of experience in UI development, HTML 5, CSS, JavaScript, HighCharts, JQuery development

5+ years of DB development experience on relational and non-relational databases like Oracle, SQL Server, Snowflake

5+ years of experience working on cloud-based development on Azure or AWS including Kubernetes, Docker, Helm Framework

Additional requirements

Ability to communicate effectively and in a professional manner both written and orally

Be a team player with a positive attitude, enthusiasm, initiative, and self-motivation

Ability to multi-task, meet aggressive timelines and have strong work ethics

Experience of working in the financial industry

Experience with agile development methodology

Any experience on Databricks, Scala and Hadoop is plus

Experience on Apache Airflow is plus

State Street's Speak Up Line