General duties:
Create and maintain data ingestion pipelines including data delivery process optimization (ETL, ELT) and implements data quality controls.
Create data models to ensure low-latency in production.
Build infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources.
Participate in building machine learning platform for the Advanced Analytics use cases.
Work with data scientists, data analysts, product managers, data architects and other stakeholders to improve the quality of the machine learning models.
Maintain the relevant technical documentation including relevant Data Dictionary up to date.
We are building a Machine Learning Platform and we will require low-latency features- and data-stores for real-time model-serving. Hence there are a handful of challenges for our Data Engineering team:
Create data pipelines to efficiently gather data from corporate DWH (Oracle) and move into cloud
Design & implement data layers for machine learning model training (batch) and real-time serving with low latency
Gather real-time streaming data from core systems and make it available for model inference
Design data quality checks & gates
Requirements:
Fluency in SQL (Oracle): indexes, DDL, complex queries
Experience with PySpark
Experience with NoSQL: MongoDB, Cassandra or cloud-native alternatives
Strong python knowledge
Ownership mentality, curiosity & pro-active approach
Verbal and written English
You are an Ideal candidate if you have:
Experience with workflow orchestrators: Airflow
Implementing data pipelines with Databricks / PySpark
SQL dialects: Postgres, MS SQL
Document-DB experience: MongoDB, Azure CosmosDB
Azure stack experience: CosmosDB, MS SQL, etc.
Streaming experience: working with Kafka / Kafka Streams or Flink
Experience with Java or Scala
DSK Bank offers:
Food vouchers in the amount of 200 BGN per month, favorable conditions for housing and mortgage lending, as well as for bank products and services
Annual bonus scheme depending on the achieved result
20+5 days of paid annual leave
Excellent opportunities for professional and career development in one of Bulgaria’s leading banks
Dynamic and challenging job with friendly work environment
Preferential conditions for Multisport card
Documents for application:
CV
Create and maintain data ingestion pipelines including data delivery process optimization (ETL, ELT) and implements data quality controls.
Create data models to ensure low-latency in production.
Build infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources.
Participate in building machine learning platform for the Advanced Analytics use cases.
Work with data scientists, data analysts, product managers, data architects and other stakeholders to improve the quality of the machine learning models.
Maintain the relevant technical documentation including relevant Data Dictionary up to date.
We are building a Machine Learning Platform and we will require low-latency features- and data-stores for real-time model-serving. Hence there are a handful of challenges for our Data Engineering team:
Create data pipelines to efficiently gather data from corporate DWH (Oracle) and move into cloud
Design & implement data layers for machine learning model training (batch) and real-time serving with low latency
Gather real-time streaming data from core systems and make it available for model inference
Design data quality checks & gates
Requirements:
Fluency in SQL (Oracle): indexes, DDL, complex queries
Experience with PySpark
Experience with NoSQL: MongoDB, Cassandra or cloud-native alternatives
Strong python knowledge
Ownership mentality, curiosity & pro-active approach
Verbal and written English
You are an Ideal candidate if you have:
Experience with workflow orchestrators: Airflow
Implementing data pipelines with Databricks / PySpark
SQL dialects: Postgres, MS SQL
Document-DB experience: MongoDB, Azure CosmosDB
Azure stack experience: CosmosDB, MS SQL, etc.
Streaming experience: working with Kafka / Kafka Streams or Flink
Experience with Java or Scala
DSK Bank offers:
Food vouchers in the amount of 200 BGN per month, favorable conditions for housing and mortgage lending, as well as for bank products and services
Annual bonus scheme depending on the achieved result
20+5 days of paid annual leave
Excellent opportunities for professional and career development in one of Bulgaria’s leading banks
Dynamic and challenging job with friendly work environment
Preferential conditions for Multisport card
Documents for application:
CV
