Streaming Data Engineer, Sofia
Банка ДСК АД
Streaming Data Engineer, Sofia
София
full-time

Streaming Data Engineer, Sofia

София full-time

Job Description

Основни задължения

  • Create and maintain data ingestion pipelines including data delivery process optimization (ETL, ELT) and implements data quality controls
  • Create data models to ensure low-latency in production
  • Build infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources
  • Participate in building machine learning platform for the Advanced Analytics use cases
  • Work with data scientists, data analysts, product managers, data architects and other stakeholders to improve the quality of the machine learning models
  • Maintain the relevant technical documentation including relevant Data Dictionary up to date

Изисквания за заемане на длъжността

Expectations:

  • Fluency in SQL (Oracle): indexes, DDL, complex queries
  • Experience with PySpark
  • Experience with NoSQL: MongoDB, Cassandra or cloud-native alternatives
  • Strong python knowledge
  • Ownership mentality, curiosity & pro-active approach
  • Verbal and written English

Ideal candidate:

  • Experience with workflow orchestrators: Airflow
  • Implementing data pipelines with Databricks / PySpark
  • SQL dialects: Postgres, MS SQL
  • Document-DB experience: MongoDB, Azure CosmosDB
  • Azure stack experience: CosmosDB, MS SQL, etc.
  • Streaming experience: working with Kafka / Kafka Streams or Flink
  • Experience with Java or Scala

Ние предлагаме

  • Excellent opportunities for professional and career development in one of Bulgaria's leading banks
  • Dynamic and challenging job with friendly work environment
  • Food vouchers in the amount of 102.26 EUR per month,
  • favorable conditions for housing and mortgage lending, as well as for bank products and services
  • Annual bonus scheme depending on the achieved results
  • Preferential conditions for Multisport card/ Cool Fit
  • Hybrid work model and great location - in the heart of Sofia's city center
  • 20+5 days of paid annual leave

Необходими документи за кандидатстване

CV