Middle Data Engineer (Apache Spark)

vacancy-thumb
Location

Remote

Experience required

3+ years

Department

Data Engineer

Project description

Ongoing project – global online shopping project for Gulf countries

Responsibilities

Project development phase: maintenance and new development

communication with international team on daily basis

conduct code review and experience with git workflows

Requirements

Must Have: Linux basics, Knowledge of Big Data ingestion, computing and orchestration such as Spark, Airflow, database connectors, Kafka Knowledge of SQL, NoSQL and Graph databases particularly PL/SQL and Vertica SQL, Experience with unified query engines (Trino/Presto) or similar. Experience with unit testing and integration/component testing.

Good to have: Experience developing applications with high-volume transactions, Experience with microservices and REST API development, Experience with AWS Services and container deployment

Apply via site