Big Data Engineer (m/f/d)
As a Big Data Engineer at Trustbit, you will be responsible for designing and implementing distributed batch and stream processing solutions. Besides creating data lakes and data pipelines, you will also take care of data security in a cloud environment.
Your tasks
Design and implementation of distributed batch and stream processing solutions
Create data lakes and data pipelines
Development and realization of Big Data infrastructures
Ensuring data security in a cloud environment
Your profile
Degree in computer science or many years of experience in data processing
Solid programming skills in at least one prominent language, preferably Java, Scala, or Python
Good understanding of software architectures, testing and application monitoring.
Practical knowledge from the development of Big Data projects
Excellent knowledge of relational databases and SQL or No-SQL databases
Experience with GIT, Linux/Bash
Optional experience and skills
Distributed database engines (e.g. Apache Drill, Impala)
Big data processing or graph cluster computing (e.g. Apache Spark, Apache Airflow, Dask).
Container technologies (e.g. Docker, Kubernetes)
Streaming/event-driven platforms (e.g. Apache Kafka).
Ideally experience with cloud service (e.g. Google Cloud)
Bonus (choose 0 or more)
Do you have an active GitHub profile?
Do you run a blog on data engineering?
Salary
For legal reasons, we are obliged to state the minimum salary of the IT collective agreement applicable in Austria of € 3,139 gross/month (full-time basis) (experience level ST2).
However, we do of course offer overpayment in line with the market, depending on qualifications and experience.