Overview
As a Data Engineer, you will provide solutions on the data processing, engineering, and enrichment phase for various projects. You will be responsible for some aspects of the data life cycle including design, maintenance and building of cloud and data architectures. These activities will deliver on ingestion, transformation, and building of high-quality data structures.
What will you do at dyvenia?
You will be responsible for:
- Creating, monitoring, and troubleshooting ELT jobs to ingest and transform data from various systems using batch and stream processing;
- Driving and advocating for state-of-the-art methods of handling data in the company, eg. data lake, stream processing, IaC, DevOps, DataOps
- Collaborate with analytics and business teams to improve data feed.
As a DE, the majority of your work will involve performing new data ingestions from various sources such as databases, APIs, and files. This will require your skills in extracting, loading, and transforming data into a usable format for downstream analysis.
The remaining of your work will involve supporting the maintenance of existing ETL jobs. This will require your attention to detail and strong problem-solving skills in monitoring, troubleshooting, and resolving any issues that arise.
Your role will be critical in ensuring the successful ingestion and processing of new data, while maintaining the integrity and efficiency of existing ETL jobs.
You will be working with the following technologies:
- Python, Prefect (preferred), Dask, SQL
- Kafka (preferred)
- AWS and/or Azure
- Docker
- Linux, bash, git
- CI/CD
You will be based at our coworking office in Krakow in a hybrid format.
What will you need to be successful in the role?
- Demonstrated proficiency in the data engineering area
- Intermediate Python
- Strong SQL
- Understanding of cloud solutions
- Understanding of Docker
- Familiarity with Linux
- Experience with ETL
Benefits
When you join our team, you can expect:
Trainings
As a member of our team, we want you to thrive! Internal tranings, a development budget, and the chance to share your newly acquired skills with others - we’ll make sure to provide you with plenty of opportunities to further your growth.
Hands-on mentorship
Taking up a new career opportunity can be overwhelming at times. To help you get off the ground, you will be guided by a mentor who will not only support you through your career development, but also help you find ways to grow professionally.
Flexibility
We provide flexible working hours and possibility to work from home (days per week vary during probation period and based on seniority).
Team events
Your life at dyvenia is not just all about work. There will be plenty of fun activities, too. Team building activities, game nights, or the occasional organized outing - we truly enjoy spending time together!
Private healthcare
We genuinely care about your wellbeing. Not only do we want you to feel your best, but we also want you to feel confident that you and your loved ones will have access to the best care whenever you might need it.
Sport packages
Like being active? Then you will like this perk. To help you lead a happy and healthy lifestyle, we offer our support through our sport packages benefit. Gym, yoga, or something a little more extravagant, the choice is yours!
Ready to apply?
- Apply to this job by sending us your CV at [email protected]
- We get back to everyone, but if you don’t hear from us within a week, send us a quick reminder
- The very best of luck!