Data Engineer Cloudera

As Data Engineer you will interact with the business and IT colleagues (architects, functional analysts, project managers, data scientists, developers) and participate in the data transformation program.

As part of this program, we are re-engineering our enterprise data platform and machine learning solutions and moving to a CDP technology stack (Cloudera Data Platform). In this re-engineering and migration, you will design and develop solutions for real-time data ingestion, processing and serving in a highly available environment. You will also be working on several generic frameworks e.g. framework for logging, for access management, …

Skills:
You are an IT professional with a minimum of five years of experience with proven experience in big data engineering.
You have experience with the Cloudera products (HDFS, Ozone, Hive, Impala, Spark, Oozie, Atlas, Ranger, …).
Experience in real-time technologies is mandatory (Nifi, Kafka, Flink, Spark Streaming, High Availability setup …).

Specifically on Kafka:
• Design and implement broker and partition architecture
• Develop consumable topics and corresponding API/microservices to render data consumable.
• Configure Producers and Consumers
• Mastering all core components required in a Kafka eco-system, like Zookeeper, YARN
• Integration with Flink and Nifi
• Stream processing knowledge Kafka with Flink
• Know-how of a Kafka administration profile is a plus

Nice to have:
Experience in NoSQL databases (CouchBase, MongoDB, …) is an advantage.
You have experience with CI/CD (Git, Jenkins / Gitlab CI, Ansible, Nexus)
You have experience in Java and/or Python programming languages.
Experience in PowerBI, Scala, Docker and Kubernetes are an advantage.

You are fluent in English, both spoken and written.
Knowledge of Dutch and/or French is an advantage.

What can you expect from us?
Mind-blowing workplace culture. You will be integrated in a professional, dynamic and collaborative team.
 
 100% Remote opportunities
We want you to have the flexibility to work where you feel most comfortable and productive.
 
International Career
You can expect professional growth and to be connect with the world.
We are represented in 2 European countries: Portugal and Belgium.
And with projects in many other countries: Netherlands, Luxembourg, Singapore and in the United States of America (and a lot more is coming…)

Extra Benefits & Perks
If you wish to work with us and you are outside European Union (good news…) we are a Tech Visa Company, We will help!
 
As a plus, we provide Health and Life Insurance.
 
Bridge351 is proud to be an equal opportunity employer. We are committed to build a diverse and inclusive culture and celebrate authenticity. We do not discriminate on the basis of race, religion, color, national origin, gender, gender identity, sexual orientation, age, marital status, disability or any other legally protected characteristics.