Kafka Consultant

We're looking for a skilled consultant to join our client’s team and contribute to an exciting project involving Kafka.

This role involves evaluating and optimizing existing infrastructure and establishing governance practices for operationalizing the platform. You will also be instrumental in resolving specific issues related to platform maintenance. Key tasks include:

• Designing and architecting data flows, integrating Kafka as the backbone of microservices and change data capture.
• Creating and optimizing data pipelines, and configuring topics, partitions, and retention mechanisms.
• Assessing existing Kafka Connect connector architecture and enhancing monitoring.
• Implementing monitoring tools, such as Grafana.
• Establishing troubleshooting procedures to ensure high availability of clusters.
• Securing data exchanges using TLS, SASL, and ACL.
• Transferring knowledge and training the technical team.

The ideal candidate will have significant experience in deploying and optimizing Kafka platforms. They should possess sharp analytical and problem-solving skills. Required competencies include:

• Deep expertise in the Apache Kafka ecosystem (Broker, KRaft, Schema Registry).
• Practical experience with Kafka Streams and Kafka Connect frameworks.
• Knowledge of containerization technologies (e.g., Strimzi, Confluent).
• Strong understanding of distributed architectures, microservices principles, and event-driven processing.
• Familiarity with Ansible.
• Optional: Understanding of data stacks on streaming technologies (e.g., Iceberg, Spark, Flink).

The successful candidate will be fluent in English and Dutch. French is a plus.