KPN Data Services Hub

The Data Service Hub (DSH) is Event Streaming Platform based on open-source components. It is developed to support sharing of data between multiple parties. It supports multiple use case type, most important are:

• Massive data streaming between a few parties

• Limited data streaming between many parties (millions) (e.g. IoT)

• Massive data streaming between many parties (e.g. devices)

• All with low latency

To ensure separation of the parties the solution supports multi-tenancy  and capabilities to prevent overloading or abusing the platform by a single consumer or producer. 

The DSH has the  capability to spin-up containers for heavy real time event processing jobs. The containers are running close to the event broker to ensure very low latency and are part of the platform so separate security testing is not required.

From a high –level point of view, it consists of a control plane and a data plane. The control plane is used to manage the platform instances (managed kafka environment, start / stop of containers, Access control and e2e monitoring of the events published on the DSH). Data events are published and streamed on the data plane.