Skip to content

Kafka Connector

Consume messages from Apache Kafka topics to detect active assets based on security event telemetry.

CategoryMessage Streaming
Modesbatch, realtime
Imageghcr.io/silentpulse/connector-kafka:1.0.0
Manifesthub.silentpulse.io/universe/packages/kafka/manifest.json
  • Apache Kafka 2.0 or later
  • Network access from SilentPulse to Kafka brokers
  • SASL credentials (if authentication is enabled)
FieldTypeRequiredDescription
brokerstextyesComma-separated list of Kafka brokers
usernametextnoSASL username
passwordpasswordnoSASL password
use_tlsbooleannoEnable TLS
FieldTypeRequiredDefaultDescription
topictextyesKafka topic to consume from
consumer_grouptextnosilentpulseConsumer group ID
hostname_fieldtextyeshostnameJSON field containing the asset hostname

The connector joins a Kafka consumer group and reads messages from the configured topic. Each message is parsed as JSON, and the hostname is extracted from the configured field.

The connector supports horizontal scaling based on Kafka partition count. Set max_replicas to match your partition count for optimal throughput. Scaling key: partitions.

ResourceRequest
CPU100m
Memory128Mi
Min replicas1
Max replicas8
  • Consumer group must be unique per SilentPulse instance
  • Max message size: 1MB