Kafka plug-in structure
- Configuring a Kafka event source
- A Generic event source that receives KafkaEvent type events can be configured in
the following way:
- Bootstrap Server
-
- Type: string
- Multiple filters
- Required
- Single predicate
- Topic
-
- Type: string
- Multiple filters
- Required
- Single predicate
- Security protocol
-
- Type: string
- Multiple filters
- Required*
- Single predicate
- Values:
PLAINTEXT
SASL_PLAINTEXT
SSL
SASL_SSL
- Default: if no security protocol is specified, the
default value is
PLAINTEXT
- identificationAlgo
-
- Type: string
- Multiple filters
- Required*
- Single predicate
- saslMechanism
-
- Type: string
- Multiple filters
- Required*
- Single predicate
- Values:
PLAIN
GSSAPI
SCRAM-SHA-256
OAUTHBEARER
SCRAM-SHA-512
- Default: if no SASL mechanism is specified, the
default value is
PLAIN
- Username
-
- Type: string
- Multiple filters
- Required*
- Single predicate
- Password
-
- Type: string
- Multiple filters
- Required*
- Single predicate
- pollInMS
-
- Type: nonnegativeinteger
- Multiple filters
- Single predicate
- Default: if no value is specified for the interval, the default value is 100
- kerberosPrincipal
-
- Type: string
- Multiple filters
- Required*
- Single predicate
- kerberosKeytab
-
- Type: string
- Multiple filters
- Required*
- Single predicate
- kerberosService
-
- Type: string
- Multiple filters
- Required*
- Single predicate
- groupID
-
- Type: string
- Multiple filters
- Single predicate
- Default: if no group ID is specified, the default value is the name of the event source -consumer
Note:- If the
securityProtocol
is set toSSL
orSASL_SSL
, theidentificationAlgo
is used to enable the hostname verification. - If the
securityProtocol
is set toSASL_PLAINTEXT
orSASL_SSL
, thesaslMechanism
is optional. - If the
saslMechanism
is set toPLAIN
,SCRAM-SHA-256
orSCRAM-SHA-512
, theusername
andpassword
are required. - If the
saslMechanism
is set toGSSAPI
, thekerberosPrincipal
,kerberosKeytab
andkerberosService
are required.
- Kafka event condition
- KafkaEvent type event conditions can be configured in job streams specifying the
following required properties:
- Name
- Type
- Event source
- Message
- Type: string
- Operator:
EQ("=")
orNE("!=")
- Wildcard allowed
- Single predicate
- Key
- Type: string
- Operator:
EQ("=")
orNE("!=")
- Wildcard allowed
- Single predicate
- Partition
- Type: string
- Operator:
EQ("=")
orNE("!=")
- Wildcard allowed
- Single predicate