Subscribing to a single Kafka partition on input connector

244
0
06-30-2023 09:30 AM
Jay_Gregory
Occasional Contributor III

We have some kafka topics with many partitions - almost 150 in one case.  When creating an input connector, I'm curious if I'm able to only subscribe to a single or range of partitions - which would effectively filter the data before it gets to geoevent.  My only other option would be to filter after the data gets there - but worried the processing power of our server couldn't handle it effectively.  

The partitions are split by site - we have over 150 sites, so if I want to pull in data from a subset of sites, being able to subscribe to specific partitions would be helpful. 

0 Kudos
0 Replies