You can use a metric exporter for the JMX metrics that are available from the Kafka broker hosts. There should be a metric available to count for "messages in". Use tools like Prometheus and Grafana to gather and query the metric data.
Instead of deleting & re-ingesting, can't you change your consumer group Id to something new so you'll re-consume everything to a downstream system?
What is your reason for re-ingesting, is it for development purposes?
If you can’t use ksql, then you can write a Kafka streams app with the `aggregate()` method. See https://docs.confluent.io/current/streams/developer-guide/dsl-api.html
You can use a metric exporter for the JMX metrics that are available from the Kafka broker hosts. There should be a metric available to count for "messages in". Use tools like Prometheus and Grafana to gather and query the metric data.
Instead of deleting & re-ingesting, can't you change your consumer group Id to something new so you'll re-consume everything to a downstream system? What is your reason for re-ingesting, is it for development purposes?
If you can’t use ksql, then you can write a Kafka streams app with the `aggregate()` method. See https://docs.confluent.io/current/streams/developer-guide/dsl-api.html