I am starting to learn Kafka, during my readings, some questions came to my mind:
-
When a producer is producing a message – it will specify the topic it wants to send the message to, is that right? Does it care about partitions?
-
When a subscriber is running – does it specify its group id so that it can be part of a cluster of consumers of the same topic or several topics that this group of consumers is interested in?
-
Does each consumer group have a corresponding partition on the broker or does each consumer have one?
-
Are the partitions created by the broker, and therefore not a concern for the consumers?
-
Since this is a queue with an offset for each partition, is it the responsibility of the consumer to specify which messages it wants to read? Does it need to save its state?
-
What happens when a message is deleted from the queue? – For example, the retention was for 3 hours, then the time passes, how is the offset being handled on both sides?
