bier-in-aktion/kafka
Watch
1
0
Fork
You've already forked kafka
 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
9 commits 1 branch 3 tags 33 KiB
  • Shell 100%
Find a file
Exact
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Alex Leidwein 80795a3c2f added db
2024-05-06 13:43:16 +02:00
create-topics.sh feat: added product udpate topic 2024-04-07 14:15:51 +02:00
docker-compose.dev.yml added db 2024-05-06 13:43:16 +02:00
docker-compose.yml added db 2024-05-06 13:43:16 +02:00
README.md feat: added retention time config, document configuration 2024-03-04 11:39:35 +01:00

README.md

Bier in Aktion: Kafka Setup

Running the setup

Run production with docker compose up -d.

For development purposes, run docker compose -f docker-compose-dev.yml up -d.

This additionally exposes Kafka UI on port 8080.

Topic Configuration

The products topic is configured as follows:

key value description
replication-factor 3 Replicate across all three nodes
partitions 6 Allows higher parallelism if more shops are added in the future
min.insync.replicas 2 Require two replicas to allow one node to be down
retention.ms 86400000 Keep products for a day, to dismiss old promotions

As key for the topic <prefix>-<productId> is used, where prefix is the name of the shop and productId the UUID of the product.