Queues

NATS
Kafka
Red Panda
RabbitMQ
- Load Testing

NATS

Liftbridge

Kafka

What every software engineer should know about kafka
How we use kafka to maintain tenant data isolation at scale
How We Maintain Tenant Data Isolation with Kafka at Scale
Gently Down The Stream ( Kafka Book )

Command Line Tooling

Libraries

https://github.com/twmb/franz-go

MemQ

https://github.com/pinterest/memq

MemQ is a new PubSub system that augments Kafka at Pinterest. It uses a decoupled storage and serving architecture similar to Apache Pulsar and Facebook Logdevice; however, it relies on a pluggable replicated storage layer i.e. Object Store / DFS / NFS for storing data. The net result is a PubSub system that:

Red Panda

https://redpanda.com/deployment-options?section=self-hosted

RabbitMQ

Load Testing

bin/runjava com.rabbitmq.perf.PerfTest -x 5 -y 5 -u "throughput-test-5" --id "test-5" -f persistent \
    --uri "amqp://admin:@helm-services-rabbitmq-ha.default:5672" --rate=4000 -z 60 --json-body --size=8096 \
    --producer-scheduler-threads 10 --consumers-thread-pools 10 --queue-pattern-from 1 \
    --queue-pattern-to 10 --queue-pattern 'perf-test-%d'

{ Josh Rendek }