Microscaling Queue Demos

Supporting demo images and config for the Microscaling Engine from Microscaling Systems. Used to show how the engine can scale a queue to maintain a target length.

Docker with NSQ

Used for the microscaling/queue-demo Docker image.

Simple demo for showing how the Microscaling Engine can scale a queue to maintain a target length. Demo currently supports NSQ (more queues will be added soon). It is implemented in Ruby and intended to be run as a Docker container.

Full instructions for running the demo are at app.microscaling.com.

Each Docker command is shown along with its environment variables and default values.

Kubernetes with NSQ

• Clone this repository
• Register at app.microscaling.com and get your user ID
• Edit kubernetes/microscaling-deployment.yml and set your user ID
• Create deployments and nsq service

$ kubectl create -f kubernetes/nsq-deployment.yml
$ kubectl create -f kubernetes/nsq-svc.yml
$ kubectl create -f kubernetes/consumer-deployment.yml
$ kubectl create -f kubernetes/producer-deployment.yml
$ kubectl create -f kubernetes/remainder-deployment.yml
$ kubectl create -f kubernetes/microscaling-deployment.yml

• View the demo
• Remove the demo

$ kubectl delete deployment microscaling consumer producer remainder nsq
$ kubectl delete service nsq

Note: your cluster will need the kube-dns addon as its used for service discovery to access the NSQ service.

Marathon with Azure Storage Queue

The marathon-install and marathon-uninstall commands creates the Marathon demo apps using its REST API. See this blog post for more details. To run the commands you need Ruby but there are no other dependencies.

marathon-install

Creates the demo apps using the Marathon REST API. You can register at app.microscaling.com to get your install command.

marathon-uninstall

Deletes the demo apps using the Marathon REST API.

consumer

The default Docker command that adds items to the queue.

MSS_QUEUE_ENDPOINT    127.0.0.1:4150
MSS_TOPIC_NAME        microscaling-demo
MSS_CHANNEL_NAME      microscaling-demo
MSS_CONSUMER_SLEEP_MS 300

producer

The producer command removes items from the queue.

MSS_QUEUE_ENDPOINT    127.0.0.1:4150
MSS_TOPIC_NAME        microscaling-demo
MSS_PRODUCER_SLEEP_MS 100

Development

Use Docker Compose to develop and test changes to the demo. From the current directory run the up command.

$ docker-compose up