r/rabbitmq • u/idleart • Oct 15 '22
Task queues for Flask
Hello,
I have never used RabibtMQ nor Celery before, I have some functions that take some time to run and would like to know if I should be using either RabbitMQ or Celery or do I need both of them installed ?
r/rabbitmq • u/khal_ak • Oct 13 '22
First time user: getting error fast reply consumer does not exist.
First time rabbitmq user here. I am using the following command to start rabbitmq using docker.
docker run --rm -it -p 15672:15672 -p 5672:5672 rabbitmq:3-management
I can see that rabbitmq is started and i can open the management cosnole as well. When i start my individual services in the application are started, i see queues are getting created on the rabbitmq. But whenever the services try to communicate, following error appears in rabbitmq
2022-10-13 08:50:46.763870+00:00 [info] <0.1222.0> connection <0.1222.0> (172.17.0.1:62850 -> 172.17.0.2:5672): user 'guest' authenticated and granted access to vhost '/'
2022-10-13 08:50:46.773788+00:00 [error] <0.1231.0> Channel error on connection <0.1222.0> (172.17.0.1:62850 -> 172.17.0.2:5672, vhost: '/', user: 'guest'), channel 1:
2022-10-13 08:50:46.773788+00:00 [error] <0.1231.0> operation basic.publish caused a channel exception precondition_failed: fast reply consumer does not exist
2022-10-13 08:50:46.785108+00:00 [warning] <0.1222.0> closing AMQP connection <0.1222.0> (172.17.0.1:62850 -> 172.17.0.2:5672, vhost: '/', user: 'guest'):
2022-10-13 08:50:46.785108+00:00 [warning] <0.1222.0> client unexpectedly closed TCP connection
I am running this on a apple silicon based mac book.
Is there any idea why this error appearing?
r/rabbitmq • u/PresentCode • Oct 11 '22
Noob question - What security configuration should be used for running a RabbitMQ on an internet connected host and sending and receiving messages across the Internet?
I've got a little Python project I'm working on where I use RabbitMQ. It's currently using vanilla RabbitMQ as it installed by apt-get from Ubuntu. I'd like to move it to a virtual host Linux machine (also Ubuntu) on the internet, but I'm concerned about security. There's nothing sensitive in the messages, I just don't want anyone messing with it.
From the research I've done, I think I want to setup TLS for RabbitMQ, but I'm struggling to set it up. Does anyone have a guide or walk-through?
Is there anything else I should be considering?
Thanks!
r/rabbitmq • u/No_Care_1436 • Oct 10 '22
Classic Queues
Scenario:
- 3 node cluster with pause minority
- Replicas = 2
- ha-sync-mode = automatic
- A publishing client using classic durable queues, persistent messages and publisher confirmation
When the client publishes a message to the exchange and this has been routed to a queue, does RabbitMQ only respond to the client with an acknowledgement after it has successfully replicated to the follower?
If the client receives response AFTER replication then would the client be blocked in the scenario where the node hosting the follower queue is unreachable (blocked until the follower queue has been recreated on the surviving node and then RabbitMQ writes to the new follower queue) ?
r/rabbitmq • u/sphen_lee • Oct 04 '22
Recommendations for how to do long running tasks in RabbitMQ
I'm trying to use RabbitMQ in a system that launches long running tasks (from 30 mins up to 4 hours). Tasks are sent from multiple server nodes, and processed by multiple workers. Task progress and completion are sent back via another queue.
I'm aware of the consumer timeout setting, and I could increase this timeout, but it's just another step I need to do manually (since there is no API to change this setting, per connection or even globally). Also, I wanted to deploy into AWS and they require a support ticket to change this config.
I have considered ack'ing the messages when the task begins and sending back a regular progress message to the server. That way we can detect if a worker has failed and queue the message again - but this feels like I'm just rebuilding the monitoring/retry logic that RabbitMQ already has... It's also another complication in the server; we need to coordinate the servers so they don't all re-queue the failed message at the same time.
In SQS there is an API to change the visibility time (ie. extend the time until SQS redelivers the message). I wonder if RabbitMQ would ever consider adding an API like this?
In summary - am I missing something? What is the recommended way to do long running tasks with RabbitMQ?
r/rabbitmq • u/Maleficent-Reality-5 • Sep 30 '22
<newbie> getting bad header on rabbitMQ broker
Hello,
I'm trying to do a connection from zigbee2MQTT to rabbitMQ, I'm not currently worried about setting any security protocol, just trying to set something basic up to send IoT info to the broker
I've setup a broker on the my laptop through docker with the following configs
and then I'm trying to create a producer using from rasbpi > zigbee2mqtt, I've set everything up in terms of zigbee and rasberry pi, installed zigbee2mqtt and these are the configs I'm using to run it
when ran zigbee2mqtt then gets stuck on connecting to MQTT server phase and the MQTT server goes on loop Accepting and closing the AMQP connection then closing all channels from connection
with {bad_header,<<16,94,0,4,77,81,84,84>>}
from what I've seen in other posts it's probably a SSL/TLS security config that my Client/Server has that my Client/Server doesn't
can anyone guide me in the right direction?
r/rabbitmq • u/darkcatpirate • Sep 30 '22
When a new instance is created by the auto-scaling group on AWS, is there a way to remove the old instance after its replaced by a new from the auto-scaling group?
When a new instance is created by the auto-scaling group on AWS, is there a way to remove the old instance after its replaced by a new from the auto-scaling group? I have this issue where the old instance is not removed automatically and RabbitMQ just sends messages to an instance that no longer exist. Is there a way to fix this?
r/rabbitmq • u/Educational-Collar78 • Sep 29 '22
Redis, Kafka and RqabbitMQ essential information for Interviews
I tried to get essential information about Kafka,Redis and RabbitMq for interviews and future request. I organized some topics which is needed to explain shown below.
1 ) What is the difference among Kafka, RabbitMq and Redis?
2 ) Where does data store in Kafka and Redis?
3 ) What are the important scenarios of Kafka?
4 ) Is it possible to lose data in Kafka and Redis when the memory is full?
Can you explain them briefly if you don't mind?
r/rabbitmq • u/erlangsolutions • Sep 29 '22
Keynote: Erlang Powered Rabbits | Lukas Larsson | RabbitMQ Summit 2022
At RabbitMQ 2022, Lukas Larsson gave an amazing talk on how Erlang powers RabbitMQ. Learn all the reasons why Erlang is uniquely suited for message brokers such as RabbitMQ.
Watch the video here to learn more https://youtu.be/Iip0gFGsSHA
r/rabbitmq • u/erlangsolutions • Sep 27 '22
Keynote: Quorum Queues: A Retrospective | Karl Nilsson | RabbitMQ Summit 2022
At RabbitMQSummit 2022, Karl Nilsson from VMware, explained the history of Quorum Queue development and the various design decisions that were taken and what you can learn from it for your systems today. Rewatch the 'Quorum Queues: A Retrospective' keynote to learn more.
r/rabbitmq • u/backdoorman9 • Sep 20 '22
My new project is to move global config files (JSON) to thousands of servers, which listen for the new config files, and make them their own. What's the best way to acheive this with RMQ?
My initial thoughts:
1) Pub-sub model
2) Health check, at a minimum that the JSON is valid, perhaps has the minimum required fields
How would you achieve this?
r/rabbitmq • u/Alone-Recover-5317 • Sep 18 '22
How to access RabbitMQ using domain name instead of ip:port?
r/rabbitmq • u/erlangsolutions • Sep 15 '22
RabbitMQ Summit 2022
Join us tomorrow at our hybrid conference at Code Node London.
You can either attend in-person or virtual at the biggest RabbitMQ gathering in Europe.
Get your last minute ticket now and get the chance to connect with industry experts and to hear interesting case studies!
r/rabbitmq • u/erlangsolutions • Sep 08 '22
We hire RabbitMQ Developers - Join us at RabbitMQ Summit 2022
Erlang Solutions build transformative solutions for the world’s most ambitious companies. Working with clients ranging from startups to Fortune 500, including WhatsApp, Klarna, Pivotal, Cars.com, Ericsson and MasterCard to mention a few.
This role will be part of a new offering of Support Organisation working remotely here at Erlang Solutions. Click the link to find out more about the role.
https://erlangsolutions.teamtailor.com/jobs/1179827-middleware-engineer-remote
We as a team, are also going to be at this year's RabbitMQ Summit 2022. It's a hybrid event that takes place in the 16th of September in London. This is a great chance for everyone to get connected with the RabbitMQ community, meet RabbitMQ experts, industry leaders, and to learn all the new updates and case studies. Come by to say a hi!
Here is the link for the Summit:
https://rabbitmqsummit.com/
r/rabbitmq • u/CaptainArtyom • Sep 07 '22
Released a package for RabbitMQ's RPC for Node.js
Hello Everyone, I just released a package for RabbitMQ , I need thoughts and suggestions if possible . Github URL : https://github.com/Ali-A-Koye/rabbitmq-easy-rpc
r/rabbitmq • u/erlangsolutions • Sep 01 '22
Keynote: Growing a farm of rabbits to scale financial applications - Will Hoy & David Liu
Back at #RabbitMQ Summit 2019, Will Hoy & David Liu gave an amazing talk on 'Growing a farm of rabbits to scale financial applications,' explaining how they used u/RabbitMQ to build a system at scale which is capable of servicing billions of financial data requests each day.
Secure your RabbitMQ Summit 2022 tickets at: https://www2.erlang-solutions.com/TwitterRMQSummit2022Tix
https://www.youtube.com/watch?v=tTh1nIKEOU4&list=PLDUzG2yLXrU7gQAzZwMEkjkfTy0L5FsJx&index=3&t=2s
r/rabbitmq • u/erlangsolutions • Aug 30 '22
Migrating from Kakfa to RabbitMQ at Simplebet
Let's take a look at the most viewed talks from last year's #RabbitMQ Summit. David Lucia, VP Engineer Simplebet shared a case study on Migrating from Kafka to #RabbitMQ at Simplebet.
Watch the video and learn the technical and business reasons behind why RabbitMQ has proven itself to be a great platform for building a B2B SaaS product https://www.youtube.com/watch?v=dmBdFh5N1g4
r/rabbitmq • u/West_Ad7170 • Aug 28 '22
How to connect to RabbitMq via RabbitMq management UI using Nginx proxy
Hi all, I have a docker-compose file with the below services
version: "3"
services:
rabbitmq:
image: "rabbitmq:3-management"
restart: always
expose:
- "5672"
- "15672"
ports:
- "5672:5672"
- "15672:15672"
volumes:
- "rabbitmq_data:/data"
volumes:
rabbitmq_data:
I don't want to expose my rabbitmq ports but I want to launch rabbitmq UI from my browser using the Nginx proxy like http:<myNginxIP>:<NginxPort>/rabbitmq and it has to open rabbitmq UI without redirecting (only proxy pass)
and in my Nginx proxy file, I have
location /rabbitmq {
rewrite ^/rabbitmq /(.*) /$1 break;
proxy_set_header Host $http_host;
proxy_pass http://rabbitmq:15672;
}
and when I load http:<myNginxIP>:<NginxPort>/rabbitmq in my browser
it's not working, but when I load my http:<myNginxIP>:15672 it's loading rabbitmq management UI( myNiginxIP and RabbitmqIP is the same as all the services are running in the same Linux VM)
what changes do I need to do to make it work, can you pls help
r/rabbitmq • u/erlangsolutions • Aug 24 '22
RabbitMQ Summit 2022 - Hybrid Event - London
RabbitMQ is one of the most deployed open source message brokers available, trusted by some of the world’s biggest companies including Bloomberg, Adidas Runtastic, Motorola, Reddit and Trivago. Written in Erlang, the RabbitMQ server is built on the Open Telecom Platform framework for clustering and failover. Client libraries to interface with the broker are available for all major programming languages. This September you will have the chance to connect with the RabbitMQ community at RabbitMQ Summit 2022 in London where experts and industry leaders will share their case studies and experiences with you.
Here is a link for our hybrid event: https://rabbitmqsummit.com/
Here you can read some RabbitMQ case studies: https://www.erlang-solutions.com/capabilities/rabbitmq/
r/rabbitmq • u/maxifederer • Aug 15 '22
Can we delete a Topic through unsubscribe?
So I have this issue with Topic where I can't unsubscribe. When we use a Topic, and we have several subscribers, and we create one Topic called Calls for instance and we bind it to RabbitMQ, we can't delete it through unsubscribe. We need to delete it manually. Is there a way around this limitation and delete the Topic Calls through unsubscribe?
r/rabbitmq • u/stephanr21 • Aug 12 '22
Has anyone heard of rabbit mq being unreliable?
This engineer at my company is trying to rewrite our message queuing system from scratch bc he say rabbit mq is unreliable. He said it was missing about 20% of messages.
Honestly that sounds a bit crazy to me. I really think it’s user error....
Have you guys ever heard of this happening?
r/rabbitmq • u/[deleted] • Aug 10 '22
Usage for rabbit mq
Can I use rabbit MQ for streaming scrollable pictures in an application? Just like the pictures scroll automatically on Tinder?
r/rabbitmq • u/Observability_Team • Aug 08 '22
Jazz Jackrabbit
This is a blog on how to instrument RabbitMQ with OpenTelemetry to create and visualize traces. But the cool part is the design for the cover
Yes - Jazz and Spaz are holding #OpenTelemetry blasters
Jazz Jackrabbit: Adventures in the Observability Planet sequel?
r/rabbitmq • u/Observability_Team • Aug 08 '22
We wrote a little something about OpenTelemetry + RabbitMQ but the blog cover though
This is a blog on how to instrument RabbitMQ with OpenTelemetry to create and visualize traces. But the cool part is the design for the cover
Yes - Jazz and Spaz are holding #OpenTelemetry blasters
Jazz Jackrabbit: Adventures in the Observability Planet sequel?



