[OSx]How to upgrade celery to Latest

shubham kumar singh
DevOps-Journey
Published in
1 min readMay 4, 2020

--

I would like to say this first that Celery is one of the best and feature-complete async task frameworks available right now. Having said that, I recently encountered an issue where a command is published to celery; however, it was never picked up. Since I have received the task_id in my messages, I presumed that request is pushed to an SQS queue. Since I was using AWS SQS, there is no publish_confiramation like the one we have in RabbitMQ to confirm this.

I ended up posting an issue in Celery https://github.com/celery/celery/issues/6071 and trying to follow up on that. As per their suggestions, I am supposed to upgrade my Celery version but ran into a few issues. I needed to upgrade Celery to latest stable version, but had issues to install that in Mac. Mainly the issue was PyCurl version, which was higher, and celery required an older version.

Setup pycurl

PYCURL_SSL_LIBRARY=openssl LDFLAGS="-L/usr/local/opt/openssl/lib" CPPFLAGS="-I/usr/local/opt/openssl/include" pip3 install --no-cache-dir pycurl==7.43.0.2

Setup celery(Rather upgrade)

pip install -U ‘celery==4.4.2’

I hope this helps to somebody who may run into this problem.

--

--

shubham kumar singh
DevOps-Journey

Googler | Cloud computing| Kubernetes | Containers | Monitoring | Python