Run multiple processes in single celery worker on a machine with single CPU

83
January 14, 2021, at 05:10 AM

I am researching on Celery as background worker for my flask application. The application is hosted on a shared linux server (I am not very sure what this means) on Linode platform. The description says that the server has 1 CPU and 2GB RAM. I read that a Celery worker starts worker processes under it and their number is equal to number of cores on the machine - which is 1 in my case.

I would have situations where I have users asking for multiple background jobs to be run. They would all be placed in a redis/rabbitmq queue (not decided yet). So if I start Celery with concurrency greater than 1 (say --concurrency 4), then would it be of any use? Or will the other workers be useless in this case as I have a single CPU?

The tasks would mostly be about reading information to and from google sheets and application database. These interactions can get heavy at times taking about 5-15 minutes. Based on this, will the answer to the above question change as there might be times when cpu is not being utilized?

Any help on this will be great as I don't want one job to keep on waiting for the previous one to finish before it can start or will the only solution be to pay money for a better machine?

Thanks

READ ALSO
Import css file from same non-root directory

Import css file from same non-root directory

I would like to distribute my css between multiple files to remain more organizedBut I want to only have to import my main

92
kotlin Converts bytearray data received through communication into string

kotlin Converts bytearray data received through communication into string

Converts bytearray data received through communication into string

124
wsimport on jax-ws who has two global components whith the same name

wsimport on jax-ws who has two global components whith the same name

I' try to use wsimport to use a jax-ws, but I get this message:

90
The code gives a parse error I can't find what the error is

The code gives a parse error I can't find what the error is

The code gives a parse error I can't find what the error is, the curlys brackets aren't wrong I'm trying to model the equation, v = \sqrt\frac{196mass}{Cd1

55