Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

First Asynch call to gevent celery worker always fails #8680

Closed
13 of 17 tasks
karthikkj172 opened this issue Nov 28, 2023 · 0 comments
Closed
13 of 17 tasks

First Asynch call to gevent celery worker always fails #8680

karthikkj172 opened this issue Nov 28, 2023 · 0 comments
Labels
Issue Type: Bug Report

Comments

@karthikkj172
Copy link

karthikkj172 commented Nov 28, 2023 •
edited

Checklist

  • I have verified that the issue exists against the main branch of Celery.
  • This has already been asked to the discussions forum first.
  • I have read the relevant section in the
    contribution guide
    on reporting bugs.
  • I have checked the issues list
    for similar or identical bug reports.
  • I have checked the pull requests list
    for existing proposed fixes.
  • I have checked the commit log
    to find out if the bug was already fixed in the main branch.
  • I have included all related issues and possible duplicate issues
    in this issue (If there are none, check this box anyway).

Mandatory Debugging Information

  • I have included the output of celery -A proj report in the issue.
    (if you are not able to do this, then at least specify the Celery
    version affected).
  • I have verified that the issue exists against the main branch of Celery.
  • I have included the contents of pip freeze in the issue.
  • I have included all the versions of all the external dependencies required
    to reproduce this bug.

Optional Debugging Information

  • I have tried reproducing the issue on more than one Python version
    and/or implementation.
  • [] I have tried reproducing the issue on more than one message broker and/or
    result backend.
  • I have tried reproducing the issue on more than one version of the message
    broker and/or result backend.
  • I have tried reproducing the issue on more than one operating system.
  • I have tried reproducing the issue on more than one workers pool.
  • I have tried reproducing the issue with autoscaling, retries,
    ETA/Countdown & rate limits disabled.
  • I have tried reproducing the issue after downgrading
    and/or upgrading Celery and its dependencies.

Related Issues and Possible Duplicates

Related Issues

  • None

Possible Duplicates

  • None

Environment & Settings

celery --version
5.2.7 (dawn-chorus)

celery report Output: 

/bin/celery -A custom_task_worker_io report

software -> celery:5.2.7 (dawn-chorus) kombu:5.2.4 py:3.8.18
            billiard:3.6.4.0 py-amqp:5.1.1
platform -> system:Linux arch:64bit, ELF
            kernel version:4.18.0-425.19.2.el8_7.x86_64 imp:CPython
loader   -> celery.loaders.app.AppLoader
settings -> transport:pyamqp results:db+mysql+pymysql://custom:**@ip/custom_celery_asynch_io_tasks

deprecated_settings: None
broker_url: 'amqp://custom_io:********@ip:port//custom_io'
result_backend: 'db+mysql+pymysql://custom:********@ip/custom_celery_asynch_io_tasks'
worker_concurrency: 3
worker_prefetch_multiplier: 1
worker_max_tasks_per_child: 1
database_engine_options: {
    'connect_args': {   'ssl': {   'cert': 'mycert.crt',
                                   'key': '********'}}}
task_default_queue: 'custom_celery_io_task'
imports: 'custom_io_distributed_task'

Steps to Reproduce

Required Dependencies

  • Minimal Python Version: python 3.8
  • Minimal Celery Version: 5.2.7
  • Minimal Kombu Version: 5.2.4
  • Minimal Broker Version: RabbitMQ 3.9.25
  • Minimal Result Backend Version: mysql Ver 8.0.34-commercial
  • Minimal OS and/or Kernel Version: 4.18.0-425.19.2.el8_7.x86_64
  • Minimal Broker Client Version: (py-amqp:5.1.1)
  • Minimal Result Backend Client Version: N/A or Unknown

Python Packages

pip freeze Output: 


amqp @ file:///tmp/site-packages/amqp-5.1.1-py3-none-any.whl
asn1crypto @ file:///tmp/site-packages/asn1crypto-0.24.0-py2.py3-none-any.whl
astor @ file:///tmp/site-packages/astor-0.7.1-py2.py3-none-any.whl
AuditLatLong @ file:///tmp/site-packages/AuditLatLong-2.0.2%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
avro-python3 @ file:///tmp/site-packages/avro_python3-1.8.2-py3-none-any.whl
bcrypt @ file:///tmp/site-packages/bcrypt-3.1.3-cp38-cp38-linux_x86_64.whl
billiard @ file:///tmp/site-packages/billiard-3.6.4.0-py3-none-any.whl
bitarray @ file:///tmp/site-packages/bitarray-0.8.1-cp38-cp38-linux_x86_64.whl
BitVector @ file:///tmp/site-packages/BitVector-3.4.5-py3-none-any.whl
blis @ file:///tmp/site-packages/blis-0.4.1-cp38-cp38-manylinux1_x86_64.whl
bravado @ file:///tmp/site-packages/bravado-9.2.2-py2.py3-none-any.whl
bravado-core @ file:///tmp/site-packages/bravado_core-4.11.1-py2.py3-none-any.whl
bulk-query-manager @ file:///tmp/site-packages/bulk_query_manager-1.0.0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
catalogue @ file:///tmp/site-packages/catalogue-1.0.0-py2.py3-none-any.whl
celery @ file:///tmp/site-packages/celery-5.2.7-py3-none-any.whl
certifi @ file:///tmp/site-packages/certifi-2023.7.22-py3-none-any.whl
cffi @ file:///tmp/site-packages/cffi-1.13.0-cp38-cp38-manylinux1_x86_64.whl
chardet @ file:///tmp/site-packages/chardet-3.0.4-py2.py3-none-any.whl
charset-normalizer @ file:///tmp/site-packages/charset_normalizer-3.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
CherryPy @ file:///tmp/site-packages/CherryPy-8.1.3-py3-none-any.whl
colorama @ file:///tmp/site-packages/colorama-0.3.7-py2.py3-none-any.whl
configobj @ file:///tmp/site-packages/configobj-5.0.6-py3-none-any.whl
confluent-kafka @ file:///tmp/site-packages/confluent_kafka-1.3.0-cp38-cp38-manylinux2010_x86_64.whl
counter-checker @ file:///tmp/site-packages/counter_checker-1.0.10%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
cryptography==41.0.3
cycler @ file:///tmp/site-packages/cycler-0.10.0-py2.py3-none-any.whl
cymem @ file:///tmp/site-packages/cymem-2.0.5-cp38-cp38-manylinux2014_x86_64.whl
Cython @ file:///tmp/site-packages/Cython-0.29.24-cp38-cp38-manylinux1_x86_64.whl
dataclasses @ file:///tmp/site-packages/dataclasses-0.6-py3-none-any.whl
db-init @ file:///tmp/site-packages/db_init-0.0.4%2Bcommit.73110b012690d791287fe40c6157c37a62cba8de-py3-none-any.whl
decorator @ file:///tmp/site-packages/decorator-4.0.10-py2.py3-none-any.whl
dill @ file:///tmp/site-packages/dill-0.3.2-py3-none-any.whl
distlib @ file:///tmp/site-packages/distlib-0.3.6-py2.py3-none-any.whl
dn-tools @ file:///tmp/site-packages/dn_tools-0.0.1%2Bcommit.f0768295970ac350e9daa55f726a9aca3cab62b2-py3-none-any.whl
docopt @ file:///tmp/site-packages/docopt-0.6.2-py2.py3-none-any.whl
dtac-th @ file:///tmp/site-packages/dtac_th-1.0.0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
ecdsa @ file:///tmp/site-packages/ecdsa-0.13-py2.py3-none-any.whl
elasticsearch @ file:///tmp/site-packages/elasticsearch-5.4.0-py2.py3-none-any.whl
elasticsearch-dsl @ file:///tmp/site-packages/elasticsearch_dsl-5.3.0-py2.py3-none-any.whl
et-xmlfile @ file:///tmp/site-packages/et_xmlfile-1.0.1-py3-none-any.whl
fastai @ file:///tmp/site-packages/fastai-2.7.12-py3-none-any.whl
fastcore @ file:///tmp/site-packages/fastcore-1.5.29-py3-none-any.whl
fastdownload @ file:///tmp/site-packages/fastdownload-0.0.7-py3-none-any.whl
fastprogress @ file:///tmp/site-packages/fastprogress-1.0.0-py3-none-any.whl
funcsigs @ file:///tmp/site-packages/funcsigs-1.0.2-py2.py3-none-any.whl
furl @ file:///tmp/site-packages/furl-0.4.91-py3-none-any.whl
future @ file:///tmp/site-packages/future-0.18.3-py3-none-any.whl
gast @ file:///tmp/site-packages/gast-0.2.0-py3-none-any.whl
GDAL @ file:///tmp/site-packages/GDAL-1.11.2-cp38-cp38-linux_x86_64.whl
gevent @ file:///tmp/site-packages/gevent-1.4.0-cp38-cp38-linux_x86_64.whl
google-ggc @ file:///tmp/site-packages/google_ggc-1.0.0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
greenlet @ file:///tmp/site-packages/greenlet-0.4.15-cp38-cp38-manylinux1_x86_64.whl
grpcio @ file:///tmp/site-packages/grpcio-1.57.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
hiredis @ file:///tmp/site-packages/hiredis-0.2.0-cp38-cp38-linux_x86_64.whl
html5lib @ file:///tmp/site-packages/html5lib-1.0.1-py2.py3-none-any.whl
hvac @ file:///tmp/site-packages/hvac-0.10.8-py2.py3-none-any.whl
idna @ file:///tmp/site-packages/idna-2.8-py2.py3-none-any.whl
imbalanced-learn @ file:///tmp/site-packages/imbalanced_learn-0.8.0-py3-none-any.whl
importlib-metadata @ file:///tmp/site-packages/importlib_metadata-4.13.0-py3-none-any.whl
ipaddress @ file:///tmp/site-packages/ipaddress-1.0.18-py3-none-any.whl
jdcal @ file:///tmp/site-packages/jdcal-1.2-py3-none-any.whl
Jinja2 @ file:///tmp/site-packages/Jinja2-3.0.1-py3-none-any.whl
joblib @ file:///tmp/site-packages/joblib-1.2.0-py3-none-any.whl
jsonref @ file:///tmp/site-packages/jsonref-0.1-py3-none-any.whl
jsonschema @ file:///tmp/site-packages/jsonschema-2.6.0-py2.py3-none-any.whl
kiwisolver @ file:///tmp/site-packages/kiwisolver-1.3.1-cp38-cp38-manylinux1_x86_64.whl
kombu @ file:///tmp/site-packages/kombu-5.2.4-py3-none-any.whl
ldap3 @ file:///tmp/site-packages/ldap3-2.5.1-py3-none-any.whl
lib3gpp @ file:///tmp/site-packages/lib3gpp-1.0.0%2Bcommit.9167a807e260f730e20ee0691cdecd88ab20f226-py3-none-any.whl
lxml @ file:///tmp/site-packages/lxml-4.9.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl
lz4 @ file:///tmp/site-packages/lz4-0.8.2-cp38-cp38-linux_x86_64.whl
MapperPy @ file:///tmp/site-packages/MapperPy-0.11.1b0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
Markdown @ file:///tmp/site-packages/Markdown-3.0-py2.py3-none-any.whl
MarkupSafe @ file:///tmp/site-packages/MarkupSafe-2.0.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl
mass-install @ file:///tmp/site-packages/mass_install-1.1.1%2Bcommit.74f6738683b4de896d239e84b98159e8ffbb94c0-py2.py3-none-any.whl
MergeInMemory @ file:///tmp/site-packages/MergeInMemory-0.1%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
migrate-redis @ file:///tmp/site-packages/migrate_redis-0.0.2%2Bcommit.e975c6b84433baba00505c214a4cd150eee2714d-py3-none-any.whl
mock @ file:///tmp/site-packages/mock-2.0.0-py2.py3-none-any.whl
openpyxl @ file:///tmp/site-packages/openpyxl-2.4.8-py2.py3-none-any.whl
packaging @ file:///tmp/site-packages/packaging-20.9-py2.py3-none-any.whl
pandas @ file:///tmp/site-packages/pandas-1.1.4-cp38-cp38-manylinux1_x86_64.whl
paramiko @ file:///tmp/site-packages/paramiko-2.10.1-py2.py3-none-any.whl
passlib @ file:///tmp/site-packages/passlib-1.6.5-py2.py3-none-any.whl
pathy @ file:///tmp/site-packages/pathy-0.4.0-py3-none-any.whl
pbr @ file:///tmp/site-packages/pbr-4.2.0-py2.py3-none-any.whl
pika @ file:///tmp/site-packages/pika-1.2.0-py2.py3-none-any.whl
Pillow @ file:///tmp/site-packages/Pillow-10.0.0-cp38-cp38-manylinux_2_28_x86_64.whl
plac @ file:///tmp/site-packages/plac-1.1.3-py2.py3-none-any.whl
platformdirs @ file:///tmp/site-packages/platformdirs-2.6.2-py3-none-any.whl
ply @ file:///tmp/site-packages/ply-3.8-py2.py3-none-any.whl
polygon-lib @ file:///tmp/site-packages/polygon_lib-1.0.0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
polysimplify @ file:///tmp/site-packages/polysimplify-1.0.dev0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
preshed @ file:///tmp/site-packages/preshed-3.0.5-cp38-cp38-manylinux2014_x86_64.whl
prompt-toolkit @ file:///tmp/site-packages/prompt_toolkit-3.0.31-py3-none-any.whl
psutil @ file:///tmp/site-packages/psutil-3.4.2-cp38-cp38-linux_x86_64.whl
py2compatibility @ file:///tmp/site-packages/py2compatibility-0.99.4%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
pyasn1 @ file:///tmp/site-packages/pyasn1-0.4.4-py2.py3-none-any.whl
pycparser @ file:///tmp/site-packages/pycparser-2.18-py2.py3-none-any.whl
pycrypto @ file:///tmp/site-packages/pycrypto-2.6.1-cp38-cp38-linux_x86_64.whl
pycryptodome @ file:///tmp/site-packages/pycryptodome-3.9.1-cp38-cp38-manylinux1_x86_64.whl
pydantic @ file:///tmp/site-packages/pydantic-1.10.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
PyExcelerate @ file:///tmp/site-packages/PyExcelerate-0.7.1-py3-none-any.whl
PyJWT @ file:///tmp/site-packages/PyJWT-1.4.0-py2.py3-none-any.whl
pyke @ file:///tmp/site-packages/pyke-1.1.1%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
PyMySQL @ file:///tmp/site-packages/PyMySQL-1.0.2-py3-none-any.whl
PyNaCl==1.2.1
pyparsing @ file:///tmp/site-packages/pyparsing-2.4.7-py2.py3-none-any.whl
pysendfile @ file:///tmp/site-packages/pysendfile-2.0.1-cp38-cp38-linux_x86_64.whl
pysmi @ file:///tmp/site-packages/pysmi-0.0.7-py2.py3-none-any.whl
pysnmp @ file:///tmp/site-packages/pysnmp-4.3.10-py2.py3-none-any.whl
python-dateutil @ file:///tmp/site-packages/python_dateutil-2.7.3-py2.py3-none-any.whl
pytz @ file:///tmp/site-packages/pytz-2022.2.1-py2.py3-none-any.whl
PyYAML @ file:///tmp/site-packages/PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl
redis @ file:///tmp/site-packages/redis-2.10.5-py2.py3-none-any.whl
redislib @ file:///tmp/site-packages/redislib-1.0.0%2Bcommit.dd9dc40a9bfcac8b65ea63d5e1c95d0c8f4dd36b-py3-none-any.whl
requests @ file:///tmp/site-packages/requests-2.31.0-py3-none-any.whl
retrying @ file:///tmp/site-packages/retrying-1.3.3-py3-none-any.whl
rfc3987 @ file:///tmp/site-packages/rfc3987-1.3.7-py2.py3-none-any.whl
schedule @ file:///tmp/site-packages/schedule-0.3.2-py3-none-any.whl
scikit-learn @ file:///tmp/site-packages/scikit_learn-1.0.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
scipy @ file:///tmp/site-packages/scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Shapely @ file:///tmp/site-packages/Shapely-1.8.1.post1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
shortuuid==1.0.11
simplejson @ file:///tmp/site-packages/simplejson-3.8.2-cp38-cp38-linux_x86_64.whl
six @ file:///tmp/site-packages/six-1.11.0-py2.py3-none-any.whl
spacy @ file:///tmp/site-packages/spacy-2.3.2-cp38-cp38-manylinux1_x86_64.whl
spacy-legacy @ file:///tmp/site-packages/spacy_legacy-3.0.1-py2.py3-none-any.whl
SQLAlchemy @ file:///tmp/site-packages/SQLAlchemy-1.3.1-cp38-cp38-linux_x86_64.whl
srsly @ file:///tmp/site-packages/srsly-1.0.5-cp38-cp38-manylinux2014_x86_64.whl
ssh2-python @ file:///tmp/site-packages/ssh2_python-0.9.1-cp38-cp38-linux_x86_64.whl
stomp.py @ file:///tmp/site-packages/stomp.py-4.1.11-py3-none-any.whl
strict-rfc3339 @ file:///tmp/site-packages/strict_rfc3339-0.7-py3-none-any.whl
support-tools @ file:///tmp/site-packages/support_tools-1.0.0%2Bcommit.8d83cf3505733a5972c7c3e5ad9742026f3cf6e9-py3-none-any.whl
swagger-spec-validator @ file:///tmp/site-packages/swagger_spec_validator-2.0.1-py3-none-any.whl
sympy @ file:///tmp/site-packages/sympy-1.11.1-py3-none-any.whl
tag-hg @ file:///tmp/site-packages/tag_hg-1.0.0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
thinc @ file:///tmp/site-packages/thinc-7.4.1-cp38-cp38-manylinux1_x86_64.whl
threadpoolctl @ file:///tmp/site-packages/threadpoolctl-2.1.0-py3-none-any.whl
torch @ file:///tmp/site-packages/torch-2.0.0%2Bcpu-cp38-cp38-linux_x86_64.whl
torchvision @ file:///tmp/site-packages/torchvision-0.15.1-cp38-cp38-manylinux1_x86_64.whl
tqdm @ file:///tmp/site-packages/tqdm-4.59.0-py2.py3-none-any.whl
typer @ file:///tmp/site-packages/typer-0.6.1-py3-none-any.whl
typing @ file:///tmp/site-packages/typing-3.6.2-py3-none-any.whl
typing_extensions @ file:///tmp/site-packages/typing_extensions-4.4.0-py3-none-any.whl
tzlocal @ file:///tmp/site-packages/tzlocal-1.4-py3-none-any.whl
umysql3 @ file:///tmp/site-packages/umysql3-0.2-cp38-cp38-linux_x86_64.whl
urllib3 @ file:///tmp/site-packages/urllib3-1.26.5-py2.py3-none-any.whl
uWSGI @ file:///tmp/site-packages/uWSGI-2.0.19.1-cp38-cp38-linux_x86_64.whl
uwsgi-utils @ file:///tmp/site-packages/uwsgi_utils-1.0.0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
uwsgitop @ file:///tmp/site-packages/uwsgitop-0.9-py3-none-any.whl
validators @ file:///tmp/site-packages/validators-1.0.0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
viavi-integration @ file:///tmp/site-packages/viavi_integration-1.0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
vine @ file:///tmp/site-packages/vine-5.0.0-py2.py3-none-any.whl
virtualenv @ file:///tmp/site-packages/virtualenv-20.17.1-py3-none-any.whl
wasabi @ file:///tmp/site-packages/wasabi-0.8.2-py3-none-any.whl
wcwidth @ file:///tmp/site-packages/wcwidth-0.2.5-py2.py3-none-any.whl
webcolors @ file:///tmp/site-packages/webcolors-1.5-py3-none-any.whl
webencodings @ file:///tmp/site-packages/webencodings-0.5.1-py2.py3-none-any.whl
Werkzeug @ file:///tmp/site-packages/Werkzeug-0.14.1-py2.py3-none-any.whl
xgboost @ file:///tmp/site-packages/xgboost-0.82-py2.py3-none-manylinux1_x86_64.whl
xlrd @ file:///tmp/site-packages/xlrd-1.2.0-py2.py3-none-any.whl
XlsxWriter @ file:///tmp/site-packages/XlsxWriter-0.8.4-py2.py3-none-any.whl
xxhash @ file:///tmp/site-packages/xxhash-1.0.1-cp38-cp38-linux_x86_64.whl
zain @ file:///tmp/site-packages/zain-1.0.0%2Bcommit.3bbde1410e72feb9751a8ee93cab9f066ccc3844-py3-none-any.whl
zipp @ file:///tmp/site-packages/zipp-3.4.1-py3-none-any.whl

Other Dependencies

N/A

Minimally Reproducible Test Case


attach-daemon2 = reloadsignal=1,stopsignal=3,control=1,cmd=/bin/celery -A <worker_module> worker -Q gen_queue --pool=gevent -Ofair --loglevel=info --concurrency=3 --heartbeat-interval 60 -n celery@%n

Expected Behavior

task should be recieved without error

Actual Behavior

[2023-11-28 05:55:25,628: WARNING/MainProcess] ImportError
[2023-11-28 05:55:25,628: WARNING/MainProcess] :
[2023-11-28 05:55:25,628: WARNING/MainProcess] libffi-0ff6ce5e.so.6.0.4: cannot open shared object file: No such file or directory
thread '<unnamed>' panicked at 'Python API call failed', /github/home/.cargo/registry/src/index.crates.io-6f17d22bba15001f/pyo3-0.18.3/src/err/mod.rs:790:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
[2023-11-28 05:55:25,634: WARNING/MainProcess] Traceback (most recent call last):
[2023-11-28 05:55:25,634: WARNING/MainProcess]   File "/lib/python3.8/site-packages/celery/concurrency/base.py", line 29, in apply_target
    ret = target(*args, **kwargs)
[2023-11-28 05:55:25,634: WARNING/MainProcess]   File "/lib/python3.8/site-packages/celery/app/trace.py", line 649, in fast_trace_task
    R, I, T, Rstr = tasks[task].__trace__(
[2023-11-28 05:55:25,634: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/app/trace.py", line 441, in trace_task
    task.backend.store_result(
[2023-11-28 05:55:25,634: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/base.py", line 528, in store_result
    self._store_result(task_id, result, state, traceback,
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/__init__.py", line 47, in _inner
    return fun(*args, **kwargs)
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/__init__.py", line 115, in _store_result
    session = self.ResultSession()
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/__init__.py", line 106, in ResultSession
    return session_manager.session_factory(
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/session.py", line 87, in session_factory
    engine, session = self.create_session(dburi, **kwargs)
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/session.py", line 56, in create_session
    engine = self.get_engine(dburi, **kwargs)
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/session.py", line 53, in get_engine
    return create_engine(dburi, poolclass=NullPool, **kwargs)
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/sqlalchemy/engine/__init__.py", line 423, in create_engine
    return strategy.create(*args, **kwargs)
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/sqlalchemy/engine/strategies.py", line 87, in create
    dbapi = dialect_cls.dbapi(**dbapi_args)
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/sqlalchemy/dialects/mysql/pymysql.py", line 62, in dbapi
    return __import__("pymysql")
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/pymysql/__init__.py", line 59, in <module>
    from . import connections  # noqa: E402
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/pymysql/connections.py", line 13, in <module>
    from . import _auth
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/pymysql/_auth.py", line 9, in <module>
    from cryptography.hazmat.primitives import serialization, hashes
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/cryptography/hazmat/primitives/serialization/__init__.py", line 7, in <module>
    from cryptography.hazmat.primitives._serialization import (
[2023-11-28 05:55:25,635: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/cryptography/hazmat/primitives/_serialization.py", line 11, in <module>
    from cryptography.hazmat.primitives.hashes import HashAlgorithm
[2023-11-28 05:55:25,636: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/cryptography/hazmat/primitives/hashes.py", line 10, in <module>
    from cryptography.hazmat.bindings._rust import openssl as rust_openssl
[2023-11-28 05:55:25,636: WARNING/MainProcess] pyo3_runtime.PanicException: Python API call failed
[2023-11-28 05:55:25,636: WARNING/MainProcess]
During handling of the above exception, another exception occurred:
[2023-11-28 05:55:25,636: WARNING/MainProcess] Traceback (most recent call last):
[2023-11-28 05:55:25,636: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/concurrency/base.py", line 38, in apply_target
    reraise(WorkerLostError, WorkerLostError(repr(exc)),
[2023-11-28 05:55:25,636: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/exceptions.py", line 108, in reraise
    raise value.with_traceback(tb)
[2023-11-28 05:55:25,636: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/concurrency/base.py", line 29, in apply_target
    ret = target(*args, **kwargs)
[2023-11-28 05:55:25,636: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/app/trace.py", line 649, in fast_trace_task
    R, I, T, Rstr = tasks[task].__trace__(
[2023-11-28 05:55:25,636: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/app/trace.py", line 441, in trace_task
    task.backend.store_result(
[2023-11-28 05:55:25,636: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/base.py", line 528, in store_result
    self._store_result(task_id, result, state, traceback,
[2023-11-28 05:55:25,636: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/__init__.py", line 47, in _inner
    return fun(*args, **kwargs)
[2023-11-28 05:55:25,636: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/__init__.py", line 115, in _store_result
    session = self.ResultSession()
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/__init__.py", line 106, in ResultSession
    return session_manager.session_factory(
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/session.py", line 87, in session_factory
    engine, session = self.create_session(dburi, **kwargs)
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/session.py", line 56, in create_session
    engine = self.get_engine(dburi, **kwargs)
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/backends/database/session.py", line 53, in get_engine
    return create_engine(dburi, poolclass=NullPool, **kwargs)
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/sqlalchemy/engine/__init__.py", line 423, in create_engine
    return strategy.create(*args, **kwargs)
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/sqlalchemy/engine/strategies.py", line 87, in create
    dbapi = dialect_cls.dbapi(**dbapi_args)
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/sqlalchemy/dialects/mysql/pymysql.py", line 62, in dbapi
    return __import__("pymysql")
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/pymysql/__init__.py", line 59, in <module>
    from . import connections  # noqa: E402
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/pymysql/connections.py", line 13, in <module>
    from . import _auth
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/pymysql/_auth.py", line 9, in <module>
    from cryptography.hazmat.primitives import serialization, hashes
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/cryptography/hazmat/primitives/serialization/__init__.py", line 7, in <module>
    from cryptography.hazmat.primitives._serialization import (
[2023-11-28 05:55:25,637: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/cryptography/hazmat/primitives/_serialization.py", line 11, in <module>
    from cryptography.hazmat.primitives.hashes import HashAlgorithm
[2023-11-28 05:55:25,638: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/cryptography/hazmat/primitives/hashes.py", line 10, in <module>
    from cryptography.hazmat.bindings._rust import openssl as rust_openssl
[2023-11-28 05:55:25,638: WARNING/MainProcess] billiard.exceptions.WorkerLostError: PanicException('Python API call failed')
[2023-11-28 05:55:25,638: WARNING/MainProcess]
During handling of the above exception, another exception occurred:
[2023-11-28 05:55:25,638: WARNING/MainProcess] Traceback (most recent call last):
[2023-11-28 05:55:25,638: WARNING/MainProcess]   File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run
[2023-11-28 05:55:25,638: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/concurrency/base.py", line 41, in apply_target
    callback(ExceptionInfo())
[2023-11-28 05:55:25,638: WARNING/MainProcess]   File "  /lib/python3.8/site-packages/celery/worker/request.py", line 725, in on_success
    failed, retval, runtime = failed__retval__runtime
[2023-11-28 05:55:25,638: WARNING/MainProcess] TypeError: cannot unpack non-iterable ExceptionInfo object
[2023-11-28 05:55:25,638: WARNING/MainProcess] 2023-11-28T05:55:25Z
[2023-11-28 05:55:25,638: WARNING/MainProcess]
[2023-11-28 05:55:25,638: WARNING/MainProcess] <Greenlet at 0x7f041c680d00: apply_target(<function fast_trace_task at 0x7f04243e9280>, ('module_execution_lib.custom_io_distributed_task., {}, <bound method create_request_cls.<locals>.Request., <bound method Request.on_accepted of <Request: mod, timeout=None, timeout_callback=<bound method Request.on_timeout of <Request: modu)> failed with TypeError
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Issue Type: Bug Report
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@karthikkj172