{ "version": "https://jsonfeed.org/version/1", "title": "Celery", "description": "", "home_page_url": "go/celery", "feed_url": "feed/celery.json", "icon": "https://cdn.v2ex.com/navatar/a49e/9411/434_large.png?m=1331890439", "favicon": "https://cdn.v2ex.com/navatar/a49e/9411/434_normal.png?m=1331890439", "items": [ { "author": { "url": "member/dearmymy", "name": "dearmymy", "avatar": "https://cdn.v2ex.com/gravatar/db518e469d91f54ee805c2069e84e819?s=73&d=retro" }, "url": "t/872514", "title": "\u8bf7\u6559\u5982\u679c celery \u4efb\u52a1\u5df2\u7ecf\u5728\u8fdb\u884c\u4e2d\uff0c\u8fd8\u80fd\u5982\u4f55\u8ddf\u7528\u6237\u4ea4\u4e92\u4e48", "id": "t/872514", "date_published": "2022-08-12T12:27:04+00:00", "content_html": "

\u672c\u6765\u4e00\u4e2a\u8017\u65f6\u4efb\u52a1\u7528 celery \u5b8c\u6210\u3002\n\u73b0\u5728\u4e00\u4e2a\u9700\u6c42\uff0c\u6267\u884c\u4e00\u534a\u65f6\u5019\uff0c\u9700\u8981\u7528\u6237\u8f93\u5165\u4e00\u4e2a\u9a8c\u8bc1\u7801\uff0c\u7136\u540e celery \u7ee7\u7eed\u6267\u884c\u3002\n\u6709\u4ec0\u4e48\u4f18\u96c5\u65b9\u5f0f\u5b9e\u73b0\u4e48\u3002\n\u73b0\u5728\u662f\u524d\u7aef\u904d\u5386 celery \u72b6\u6001\uff0c\u53d1\u73b0\u9700\u8981\u8f93\u5165\u65f6\u5019\uff0c\u5199\u5165\u6570\u636e\u5e93\uff0ccelery \u90a3\u8fb9\u904d\u5386\u6570\u636e\u5e93\u3002

\n" }, { "author": { "url": "member/longmeier90", "name": "longmeier90", "avatar": "https://cdn.v2ex.com/gravatar/8dbc4123e8644a41d1409ad8dd0d0b35?s=73&d=retro" }, "url": "t/862394", "title": "\u8bf7\u6559\u4e00\u4e2a celery \u7684 worker \u8fdb\u7a0b\u8d8a\u6765\u8d8a\u591a\u7684\u95ee\u9898", "id": "t/862394", "date_published": "2022-06-27T01:43:24+00:00", "content_html": "

\u6211\u7528 django \u9879\u76ee \u914d\u7f6e\u4e86 celery \uff0c\u56e0\u4e3a 16 \u4e2a\u961f\u5217\uff0c\u8d77\u4e86 6 \u4e2a worker \u53bb\u6d88\u8017\u3002\u4f46\u662f\u6211\u53d1\u73b0 celery \u7684 worker \u6570\u91cf\u4f1a\u4e00\u76f4\u81ea\u52a8\u589e\u52a0\uff0c\u4e0d\u77e5\u9053\u662f\u4e3a\u4ec0\u4e48\uff0c\u66f4\u8981\u547d\u7684\u662f\u5185\u5b58\u5360\u7528\u633a\u5927\u7684\u3002\u670d\u52a1\u5668\u90fd\u62a5\u8b66\u4e86\uff0c\u6211\u628a celery-worker \u8fdb\u7a0b\u7ed3\u675f\u6389\uff0c\u5185\u5b58\u5c31\u4f1a\u964d\u4e0b\u6765\u3002celery-worker \u6211\u662f\u7528 supervisor \u53bb\u542f\u52a8\u7684\u3002

django/celery-config \u6587\u4ef6\u914d\u7f6e

worker_cOncurrency= 6\nceleryd_cOncurrency= 6\n# \u6bcf\u4e2a worker \u6700\u591a\u6267\u884c 10KB \u4efb\u52a1\u88ab\u9500\u6bc1\uff0c \u53ef\u4ee5\u9632\u6b62\u5185\u5b58\u6cc4\u9732\nworker_max_tasks_per_child = 40\n# \u5355\u4e2a\u4efb\u52a1\u7684\u6700\u5927\u8fd0\u884c\u65f6\u95f4\ntask_time_limit = 30 * 60\n\n

supervisord/celry.ini

\ndirectory=/data/code/prd/bolin/src\ncommand=/data/code/prd/bolin/env/bin/celery -A config worker --cOncurrency=6 -l INFO\nuser=pyer\nautostart=true\nautorestart=true\nstopsignal=QUIT\nstopwaitsecs=60\nstopasgroup=true\nkillasgroup=true\n

\n" }, { "author": { "url": "member/dreamTa", "name": "dreamTa", "avatar": "https://cdn.v2ex.com/gravatar/e10722221641192f489241d1d4f8f64c?s=73&d=retro" }, "url": "t/775674", "title": "Celery \u7684\u8be1\u5f02\u95ee\u9898\uff0c\u8bf7\u5927\u4f6c\u4eec\u770b\u770b", "id": "t/775674", "date_published": "2021-05-08T08:14:29+00:00", "content_html": "

\u9879\u76ee\u91c7\u7528 django \uff08 v2.1.7 \uff09\u5f00\u53d1\uff0c\u7528\u4e86 django-celery(v3.3.1)\u505a\u5f02\u6b65

celery \u914d\u7f6e\u5982\u4e0b

import djcelery\n\ndjcelery.setup_loader()\n\nBROKER_URL = 'redis://localhost/3'\nCELERY_RESULT_BACKEND = 'redis://localhost/4'\n\nCELERY_ENABLE_UTC = False\n\nCELERYD_COnCURRENCY= 20\nCELERYD_MAX_TASKS_PER_CHILD = 4\n\nCELERYBEAT_SCHEDULER = 'djcelery.schedulers.DatabaseScheduler'\n

\u5728\u6267\u884c\u5f02\u6b65\u4efb\u52a1\u7684\u8fc7\u7a0b\u4e2d\uff0c\u5076\u5c14\u4f1a\u51fa\u73b0\u4efb\u52a1\u5361\u4f4f\u7684\u60c5\u51b5\uff0c\u5177\u4f53\u8868\u73b0\u662f\u4efb\u52a1\u5e76\u6ca1\u6709\u6267\u884c\uff0c\u4f46\u4efb\u52a1\u5728\u4e00\u4e2a\u5c0f\u65f6\u540e\u5c31\u4f1a\u518d\u6b21\u81ea\u52a8\u6267\u884c\uff0c\u7b49\u4e8e\u662f\u5361\u6574\u6574\u4e00\u4e2a\u5c0f\u65f6

\u5361\u4efb\u52a1\u7684\u60c5\u51b5\u5076\u7136\u51fa\u73b0\uff0c\u4e0d\u89c4\u5f8b

\u5f53\u4efb\u52a1\u5361\u4f4f\u7684\u65f6\u5019\uff0c\u670d\u52a1\u5668\u4e0a\u540c\u65f6\u8fd0\u884c\u7684\u4efb\u52a1\u5e76\u4e0d\u591a\uff0c\u5c11\u4e8e 4 \u4e2a\uff0c\u518d\u6b21\u8fd0\u884c\u4efb\u52a1\u5c31\u80fd\u6b63\u5e38\u6267\u884c\uff0c\u67e5\u4e86\u597d\u4e45\u4e0d\u77e5\u9053\u54ea\u91cc\u7684\u95ee\u9898\uff0c\u6709\u6ca1\u6709\u5927\u4f6c\u53ef\u4ee5\u8bf4\u8bf4\u6392\u67e5\u601d\u8def\uff1f\u6216\u8005\u662f\u9047\u5230\u8fc7\u7c7b\u4f3c\u7684\u95ee\u9898\uff1f