浏览代码

Smaller batches on Heroku

microtasks
tech234a 3 年前
父节点
当前提交
e8935a6da1
共有 1 个文件被更改,包括 11 次插入1 次删除
  1. +11
    -1
      worker.py

+ 11
- 1
worker.py 查看文件

@@ -22,9 +22,19 @@ from export import subprrun

batchcontent = []

HEROKU = False
if isfile("../Procfile"):
HEROKU = True

def batchfunc():
ydl = YoutubeDL({"extract_flat": "in_playlist", "simulate": True, "skip_download": True, "quiet": True, "cookiefile": "cookies.txt", "source_address": "0.0.0.0", "call_home": False})
while jobs.qsize() < 251:
if not HEROKU:
desqsize = 51
elif HEROKU:
desqsize = 251
while jobs.qsize() < desqsize:
desit = tracker.request_item_from_tracker()
if desit:
if desit.split(":", 1)[0] == "video":


正在加载...
取消
保存