Sam Hames

Now with RSS!

python - Luigi not picking up next task to run, bunch of pending tasks left, no failed tasks - Stack Overflow

https://stackoverflow.com/questions/48567122/luigi-not-picking-up-next-task-to-run-bunch-of-pending-tasks-left-no-failed-ta?rq=1

I was wondering if there was a way to programmatically set resource maximums, outside of settings in the config file for the scheduler. It looks like there is :)

"Passing a resource parameter of {"cpu_cores": 10} solved my issue."

Tags

Related By Tags

Details

Revised
Created
Edited