Hello! I was curious if there’s an idiomatic Guild way to run a batch of runs that are dependent on a batch of prior runs. To be concrete, suppose I run a batch of train runs. Also suppose I have an evaluation operation called eval_op that requires a train run (so the model checkpoint can be loaded…

The original syntax you specified is correct. In that case Guild will run eval_op once for each specified run ID. The only issue I see there is the use of spaces within the square brackets. Something like this will do what you want, where the entries for the train flag list value are run IDs, or pa…

Ah! I bet I did put a space. I’ll try again next time. I did end up instead using the queue solution combined with staging as you described. Thank you!

If you want to include spaces, just quote the argument: guild run eval_op train='[abc, def, ...]'

Batch eval runs over batch train runs via required resource?

General

ghwatson February 3, 2021, 10:56pm 2

Ah to answer my own question here, I missed the batch file capability when going thru the docs: Runs

Topic		Replies	Views
Runs Concepts	0	7507	June 7, 2020
Command: run Commands	0	5229	June 11, 2020
Commands Cheatsheet Cheatsheets	0	1524	June 19, 2020
Running cases in parallel General	1	1034	September 10, 2020
Restarting multiple runs General	9	1531	July 28, 2020

Batch eval runs over batch train runs via required resource?

Related topics