# Latest **URL:** https://guildai.org/latest.md [Latest](https://guildai.org/latest.md) · [Categories](https://guildai.org/categories.md) --- ## [This site is deprecated - please use GitHub](https://guildai.org/t/this-site-is-deprecated-please-use-github/1081)
**Author:** [@garrett](https://guildai.org/u/garrett)\ **Replies:** 0\ **Last updated:** [July 18, 2024, 7:47pm UTC](https://guildai.org/t/this-site-is-deprecated-please-use-github/1081 "2024-07-18T19:47:24Z")
We are moving out support systems over to GitHub. This site will be place on read-only mode to maintain references for search. If you have issues or questions, please open an issues at: Issues · guildai/guildai · GitHu… --- ## [How do you use GuildAI with Slurm/remote jobs?](https://guildai.org/t/how-do-you-use-guildai-with-slurm-remote-jobs/673)
**Author:** [@jan\_r](https://guildai.org/u/jan_r)\ **Replies:** 9\ **Last updated:** [June 23, 2024, 6:26pm UTC](https://guildai.org/t/how-do-you-use-guildai-with-slurm-remote-jobs/673 "2024-06-23T18:26:22Z")
Hi, I am contemplating of switching from a custom build experiment tracking system to Guild but I am unsure if it’s worth it. I run all my experiments on a remote slurm cluster. Right now, I create a new folder for eac… --- ## [Flags.yml already exists, skipping copy](https://guildai.org/t/flags-yml-already-exists-skipping-copy/1072)
**Author:** [@Epinephrine](https://guildai.org/u/Epinephrine)\ **Replies:** 1\ **Last updated:** [June 18, 2024, 7:53pm UTC](https://guildai.org/t/flags-yml-already-exists-skipping-copy/1072 "2024-06-18T19:53:44Z")
I’m trying to do some hyperparam tuning through guild. I want a single command to be able to trigger hyperparameter tuning, and then mark the best run, then call the full train function. I’m doing this via a subprocess.… --- ## [Reducing storage size of guild runs](https://guildai.org/t/reducing-storage-size-of-guild-runs/1078)
**Author:** [@hjenne](https://guildai.org/u/hjenne)\ **Replies:** 1\ **Last updated:** [June 18, 2024, 7:49pm UTC](https://guildai.org/t/reducing-storage-size-of-guild-runs/1078 "2024-06-18T19:49:39Z")
Hi everyone! I’m fairly new to Guild and I’m trying to reduce the amount of space all of the run directories are using. In the run directory, in my results folders I see “chkpt.pt” files that are about 50 MB. Can I delet… --- ## [How do I contribute to Guild Documentation?](https://guildai.org/t/how-do-i-contribute-to-guild-documentation/1066)
**Author:** [@douwmarx](https://guildai.org/u/douwmarx)\ **Replies:** 1\ **Last updated:** [June 18, 2024, 7:40pm UTC](https://guildai.org/t/how-do-i-contribute-to-guild-documentation/1066 "2024-06-18T19:40:40Z")
How do I send a pull request with a proposed change to the Guild documentation? I think there might be an error here: https://guildai.org/t/get-started-use-guild-in-a-project/203: guild purge --started "before 30 days … --- ## [Guild Stage-Trials Rerun on Error](https://guildai.org/t/guild-stage-trials-rerun-on-error/1069)
**Author:** [@ratheile](https://guildai.org/u/ratheile)\ **Replies:** 1\ **Last updated:** [June 18, 2024, 7:17pm UTC](https://guildai.org/t/guild-stage-trials-rerun-on-error/1069 "2024-06-18T19:17:02Z")
For my academic project, I use guild.ai as a lightweight job scheduler on our GPU cluster node. Following some of the tutorials on my.guild.ai, I am currently using several queues to split tasks to different GPUs on the… --- ## [Reducing duplication in fully specified guild.yml files](https://guildai.org/t/reducing-duplication-in-fully-specified-guild-yml-files/1062)
**Author:** [@Alessandro](https://guildai.org/u/Alessandro)\ **Replies:** 1\ **Last updated:** [June 18, 2024, 6:50pm UTC](https://guildai.org/t/reducing-duplication-in-fully-specified-guild-yml-files/1062 "2024-06-18T18:50:54Z")
Hi there! Is it possible to move common attributes of different operations upwards? For example, given the existing two operations for model - model: model operations: train: exec: python module/trainer.py… --- ## [Guild.ai x Lightning CLI](https://guildai.org/t/guild-ai-x-lightning-cli/1057)
**Author:** [@Alessandro](https://guildai.org/u/Alessandro)\ **Replies:** 6\ **Last updated:** [April 4, 2024, 1:31pm UTC](https://guildai.org/t/guild-ai-x-lightning-cli/1057 "2024-04-04T13:31:26Z")
(PyTorch) Lightning has moved on to a more sophisticated CLI based on argparse (Configure hyperparameters from the CLI — PyTorch Lightning 2.1.2 documentation) and I’m facing some troubles combining both. I was able to … --- ## [Combine argparse and config files](https://guildai.org/t/combine-argparse-and-config-files/747)
**Author:** [@copah](https://guildai.org/u/copah)\ **Replies:** 7\ **Last updated:** [February 27, 2024, 7:28pm UTC](https://guildai.org/t/combine-argparse-and-config-files/747 "2024-02-27T19:28:47Z")
Is it possible to combine flags from the argparse interface and config files? Consider this pseudo example: Project structure: guild\_combine\_argparse\_config\_files/ ├── guild.yml ├── model\_flags.yml └── train.py # tra… --- ## [Guild runs command is slow](https://guildai.org/t/guild-runs-command-is-slow/1063)
**Author:** [@Alessandro](https://guildai.org/u/Alessandro)\ **Replies:** 0\ **Last updated:** [February 16, 2024, 12:12pm UTC](https://guildai.org/t/guild-runs-command-is-slow/1063 "2024-02-16T12:12:17Z")
Hi there, in contrast to the other topics I’m talking about the CLI command guild runs. The problem I’m frequently encountering is that running anything related to guild runs, e.g. guild view, or guild compare is… ofte… --- ## [Multi-Objective Optimisation](https://guildai.org/t/multi-objective-optimisation/1056)
**Author:** [@jlsachse](https://guildai.org/u/jlsachse)\ **Replies:** 1\ **Last updated:** [November 15, 2023, 11:19pm UTC](https://guildai.org/t/multi-objective-optimisation/1056 "2023-11-15T23:19:25Z")
Hi @garrett, I’ve created a quick and dirty implementation for optimisation with Optuna based on your TPE example. It works fine, but I’m forced to set the objectives and their directions with custom flags when optimis… --- ## [WinError 1314 when trying to do a grid search](https://guildai.org/t/winerror-1314-when-trying-to-do-a-grid-search/800)
**Author:** [@spiderlingjr](https://guildai.org/u/spiderlingjr)\ **Replies:** 3\ **Last updated:** [November 10, 2023, 9:24pm UTC](https://guildai.org/t/winerror-1314-when-trying-to-do-a-grid-search/800 "2023-11-10T21:24:09Z")
Hi, I’m having trouble when trying to do a search with guild on a Windows 10 machine. I took the example code fromt the tutorial import numpy as np # Hyperparameters x = 0.1 noise = 0.1 # Simulated training loss los… --- ## [Guild interfering with distributed resource allocation (pytorch-lightning/ray-tune](https://guildai.org/t/guild-interfering-with-distributed-resource-allocation-pytorch-lightning-ray-tune/1050)
**Author:** [@davzaman](https://guildai.org/u/davzaman)\ **Replies:** 6\ **Last updated:** [July 6, 2023, 3:04am UTC](https://guildai.org/t/guild-interfering-with-distributed-resource-allocation-pytorch-lightning-ray-tune/1050 "2023-07-06T03:04:16Z")
I am using both pytorch-lightning (2.0.3) and ray-tune (2.4.0) on Python 3.9.15 for tuning a ML model. The tuning procedure can be found here. Essentially I am using the new ray LightningTrainer interface alongside the… --- ## [Seeking Access to Training Data for Research Purposes](https://guildai.org/t/seeking-access-to-training-data-for-research-purposes/1049)
**Author:** [@lorenasimedo](https://guildai.org/u/lorenasimedo)\ **Replies:** 2\ **Last updated:** [June 14, 2023, 6:35pm UTC](https://guildai.org/t/seeking-access-to-training-data-for-research-purposes/1049 "2023-06-14T18:35:27Z")
Hey everyone, I am a Master’s student from Concordia University, and I am currently conducting research using some open-source projects, including guildai/guildai. I am writing to inquire if there might be a way for me… --- ## [How to avoid copying source code for each run](https://guildai.org/t/how-to-avoid-copying-source-code-for-each-run/1044)
**Author:** [@kyika](https://guildai.org/u/kyika)\ **Replies:** 2\ **Last updated:** [June 13, 2023, 9:30pm UTC](https://guildai.org/t/how-to-avoid-copying-source-code-for-each-run/1044 "2023-06-13T21:30:02Z")
Dear Garrett and other developers, I would like to know if there is a way to avoid copying the source code for each guild run I executed. I need this since I am running tens of thousands of guild runs, each executing t… --- ## [Assigning runs to GPUs](https://guildai.org/t/assigning-runs-to-gpus/1038)
**Author:** [@imani](https://guildai.org/u/imani)\ **Replies:** 4\ **Last updated:** [June 12, 2023, 8:40pm UTC](https://guildai.org/t/assigning-runs-to-gpus/1038 "2023-06-12T20:40:49Z")
I am working on a system with 3 GPUs. I have a set of 14 runs that I want to queue up. I want to assign each run to a single GPU, so that at any given time, there are only 3 runs active, and once a GPU has finished proc… --- ## [Logging non-numeric output variables](https://guildai.org/t/logging-non-numeric-output-variables/262)
**Author:** [@emgong](https://guildai.org/u/emgong)\ **Replies:** 12\ **Last updated:** [June 5, 2023, 2:49pm UTC](https://guildai.org/t/logging-non-numeric-output-variables/262 "2023-06-05T14:49:41Z")
Hi, Any plans on adding support for (\\key): (\\value) output variables which are not necessarily numeric? --- ## [Pipenv compatibility in 0.9.0](https://guildai.org/t/pipenv-compatibility-in-0-9-0/1035)
**Author:** [@neelavd](https://guildai.org/u/neelavd)\ **Replies:** 2\ **Last updated:** [May 24, 2023, 1:45am UTC](https://guildai.org/t/pipenv-compatibility-in-0-9-0/1035 "2023-05-24T01:45:42Z")
I’ve had some unexpected behavior using pipenv in 0.9.0 versus 0.8.2 - using guild check yields the following: in 0.9.0 ➤ pipenv run guild check guild\_version: 0.9.0 guild\_install\_location: /home/neelav… --- ## [How to require multiple files from the same directory in guild.yml?](https://guildai.org/t/how-to-require-multiple-files-from-the-same-directory-in-guild-yml/991)
**Author:** [@guildedkage](https://guildai.org/u/guildedkage)\ **Replies:** 5\ **Last updated:** [May 3, 2023, 7:38pm UTC](https://guildai.org/t/how-to-require-multiple-files-from-the-same-directory-in-guild-yml/991 "2023-05-03T19:38:41Z")
I want to call something like data/\* under required files. Is this possible? Basically, I have different datasets as parameters to my problem that I call via flags. Listing each dataset by name is not robust. Can I requ… --- ## [Confusion on multistep operations, restarting substeps, and copied files?](https://guildai.org/t/confusion-on-multistep-operations-restarting-substeps-and-copied-files/998)
**Author:** [@davzaman](https://guildai.org/u/davzaman)\ **Replies:** 7\ **Last updated:** [May 2, 2023, 6:18pm UTC](https://guildai.org/t/confusion-on-multistep-operations-restarting-substeps-and-copied-files/998 "2023-05-02T18:18:24Z")
I have a guild operation main that runs 3 steps which are other operations: impute, evaluate, and predict. The latter two require on the impute operation (specifically a model checkpoint and some data output). (guild.ym… --- ## [Guild File Reference](https://guildai.org/t/guild-file-reference/197)
**Author:** [@guildai](https://guildai.org/u/guildai)\ **Replies:** 0\ **Last updated:** [June 21, 2020, 4:10pm UTC](https://guildai.org/t/guild-file-reference/197 "2020-06-21T16:10:10Z")
Guild File Format Guild files are named guild.yml. They contain Guild AI related project configuration. This document describes their format and schema. Guild files are plain text, YAML formatted files. Guild files … --- ## [Specifying different target types for the same operation](https://guildai.org/t/specifying-different-target-types-for-the-same-operation/761)
**Author:** [@travis51](https://guildai.org/u/travis51)\ **Replies:** 2\ **Last updated:** [April 12, 2023, 6:46am UTC](https://guildai.org/t/specifying-different-target-types-for-the-same-operation/761 "2023-04-12T06:46:33Z")
I am trying to link and copy different files from the same operation resource in my guild stage. It seems that specifying an operation multiple times only results in the last operation being used. Here is an example th… --- ## [Excecute runs in sequential order](https://guildai.org/t/excecute-runs-in-sequential-order/992)
**Author:** [@bbach63](https://guildai.org/u/bbach63)\ **Replies:** 2\ **Last updated:** [March 25, 2023, 11:00am UTC](https://guildai.org/t/excecute-runs-in-sequential-order/992 "2023-03-25T11:00:16Z")
I would like to prevent all runs in a grid search running in parallel. The only way I found is to use staged runs and the queue option for a sequential execution with wait-for-running=yes. Is there another way to achi… --- ## [Cross Validation](https://guildai.org/t/cross-validation/1017)
**Author:** [@jlsachse](https://guildai.org/u/jlsachse)\ **Replies:** 3\ **Last updated:** [March 23, 2023, 11:04pm UTC](https://guildai.org/t/cross-validation/1017 "2023-03-23T23:04:18Z")
Hello everyone, I just started using guild.ai and have a question regarding cross-validation during hyperparameter optimisation. As I understand it, guild runs my python scripts/jupyter notebooks externally and can cha… --- ## [Hierarchical view in runs list](https://guildai.org/t/hierarchical-view-in-runs-list/1020)
**Author:** [@garrett](https://guildai.org/u/garrett)\ **Replies:** 1\ **Last updated:** [March 23, 2023, 10:00pm UTC](https://guildai.org/t/hierarchical-view-in-runs-list/1020 "2023-03-23T22:00:54Z")
Summary TODO: stub for a proposal to show runs indented under parents (batches and pipelines) This proposal is under development Problem Guild’s flat listing of runs does not help when viewing pipelines and batche… --- ## [Summary operations](https://guildai.org/t/summary-operations/872)
**Author:** [@garrett](https://guildai.org/u/garrett)\ **Replies:** 4\ **Last updated:** [March 23, 2023, 9:16pm UTC](https://guildai.org/t/summary-operations/872 "2023-03-23T21:16:34Z")
Summary This is a proposal for a feature that lets users run operations that use one or more Guild runs as inputs. Consider the case where a user wants to analyze a set of runs to calculate average performance and to… --- ## [Canonical Guild file data structure](https://guildai.org/t/canonical-guild-file-data-structure/986)
**Author:** [@garrett](https://guildai.org/u/garrett)\ **Replies:** 2\ **Last updated:** [March 13, 2023, 9:55pm UTC](https://guildai.org/t/canonical-guild-file-data-structure/986 "2023-03-13T21:55:55Z")
Summary This proposal seeks to formalize Guild’s project configuration (a Guild file) as a data structure. This proposal is awaiting feedback Problem Guild supports a flexible project configuration structure. Howe… --- ## [Restart behavior of Guild steps (pipelines)](https://guildai.org/t/restart-behavior-of-guild-steps-pipelines/1015)
**Author:** [@garrett](https://guildai.org/u/garrett)\ **Replies:** 0\ **Last updated:** [March 13, 2023, 8:42pm UTC](https://guildai.org/t/restart-behavior-of-guild-steps-pipelines/1015 "2023-03-13T20:42:10Z")
Summary We propose the following changes to the steps support in Guild: When restarting a pipeline run, new steps should not be started but rather restarted in place. This should be the equivalent of running guild … --- ## [Flags-dest only delivers defined flags, not config file](https://guildai.org/t/flags-dest-only-delivers-defined-flags-not-config-file/1004)
**Author:** [@gummz](https://guildai.org/u/gummz)\ **Replies:** 1\ **Last updated:** [March 10, 2023, 4:26pm UTC](https://guildai.org/t/flags-dest-only-delivers-defined-flags-not-config-file/1004 "2023-03-10T16:26:52Z")
Hi, I have an issue in which flags-dest only seems to work for flags I define explicitly under flags. I have a Hydra config with nested values and following guildai/examples/hydra at main · guildai/guildai · GitHub . U… --- ## [Value dependent flag definitions/flag groups](https://guildai.org/t/value-dependent-flag-definitions-flag-groups/1012)
**Author:** [@garrett](https://guildai.org/u/garrett)\ **Replies:** 0\ **Last updated:** [March 9, 2023, 10:41pm UTC](https://guildai.org/t/value-dependent-flag-definitions-flag-groups/1012 "2023-03-09T22:41:50Z")
Summary We propose a scheme to support value-dependent flag definitions. A value-dependent flag definition applies only when another flag is a particular value. Consider this example: train: flags: db: … [Next page](https://guildai.org/latest.md?page=1)