# General

**URL:** https://guildai.org/c/general/5.md

[Latest](https://guildai.org/latest.md) · [Categories](https://guildai.org/categories.md)

---

## [This site is deprecated - please use GitHub](https://guildai.org/t/this-site-is-deprecated-please-use-github/1081)

<div class="topic-metadata">

**Author:** [@garrett](https://guildai.org/u/garrett)\
**Replies:** 0\
**Last updated:** [July 18, 2024, 7:47pm UTC](https://guildai.org/t/this-site-is-deprecated-please-use-github/1081 "2024-07-18T19:47:24Z")

</div>

We are moving out support systems over to GitHub. This site will be place on read-only mode to maintain references for search. If you have issues or questions, please open an issues at: Issues · guildai/guildai · GitHu…

---

## [Welcome to Guild AI](https://guildai.org/t/welcome-to-guild-ai/7)

<div class="topic-metadata">

**Author:** [@guildai](https://guildai.org/u/guildai)\
**Replies:** 0\
**Last updated:** [June 4, 2020, 9:06pm UTC](https://guildai.org/t/welcome-to-guild-ai/7 "2020-06-04T21:06:36Z")

</div>

Welcome to the Guild AI! This is the place to find answers to questions, get news about features, and discover ways to leverage the many features of Guild AI. It’s where the Guild AI community collaborates and helps one …

---

## [Code of Conduct](https://guildai.org/t/code-of-conduct/17)

<div class="topic-metadata">

**Author:** [@guildai](https://guildai.org/u/guildai)\
**Replies:** 0\
**Last updated:** [June 5, 2020, 2:44pm UTC](https://guildai.org/t/code-of-conduct/17 "2020-06-05T14:44:12Z")

</div>

Overview The Guild AI Forum is a civilized place for connecting with others, learning new skills, sharing feedback and ideas, and getting help with Guild AI. By participating in this Forum, you agree to this Code of Cond…

---

## [About the General category](https://guildai.org/t/about-the-general-category/12)

<div class="topic-metadata">

**Author:** [@guildai](https://guildai.org/u/guildai)\
**Replies:** 0\
**Last updated:** [June 4, 2020, 10:07pm UTC](https://guildai.org/t/about-the-general-category/12 "2020-06-04T22:07:15Z")

</div>

Post a general question or comment including feature requests. If you need help with a particular issue, use Troubleshooting. If a post isn’t related to Guild AI, use Random.

---

## [How do you use GuildAI with Slurm/remote jobs?](https://guildai.org/t/how-do-you-use-guildai-with-slurm-remote-jobs/673)

<div class="topic-metadata">

**Author:** [@jan\_r](https://guildai.org/u/jan_r)\
**Replies:** 9\
**Last updated:** [June 23, 2024, 6:26pm UTC](https://guildai.org/t/how-do-you-use-guildai-with-slurm-remote-jobs/673 "2024-06-23T18:26:22Z")

</div>

Hi, I am contemplating of switching from a custom build experiment tracking system to Guild but I am unsure if it’s worth it. I run all my experiments on a remote slurm cluster. Right now, I create a new folder for eac…

---

## [How do I contribute to Guild Documentation?](https://guildai.org/t/how-do-i-contribute-to-guild-documentation/1066)

<div class="topic-metadata">

**Author:** [@douwmarx](https://guildai.org/u/douwmarx)\
**Replies:** 1\
**Last updated:** [June 18, 2024, 7:40pm UTC](https://guildai.org/t/how-do-i-contribute-to-guild-documentation/1066 "2024-06-18T19:40:40Z")

</div>

How do I send a pull request with a proposed change to the Guild documentation? I think there might be an error here: https://guildai.org/t/get-started-use-guild-in-a-project/203: guild purge --started "before 30 days …

---

## [Reducing duplication in fully specified guild.yml files](https://guildai.org/t/reducing-duplication-in-fully-specified-guild-yml-files/1062)

<div class="topic-metadata">

**Author:** [@Alessandro](https://guildai.org/u/Alessandro)\
**Replies:** 1\
**Last updated:** [June 18, 2024, 6:50pm UTC](https://guildai.org/t/reducing-duplication-in-fully-specified-guild-yml-files/1062 "2024-06-18T18:50:54Z")

</div>

Hi there! Is it possible to move common attributes of different operations upwards? For example, given the existing two operations for model - model: model operations: train: exec: python module/trainer.py…

---

## [Combine argparse and config files](https://guildai.org/t/combine-argparse-and-config-files/747)

<div class="topic-metadata">

**Author:** [@copah](https://guildai.org/u/copah)\
**Replies:** 7\
**Last updated:** [February 27, 2024, 7:28pm UTC](https://guildai.org/t/combine-argparse-and-config-files/747 "2024-02-27T19:28:47Z")

</div>

Is it possible to combine flags from the argparse interface and config files? Consider this pseudo example: Project structure: guild\_combine\_argparse\_config\_files/ ├── guild.yml ├── model\_flags.yml └── train.py # tra…

---

## [Multi-Objective Optimisation](https://guildai.org/t/multi-objective-optimisation/1056)

<div class="topic-metadata">

**Author:** [@jlsachse](https://guildai.org/u/jlsachse)\
**Replies:** 1\
**Last updated:** [November 15, 2023, 11:19pm UTC](https://guildai.org/t/multi-objective-optimisation/1056 "2023-11-15T23:19:25Z")

</div>

Hi @garrett, I’ve created a quick and dirty implementation for optimisation with Optuna based on your TPE example. It works fine, but I’m forced to set the objectives and their directions with custom flags when optimis…

---

## [Seeking Access to Training Data for Research Purposes](https://guildai.org/t/seeking-access-to-training-data-for-research-purposes/1049)

<div class="topic-metadata">

**Author:** [@lorenasimedo](https://guildai.org/u/lorenasimedo)\
**Replies:** 2\
**Last updated:** [June 14, 2023, 6:35pm UTC](https://guildai.org/t/seeking-access-to-training-data-for-research-purposes/1049 "2023-06-14T18:35:27Z")

</div>

Hey everyone, I am a Master’s student from Concordia University, and I am currently conducting research using some open-source projects, including guildai/guildai. I am writing to inquire if there might be a way for me…

---

## [How to avoid copying source code for each run](https://guildai.org/t/how-to-avoid-copying-source-code-for-each-run/1044)

<div class="topic-metadata">

**Author:** [@kyika](https://guildai.org/u/kyika)\
**Replies:** 2\
**Last updated:** [June 13, 2023, 9:30pm UTC](https://guildai.org/t/how-to-avoid-copying-source-code-for-each-run/1044 "2023-06-13T21:30:02Z")

</div>

Dear Garrett and other developers, I would like to know if there is a way to avoid copying the source code for each guild run I executed. I need this since I am running tens of thousands of guild runs, each executing t…

---

## [Logging non-numeric output variables](https://guildai.org/t/logging-non-numeric-output-variables/262)

<div class="topic-metadata">

**Author:** [@emgong](https://guildai.org/u/emgong)\
**Replies:** 12\
**Last updated:** [June 5, 2023, 2:49pm UTC](https://guildai.org/t/logging-non-numeric-output-variables/262 "2023-06-05T14:49:41Z")

</div>

Hi, Any plans on adding support for (\\key): (\\value) output variables which are not necessarily numeric?

---

## [How to require multiple files from the same directory in guild.yml?](https://guildai.org/t/how-to-require-multiple-files-from-the-same-directory-in-guild-yml/991)

<div class="topic-metadata">

**Author:** [@guildedkage](https://guildai.org/u/guildedkage)\
**Replies:** 5\
**Last updated:** [May 3, 2023, 7:38pm UTC](https://guildai.org/t/how-to-require-multiple-files-from-the-same-directory-in-guild-yml/991 "2023-05-03T19:38:41Z")

</div>

I want to call something like data/\* under required files. Is this possible? Basically, I have different datasets as parameters to my problem that I call via flags. Listing each dataset by name is not robust. Can I requ…

---

## [Excecute runs in sequential order](https://guildai.org/t/excecute-runs-in-sequential-order/992)

<div class="topic-metadata">

**Author:** [@bbach63](https://guildai.org/u/bbach63)\
**Replies:** 2\
**Last updated:** [March 25, 2023, 11:00am UTC](https://guildai.org/t/excecute-runs-in-sequential-order/992 "2023-03-25T11:00:16Z")

</div>

I would like to prevent all runs in a grid search running in parallel. The only way I found is to use staged runs and the queue option for a sequential execution with wait-for-running=yes. Is there another way to achi…

---

## [Cross Validation](https://guildai.org/t/cross-validation/1017)

<div class="topic-metadata">

**Author:** [@jlsachse](https://guildai.org/u/jlsachse)\
**Replies:** 3\
**Last updated:** [March 23, 2023, 11:04pm UTC](https://guildai.org/t/cross-validation/1017 "2023-03-23T23:04:18Z")

</div>

Hello everyone, I just started using guild.ai and have a question regarding cross-validation during hyperparameter optimisation. As I understand it, guild runs my python scripts/jupyter notebooks externally and can cha…

---

## [Run labels as runs DataFrame columns?](https://guildai.org/t/run-labels-as-runs-dataframe-columns/1010)

<div class="topic-metadata">

**Author:** [@Alessandro](https://guildai.org/u/Alessandro)\
**Replies:** 2\
**Last updated:** [March 9, 2023, 3:02pm UTC](https://guildai.org/t/run-labels-as-runs-dataframe-columns/1010 "2023-03-09T15:02:12Z")

</div>

Hi there, is it currently possible to show all run labels as columns in the ipy guild interface? My current workflow is somewhat hacky: import guild.ipy as guild # All runs runs = guild.runs() runs = runs.loc\[(runs.s…

---

## [How can I cite Guild AI in my scientific paper?](https://guildai.org/t/how-can-i-cite-guild-ai-in-my-scientific-paper/1011)

<div class="topic-metadata">

**Author:** [@kyika](https://guildai.org/u/kyika)\
**Replies:** 1\
**Last updated:** [March 8, 2023, 5:21pm UTC](https://guildai.org/t/how-can-i-cite-guild-ai-in-my-scientific-paper/1011 "2023-03-08T17:21:55Z")

</div>

Hi, I would like to cite Guild AI in my scientific paper since it significantly helped my research. Could you let me know what’s the proper way to do so? Thanks. Kyika

---

## [Welcome Alex to Guild AI team](https://guildai.org/t/welcome-alex-to-guild-ai-team/1008)

<div class="topic-metadata">

**Author:** [@garrett](https://guildai.org/u/garrett)\
**Replies:** 0\
**Last updated:** [March 3, 2023, 10:19pm UTC](https://guildai.org/t/welcome-alex-to-guild-ai-team/1008 "2023-03-03T22:19:04Z")

</div>

I’d like to extend a warm welcome to @alxmke to the Guild AI core team! Alex is quickly coming up to speed on the Guild code base and making contributions to issues and features. Look for him here and on GitHub as an act…

---

## [Can GuildAI read log files for output scalars?](https://guildai.org/t/can-guildai-read-log-files-for-output-scalars/983)

<div class="topic-metadata">

**Author:** [@gummz](https://guildai.org/u/gummz)\
**Replies:** 2\
**Last updated:** [February 2, 2023, 2:49pm UTC](https://guildai.org/t/can-guildai-read-log-files-for-output-scalars/983 "2023-02-02T14:49:21Z")

</div>

Hi!:wave:Is it possible for Guild to read from log file (for example from Hydra) for output scalars? Because everything gets saved to a log file on the remote I’m using, which I have no control over, so outputting to con…

---

## [How to define an optimizer with a maximization target in guild.yml?](https://guildai.org/t/how-to-define-an-optimizer-with-a-maximization-target-in-guild-yml/963)

<div class="topic-metadata">

**Author:** [@jbmorgado](https://guildai.org/u/jbmorgado)\
**Replies:** 0\
**Last updated:** [November 20, 2022, 11:26pm UTC](https://guildai.org/t/how-to-define-an-optimizer-with-a-maximization-target-in-guild-yml/963 "2022-11-20T23:26:15Z")

</div>

I see some CLI syntax to define an optimizer with a maximization target, but I can’t find the way to define that in the guild.yml file. Let’s say I have 2 input parameters, a and b and I want to do a search for a = \[0.1…

---

## [Specify the config file from the command line?](https://guildai.org/t/specify-the-config-file-from-the-command-line/948)

<div class="topic-metadata">

**Author:** [@mtmccann](https://guildai.org/u/mtmccann)\
**Replies:** 5\
**Last updated:** [November 2, 2022, 7:12pm UTC](https://guildai.org/t/specify-the-config-file-from-the-command-line/948 "2022-11-02T19:12:45Z")

</div>

I’d like to read flags from a config file. The example from guildai/examples/flags at main · guildai/guildai · GitHub using flags-dest: config:flags.yml mostly does what I want, but I’d love to be able to point the same …

---

## [We're hiring!](https://guildai.org/t/were-hiring/947)

<div class="topic-metadata">

**Author:** [@garrett](https://guildai.org/u/garrett)\
**Replies:** 0\
**Last updated:** [October 24, 2022, 2:40pm UTC](https://guildai.org/t/were-hiring/947 "2022-10-24T14:40:44Z")

</div>

I’m very excited to announce our first job posting! If you’re interested in a full time job working on Guild, please let us know! Feel free to circulate the news as well.

---

## [Distributing runs on a multi-gpu machine](https://guildai.org/t/distributing-runs-on-a-multi-gpu-machine/841)

<div class="topic-metadata">

**Author:** [@sjoshi804](https://guildai.org/u/sjoshi804)\
**Replies:** 2\
**Last updated:** [October 19, 2022, 8:36pm UTC](https://guildai.org/t/distributing-runs-on-a-multi-gpu-machine/841 "2022-10-19T20:36:25Z")

</div>

I’m trying to optimally distribute many runs on a multi-gpu system so that I can complete the experiments in minimum total running time. I was wondering how guild could help with this?

---

## [Cross referencing run id with a job's arguments](https://guildai.org/t/cross-referencing-run-id-with-a-jobs-arguments/912)

<div class="topic-metadata">

**Author:** [@Gilded](https://guildai.org/u/Gilded)\
**Replies:** 1\
**Last updated:** [October 11, 2022, 1:47pm UTC](https://guildai.org/t/cross-referencing-run-id-with-a-jobs-arguments/912 "2022-10-11T13:47:52Z")

</div>

I am using guild’s tensorboard extract command so I can post-process the scalar values, very useful: guild tensorboard -Fo train --export-scalars events.csv The first column is the run id. Is there a way to cross refer…

---

## [How to filter runs using multiple flag values](https://guildai.org/t/how-to-filter-runs-using-multiple-flag-values/760)

<div class="topic-metadata">

**Author:** [@kyika](https://guildai.org/u/kyika)\
**Replies:** 3\
**Last updated:** [October 11, 2022, 1:00pm UTC](https://guildai.org/t/how-to-filter-runs-using-multiple-flag-values/760 "2022-10-11T13:00:01Z")

</div>

Hi, I would like to know if there is a way to filter runs using multiple flag values. For example I have a batch of runs with flags: a=1/2/3, b=4/5/6 (so in total 9 runs). And I would like to filter the runs using gui…

---

## [Self requiring operation](https://guildai.org/t/self-requiring-operation/886)

<div class="topic-metadata">

**Author:** [@teracamo](https://guildai.org/u/teracamo)\
**Replies:** 7\
**Last updated:** [October 5, 2022, 8:32pm UTC](https://guildai.org/t/self-requiring-operation/886 "2022-10-05T20:32:35Z")

</div>

I am trying to learn a recipe (a sequence of hyperparameters) to train a model. In essence, I would like to have the model requiring itself in a fashion like this: op: main: XX flags: \[some flags\] requires: - …

---

## [How to have optional run resources](https://guildai.org/t/how-to-have-optional-run-resources/494)

<div class="topic-metadata">

**Author:** [@felixab](https://guildai.org/u/felixab)\
**Replies:** 8\
**Last updated:** [October 5, 2022, 8:31pm UTC](https://guildai.org/t/how-to-have-optional-run-resources/494 "2022-10-05T20:31:07Z")

</div>

I have multiple datasets that I preprocess using different guild operations. My train operation in turn uses these runs as resources, and I want to be able to only input a selected subset of these preprocess runs to my t…

---

## [More memorable run name generation](https://guildai.org/t/more-memorable-run-name-generation/884)

<div class="topic-metadata">

**Author:** [@bunbunbun](https://guildai.org/u/bunbunbun)\
**Replies:** 9\
**Last updated:** [October 4, 2022, 5:10pm UTC](https://guildai.org/t/more-memorable-run-name-generation/884 "2022-10-04T17:10:10Z")

</div>

I really love the way wandb and docker generate names, they combine words in a way which is very memorable. In guild i often struggle to remember which run is which. Is there a way to change the unique run generation ke…

---

## [Delete-on-success configuration](https://guildai.org/t/delete-on-success-configuration/876)

<div class="topic-metadata">

**Author:** [@copah](https://guildai.org/u/copah)\
**Replies:** 1\
**Last updated:** [October 4, 2022, 3:09pm UTC](https://guildai.org/t/delete-on-success-configuration/876 "2022-10-04T15:09:45Z")

</div>

In the docs for the run command it is mentioned that you can add --keep-run if the run is configured with delete-on-success. I can’t find any documentation on the delete-on-success configuration. Essentially what I am …

---

## [Using flag values as a resource definition](https://guildai.org/t/using-flag-values-as-a-resource-definition/917)

<div class="topic-metadata">

**Author:** [@chris](https://guildai.org/u/chris)\
**Replies:** 0\
**Last updated:** [September 17, 2022, 2:11am UTC](https://guildai.org/t/using-flag-values-as-a-resource-definition/917 "2022-09-17T02:11:50Z")

</div>

I have a few parameters to my training script that point to files, e.g. to a pretrained model for transfer learning. If I use a relative path, I need to include the file in my resources section of the guild.yml file, or…

[Next page](https://guildai.org/c/general/5.md?page=1)
