My apologies for the late reply! I had typed a reply but never send it.
You can use something like this:
remotes:
azure-deeplearning:
venv-activate: source mypath/.training_venv/bin/activate && source my_custom_bash.sh
Refer to Remotes Reference for info on the venv-activate attribute for ssh remotes.