Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 SGE fails to start. Unset -S parameter? #2150

Open
14 tasks
nimzodisaster opened this issue Sep 11, 2024 · 1 comment
Open
14 tasks

🐛 SGE fails to start. Unset -S parameter? #2150

nimzodisaster opened this issue Sep 11, 2024 · 1 comment

Comments

@nimzodisaster
Copy link
Contributor

Describe the bug

un called with config file /mnt/odd/rs/v1/output/log/pipeline_APP0Base/107925100_1/cpac_pipeline_config_195db324_2024-09-11T03-18-11Z.yml
raise exception
File "/code/run.py", line 827, in
run_main()
File "/code/run.py", line 796, in run_main
exitcode = CPAC.pipeline.cpac_runner.run(
File "/code/CPAC/pipeline/cpac_runner.py", line 397, in run
run_cpac_on_cluster(config_file, subject_list_file, cluster_files_dir)
File "/code/CPAC/pipeline/cpac_runner.py", line 185, in run_cpac_on_cluster
raise Exception(err_msg)
Exception: Error submitting C-PAC pipeline run to sge queue

I suspect:
SGE batch files have empty -S parameter
causing it to crash (I think)

#!

SGE batch file - 2024_09_11_03_18_15

#$ -S
#$ -N CPAC_APP0Base
#$ -t 1-138
#$ -q [email protected]
#$ -pe mpi_smp 8
#$ -A c-pac_user
#$ -V
#$ -wd /mnt/odd/rs/v1/output/log/cluster_files

echo "Start - TASKID " $SGE_TASK_ID " : " $(date)
python -c "from CPAC.pipeline.cpac_pipeline import run; run('/mnt/odd/rs/v1/output/log/pipeline_APP0Base/107925100_1/cpac_pipeline_config_195db324_2024-09-11T03-18-11Z.yml', '/mnt/odd/rs/v1/output/log/pipeline_APP0Base/107925100_1/cpac_data_config_195db324_2024-09-11T03-18-11Z.yml', $SGE_TASK_ID, 'APP0Base', plugin='MultiProc', plugin_args={'n_procs': 8, 'memory_gb': 40.0, 'raise_insufficient': False, 'status_callback': <function log_nodes_cb at 0x7fb0ea661c60>})"
echo "End - TASKID " $SGE_TASK_ID " : " $(date)

To reproduce

No response

Preconfig

  • default
  • abcd-options
  • anat-only
  • blank
  • ccs-options
  • fmriprep-options
  • fx-options
  • monkey
  • monkey-ABCD
  • ndmg
  • nhp-macaque
  • preproc
  • rbc-options
  • rodent

Custom pipeline configuration

No response

Run command

No response

Expected behavior

run sge

Acceptance criteria

run sge

Screenshots

No response

C-PAC version

1.87 docker

Container platform

No response

Docker and/or Singularity version(s)

No response

Additional context

No response

@nimzodisaster nimzodisaster changed the title 🐛 [User-reported Bug] 🐛 [User-reported Bug] SGE fails to start. Unset -S parameter? Sep 11, 2024
@tamsinrogers
Copy link

Hi @nimzodisaster , could you attach your pipeline config file so I can see what might be going on? Thanks!

@shnizzedy shnizzedy changed the title 🐛 [User-reported Bug] SGE fails to start. Unset -S parameter? 🐛 SGE fails to start. Unset -S parameter? Sep 13, 2024
@shnizzedy shnizzedy added the HPC label Sep 19, 2024
@shnizzedy shnizzedy mentioned this issue Sep 23, 2024
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: No status
Development

No branches or pull requests

3 participants