|
|
# Queues
|
|
|
A queue is needed when submitting jobs, if no queue is given the SGE submits your job to your default queue. There are several queues available. Only the administrator can create others if needed. To display the available queues use the qstat or qconf command.
|
|
|
|
|
|
|
|
|
#!div class=important style="border: 2pt solid; text-align: left"
|
|
|
vill@shark:~$ qstat -g c
|
|
|
|
|
|
Prints a cluster queue summary
|
|
|
|
|
|
|
|
|
CLUSTER QUEUE CQLOAD USED RES AVAIL TOTAL aoACDS cdsuE
|
|
|
--------------------------------------------------------------------------------
|
|
|
12hr-KG.q 0.16 12 0 60 72 0 0
|
|
|
2hr-all.q 0.16 0 0 72 72 0 0
|
|
|
LGTC_HiSeq.q 0.64 1 0 23 24 0 0
|
|
|
MolEpi_HighMem.q 0.06 7 0 5 12 0 0
|
|
|
all.q 0.59 287 0 157 444 0 0
|
|
|
mpi.q 0.61 0 0 0 27 0 27
|
|
|
notebook.q 0.00 1 0 23 24 0 0
|
|
|
qlogin.q 0.00 3 0 37 40 0 0
|
|
|
|
|
|
Or
|
|
|
|
|
|
|
|
|
#!div class=important style="border: 2pt solid; text-align: left"
|
|
|
vill@shark:~$ qconf -sql
|
|
|
|
|
|
Prints only the available queues
|
|
|
|
|
|
|
|
|
12hr-KG.q
|
|
|
2hr-all.q
|
|
|
LGTC_HiSeq.q
|
|
|
MolEpi_HighMem.q
|
|
|
all.q
|
|
|
mpi.q
|
|
|
notebook.q
|
|
|
qlogin.q
|
|
|
|
|
|
|
|
|
Currently these queues are available for the following purposes:
|
|
|
||12hr-KG.q ||Clinical Genetics 12 hour run time high priority queue runs on catshark, sleepershark and iridescentshark ||
|
|
|
||2hr-all.q || A queue with maximum runtime of 2 hours for everyone to use ||
|
|
|
||LGTC_HiSeq.q ||Human Genetics LGTC !HiSeq sequence queue, only uses the baskingshark ||
|
|
|
||!MolEpi_HighMem.q ||!MolEpi High memory queue, only uses the wobbegongshark, only !MolEpi can use this queue||
|
|
|
||all.q ||Everyone can use this queue only the basking shark cannot be used with this queue, can only be used for batch jobs||
|
|
|
||qlogin.q||Everyone can use this queue, this queue is only for interactive jobs, and runs on koala and kiribati||
|
|
|
||notebook.q || Everyone can use this queue for their ipython notebook [IPythonNotebook](https://humgenprojects.lumc.nl/trac/shark/wiki/IPythonNotebook)
|
|
|
||mpi.q || Everyone can use this queue if you need to run MPI jobs [MPICH2](https://humgenprojects.lumc.nl/trac/shark/wiki/MPICH2)
|
|
|
|
|
|
Find the executions hosts for a queue (in this example the LGTC.q) the first command finds the hostlist for the queue.
|
|
|
|
|
|
#!div class=important style="border: 2pt solid; text-align: left"
|
|
|
qconf -sq all.q |grep hostlist | sed 's/[ ]\+/:/g' | cut -d : -f2
|
|
|
|
|
|
|
|
|
@allqueue
|
|
|
|
|
|
The second command will print all the hosts in the hostlist
|
|
|
|
|
|
|
|
|
#!div class=important style="border: 2pt solid; text-align: left"
|
|
|
qconf -shgrp @allqueue
|
|
|
|
|
|
|
|
|
group_name @allqueue
|
|
|
hostlist angelshark.cluster.loc blacktipshark.cluster.loc \
|
|
|
caribbeanshark.cluster.loc dogfishshark.cluster.loc \
|
|
|
epauletteshark.cluster.loc frilledshark.cluster.loc \
|
|
|
greatwhiteshark.cluster.loc hammerheadshark.cluster.loc \
|
|
|
kitefinshark.cluster.loc lemonshark.cluster.loc makoshark.cluster.loc \
|
|
|
megamouthshark.cluster.loc nightshark.cluster.loc \
|
|
|
pygmeshark.cluster.loc threshershark.cluster.loc \
|
|
|
tigershark.cluster.loc zebrashark.cluster.loc
|
|
|
|
|
|
Print all hosts in every hostlist
|
|
|
|
|
|
|
|
|
#!sh
|
|
|
for i in `qconf -shgrpl` ; do qconf -shgrp $i ; done
|
|
|
|
|
|
|
|
|
## Which queue do I use?
|
|
|
I you don't give a queue to run on with your job the Open Grid Schedular will use an available queue where you have access to.
|
|
|
If you use the -q queue name option then you use a so called hard_queue list and that queue will be used.
|
|
|
Add there "For an explanation about how/when to use checkpointing see the [Using the checkpointing queue](CheckpointingQueue) page.
|
|
|
|