fast.submissions

fast.submissions.lsf_subs module

class fast.submissions.lsf_subs.LSFSub(queue, n_tasks=1, max_time=1500, job_name=None, **kwargs)[source]

Bases: base

LSF submission wrapper.

Parameters

queue (str,) – The queue to submit.
n_tasks (int, default=1,) – The number of tasks for the submission job.
max_time (int, default = 1500,) – The maximum time for submission job in hours.
job_name (str, default = None,) – The name of the submission job.

property class_name

property config

run(cmds, output_dir=None, output_name=None)[source]

class fast.submissions.lsf_subs.LSFWrap(max_n_procs=inf)[source]

Bases: base

Wrapper for LSF checking and waiting for jobs

Parameters: max_n_procs (int, default = np.inf,) – The maximum number of jobs to be running at a time.

property class_name

property config

get_submission_names(pids)[source]: Returns the submission file name

wait_for_pids(pids, wait_time=2, wait_for_all=False)[source]

fast.submissions.lsf_subs.get_running_jobs()[source]: Finds jobs that are currently running

fast.submissions.os_sub module

class fast.submissions.os_sub.OSWrap(max_n_procs=inf)[source]

Bases: base

Wrapper for the linux operating system.

property class_name

property config

get_submission_names(pid=None)[source]

wait_for_pids(pids, wait_time=2, wait_for_all=False)[source]

class fast.submissions.os_sub.SPSub(wait=False, **kwargs)[source]

Bases: base

Submission wrapper using subprocessing.

Parameters: wait (bool, default = False,) – Optionally submit and wait for each job. When False, will submit a job and return while it is still running.

property class_name

property config

run(cmds, output_dir=None, output_name=None)[source]

fast.submissions.os_sub.check_pid(pid)[source]: Check For the existence of a unix pid.

fast.submissions.slurm_subs module

class fast.submissions.slurm_subs.SlurmSub(queue, n_tasks=1, n_cpus=1, exclusive=False, email=None, max_time=1500, job_name=None, **kwargs)[source]

Bases: base

Slurm submission wrapper.

Parameters

queue (str,) – The queue to submit.
n_tasks (int, default=1,) – The number of tasks for the submission job.
n_cpus (int, default = 1,) – Number of cpus to use.
exclusive (bool, default = False,) – To request exclusive use of a node.
email (str, default = None,) – Email address to optionally email updates.
max_time (int, default = 1500,) – The maximum time for submission job in hours.
job_name (str, default = None,) – The name of the submission job.

property class_name

property config

run(cmds, output_dir=None, output_name=None)[source]

class fast.submissions.slurm_subs.SlurmWrap(max_n_procs=inf)[source]

Bases: base

Wrapper for slurm checking and waiting for jobs

Parameters: max_n_procs (int, default = np.inf,) – The maximum number of jobs to be running at a time.

property class_name

property config

get_submission_names(pids)[source]: Returns the submission file name

wait_for_pids(pids, wait_time=2, wait_for_all=False)[source]

fast.submissions.slurm_subs.get_running_jobs()[source]: Finds jobs that are currently running