what is a batch processing operating system

Choose a clusterīefore you start preparing a job script you should decide which cluster you want your job to run on, Owens or Pitzer. Here is a very brief overview of how to use the batch system. More standard terminology considers a job to be parallel if it involves multiple processes.

Similarly, a parallel job is one that uses more than one node. From the point of view of the batch system a serial job is one that uses just one node, regardless of how many processors it uses on that node. The words “parallel” and “serial” as used by SLURM can be a little misleading. See HPC basics if you need this background information. A central manager slurmctld, monitors resources and work. You’ll need to understand the terms cluster, node, and processor (core) in order to request resources for your job. You can check the status of your job interactively and/or receive emails when it begins and ends execution. The output you would normally see on your display goes into a log file. You submit this file to the batch system, which will run it as soon as resources become available. To run a batch job, you put the commands into a text file instead of typing them at the prompt.

When you type commands in a login shell and see a response displayed, you are working interactively. The scheduling policies in place on the system are an attempt to balance the desire for short queue waits against the need for efficient system utilization. The jobs are queued and then run as resources become available. The batch system allows users to submit jobs requesting the resources (nodes, processors, memory, GPUs) that they need. If a process is started on the login nodes that is using too much cpu or memory, then it may be killed without warning.

What is a batch processing operating system