Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Note
iconfalse

From 1 November 2022 Atos HPCF usage will be charged against SBU allocations. 

To ensure that computing resources are distributed equitably and to discourage irresponsible use users' jobs on the Atos HPCF are charged for the resources they have used against a project account. Each project account is allocated a number of System Billing Units(SBU) at the beginning of each accounting year (1 January to 31 December).  You can monitor your usage in the HPC SBU accounting portal.

Tip
titleECS usage

Resources used on the ECGATE Class Service (ECS) cluster will not be charged to your HPCF resource allocation.

...

The accounting on the HPCF is currently based on the total elapsed time for which cores are used. With that, the HPCF unit of account, the System Billing Unit, or SBU, for both serial and parallel jobs is defined as follows.the cores allocated to serial or parallel batch jobs. To reflect the current system configuration and performance the formula to compute SBU will change on 1 January 2024 to

Panel

SBU = P * N * T

where:

P = 424074479 / (8090 * 128 * 86400)

is a fixed proportionality factor, adjusted so that the entire Atos system will deliver 424,074,479 SBU per day on a "typical"
ECMWF job mix on the HPC system (8090 * 128 is the total number of physical cores used to run batch jobs and 86400
the number of seconds in a day).

N

Is the number of (physical) cores allocated to a job. 

T

is the elapsed time (real time in seconds) recorded for a job.

Examples:

  1. A serial job using 1 hour (3600 seconds) of elapsed time will be charged about 17.06 SBU.
  2. A parallel job requesting 2 nodes, running for 3 hours elapsed time will be charged 13104.90 SBU.

Compared to 2023 the SBU cost of the same job in 2024 will be ~10.8% less . 

Expand
titleSBU formula in 2023


Panel

SBU = P * N * T

where:

P = 470410408 / (8098 * 128 * 86400)

is a fixed proportionality factor, adjusted so that the entire Atos system will deliver 470,410,408 SBU per day on a "typical"
ECMWF job mix on the HPC system (8098 * 128 is the total number of physical cores used to run batch jobs and 86400
the number of seconds in a day).

N

Is the number of (physical) cores allocated to a job. 

T

is the elapsed time (real time in seconds) recorded for a job.

Examples:

  1. A serial job using 1 hour (3600 seconds) of elapsed time will be charged about 18.91 SBU.
  2. A parallel job requesting 2 nodes, running for 3 hours elapsed time will be charged 14522.43 SBU.


Tip
titleEnd of job information

At the end of your jobs a short report is appended to the corresponding job output file, which amongst other useful information, includes how many SBUs where used and the account they were charged on:

No Format
[ECMWF-INFO -ecepilog] ----------------------------------------------------------------------------------------------------
[ECMWF-INFO -ecepilog] This is the ECMWF job Epilogue
[ECMWF-INFO -ecepilog] +++ Please report issues using the Support portal +++ 
[ECMWF-INFO -ecepilog] +++ https://support.ecmwf.int                     +++ 
[ECMWF-INFO -ecepilog] ----------------------------------------------------------------------------------------------------
[ECMWF-INFO -ecepilog] Run at 2022-08-24T09:09:01 on ac
[ECMWF-INFO -ecepilog] JobName                   : myjob
[ECMWF-INFO -ecepilog] JobID                     : 37015044
[ECMWF-INFO -ecepilog] Submit                    : 2022-08-24T09:08:55
[ECMWF-INFO -ecepilog] Start                     : 2022-08-24T09:08:55
[ECMWF-INFO -ecepilog] End                       : 2022-08-24T09:09:01
[ECMWF-INFO -ecepilog] QueuedTime                : 0.0 
[ECMWF-INFO -ecepilog] ElapsedRaw                : 6 
[ECMWF-INFO -ecepilog] ExitCode                  : 0:0 
[ECMWF-INFO -ecepilog] DerivedExitCode           : 0:0 
[ECMWF-INFO -ecepilog] State                     : COMPLETED
[ECMWF-INFO -ecepilog] Account                   : myaccount
[ECMWF-INFO -ecepilog] QOS                       : np
[ECMWF-INFO -ecepilog] User                      : user
[ECMWF-INFO -ecepilog] StdOut                    : /home/user/slurm-37015044.out
[ECMWF-INFO -ecepilog] StdErr                    : /home/user/slurm-37015044.out
[ECMWF-INFO -ecepilog] NNodes                    : 1 
[ECMWF-INFO -ecepilog] NCPUS                     : 256 
[ECMWF-INFO -ecepilog] SBU                       : 4.083
[ECMWF-INFO -ecepilog] ----------------------------------------------------------------------------------------------------


SBU simulator

You can see how much your job would cost in terms of SBUs by copying and pasting here your job headers.

Tip
titleDefining how long your job will run

Use the SLURM time directive for the job duration. For example, for a job that needs to run for 12 hours:

#SBATCH --time=12:00:00

HTML Include
urlhttps://sites.ecmwf.int/udoc/sbu/simulator.html

What are my project accounts?

...

How do I monitor my usage?

...

...

To monitor your SBU usage (Cray HPCF until 31 Oct 2022, Atos HPCF from 1 Nov 2022) charged against allocations please visit the HPC SBU accounting portal and login with your relevant computer user-ID. 

...

Any Atos usage before 1 Nov 2022 can be monitored at Atos Preproduction HPC SBU Accounting portal. You can login with your usual ECMWF credentials.

You will find the accumulated SBU usage for your different accounts from the beginning of the accounting year as well as the allocations granted for each of them.

...

Member States may nominate "privileged users" to perform limited administration of Member State accounts using the HPC SBU accounting portal. By default, the Centre will grant this status to all Member State Computing Representatives with a registered user identifier, but Member State Computing Representatives may propose an alternative person and/or nominate a backup if they wish.

...