Search

link to homepage

Institute for Advanced Simulation (IAS)

Navigation and service


Introduction of the new JSC Usage Model

JSC will introduce a new model for using the supercomputing systems starting in November. The new model will overcome well-known obstacles in using the systems like the handling of several user accounts and sharing of data between project members and even between different projects.

To achieve these goals the new model is user-centered, i.e. each user will have only one account on the systems, via this account all assigned projects can be accessed. Particular attention was paid to data handling: user space is from now on separated from project space, this allows working on the same data for all project members. An important step for future needs is also the introduction of data projects. A data project is not connected to a CPU budget like the known compute projects, but it provides access to further storage layers. Data projects are independent of compute projects and allow sharing of data also in communities using different compute projects.

Please regard concerning data projects: all current projects with data in ARCH or access to DATA will get a data project automatically, there is nothing to do for the users or PIs. Starting in spring 2019, proposals for data projects independent of compute projects can be accepted. This will be announced separately.

To get this model up and running, all users need to get a new single account on the systems and also a significant amount of data movement is required. These steps have already started transparently for the users. Nevertheless adaptions also from user-side cannot be fully avoided. Please see all needed information here.

Please note: this documentation will be further completed until the new model goes into production. We will inform about new information in the news-header. Please let us know in case of questions so that we can help you and also other users through improving the documentation.

News

Date

News
29.10.2018Maintenance announcement: user information by email.
22.10.2018Maintenance announcement for Nov 30 - Dec 4.
17.10.2018Link to the JuDoor portal documentation included.
17.09.2018JSC news article published.
11.09.2018Documentation online.

The new model described

The concept can be most easily explained by a comparison between the current and the new model:

Comparison between current and new usage model

Summarized key features:

Transition to the new model

As can be seen in the comparison between the old and the new model the filesystems are ordered: to compute projects $PROJECT and $SCRATCH are assigned, access to the known $ARCH is now handled via data projects. Additionally there is no project data anymore in the user's home.

Data migration

To achieve this data migration is needed. Users don't have to perform this themselves, it is done for them. But you need to know how we proceed:

  1. All PIs of projects storing currenty data in ARCH, will get a data project automatically with the same runtime as their current compute project.
  2. As the amount of data in $ARCH is of course quite huge we cannot change the path to the data, that means this new created data projects will get the name of the former compute project (also users shall not change this!).
  3. The name of the compute project will change, we will put a "c" in front, e.g. hcp01 will be called chcp01 in future. The name hcp01 will refer the data project.

User Account

All Users automatically get a new account for access to the systems, they will be informed after transition about the new account name. You can just login with this new account name as before because all ssh-keys will be transferred automatically to that account.

Maintenance planning

The maintenance to apply this new usage model will affect all HPC systems at JSC and will take place between

30th November starting 08:00 until 4th of December.

We will also add the detailed workflow, e.g. end of job submission before start of maintenance.

How to work with the new model / tools for users

Currently tools are in development to help users setting up their environment under the new model:

  • activate a certain project (e.g. export environment variables)
  • query project the user belongs to
  • query cpuquota
  • query diskquota

New user portal JuDoor

At the same time we will start production of our new Portal to our supercomputer services called JuDoor.

All users will get access to the portal and can manage their personal data as well as their account and project memberships via JuDoor. A big advantage: account creation on an SC system will be performed in minutes. This is possible by a fully online process including the user and the project's principle investigator (PI), no paper handling will be involved anymore. Please consider that JuDoor will be the only way to get accounts on the JSC systems. PIs can manage their project members online themselves, they also have the possibility to assign a project administrator (PA) who can manage the account handling for them. The PA announcement can also be done in the portal itself.

Please have a look at the JuDoor Documentation.

FAQ

  1. What is my new account and where are the old ones?
  2. Where is my data after switch to the new model?
  3. What do I have to change for job submission?



Contact:
SC-Support Team
Jülich Supercomputing Centre
Forschungszentrum Jülich
52425 Jülich
Germany

Phone: 02461 61-2828
E-Mail: sc@fz-juelich.de


Servicemeu

Homepage