12.5 ATLAS¶

Overview¶

Resource type	Resource amount	Notes
Login nodes
HTCondor
Slurm
Home directory
Work directory

12.5.1 Summary¶

ATLAS computing resources are divided into Tier2 and Tier3 resources. Tier2 resources are grid computing and storage resources. Tier3 resources are local computing and storage resources for local users.

IHEP public login nodes:

lxlogin.ihep.ac.cn  (4 nodes)

ATLAS dedicated login nodes:

atlasui01.ihep.ac.cn atlasui02.ihep.ac.cn  (SL6, 2 public nodes)
atlasui03.ihep.ac.cn - atlasui06.ihep.ac.cn  (SL6, 4 internal nodes)

12.5.3 Tier3 Computing Resources¶

Queue	Priority	Wall time	Max running jobs in queue	Max running jobs per user	Max queued jobs per user	Max queued jobs in queue	Node type	Node list
atlaslque	High	Unlimited	150	150	700	1000	SL6	aws134-aws162
atlassque	Low	1 hour	304	304	700	1000	SL6	aws134-aws162
Atlas6q	High	Unlimited	150	150	500	1000	SL6	aws163-aws177

12.5.4 Tier3 Storage¶

Public Storage Area: Lustre¶

/publicfs/atlas  (870 TB)

Users can check storage usage from login nodes:

lfs df -h -p acfs.atlaspool /publicfs

/publicfs/atlas/codesbackup/user_name is backed up weekly and can be used for long-term storage of source code generated by users.

For public storage usage, see /publicfs/atlas/README and contact shanly@ihep.ac.cn.

Public Storage Area: AFS¶

Public ATLAS software is installed under:

/afs/ihep.ac.cn/soft/atlas/

Personal Storage Area: Lustre¶

/workfs/atlas/afs_user_name
/scratchfs/atlas/afs_user_name

Notes:

/workfs stores important personal files. Each user has 10 GB and up to 50,000 files. It is backed up by the Computing Center. Login nodes can read and write it; compute nodes can only read it.
/scratchfs stores temporary files. Each user has 500 GB. Files are retained for two weeks. Login nodes and compute nodes can read and write it.

Personal Storage Area: AFS¶

/afs/ihep.ac.cn/users/

Each user has 500 MB.

Use the following commands on login nodes to query Lustre quota:

lfs quota -u afs_user_name /workfs
lfs quota -u afs_user_name /scratchfs
lfs quota -u afs_user_name /publicfs

12.5.5 Tier3 ATLAS Software¶

Tier3 ATLAS software is located under:

/cvmfs/atlas.cern.ch/repo/sw/software

All login and compute nodes can access this path.

When using some CERN services, such as SVN checkout, use Kerberos tickets to avoid repeated authentication. Run the following commands on IHEP login nodes:

kinit afs_user@CERN.CH
klist

12.5.7 Tier2 Data Download¶

RUCIO data can be downloaded to Tier2 storage resources, such as BEIJING-LCG2_LOCALGROUPDISK, or directly to Tier3.

source /cvmfs/atlas.cern.ch/repo/sw/ddm/latest/setup.sh
export DQ2_LOCAL_SITE_ID=BEIJING-LCG2_LOCALGROUPDISK

🤖 AI 助手