Disk Storage and Datasets at SLAC

 


The general dataset access tool of dq2 is described in the usage of dq2. A very useful tool is the dq2 dataset browser allowing examine available data from different generators and releases. For problems in dq2 usage, the dq2-DDM operations savannah page has links for various related info, in particular the bug tracker in development tools section seemed to be the place user problems are reported and addressed.  Some specific instructions for pulling datasets to SLAC is also available.


Local ATLAS Disks at SLAC:

The larger new Tier-2 user disks are all managed through XROOTD which is the preferred location for all user datasets.  Please take a look at the instructions below for the usage of the XROOTD space.

There are also some smaller old disk spaces (close to be full) which are intended as scratch area for releases, log files and smaller nutpules etc. together with some historical old datasets:

Access Path Physical disk Total size (Gbtyes) dq2 share
/nfs/surrey13/atlaswork /a/surrey13/vol/vol0/f.atlas_data1 130  
/nfs/surrey14/atlaswork /a/surrey14/vol/vol0/f.atlas_data1 130  
$ATLROOT/work/data1 /nfs/sulky51/atlaswork.u1 1240  
$ATLROOT/work/data2 /nfs/sulky51/atlaswork.u2 1240 Y

Note: Again, for normal datasets you should think about the XROOTD space first.  Any dataset you wish to move into the above disks will be sharing with user working space which are spread out on the last 4 disks, and the dq2 operations space on the two disks indicated by the last column of the table. So it is important to take a look at the space left on the disk you are targeting for storing samples (with command df -k .) to make sure it won't be close to full, before shipping a large sample.  ATLROOT is /afs/slac.stanford.edu/g/atlas/ at SLAC.


New datasets at SLAC, including pileup datasets

These datasets reside in the XROOTD storage element at SLAC. In order to use XROOTD, please take a look at the instructions below. Other useful links are provided at the top of this page.

I have also slightly separated the pileup samples reconstructed with Release 12 from those done with Release 13. The differences are non-trivial, both in the EDM itself as well as in the pileup digitization and reconstruction. A discussion is ongoing as to some subtle yet perhaps very important differences in the pileup digitization, as can be read about in this meeting:


Dataset Name (link goes to Panda dataset if it exists)

# Events

# files

Lumi

Release

HITS

ttbar

misal1_mc12.005200.T1_McAtNlo_Jimmy.simul.HITS.v12000605_tid008994

10K/10K

200/200

N/A

12.0.6.5

Min bias

misal1_csc11.005001.pythia_minbias.simul.HITS.v12003104_tid004278

101K/101K

404/404

N/A

12.0.31.4

Cavern bckg

misal1_csc11.007903.cavernbg_sf05.simul.HITS.v12003104_tid003999

10K/10K

40/40

N/A

12.0.31.4

J3

misal1_valid1.005012.J3_pythia_jetjet.simul.HITS.v12000605

9950/9950

199/199

N/A

12.0.6.5

RDO







ESD







AOD

ttbar

trig1_pile1sf05_misal1_csc11.005200.T1_McAtNlo_Jimmy.recon.AOD.v12000605_tid009270

8750/10K

35/40

1033

12.0.6.5

Min bias

trig1_misal1_csc11.005001.pythia_minbias.recon.AOD.v12000601_tid005901

40975/500K

1639/2000

(zero)

12.0.6.1

Min bias

trig1_pile1sf05_misal1_csc11.005001.pythia_minbias.recon.AOD.v12000605

103K/103K

413/413

1033

12.0.6.5

Di jet

trig1_pile1sf05_misal1_csc11.005015.J6_pythia_jetjet.recon.AOD.v12000605_tid014764

390K/390K

1561/1561

1033

12.0.6.5

W to e nu

trig1_pile1sf05_misal1_csc11.005104.PythiaWenu.recon.AOD.v12000605

12.5K/17K

50/67

1033

12.0.6.5

Z to mu mu

trig1_pile1sf05_misal1_csc11.005145.PythiaZmumu.recon.AOD.v12000605_tid009260

10K/10K

40/40

1033

12.0.6.5

Z to 4 leptons

trig1_pile1sf05_misal1_csc11.005980.Pythiazz4l.recon.AOD.v12000605

20K/42K

79/171

1033

12.0.6.5

Higgs to γγ

trig1_pile1sf05_misal1_mc12.005316.PythiaWH120gamgam.recon.AOD.v12000605_tid009265

4.75K/4.75K

19/19

1033

12.0.6.5

Higgs to γγ

trig1_pile1sf05_misal1_mc12.006307.PythiaH130gamgam.recon.AOD.v12000605_tid009873

34.5K/47K

138/187

1033

12.0.6.5

Ttbar plus jets

trig1_pile1sf05_misal1_mc12.006371.AlpgenJimmyttW1jets.recon.AOD.v12000605_tid009849

10K/15K

40/60

1033

12.0.6.5

Ttbar (4 leptons)

trig1_pile1sf05_misal1_mc12.005211.ttbarMcAtNLO4Leptons.recon.AOD.v12000605_tid018095

12K/88K

48/349

1033

12.0.6.5

Filtered minbias

trig1_pile1sf05_misal1_mc12.005805.filtered_minbias6.recon.AOD.v12000605

139K/529K

556/2115

1033

12.0.6.5







Higgs to γγ

misal1_pile1sf05_misal1_csc11.005310.PythiaH120gamgam.recon.AOD.v13003002

10K/10K

20/20

1033

13.0.30.2

Z to ee

trig0_pile0sf05_ideal0_csc11.005144.PythiaZee.recon.AOD.v13003002_tid017199

81K/87.5K

162/175

1033

13.0.30.2

Electrons

trig0_pile0sf05_ideal0_mc12.007000.singlepart_e_Et10.recon.AOD.v13003002

50K/50K

50/50

1033

13.0.30.2

Gammas

trig0_pile0sf05_ideal0_mc12.007040.singlepart_gamma_Et20.recon.AOD.v13003002

49K/49K

49/49

1033

13.0.30.2

ttbar

trig1_pile1sf02_misal1_mc12.005200.T1_McAtNlo_Jimmy.recon.AOD.v13003003

9.5K/9.5K

19/19

1033

13.0.30.3

Muons

trig1_pile1sf02_misal1_mc12.007264.singlepart_mu_p10.recon.AOD.v13003003

9K/9K

9/9

1033

13.0.30.3

Electrons

trig1_pile1sf05_calib1_mc12.007000.singlepart_e_Et10.recon.AOD.v13003002

47K/47K

47/47

1033

13.0.30.2

Gammas

trig1_pile1sf05_calib1_mc12.007040.singlepart_gamma_Et20.recon.AOD.v13003002

47K/47K

47/47

1033

13.0.30.2

W to e ν

trig1_pile1sf05_misal1_csc11.005104.PythiaWenu.recon.AOD.v13003002_tid017209

500/16.5K

1/33

1033

13.0.30.2

Higgs to γγ

trig1_pile1sf05_misal1_csc11.005310.PythiaH120gamgam.recon.AOD.v13003002

10K/10K

20/20

1033

13.0.30.2

Z to ee

trig1_pile1sf05_misal1_csc11_V1.005144.PythiaZee.recon.AOD.v13003002_tid017200

4K/108K

8/216

1033

13.0.30.2

W + Z to 3 leptons

trig1_pile1sf05_misal1_mc12.006359.JimmyWZ_3l.recon.AOD.v13003002

15K/15K

30/30

1033

13.0.30.2

Electrons

trig1_pile1sf05_misal1_mc12_V1.007020.singlepart_e_Et7-80.recon.AOD.v13003003_tid017748

3.9K/3.9K

39/39

1033

13.0.30.3

ttH_poslepnu_jj_bb

DQ2


39/41

(zero)

11.0.42.1

JF17_pythia_jet_filter

user.alessandrotricoli.trig1_misal1_mc12_V1.005802.JF17_pythia_jet_filter.recon.v12000601


795/795

(zero)

12.0.6.1

 



Old CSC11 datasets at SLAC
 

Dataset generator options

File location

Run

Release

Files

Notes

ESD

TTbar_FullHad_McAtNlo_Jimmy

ATLROOT/work/data1/csc11/

5204

v11004107

2/78


pythia_minbias

ATLROOT/work/data1/csc11/

5001

v11004201

2/28


AOD

ttH_poslepnu_jj_bb

ATLROOT/work/data1/btag/

5340

v11004201

39/41


ttH_neglepnu_jj_bb

ATLROOT/work/data1/btag/

5341

v11004201

46/48


WH120bb_pythia

ATLROOT/work/data1/btag/

5850

v11004103

77/88


WH120cc_pythia

ATLROOT/work/data1/btag/

5853

v11004103

9/11


WH120uu_pythia

ATLROOT/work/data1/btag/

5851

v11004103

80/82


J2_pythia_jetjet

ATLROOT/work/data1/btag/

5011

v11004103

263/277


J3_pythia_jetjet

ATLROOT/work/data1/btag/

5012

v11004103

143/150


TTbar_FullHad_McAtNlo_Jimmy

ATLROOT/work/data1/csc11/

5204

v11004107

3/78


pythia_minbias

ATLROOT/work/data1/csc11/

5001

v11004201

5/28


DPD

JF17_pythia_jet_filter

ATLROOT/work/data1/wz_jets_csc/JF17/

5802

v1200601

795/795

AANT Contents

 



Last Update:  Jan/10/2008
David Miller