Importing data to SLAC

To import data you need a grid certificate and proxy. Use grid-proxy-init to create your proxy.

To actually start the import using the following command (the --archive flag makes sure it doesn't automatically get deleted after a week).

dq2-register-subscription --archive <dataSet> SLACXRD

It will take some time for the data to appear. You can check with;

dq2_ls -f <dataSet>

to see how many files are available locally.

If you do not want a whole dataset you can use the dq2_sample command (at CERN) to create a subset. More information is in the ATLAS Wiki about this command. Once you import these user datasets they will appear under the original dataset's path in the DQ2 area.

To get the list of files you can use a command like the following;

dq2_ls -pf <dataSet> | grep root | sed 's;/xrootd/atlas;root://atl-xrdr//atlas/xrootd;'

Or to get a PoolCatalog.xml and files_jobO.py (setup EventSelector) for the dataset do;

dq2_poolFCjobO -pj <dataSet>
sed 's;/xrootd/atlas;root://atl-xrdr//atlas/xrootd;g' PoolFileCatalog.xml > PoolFileCatalog_new.xml
mv PoolFileCatalog_new.xml PoolFileCatalog.xml
sed 's;/xrootd/atlas;root://atl-xrdr//atlas/xrootd;g' files_jobO.py > files_jobO_new.py
mv files_jobO_new.py files_jobO.py