Importing data to SLAC

To import data you need a grid certificate and proxy.

voms-proxy-init -voms atlas

To actually start the import using the following command (the --archive flag makes sure it doesn't automatically get deleted after a week).

dq2-register-subscription --archive <dataSet> SLACXRD

It will take some time for the data to appear. You can check with;

dq2-ls -f <dataSet> -L SLACXRD

to see how many files are available locally.

If you do not want a whole dataset you can use the dq2_sample command (at CERN) to create a subset.
More information is in the ATLAS Wiki about this and other dq2 commands.
Once you import these user datasets they will appear under the original dataset's path in the DQ2 area.

To get the list of files you can use a command like the following:

dq2-ls -L SLACXRD -fp <dataSet> | cut -d "?" -f 2 | sed s%SFN=/xrootd/atlas%root://atl-xrdr//atlas/xrootd%
And you can make a PoolFileCatalog.xml file directly:
dq2-ls -L SLACXRD -P <dataSet>
sed s%srm://osgserv04.slac.stanford.edu:8443/srm/v2/server?SFN=/xrootd/atlas%root://atl-xrdr//atlas/xrootd%g PoolFileCatalog.xml >! PoolFileCatalog.xml