|
|
New Bookkeeping Data Distribution Status
as of 18 Feb 2004
Current problems (should be fixed very soon)
- is_local flag is not yet local (BbkDbMirror copies it from the source site rather than resetting it to 0)
- BbkDatasetTcl ignores is_local, so includes collections even if they haven't been imported yet
- BbkImport requires that the script LocateForImport be in your login $PATH at SLAC. You can specify a different path with the --locate-remote option.
- The SLAC LocateForImport script only gives access to files that are on disk on one of the transfer machines (bbr-xfer01-07). Other files can be staged in by hand using LocateForImport -stage.
Future work
- Allow local site database connection configuration without needing to create an entry in SLAC AFS.
- Interface LocateForImport to Tier A data management systems, eg. xrootd via XTNetAdmin
- Use new SQL selection API to provide more file selection options.
- Define publication mechanism for Tier As to advertise what they have
- Use deep copy application to allow export of pointer skims to Tier C
- Define interface to importing site's data management system, eg.
writing directly to xrootd (for now, import to xrootd servers via NFS).
This could also handle writing to HPSS (or other MSS).
- If required, support new transfer protocols, eg. xrootd, SRB (which uses bbftp underneath), GridFTP, etc.
- If required, catalogue borrowed-file relationships so import can automatically include (or deep copy) borrowed files.
/BFROOT/www/Computing/Offline/DataDist/bbk-status-040218.html last modified on 16th February 2004 by
Tim Adye, <T.J.Adye@rl.ac.uk>
|
|