next up previous contents
Next: replicateFile Up: Management Commands Previous: Command Line Tool   Contents

bulkCopyAndRegisterFile

Command: bulkCopyAndRegisterFile
Description: Put many files into Grid Storage and register them in the Catalog, all in one atomic operation.
Arguments: filelist A file containing a list of local files to be bulk uploaded. This should be specified as a URI (with scheme `file').
Options: -d or - -destination destination-SURL or SE host
  -s or - -logical-filename-suffix suffix
  -l or - -logical-file-names filename
  -p or - -protocol protocol
  -n or - -streams number of streams
Example: edg-replica-manager -vo=wpsix bulkCopyAndRegisterFile file:///home/mydir/myfile-list

COMMAND LINE TOOL

usage: edg-replica-manager bulkCopyAndRegister filelist [command-options]
Bulk upload multiple files to a given SE and register them in the replica
catalog.
 -d,--destination-host <host>            The destination SE host. If it is
                                         not given, the closeSE is found
                                         from the info services. The
                                         destination SURLs are always
                                         automatically generated.
 -s,--logical-filename-suffix <suffix>   The logical filename suffix to
                                         register this entry with. The LFN
                                         will be constructed using the full
                                         filename plus this suffix. If this
                                         option is not specified, no LFN
                                         will be registered. This cannot be
                                         used with the --logical-files (-l)
                                         option.
 -l,--logical-files <filename>           A file containing the list of LFNs
                                         to register for each source file.
                                         This must have the same number of
                                         entries as filelist. This filename
                                         should be specified as a URI (with
                                         scheme 'file'). This option cannot
                                         be used with the
                                         --logical-file-name-suffix (-s)
                                         option.
 -n,--streams <#streams>                 The number of parallel streams to
                                         use. Defaults to 8. This only has
                                         an effect if the protocol supports
                                         parallel streams. Currently the
                                         only protocol to do so is gsiftp.
 -p,--protocol <protocol>                The protocol to be used for
                                         transfer. Defaults to gsiftp.
 Arguments:
  filelist              A file containing a list of local files to be bulk
                        uploaded. This should be specified as a URI (with
                        scheme 'file').

The functionality is very similar to the command copyAndRegisterFile and thus we only outline the most important differences here.

Semantics

If several files need to be ``uploaded'' to the Grid in one operation, running the command line copyAndRegisterFile might take a rather long time as each time the Java virtual machine has to be started. In order to reduce the start-up latency, the following command takes several files in one operation and thus the latency is decreased. The major difference to the command copyAndRegisterFile is that for possible LFNs one can only specify a suffix for all of the files rather than individual LFNs.

Arguments

A single file (identified by a URI with the scheme file) needs to be specified that contains all files that are a locally available and are to be transferred to the Grid.

Options

There two ways in which one can specify the LFNs for the set of files to be bulk uploaded:

  1. The option -s or -logical-filename-suffix takes a suffix for all LFNs that are then automatically generated by suffixing the filenames given in the file list.

  2. The option -l or -logical-files takes a file which contains a list of LFNs and these LFNs are used for each file uploaded to the Grid.

Return value

The call returns 0 on success and -1 on failure.


next up previous contents
Next: replicateFile Up: Management Commands Previous: Command Line Tool   Contents
2004-06-14