WIP: Datastaging information capability extension for arcctl

Extention of datadelivery information for arcctl. Mostly for jobs where datadelivery is ongoing, but some information might also be gathered for jobs that are done in PREPARING. In that case the arcctl accounting could be used instead, will think about that as I go.

Goal: to give some useful overview in times where there are datastaging problems on the site, or just for general information about typical times used in datastaging.

Plans:

A) Input-file info for preparing jobs

• Show number of files already downloaded, number of files left to download
• Show info about time used so far for downloads (see B)
• Show info about download speed min, max, avg for the files downloaded so far
• Show detailed list of download speed for the files downloaded so far file by file

B) Duration of preparation step for a certain job Input:

• jobid

Output

• It datastaging is done: total duration of datastaging
• It datastaging still ongoing: duration until now

C) Duration overview/summary of jobs within a chosen timewindow Input:

• argument for: days,hours,minutes,seconds Output: S* orted list of jobs - longest prep to shortest prep
• Sorted list of jobs - not yet done - sort by start-time

D) Cache-locks - to be discussed