Skip to content

Datastaging information capability extension for arcctl (Fixes BUGZ-3906)

Maiken requested to merge dev-arcctl_datastaging_addition into master

Extention of datadelivery information for arcctl. Mostly for jobs where datadelivery is ongoing, but some information might also be gathered for jobs that are done in PREPARING. In that case the arcctl accounting could be used instead, will think about that as I go.

Goal: to give some useful overview in times where there are datastaging problems on the site, or just for general information about typical times used in datastaging.

Plans:

A) Input-file info for preparing jobs

  • Show number of files already downloaded, number of files left to download
  • Show info about time used so far for downloads (see B)
  • Show more detailed info about the different stages of the file in datastaging and the average download speed

B) Duration of preparation step for a certain job

  • If datastaging is done: total duration of datastaging
  • If datastaging still ongoing: duration until now

C) Duration overview/summary of jobs within a chosen timewindow

  • Sorted list of jobs - longest prep to shortest prep
  • Sorted list of jobs - not yet done - sort by start-time

D) Cache-locks - to be discussed

E) DTR-states

  • Show current dtr-states (from dtr.state file)
Edited by Maiken

Merge request reports