Skip to content

Draft: Enhancing the arcctl datastaging job get-totaltime

Maiken requested to merge maikenp/arc:arcctl_datastaging_tottime into next

Enhancing the arcctl datastaging job get-totaltime to fetch total datastaging download time also for finished jobs. If that is the case it fetches the information from accounting.

Output if the job is INRLMS or PREPARING:

[root@uio-atlas-ce1 control]# arcctl datastaging job get-totaltime 9862b36a79da

Total datastaging duration for jobid 9862b36a79da - job is currently INLRMS
	Start                 	End                   	Duration    
	2024-10-22T12:19:46Z  	2024-10-22T12:20:03Z  	0:00:17

Output if the job is FINISHED (or really, if there is no .grami file..)

[root@uio-atlas-ce1 control]# arcctl datastaging job get-totaltime fa906bc08d98

Total datastaging duration for jobid fa906bc08d98 - job is FINISHED - fetching information from accounting.

Remotely downloaded files
	Start                    End                      Duration     Size  Nfiles
	2024-10-22 01-06-25:24   2024-10-22 01-30-35:24   0:24:10      1.1G       3

Cached files
	Start                    End                      Duration     Size  Nfiles
	2024-10-22 01-06-24:24   2024-10-22 01-57-58:24   0:51:34      1.1G       2

Grand totals
	Start                    End                      Duration     Size  Nfiles
	2024-10-22 01-06-25:24   2024-10-22 01-57-58:24   0:51:33      1.1G       5

There is more information when the job is finished, since I then fetch info from accounting database instead of the logfiles. I do not really want to expand the information fetched from the logfiles, so if the extra information is unfortunate, since then users might want it for the INLRMS/PREPARING jobs too - I could remove it, until I eventually find a good way to fetch the extra info (size and nfiles) from the logs too.

Merge request reports