ChangeLog 36.3 KB
Newer Older
1 2 3 4 5
2017-12-08 Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Turned on multicore single node scratch by default
    Revs: {33327}  
    Type: bugfix

6 7 8 9 10
2017-11-22 Florido Paganelli <florido.paganelli@hep.lu.se>
  * port of ARC VO patch from trunk for bug 3686
    Revs: {33318}
    Type: bugfix

11 12 13 14 15 16
2017-11-21  Florido Paganelli <florido.paganelli@hep.lu.se>
  * Second patch for negative numbers in GLUE2 VO ComputingShares
    (bug 3686)
    Revs: {33316}
    Type: bugfix

17 18 19 20 21
2017-09-13 Florido Paganelli <florido.paganelli@hep.lu.se>
  * Patch for negative numbers in GLUE2 VO ComputingShares
    Revs: {33017}
    Type: bugfix

22 23 24 25 26
2017-06-29 Martin Skou Andersen <skou@nbi.dk>
  * Removing support for java
    Revs: {32748}
    Type: feature removement

27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57
2017-05-26 Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
  * Fix for multiple file transfers cross-affecting transferred sizes
    Revs: {32506}
    Type: bugfix

2017-05-26 Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
  * File handles leaks and improper usage fixes
    Revs: {32468,32469,3247132472,32473,32474,32507}
    Type: bugfix

2017-05-26 Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
  * Loadable modules loading speed-up and possible botleneck removal
    Revs: {32455,32578}
    Type: bugfix

2017-05-26 Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
  * Replacing unreliable Glib sprocess spawning with pure fork
    Revs: {32410,32441}
    Type: bugfix

2017-05-26 Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
  * SQLite delegation storage speed-up
    Revs: {32400,32401}
    Type: bugfix

2017-05-26 Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
  * Numerous memory leaks and corruptions fixed.
    Revs: {32357,32358,32359,32360,32363,32364,32365,32366,32367,32368,32370,32372,32372,32373,32374,32395,32469,32462}
    Type: bugfix


58 59 60 61
2017-05-12 Andrii Salnikov <manf@grid.org.ua>
  * ARCHERY client implementation
    Type: new feature

62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99
2017-03-28 Maiken Pedersen <maiken.pedersen@fys.uio.no>
  * Arex-ganglia integration is now working. New histograms have also been included.
    Feature is configurable using enable_ganglia="yes" and ganglialocation="<path>" (usually /usr/bin).
    Revs:{31856,31859,31870,31875,31876,31877,31880} also linked with Aleksandr Konstantinovs commits
    Revs:{31864,31879,31899}
	
2017-03-03 Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
  * Ganglia support for job state changes integrated directly into A-Rex.
    Revs: {31864,31879,31899}
    Type: enhancement

2017-01-28 Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
  * Handle unexpected callback in GridFTP related code. Improves stability of GridFTP DMC.
    Revs: {31889, 31890, 31894, 31895}
    Type: bugfix

2017-01-25 Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
  * Introduced support for sqlite as delegation database. To replace unstable BDB.
    Revs: {31777,31779,31784}
    Type: bugfix
	
2017-02-24 Florido Paganelli <florido.paganelli@hep.lu.se>
  * Removal of heartbeat between A-REX and infoproviders.
    (bugs 2036,3573)
    A consequence of these fixes is that A-REX should be more stable,
    but infoproviders might take more time. In particular:
    - The default infoproviders timeout is changed to 3 hours
    - The default bdii timeout is changed to 6 hours
    Revs:{31857,31858,31871,31873}
    DocRevs:{31872,31874}
    Type:bug
    
  * Removal of leftover code from old infoproviders, namely support
    for gridftp storage. (bug 3286)
    ARC can no longer publish gridftp Storage Element information.
    Revs:{31866,31867,31868,31869}
    Type: bug

100 101
2017-02-24 David Cameron <d.g.cameron@fys.uio.no>
  * Add new option to allow all data transfer log messages to be collected in
102 103 104
    a central log (bug 2598)
    Revs:{31885}
    Type:minor
105

106 107 108 109 110 111 112 113 114 115 116 117 118
2016-12-15 Aleksandr Konstantinov <@>
  * Fixed bug 3599 
    Revs:{31454}  
    Type:bug

2016-12-13 Aleksandr Konstantinov <@>
  * Fixed bug 3622 
    Revs:{31651}  
    Type:bug
  * Fixed bug reported on mailing list
    Revs:{31653}  
    Type:bug

119 120 121 122 123 124 125 126 127 128 129 130
2016-12-13 Florido Paganelli <florido.paganelli@hep.lu.se>
  * Reduced frequency of infoproviders performance data collection
    to half an hour. This solves bug #3616 .
    Users are encouraged to clean up the folder where the NYTProf performance
    collection is stored, called perl_nytprof. Default location is
      /var/log/arc/perfdata/perl_nytprof
    It is safe to run 
      rm -f /var/log/arc/perfdata/perl_nytprof/*
    while A-REX is running. 
    Revs:{31600,31649}
    Type:bug

Christian Søttrup's avatar
Christian Søttrup committed
131 132 133 134 135 136 137 138 139 140 141 142 143
2016-12-09 Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Added support for lowercase slurm in arc.conf to match other LRMS
    Revs:{31580}  
    Type:minor

2016-12-09 Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Fixed bug 3603 
    Revs:{31566,31567}  
    Type:bug
  * Fixed problem in condor info backend reported by Frederic Schaer
    Revs:{31569}  
    Type:bug

144 145 146 147 148 149 150 151 152
2016-12-08 Florido Paganelli <florido.paganelli@hep.lu.se>
  * Fixed issues with paths and SLURM support in PerfData.pl
    Revs:{31557,31558,31576}  
    Type:bug
  * Data collection in perferator is now done using PerfData.pl 
    instead of nytprofmerge (attempts to ease issues in bug #3616)
    Revs:{31578,31579}  
    Type:minor
  
153
2016-12-02 Martin Skou Andersen <skou@nbi.dk>
154
  * Support output redirection from shell in arccat (fixes bug 3613) [bugfix;{31582}]
155

156 157 158 159 160 161 162 163 164 165 166 167 168 169 170
2016-11-30 Aleksandr Konstantinov <@>
  * Fixed bug 3538 
    Revs:{31577}  
    Type:bug

2016-11-24 Aleksandr Konstantinov <@>
  * Fixed bug 
    Revs:{31568}  
    Type:bug

2016-11-03 Aleksandr Konstantinov <@>
  * Fixed bug 3596 
    Revs:{31516}  
    Type:bug

171 172 173
2016-10-31 Andrii Salnikov <manf@grid.org.ua>
  * [ARC 6] New RunTimeEnvironemnt handling approach without sharing a scripts
    directory
174
  * Introducing system-defined RTE location in /usr/share/arc/rte/ in addition
175 176 177
    to user-defined in arc.conf
  * ENV/PROXY and ENV/RTE scripts to be packaged

178 179 180 181 182 183 184 185 186 187 188 189 190 191 192
2016-10-29 Aleksandr Konstantinov <@>
  * Partially fixed bug 3557 
    Revs:{31512}  
    Type:bug

2016-10-24 Aleksandr Konstantinov <@>
  * Fixed bug 3610 
    Revs:{31473}  
    Type:bug

2016-10-20 Aleksandr Konstantinov <@>
  * Fixed bug 3604, 3586, 3579 
    Revs:{31460, 31461, 31462}  
    Type:bug

Florido Paganelli's avatar
Florido Paganelli committed
193
2016-10-03 Florido Paganelli <florido.paganelli@hep.lu.se>
194
  * Added PerfData.pl, an offline script to generate
Florido Paganelli's avatar
Florido Paganelli committed
195 196 197 198
    ARC performance data collected from a NYTProf database file
    generated by infoproviders.
    {31117,31347}

Florido Paganelli's avatar
Florido Paganelli committed
199 200 201 202
2016-08-25 David Cameron <d.g.cameron@fys.uio.no>
  * Added new configuration options hostname and port in the acix/cacheserver
    block

203 204 205 206 207
2016-08-09 Aleksandr Konstantinov <@>
  * Introduced tool for converting delegation database  
    Revs:{31122}  
    Type:user friendliness

Florido Paganelli's avatar
Florido Paganelli committed
208
2016-07-07 Florido Paganelli <florido.paganelli@hep.lu.se>
209
  * Added support for VO in the GLUE2 schema. Every authorizedvo will
Florido Paganelli's avatar
Florido Paganelli committed
210
    generate a different ComputingShare with statistics about the defined VO.
211
    For minimum backward compatibility there is a Share without any VO
212
    that presents information the same way ARC did before this change,
213
    but doesn't list all the VOs as in the previous version.
214 215
    This breaks backward compatibility with EMIES clients.
    {29933,30067,30077,30078,30288,30582,30583,31498}
Florido Paganelli's avatar
Florido Paganelli committed
216

217 218 219 220 221
2016-07-05 Aleksandr Konstantinov <@>
  * Support for faking VOMS assignment of user on cluster size
    Revs:{31020}  
    Type:flexibility enhancement

222 223 224
2016-07-04 David Cameron <d.g.cameron@fys.uio.no>
  * Added support for using Rucio as a proxy to read/write to objectstores

225 226 227 228
2016-07-04 David Cameron <d.g.cameron@fys.uio.no>
  * Added new URL option "relativeURI" to force HTTP operations to use relative
    paths

229 230 231
2016-06-13 David Cameron <d.g.cameron@fys.uio.no>
  * Changed the third parameter of cacheaccess to allow regular expressions

232 233 234 235 236 237 238 239 240 241
2016-05-24 Aleksandr Konstantinov <@>
  * Fixed bug 3561 
    Revs:{30285}  
    Type:bug

2016-05-22 Aleksandr Konstantinov <@>
  * Fixed bug 3560, 3558 
    Revs:{30266}  
    Type:bug

242 243
2016-04-19 David Cameron <d.g.cameron@fys.uio.no>
  * Added new URL option "failureallowed" - if set then a failed transfer does
244
    not fail the job
245

David Cameron's avatar
David Cameron committed
246 247 248 249
2016-03-30 David Cameron <d.g.cameron@fys.uio.no>
  * Changed behaviour of gridftp jobplugin so it does not restart failed jobs
    automatically when proxy is renewed.

David Cameron's avatar
David Cameron committed
250 251 252 253
2016-03-18 David Cameron <d.g.cameron@fys.uio.no>
  * Add new options for performance reporting: enable_perflog_reporting and
    perflogdir

254 255 256 257 258 259 260 261 262 263
2016-02-29 Aleksandr Konstantinov <@>
  * Extended authorization to WS interfaces
    Revs:{30064}  
    Type:bug

2016-01-29 Aleksandr Konstantinov <@>
  * Fixed conflict of internal code with VOMS libraries
    Revs:{29976}  
    Type:bug

264 265
2016-01-19 Andrii Salnikov <manf@grid.org.ua>
  * Nordugridmap code changes to keep log records format the same across all ARC components
266 267
  * Review of log messages text in nordugridmap
  * Logging to file now enabled by default in nordugridmap
268

Szigeti Gabor's avatar
Szigeti Gabor committed
269 270 271
2015-11-17  Gabor Szigeti <szigeti@niif.hu>
  * Add file trasnfer statistics information to SGAS accounting record. (fixes bug #3519)

272 273 274
2015-09-10 Anders Waananen <waananen@nbi.dk>
  * Remove uploader and downloader binaries

Christian Søttrup's avatar
Christian Søttrup committed
275 276 277
2015-06-18 Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Bugfix: fixed file permission filter in submit-condor-job

278 279 280
2015-06-18  Gabor Szigeti <szigeti@niif.hu>
  * Add accounting records re-report functionality by JURA. (fixes bug #3458)

281
2015-06-10  Martin Skou Andersen <skou@nbi.dk>
282
  * [JobSupervisor] Add method for selecting jobs using custom selector class (fixes bug 3484).
283 284
  * [Python examples] Better checking of python examples.

285 286 287 288
2015-06-04 Andrii Salnikov <manf@grid.org.ua>
  * Added options to allow to set ownership/permissions on generated
  gridmapfile

289 290 291
2015-06-02  Gabor Szigeti <szigeti@niif.hu>
  * Extend (with timestamp) JURA's log to long format. (fixes bug #3480)

Christian Søttrup's avatar
Christian Søttrup committed
292
2015-04-28  Christian Ulrik Søttrup <soettrup@nbi.dk>
293
  * Changed priority calculation for SGE jobs to only negative priorities.
Christian Søttrup's avatar
Christian Søttrup committed
294 295
  * fixed comment typos.

296 297 298
2015-03-28  Gabor Roczei <roczei@niif.hu>
  * Bugfix: adding correct free slot number to SLURM partition

299
This can be usefuly in a
300 301
    multicore system where the jobs can use more than one core

302 303 304 305
2015-03-23  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Changed scan-ll-job to use Luca's method. Should solve 3395 for Rod and improve performance.
  * Added Luca to AUTHORS

306 307 308 309
2015-03-19  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Fixed a possible double output of nodename to diag in PBS and SLURM
  * Added a baseline nodecount to diag file

310 311 312
2015-03-18  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Added a infosystem support for new format of exec_host in PBS backend

313 314 315 316
2015-03-10  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Fixed wrong debug output in Condor.pm
  * Added option to use sacct in slurm backend

Christian Søttrup's avatar
Christian Søttrup committed
317
2015-01-26  Christian Ulrik Søttrup <soettrup@nbi.dk>
318
  * Added a defined check to LL.pm for hosts and walltime to get rid of
Christian Søttrup's avatar
Christian Søttrup committed
319 320 321 322 323 324
    undefined warnings when running perl with strict.

2015-01-22  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Added a check for the availability of qacct to the sge backend,
  * Changed RegExp to work for several version of llstatus in LL.pm

325 326 327 328
2015-01-22  David Cameron <d.g.cameron@fys.uio.no>
  * Add new arc.conf option cachespacetool to allow a user-specified tool for
    the cache cleaner to find file system space information.

Christian Søttrup's avatar
Christian Søttrup committed
329 330
2015-01-20  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * change submit_common.sh to use compat config parser.
Christian Søttrup's avatar
Christian Søttrup committed
331
  * added warning to backend log, when requesting less than 0 cpu/wall time
Christian Søttrup's avatar
Christian Søttrup committed
332 333 334 335 336 337 338 339

2015-01-16  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Added support for job priority in backends: Condor,LL,LSF,PBS,SGE,SLURM

2015-01-15  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Added support for recognizing suspended jobs in newer condor versions
  * Added support for per job history file in condor backend

340 341 342 343
2015-01-14  David Cameron <d.g.cameron@fys.uio.no>
  * Add new arc.conf option cacheshared to enable better management of caches on
    filesystems shared with other data.

Szigeti Gabor's avatar
Szigeti Gabor committed
344 345 346
2015-01-12  Gabor Szigeti <szigeti@niif.hu>
  * Accounting message publisher update to SSM 2.1.5.

Christian Søttrup's avatar
Christian Søttrup committed
347 348 349 350 351 352
2014-12-19  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * removed bashisms in condor and boinc backends.

2014-12-16  Christian Ulrik Søttrup <soettrup@nbi.dk>
  * Changed "ExecutionUnits" default in submit common to "Processors" to match accounting

353
2014-12-11  Anders Waananen <waananen@nbi.dk>
Anders Waananen's avatar
Anders Waananen committed
354 355
  * Remove gridsite dependency and therefore gridftpd gacl file support
  * Remove arcacl client utility
356

357 358 359 360
2014-12-11  David Cameron <d.g.cameron@fys.uio.no>
  * Remove old data-staging related code. Move all data-staging options in
    arc.conf to [data-staging] section.

361 362 363 364 365
2014-12-05 Jon Kerr Nilsen <j.k.nilsen@usit.uio.no>
  * Remove confusa (moved to obsolete)
  * Move echo services to examples dir
  * Remove arcmigrate

Anders Waananen's avatar
Anders Waananen committed
366 367 368
2014-12-02  Anders Waananen <waananen@nbi.dk>
  * Removed LFC and DQ2 DMCs

369 370 371
2014-11-25  Gabor Roczei <roczei@niif.hu>
  * Adding ComputingShare->WaitingJobs GLUE2 attribute to ARC1 target retriever, because FastestQueueBroker require it

Szigeti Gabor's avatar
Szigeti Gabor committed
372 373 374
2014-11-17  Gabor Szigeti <szigeti@niif.hu>
  * Replace the mainnode to headnode URL in the recordID. (fixes bug #3435)

Szigeti Gabor's avatar
Szigeti Gabor committed
375
2014-10-20  Gabor Szigeti <szigeti@niif.hu>
376
  * Set extra VO Group attribute to every generated CAR accounting record
Szigeti Gabor's avatar
Szigeti Gabor committed
377 378
    if the proxy does not contains VOM attributes. (fixes bug #3404)

Szigeti Gabor's avatar
Szigeti Gabor committed
379 380 381
2014-09-02  Gabor Szigeti <szigeti@niif.hu>
  * Set extra VO attribute to every generated CAR accounting record. (fixes bug #3404)

Szigeti Gabor's avatar
Szigeti Gabor committed
382 383 384
2014-08-08  Gabor Szigeti <szigeti@niif.hu>
  * Accounting message publisher update to SSM 2.1.3.

385 386 387
2014-08-07  Gabor Roczei <roczei@niif.hu>
  * Bug fixed: SGE BDII integration has problems with long hostnames (#3306)

388 389 390
2014-08-06  Gabor Szigeti <szigeti@niif.hu>
  * Add new configuration option that able to set the frequency of accouting
    message publishing. (fixing bug #3399)
391

392 393 394
2014-07-28  Gabor Roczei <roczei@niif.hu>
  * Bug fixed: down nodes cause SGEmod to fail (#3303)

395 396 397
2014-05-09  David Cameron <d.g.cameron@fys.uio.no>
  * Add writing/deleting capability to xrootd DMC

398 399 400 401
2014-05-09  Jon Kerr Nilsen <j.k.nilsen@usit.uio.no>
  * Add Rerun option as nordugrid extension to ADL - needed to enable arcresume
    for EMI-ES (fixes bug 3266).

Martin Skou Andersen's avatar
Martin Skou Andersen committed
402 403 404 405
2014-03-05  Martin Skou Andersen <skou@nbi.dk>
  * Only parse second part of the inputfiles xRSL attribute value as file size
    and checksum for GM input (fixes bug 3334). Als simplify parsing of this
    attribute.
406

Martin Skou Andersen's avatar
Martin Skou Andersen committed
407 408 409 410 411 412 413 414 415 416
2014-03-04  Martin Skou Andersen <skou@nbi.dk>
  * Fix invalid C++ code generated by swig 2.0.12.

2014-02-27  Martin Skou Andersen <skou@nbi.dk>
  * arctest: Print job description, client version and name of computing service
    test job is submitted to (fixes bug 2947).

2014-02-26  Martin Skou Andersen <skou@nbi.dk>
  * Print summary for arcstat (fixes bug 3145).
  * Improve parsing of the JSDL RangeValue_Type type (fixes bug 2352).
417

David Cameron's avatar
David Cameron committed
418 419 420
2014-02-26  David Cameron <d.g.cameron@fys.uio.no>
  * Add Rucio DMC for access to new ATLAS data management system

Martin Skou Andersen's avatar
Martin Skou Andersen committed
421 422 423 424 425 426 427 428 429 430 431 432 433 434 435
2014-02-25  Martin Skou Andersen <skou@nbi.dk>
  * Make it possible in arcstat to print jobs whose status information is not
    available (fixes bug 3240). Add information to man pages. Print status
    information in Job::SaveToStream method even if state is undefined.
  * Print warning when attempting to retrieve job with no output files, also do
    not count such jobs as retrieved in arcget summary (fixes bug 2946).
  * Quote job name when sending notification email (fixes bug 3339). Add some
    more logging information.

2014-02-25  Martin Skou Andersen <skou@nbi.dk>
  * Only list specific state for job in long output (fixes bug 3178).

2014-02-21  Martin Skou Andersen <skou@nbi.dk>
  * Make path to Berkeley DB absolute (fixes bug 3340).

436
2014-02-20  Anders Waananen <waananen@nbi.dk>
437
  * Add arc-blahp-logger
438

439 440 441
2014-02-20  Anders Waananen <waananen@nbi.dk>
  * Remove obsolete (not used) perl module LRMS.pm

Martin Skou Andersen's avatar
Martin Skou Andersen committed
442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459
2014-02-19  Martin Skou Andersen <skou@nbi.dk>
  * Add verbose log message which shows the invoked command for job management
    CLI.
  * Add function which converts a string case-insensitively to a LogLevel
    object.
  * Treat specified log level to commands, in configuration etc. as
    case-insensitive.

2014-02-18  Martin Skou Andersen <skou@nbi.dk>
  * Add default port and path arguments to URL constructor.
  * Use URL constructor with defaults for constructing URLs in ACCs (fixes issue
    with IPv6 addresses, bug 3331).

2014-02-17  Martin Skou Andersen <skou@nbi.dk>
  * Add default port and path arguments to URL constructor.
  * Use URL constructor with defaults for constructing URLs in ACCs (fixes issue
    with IPv6 addresses, bug 3331).

460 461 462 463
2014-01-31  David Cameron <d.g.cameron@fys.uio.no>
  * Add acix_endpoint option to arc.conf to allow A-REX to download cached
    replicas of input files from other sites

David Cameron's avatar
David Cameron committed
464 465 466
2014-01-22  David Cameron <d.g.cameron@fys.uio.no>
  * Add ACIX DMC to allow discovery of locations of cached copies of data

Anders Waananen's avatar
Anders Waananen committed
467 468 469 470 471 472
2013-12-26  Anders Waananen <waananen@nbi.dk>
  * Package Boinc lrms

2013-12-26  Wenjing Wu <Wenjing.Wu@cern.ch>
  * Add Boinc lrms

473 474 475
2013-12-06  David Cameron <d.g.cameron@fys.uio.no>
  * Use 'anonymous' username by default for ftp listing (fixing bug #3312)

476 477 478
2013-11-27  Gabor Szigeti <szigeti@niif.hu>
  * Add VO filter to the jobreporter. (fixing bug #3302)

Szigeti Gabor's avatar
Szigeti Gabor committed
479 480 481
2013-11-19  Gabor Szigeti <szigeti@niif.hu>
  * Do not create new element in the aggregation record for every record. (fixing bug #3301)

482 483 484
2013-11-15  Anders Waananen <waananen@nbi.dk>
  * Remove the arc-ur-logger since jura is now a drop-in replacement

485 486 487
2013-11-13  Anders Waananen <waananen@nbi.dk>
  * Remove the old ngclient2arc utility

488
2013-11-13  Anders Waananen <waananen@nbi.dk>
489
  * Support unit tests for the alternative python
490 491 492 493 494
  * Support unit tests for python 3
  * Reorganise build tree layout for python to make unit tests simpler
  * Add -py3 option to swig if using python3
  * Move python shared library (_arc.*) to <site-packages>

David Cameron's avatar
David Cameron committed
495 496
2013-11-13  David Cameron <d.g.cameron@fys.uio.no>
  * Remove option to use old downloader and uploader for data staging
497
  * Add ability to expose cache content through A-REX web interface
David Cameron's avatar
David Cameron committed
498

Anders Waananen's avatar
Anders Waananen committed
499 500 501
2013-11-12  Anders Waananen <waananen@nbi.dk>
  * Remove the HED cache client

502 503 504
2013-11-12  Anders Waananen <waananen@nbi.dk>
  * Remove the Chelonia DMC (libdmcarc.so) which handles the arc:// protocol

Szigeti Gabor's avatar
Szigeti Gabor committed
505 506 507 508 509 510 511
2013-11-11  Gabor Szigeti <szigeti@niif.hu>
  * Rename the RuntimeEnvironment element by the UR that send to SGAS. (fixing bug #3297)

2013-11-05  Gabor Szigeti <szigeti@niif.hu>
  * Add "JURA-ARC-" prefix for an Infrastructure's description in a CAR. Requested by APEL.
  * Extend the LocalJobId with the endtime in UTC Time format by the SGAS URs. (fixing bug #3288)

512 513 514
2013-11-05  Anders Waananen <waananen@nbi.dk>
  * Add support for ptyhon3 bindings. (fixing bug #3276)

515 516 517
2013-10-31  Gabor Szigeti <szigeti@niif.hu>
  * Remove the unnecessary "s" from the reported Processors value. (fixing bug #3289)

Florido Paganelli's avatar
Florido Paganelli committed
518 519 520
2013-10-30  Florido Paganelli <florido.paganelli@hep.lu.se>
   * Added support for cluster_alias option in GLUE2, as ServiceName.
   * Default Validity of GLUE2 information is set to 10 minutes.
521
   * AdminDomain Name is now validated by 'service a-rex validate' to
Florido Paganelli's avatar
Florido Paganelli committed
522
   avoid infosystem to crash at startup
523 524
   * LDAP DNs containing characters that needs to be base64 encoded are
   now skipped and not published. This mostly affects NorduGrid schema
Florido Paganelli's avatar
Florido Paganelli committed
525 526
   nordugrid-authuser-name objects.

527 528 529
2013-10-18  Gabor Szigeti <szigeti@niif.hu>
  * Collecting processor count information from the backend (SGE, SLURM) into the accounting record.

530 531 532 533
2013-10-17  David Cameron  <d.g.cameron@fys.uio.no>
   * Add DQ2 DMC to allow download of ATLAS files using dataset and LFN.
     The URL convention is dq2://atlddmcat-reader.cern.ch/dataset/lfn

534 535 536 537
2013-10-08  Gabor Szigeti <szigeti@niif.hu>
  * Collecting information for the aggregation records during the accounting messsage sending procedure.
  * Send APEL sync record after every successfully sent CAR message. Partly fixes bug 3269.

538 539 540 541
2013-08-30  Martin Skou Andersen <skou@nbi.dk>
  * Enable client job management tools to be able to use Berkeley database for
    storing information about jobs.

542 543 544 545
2013-08-21  Martin Skou Andersen <skou@nbi.dk>
  * EMI-ES: Make use of bulk operations when retrieving list of jobs from
    service. Performance improvement to arcsync. On the way to fixing bug 3099.

546 547 548 549 550
2013-08-20  Martin Skou Andersen <skou@nbi.dk>
  * arcsync: Pass timeout value specified on command-line to used UserConfig
    object. Previously arcsync ignored the specified timeout value. Fixes bug
    3243 - a consequence of an unintentional omission in revision 12298.

551 552 553 554 555
2013-08-05  Martin Skou Andersen <skou@nbi.dk>
  * EMI-ES: Make use of bulk operations when submitting jobs directly to a
    submission endpoint (i.e. using the '--direct' flag with arcsub). On the way
    to fixing bug 3099.

556 557 558 559
2013-07-17  Gabor Szigeti <szigeti@niif.hu>
  * Add new (use_ssl) configuration option that can be use during the communication
    with a production accounting server.

Szigeti Gabor's avatar
Szigeti Gabor committed
560 561
2013-06-26  Gabor Szigeti <szigeti@niif.hu>
  * Fixed ServiceLevel value and type in the accounting records.
562

563 564
2013-06-10  Gabor Szigeti <szigeti@niif.hu>
  * Option for setting benchmark parameters in the CAR from the arc.conf.
565

566 567 568
2013-06-05  Dmytro Karpenko  <dmytrok@fys.uio.no>
  * Support for job exclusive execution in Condor.

Szigeti Gabor's avatar
Szigeti Gabor committed
569 570 571
2013-05-10  Gabor Szigeti <szigeti@niif.hu>
  * Better VO group and role parsing mechanism by the CAR.

Szigeti Gabor's avatar
Szigeti Gabor committed
572 573 574
2013-05-02  Gabor Szigeti <szigeti@niif.hu>
  * Accounting message publisher update to SSM 2.1.0.

575 576 577 578
2013-04-23  David Cameron  <d.g.cameron@fys.uio.no>
  * Split log for A-REX WS-interface operations into separate file, specified
    by wslogfile in arc.conf. Default is /var/log/arc/ws-interface.log.

Szigeti Gabor's avatar
Szigeti Gabor committed
579
2013-04-22  Gabor Szigeti <szigeti@niif.hu>
580
  * Fixed wrong VO attribute that leading '/' character in the CAR. Required
Szigeti Gabor's avatar
Szigeti Gabor committed
581 582
    for the APEL. (fixes bug #3152)

David Cameron's avatar
David Cameron committed
583 584 585
2013-04-17  David Cameron  <d.g.cameron@fys.uio.no>
  * Add support for in-memory credentials for http and gsiftp-based protocols
    and use in data staging to avoid the need for creating temporary proxies.
586

587 588 589 590
2013-04-16  Martin Skou Andersen  <skou@nbi.dk>
  * EMI-ES: Make use of bulk queries (vector operations in EMI ES terminology)
    when retrieving job information. Partly fixes bug 3099.

591 592 593 594
2013-04-12  Gabor Roczei <roczei@niif.hu>
  * SGE bugfix (#2714), the SGE backend will detect the MainMemorySize
  * SGE bugfix (#2716), correct handling of the Eqw SGE state

Dmytro Karpenko's avatar
Dmytro Karpenko committed
595
2013-03-19  Dmytro Karpenko <dmytrok@fys.uio.no>
596
  * Condor configuration options in arc.conf have been revised. Condor users are
Dmytro Karpenko's avatar
Dmytro Karpenko committed
597 598 599
    strongly advised to check the updated Condor configuration manual
    http://www.nordugrid.org/documents/condor-config.html

Szigeti Gabor's avatar
Szigeti Gabor committed
600 601 602
2013-03-19  Gabor Szigeti <szigeti@niif.hu>
  * Configurable Site attribute from the arc.conf. Required for the APEL.
    (fixes bug #3126)
603

604
2013-02-06  Martin Skou Andersen  <skou@nbi.dk>
605
  * Adding support in library for storing job information in a Berkeley DB.
606

607 608 609
2013-01-31  Florido Paganelli, Mattias Ellert <florido.paganelli@hep.lu.se> <mattias.ellert@fysast.uu.se>
  * Improved bdii-update automatical configuration. BDII configuration commands
    are no longer needed in the [infosys] configuration block.
610

611 612 613
2013-01-29  Dmytro Karpenko <dmytrok@fys.uio.no>
  * SLURMmod.pm plugin with native ARC1 API is introduced.

614
2013-01-29  Anders Waananen <waananen@nbi.dk>
615
  * Make arc-ur-logger use ARC python api to retrieve information in proxy
616 617
     instead of relying on voms-proxy-info (fixes bug #2597).

Szigeti Gabor's avatar
Szigeti Gabor committed
618 619 620 621
2013-01-29  Gabor Szigeti <szigeti@niif.hu>

  * Use 2.0.0 version of SSM to the message sending.

622 623
2013-01-25  Anders Waananen <waananen@nbi.dk>
  * Rename perftest to arcperftest and add a man page.
624 625 626
  * Move some test and misc tools to a new sub package
    nordugrid-arc-misc-utils (fixes bug #3048):
      arcwsrf, arcemiestest, arcperftest, saml_assertion_init
627

Gabor Roczei's avatar
Gabor Roczei committed
628 629 630
2013-01-21  Gabor Roczei  <roczei@niif.hu>
  * Several exclusive execution related bug fixes

Szigeti Gabor's avatar
Szigeti Gabor committed
631
2013-01-22  Gabor Szigeti <szigeti@niif.hu>
632

Szigeti Gabor's avatar
Szigeti Gabor committed
633 634 635
  * Add VO attributes to the reported accounting record. (fixes bug #3003)
  * Use different filename for the different achiving record (UR or CAR).

636 637 638 639 640 641 642
2013-01-15  Martin Skou Andersen  <skou@nbi.dk>

  * Improved backwards compatibility when reading job list files (client side).
    Job records from 1.x and 2.x is supported, 1.x and 2.x does not support the
    format used in 3.x. Support for NOX job record format is dropped. As always
    'arcsync' can be used to recover the job list.

643 644 645 646
2013-01-15  Florido Paganelli <florido.paganelli@hep.lu.se>

  * Added infosys support for openldap2.4 on SLX distributions

Martin Skou Andersen's avatar
Martin Skou Andersen committed
647 648 649 650 651
2012-12-30  Martin Skou Andersen  <skou@nbi.dk>

  * Extending xRSL parser to parse "countpernode" and "exclusiveexecution"
    attributes used for expressing parallel setup requirements.

652 653 654 655
2012-12-20  Martin Skou Andersen  <skou@nbi.dk>

  * Extending arctest to print DNs of installed CA-certificates.

Anders Waananen's avatar
Anders Waananen committed
656 657 658 659
2012-12-19  Anders Waananen <waananen@nbi.dk>

  * Remove RLS support

660 661
2012-12-19  Martin Skou Andersen  <skou@nbi.dk>

662
  * [Java] List classes in ARC Java bindings now implements the Iterable Java
663 664 665
    interface. That makes it possible to use list objects in Java foreach
    statement. Addapting the listiterator classes in order to comply with the
    Java Iterator interface which those classes now implements.
666

667 668 669 670 671
2012-12-12  David Cameron  <d.g.cameron@fys.uio.no>

  * Add ability to run DataDelivery service without the need for a host
    certificate. See documentation for configuration details.

672
2012-12-12  Christian Søttrup  <soettrup@nbi.dk>
673

Christian Søttrup's avatar
Christian Søttrup committed
674 675 676 677 678
  * Removed GridFactory back-end
  * Added GRAMI support for EMI-ES parallel specification
  * Added parallel support in the LoadLeveler back-end
  * Fixed bug in DGBridge back-end

679
2012-12-12  Dmytro Karpenko  <dmytrok@fys.uio.no>
680

681 682
  * Added support for GLUE2 in SLURM infoprovider (fixes bug 2904)

683
2012-12-06  Martin Skou Andersen  <skou@nbi.dk>
684

685
  * Significant fixes and cleanup in the CREAM job plugin.
686 687
  * Added submitting convenience methods to Submitter class which only takes
    endpoints and job descriptions as arguments.
688 689
  * Extended arcsub to be able to submit directly to submission endpoints (no
    resource discovery and matchmaking).
690

691 692 693 694
2012-11-26  David Cameron  <d.g.cameron@fys.uio.no>

  * Change recursion options for arccp and arcls. -r specifies infinite
    recursion and -D is used for a specific level or recursion.
695 696
  * Change A-REX default data staging mechanism to DTR. The old system can
    still be used by setting enable_dtr="no" in arc.conf.
697 698
  * Change DataPoint API - Check() now takes a bool parameter to determine
    whether metadata information should be obtained during permission check.
699 700 701 702 703

2012-11-20  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>

  * Support for EMI ES interface version 1.16 implemented in A-REX service.

704 705
2012-11-17  Zsombor Nagy  <zsombor@niif.hu>

706 707 708
  * Changing the main attributes of the Job class, also in the jobs.xml:
    remove the Cluster and the InterfaceName attributes, change the JobID
    from URL to string, add ServiceInformation, JobManagement and
709
    JobStatus URL and InterfaceName attributes, and StageIn, StageOut and
710 711
    SessionDir attributes. (Hopefully it can still understand the previous
    versions of the jobs.xml.)
712

713 714
2012-11-14  Gabor Szigeti <szigeti@niif.hu>

715
  * [ldap-monitor] Add new column to the Queue table by GLUE2 rendering.
716

717 718 719
2012-11-14  Florido Paganelli   <florido.paganelli@hep.lu.se>

  * Finalized GLUE2 rendering:
720 721 722
    * Removed ARIS service. All endpoints are now shown inside
      the A-REX org.nordugrid.arex ComputingService. This makes the GLUE2
      rendering backward incompatible with previous versions of ARC.
723 724 725
    * Removed ComputingActivities from LDAP rendering. Can be enabled with
      infosys_glue2_ldap_showactivities new option.
    * Finalized EMI-ES rendering, one Endpoint per port-type
726
      including data capabilities. This obsoletes the experimental 12.05
727
      EMI-ES GLUE2 rendering and therefore makes this change backward
728
      incompatible.
729 730 731 732 733
    * added infosys_glue2_service_qualitylevel option for the sysadmin
      to set manually GLUE2 QualityLevel, useful for operations within
      EGI.
  * Implemented a solution for client to match GLUE2 Service ID even if
    looking at data from nordugrid schema.
734
  * Implemented a solution for the client to know which interface the
735 736 737 738
    job was submitted both in GLUE2 and Nordugrid schema.
  * Introduced a relay backend in ldap configuration for interoperability
    with GLUE2 top-bdii. Now an ARC CE can directly be aggregated by
    a top-bdii if ARIS ldap URL is configured correctly in GOCDB.
739
  * Changed the top element of glue1 schema to match the needs of
740 741 742 743 744
    Glue1 top-bdii; now ARC CE can directly be aggregated by top-bdii if
    ARIS ldap URL is configured correctly in GOCDB
  * Added several fixes to Glue1 schema thanks from contributions
    by Finnish partners: localse, queue names.

745
2012-11-13  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
746

747 748
  * EMI ES interface implemented in ARC client tools. See documentation
    and man pages for new interface names.
749

750 751
2012-11-10  Gabor Szigeti <szigeti@niif.hu>

752
  * Update the CAR accounting message version to 1.2.
753

754
2012-11-09  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
755 756

  * Communication with ARGUS PDP is implemented and integerated into A-REX.
757
    See documentation for new configuration options.
758

759 760 761 762 763 764
2012-11-08  Gabor Szigeti <szigeti@niif.hu>

  * Set the non-standard compilation prefix by ssm_master location.

2012-11-08  Gabor Szigeti <szigeti@niif.hu>

765 766
  * Send CAR 1.1 accounting message to the APEL destination. See documentation
    for configuration options.
767

768 769 770 771
2012-11-08  David Cameron  <d.g.cameron@fys.uio.no>

  * Remove support for per-user control directories in A-REX. Add support
    for substitutions in configuration based on dynamically mapped local user.
772
    See documentation for changes in configuration options.
773

774
2012-11-07  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
775 776

  * Administrator utility gm-jobs is extended to provide information about delegated
777 778
    tokens and filter jobs by identifier. See documentation and man pages for new
    options.
779

780 781 782 783 784
2012-11-03  Martin Skou Andersen <skou@nbi.dk>

  * Moving ClientInterface classes to new libarccommunication library.
    Renaming libarcclient library to libarccompute.

785 786 787 788
2012-11-02  Martin Skou Andersen <skou@nbi.dk>

  * [Python] Splitting python bindings into multiple modules (fixes bug 2934).

789 790 791 792
2012-10-31  Martin Skou Andersen <skou@nbi.dk>

  * [Java] Transparently load native ARC JNI-C++ library when using ARC Java
    bindings. Thus making it redundant to call 'System.loadLibrary("jarc")'.
793

Anders Waananen's avatar
Anders Waananen committed
794
2012-10-31  Anders Waananen <waananen@nbi.dk>
795

Anders Waananen's avatar
Anders Waananen committed
796 797
  * Add NSS as a dependency. Currently used only by arcproxy

798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814
2012-10-29  Gabor Szigeti <szigeti@niif.hu>

  * Fixed the logger url by the APEL destination. (fixes bug 2971)

2012-10-19  Gabor Szigeti <szigeti@niif.hu>

  * Fixed the published MachineName attribute by JURA. (fixes bug 2959)

2012-10-18  Gabor Szigeti <szigeti@niif.hu>

  * Update the regexp for a new type of JobID. (fixes bug 2958)

2012-10-18  Gabor Szigeti <szigeti@niif.hu>

  * Enabled GLUE2 schema rendering together with the old nordugrid schema
    in the ldap-monitor.

815
2012-10-17  Anders Waananen <waananen@nbi.dk>
816

817 818
  * Obsolete the python utility module arcom

819 820 821 822 823
2012-10-09  David Cameron  <d.g.cameron@fys.uio.no>

  * Move xrootd DMC out of plugins-globus package and into a new package
    nordugrid-arc-plugins-xrootd

824 825 826
2012-10-08 Weizhong Qiang <weizhong.qiang@fys.uio.no>

  * Security plugin (Argus PDP Client) supports the contact with Argus PDP
827 828
    server to achieve access control decision. Argus library dependency is
    not required for this plugin.
829

David Cameron's avatar
David Cameron committed
830 831 832 833 834
2012-10-05  David Cameron  <d.g.cameron@fys.uio.no>

  * Add new package nordugrid-arc-plugins-gfal which contains the GFAL DMC and
    depends on gfal2 (RHEL/Fedora only)

835 836 837 838 839 840
2012-10-03  David Cameron  <d.g.cameron@fys.uio.no>

  * Rename ngconfigtest to arc-config-check, install to libexec instead of bin
    and package with A-REX instead of common package. Add new "validate" option
    to a-rex init script which calls arc-config-check.

841 842 843 844
2012-10-01  David Cameron  <d.g.cameron@fys.uio.no>

  * Change configuration option "newdatastaging" to "enable_dtr"

845 846 847 848
2012-09-26  Mattias Ellert  <mattias.ellert@fysast.uu.se>

  * Rename libarcdata2 to libarcdata

849 850 851 852 853 854 855 856
2012-09-26  Gabor Szigeti <szigeti@niif.hu>

  * Parse the configured (optional) topic value from the server configuration.

2012-09-25  Gabor Szigeti <szigeti@niif.hu>

  * Send CAR records to the APEL.

857 858
2012-11-19  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>

Martin Skou Andersen's avatar
Martin Skou Andersen committed
859
  * HTTP implementation in data plugin enhanced to support redirection and
860 861
    chunked transfers for all functions.

862 863 864 865
2012-09-19  Gabor Szigeti <szigeti@niif.hu>

  * Use 1.2-2 version of SSM to the message sending.

866 867
2012-09-11  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>

868 869
  * Administrator utility gm-jobs is extended to cancel and clean jobs. See
    documentation and man pages for new options.
870

871 872 873 874 875
2012-09-08  Weizhong Qiang <weizhong.qiang@fys.uio.no>

  * arcproxy supports the detection of nss db from default location of
    filefox, seamonkey and thunderbird.

876 877 878 879
2012-09-06  David Cameron  <d.g.cameron@fys.uio.no>

  * Remove ability to set locale per LogDestination

880 881 882 883
2012-09-04  Weizhong Qiang <weizhong.qiang@fys.uio.no>

  * arcproxy supports proxy retrieval from myproxy server with VOMS AC included

884
  * arcproxy supports proxy generation with VOMS AC included, when using
885 886
    credential source from nss db

887 888 889 890
2012-09-04  Anders Waananen <waananen@nbi.dk>

  * Remove arcsrmping (fixes bug #2902)

891
2012-08-17  Martin Skou Andersen <skou@nbi.dk>
892 893 894 895 896

  * Introducing new class ExecutionTargetSorter for sorting ExecutionTarget
    objects. It is to replace the ExecutionTargetSet class which isn't working
    as intended.

897
2012-08-14  Martin Skou Andersen <skou@nbi.dk>
898 899 900 901

  * Submitter class extended with capability of job submission relying on
    resource discovery and brokering, previously part of arcsub

902
  * arcsub adapted to use rebased submission functionality
903

904 905
2012-08-07  David Cameron  <d.g.cameron@fys.uio.no>

906 907
  * Add ACIX (ARC Cache Index) to distribution (RHEL>=5, Fedora>=7, Debian>=4).
    See documentation for configuration options.
908

909
2012-08-02  Martin Skou Andersen <skou@nbi.dk>
910 911 912 913

  * Adding possibility to format the CE specific job state string (fixes bug
    2847)

David Cameron's avatar
David Cameron committed
914 915
2012-07-17  David Cameron  <d.g.cameron@fys.uio.no>

916
  * Implement 3rd party transfer in data library (new method
917
    DataPoint::Transfer3rdPaty()) and arccp (new option -3) using GFAL DMC
David Cameron's avatar
David Cameron committed
918 919 920

2012-07-13  David Cameron  <d.g.cameron@fys.uio.no>

921
  * Add errno-like field to DataStatus class
David Cameron's avatar
David Cameron committed
922

923
2012-07-03  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>
924 925 926 927

  * Increase performance of client file staging to/from HTTPS interface
    of A-REX service by turning off encryption.

928 929
2012-06-28  David Cameron  <d.g.cameron@fys.uio.no>

930
  * Improved formatting of arcls -l by aligning columns
931

932 933 934 935
2012-06-27  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>

  * Support for plugin priorities added.

936 937
2012-06-20  David Cameron  <d.g.cameron@fys.uio.no>

938 939
  * Add arcrename command and DataPoint::Rename()  See documentation and
    man pages for functionality and possible options.
940

941 942
2012-06-08  David Cameron  <d.g.cameron@fys.uio.no>

943
  * Cache service can run in same arched as A-REX with shared DTR instance
944

945 946 947 948 949 950 951 952 953
2012-06-05  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>

  * Janitor component removed from source tree.

2012-06-05  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>

  * Client files stage in performance enhanced by decreasing number of
    reconnections during one submission cycle.

954 955
2012-06-01 Weizhong Qiang <weizhong.qiang@fys.uio.no>

956 957
  * arcproxy can support the contacting to voms server with RESTful interface.
    See documentation and man pages for options.
958

959 960
2012-06-01  Anders Wäänänen  <waananen@nbi.dk>

961
  * Remove ISIS, Janitor, Chelonia and Hopi
962

963 964
2012-05-25  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>

965 966
  * Watchdog implemented for arched container and used in A-REX. See
    documentation for configuration options.
967

968 969
2012-04-23  Andrii Salnikov  <manf@grid.org.ua>

970 971
  * nordugridmap updated to version 2.0. See documentation for configuration
    options.
972 973 974 975 976 977 978 979

2012-04-02  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>

  * Handle out-of-band data at TCP layer.

2012-03-30  Aleksandr Konstantinov <aleksandr.konstantinov@fys.uio.no>

  * Communication with ARGUS PEP is implemented and integerated into A-REX.
980
    See documentation for configuration options.
981