# changelog

author: Tim Theisen <tim@cs.wisc.edu> - 9.0.0-1
changelog:
  - Absent any configuration, HTCondor denies authorization to all users
  - AES encryption is used for all communication and file transfers by default
  - New IDTOKEN authentication method enables fine-grained authorization
  - IDTOKEN authentication method is designed to replace GSI
  - Improved support for GPUs, including machines with multiple GPUs
  - New condor_watch_q tool that efficiently provides live job status updates
  - Many improvements to the Python bindings
  - New Python bindings for DAGMan and chirp
  - Improved file transfer plugins supporting uploads and authentication
  - File transfer times are now recorded in the job log
  - Added support for jobs that need to acquire and use OAUTH tokens
  - Many memory footprint and performance improvements in DAGMan
  - Submitter ceilings can limit the number of jobs per user in a pool


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.1-1
changelog:
  - Fix problem where X.509 proxy refresh kills job when using AES encryption
  - Fix problem when jobs require a different machine after a failure
  - Fix problem where a job matched a machine it can't use, delaying job start
  - Fix exit code and retry checking when a job exits because of a signal
  - Fix a memory leak in the job router when a job is removed via job policy
  - Fixed the back-end support for the 'bosco_cluster --add' command
  - An updated Windows installer that supports IDTOKEN authentication


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.2-1
changelog:
  - HTCondor can be set up to use only FIPS 140-2 approved security functions
  - If the Singularity test fails, the job goes idle rather than getting held
  - Can divide GPU memory, when making multiple GPU entries for a single GPU
  - Startd and Schedd cron job maximum line length increased to 64k bytes
  - Added first class submit keywords for SciTokens
  - Fixed MUNGE authentication
  - Fixed Windows installer to work when the install location isn't C:\Condor


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.14-1
changelog:
  - Fix for security issue
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2021-0003/


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.3-1
changelog:
  - Fixes for security issues
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2021-0003/
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2021-0004/


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.5-1
changelog:
  - Other authentication methods are tried if mapping fails using SciTokens
  - Fix rare crashes from successful condor_submit, which caused DAGMan issues
  - Fix bug where ExitCode attribute would be suppressed when OnExitHold fired
  - condor_who now suppresses spurious warnings coming from netstat
  - The online manual now has detailed instructions for installing on MacOS
  - Fix bug where misconfigured MIG devices confused condor_gpu_discovery
  - The transfer_checkpoint_file list may now include input files


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.6-1
changelog:
  - CUDA_VISIBLE_DEVICES can now contain GPU-<uuid> formatted values
  - Fixed a bug that caused jobs to fail when using newer Singularity versions
  - Fixed a bug in the Windows MSI installer for the latest Windows 10 version
  - Fixed bugs relating to the transfer of standard out and error logs
  - MacOS 11.x now reports as 10.16.x (which is better than reporting x.0)


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.7-1
changelog:
  - Fix bug where condor_gpu_discovery could crash with older CUDA libraries
  - Fix bug where condor_watch_q would fail on machines with older kernels
  - condor_watch_q no longer has a limit on the number of job event log files
  - Fix bug where a startd could crash claiming a slot with p-slot preemption
  - Fix bug where a job start would not be recorded when a shadow reconnects


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.8-1
changelog:
  - Fix bug where huge values of ImageSize and others would end up negative
  - Fix bug in how MAX_JOBS_PER_OWNER applied to late materialization jobs
  - Fix bug where the schedd could choose a slot with insufficient disk space
  - Fix crash in ClassAd substr() function when the offset is out of range
  - Fix bug in Kerberos code that can crash on macOS and could leak memory
  - Fix bug where a job is ignored for 20 minutes if the startd claim fails


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.9-1
changelog:
  - Added Debian 11 (bullseye) as a supported platform
  - Since CentOS 8 has reached end of life, we build and test on Rocky Linux 8
  - The OAUTH credmon is now packaged for Enterprise Linux 8


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.16-1
changelog:
  - Fix for security issue
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2022-0003


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.10-1
changelog:
  - Fixes for security issues
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2022-0001
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2022-0002
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2022-0003


author: Marco Mambelli <marcom@fnal.gov> - 3.4.4-1
changelog:
  - GlideinWMS v3.4.4
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_4_4/history.html
  - Release candidates: 3.4.4-0.1.rc1 to 3.4.4-0.4.rc4


author: Marco Mambelli <marcom@fnal.gov> - 3.4.5-1
changelog:
  - GlideinWMS v3.4.5
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_4_5/history.html
  - Release candidates: 3.4.5-0.1.rc1


author: Marco Mambelli <marcom@fnal.gov> - 3.5
changelog:
  - GlideinWMS v3.5
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_5/history.html
  - Release candidates: 3.5-0.1.rc1 to 3.5-0.1.rc2


author: Marco Mambelli <marcom@fnal.gov> - 3.4.6-1
changelog:
  - GlideinWMS v3.4.6
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_4_6/history.html
  - Release candidates: 3.4.6-0.1.rc1


author: Marco Mambelli <marcom@fnal.gov> - 3.5.1-1
changelog:
  - GlideinWMS v3.5.1
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_5_1/history.html
  - Release candidates: 3.5.1-0.1.rc1


author: Marco Mambelli <marcom@fnal.gov> - 3.6-1
changelog:
  - GlideinWMS v3.6
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_6/history.html
  - This is a rename of 3.5.1, to respect the odd-even numbering


author: Marco Mambelli <marcom@fnal.gov> - 3.6.1-1
changelog:
  - GlideinWMS v3.6.1
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_6_1/history.html
  - Release candidates: 3.6.1-0.1.rc1


author: Marco Mambelli <marcom@fnal.gov> - 3.6.2-1
changelog:
  - GlideinWMS v3.6.2
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_6_2/history.html
  - Release candidates: 3.6.2-0.0.rc0 to 3.6.2-0.3.rc3


author: Marco Mambelli <marcom@fnal.gov> - 3.7-1
changelog:
  - GlideinWMS v3.7
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_7/history.html
  - Release candidates: 3.7-0.1.rc1 to 3.7-0.3.rc3


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.13-1
changelog:
  - Host based security is no longer the default security model
  - Hardware accelerated integrity and AES encryption used by default
  - Normally, AES encryption is used for all communication and file transfers
  - Fallback to Triple-DES or Blowfish when interoperating with older versions
  - Simplified and automated new HTCondor installations
  - HTCondor now detects instances of multi-instance GPUs
  - Fixed memory leaks (collector updates in 8.9 could leak a few MB per day)
  - Many other enhancements and bug fixes, see version history for details


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.13-1
changelog:
  - condor_ssh_to_job now maps CR and NL to work with editors like nano
  - Improved the performance of data transfer in condor_ssh_to_job
  - HA replication now accepts SHA-2 checksums to prepare for MD5 removal
  - Submission to NorduGrid ARC CE works with newer ARC CE versions
  - Fixed condor_annex crashes on platforms with newer compilers
  - Fixed "use feature: GPUsMonitor" to locate the monitor binary on Windows
  - Fixed a bug that prevented using the '@' character in an event log path


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.14-1
changelog:
  - Fix for security issue
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2021-0003.html


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.3-1
changelog:
  - Fixes for security issues
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2021-0003.html
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2021-0004.html


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.7-1
changelog:
  - Multiple enhancements in the file transfer code
  - Support for more regions in s3:// URLs
  - Much more flexible job router language
  - Jobs may now specify cuda_version to match equally-capable GPUs
  - TOKENS are now called IDTOKENS to differentiate from SCITOKENS
  - Added the ability to blacklist TOKENS via an expression
  - Can simultaneously handle Kerberos and OAUTH credentials
  - The getenv submit command now supports a blacklist and whitelist
  - The startd supports a remote history query similar to the schedd
  - condor_q -submitters now works with accounting groups
  - Fixed a bug reading service account credentials for Google Compute Engine


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.10-1
changelog:
  - condor_qedit can no longer be used to disrupt the condor_schedd
  - Fixed a bug where the SHARED_PORT_PORT configuration setting was ignored
  - Ubuntu 20.04 and Amazon Linux 2 are now supported

  - In MacOSX, HTCondor now requires LibreSSL, available since MacOSX 10.13


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.8-1
changelog:
  - Added htcondor.dags and htcondor.htchirp to the HTCondor Python bindings
  - New condor_watch_q tool that efficiently provides live job status updates
  - Added support for marking a GPU offline while other jobs continue
  - The condor_master command does not return until it is fully started
  - Deprecated several Python interfaces in the Python bindings


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.8-1.1
changelog:
  - Add libcgroup-devel requirement for EL8
  - Drop bosco_findplaform patch
  - Update permissions on /var/{lock,run}/condor so rpm verify works on EL8
  - Don't try to build contrib code (fails on EL8)


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.11-1
changelog:
  - HTCondor now properly tracks usage over vanilla universe checkpoints
  - New ClassAd equality and inequality operators in the Python bindings
  - Fixed a bug where removing in-use routes could crash the job router
  - Fixed a bug where condor_chirp would abort after success on Windows
  - Fixed a bug where using MACHINE_RESOURCE_NAMES could crash the startd
  - Improved condor c-gahp to prioritize commands over file transfers
  - Fixed a rare crash in the schedd when running many local universe jobs
  - With GSI, avoid unnecessary reverse DNS lookup when HOST_ALIAS is set
  - Fix a bug that could cause grid universe jobs to fail upon proxy refresh


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.9-1
changelog:
  - The RPM packages requires globus, munge, scitokens, and voms from EPEL
  - Improved cgroup memory policy settings that set both hard and soft limit
  - Cgroup memory usage reporting no longer includes the kernel buffer cache
  - Numerous Python binding improvements, see version history
  - Can create a manifest of files on the execute node at job start and finish
  - Added provisioner nodes to DAGMan, allowing users to provision resources
  - DAGMan can now produce .dot graphs without running the workflow


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.12-1
changelog:
  - Added a family of version comparison functions to ClassAds
  - Increased default Globus proxy key length to meet current NIST guidance


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.10-1
changelog:
  - Fix bug where negotiator stopped making matches when group quotas are used
  - Support OAuth, SciTokens, and Kerberos credentials in local universe jobs
  - The Python schedd.submit method now takes a Submit object
  - DAGMan can now optionally run a script when a job goes on hold
  - DAGMan now provides a method for inline jobs to share submit descriptions
  - Can now add arbitrary tags to condor annex instances
  - Runs the "singularity test" before running the a singularity job


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.11-1
changelog:
  - This release of HTCondor fixes security-related bugs described at
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2021-0001.html
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2021-0002.html


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.1-1
changelog:
  - Fixed excessive CPU consumption with GPU monitoring
  - GPU monitoring is off by default; enable with "use feature: GPUsMonitor"
  - HTCondor now works with the new CUDA version 10 libraries
  - Fixed a bug where sometimes jobs would not start on a Windows execute node
  - Fixed a bug that could cause DAGman to go into an infinite loop on exit
  - The JobRouter doesn't forward the USER attribute between two UID Domains
  - Made Collector.locateAll() more efficient in the Python bindings
  - Improved efficiency of the negotiation code in the condor_schedd


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.0-1
changelog:
  - Absent any configuration, HTCondor denies authorization to all users
  - All HTCondor daemons under a condor_master share a security session
  - Scheduler Universe jobs are prioritized by job priority


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.2-1
changelog:
  - Fixed problems with condor_ssh_to_job and Singularity jobs
  - Fixed a problem that could cause condor_annex to crash
  - Fixed a problem where the job queue would very rarely be corrupted
  - condor_userprio can report concurrency limits again
  - Fixed the GPU discovery and monitoring code to map GPUs in the same way
  - Made the CHIRP_DELAYED_UPDATE_PREFIX configuration knob work again
  - Fixed restarting HTCondor from the Service Control Manager on Windows
  - Fixed a problem where local universe jobs could not use condor_submit
  - Restored a deprecated Python interface that is used to read the event log
  - Fixed a problem where condor_shadow reuse could confuse DAGMan


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.1-1
changelog:
  - An efficient curl plugin that supports uploads and authentication tokens
  - HTCondor automatically supports GPU jobs in Docker and Singularity
  - File transfer times are now recorded in the user job log and the job ad


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.3-1
changelog:
  - Fixed a bug where jobs were killed instead of peacefully shutting down
  - Fixed a bug where a restarted schedd wouldn't connect to its running jobs
  - Improved file transfer performance when sending multiple files
  - Fix a bug that prevented interactive submit from working with Singularity
  - Orphaned Docker containers are now cleaned up on execute nodes
  - Restored a deprecated Python interface that is used to read the event log


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.2-1
changelog:
  - The HTTP/HTTPS file transfer plugin will timeout and retry transfers
  - A new multi-file box.com file transfer plugin to download files
  - The manual has been moved to Read the Docs
  - Configuration options for job-log time-stamps (UTC, ISO 8601, sub-second)
  - Several improvements to SSL authentication
  - New TOKEN authentication method enables fine-grained authorization control


author: Edgar Fajardo <emfajard@ucsd.edu> - 5.1.0-0.rc4.1.osg
changelog:
  - Rebuild to RC4
  - Remove patch Fix-typo-XrdAccAuthorizeObjectAdd-XrdAccAuthorizeObj.paatch
  - Remove patch Adding-ObjAdd-to-list-of-scitokens-functions-exporte.patch
  - Remove patch Rename-XrdAccAuthorizeObjectAdd-to-XrdAccAuthorizeOb.patch


author: Mátyás Selmeci <matyas@cs.wisc.edu> - 5.1.0-0.rc1.2.osg
changelog:
  - Build xrootd-scitokens and xrootd-compat again  (SOFTWARE-4356)
  - Use 4.12.5 for the compat package  (SOFTWARE-4247)


author: Mátyás Selmeci <matyas@cs.wisc.edu> - 5.1.0-0.rc3.2.osg
changelog:
  - Update to upstream rc3  (SOFTWARE-4356)
  - Use 4.12.6 for the compat package  (SOFTWARE-4247)
  - Add Rename-XrdAccAuthorizeObjectAdd-to-XrdAccAuthorizeOb.patch from https://github.com/xrootd/xrootd/pull/1361


author: Mátyás Selmeci <matyas@cs.wisc.edu> - 5.1.0-0.rc3.5.osg
changelog:
  - Add Fix-typo-XrdAccAuthorizeObjectAdd-XrdAccAuthorizeObj.patch from https://github.com/xrootd/xrootd/commit/bf5aa963185c62228b93312dd0517ba1b1f43e52
  - Add Adding-ObjAdd-to-list-of-scitokens-functions-exporte.patch  from https://github.com/xrootd/xrootd/pull/1363


author: Brian Lin <blin@cs.wisc.edu> - 1.18.36.bosco-1
changelog:
  - Verify input file existence before submission (SOFTWARE-3154)
  - Save debugging dirs if job submission fails (SOFTWARE-2827)


author: Carl Edquist <edquist@cs.wisc.edu> - 1.18.40.bosco-1
changelog:
  - Update PBS Pro qstat options for completed jobs (SOFTWARE-3675)
  - Apply patches from condor blahp (SOFTWARE-3587)
  - Use the original proxy if blahp proxy delegation is disabled (SOFTWARE-3661)
  - Use new condor env format (SOFTWARE-3589)


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.3-1
changelog:
  - TOKEN and SSL authentication methods are now enabled by default
  - The job and global event logs use ISO 8601 formatted dates by default
  - Added Google Drive multifile transfer plugin
  - Added upload capability to Box multifile transfer plugin
  - Added Python bindings to submit a DAG
  - Python 'JobEventLog' can be pickled to facilitate intermittent readers
  - 2x matchmaking speed for partitionable slots with simple START expressions
  - Improved the performance of the condor_schedd under heavy load
  - Reduced the memory footprint of condor_dagman
  - Initial implementation to record the circumstances of a job's termination


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.6-1
changelog:
  - Initial support for CentOS 8
  - Fixed a memory leak in SSL authentication
  - Fixed a bug where "condor_submit -spool" would only submit the first job
  - Reduced encrypted file transfer CPU usage by a factor of six
  - "condor_config_val -summary" displays changes from a default configuration
  - Improved the ClassAd documentation, added many functions that were omitted


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.4-1
changelog:
  - Amazon S3 file transfers using pre-signed URLs
  - Further reductions in DAGMan memory usage
  - Added -idle option to condor_q to display information about idle jobs
  - Support for SciTokens authentication
  - A tool, condor_evicted_files, to examine the SPOOL of an idle job


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.7-1
changelog:
  - Updated condor_annex to work with upcoming AWS Lambda function changes
  - Added the ability to specify the order that job routes are applied
  - Fixed a bug that could cause remote condor submits to fail
  - Fixed condor_wait to work when the job event log is on AFS
  - Fixed RPM packaging to be able to install condor-all on CentOS 8
  - Period ('.') is allowed again in DAGMan node names


author: Tim Theisen <tim@cs.wisc.edu> - 8.9.5-1
changelog:
  - Added a new mode that skips jobs whose outputs are newer than their inputs
  - Added command line tool to help debug ClassAd expressions
  - Added port forwarding to Docker containers
  - You may now change some DAGMan throttles while the DAG is running
  - Added support for session tokens for pre-signed S3 URLs
  - Improved the speed of the negotiator when custom resources are defined
  - Fixed interactive submission of Docker jobs
  - Fixed a bug where jobs wouldn't be killed when getting an OOM notification


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.8-1
changelog:
  - Fixes addressing CVE-2019-18823
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2020-0001.html
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2020-0002.html
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2020-0003.html
  - https://research.cs.wisc.edu/htcondor/security/vulnerabilities/HTCONDOR-2020-0004.html


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.9-1
changelog:
  - Proper tracking of maximum memory used by Docker universe jobs
  - Fixed preempting a GPU slot for a GPU job when all GPUs are in use
  - Fixed a Python crash when queue_item_data iterator raises an exception
  - Fixed a bug where slot attribute overrides were ignored
  - Calculates accounting group quota correctly when more than 1 CPU requested
  - Updated HTCondor Annex to accommodate API change for AWS Spot Fleet
  - Fixed a problem where HTCondor would not start on AWS Fargate
  - Fixed where the collector could wait forever for a partial message
  - Fixed streaming output to large files (>2Gb) when using the 32-bit shadow


author: Marco Mambelli <marcom@fnal.gov> - 3.6.3-1
changelog:
  - GlideinWMS v3.6.3
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_6_3/history.html
  - Release candidates: 3.6.3-0.1.rc1 to 3.6.3-0.3.rc3


author: Marco Mambelli <marcom@fnal.gov> - 3.6.4-1
changelog:
  - GlideinWMS v3.6.4
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_6_4/history.html
  - Release candidates: 3.6.4-0.1.rc1


author: Marco Mambelli <marcom@fnal.gov> - 3.6.5-1
changelog:
  - GlideinWMS v3.6.5
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_6_5/history.html
  - Release candidates: 3.6.5-0.1.rc1


author: Dennis Box <dbox@fnal.gov> - 3.7.1-1
changelog:
  - GlideinWMS v3.7.1
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_7_1/history.html
  - Release candidates: 3.7.1-0.1.rc1 to 3.7.1-0.7.rc9


author: Dennis Box <dbox@fnal.gov> - 3.7.2-1
changelog:
  - GlideinWMS v3.7.2
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_7_2/history.html
  - Release candidates: 3.7.0.1.rc1 to 3.7.2-0.3.rc3


author: 2020 Dennis Box <dbox@fnal.gov> - 3.7.3-1
changelog:
  - GlideinWMS v3.7.3
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_7_3/history.html
  - Release candidates: 3.7.3-01.rc1 .rc1 to


author: Dennis Box <dbox@fnal.gov> - 3.7.5
changelog:
  - Glideinwms v3.7.5
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_7_5/history.html
  - Release candidates 3.7.5-01.rc1 to  3.7.5-06.rc6


author: Dennis Box <dbox@fnal.gov> - 3.7.6-1
changelog:
  - GlideinWMS v3.7.6
  - Release Notes http://glideinwms.fnal.gov/doc.v3_7_6/history.html
  - Release candidates  3.7.6-01.rc1 to 3.7.6-01.rc2


author: Dennis Box <dbox@fnal.gov> - 3.7.3-1
changelog:
  - GlideinWMS v3.7.3
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_7_3/history.html
  - Release candidates: 3.7.3-01.rc1 to 3.7.3-03.rc3


author: Dennis Box <dbox@fnal.gov> - 3.7.1-1
changelog:
  - GlideinWMS v3.7.1
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_7_1/history.html
  - Release candidates: 3.7.1-0.1.rc1 to 3.7.1-0.9.rc10


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.4-1
changelog:
  - Python 3 bindings - see version history for details (requires EPEL on EL7)
  - Can configure DAGMan to dramatically reduce memory usage on some DAGs
  - Improved scalability when using the python bindings to qedit jobs
  - Fixed infrequent schedd crashes when removing scheduler universe jobs
  - The condor_master creates run and lock directories when systemd doesn't
  - The condor daemon obituary email now contains the last 200 lines of log


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.5-1
changelog:
  - Fixed two performance problems on Windows
  - Fixed Java universe on Debian and Ubuntu systems
  - Added two knobs to improve performance on large scale pools
  - Fixed a bug where requesting zero GPUs would require a machine with GPUs
  - HTCondor can now recognize nVidia Volta and Turing GPUs


author: Brian Lin <blin@cs.wisc.edu> - 3.5-2
changelog:
  - Opt into default configuration provided by xrootd-lcmaps-1.7.4 (SOFTWARE-3534)
  - Remove osg-configure and redundant dependencies


author: Brian Lin <blin@cs.wisc.edu> - 3.5-3
changelog:
  - Restore osg-configure requirement for standalone installations
    since they'll be using /etc/lcmaps.db instead of the LCMAPS configuration
    shipped with xrootd-lcmaps
  - Ensure that XRootd/HTTP ports are the same


author: Tim Theisen <tim@cs.wisc.edu> - 8.8.0-1
changelog:
  - Automatically add AWS resources to your pool using HTCondor Annex
  - The Python bindings now include submit functionality
  - Added the ability to run a job immediately by replacing a running job
  - A new minicondor package makes single node installations easy
  - HTCondor now tracks and reports GPU utilization
  - Several performance enhancements in the collector
  - The grid universe can create and manage VM instances in Microsoft Azure
  - The MUNGE security method is now supported on all Linux platforms


author: Brian Lin <blin@cs.wisc.edu> - 4.2.1-1
changelog:
  - Drop vestigial central collector config generator
  - Fix unmapped GSI/SSL regexps and allow unmapped enttities to advertise to the central ceollector (SOFTWARE-3939)


author: Brian Lin <blin@cs.wisc.edu> - 4.3.0-1
changelog:
  - Add the CE registry web application to the central collector. The
    registry provides an interface to OSG site administrators of
    HTCondor-CEs to retrieve an HTCondor IDTOKEN for authenticating
    pilot job submissions (#298, #299)
  - Identify broken job routes upon startup (#319)
  - Add benchmarking parameters to the BDII provider via HTCONDORCE_SPEC
    in the configuration. See /etc/condor-ce/config.d/99-ce-bdii.conf
    for examples (#311)
  - Fix handling of unmapped GSI users in the central collector (#317)
  - Fix reference to old BDII configuration values (#322)


author: Brian Lin <blin@cs.wisc.edu> - 4.4.0-1
changelog:
  - Add plug-in interface to HTCondor-CE View and separate out
    OSG-specific code and configuration (SOFTWARE-3963)
  - Add configuration option (COMPLETED_JOB_EXPIRATION) for how many
    days completed jobs may stay in the queue (SOFTWARE-4108)

  - Replace APEL uploader SchedD cron with init and systemd services
    (#323)
  - Fix HTCondor-CE View SchedD query that caused "Info" tables to be blank


author: Brian Lin <blin@cs.wisc.edu> - 4.4.1-1
changelog:
  - Fix a stacktrace with the BDII provider when `HTCONDORCE_SPEC` isn't
    defined in the local HTCondor configuration
  - Fixed a race condition that could result in removed jobs being put
    on hold
  - Improve performance of the HTCondor-CE View


author: Mátyás Selmeci <matyas@cs.wisc.edu> - 4.4.1-2
changelog:
  - Change voms-clients-cpp requirement to voms-clients for non-OSG builds,
    because voms-clients-java works equally well


author: Brian Lin <blin@cs.wisc.edu> - 5.0.0-0.rc1
changelog:
  - Convert HTCondor-CE to Python 3 (#391, #397, #400, #402, #403, #404, #405,
    - Add USE_CE_HOME_DIR configuration to allow users to disable passing the CE
    users's HOME dir to the job on the worker node (#377)
  - RPM packaging fixes for default CE registry httpd configuration (#372)
  - Add CE View advertising of GPU job counts to the central collector (#381)
  - BDII: Reduce package dependencies of htcondor-ce-bdii (#384)
  - BDII: Add support for whitespace/comma separated local collectors (#375)


author: Brian Lin <blin@cs.wisc.edu> - 5.0.0-1
changelog:
  - Add Python 3 and EL8 support (HTCondor-13)
  - Whole node jobs (HTCondor batch systems only) now make use of GPUs (HTCONDOR-103)
  - Added `USE_CE_HOME_DIR` configuration variable (default: `False`) to allow users to enable setting `$HOME` in the
    routed job's environment based on the HTCondor-CE user's home directory
  - HTCondor-CE Central Collectors now prefer GSI over SSL authentication (HTCONDOR-237)
  - HTCondor-CE registry now validates the value of submitted client codes (HTCONDOR-241)
  - Automatically remove CE jobs that exceed their `maxWalltime` (if defined) or the configuration value of
    `ROUTED_JOB_MAX_TIME` (default: 4320 sec/72 hrs)
  - Remove circular HTCondor-CE View configuration definition (HTCONDOR-161)
  - Replace htcondor-ce package requirement with python2-condor for htcondor-ce-bdii


author: Mark Coatsworth <coatsworth@cs.wisc.edu> - 5.1.0-1
changelog:
  - Fix an issue where the CE removed running jobs prematurely (HTCONDOR-350)
  - Add optional job router transform syntax (HTCONDOR-243)
  - Add username and X.509 accounting group mapfiles for use by job router transforms (HTCONDOR-187)
  - Replace custom mappings in condor_mapfile with /etc/condor-ce/mapfiles.d/ (HTCONDOR-244)
  - Require regular expressions in the second field of the unified mapfile be enclosed by '/'(HTCONDOR-244)
  - Update maxWallTime logic to accept BatchRuntime (HTCONDOR-80)
  - Append SSL to the default authentication methods list (HTCONDOR-366)
  - APEL reporting scripts now use the local HTCondor's PER_JOB_HISTORY_DIR to collect job data. (HTCONDOR-293)
  - Use the `GlobalJobID` attribute as the APEL record `lrmsID` (#426)
  - Update HTCondor-CE registry app to Python 3 (HTCONDOR-307)
  - Enable SSL authentication by default for `READ`/`WRITE` authorization levels (HTCONDOR-366)
  - Downgrade errors in the configuration verification startup script to support routes written in the transform syntax (#465)
  - Allow required directories to be owned by non-`condor` groups (#451)
  - Fix an issue with an overly aggressive default `SYSTEM_PERIODIC_REMOVE` (HTCONDOR-350)
  - Fix incorrect path to Python 3 Collector plugin (HTCONDOR-400)
  - Fix faulty validation of `JOB_ROUTER_ROUTE_NAMES` and `JOB_ROUTER_ENTRIES` in the startup script (HTCONDOR-406)
  - Fix various Python 3 incompatibilities (#460)


author: Mátyás Selmeci <matyas@cs.wisc.edu> - 5.4.1-0.rc2.osg
changelog:
  - Update to 5.4.1rc2 and merge OSG changes (SOFTWARE-4998, SOFTWARE-4999)
  - Update SOFTWARE-4870.voms-mapfile.patch


author: Dennis Box <dbox@fnal.gov> - 3.7.2-1
changelog:
  - GlideinWMS v3.7.2
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_7_2/history.html
  - Release candidates: 3.7.2-0.1rc1 to 3.7.2-0.1.rc3


author: Carl Edquist <edquist@cs.wisc.edu> - 1.18.42
changelog:
  - Move glite-build-common-cpp m4 files to vendor area (SOFTWARE-3587)
  - Pull rpm spec file into source repo


author: Carl Edquist <edquist@cs.wisc.edu> - 1.18.44
changelog:
  - Add Slurm SystemCpu accounting when job completes (SOFTWARE-3825)
  - Add support for decimal seconds fields from sacct (SOFTWARE-3826)
  - Pull in various updates to slurm scripts from htcondor's blap (SOFTWARE-3587)
  - Move local submit attributes scripts from spec to sources (SOFTWARE-3749)


author: Carl Edquist <edquist@cs.wisc.edu> - 1.18.45
changelog:
  - Fix an issue where the slurm binpath always returned scontrol (SOFTWARE-3986)
  - Python 3 compatibility (#7)
  - Handle extra-quoted arguments to condor_submit.sh (SOFTWARE-3993)
  - Expand env vars in configured slurm_binpath (#10)
  - Fix cluster handling in slurm_status.py (#13)
  - Introduce blah_job_env_confs for dynamic env var expansion (SOFTWARE-2521)
  - Add EXIT trap to remove barrier file (SOFTWARE-3930)
  - Amended file credits for Matt Farrellee (#17)


author: Brian Lin <blin@cs.wisc.edu> - 5.1.1-1
changelog:
  - Improve restart time of HTCondor-CE View (HTCONDOR-420)
  - Fix bug that caused HTCondor-CE to ignore incoming BatchRuntime requests (#480)
  - Fix blahp packaging requirement (HTCONDOR-504)


author: Tim Theisen <tim@cs.wisc.edu> - 5.1.2-1
changelog:
  - Fixed the default memory and CPU requests when using job router transforms
  - Apply default MaxJobs and MaxJobsIdle when using job router transforms
  - Improved SciTokens support in submission tools
  - Fixed --debug flag in condor_ce_run
  - Update configuration verification script to handle job router transforms
  - Corrected ownership of the HTCondor PER_JOBS_HISTORY_DIR
  - Fix bug passing maximum wall time requests to the local batch system


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.11-1
changelog:
  - The Job Router can now create an IDTOKEN for use by the job
  - Fix bug where a self-checkpointing job may erroneously be held
  - Fix bug where the Job Router could erroneously substitute a default value
  - Fix bug where a file transfer error may identify the wrong file
  - Fix bug where condor_ssh_to_job may fail to connect


author: Brian Lin <blin@cs.wisc.edu> - 1.5.3-1
changelog:
  - Add default values for the number of blocks and threads used for
    writing in parallel
  - Add new ATLAS XCache default values for the write queue, block size,
    and the number of prefetch blocks
  - Disable additional ATLAS debugging by default


author: Tim Theisen <tim@cs.wisc.edu> - 9.0.0-1.2
changelog:
  - Fix malformed default Bosco tarball URL format (HTCONDOR-433)
  - Fix autocluster problem (HTCONDOR-414)
  - Fix claim activation faiure (HTCONDOR-434)
  - Fix Bosco tarball extraction (HTCONDOR-438)


author: Diego Davila <didavila@ucsd.edu> - 1.5.2-6
changelog:
  - Build for el8 (software-4257)
  - Adding patch: buff_size.patch to avoid compiling error
  - Adding if around libXrdCmsTfc.so.* in the 'files' section


author: Dennis Box <dbox@fnal.gov> - 3.7.4-1
changelog:
  - GlideinWMS v3.7.4
  - Release Notes: http://glideinwms.fnal.gov/doc.v3_7_4/history.html
  - Release candidates: 3.7.4-01.rc1


author: Mátyás Selmeci <matyas@cs.wisc.edu> - 8.9.11-1.1
changelog:
  - Add SOFTWARE-4525-condor_watch_q_crash.patch to fix a condor_watch_q crash when watching DAGs (SOFTWARE-4525)
  - Add HTCONDOR-315-Always-handle-exceptions-when-decoding-.patch to fix a schedd crash caused by malformed SciTokens (SOFTWARE-4533)


author: Dennis Box <dbox@fnal.gov> - 3.7.5-1
changelog:
  - GlideinWMS v3.7.5
  - Release Notes http://glideinwms.fnal.gov/doc.v3_7_5/history.html
  - Release candidates  3.7.5-01.rc1 to 3.7.5-06.rc6


author: Tim Theisen <tim@cs.wisc.edu> - 5.1.3-1
changelog:
  - The HTCondor-CE central collector requires SSL credentials from client CEs
  - Fix BDII crash if an HTCondor Access Point is not available
  - Fix formatting of APEL records that contain huge values
  - HTCondor-CE client mapfiles are not installed on the central collector


author: Diego Davila <didavila@ucsd.edu> - 0.4.3-1
changelog:
  - Adding XrootD major version to the shared file name
  - building against XrootD-4.12.2 (software-4093)


author: Carl Edquist <edquist@cs.wisc.edu> - 0.5.0-1
changelog:
  - Build against xrootd 5.1 (SOFTWARE-4426)
  - Refactor how username is determined to match new behavior in xrootd 5.1 (#17)
  - Check for 'request.name' attribute before failing (#18)
  - Obtain username from passed env when SecEntity object not passed (#19)
  - Disable POSC when set in file open() (#20)


author: Derek Weitzel <dweitzel@unl.edu> - 1.0.0-1
changelog:
  - Wrap the OSS filesystem rather than SFS.  Available in XRootD 5.0+
  - Add checksum wrapper, only available in XRootD 5.2+


author: Mátyás Selmeci <matyas@cs.wisc.edu> - 5.4.2-1
changelog:
  - Update to 5.4.2 and merge OSG changes (SOFTWARE-5072, SOFTWARE-5073)
  - Update SOFTWARE-4870.voms-mapfile.patch


author: Diego Davila <didavila@ucsd.edu> - 1.7.7-3
changelog:
  - Removig patches: dont_link and find_libXrdSec
  - Making sure upcoming version is higher than testing


author: Diego Davila <didavila@ucsd.edu> - 1.7.8-2
changelog:
  - building against xrootd-5.0.0-1 (SOFTWARE-3923)
  - updating xrootd_current_major and xrootd_next_major to 5 and 6 respectively


author: Diego Davila <didavila@ucsd.edu> - 2.1.5-1
changelog:
  - Adding directory config.d and file config.d/40-xrootd-hdfs.cfg (SOFTWARE-3535)
  - Changing xrootd requirement to 4.9.0


author: Carl Edquist <edquist@cs.wisc.edu> - 2.2.0-1
changelog:
  - Build against xrootd 5 (SOFTWARE-3923, #32)
  - Only write checksum file if hdfsCloseFile() was successful (#34)
  - Add support for new extended attribute API for XrdSecEntity (#35)


author: Mátyás Selmeci <matyas@cs.wisc.edu> 3.5.upcoming-3
changelog:
  - Set grid-mapfile location (http.gridmap and -gridmap in sec.protocol gsi)
    to the standard location (SOFTWARE-4937)


author: Diego Davila <didavila@ucsd.edu> 3.5.upcoming-4
changelog:
  - Configure Xrootd to send caching monitoring data (SOFTWARE-5026)
  - Make the ShovelerHostPort variable to use as the monitoring collector if there is a shoveler


author: Diego Davila <didavila@ucsd.edu> - v1.2-1
changelog:
  - Building against Xrootd 5.0 (SOFTWARE-3923)
  - Adding patch: link_to_lXrdPfc5.patch 
  - Bumping version 1.2-1


author: Diego Davila <didavila@ucsd.edu> - v1.2-3.1
changelog:
  - Removing patch: link_to_lXrdPfc5.patch 
  - Adding patch: dont_link.patch that removes the linking against libXrdFileCache-4


author: Brian Lin <blin@cs.wisc.edu> - 1.18.48-1
changelog:
  - Add an option for HTCondor batch system to expand references to $HOME in the job environment (#23)
  - Add efficient querying of LSF job statuses (#14)
  - Improve logic when proxy refresh is disabled (#24)
  - Fix invalid argument, output, and error format for HTCondor job submission (#22)


author: Derek Weitzel <dweitzel@unl.edu> - 2.0.0-1
changelog:
  - Add checksum library that saves to extended attributes
  - Add multiuser.checksumonwrite option to turn on checksumming the file while it is being written.


author: Brian Lin <blin@cs.wisc.edu> 2.0.0-1
changelog:
  - Add GPU support (#12)
  - Improve multi-node support for Slurm (HTCONDOR-166)
  - More efficient status queries for Slurm (HTCONDOR-104)
  - More robust job ID extraction from SLurm (HTCONDOR-259)
  - Better interfacing with PBS and Slurm
  - More Python 3 fixes for PBS and Slurm scripts
  - Convert LSF script to Python 3 (HTCONDOR-333, #34)
  - Add Debian build files


author: Tim Theisen <tim@cs.wisc.edu> 2.0.1-1
changelog:
  - Convert to pure Python 3 (no Python 2 compatibility)
  - Restore blah_libexec_directory to the blah.config file


author: Tim Theisen <tim@cs.wisc.edu> 2.1.0-1
changelog:
  - Fix bug where GPU request was not passed onto the batch script
  - Fix problem where proxy symlinks were not cleaned up by not creating them
  - Fix bug where output files are overwritten if no transfer output remap
  - Added support for passing in extra submit arguments from the job ad


author: Tim Theisen <tim@cs.wisc.edu> 2.1.1-1
changelog:
  - Add Python 2 support back for Enterprise Linux 7
  - Allow the user to override system configuration files
  - Enable flexible configuration via a configuration directory
  - Fix Slurm resource usage reporting


author: Derek Weitzel <dweitzel@cse.unl.edu> - 1.2.0-1
changelog:
  - Add issuer for latter mapping decisions by issuer
  - Correct access control when allowing only reads


author: Mátyás Selmeci <matyas@cs.wisc.edu> - 2.2.0-1.1
changelog:
  - Add SOFTWARE-4645-usernames-with-tokens.patch to fix finding the right
    username with token auth (SOFTWARE-4645, #36)


author: Diego Davila <didavila@ucsd.edu> - 2.1.7-3.1
changelog:
  - Rebuild for xrootd 5.0.0-rc2 (SOFTWARE-3923)
  - adding patch: link2serverlib to link with the right library


