Singularity-1.5.0

Special Note

This is planned to be the final public release of Singularity. We want to thank all those that have contributed over the past years for all of their help! If you need assistance with Singularity the team will plan to keep the singularity-framework slack open for another few months.

Changes in 1.5.0

Check out the 1.5.0 milestone to see new features / bugfixes in detail.

Improvements

• 2290 - Add a class of scheduler-related metrics to expose more easily
• 2289 - Handle combined cpu,cpuacct cgroup mountpoints
• 2282 - Add large scale down flag to client
• 2275 - Prevent accidental large scale downs
• 2272 - Add decom reasons to task cleaning messages
• 2270 - Run persisters in parallel
• 2264 - Add @Schema annotation to SingularityScheduledTasksInfo for JSON parsing
• 2260 - Add endpoint and client call to retrieve scheduled tasks info
• 2259 - Task Persister skips too long task Ids
• 2256 - Add UI support for freezing/unfreezing racks
• 2252 - Disasters UI Improvements
• 2253 - Cleanup old decommissioned agents
• 2246 - Add request-level maximum scale option
• 2245 - Request Priority API
• 2241 - Add fire alarm
• 2239 - Improve Offer Loop Usage of Request Locks
• 2226 - Configurably skip the file open check in S3Uploader.
• 2227 - Show request edit for some groups, add priority button
• 2228 - Support global overrides of request placement strategy/rack sensitivity
• 2225 - Curator framework improvements
• 2224 - Smarter timeouts in offer loop
• 2220 - Add request deploy history endpoint to SingularityClient
• 2205 - Refactor the LoadBalancerClient
• 2202 - Add media type to config resource
• 2199 - Add endpoint to get Singularity config values
• 2198 - S3Uploader aws client usage efficiency
• 2196 - Also check if a task is a killed task in rack placements
• 2192 - Support more stable canary deploys in Singularity
• 2195 - Optionally compress files prior to uploading them in SingularityS3Uploader.
• 2191 - Granular forced logrotate crons
• 2188 - Thread and stream clean up
• 2190 - Lifecycle tweaks for Singularity
• 2186 - Create thread pool that blocks when full
• 2187 - Add status queue size accessor for status update handler
• 2185 - Block reconciliation if queue nearly full
• 2182 - change bucket name in example
• 2183 - Bump version of mysql-connector-java
• 2184 - Make docker stop timeout overideable
• 2180 - Support fine-grained logrotateAdditionalFiles intervals, with a separate logrotate conf file for each configured interval
• 2176 - Opt in mode for Singularity emails
• 2177 - Clean up lifecycle ordering on shutdown
• 2173 - Remap names in disabled actions list
• 2172 - Added logging decorator for CuratorFramework to Audit ZK Endpoints
• 2167 - Counters for last persister successes
• 2168 - Add ability to re-add recovered tasks to the load balancer
• 2169 - Initialize last persister AtomicLongs to current time
• 2166 - Turn down some noisy logging

Bug Fixes

• 2285 - Task history handling when missing data
• 2287 - Omit on demand jobs from scale limit during deploy validation
• 2283 - Unused method fix
• 2284 - Handle tasks which no longer have data in zk
• 2280 - Update broken links
• 2281 - Various bug fixes and stability improvements
• 2278 - Fix up some s3 listing bugs
• 2276 - Fix client params
• 2274 - Address missing task data
• 2265 - Fix SingularityScheduledTasksInfo retrieval in client
• 2266 - Mutate request instances based on existing request
• 2269 - Retry failed tasks with new deploys
• 2262 - Fix npe for tasks with null hostnames from decommissioned host resources
• 2263 - Count all lost tasks as inactive
• 2257 - Fix npm dependencies
• 2247 - Restore old constructor in singularity request parent
• 2251 - Guice bindings for custom authorizer implementations
• 2244 - Avoid Request Locks With Task Lag
• 2243 - Clean up more zk parent nodes for stale requests
• 2240 - Cleanup hosts marked as missing on startup
• 2237 - Limit # of crash loop nodes for requests without requiring new deploys
• 2238 - Fix NoSuchFileExceptions in S3Uploader
• 2236 - Fix junit jupiter setup
• 2234 - Log task resource usage at trace level
• 2235 - Avoid null next value in zk curator load distributor
• 2230 - Fix possible port collisions across tasks again
• 2233 - Better handling of errors in scheduler poller
• 2215 - Fix possible port collisions across tasks
• 2213 - Caffeine cache for request api
• 2214 - Replace caffeine cache with reference to full map
• 2212 - Prevent map merge issues in artifact verification
• 2210 - Check against artifacts without signatures
• 2208 - Add taskId to loadbalancer upstream
• 2207 - Add extension to agent decom
• 2203 - Only run force logrotates for cron-faked logrotate confs which actually exist on the filesystem
• 2204 - Extra logging in deploy checker
• 2200 - One additional null check in uploader client return
• 2197 - Correctly render cron entries for size-based logrotation.
• 2175 - Throw exception to resubscribe to mesos
• 2170 - Default to user id when no email available in notifications

Documentation

• 2218 - Update adopters.md