Release Report (sprint-60 - sprint-61)

Major accomplishments:

• SDSC issue investigated and resolved
• UI load issue investigated and appears to be resolved (monitoring)
• Collection Admin features enabled in production
• Cognito + SAML enabled in production
• Storage Scan implementation on Stage
• Queue visibility gained (Access, Inventory, Ingest)

mrt-doc sprint-60-main..sprint-61-main

• c112269 2021-10-27 Update log with sprint goals for Sprints 61 and 62
• 38893c5 2021-10-27 update nav
• 7ab445f 2021-10-27 index nav
• 2a17521 2021-10-27 add saml to cognito diagrams
• 2fedf5b 2021-10-27 refine nav/index
• ad19d26 2021-10-27 prev page nav
• 83c1b4d 2021-10-27 prev page nav
• bbb476d 2021-10-27 update highlight
• ef24ed5 2021-10-27 ui4
• c106e26 2021-10-27 update ui4
• b580eb3 2021-10-27 diagram updates
• f596104 2021-10-19 Refine store admin notes
• f50c4e2 2021-10-19 Refine Storage Admin Design

mrt-inventory sprint-60..sprint-61

• 18c0498 2021-10-21 Merge pull request 6 from CDLUC3/scan
• 5f61321 2021-10-21 Minor changes to status

mrt-ingest sprint-60-main..sprint-61-main

• 1e8bf47 2021-10-26 Merge pull request 32 from CDLUC3/requeueAPI
• ad7ce6d 2021-10-24 Support delete queue API
• 2e64615 2021-10-24 requeue API
• 8f9638d 2021-10-13 Merge pull request 31 from CDLUC3/zkQueuesAPI
• 1bc9b46 2021-10-13 Add que:queueNode and que:ID to Access and Inventory queries

mrt-replic sprint-60..sprint-61

• 7ec8648 2021-10-22 Merge pull request 6 from CDLUC3/scan
• b280b58 2021-10-21 Switch copy to CopyManifestVersion Add scan status command Add orphan copy

mrt-store sprint-60..sprint-61

• 718c951 2021-10-13 Merge pull request 20 from CDLUC3/queueAccess
• 105e990 2021-10-13 Fix overflow bug for large/small worker threshold

mrt-cloud sprint-60..sprint-61

• 0ac8054 2021-10-22 Reset logging for needsCopy
• 9ff729d 2021-10-21 CloudManifestCopyVersion replaces existing copy - block copy on matching meta sha256

mrt-zoo sprint-60..sprint-61

• dc43017 2021-10-27 Change cdl-zk-queue delete to deletep. Used on zookeeper exception

cdl-zk-queue sprint-60..sprint-61

• 7aa272c 2021-10-26 Merge pull request 4 from CDLUC3/requeueFail
• 3ff0edb 2021-10-24 Support requeue and delete

mrt-dashboard sprint-60-main..sprint-61-main

• f1aaf9e8 2021-10-22 Merge pull request 106 from CDLUC3/i724a
• f55de4a2 2021-10-21 force commit
• 5d9e5d3f 2021-10-21 update puma, add robots

mrt-admin-lambda sprint-60-main..sprint-61-main

• 36a9593 2021-10-27 Merge pull request 35 from CDLUC3/requeue
• 90a0db9 2021-10-27 use storage scan id
• 0e83834 2021-10-27 refine queue state handling
• f2526a3 2021-10-26 update reload handling
• f1e98b9 2021-10-26 ajax invoke of queue cmd
• 37af854 2021-10-25 requeue buttons
• ec6f736 2021-10-22 pull name when no mnemonic exists
• d5a1b7b 2021-10-22 Add link to collection info
• 3bb9a15 2021-10-22 coll info page
• 58a0005 2021-10-22 store obj page simplification
• 62101b6 2021-10-21 add buttons
• 1724605 2021-10-18 query scans table
• ecea5c8 2021-10-18 refine use of WARN
• c53c789 2021-10-15 datetime fileds
• 9e88268 2021-10-15 Queue report date filters
• 8adfe8b 2021-10-14 Identify large access server
• 1f2cb71 2021-10-14 add clarifying text to pages, limit admin object submission
• c062aa0 2021-10-14 Allow colladmin in prod
• 6e02a0f 2021-10-14 query on mod date
• 9cc9f5c 2021-10-13 categorize replic initiated
• ed35afc 2021-10-13 Add category to replic report
• 1372912 2021-10-12 add ip and az to server info
• d69a2f0 2021-10-12 add prior/next day nav
• 65d8f78 2021-10-11 report tidy
• 51335b3 2021-10-10 refine replic queries
• 8902cec 2021-10-08 clear stale audit batches
• e6bb8e4 2021-10-07 tidy store admin buttons
• 0463c4f 2021-10-07 support reaudit and rereplic in prod
• 0b3ba71 2021-10-07 Merge pull request 34 from CDLUC3/ingestSSM
• dd70dec 2021-10-01 Ingest SSM parms

mrt-cron sprint-60-main..sprint-61-main

• 31d190f 2021-10-18 call aggregate mult_coll
• 5b81b3b 2021-10-15 add queue reports

merritt-docker sprint-60-main..sprint-61-main

• 9d1ddb5 2021-10-27 update commits
• 5d128fd 2021-10-21 update commits

mrt-dashboard-config sprint-60..sprint-61

• 2a4b9e1 2021-10-12 #819
• a1aea00 2021-10-12 Fix error in creating Jack Miles papers
• 0f84a86 2021-10-12 #818
• 09dcadd 2021-10-12 #817

Deployment 2021-11-10: Ingest Callback Method

#844

Deployment 2021-11-09: Replication Scan

#842

Deployment 2021-11-03: Deploy Atom Feed Default Page Size Change

#846

Deployment 2021-10-28: Ingest Releases - EZID retry handling, Requeuing Endpoints

• #840
• #841

Deployment 2021-10-21: UI Release Puma Update to 5.5.1

#831

At the same time this change was deployed, Ashley modified our puppet config files to redirect /tmp to a larger disk.

Deployment 2021-10-19: Redeploy access server daemon control

#829

Sprint 60: Release Report (sprint-59 - sprint-60)

Major accomplishments:

• Storage Access queueing released
• Storage scan implementation moved to Stage
• Collection Admin: collection admin object submission workflow completed
• Collection admin object review and cleanup
• Multiple new Nuxeo feeds established for UCI

mrt-doc sprint-59-main..sprint-60-main

• 861dd34 2021-10-05 Merge pull request 813 from CDLUC3/release-template
• e479d12 2021-10-05 Create a Release templates
• b008e96 2021-10-01 Merge branch 'main' of https://github.com/CDLUC3/mrt-doc into main
• a148bed 2021-10-01 diagram updates
• b14f67f 2021-09-23 rm act on collection links

mrt-inventory sprint-59..sprint-60

• 3c43c4e 2021-10-05 Merge pull request 5 from CDLUC3/scan
• 16029bb 2021-10-05 Scan content objects
• ecf923a 2021-08-27 inv changes for replic scan
• edb1f97 2020-11-19 remove back-slash from ingest properties to be loadded

mrt-ingest sprint-59-main..sprint-60-main

• bb17200 2021-09-29 Merge pull request 30 from CDLUC3/ezidAdminMint
• 554032f 2021-09-28 Can not mint and make unavailable. Let's flag admin objects as "reserved" https://ezid.cdlib.org/doc/apidoc.htmlidentifier-status
• 171723e 2021-09-27 Merge pull request 29 from CDLUC3/zkQueuesAPI
• 8d20806 2021-09-24 Complete support for Inv and Access queue endpoints
• de75d0e 2021-09-23 Support Access and Inventory queue listing

mrt-replic sprint-59..sprint-60

• 3da2ec6 2021-10-05 Merge pull request 5 from CDLUC3/scan
• 8efb456 2021-10-05 Scan content objects
• defcd18 2021-08-27 changes replic scan

mrt-store sprint-59..sprint-60

• c9a7182 2021-09-22 Change status 201 to original 202
• 474179b 2021-09-17 Merge pull request 19 from CDLUC3/queueAccess
• 1886c22 2021-09-15 Allow large workers to process small queue when idle
• 1fb375f 2021-09-15 Fail a request on the ZK queue, if necessary
• 9733181 2021-09-14 Enable daemon process to perform work
• a54271c 2021-09-14 Merge remote-tracking branch 'origin/queueAsync' into queueAccess
• 8095792 2021-09-14 Create queuing method and prepare to integrate presigned processing method
• 4f24e4a 2021-09-14 changes to support queued creation of archive file
• 6d801c6 2021-09-01 Stub of Daemon thread to process access zookeeper queue.

mrt-cloud sprint-59..sprint-60

• 4633e7c 2021-10-05 Merge pull request 18 from CDLUC3/ListAfter
• a11ee2d 2021-10-05 Prop to Entry
• 1e52fa2 2021-08-26 ListAfter changes

mrt-core2 sprint-59..sprint-60

• f224861 2021-10-05 Add scan classes to format table

cdl-zk-queue sprint-59..sprint-60

• 39283cb 2021-09-17 Merge pull request 3 from CDLUC3/requeueFail
• 1f612a9 2021-09-15 Create ability to fail a ZK entry from consumed state

mrt-dashboard sprint-59-main..sprint-60-main

• 058a786b 2021-09-27 Merge pull request 104 from CDLUC3/i724
• 71bb049a 2021-09-27 return 308
• 227cfeb0 2021-09-27 disable file download
• 12e24901 2021-09-22 update favicon

mrt-admin-lambda sprint-59-main..sprint-60-main

• 10023a6 2021-10-01 document DEV only vars
• 70cb1f0 2021-10-01 fix keys, add top level comment
• 50bc032 2021-10-01 document ssm vars
• a885e62 2021-10-01 formulate state endpoints
• 75df205 2021-10-01 use port numbers for state requests
• b1bdc6e 2021-10-01 refine own/coll inserts
• 83d6a56 2021-09-30 add ec2 and ssm registry
• f07d325 2021-09-28 system introspect reports
• 29c664a 2021-09-28 add queue props
• 089d8fa 2021-09-28 Merge pull request 33 from CDLUC3/invaccqueue
• 90fde9f 2021-09-28 display access queue
• a1ca0f1 2021-09-28 disp new queues
• 3319b17 2021-09-28 add context for admintool
• 0b193b3 2021-09-23 refine button activation
• 05463c7 2021-09-23 audit replic button consistency
• f276b24 2021-09-23 implement audit restart
• ff48089 2021-09-21 refine objlist rpts
• 706a1eb 2021-09-21 add child count to adobj rpts
• 17f991c 2021-09-21 Split admin submit vs update list
• c20944e 2021-09-21 document authentication
• 73f862d 2021-09-20 read client context
• c1d0868 2021-09-20 update permission check
• 30aab29 2021-09-20 add unver node info
• 78a2f4c 2021-09-20 link audit reports
• 161ba7c 2021-09-20 audit status link
• b26cf33 2021-09-17 cognito perm tests
• 75b0bbe 2021-09-17 refine colladmin nodes pages
• 14106df 2021-09-17 display users and groups
• 2fec010 2021-09-16 store admin params
• e473df9 2021-09-16 refine match rpts

mrt-cron sprint-59-main..sprint-60-main

• b621037 2021-09-20 update email dist
• 439e9f0 2021-09-20 Merge pull request 1 from CDLUC3/context
• 6635797 2021-09-20 strict enc
• 6e34ddb 2021-09-20 move context config
• 96feeb1 2021-09-20 cli context
• de96183 2021-09-20 enc context
• 9eb56aa 2021-09-20 update context logic
• cc31ab5 2021-09-20 context
• 7054915 2021-09-20 pass context

merritt-docker sprint-59-main..sprint-60-main

• e9824db 2021-10-01 commit update
• b0a4bb0 2021-09-28 Start Access Daemon process for Access/Storage
• d99dee9 2021-09-20 refine store nodes info

mrt-dashboard-config sprint-59..sprint-60

• b190c68 2021-09-30 #804
• 15924f7 2021-09-30 #799
• 797cf7b 2021-09-30 #798
• 0a93c7a 2021-09-30 #797
• 7a020fa 2021-09-29 New Nuxeo feed from UCI

Deployment 2021-10-14: Ingest Service - provide api access to the inventory queue and to the access queue

Reference release ticket: #810

Deployment 2021-10-13: Access Server - Read large assembly SSM variable as a long vs an int

Reference release ticket: #826