tags |
---|
CDEvents |
This document contains the notes from the CDEvents Working Group.
- Tuesday meetings are held at 3pm UTC during summer time and at 4pm UTC during winter time)
- Monday meetings are held at 11am UTC during summer time and at 12pm UTC during winter time).
Participants:
- Name / affiliation / TZ
Links:
Agenda:
- New attendees
- Action Items
- <addme>
- Review proposal for demo system cdevents#31
Participants:
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Ben Powell, Apple, CST
- Brett Smith, SAS, UTC-4
- Christian Provenzano, Fidelity, UTC-4
Agenda:
-
New attendees
-
Action Items
- Ben to prepare a demo on the maintainability topic
- Plan to work on it next week
- Demo in 2024
- Owen to create an issue about capitalizing URI
- Andrea to archive meeting notes for 2023
- Andrea to create an issue about conformance groups: pending
- Andrea to update the Artifact PR based on feedback: pending.
- Andrea to update the SBOM PR based on feedback: done
- Ben to prepare a demo on the maintainability topic
-
(Sean/Ben) Ticket/Approvals Proposal
- Tickets/issues
- Draft proposal
- Proposal planned for 1st/2nd week in Jan 2024
- Sean/Ben to compare the current proposal against existing ticketing systems (GitHub issues, etc)
-
(Jalander) Generate Java SDK v0.3.0
- PR is merged.
- Conformance testing?
- Apple looking to have an up to date Java SDK
- Apple experiencing issues with some of the APIs
- Andrea to make an Release Candidate in Jan to let people test it
-
(Andrea) Spelling PR cdevents/spec#173
- Andrea to update the config to exclude code sections in markdown
-
(Andrea) SBOM uri cdevents/spec#171
- We need to define how we want case to be in case of acronyms
- Update the document in https://github.com/cdevents/spec/blob/main/spec.md#types
- Andrea to create an issue
- Update two remaining comments and then ready to merge
-
(Brett) CDEvents Workshop
- More work coming on this in the next weeks
- Need a go client for the EPR API
- Workshop should not ask users to post JSON via curl :)
- Blog post to announce the EPR
- It mentions SAS so it needs internal approval
- More work coming on this in the next weeks
-
(Andrea) Custom events cdevents/spec#168
- Allowing for custom events expands the audience for events
- If we do allow custom events, we need a good set of rules
- We need to protect both producers and consumers
- The SDKs could provide hooks to parse the subject/context
- The schema should be hosted on the tool side, we could provide in the context a field that points to the schema
- Andrea to formalise the proposal in an hackmd linked into the issue
Participants:
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Christian Provenzano, Fidelity, UTC-4
- Andrew Larsen, SAS, UTC-4
- Owen Bower Adams, IGS, UTC
- Jalander Ramagiri, Ericsson Software Technology, UTC
Links:
Agenda:
-
New attendees
- Welcome Christian Provenzano
-
Action Items
- Ben to prepare a demo on the maintainability topic
Emil to create a repo for Brett's workshophttps://github.com/cdevents/event-provenance-registry-workshop- Owen to create an issue about capitalizing URI
Jalander to create a PR for SDK v0.3.0cdevents/sdk-java#62
-
Proposing Ben as spec maintainer
-
Introduce semantic conventions for CI/CD observability with OpenTelemetry
- Any update from the working group last week?
- Discussion about where the group belongs within CNCF
- PR was created to propose the group
- No technical discussion in the first meeting, mostly formalities
- Slack
- Meeting Notes
- PR
-
(Jalander) Generate Java SDK v0.3.0
-
CDEvents Governance
- CDEvents Governance election coming up
- SIG Events meeting tomorrow, we should bring this up there
- Processes and policies: https://github.com/cdevents/community/blob/main/governance.md
-
CDEvents meetings during holidays season
- Dec 18th: ok
- Dec 25th (US + APAC): cancelled
- Jan 1st: cancelled
- Jan 8th: ok
-
(Andrea) Artifact events cdevents/spec#143
- PR available cdevents/spec#172
- Existing event is called published
- Artifact pulled should be renamed to download
- "Pulled" is specific to git/oci and might be confusing
- Use cases for download
- Track downloads of restricted artifact
- Andrea to create an issue about conformance groups
- Let's use the CI bucket for artifact events until we define a policy for grouping events and conformance
-
(Andrea) SBOM uri cdevents/spec#171
-
(Andrea) Custom events cdevents/spec#168
-
(Brett) CDEvents Workshop
-
(Ben) Connecting & linking events
-
(Ben) Maintainability of schemas, examples, and tests
-
(Sean/Ben) Ticket/Approvals Proposal
Participants:
- Emil Bäckmark, Ericsson, UTC+1
- Brett Smith, SAS, UTC-4
- Ben Powell, Apple, CST
- Jalander Ramagiri, Ericsson Software Technology, UTC
- Owen Bower Adams, IGS, UTC
- Andrew Larsen, SAS, UTC-4
Links:
Agenda:
-
New attendees
-
Action Items
-
(Andrea/Emil) Proposal for Governance and Contributor Ladder
- Any objections to merging the PR? Ok to merge it now.
-
Introduce semantic conventions for CI/CD observability with OpenTelemetry
- Workgroup kick-off this Thursday: https://cloud-native.slack.com/archives/C0598R66XAP/p1701267889193129?thread_ts=1701100511.547279&cid=C0598R66XAP
- Emerged from open-telemetry/oteps#223 (comment)
-
(Ben) Connecting & linking events
- PR
- Will work on resolving the comments this week
-
(Ben) Maintainability of schemas, examples, and tests
- cdevents/spec#170
- Ben to prepare a demo this week
-
(Brett) Workshop for CDF with CDEvents
- WIP Event Provenance Registry
- We should create a workshop repo under CDEvents "Event Provenance Registry workshop". Set Brett and Andrew as maintainers.
- Action: Emil
-
(Sean/Ben) Ticket/Approvals Proposal
-
(Andrea) Artifact events cdevents/spec#143
- PR available cdevents/spec#172
- Artifact scanned event upcoming
- Discussions about what scanning an artifact means and how it should be noted in events. Different scan types need to be possible to provide.
- Scanning is made for example to find CVEs. 'binary.analyzed' migt be an option, to also cater for other types of binary analyses
- Also source code, Docker base images and deployments are scanned at SAS. Would it be better to have a 'scan.performed' event instead, to not limit to binaries only?
- The links proposal should be able to help declaring what artifacts has passed a certain scanning step or not, etc.
-
(Andrea) SBOM uri cdevents/spec#171
- What about capitalizing 'URI' in our parameters? What are the concerns regarding SDKs when it comes to paremeters formats?
- Owen to write an issue to track that discussion
- Concistency is key. Regardless of if we choose capitalizing all abbreviations or not.
- Golang is opinionated about capitalizing URI so we might need to stick with that.
-
(Jalander) Generate Java SDK v0.3.0
- PR to be created - cdevents/sdk-java#62
-
(Andrea) Custom events cdevents/spec#168
Participants:
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Brett Smith, SAS, UTC-4
- Ben Powell, Apple, UTC+1
- Jalander Ramagiri, Ericsson Software Technology, UTC
Links:
Agenda:
-
New attendees
- Andrew Larsen, SAS, welcome!
-
(Andrea) Proposal for Governance and Contributor Ladder
- Spec maintainers file cdevents/spec#167
-
(Ben) Connecting & linking events
- PR
- Examples to be updated
-
(Ben) Maintainability of schemas, examples, and tests
- cdevents/spec#170
- Very painful today to make changes to the CDEvents context
- Ben to prepare a demo next week
- Examples today have two functions:
- Documentation
- Testing (SDK conformance)
- Automation will generate
- Schemas - factor up duplicate schema fragments
- Examples for testing purposes
- Template engine:
- Emil:
- Hopefully not too many context changes in future
- It would be good to still validate any example we provide
- Ben: would like to handle testing of examples in a separate proposal
- Brett:
- Jinja - very powerful, it can become hard to read at times
- gomplate - could as well use go template directly
- Ben: gomplate provides a CLI on top of go template
- examples should always pass the schema
- Why not using the examples using the SDK?
- SDKs are dependant on the examples
- Chicken and egg issue with updating schema, examples, and SDK
-
(Brett) Workshop for CDF with CDEvents
- WIP Event Provenance Registry
- Ben: what is the goal of the workshop
- Brett: workshop definition still being figured out
-
(Sean/Ben) Ticket/Approvals Proposal
-
(Andrea) Artifact events cdevents/spec#143
- PR available cdevents/spec#172
- Artifact scanned event upcoming
-
(Andrea) SBOM uri cdevents/spec#171
-
(Andrea) Custom events cdevents/spec#168
Participants:
- Emil Bäckmark, Ericsson, UTC+1
- Jalander Ramagiri, Ericsson Software Technology, UTC
- Ben Powell, Apple, CST
- Sean Brennan, Bloomberg, EST
- Andrea Frittoli, IBM, UTC
Links:
Agenda:
-
New attendees
-
Action Items
-
(Adam) Flux CD Integration with CDEvents
- Discussion held in Flux dev meeting
- fluxcd/flux2#4339
- Showcased a receiver & provider demo
- Reciever (consumer) will get a PR up soon
- The provider (producer) will need some more discussions before being implemented
- Where should source change events be sent from, when Flux directly integrates with e.g. GitHub?
- (Emil) The CDEvents protocol doesn't dictate who should send what event
- (Emil) It's important that the same event is not sent from multiple producers. Events should be unique.
- (Emil, Ben) The event should be sent as close to the source of the occurrence as possible. I.e. SCM related events should be sent from the SCM system if possible.
- (Emil) It's up to the system integrator to decide what tool sends what events.
-
(Jalander) Design approach Gerrit CDEvents integration
- (Emil) Would it be relevant/helpful to also have Argo-events in this picture? argoproj/argo-events#2841
- (Andrea) We shouldn't maintain a lot of tool specific CDEvents implementations. With our limited community we need to take concious decisions on what tools to provide plugins or translators for
- (Emil) Webhook vs Gerrit 'stream-event' (inbout vs outbound connection & https vs ssh)?
-
Connecting & linking events
-
Ticket/Approvals Proposal
- Tickets/issues
- Draft proposal
- PR to be created
-
(Andrea) Proposal for Governance and Contributor Ladder
- Targeting final review at next CDEvents meeting
-
Postponed to next meeting: (Andrea) Harbor integration & custom events
- Artifact events cdevents/spec#143
- Custom events cdevents/spec#168
-
Java SDK updates
- To be reviewed - cdevents/sdk-java#60
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Ben Powell, Apple, CST
- Sean Brennan, Bloomberg, EST
- Jalander Ramagiri, Ericsson Software Technology, UTC
Links:
Agenda:
-
New attendees
- Felipe Silveira, Farfetch
- Focussed on CI/CD, ArgoCD, Workflow, Jenkins
- Felipe Silveira, Farfetch
-
Action Items
-
<addme>
-
(Andrea) Proposal for Governance and Contributor Ladder
- Once we have an agreed version we can
- Start GB elections
- Setup GitHub reviewes/maintainers teams and files
- Once we have an agreed version we can
-
(Andrea) Updates from KubeCon+CloudNativeCon NA
- Make projects and companies available on the CDEvents website cdevents/cdevents.dev#36
- Harbor
- Still supportive of CDEvents adoption
- CDEvents notifications must cover all event types. For Harbor events that are not defined by the CDEvents spec
- A schema should be defined
- The schema could be maintained on Harbor side
- Versioning to be clarified
- Extension mechanism on CDEvents side
- Proposal: cdevents/spec#168
- Other registries to look into
- CNCF App Delivery TAG
- Still interested in CDEvents
- Need contributors to work with Podtato Head
- Argo CD / Workflow
- Still interested in CDEvents
- (Initial) implementation could be achieved via Argo Notifications
- Use templates instead of SDKs
- Met together with CNOE.io team repr
- CNOE.io
- IDP platform, very interested in CDEvents
- Define capabilities as well as CNOE favourite set of tools
- Would like to support interoperability
- Make it easy to swap tools
- Single language for a Backstage plugin to surface data to users
- Would need IaaS events
- Will help drive implementation in Argo CD/Workflow and possibly other tools
- Guac.sh
- Interested in ingesting SBOM through CDEvents
- SBOM link in artifact events
- Artifact type already in purl
- SBOM type is not important for guac (for now at least)
- Should try and include in upcoming v0.4
- Interested in asyncapi.io / openapi definitions for CDEvents
- Pelorus project for DORA metrics
- Harness
- CDEvents integration may be technically simple
- Engineering focussed on end-user demand, CDEvents not in scope yet
- May be possible to build a POC in collaboration with Dev Advocacy
- Dagger.io
- Interested in pipeline observability
- Looked into distributed tracing, however the lack of fan-in was a showstopper
- CDEvents is an interesting alternative as long as it supports fan-in/fan-out
- Some vendors associated the idea of interoperability with making it easiers for users to leave their platform
- My take on this is that it also makes it easier for users to adopt their platform. Users should stay because the platform is excellent in solving their problem, not because of lock-in and attrition.
- Ben: how do we alleviate that fear? Similar to early days of SQL.
-
Connecting & linking events
- PR
- New link type
- Connecting of the graph
- Attach metadata to nodes in the graph
- Commit 1. New PR coming up to separate the two things
- Commit 2. Adding optional links to context
- Commit 3. Examples being added
-
Tickets / Approvals
- Probably two separate proposals
- Tickets first, only a couple of outstanding questions
- How to link tickets to anything else
- Trying to envision how a consumer would use this events
- We won't model the consumer workflow in the protocol
- Next week or two ready for initial review
-
Java SDK
- Generating the SDK - review pending
-
Flux
- Flux integration work in progress
- Planning to present to flux community this week or next
- Flux integration work in progress
Participants:
- Name / affiliation / TZ
- Emil Bäckmark, Ericsson, UTC+1
- Ben Powell, Apple, CST
- Sean Brennan, Bloomberg, EST
Links:
Agenda:
-
New attendees
-
Action Items
- Ben, Add reviewers to Spinnaker FE PR
-
- Project
- No resolved issues this time
-
CDEvents integrations
- Project: https://github.com/orgs/cdevents/projects/4
- Proposed implementations at Apple that could potentially be open-sourced if the community is interested
- Event bus - with authentication/autorization
- Collector - for collecting events in a distributed way. Might not be needed at this stage, before we reach a certain scale of events sent
- Links service - for connecting events
- Events storage - for storing and retrieving events
- Does the CDEvents SDK propagate for any specific infrastructure?
- No, they should all be based on the corresponding Cloudevents SDK
-
Connecting & linking events
- PR
- (Andrea) Fan-out/fan-in support
- Supported today through links
- It would be nice to support through CDEvents context alone
- What about adding a list of parent_ids into the context (together with chain_id) for a simple solution for fan-out/fan-in?
- Alternative add the link list into the context?
- NIT: could we call the chain_id a graph_id
-
<addme>
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, he/him, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Sean Brennan, Bloomberg, UTC-4
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
New attendees
-
Action Items
- Andrea, Meeting times ✔️
- Andrea, create an issue about deprecations ✔️
- Ben, Add reviewers to Spinnaker FE PR
-
Meeting recordings
- New notification in the #cdevents channel
-
LF Member Summit Updates (Andrea)
- Presentation
- Possible collaboration with Guac / OpenSSF
- Guac provides storage for supply chain documents, needs data/context with events in the CI/CD pipeline
- CDEvents could provide that link
- Prototype by Michael Libermann
-
CDEvents mentioned in CNCF slack channels
- #aep
- #cicd-o11y (opentelemetry)
-
CNOE https://cnoe.io/
-
Cloud Native Telco Day
- Andrea - CDEvents lightning talk
-
CDEvents integrations
- Project: https://github.com/orgs/cdevents/projects/4
- GitHub action repo cdevents#28
- Andrea to follow up on potential JFrog integration
-
Connecting Events
- Connecting/linking events
- New PR version to be reviewed
-
Ticket/Approvals Proposal
-
Planning for v0.4
- Proposal: aiming for a v0.4 by the end of November
- In time for cdCon Japan Dec 4
- Scope:
- Connecting events
- SBOM link in artifact events
- Do we need to store the format of the SBOM?
- Ortelius registry link?
-
Implementing CDEvents
- Is there any guidance about implementing CDEvents
- Setting up topics
- Architecture
- Emil: no experience in prod with CDEvents, but could share best practices about Eiffel
- Fidelity and SAS may have some insight
- CDF User Stories https://cd.foundation/user-stories-and-whitepapers/
- CDF Best Practices https://bestpractices.cd.foundation/
- CDF Reference Architecture https://bestpractices.cd.foundation/architecture/
- CDEvents https://cdevents.dev/docs/primer/
- We could expand on the primer
-
<addme>
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, he/him, IBM, PDT
- Ben Powell, Apple, CST
- Emil Bäckmark, Ericsson, UTC+2
- Sean Brennan, Bloomberg, EST
- Jalander Ramagiri, Ericsson Software Technology, UTC+1
- Owen Bower Adams, Intelligent Growth Solutions, BST
Links:
-
- Planned for TBD
-
New meeting schedule (reminder)
- CDEvents: Every Monday at 3pm UTC (Summer) / 4pm (Winter)
- Every 4 weeks APAC friendly meeting at 11am UTC (Nov 27th ->)
- DST in Americas end on Nov 5: https://en.wikipedia.org/wiki/Daylight_saving_time_in_the_United_States
- DST in Europe end on Oct 29: https://en.wikipedia.org/wiki/Summer_time_in_Europe#Table_of_transition_dates_for_European_Summer_Time
- Andrea to propose the exact time for next week on slack (1h later for EU timezone)
-
Connecting Events
- Connecting/linking events
- Ben to address comments on the links section
- Ben will update the PR with schema updates (all events)
- Ben plans to create a mock CI/CD system to demonstrate links to demonstrate CDEvents at Apple
-
Ticket Proposal
- Sean and Ben met weekly to discuss about this
- Approvals
- Dedicated subject or use the tickets subject
- At Apple: an approval is every time a manual approval is involved
- Good for auditing
- Example, during freeze, two step approval process is required
- Emil: at Ericsson, approval is only at review time
- Alternative: add "approved" preticate to all (many) events
- Ben and Sean to identify pros/cons of the two options
- A new "approval" subject (declined, accepted?, in progress)
- Add "approval" predicate to several existing subjects
- Tickets
- ticket subject
- Predicates could be what happened or the ticket state
- Emil: workflow can be customised per project/team, predicates should not dictate the workflow names
- Approvals
- Owen:
- Automated approval can be part of the model
- An approval can come from humans or machines or a combination
- It would be good to include this in the "approval" subject docs
- Emil:
- PRs can be automatically approved if they are small enough
- Owen:
-
PR Reviews
-
Deprecation of fields
- Option1 - Document on the markdown, define an ETA for removal
- Option2 - Keep the deprecate fields forever
- Option3 - Just update the version and drop the field
- Related PR
- PR not urgent, good to use to define the deprecation process
- Action Andrea to capture this in a ticket
-
SDKs Updates
- Java
- Part 2 of generating the SDK to be reviewed
- cdevents/sdk-java#60
- Rust
- Scaffolding started as part of Hacktoberfest
- .NET
- Owen: have been working wih a manually generated .NET SDK for a couple of months. Work is starting on a generated version.
- Ben: what languages are tools written in?
- Swift used heavly at Apple
- Java
-
CDEvents Use Cases
- Owen to present internal use cases for CDEvents (added to the agenda in a few weeks)
-
Spinnaker
- Ben to add reviewers to the Front End PR
-
<other topics, please add>
Participants:
- Name / affiliation / TZ
- Emil Bäckmark, Ericsson, UTC+1
- Andrea Frittoli, IBM, UTC+1
- Jalander Ramagiri, Ericsson Software Technology, UTC+1
Links:
-
- Planned for TBD
-
New attendees
-
Adam working on a Flux integration
- Jalander: Plan to include in the original POC
- Emil: should we have a dedicated POC instead?
- https://github.com/orgs/cdevents/projects/4
- Adam to file an issue on CDEvents side
-
Connecting Events
- Connecting/linking events
- Emil: Call for reviews!
-
Proposed New Meeting Schedule:
- CDEvents APAC meeting, 10am UTC, every 4 weeks on Monday, starting 30/10
- CDEvents EMEA/NA meeting 1, 3pm UTC, every other Tuesday, starting on 17/10 (no change!)
- CDEvents EMEA/NA meeting 2, 3pm UTC, every other Monday, starting on 09/10 (takes the slot that used to be SIG Events)
- SIG Events, 3pm UTC, every 4 weeks on Monday, starting 16/10 (same time, different week)
- Topics that are broader than CDEvents, e.g. VSMI or events in general
-
PR Reviews
- https://github.com/cdevents/spec/pulls
- URL to URI cdevents/spec#162
- Version numbers ok now
- Will the backwards incompatible change cause issues for SDKs?
-
SDKs Updates
- Java
- Part 1 of generating the SDK is merged
- Part 2 to be reviewed?
- Java
-
Spinnaker integration
- Jalander working on addressing review comments
-
Ben: can we add links to recording in these notes?
- Andrea to share the link to the videos
-
<other topics, please add>
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, IBM, UTC+1
- Ben Powell, Apple, CST
- Emil Bäckmark, Ericsson, UTC+2
- Daniel Han, Bloomberg, EDT
Links:
-
- Planned for TBD
-
New attendees
- Sean Brennan - Bloomberg
- E2E visibility
- Automation in pipelines
- Sean Brennan - Bloomberg
-
Discuss introduction of new ticket/issue events, with Sean Brennan, base on Slack chat
- Also detailed in issue 164
- Sean: Product approvals through issues
- Ben: CDEvents for ticketing systems needed at Apple
- Link between PRs and issues
- At bloomberg: Jira ID in the PR title
- Emil: at Ericsson, specific syntax in the commit message
- Andrea: CDEvents should define the data model of how tickets and CSM/other events are connected
- What does the data model look like?
- Possibly a ticket subject
- Several events:
- Create event is needed
- Ben: we will need a "resolved" event too. It would be important for deploy/rollback use cases
- Sean: updates / transition events, e.g. approval
- Do we need to track all ticket events?
- Emil: we should not replicate the whole data model of ticketing systems
- Ben: we can optional components of the tickets spec
- Sean: if we define events, consumers may use those they need
- Daniel: identify the bare minimum data model we can start with
- We can add more fields, but we need to be careful and not to slip into adding too much
- Next steps:
- Example proposals
- Testing events cdevents/spec#126
- Incident events cdevents/spec#107
- Sean and Ben to collaborate on getting this started
- Example proposals
-
Meetings Schedule Review
- Weekly alternate times
- SIG Events bi-weekly
- Proposal for new meeting schedule
- Every other Monday and every other Tuesday
- Reduce APAC meeting to monthly/optional
-
OTel proposal
- OpenTelemetry and CDEvents
- Ben cannot share example payloads from Apple about how CDEvents would work at Apple
-
- Ben to document advantages of using separate link events
-
PR Reviews
-
SDKs Updates
- Java
- Part 1 of generating the SDK is merged
- Part 2 to be reviewed?
- Java
Participants:
- Name / affiliation / TZ
- Andrea Frittoli. IBM, UTC+1
Links:
-
- Planned for TBD
-
New attendees
-
OTel proposal
-
PR Reviews
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, he/him, IBM, UTC+1
- Ben Powell, Apple, CST
- Daniel Han, Bloomberg, EDT
- Emil Bäckmark, Ericsson, UTC+2
- Dotan Horovits, Logz.io, CNCF, UTC+3
- Adam Kenihan
- Evan Elms
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
New attendees
-
Action Items
-
Focus on "Tracing with CDEvents"
- with Dotan Horovits, OpenTelemetry and CDEvents
- A new OTEP to add CI/CD observability semantics to OpenTelemetry
- Dotan presented
- Brief intro to OTel
- Main uses case is monitoring a production system
- Monitoring the release pipeline is just as critical
- Otel plugin for Jenkins shows some pipeline data: https://plugins.jenkins.io/opentelemetry/ (in proprietary format)
- OTel is not just for distributed tracing, but also to monitoring and logging
- Blog post: https://logz.io/learn/cicd-observability-jenkins/
- The PR focuses on the modelling part (read it in repo)
- OTLP allows to transmit OTel data within other protocols
- OpenObservability Talks podcast episode on observability in CI/CD pipelines, hosting Oleg Nenashev: https://podcasters.spotify.com/pod/show/openobservability/episodes/Continuous-Observability-Shedding-Light-on-CICD-Pipelines---OpenObservability-Talks-S3E02-e26p5fk
- Questions
- Where should the border between CDEvents and OTel be? What should be notified with what technology/protocol?
- Next steps
- Andrea to call for a separate session to continue the discussion on OTel & CDEvents
- It would be great to have a simple PoC showcasing how we can manage this
- with Dotan Horovits, OpenTelemetry and CDEvents
-
- Ben will add example payloads to the sequence diagram events, for clarity
- Also add some pros/cons on keeping the relation object as a separate event compared to including it as an optional array of relations within the events
- Consider architectural differences
-
- Not many issues labeled yet
-
SDK Updates
-
Integration updates
- Tekton: proposal merged
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Andrea Frittoli, IBM, UTC+1
- Victor Lu
Links:
- v0.4 Roadmap
- Planned for TBD
Agenda:
-
New attendees
-
Action Items
-
Visualisation POC (@SIG Events meeting)
- PR: cdevents/visualisation#1
- GitHub Action with hosted worker
- Visualization independent from tools
- Two kind of visualization tools
- CDEvents specific
- Generic (Grafana based)
- Dependency to the link model
- Current assumption do not affect the visualisation codebase much
- Data collection part depends on the link model
- POC Demo Recording
-
(Victor) Comparison of different CI/CD
- It would be nice to have a comparision table to understand which tool can be used for what
- Discussion forum would be helpful too
-
- Action for all: label issues for hacktoberfest
-
- A few PR were merged
- We could make a release if it takes too long for connecting events to be implemented
-
SDK Updates
- Java v0.1.2 released
- Dotnet SDK
- obowersa plans to contribute the SDK
- slack thread
- Would be good to plan a presentation / discussion in the CDEvents WG
-
Integration updates
- Tekton: proposal approved
- Harbor: proposal pending approval
- Argo CD: draft proposal - next step is building a POC, Andrea to follow-up
- Spinnaker: PRs pending reviews
-
- Ben has some action items to update the PR based on the latest discussion
- List of parent ids to be removed for now and potentially added back later on
-
<addme>
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Ben Powell, Apple, CST
Agenda:
-
Connecting/linking events, using trace spans
- How to create/finish spans
- We could hide the complexity of calling a Links Service, when producing events, within the SDK.
- Having a links service as part of producing an event adds a synchronous/blocking call, unless the links service is also called through the asynchronous message bus
- Specific or generic relations types
- Links/relationships between events is critically important if not all info relevant for a consumer is contained within a specific event.
- Should a service.deployed event contain all relevant info from artifact.packaged and change.merged event, or should the relationships between the events be used to find that info.
- What should the global id / trace id be called?
- Global id, Trace id, Context id, Trail id, Lifecycle id, ...
- Ben will create a poll on CDEvents Slack to vote for the right term
- For now the parent id will be removed from the PR, just keeping the global id in there.
- To be discussed further and eventually decided on:
- Should the relationships/links be contained in the Links Spec and event data in CDEvents spec, or should it all be combined in the CDEvents spec?
- Span id to be the only relationship to keep in the CDEvents spec, and the rest of relationships in the Links spec?
- Separating the data from relationships introduced a dependency between the two, both ways, and they need to evolve hand-in-hand
- Should the relationships/links be contained in the Links Spec and event data in CDEvents spec, or should it all be combined in the CDEvents spec?
- How to create/finish spans
-
Hacktoberfest
- cdevents#35
- Let's label more issues
- https://docs.google.com/document/d/1IxVtP7GTm0NqwIn98pLSHONKllbzm0kVRmURn8x394w/edit
- Ben will create/identify some issues and ask Emil/Andrea to label them.
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Brad McCoy, Basiq, UTC+11
- Adam Kenihan, UTC+1
Agenda:
-
Incident Events
- (Brad) shows an implementation of incident.reported event with Atlassian Jira
-
GitHub Actions
- (Brad) Working on GitHub actions as well (TestKube folks interested)
- GitHub actions runner (self-hosted runner). Could either pull or push.
- https://github.com/cdevents/github-action
-
OpenTelemetry integration. Not much news. Looking forward to discussion on Sept 5.
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Ben Powell, Apple, CST
- Jalander Ramagiri, Ericsson Software Technology, UTC+1
- Daniel Han, Bloomberg, EDT
- Evan Elms
- Name / affiliation / TZ
Links:
- v0.4 Roadmap
- Planned for 31.08. Will most certainly be delayed.
Agenda:
-
New attendees
-
Action Items
-
- Hacktoberfest on CDF Website
- CDEvents Hacktoberfest issue 2022
- CDEvents Hacktoberfest project 2023
- Emil to notify CDF about the new issue link once its there
- Items to add
- Ideas from Microcks presentation? cdevents/spec#148
- Visualization?
- Python SDK?
- Code generation
- Putting it on PyPi
- Other SDK improvements?
- Daniel to write an issue about code generation for e.g. Python/Go (could relate to cdevents/sdk-go#24)
- Generate DB schemas for the events?
- Client hooks for SDK usage
- Create github issue (Ben)
-
Visualization proposals
- https://github.com/cdevents/presentations/blob/main/CDEvents-Visualisation/CDEvents_visualisation_types.pdf
- A demo of the current state of the visualization PoC to be presented on SIG Events next week
-
Other current PRs and issues
- Java SDK generator cdevents/sdk-java#58
- Spinnaker integration spinnaker/deck#9997 spinnaker/echo#1295 Ben will invite reviewers to these reviews
-
<addme>
Meeting canceled since no one showed up
Participants:
- Andrea Frittoli, IBM, UTC+1
- Emil Bäckmark, Ericsson, UTC+2
- Ben Powell, Apple, CST
- Jalander Ramagiri, Ericsson Software Technology, UTC+1
- Tracy Ragan, DeployHub / Ortelius
- Adam Kenihan
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
New attendees
-
Action Items
-
- From CDF TOC meeting:
- Roxanne wants to know by August 31st
- Which projects plan to participate
- Blog posts need to be live and sent to CDF by September 29th
- Project contact persons need to be identified
- Hacktoberfest 2022 info on CDF Website
- Ideally list of participating projects and contact persons by next TOC meeting on Aug 15th
- Roxanne wants to know by August 31st
- Shall CDEvents participate?
- It requires a little bit of initial investment, but not too much
- The more we invest, the better the return, see Jenkins 2022 https://www.jenkins.io/events/hacktoberfest/
- It requires extra review bandwidth during the event
- Good for new reviewers and prospective reviewers to refine their skills and build review numbers
- It usually brings mostly occasional contributors, but it may help us tackling our bug backlog and implement small improvements on docs, tools and website
- If we participate, we need:
- One person driving the effort (contact for CDF)
- List of interested CDEvents projects, and project/areas ideas
- A blog post or github issue
- Ideally (but optional) list of interested reviewers / mentors
- Tracy:
- We should participate
- Happy to write a blog post
- Security Events?
- Point of contact for the CDF
- Ben: security events might be too much for hacktoberfest
- Emil: hacktobefest should be easy to review
- Topics:
- Ben:
- SDK code generation, modelling
- Documentation
- Abstraction layers
- Andrea:
- CLI
- Autogeneration of docs
- Investigate async
- Ben:
- 2022 Project: https://github.com/orgs/cdevents/projects/3/views/1
- From CDF TOC meeting:
-
v1.0 release
-
<please add>
Participants:
- Andrea Frittoli, IBM, UTC+1
- Neil McGonigle, Fidelity, UTC+1
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
New attendees
-
Action Items
-
Request for reviews:
-
Java SDK v0.1.2 released
Participants:
- Ben Powell, Apple, CST
- Andrea Frittoli, IBM, UTC+1
- Daniel Han, Bloomberg, EDT
- Neil McGonigle, Fidelity, UTC+1
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
New attendees
-
Action Items
-
(Ben) New optional fields for change events
-
Bundle artifacts are required to avoid sending one event for each single artifact
- Example deployment @ Apple with 500+ artifacts
- This is a single deployment, and there are many deployments
-
Ben: adding more fields, but make them optional
- Note: optional -> mandatory is a breaking change
- Requiring API Calls is not good for interoperability as they shift the issue of interoperability
-
Dan: for test cases we have testcaserun which could generate 1000s if events
- How would bundling help?
-
Dan: is there a cadence for releases
- Andrea: We are automating the SDKs updates
- Andrea: Currently we plan releases on demand, we could switch to a regular cadence if we have enough contributions
- (A) Andrea to make a proposal for regular release candence
-
Ben: How do we help people transition from customData to CDEvents data
-
Daniel: we could add helpers/adapters in the SDK that help with that
-
(A) Ben to create an issue to track this discussion
-
(Ben) Not all data in events can be disclosed to everyone
- Some team cannot broadcast their events to all
- Identity of sender
- Ben to create an issue
- Dan: can we have an FAQ page, recommendation about things
- How do I deal with security
- How do I add data to the subject
- Can be open-ended i.e. we have the question, not the answer yet
- Andrea: we have the primer today, but that does not answer specific questions
- Ben: it should not be in the spec
- Daniel: create an issue
-
(Ben) What about Ticket/Feature/Issues
- Brad McCoy is interested in this feature
- Steve Pereira from VSMI
-
Connecting Events
-
Bundling of events
- Daniel: Binding events in the some format, so that they are sent out all together, it could help consumers connect the dots
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, IBM, UTC+1
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
New attendees
-
Action Items
- (Andrea) Create a repo for the visualisation reference architecture and poc
- (Jalander) Share slides at https://github.com/cdevents/presentations
-
How does CDEvents fit with the big platform picture?
- We should add diagrams to document the big picture
-
What about CDEvents and software supply chain
- We have artifact signed event today
- We want to have more, looking to collaborate with OpenSSF
-
<addme>
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, IBM, UTC+1
- Ben Powell, Apple, UTC+5
- Jalander Ramagiri, Ericsson Software Technology, UTC+1
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
Action Items
- (Ben) Meeting with Spinnaker for CDEvents demo
- Ben to create the meeting in the next ~1w
- Invite Spinnaker team as optional
- (Andrea) Create an issue / doc / slack channel to discuss artifact events
- Issue: cdevents/spec#143
- Design doc: https://hackmd.io/AfT-5D3JQZynKk5yDyAWeA?both
- Slack channel: #cdevents-artifacts
- (Ben) Meeting with Spinnaker for CDEvents demo
-
CDEvents Visualization - Reference Architecture
- (Jalander) Share slides at https://github.com/cdevents/presentations
- (Andrea) Create a repo for the visualisation reference architecture and poc
-
Connecting Events
- PR
- (Andrea) How do we handle proposals?
- Switch to hackmd
- Add a proposal folder in the spec repo
- Use a separate repo
- Else?
- (Andrea) Trying to visualise the connecting events proposal in a simple example
Participants:
- Victor Lu
- Ben Powell
- Emil Bäckmark
- Andrea Frittoli
Agenda: Session dedicated at Connecting Events
- PR
- Review of comments on the PR, discussion tracked in comments
- We could use some of the nomenclature from the VSMI reference arch
Participants:
- Name / affiliation / TZ
- Emil Bäckmark, Ericsson, UTC+2
- Fatih Degirmenci, CDF, UTC+2
- Tracy Ragan, DeployHub / Ortelius
- Daniel Han / Bloomberg / NY
- Jalander Ramagiri, Ericsson Software Technology, UTC+1
- Neil McGonigle, Fidelity, UTC+1
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
New attendees
- Carmit from JFrog
-
Action Items
- (Ben) Meeting with Spinnaker for CDEvents demo
- The PR is being reviewed
- Meeting still TBD
- (Ben) Meeting with Spinnaker for CDEvents demo
-
SDK Updates
-
Golang: v0.3.2 patch release
- Fix the CDEvents spec version
- Set CloudEvents Id
-
Java:
- Release v0.1.2 - ready to be done
- Generating the SDK
-
Security Events:
- Ortelius and GUAC talking to develop security use cases / events
-
-
Tools Adoption Updates
- Harbor:
- Proposal: goharbor/community#229
- Implementation: goharbor/harbor#18853
- Demo
- Tekton:
- ArgoCD:
- Spinnaker
- PR being reviewed
- Testkube
- (Andrea) Reach out to Ole for updates
- Harbor:
-
CDF Online meeting
- Testkube team presented, including CDEvents
- Available on youtube playlist https://youtu.be/d2BRv3sY2A8
-
Artifact events
-
Carmit:
- Events produced by an artifact registry
- bundling of artifacts
- promotion of artifacts/bundles
- distribution
- release
- Events produced by an artifact registry
-
Dan:
- Tagging of artifacts as event
-
Carmit:
- Generally events should contain only event data
- More data about the artifact can be pulled via APIs
-
Emil: What is the bundling of events specifically
-
Carmit: a bundle is a group of artifacts (like docker image, helm chart etc), a bundle can inculde up to 1k artifacts
-
(Andrea) Create initial tickets to track the events
- Link issues about events to artifact registries
-
Artifact pull/pushed/deleted but also moved (for artifactory)
-
Artifact scanning events are security type of events and should be produced by the tool the perform the security scan
-
Quota events in Harbor may not be good candidates for CDEvents
-
Archiving may be relevant from an audit trail point of view, less relevant from and SDLC point of view
-
Tags could be used to indicate that an artifact is ready for promotion or deployment
-
Emil: start a document about events from registries
- Capture events for different artifact registry
- Collaborate on the document
- Use this document as input for the specification work
- Create a slack channel for artifact registry specific discussions
-
-
Issue tracking events
- Carmit: it would be interesting to have those associated with artifacts
-
Spec Topics
- Connecting Events
- PR ready for review
- Connecting Events
-
Collaborations
- VSM Interoperability
- New monthly meeting for CDEvents + VSMI collaboration
- Meeting Notes
- Steve introduced the VSMI Topology and Ontology
- CDEvents is part of picture
- CNCF App Delivery TAG
- Looking for contributors to drive/work on a version of podtato-head based on CDEvents
- VSM Interoperability
-
CDEvents visualisation
-
<addme>
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Neil McGonigle, Fidelity Investments, UTC
- Andrea Frittoli, IBM, UTC+1
- Name / affiliation / TZ
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
Action Items
- Ben to arrange a meeting with Spinnaker team for CDEvents demo
-
(Brad) Update on GitHub action for CDEvents
- Mock end point implemented
- Testing different example, getting ready for first version
- To be presented in the next version
-
(Brad) Events for featureas and issues
- CDEvents in scope for features and issues?
- Issues can be associated with incidents as well
- Related to VSM interop
- Related to connecting events discussion
- Source code events could be associated to issues/features delivered in a certain code change
- CDEvents in scope for features and issues?
-
(Andrea) Harbor proposal pull request
- Changes on CDEvents side may be required
- (Emil) We should be consciuous about the use cases associated with events when adding new events
- (Emil) Are events related to CD? We don't have a definition today of what is in scope for CD
- Relevant for triggering a CI/CD workflow
- Relevant for observation of a CI/CD overall workflow
- (Emil) We should invite JFrog to the conversation about relevant events for artifact registries
- (Neil) What kind of events (if any) does artifactory support today?
-
(Andrea) Parent-child pipelines use case cdevents/spec#142
- (Emil) Is this within a pipeline execution or upstream/downstream dependencies?
- (Emil) Example: a test step is replaced with a call to an external test system which may have its own pipeline and events. How do events from the test system refer back to the original pipeline?
-
v0.4 Planning (in progress):
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, IBM, UTC+1
- Ben Powell, Apple, CST
- Jalander Ramagiri, Ericsson Software Technology, UTC+1
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
Action Items (None)
-
CDF TOC:
- Voting for the CDF TOC representatives ongoing
- Please vote if you're eligible!
-
CDF Outreach Committee:
- Proposed project updates:
- CDEvents, a common specification for Continuous Delivery events: it drives interoperability and brings disruption in the CD ecosystem with a growing and active community. Contributors from 20 companies, 142 twitter followers, 85 GitHub stars.
- Releases v0.2, v0.3: test and incident events, initial software supply chain security. Java SDK to Maven.
- Tools: Jenkins, Testkube, Spinnaker (implementing), Tekton (experimental), ArgoCD (RFC), Harbor (RFC). More tools have expressed interest (Shipwright, JX, Tracetest, JReleaser, Flux)
- Collaborations: VSM Interop, CNCF App Delivery TAG, OpenSSF, CDF SIG Interop
- Interested companies: Fidelity (adopter), SAS, Apple, Ericsson, IBM and more
- What’s next: connecting events, visualisation, supply chain security, more tools and adoption
- CDEvents, a common specification for Continuous Delivery events: it drives interoperability and brings disruption in the CD ecosystem with a growing and active community. Contributors from 20 companies, 142 twitter followers, 85 GitHub stars.
- Proposed project updates:
-
Connecting events
- Reminder to review
- https://hackmd.io/-Or6hobHSLWVj4duAWX7nA
- cdevents/spec#104
- cdevents/spec#139 (Very Rough Draft)
- Ben working on client API and storage description
- PR will be available soon-ish
-
Spinnaker
- Ben to arrange a meeting for a demo of the current implementation
-
Fidelity adoption:
- User story
- Starting from the central point: Jenkins
- Looking forward to artifactory plugin
- Challenges:
- Versioning (of Jenkins)
- Implementation of the plugin (Jenkins documentation issue)
- Events are sent to a Kafka queue
- Goals:
- Improve developer experience: automatic audit trail for artifacts, track via commit id
- Visibility towards management of application landscape
- Non-relational DBs are really beneficial
- But they do present challenges with versioning
- Posgres provide a JSON type column
-
CDEvents visualisation
-
Python SDK
- Adopting pydantic in progress
- Release to pypi in progress
- Question: generation of the SDK?
-
v0.4 Planning (in progress):
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Andrea Frittoli, IBM, UTC+1
- Name / affiliation / TZ
Links:
- v0.4 Roadmap
- Planned for 31.08
Agenda:
-
Action Items
- Emil's nomination for TOC
- Nominations close today
-
v0.4 Planning
-
Connecting events
- Reminder to review
- https://hackmd.io/-Or6hobHSLWVj4duAWX7nA
- cdevents/spec#104
- cdevents/spec#139 (Very Rough Draft)
-
Updates
- Harbor draft RFC
- Java SDK: ready for v0.1.2
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Ben powell, Apple, CST
- Fatih Degirmenci, CDF, UTC+2
- Andrea Frittoli, IBM, UTC+1
- Jalander Ramagiri, Ericsson Software Technology, UTC+1
- Daniel Han, Bloomberg, UTC-4
- Andrew Fenner, Ericsson Software Technology, UTC+1
- Adam Kenihan, Ericsson Software Technology, UTC+1
- Name / affiliation / TZ
Links:
- v0.4 Roadmap
- Planned for [TBD]
Agenda:
-
Action Items
-
Welcome Daniel Han!
- Standardization around testing
- Special focus on integration testing
- Interested in contributing back to CDEvents
-
TOC Project representatives
- Process
- 4 seats from 9 projects in TOC
- Nominations
- The nomination period starts on May 22, 2023 and ends on June 5, 2023.
- Emil has volunteered to be nominated from CDEvents. The nomination will be submitted later today.
- Process
-
CDEvents visualization discussion - Adam/Andrew/Jalander from Ericsson Software Technology
- Follow-up: track slide questions on github
- Discuss libraries vs. services in this area
- Share screenshots of demos?
- Issue on visualizing CDEvents: cdevents#25
-
Update on Connecting Events
- https://hackmd.io/-Or6hobHSLWVj4duAWX7nA
- cdevents/spec#104
- cdevents/spec#139 (Very Rough Draft)
- Should be ready in a couple of weeks
- Ben to let the team know when it's ready for review
-
CDEvents usage at Bloomberg - Daniel Han from Bloomberg
-
(Andrea) Signed CDEvents
- We should probably delegate signature to the envelope layer
- That would allow us to sign the entire payload
- Which CE headers would we like to be included in the signature?
- Trying to restart the conversation on CloudEvents side
- It would be really useful to have a security expert involved in the discussion
- Signatures associated to the envelope layer means that they would only be available with certain bindings
- That should be acceptable
- We should probably delegate signature to the envelope layer
-
Updates:
- CDEvents + Argo:
- Project View
- Draft RFC
- Question
- Do we need separate proposal for each Argo project?
- CDEvents + Harbor:
- Discussed in the CNCF Harbor slack channel
- Andrea to start and RFC
- https://github.com/goharbor/community/tree/main/proposals
- CDEvents + other registries
- JFrog, meeting today
- Chainguard, planning POC
- CDEvents + GitHub:
- Brad working on a GitHub App
- SCM events
- Pipeline events (GH Actions)
- Brad working on a GitHub App
- CDEvents + Testkube:
- Implemented in dev
- Release coming soon
- CDEvents + Spinnaker
- PRs ready for review
- Demo available for Spinnaker meetings
- Ben to ping people on Spinnaker side
- Organise a meeting to see the demo with all interested parties
- CDEvents + Argo:
-
CDEvents v0.4 planning
-
Other topics?
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Brad McCoy, Basiq, UTC+10
- Name / affiliation / TZ
Links:
- v0.4 Roadmap
- Planned for [TBD]
Agenda:
-
Updates from last meeting
- Discussed connecting events
- Ben presented a proposal
- Ben to make a PR, discuss internally at Apple and then present to the group
-
Brad created a PRs to update licensing
- cdevents/sdk-go#55
- cdevents/spec#137
- cdevents/sdk-java#52 (issue)
- cdevents/sdk-python#27
- We may want to remind about this in the TOC
-
- Blog post
-
Updates from CDCon
-
CDEvents Summit
-
Events broker
- Challenges with Kafka. It would be great to get a sharable feedback on Kafka experiences
- Should it be part of CDEvents or reference architecture
- FRSCA use an opinionated set of tools, but as an example to represent their reference architecture
-
Platform and CDEvents
- submit CDEvents to the evidence storage and then the platform take over
- Then you can switch between tools (Tekton, Jenkins, etc) as long as they can provide CDEvents JSON to the storage
-
Modeling feature flags
- In the context of OpenFeature, should model feature flags (and perhaps configurations in general) in CDEvents?
- We don’t support those events today, but that’s something we could model more accurately
- Feature flag changes are a runtime event, with no deployment involved
- Is that a deployment too? CDEvents could help make common terminology here
- If we put feature flags data in deployments, a change to feature flags would require a new deployment event. Too much granularity can become difficult to manage
-
How do we get CDEvents in big cloud vendors?
- We should have projects in the CDF adopting CDEvents, explain benefits at TOC
- Users that use CDF tools adopt CDEvents and can explain the benefits
- It becomes easier to talk to commercial CI/CD tools first, and then to cloud providers
- What about CDEvents for GitHub actions?
- We’re building an adapter, but really we should have CDEvents natively eventually
-
Cloud is not the only place where we deliver software, creating momentum there would help too
-
Hosting CDEvents presentations for the benefits of other projects
-
- It would be nice to have an open source framework (react?) to visualise events
- Visualisation can be good do demonstrate the value of CDEvents
- Similar project in the JS space
- UI would be really a cherry on the cake on top of standardisation, it can add great value
-
Benefit from artifactory and other registries if they had a plugin that generates CDEvents automatically
-
End users can help by talking to vendors about features they’d like to see in products
-
-
Michael Crenshaw reached out about implementing CDEvents in Argo CD
- GitOps, update from registry use case
- Also generating events
- Michael to start the process on Argo side
-
-
Argo
- image updater https://argocd-image-updater.readthedocs.io/en/stable/
- Now part of ArgoCD
- Argo integration interesting for Ericsson
- Argo integration interesting for RedHat
- image updater https://argocd-image-updater.readthedocs.io/en/stable/
-
CDEvents in the OSS keynote, thank you Tracy!
-
Include updated architecture picture in docs
- It would be good to show what kind of events are used where
- Links to examples
-
Configuration changes
- Not part of the CDEvents scope today
- Good match for VSMI scope
-
GitHub adapter
- Brad to start this week
- Adam is also working on similar adapter for Gitlab
- SCM, Pipeline and Testing event can all be in scope, so we could provide visualizatio of GitHub and GitLab pre-merge pipelines
- With GitLab we used to talk to Kevin
- Interoperability stories
- Switch betweeb GitLab and GitHub, combined with other tools (e.g. Tekton and Testkube)
- Send test events from Tekton first, then adopt Testkube - similar CDEvents are sent and consumers are not affected
- Brad to create issues to track this
-
SDK updates
- Golang v0.3
- Java updated to v0.1.2
- Working on a release for v0.1.2
- Working on integrating JReleaser too
- Next: automation for the Java SDK
-
Implementation updates
- testkube initial implementation done
- Spinnaker PR created and under reviews
-
Consume CDEvents - Using Automated Trigger spinnaker/deck#9977 spinnaker/echo#1290 spinnaker/gate#1651
-
Produce CDEvents - using Notification spinnaker/echo#1295 spinnaker/deck#9997
-
-
V0.4 planning
-
Other topics?
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Ben Powell, Apple
- Tracy Ragan
- Name / affiliation / TZ
Links:
- v0.3 Roadmap
- Planned for [Apr 20th]
- v0.4 Roadmap
- No due date yet
Agenda:
-
Action Items
-
TOC Project representatives
- cdfoundation/toc#202
- 4 seats from 9 projects in TOC
- The nomination period starts on May 22, 2023 and ends on June 5, 2023.
- Eligible Voters
- Are you on the voters list? If not, and if you consider yourself a contributor to CDF or any of its projects, you could sign up on this form.
-
v0.3 release
- Tracking issue: cdevents#24
- Release done, announcements missing
-
v0.4 release
- Focus: Connecting events
-
Connecting Events
- https://hackmd.io/-Or6hobHSLWVj4duAWX7nA
- A lot of discussion around the links model, clearing out some misconceptions about Eiffel and nailing down some scenarios and use cases for the links/parents
- To find other events than the parents there is a need for a "links service", i.e. a database of previously sent events (often called Event Repository in Eiffel)
- Ben will provide a draft PR hopefully later this week
-
<addme>
Participants:
- Emil Bäckmark, Ericsson, UTC+2
- Andrea Frittoli, IBM, UTC+1
- Name / affiliation / TZ
Links:
- v0.3 Roadmap
- Planned for [Apr 20th]
Agenda:
-
Action Items
-
v0.3 release
- Test events merged
- Artifact signed event merged
- Prepare v0.3 PR
- Planning to release tomorrow 03.05.2023
- CDEvents website update due after release on spec repo
- Blog post for v0.2 + v0.3 after announcement
- Tracking issue: cdevents#24
-
Java SDK updates
- Release process in place, draft release on maven central
- All v1 events included, but format still v0.1-draft
- SDK alignment to v0.1.x in progress
- Moving away from reload4j
-
Golang SDK updates
- Support for more complex subjects merged
- Session with TestKube this week to demonstrate the process of updating the SDK. After that v0.3.0 to be relesed
-
Python SDK updates
- Update pydantic in progress (improved JSON parser)
- Evan working on automated releases and publishing to PyPi
-
Jenkins Plugin update
- GitHub repo: https://github.com/jenkinsci/cdevents-plugin
- Plugin site: https://plugins.jenkins.io/cdevents/
- Still not fully integrated in the Jenkins release management
- Jenkins to Jenkins communication enabled by the plugin
- It would be great to have a demo in a SIG-events meeting
-
Connecting Events
Meeting canceled due to too few participants
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, IBM, UTC+1
- Emil Bäckmark, Ericsson, UTC+2
Links:
- v0.3 Roadmap
- Planned for [Apr 30th]
Agenda:
-
Test Events
- cdevents/spec#105
- Comments made in the PR
-
Connecting Events
- https://hackmd.io/-Or6hobHSLWVj4duAWX7nA
- No updates yet
-
Artifact signed event
-
Release v0.3 status
-
Java SDK status
- Work in progress to fix issues and align to v0.1
- Proposal do adopt JReleases
-
Python SDK status
- Evan working on publishing to pypi
- cdevents/sdk-python#22
Participants:
- Emil Bäckmark, Ericsson, UTC+1
- Tracy Ragan, DeployHub, CDF TOC, UTC-7
- Evan Elms
- Name / affiliation / TZ
Links:
- v0.3 Roadmap
- Planned for Apr 20th
Agenda:
-
Action Items
-
Release v0.2 status
- Remaining actions:
- Andrea to finish the announcements
- Remaining actions:
-
Release v0.3 status
-
SDK updates
- Golang
- v0.2 released
- SDK is now generated from schemas hosted in the spec repo
- SDK generator
- Can be used for other languages as well, with dedicated template files
- SDK now runs tests against the examples defined in the spec repo
- Python
- Working on GitHub Actions to automate stuff
- Java
- Golang
-
- Spinnaker
- Jenkins
- Progressing well
- Hopefully be contributed to open source by May
- TestKube
-
Connecting Events
-
Upcoming meetings
- Monday April 10th.
- Bank Holiday in Sweden, but not everywhere else so the meeting is kept.
- Tuesday April 18th.
- Canceled due to KubeCon Europe? To be discussed on Slack
- Monday April 10th.
Participants:
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Name / affiliation / TZ
Links:
- v0.2 Roadmap
- Planned for Mar 20th
- v0.3 Roadmap
- Planned for Apr 20th
Agenda:
-
Action Items
-
Release v0.2 status
-
Golang SDK
- Added support for multiple versions
- Always produce latest version
- Parse any compatible future version (minor/patch)
- Parse any compatible old version (minor/patch)
- Unknown data in future versions is ignored for now
- V0.2 updates WIP
- 80% implemented generating the SDK
- Added support for multiple versions
-
Next steps:
- Release golang SDK
- Move to v0.3-draft on main
- Andrea to finish the announcements
-
Python SDK
- New contributor from Fidelity to work on pydantic issue
- Evan continued working on release automation for Python and Java
-
- The existing PR will need to be updated based on v0.2
-
- Spinnaker
- RFC merged!
- It should be ok to start the implementation
- Jenkins
- Framework up, pipelinerun events
- Work happening internally at Fidelity for now
- Spinnaker
-
Connecting Events
Participants:
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Ben Powell, Apple, UTC-6
- Jalander Ramagiri, Ericsson Software Technology, UTC
- Name / affiliation / TZ
Links:
- v0.2 Roadmap
- Planned for Mar 20th
Agenda:
-
Action Items
- n/a
-
Release v0.2 status
- All spec PRs merged
- Nice to have: cdevents/spec#121
- Website update ready
- Golang SDK
- Added support for multiple versions
- Always produce latest version
- Parse any compatible future version (minor/patch)
- Parse any compatible old version (minor/patch)
- Unknown data in future versions is ignored for now
- Release 0.1.1 and 0.1.2
- Main branch updated to 0.1.2
- V0.2 updates WIP (incident events)
- Added support for multiple versions
- Next steps:
- Merge spec PR cdevents/spec#121
- Tag spec and do release notes
- Merge website PR cdevents/cdevents.dev#34
- Update spec in go SDK to v0.2
- Implement v0.2 changes
- Release golang SDK
- Move to v0.3-draft on main
- All spec PRs merged
-
Python SDK
- CI linting using flake8 working locally (ready to go)
- Release to pypi
- Vanilla framework is already there
- TOML file with metadata required
- Next step: v0.1 release
-
- The existing PR will need to be updated based on v0.2
-
- Spinnaker
- RFC is getting close to merge
- It should be ok to start the implementation
- Jenkins
- Framework up, pipelinerun events
- Work happening internally at Fidelity for now
- Spinnaker
-
Connecting Events
- https://hackmd.io/-Or6hobHSLWVj4duAWX7nA
- Make a PR with hybrid approach so we can have hands on experience
- Continue working on the DORA metrics POC and try to apply different way of connecting events
Participants:
- Emil Bäckmark, Ericsson, UTC+1
- Andrea Frittoli, IBM, UTC
- Name / affiliation / TZ
Links:
- v0.2 Roadmap
- Planned for TBD
Agenda:
-
Action Items
-
Incident Events
- PR Merged
- Next steps
- Include in SDKs
- Andrea Create and issue for each SDK
- Cut a release
- Update the website with the new event group
- Emil will create an issue for this - CDEvents.dev #31
- Include in SDKs
-
- Open PRs
- Open Issues
- Review content
- Plan date
- Next steps
-
SDKs
- Python SDK
- We will need pypi publishing
- Java SDK
- For v0.2 (or v0.3) for Maven central repository
- Naming: defined in the pom files dev.cdevents/java-sdk
- Go SDK
- Managed by the tooling directly
- Investigate external tool for secrets for release mgmt
- 1password
- Discorability of SDKs important for integrations
- Licensing
- Apache 2.0 license should be in all SDK repos
- Python SDK
-
- Spinnaker RFC
- Jenkins
- Fidelity plans to contribute a CDEvents plugin
-
<addme>
Participants:
- Emil Bäckmark, Ericsson, UTC+1
- Andrea Frittoli, IBM, UTC
- Robert Reeves, Liquibase, UTC-6
- Name / affiliation / TZ
Links:
- v0.2 Roadmap
- Planned for March 13th
Agenda:
-
Action Items
-
Spinnaker integration:
- Robert's proposed plan is:
- Spinnaker to support CDEvents - RFC
- Ben talking about Spinnaker + CDEvents on behalf of Apple
- Robert's proposed plan is:
-
- "Continuous Operations" or "Continuous Operation"?
- No reference in the json schema
- let's keep the plural version for now
- we can discuss with SIG interop about naming
- "Continuous Operations" or "Continuous Operation"?
-
URI vs. URI-reference
- Proposal: keep URI-reference as enforcement, propose URI as best practice in the spec
- Extend cdevents/spec#116 to include best practices
-
- What would it take to have more options optional?
- What it would look like from syntax POV
-
- Spinnaker RFC
- Jenkins
- Fidelity plans to contribute a CDEvents plugin
-
SDK Updates
- Python SDK
- Erik in between jobs
- No may not expect updates until May/June
- Java SDK
- Should be ready for v0.1
- Python SDK
-
<addme>
Participants:
- Emil Bäckmark, Ericsson, UTC+1
- Andrea Frittoli, IBM, UTC
Links:
- v0.2 Roadmap
- Planned for Feb 28th
- Need to reschedule - take cdCon into account
Agenda:
-
Action Items
- (Andrea) Create an issue about defining the process for formal releases cdevents#23
- (Andrea) Add details about tracing contexts in Connecting events
- Still pending
- Connected events
- Flesh out Hybrid approach section (Ben)
- Ask AI/ML what links proposal works best (Ben/Emil)
- Spinnaker RFC
- Review new commits on RFC (Ben)
-
- Comments to be answered
-
- Need to clarify the difference between various IDs (trace, context, global)
- For hybrid approach, how does it work from a consumer POV if either or both links and global ID can be provided? Needs to be clarified
-
- Comments to be answered
-
- Review new commits on RFC (Ben)
-
SDK Updates
- Python SDK
- Erik in between jobs
- No may not expect updates until May/June
- Java SDK
- Should be ready for v0.1
- Python SDK
-
Events for Supply Chain
- To be discussed at SIG Events this afternoon
- Signatures, SBOM, etc
-
<add me>
Participants:
- Emil Bäckmark, Ericsson, UTC+1
- Ben Powell, Apple, CST
- Robert Reeves, Liquibase, CST
- Fatih Degirmenci, CDF, UTC+1
Links:
- v0.2 Roadmap
- Planned for Feb 28th
Agenda:
-
Action Items
- (Andrea) Create an issue about defining the process for formal releases
(Ben) Add use cases about Global ID in Connecting events- (Andrea) Add details about tracing contexts in Connecting events
-
- Flesh out Hybrid approach section (Ben)
- Expand on how to relate test artifact events to eachother, which can be done by relying on Eiffel instead of the global ID.
- Ask AI/ML what links proposal works best (Ben/Emil)
- Flesh out Hybrid approach section (Ben)
-
- Review new commits on RFC (Ben)
-
SDK Updates
- Can we generate SDKs from our schemas?
- Similar generations has been done at Liquibase (Robert)
- OpenAPI/Swagger
- Used everywhere
- JSON/Yaml
- Smithy
- Heavily used in AWS
- Can we generate SDKs from our schemas?
-
<add me>
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, IBM, GMT
- Emil Bäckmark, Ericsson, CET
- Ben Powell, Apple, CST
- Brad McCoy, Basiq, AEST
Links:
- v0.2 Roadmap
- Planned for Feb 16th
- (Andrea) Should we reschedule?
- We could release even if we have incident events alone
- Planned for Feb 16th
Agenda:
-
Action Items
- We can document in the primer that if there is risk of confusion between an object and its execution we should append
Run
to the subject- Emil wrote an issue: cdevents/spec#109
- We can document in the primer that if there is risk of confusion between an object and its execution we should append
-
- Ole cannot join today
- Ole to review latest comments on PR
- Emil would like to review
-
Release process - how long changes can be merged before a release
- Relatively informal process for now
- Favouring speed for now, initial 0.x release
- More formal process required in future
- (Andrea) Create an issue about defining the process
-
- Review remaining comments
- Subject Type
- Type is optional
- We should link standard fields in table to the core
- Goal should be to make things as easy as possible
- Separate PR to document subject type is a more clear way in scope for 0.2
- Andrea to check the go SDK - if it's required
- We should document that it's the same as what's in the event type
-
- (A) Ben to add use cases about Global ID
- (A) Andrea to add details about tracing contexts
-
SDK updates
- Java
- Golang
- Python
-
Tool integration updates
- Spinnaker
- Jenkins
- Jenkins-X
- Tekton
- Kubetest
-
v0.2 Roadmap Review
Participants:
- Name / affiliation / TZ
- Andrea Frittoli, IBM, GMT
- Ben Powell, Apple
- Emil Bäckmark, Ericsson, GMT+1
- Robert Reeves, Liquibase / CDF TOC, CST (GMT-6)
Links:
- v0.2 Roadmap
- Planned for Feb 16th
- Should we use the GitHub roadmap view? https://github.blog/changelog/2023-01-31-roadmap-in-projects-public-beta/
- Emil to try the roadmap functionality
Agenda:
-
Action Items
- We can document in the primer that if there is risk of confusion between an object and its execution we should append
Run
to the subject- Emil wrote an issue: cdevents/spec#109
- We can document in the primer that if there is risk of confusion between an object and its execution we should append
-
Spinnaker RFC for CDEvents
- Lessen scope of RFC and then iterate
- RFC originally wanted to rework Spinnaker's architecture, which is very difficult, so instead we lessened the scope to just have Spinnaker first injest CDEvents
- If this goes well, we can look to re-architecting Spinnaker to utilize more of CDEvents
- RFC originally wanted to rework Spinnaker's architecture, which is very difficult, so instead we lessened the scope to just have Spinnaker first injest CDEvents
- Integrating CDEvents with Spinnaker
- Jalander created the RFC: spinnaker/governance#299
- From the meeting:
- Limited to a new event type in Spinnaker
- The CDEvents event type in Spinnaker will be able to inject any CDEvent and define reactions to it
- RFC limited for now to receiving events (to reduce scope)
- Next RFC for sending events
- Robert: what does CDEvents give Spinnaker Users?
- Ben:
- End users: plugin any system that uses CDEvents to trigger Spinnaker
- Spinnaker maintainers: no need to maintain /add ad-hoc integration
- Lessen scope of RFC and then iterate
-
Jenkins and CDEvents
- Fidelity interested in it
- A CloudEvents plugin for Jenkins exists today
- Project (GSoC?): create a CDEvents pluing
- Mentor required
-
Tekton and CDEvents
-
Jenkins X and CDEvents
- Dependency on Tekton?
- There was interest from the project
- GSoC idea by Brad https://jenkins-x.io/blog/2023/02/06/gsoc2023-ideas/
-
- Ben: abort -> cancel (consistency)
-
- Andrea to update the PR
- Next step after merge golang SDK
-
- Proposed plan:
- next meeting (SIG meeting) for further notes from all parties
- decision in two meetings (two weeks from now)
- we can use customData to begin with to carry the information
- Proposed plan:
-
SDK updates
- Java
- Golang
- Plan to update once test/incident events are in
- Python
-
<addme>
Participants:
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Ole Lensmar, Kubeshop, UTC+1
Links:
- v0.2 Roadmap
- Planned for Feb 16th
Agenda:
-
Action Items
- Action Andrea: archive SIG Events notes too
- https://github.com/cdfoundation/sig-events/blob/main/docs/SIG%20Meeting%20Notes%202022.md
- Any meeting in December? Andrea to check
- https://github.com/cdfoundation/sig-events/blob/main/docs/SIG%20Meeting%20Notes%202022.md
- Andrea to create an issue / PR about reason for current version structure
- Issue: cdevents/cdevents.dev#30
- Action Andrea: archive SIG Events notes too
-
Test events
- PR proposed by Ole (thank you!)
- TestCase / TestSuite: should we rename to TestCaseRun / TestSuiteRun
- Consistent with TaskRun / PipelineRun
- Emil: PipelineRun / TaskRun is tekton specific
- Execution could be an alternative, but it's very long
- Json schema editing is error prone
- It would be good to have automation for boiler plate schema parts
- Agreed that we will use
*Run
events - We can document in the primer that if there is risk of confusion between an object and its execution we should append
Run
to the subject- Emil to create an issue
- We probably don't need to add "Run" to the "build" events, since Build is a verb already
- TestCase / TestSuite: should we rename to TestCaseRun / TestSuiteRun
- PR proposed by Ole (thank you!)
-
Incident events
- Draft PR
- Design in hackmd
- Incident reported
- Ticket reference should be an URI
- URI Optional or Mandatory
- URI vs. details protect potential sensitive data in the Ticket
- Do we need alerts?
- Eiffel has a proposed extension about alerts
- In eiffel an alert should be sent when there is an incident
- Alerts are not necessarly associated to a "negative" occurrence
- Alert events might be considered later, but not as part of the incident events PR
- Andrea to update the PR
-
Environment uses URL (as field name) instead of URI
- The type is URI
- Create an issue to update events to consistent naming with URI
- Enforce the URI type directly in the JSON schema
- JSON format uri: https://json-schema.org/understanding-json-schema/reference/string.html#resource-identifiers
-
Connecting events
- Design doc
- No progress since last discussed
- Comments welcome
-
Roadmap Review
Participants:
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Ben Powell, Apple
Links:
- v0.2 Roadmap
- Planned for Feb 16th
Agenda:
-
Action Items
- Java SDK migration: (Adam) Working on a single PR
- Spinnaker RFC: meeting setup for Jan 31st (thanks Ben)
- Notes for 2022 archived (notes moved to CDEvents community repo)
- Action Andrea: archive SIG Events notes too
-
Test events
- PR proposed by Ole (thank you!)
- Review cycle ongoing
- More feedback welcome
-
Incident events
- Draft PR
- Design in hackmd
- Reviews welcome
- Incident will require triaging / ticketing
- Incident
- Detected
- Reported -> Include a references to a ticket
- Resolved
- We don't want to replicate the entire lifecycle of tickets
- Severity could be on the incident
- Keep in custom data for now to keep things simple
- Priority on the ticket
- Track decision reasoning, not in the spec directly but supporting document (tbd)
-
Connecting events
- Design doc
- No progress since last discussed
- Comments welcome
-
Event versions
- Ben - The current approach with versions requires string splitting
- For the SDK it makes (de-)serilization more complex
- Action:
- Document the reason for the current version structure
- Andrea to create an issue / PR
- Ben - The current approach with versions requires string splitting
Participants:
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Brad McCoy, Basiq, UTC+10
- Ole Lensmar, Kubeshop, UTC+1
- Bruno Lopes, Kubeshop, UTC+1
Links:
- v0.2 Roadmap
- Planned for Feb 16th
Agenda:
-
Action items from last week
- Needs review cdevents/sdk-java#12
- Review comments need to be addressed
- (Andrea) How are we planning the migration?
- Spinnaker RFC ad-hoc meeting
- Left a comment on spinnaker/governance#299
- Any more updates?
- Needs review cdevents/sdk-java#12
-
Shall we archive meeting notes from 2022?
- (Andrea) Create an archive file for CDEvents and SIG
- (Andrea) Sync to GitHub, add link to past ones
-
Test events
- Proposal by Ole (TestKube) https://github.com/kubeshop/cdevents-spec/blob/main/testing-events.md
- Moving events to a dedicated bucket
- Tests can be executed outside of CI
- Are CDEvents only for automated scenarios?
- Not necessarily!
- Agreed: Move test events to a new bucket
- Update schema
- Test types
- Could be an enum
- We could start with plain string
- Work in the interop WG about standard naming
- Proposal by Ole (TestKube) https://github.com/kubeshop/cdevents-spec/blob/main/testing-events.md
-
Incident events
- cdevents/spec#59
- (@menehune23) proposed to start with a minimalist model
- (Emil) We need a formal definition of incidents
- Minimal data model (starting point)
- Subject: Incident
- Attributes:
- ID, Source (mandatory in all subjects)
- Environment (reference, mandatory)
- Service or Artifact (reference, optional)
- Predicates:
- reported
- resolved
-
Conferences
- cdCon CFP open, early bird ends Jan 17th
- Feb 10th CFP deadline
- https://cd.foundation/blog/2023/01/11/cdcon-2023-call-for-papers-now-open/
- cdCon CFP open, early bird ends Jan 17th
-
Other updates?
- Jenkins X
- Starting back after holidays, next week meeting
- Python SDK
- Jenkins X
Participants:
- Andrea Frittoli, IBM, UTC
- Emil Bäckmark, Ericsson, UTC+1
- Ben Powell, Apple
- Jalander Ramagiri, Ericsson Software Technology, UTC
Links:
- v0.2 Roadmap
- Planned for Feb 16th
Agenda:
-
Spec Updates
- Connecting events, design WIP
-
SDK Updates
- Golang
- No updates
- Java
- Adam is working on it
- Update to the continuous deployment events
- Needs review: cdevents/sdk-java#12
- Python
- Golang
-
Tool Updates
- Spinnaker
- RFC
- Proposal: setup an ad-hoc meeting to discuss and progress on the RFC