Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

new(kernel_crawler): rename distro keys to match os-release names. #185

Closed
wants to merge 271 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
271 commits
Select commit Hold shift + click to select a range
a66abc8
Automatically build eBPF probes on newer distributions
gnosek Sep 14, 2021
c7c65f7
Fix formatting
gnosek Sep 14, 2021
0f43911
Separate kmod from ebpf builds at the build-probe-binaries level
gnosek Sep 14, 2021
fc9b1e4
List eBPF probes as well in the directory listing
gnosek Sep 24, 2021
663a9ac
Use repository metadata to find kernel packages
gnosek Sep 21, 2021
4afcb52
Add empty CoreOS/Fedora-Atomic mirrors, for compatibility
gnosek Sep 21, 2021
ba97c09
Disable IPv6
gnosek Sep 21, 2021
1459fb5
Consider linux-image-*-unsigned packages
gnosek Sep 21, 2021
1cfe208
Drop some kernels explicitly
gnosek Sep 24, 2021
78f4ec9
Keep Debian-like package lists per distro
gnosek Sep 21, 2021
f1bb0e4
Allow filtering by kernel versions in the new kernel crawler
gnosek Sep 24, 2021
ca188ec
Revert SSPROD-8709
gnosek Oct 8, 2021
33455a9
Clean the eBPF probe directory before we build the probe
gnosek Oct 13, 2021
64b0a4f
Don't build eBPF probes for kernels < 4.14
gnosek Oct 14, 2021
88730f4
[SSPROD-8709] Also consider linux-modules-* as a build trigger
gnosek Oct 14, 2021
625b4d0
[SSPROD-9627] Enhance build-probe-binaries Debian logic to handle new…
jcpittman144 Oct 20, 2021
11df835
[SSPROD-9627] Fixes to build-probe-binaries and Debian Dockerfiles to…
jcpittman144 Oct 21, 2021
2bf2fb6
Merge pull request #21 from draios/SSPROD-9627
jcpittman144 Oct 21, 2021
88f1c57
[SSPROD-9627] Fix README.md to document use of CustomDebian for Debia…
jcpittman144 Oct 25, 2021
51a37a0
Merge pull request #22 from draios/SSPROD-9627-readme
jcpittman144 Oct 25, 2021
15c9e34
[SSPROD-9709] Add SYSDIG_PROBE_OVERRIDE_FULL_URL environment variable…
jcpittman144 Oct 29, 2021
4480b34
Add a Fedora 35 builder (#24)
gnosek Nov 2, 2021
906247d
Merge pull request #23 from draios/SSPROD-9709
jcpittman144 Nov 3, 2021
ca311d1
Install python3 in the builder container
gnosek Oct 8, 2021
66724e2
[SMAGENT-3278] Don't install clang in Fedora 35 container
gnosek Dec 3, 2021
600673f
[SMAGENT-3278] Use specific builder for Fedora 34
gnosek Dec 3, 2021
b1bc424
Dockerfile: fix building of debian probes (#27)
iurly Jan 17, 2022
5a5cbed
refactor: add helper functions to reduce indentation level
francesco-racciatti Feb 2, 2022
2c86381
feat: add option to enforce probe downloading
francesco-racciatti Feb 2, 2022
a340f44
Merge pull request #29 from draios/option-to-enforce-probe-download
francesco-racciatti Feb 2, 2022
4cf604f
feat: add option to enforce probe building
francesco-racciatti Feb 2, 2022
c665cc9
feat: prevent installing leftover probe when using force options
francesco-racciatti Feb 2, 2022
52eefcb
Merge pull request #30 from draios/option-to-enforce-probe-build
francesco-racciatti Feb 8, 2022
8e8fe53
Remove Fedora Atomic support
gnosek Oct 18, 2021
08f2038
Remove CoreOS support
gnosek Oct 18, 2021
6001aaf
Rewrite the probe builder in Python
gnosek Oct 18, 2021
ffbc531
Add Flatcar Linux support
gnosek Jan 3, 2022
33f7351
Add Oracle Linux support
gnosek Jan 4, 2022
f127806
Add some notes about the implementation
gnosek Jan 20, 2022
5294d89
Fix AmazonLinux builder py3 compatibility
gnosek Feb 11, 2022
b2fc438
Fix deb crawler py3 compatibility
gnosek Feb 14, 2022
71a82a3
fix centos vault error handling
iurly Feb 21, 2022
f9b9259
rpm crawler: filter out non-existing distributions
iurly Feb 22, 2022
79ce976
fix centos 8 handling
iurly Feb 22, 2022
06ca530
fix handling of missing kernel packages
iurly Feb 21, 2022
ed4839b
tolerate broken debian packages
iurly Feb 21, 2022
3c89fc3
batch crawled packages as if it were local
iurly Feb 22, 2022
f218cbd
debian: fix parsing of kernel package version
iurly Feb 23, 2022
16b4d90
ubuntu: handle release_ids containing dashes
iurly Feb 23, 2022
80da8c4
crawler: fedora: add fedora updates
iurly Feb 10, 2022
01d5569
probe-builder: fix typo in comment
iurly Feb 28, 2022
813569d
Merge pull request #34 from draios/python-builder-road-test
iurly Feb 28, 2022
8cdb98a
crawler: ubuntu: no longer treat it as a debian-like mirror
iurly Mar 2, 2022
a4c6cca
crawler: debian: drop DebianLikeMirror
iurly Mar 2, 2022
18a8418
builder: allow multiple target directories for the same release
iurly Mar 3, 2022
7cf8cce
ubuntu: treat each package version as a separate release
iurly Mar 3, 2022
7d349c4
builder: do not try to build probes that should be skipped
iurly Mar 7, 2022
bc47c34
builder: log errors if the probe file does not get built
iurly Mar 7, 2022
cc6b4c7
fix eBPF build for Fedora 35 (#37)
iurly Mar 7, 2022
58c648b
Merge pull request #38 from draios/improve-logging
iurly Mar 7, 2022
7c3d1a9
refine kernel version filtering (#41)
iurly Mar 17, 2022
c875f4a
add -d option to the entry point to pass --debug to the probe builder…
iurly Mar 17, 2022
c8ca918
add comments and debug messages for deb-based repositories
iurly Mar 17, 2022
8a3ea29
builder: only batch packages for debian and ubuntu
iurly Mar 17, 2022
d7bbd4c
fix building of ubuntu's dishomogenous versions
iurly Mar 17, 2022
a9d8cbb
Merge pull request #42 from draios/fix-ubuntu-take-2
iurly Mar 17, 2022
9ba4422
fix debian builder (missing pprint package) (#43)
iurly Mar 18, 2022
5e448ef
optimize download (#45)
iurly Mar 22, 2022
3d64151
new(kernel_crawler): implemented multiarch support.
FedeDP Mar 1, 2022
7d22cb8
update(kernel_crawler): allow to list all kernels from all supported …
FedeDP Mar 3, 2022
333271d
new: support json encoding for kernel_crawler.
FedeDP Mar 4, 2022
733e6c2
new: added a cron based github action to automatically push new list …
FedeDP Apr 4, 2022
6344557
chore(kernel_crawler): dropped unused files.
FedeDP Apr 5, 2022
adace40
Merge pull request #1 from FedeDP/multiarch_support
FedeDP Apr 5, 2022
dc767b1
docs(README): updated readme with gh action badge.
FedeDP Apr 5, 2022
137d460
[CI] updated kernel json lists.
invalid-email-address Apr 10, 2022
842e705
new: added driverkit config json output.
FedeDP Apr 13, 2022
693adba
chore: removed useless pycache folders.
FedeDP Apr 13, 2022
364867d
update: improved click interface for crawl program.
FedeDP Apr 13, 2022
bd62a33
chore: use 'x86_64' and 'aarch64' naming by default.
FedeDP Apr 13, 2022
db32110
Merge pull request #2 from FedeDP/driverkit_config_out
FedeDP Apr 13, 2022
7d9d3eb
fix: driverkit config for debian requires "-$arch" for kernelrelease.
FedeDP Apr 13, 2022
ad0ffdc
update: checkout before installing deps to avoid failing CI.
FedeDP Apr 17, 2022
68f8ec0
update: updated github workflow to fix CI.
FedeDP Apr 19, 2022
bfbb7dd
update: merged back some amazonlinux improvements from origin.
FedeDP Apr 19, 2022
b5039de
[CI] updated kernel json lists.
invalid-email-address Apr 19, 2022
f6dbbc9
[CI] updated kernel json lists.
invalid-email-address Apr 24, 2022
1394b79
docs: added owners file
FedeDP Apr 26, 2022
46a35ec
update: fixed ubuntu flavours recognition.
FedeDP Apr 27, 2022
0630fdf
doc: added license file.
FedeDP Apr 28, 2022
ee3c565
chore: renamed COPYING to LICENSE.
FedeDP Apr 28, 2022
65791b4
docs: added a pull request template.
FedeDP Apr 28, 2022
c36cf61
update(README): updated badge link.
FedeDP May 2, 2022
bdfe912
fix(CI): proper permissions on github action token.
FedeDP May 2, 2022
3323afc
update(ci): use create pr action.
FedeDP May 2, 2022
545109c
chore(ci): switched on push for testing purposes.
FedeDP May 2, 2022
47549c8
fix(CI): update permissions on github action.
FedeDP May 3, 2022
ac66ac5
fix(CI): update permissions with contents write too.
FedeDP May 3, 2022
04eb31e
update(ci): revert on push.
FedeDP May 3, 2022
5a3df6f
update(crawler): properly use amazonlinux2022 target for Al2022 drive…
FedeDP May 4, 2022
bc7cf80
update(kernels): updated kernel json lists.
poiana May 8, 2022
d219d5d
chore(CI): updated workflow file.
FedeDP May 9, 2022
a6c62f9
update(kernels): updated kernel json lists.
poiana May 22, 2022
2d8bb6b
Changing to find_packages in setup
abroglesc May 25, 2022
199d6d6
update(kernels): updated kernel json lists.
poiana May 29, 2022
596fa4c
update(kernels): updated kernel json lists.
poiana Jun 5, 2022
5df962e
update(kernels): updated kernel json lists.
poiana Jun 12, 2022
9e0b97c
update(kernels): update kernel json lists.
poiana Jun 15, 2022
9c419c5
chore(ci): dropped github action because we will now use a prow job.
FedeDP Jun 8, 2022
a566283
update(kernels): update kernel json lists.
poiana Jun 19, 2022
a0dfe6b
fix(crawler): debian needs kbuild too in its headers output.
FedeDP Jun 16, 2022
3be970c
update(kernels): update kernel json lists.
poiana Jun 26, 2022
57f0a31
update(kernels): update kernel json lists.
poiana Jul 4, 2022
0317194
switching to vault.centos.org and adding archive.kernel.org
EXONER4TED Jul 18, 2022
dab4231
fix(crawler): skip photonOS linux-PAM-devel packages.
FedeDP Jul 21, 2022
56b8311
Basic crawl of kernels as taken from container image
johnbrydon Jun 30, 2022
c9d8419
Fix plain/json output
johnbrydon Jun 30, 2022
3452fcf
Fix driverkit output
johnbrydon Jun 30, 2022
0ea2bed
Add progress bar that shows output of command
johnbrydon Jun 30, 2022
0cfac7d
Allow multiple images at one time
johnbrydon Jul 1, 2022
0d29a3c
Remove unused container list
johnbrydon Jul 1, 2022
0f624af
replace 'container' with 'image' in readme
johnbrydon Jul 4, 2022
b966847
moved image loop to 'crawl_kernels'
johnbrydon Jul 25, 2022
98a27d9
fixed output of container command when buffered
johnbrydon Jul 25, 2022
2bdcbe3
update(crawler): add 'kernelconfigdata' attribute to 'DriverKitConfig…
alacuku Jul 24, 2022
03b05fe
new(crawler): add support for minikube distro
alacuku Jul 24, 2022
cb7d352
update(crawler): add required packages for minikube distro
alacuku Jul 24, 2022
1c6bcae
update(docs): add minikube to the list of supported distros
alacuku Jul 26, 2022
a1fa909
initial changes to simplify target to ubuntu
EXONER4TED Jul 20, 2022
6ebd85c
adjusted the regex logic, set a default flavor to generic, and build …
EXONER4TED Jul 20, 2022
421438e
fixing python3 support
EXONER4TED Jul 26, 2022
bb9fcb2
new(kernel_crawler): added centos9 stream support.
FedeDP Jul 29, 2022
7a7a401
chore(docs): updated kernels/README.
FedeDP Jul 29, 2022
934d5e2
fix(crawler): made click.Choice options actually case sensitive.
FedeDP Aug 1, 2022
31a9eb3
fix(kernel_crawler): fixed ubuntu targets: actually use real ubuntu f…
FedeDP Aug 26, 2022
2794967
update(kernels): update kernel json lists.
poiana Aug 29, 2022
e7a6d7b
test: add whitespace to readme.
FedeDP Aug 31, 2022
a9bf5b4
chore(kernels, readme): updated readme and dropped kernels lists that…
FedeDP Aug 31, 2022
b8c6c59
fix(kernel_crawler): fixed photonOS driverkit output ID.
FedeDP Sep 21, 2022
0694a7c
new: added support for a docker image that will also be auto-update o…
FedeDP Sep 21, 2022
9b89230
chore: properly install an entrypoint script for the kernel_crawler.c…
FedeDP Sep 21, 2022
4fbe722
chore: multi arch image builds, plus using releases.
FedeDP Sep 21, 2022
fccaafa
chore: fix install deps step.
FedeDP Sep 21, 2022
58f07dc
fix(kernel_crawler): import repo.
FedeDP Sep 22, 2022
12782e3
update(readme): updated readme docker info + added a couple of badges.
FedeDP Sep 22, 2022
3b8e5a8
fix(kernel_crawler): make flatcar distro support similar to minikube.
FedeDP Sep 23, 2022
19d44ce
adding 5.15 to AmazonLinux2 kernel urls
EXONER4TED Oct 12, 2022
862ee75
fix whitespace
EXONER4TED Oct 12, 2022
e2bbe64
fix whitespace
EXONER4TED Oct 12, 2022
3ae4f37
Introduce support to AlmaLinux and RockyLinux
dark-vex Oct 22, 2022
c93ad74
chore: added release.md file.
FedeDP Oct 24, 2022
d8d4fff
adjust rockylinux driverkit target to rocky
EXONER4TED Oct 25, 2022
ff3aa70
adding initial support for opensuse
EXONER4TED Oct 27, 2022
b28e9c2
remove unecessary import
EXONER4TED Oct 27, 2022
577e435
added more suse mirrors and filters required
EXONER4TED Oct 27, 2022
a7b2dd5
updating opensuse to now produce a noarch rpm url in combination with…
EXONER4TED Oct 28, 2022
274959c
remove unecessary imports from opensuse
EXONER4TED Oct 28, 2022
7b6c5a6
add initial archlinux support
EXONER4TED Oct 31, 2022
cc2e269
add some other arch mirrors and trim the arch off the kernel release
EXONER4TED Oct 31, 2022
04f0767
add another check for if aarch64 arechitecture
EXONER4TED Oct 31, 2022
4d0b807
adding beautifulsoup4 to requirements
EXONER4TED Nov 2, 2022
b05a6a3
add beautifulsoup4 to setup.py
EXONER4TED Nov 2, 2022
8aa8852
new(ci): add github test ci for main.
FedeDP Nov 7, 2022
f6bdf44
chore(ci): redirect to file and store file as artifact.
FedeDP Nov 7, 2022
f7c73f7
fix(minikube): print only once the progress bar label when not in tty
alacuku Nov 10, 2022
b4cb5b5
rewrite improve opensuse error handling
EXONER4TED Nov 8, 2022
164dba1
use a tempfile and regex parsing for better memory management in open…
EXONER4TED Nov 10, 2022
f1e82d7
fix(kernel_crawler): check that regex search matches anything before …
FedeDP Nov 14, 2022
52fe212
update(docker): updated to python 3.10 image.
FedeDP Nov 14, 2022
9b6bbf7
fix(kernel_crawler): fix referenced before assignment issue.
FedeDP Nov 14, 2022
1057fae
fix(minikube): avoid printing to stdout.
FedeDP Nov 15, 2022
d3e7489
chore(ci): added a jq validation step for outputted json.
FedeDP Nov 15, 2022
ccb8c8a
fix(kernel_crawler): proper exceptions handling in flatcar GET request.
FedeDP Dec 12, 2022
8a7c7d8
new(kernel_crawler): initial bottlerocket support.
FedeDP Dec 12, 2022
3fd0d43
cleanup(kernel_crawler): refactored common git related code between m…
FedeDP Dec 12, 2022
8234f03
cleanup(kernel_crawler): drop non-driverkit output formatter.
FedeDP Dec 12, 2022
d8b36ec
chore(kernel_crawler): multiple fixes and refactors.
FedeDP Dec 12, 2022
8274d49
fix(kernel_crawler): bottlerocket needs to download the base kernel f…
FedeDP Dec 13, 2022
4e23767
fix(kernel_crawler): properly use unique key for bottlerocket res dic…
FedeDP Dec 14, 2022
d96c973
new(kernel_crawler): discover bottlerocket kvers and flavors dynamica…
FedeDP Dec 14, 2022
40db2df
chore(readme): typo.
FedeDP Dec 14, 2022
8e774b8
new(ci): ported release workflow to gh action.
FedeDP Jan 16, 2023
890fee3
cleanup(ci): dropped circleci workflow.
FedeDP Jan 16, 2023
09d09df
chore: no need for permissions.
FedeDP Jan 16, 2023
f08155f
chore: adjust semver for tags.
FedeDP Jan 16, 2023
92a8034
fix(ci): fixed github ref name.
FedeDP Jan 16, 2023
6b1683a
new(ci): added update-kernels gha.
cappellinsamuele Jan 27, 2023
f5f86f2
fix(ci): fix on workflow syntax.
cappellinsamuele Jan 30, 2023
05a9817
fix(ci): removed sudo on apt operations.
cappellinsamuele Jan 30, 2023
7d5242b
fix(ci): fixed update-kernels git setup phase
FedeDP Jan 30, 2023
d529e54
fix(ci): use a dev version of `create-pull-request` action to fix issue.
FedeDP Jan 31, 2023
df57340
cleanup(ci): dropped `update-kernels` workflow from main workflows.
FedeDP Jan 31, 2023
8cb21d5
chore: updated readme.
FedeDP Jan 31, 2023
cc1cb68
chore(ci): add back `update-kernels` on main branch.
FedeDP Feb 3, 2023
f5db21d
update Dockerfile, add more checks to actions pipeline, update circle…
EXONER4TED Nov 11, 2022
853288b
adding in some advanced centos community repos for ml kernels
EXONER4TED Mar 23, 2023
6ae769f
update(kernel_crawler): updated oracle to support OracleLinux9.
FedeDP Mar 24, 2023
dda3edb
chore(docs): updated readme.
FedeDP Mar 24, 2023
251e769
fix(docker): git is a dep.
FedeDP Mar 27, 2023
9000073
chore(docker): cleanup apt lists.
FedeDP Mar 27, 2023
dce1ca7
chore(docker): pin git version.
FedeDP Mar 27, 2023
c17b6ee
fix(ci): force use root user.
FedeDP Mar 27, 2023
ca2c95a
Alibaba Cloud Linux(AliyunLinux) 2 and 3 kernel crawl
dark-vex Mar 26, 2023
90d44e6
Fix drivekit config name, replaced aliyunlinux* with alinux
dark-vex Mar 27, 2023
cebfd48
merged aliyun linux 2 and 3 mirrors into a single mapping
dark-vex Mar 27, 2023
078231d
proposing EXONER4TED as maintainer
EXONER4TED Mar 24, 2023
4d7cc8d
reworking oracle possible urls, we were missing a few
EXONER4TED Apr 4, 2023
20d594d
adjust crawling rpm distros handling 404 errors more gracefully
EXONER4TED Apr 4, 2023
612b24c
catch an error where an rpm repo points to a no-longer-existing rpm a…
EXONER4TED Apr 10, 2023
583d3ce
new(kernel_crawler): add support for AmazonLinux2023.
FedeDP Apr 14, 2023
fc95825
update(kernel_crawler): added amazonlinux2 `kernel-ng` repository.
FedeDP Apr 14, 2023
a071dd8
new(ci): enabled crawling for specified distro to choose
cappellinsamuele Apr 26, 2023
8118c60
fix(ci): fixed some oversights on paths management.
cappellinsamuele Apr 27, 2023
134777a
chore(ci): added step to correctly handle no specific distro case
cappellinsamuele Apr 27, 2023
7746953
chore(ci): set distro choice as required
cappellinsamuele Apr 27, 2023
f5aa6eb
fix(ci): fixed jq script and handled the distro value when action run…
cappellinsamuele Apr 27, 2023
65c444c
fix(ci): fixed oversight (extra quote) on update-kernels gha.
cappellinsamuele Apr 28, 2023
51929a6
fix(ci): removed extra quote (x86_64).
cappellinsamuele Apr 28, 2023
deb7215
fix(ci): fixed `if:` condition for update-kernels single distro updat…
FedeDP May 2, 2023
70ad413
chore(kernel_crawler): add new fedora repos.
FedeDP Apr 28, 2023
e3c88dc
chore(readme.md): updated docs for docker images generation.
cappellinsamuele May 2, 2023
8378a73
update(ci): specific commit body message for distro-specific runs.
cappellinsamuele Apr 28, 2023
685563a
fix(ci): added missing variables.
cappellinsamuele Apr 28, 2023
4b5141f
new(kernel_crawler): add talos support.
FedeDP May 4, 2023
3f37c4c
fix(kernel_crawler): fixed talos support.
FedeDP May 16, 2023
e8acfcd
fix(kernel_crawler): fixed opensuse tumbleweed crawler.
FedeDP May 17, 2023
f4054a9
chore(kernel_crawler): add more openSUSE paths and fixup exusting ones.
FedeDP May 17, 2023
9670719
chore(ci): add all supported distros to update-kernels input choices.
FedeDP May 17, 2023
188c0a6
if uek in oracle kernel release, kernel version is 2
EXONER4TED May 22, 2023
62a02de
clean up centos mirror list and add back in centos 8
EXONER4TED May 24, 2023
314049c
docs(README.md): add scope and status badges
leogr Jun 6, 2023
1fe5aae
fix(kernel_crawler): fixed talos output protocol.
FedeDP Jun 8, 2023
477eed1
chore(ci): properly update last run distro file in CI.
FedeDP Jun 8, 2023
ccdc755
fix(ubuntu): removed flavor from kernel version
therealbobo Jun 12, 2023
4771f32
fix(kernel_crawler): properly support debian `cloud` and `rt` flavors.
FedeDP Jun 8, 2023
3124214
the pinned git version no longer exists in the base image, just remov…
EXONER4TED Jun 23, 2023
938f516
ignore pinned versions in dockerfile
EXONER4TED Jun 23, 2023
654ec16
fix(ci): properly quote "*" when creating last_run_distro file.
FedeDP Jun 26, 2023
b056143
fix(kernel_crawler): kernelversion should always be a string.
FedeDP Jul 26, 2023
bb69a6f
fix(kernel_crawler): enforce kernelversion to be a string.
FedeDP Aug 3, 2023
24815ec
docs: add license headers and spdx id.
FedeDP Oct 11, 2023
180bc33
new(kernel_crawler): add photonOS 5.0 support.
FedeDP Oct 13, 2023
b60ac29
new(ci): run update-kernels daily.
FedeDP Oct 12, 2023
1d7cc87
chore(ci): avoid the needs to push to `kernels` branch.
FedeDP Oct 19, 2023
874da41
chore(ci): properly validate produced jsons.
FedeDP Oct 19, 2023
7c5cc13
chore: updated readme.
FedeDP Oct 19, 2023
e8c0d32
fix(ci): fix typo.
FedeDP Oct 19, 2023
de7d991
chore: moved index.html under site folder to semplify workflow.
FedeDP Oct 19, 2023
dca59de
chore(ci): skip ci tests for commits not touching python code.
FedeDP Oct 19, 2023
98c97fa
new(kernel_crawler): rename distro keys to match os-release names.
FedeDP Oct 19, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
52 changes: 52 additions & 0 deletions .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,52 @@
<!-- Thanks for sending a pull request! Here are some tips for you:

1. If this is your first time, please read our contributor guidelines in the [CONTRIBUTING.md](https://github.com/falcosecurity/.github/blob/master/CONTRIBUTING.md) file.
2. Please label this pull request according to what type of issue you are addressing.
3. Please add a release note: it's really useful for the changelog!
4. If the PR is unfinished while opening it specify a wip in the title before the actual title, for example, "wip: my awesome feature"
-->

**What type of PR is this?**

> Uncomment one (or more) `/kind <>` lines:

> /kind bug

> /kind cleanup

> /kind documentation

> /kind feature

<!--
Please remove the leading whitespace before the `/kind <>` you uncommented.
-->

**Any specific area of the project related to this PR?**

> Uncomment one (or more) `/area <>` lines:

> /area crawler

> /area ci

> /area utils

<!--
Please remove the leading whitespace before the `/area <>` you uncommented.
-->

**What this PR does / why we need it**:

**Which issue(s) this PR fixes**:

<!--
Automatically closes linked issue when PR is merged.
Usage: `Fixes #<issue number>`, or `Fixes (paste link of issue)`.
If PR is `kind/failing-tests` or `kind/flaky-test`, please post the related issues/tests in a comment and do not use `Fixes`.
-->

Fixes #

**Special notes for your reviewer**:

28 changes: 28 additions & 0 deletions .github/workflows/docker.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
---
name: Docker
on:

Check warning on line 3 in .github/workflows/docker.yml

View workflow job for this annotation

GitHub Actions / Lints and Scans

3:1 [truthy] truthy value should be one of [false, true]
pull_request:
branches:
- main
paths:
- 'docker/*'

jobs:
build:
name: Build Dockerfile
runs-on: ubuntu-latest
outputs:
dockerfile_changed: ${{ steps.filter.outputs.docker }}
steps:
- name: Checkout repo ⤵️
uses: actions/checkout@v3

# test that the Dockerfile builds at all
# CircleCI handles pushes for now
- name: Build Image
uses: docker/build-push-action@v3
with:
file: docker/Dockerfile
context: .
push: false
tags: falcosecurity/kernel-crawler:test
34 changes: 34 additions & 0 deletions .github/workflows/lint.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
---
name: Lint
on:

Check warning on line 3 in .github/workflows/lint.yml

View workflow job for this annotation

GitHub Actions / Lints and Scans

3:1 [truthy] truthy value should be one of [false, true]
pull_request:
branches:
- main

jobs:
lint:
name: Lints and Scans
runs-on: ubuntu-latest
steps:
- name: Checkout repo ⤵️
uses: actions/checkout@v3

- name: Lint Dockerfile
uses: hadolint/[email protected]
with:
dockerfile: docker/Dockerfile
ignore: DL3008

- name: Lint kernel-crawler
uses: cclauss/[email protected]
with:
args: "pip install -r requirements.txt ; pylint kernel_crawler"
continue-on-error: true # allow failure for now

- name: Lint YAML
uses: karancode/[email protected]
with:
yamllint_file_or_dir: '.github/workflows/'
yamllint_strict: false
yamllint_comment: false
yamllint_config_filepath: .yamllint
38 changes: 38 additions & 0 deletions .github/workflows/release.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
---
name: Release

on:

Check warning on line 4 in .github/workflows/release.yml

View workflow job for this annotation

GitHub Actions / Lints and Scans

4:1 [truthy] truthy value should be one of [false, true]
push:
tags:
- '[0-9]+.[0-9]+.[0-9]+'

jobs:
build-images:
runs-on: ubuntu-22.04
steps:
- name: Checkout
uses: actions/checkout@v3
with:
fetch-depth: 0

- name: Login to Docker Hub
uses: docker/login-action@v1
with:
username: ${{ secrets.DOCKERHUB_USER }}
password: ${{ secrets.DOCKERHUB_SECRET }}

- name: Set up QEMU
uses: docker/setup-qemu-action@v2
with:
platforms: 'amd64,arm64'
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2

- name: Build and push container images
uses: docker/build-push-action@v3
with:
platforms: linux/amd64,linux/arm64
file: docker/Dockerfile
context: .
tags: falcosecurity/kernel-crawler:${{ github.ref_name }},falcosecurity/kernel-crawler:latest
push: true
53 changes: 53 additions & 0 deletions .github/workflows/test.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
---
name: Test
on:

Check warning on line 3 in .github/workflows/test.yml

View workflow job for this annotation

GitHub Actions / Lints and Scans

3:1 [truthy] truthy value should be one of [false, true]
pull_request:
branches:
- main
push:
branches:
- main

jobs:
paths-filter:
runs-on: ubuntu-latest
outputs:
crawler_changed: ${{ steps.filter.outputs.crawler }}
steps:
- uses: actions/checkout@v3
- uses: dorny/paths-filter@v2
id: filter
with:
filters: |
crawler:
- 'kernel_crawler/**'

test:
name: test kernel-crawler
runs-on: ubuntu-latest
needs: paths-filter
if: needs.paths-filter.outputs.crawler_changed == 'true'
steps:
- name: Checkout repo ⤵️
uses: actions/checkout@v3

- name: Install deps
run: |
sudo apt update
sudo apt install python3 python3-pip python3-pygit2 jq

- name: Install crawler
run: |
pip3 install .

- name: Run crawler
run: |
kernel-crawler crawl --distro "*" > kernels.json

- name: Validate json
run: |
cat kernels.json | jq empty

- uses: actions/upload-artifact@v3
with:
path: kernels.json
53 changes: 53 additions & 0 deletions .github/workflows/update-kernels.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
---
name: Update Kernels

on:

Check warning on line 4 in .github/workflows/update-kernels.yml

View workflow job for this annotation

GitHub Actions / Lints and Scans

4:1 [truthy] truthy value should be one of [false, true]
workflow_dispatch:
schedule:
- cron: '30 6 * * *'

# Checks if any concurrent jobs is running for kernels CI and eventually cancel it.
concurrency:
group: kernels-ci
cancel-in-progress: true

jobs:
update-kernels:
runs-on: ubuntu-latest
container:
image: falcosecurity/kernel-crawler:latest
options: -u root
permissions:
contents: read
pages: write
id-token: write
steps:
- name: Checkout crawler
uses: actions/checkout@v3

- name: Run crawler for x86_64
run: |
mkdir site/x86_64
kernel-crawler crawl --distro="*" > site/x86_64/list.json

- name: Run crawler for aarch64
run: |
mkdir site/aarch64
kernel-crawler crawl --distro="*" --arch=aarch64 > site/aarch64/list.json

- name: Install deps
run: |
apt update
apt install -y jq

- name: Validate jsons
run: |
cat site/x86_64/list.json | jq empty
cat site/aarch64/list.json | jq empty

- uses: actions/upload-pages-artifact@v1
with:
path: 'site'

- id: deployment
uses: actions/deploy-pages@v1
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
kernel_crawler.egg-info/
__pycache__/
.idea/
35 changes: 35 additions & 0 deletions .yamllint
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
---

yaml-files:
- '*.yaml'
- '*.yml'
- '.yamllint'

rules:
braces: enable
brackets: enable
colons: enable
commas: enable
comments:
level: warning
comments-indentation:
level: warning
document-end: disable
document-start:
level: warning
empty-lines: enable
empty-values: disable
float-values: disable
hyphens: enable
indentation: enable
key-duplicates: enable
key-ordering: disable
line-length:
max: 120
new-line-at-end-of-file: enable
new-lines: enable
octal-values: disable
quoted-strings: disable
trailing-spaces: enable
truthy:
level: warning
19 changes: 0 additions & 19 deletions Dockerfile

This file was deleted.

18 changes: 0 additions & 18 deletions Dockerfile.centos-gcc4.4

This file was deleted.

18 changes: 0 additions & 18 deletions Dockerfile.centos-gcc4.8

This file was deleted.

20 changes: 0 additions & 20 deletions Dockerfile.centos-gcc7.3

This file was deleted.

Loading