Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Patch 4 #1

Open
wants to merge 2,178 commits into
base: master
Choose a base branch
from
Open

Patch 4 #1

wants to merge 2,178 commits into from

Conversation

sophieyfang
Copy link
Owner

No description provided.

cosmo0920 and others added 30 commits September 2, 2022 21:21
* README: add requirements section

Signed-off-by: Takahiro Yamashita <[email protected]>
* README: add requirements section

Signed-off-by: Takahiro Yamashita <[email protected]>
…#5980) (fluent#5994)

* Revert "tests: runtime: out_plot: updated the wait_for_file calls to match the new prototype."

This reverts commit 1495eee.

* Revert "tests: runtime: out_file: switched the sleep with a timed mechanism that waits for the expected file to be available."

This reverts commit ee2a225.

* Revert "tests: runtime: modified wait_for_file so it can wait for the file to have data inside so it can be used by the out_file test case."

This reverts commit 693ea43.

* Revert "tests: runtime_shell: changed the listener ports so they don't overlap with each other or the runtime in_tcp test."

This reverts commit f4e9a5f.

* Revert "test: internal: flb_event_loop: added an epsilon value that works better with macos on CI."

This reverts commit d027a7f.

* Revert "lib: monkey: deprecated usage of a TLS buffer for error description storage as a test since it causes a memory corruption in m1 macs when the TLS key is not initialized (and this one is not easy to initialize from outside without creating a monkey server instance)"

This reverts commit f166dbe.

* Revert "tests: internal: stream_processor: fixed datafile variable size and made the code respect its limit (this issue was exposed when running fluent-bit in macos with a 56 character long cwd)"

This reverts commit 0cc0cc8.

* Revert "tests: runtime: config_map_opts: added missing TLS initialization"

This reverts commit 194e1b2.

* Revert "tests: runtime: out_plot: added a mechanism to wait for the file so the test doesn't fail due to its undeterministic nature."

This reverts commit dbd5bac.

* Revert "tests: runtime: added a function to add a bit of determinism to the tests that require a file to be created by fluent-bit so they don't depend purely on a sleep."

This reverts commit 9ebdc1c.

* Revert "tests: runtime: in_syslog: exclude macos from the uds test since it doesn't support uds in datagram mode."

This reverts commit 92c0344.

* Revert "plugins: in_dummy_thread: added collector delete before thread destroy to prevent fluent-bit from trying to destroy a collector whoses fd was already released (which causes a crash in macos)"

This reverts commit df6d234.

* Revert "downstream: retain the original event mask when injecting the wakeup event to prevent the subsequent `_mk_event_del` call from trying to delete the wrong type of event from the underlying event loop."

This reverts commit 82be6b4.

* Revert "upstream: retain the original event mask when injecting the wakeup event to prevent the subsequent `_mk_event_del` call from trying to delete the wrong type of event from the underlying event loop."

This reverts commit 5d90765.

* Revert "tests: internal: input_chunk: added required TLS initialization to prevent a crash in when trying to release flush params in `flb_output_exit`"

This reverts commit 2724ec3.

* Revert "config: added a check to keep it from trying to destroy non initialized timer (only happens in sloppy internal tests)"

This reverts commit 9265742.

* Revert "tests: internal: flb_event_loop: inverted the pipe close and event loop delete operations so it works as expected in macos"

This reverts commit 18e7356.

* Revert "tests: internal: utils: added config initialization to prevent macos crashes."

This reverts commit fd3bb78.

* Revert "tests: internal: stream_processor: added config initialization to prevent macos crashes."

This reverts commit 49a44db.

* Revert "tests: internal: sinv4: added config initialization to prevent macos crashes."

This reverts commit b413ea3.

* Revert "tests: internal: record_accessor: added config initialization to prevent macos crashes."

This reverts commit 7b88192.

* Revert "tests: internal: pack: added config initialization to prevent macos crashes."

This reverts commit d2e6da9.

* Revert "tests: internal: metrics: added config initialization to prevent macos crashes."

This reverts commit af4dee3.

* Revert "tests: internal: fstore: added config initialization to prevent macos crashes."

This reverts commit 6aa2770.

* Revert "tests: internal: time: added config initialization to prevent macos crashes."

This reverts commit 9c74d2f.

* Revert "tests: internal: config_format_fluentbit: added config initialization to prevent macos crashes."

This reverts commit 11de3bf.

* Revert "tests: internal: config_format_fluentbit: added config initialization to prevent macos crashes."

This reverts commit 6007d7a.
flb_sds_create_len may fail and this needs to be handled.

Fixes: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=46082

Signed-off-by: David Korczynski <[email protected]>
Signed-off-by: Eduardo Silva <[email protected]>
…-2022 (fluent#6011)

* lib: wasm-micro-runtime: Upgrade to fast-jit-06-29-2022

Signed-off-by: Hiroshi Hatake <[email protected]>
…ent#6006)

Without this fix, fluent-bit on macOS does not handle mkdir option in
out_file correctly:

```console
$ bin/fluent-bit -i dummy -o file -p path=output/log.txt -p mkdir=true -vv
Fluent Bit v2.0.0
* Copyright (C) 2015-2022 The Fluent Bit Authors
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2022/09/05 23:13:42] [ info] Configuration:
[2022/09/05 23:13:42] [ info]  flush time     | 1.000000 seconds
[2022/09/05 23:13:42] [ info]  grace          | 5 seconds
[2022/09/05 23:13:42] [ info]  daemon         | 0
[2022/09/05 23:13:42] [ info] ___________
[2022/09/05 23:13:42] [ info]  inputs:
[2022/09/05 23:13:42] [ info]      dummy
[2022/09/05 23:13:42] [ info] ___________
[2022/09/05 23:13:42] [ info]  filters:
[2022/09/05 23:13:42] [ info] ___________
[2022/09/05 23:13:42] [ info]  outputs:
[2022/09/05 23:13:42] [ info]      file.0
[2022/09/05 23:13:42] [ info] ___________
[2022/09/05 23:13:42] [ info]  collectors:
[2022/09/05 23:13:42] [ info] [fluent bit] version=2.0.0, commit=86eb764b85, pid=46456
[2022/09/05 23:13:42] [debug] [engine] coroutine stack size: 24576 bytes (24.0K)
[2022/09/05 23:13:42] [ info] [storage] version=1.2.0, type=memory-only, sync=normal, checksum=disabled, max_chunks_up=128
[2022/09/05 23:13:42] [ info] [cmetrics] version=0.3.6
[2022/09/05 23:13:42] [debug] [dummy:dummy.0] created event channels: read=21 write=22
[2022/09/05 23:13:42] [debug] [file:file.0] created event channels: read=23 write=24
[2022/09/05 23:13:42] [debug] [router] default match rule dummy.0:file.0
[2022/09/05 23:13:42] [ info] [sp] stream processor started
[2022/09/05 23:13:42] [ info] [output:file:file.0] worker #0 started
[2022/09/05 23:13:43] [debug] [input chunk] update output instances with new chunk size diff=26
[2022/09/05 23:13:44] [trace] [task 0x6000013b0000] created (id=0)
[2022/09/05 23:13:44] [debug] [task] created task=0x6000013b0000 id=0 OK
[2022/09/05 23:13:44] [debug] [output:file:file.0] task_id=0 assigned to thread #0
[2022/09/05 23:13:44] [debug] [output:file:file.0] creating directory .
[2022/09/05 23:13:44] [error] [/Users/cosmo/GitHub/fluent-bit/plugins/out_file/file.c:475 errno=17] File exists
[2022/09/05 23:13:44] [error] [output:file:file.0] error opening: output/log.txt/dummy.0
[2022/09/05 23:13:44] [debug] [out flush] cb_destroy coro_id=0
```

Signed-off-by: Hiroshi Hatake <[email protected]>
replying to a udp host which was not the sender of the last message we
received or before starting a TCP connection attempt.

Signed-off-by: Leonardo Alminana <[email protected]>
network: fixed uninitialized address processing
network: added connection remote host set call before starting a
connection attempt

note: there's still a corner case where if a tcp connection attempt
times out while performing a dns query the remote host address will not
be available.

Signed-off-by: Leonardo Alminana <[email protected]>
* workflows: add override to allow partial staging build

Signed-off-by: Patrick Stephens <[email protected]>

* workflows: fix typo

Signed-off-by: Patrick Stephens <[email protected]>

Signed-off-by: Patrick Stephens <[email protected]>
Signed-off-by: Eduardo Silva <[email protected]>
Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action) from 1.1.2 to 2.0.0.
- [Release notes](https://github.com/ossf/scorecard-action/releases)
- [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md)
- [Commits](ossf/scorecard-action@ce330fd...13ec8c7)

---
updated-dependencies:
- dependency-name: ossf/scorecard-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
edsiper and others added 28 commits October 10, 2022 22:52
Only limited fields should be freed when an early error happens in
`parser_conf_file`. Otherwise, we will either free too much such that a
double free will happen when used in combination with `flb_parser_exit`
and `flb_config_exit`, or, memory leaks will happen. This fixes so
neither of these situations happen.

Fixes: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=51223

Signed-off-by: David Korczynski <[email protected]>
The current boundary is wrong, this fixes it.

Fixes: https://bugs.chromium.org/p/oss-fuzz/issues/detail?id=51024

Signed-off-by: David Korczynski <[email protected]>
Signed-off-by: Patrick Stephens <[email protected]>

Signed-off-by: Patrick Stephens <[email protected]>
* dockerfiles: add OpenSSL to Windows container

Signed-off-by: Patrick Stephens <[email protected]>

* dockerfiles: remove openssl copying

Signed-off-by: Patrick Stephens <[email protected]>

Signed-off-by: Patrick Stephens <[email protected]>
* packaging: update to provide AL 2022 as an official target

Signed-off-by: Patrick Stephens <[email protected]>

* packaging: update publish script

Signed-off-by: Patrick Stephens <[email protected]>

* packaging: update README.md

Signed-off-by: Patrick Stephens <[email protected]>

* packaging: handle createrepo_c existence

Signed-off-by: Patrick Stephens <[email protected]>

Signed-off-by: Patrick Stephens <[email protected]>
On a 32 bit system, the inode number is 32 bits, not 64, so the format string expecting a 64bit parameter would end up with junk data and continue to think a new file was found, leaking file descriptors and eventually preventing fluent bit from running.

Cast the inode parameter when generating the file hash to 64 bits to avoid differences on 32 versus 64 bit systems.

Signed-off-by: Megan E. Smith <[email protected]>
Signed-off-by: Aditya Prajapati <[email protected]>
compose_payload allocates memory when 'format' is not 'msgpack'.
It is not released when no connection is available and it causes issue fluent#6208.

This patch is to change flush flow.

1. Check connection
2. Invoke compose_payload

Signed-off-by: Takahiro Yamashita <[email protected]>
…t Log (fluent#6176)

* Additions to in_winevtlog plugin to allow scenarios where one or more channels are missing on Windows Event Log, e.g:

PowerShellCore/Operational needs the proper software installed to  appear under Application and Services Log

Signed-off-by: Meissner Morales <[email protected]>
* pack: add 'epoch_ms' format

Signed-off-by: Jeongki Kim <[email protected]>
Signed-off-by: shifter <[email protected]>
In fluent#4359, @nokute78 notes that bare keys in logfmt lines get the wrong
value after parsing: they should get a `true` value, not `nil`.

Signed-off-by: Dennis Kaarsemaker <[email protected]>
…rsion

This commit sets a limit number of config files.
It also checks recursion based on inode number.

Signed-off-by: Takahiro Yamashita <[email protected]>
Signed-off-by: sophieyfang <[email protected]>
@github-actions
Copy link

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.

@github-actions github-actions bot added the Stale label Jan 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.