Skip to content
This repository has been archived by the owner on Oct 28, 2024. It is now read-only.

Merge custom changes into v0.39 #19

Merged
merged 56 commits into from
Aug 22, 2024
Merged

Conversation

andrewma2
Copy link
Collaborator

@andrewma2 andrewma2 commented Aug 20, 2024

Upgrading to v0.39 (following this SOP to produce a PR like this)

Checked that content changes are from our specific changes

Checked that image still builds and UTs still pass, also checked with load test w/ custom image

Also setting the version to our custom tag

jszwedko and others added 30 commits February 13, 2024 06:40
* chore(website): remove changelog cliffhanger

* chore(changelog): use more stable v0.36 source link
The docs assumed the default was `false` when it is actually `true`. I slimmed them down so that
they don't refer to the default.

Fixes: vectordotdev#19916

Signed-off-by: Jesse Szwedko <[email protected]>
…dotdev#19939)

* Use http client so we can use openssl tls.

* Share connector code.

Signed-off-by: Stephen Wakely <[email protected]>

* Clippy

Signed-off-by: Stephen Wakely <[email protected]>

* Feedback from Bruce.

Signed-off-by: Stephen Wakely <[email protected]>

---------

Signed-off-by: Stephen Wakely <[email protected]>
…v#19972)

* Use http client so we can use openssl tls.

* Share connector code.

Signed-off-by: Stephen Wakely <[email protected]>

* Clippy

Signed-off-by: Stephen Wakely <[email protected]>

* Feedback from Bruce.

Signed-off-by: Stephen Wakely <[email protected]>

* Resolve region with custom http provider.

Signed-off-by: Stephen Wakely <[email protected]>

---------

Signed-off-by: Stephen Wakely <[email protected]>
* chore(deps): Bump whoami to 1.5.0

Resolves RUSTSEC-2024-0020

Signed-off-by: Jesse Szwedko <[email protected]>

* regenerate licenses

Signed-off-by: Jesse Szwedko <[email protected]>

---------

Signed-off-by: Jesse Szwedko <[email protected]>
…tordotdev#20030)

Otherwise it outputs this warning:

```
2024-03-07T11:59:25.573521Z  WARN provide_credentials{provider=default_chain}: aws_config::meta::credentials::chain: provider failed to provide credentials provider=Profile error=the credentials provider was not properly configured: ProfileFile provider could not be built: This behavior requires following cargo feature(s) enabled: credentials-process. In order to spawn a subprocess, the credentials-process feature must be enabled. (InvalidConfiguration(InvalidConfiguration { source: "ProfileFile provider could not be built: This behavior requires following cargo feature(s) enabled: credentials-process. In order to spawn a subprocess, the credentials-process feature must be enabled."
```

Signed-off-by: Jesse Szwedko <[email protected]>
…tdev#20032)

* fix(compression): Fix gzip and zlib performance degradation

Fix gzip and zlib performance degradation caused by:
* flate2 v1.0.28 started to resize its input buffer up to its capacity
  and back to the actual number of bytes written.
* Some sinks are writing to Compressor without buffering,
  resulting in frequent small writes to the flate2 writer.
  Within 32KB of input buffer in flate2, this causes an excessive number of memset operations
  and degraded sink throughput.

This fix introduces a wrapper buffer in front of gzip and zlib writers to accumulate data
before calling the write function of the underlying writer.

Signed-off-by: Artur Malchanau <[email protected]>

* Add a link to the comment with more context.

---------

Signed-off-by: Artur Malchanau <[email protected]>
Resolves RUSTSEC-2024-0019

Signed-off-by: Jesse Szwedko <[email protected]>
…ectordotdev#20186)

* chore(docs): note for 0.37 about incorrect ddtags parsing behavior

* generate docs

* feedback jhgilbert
I'd planned to time this with the v0.37.0 release.

Signed-off-by: Jesse Szwedko <[email protected]>
…ource mode (vectordotdev#20202)

* docs(dnstap source, releasing): Add breaking change note for dnstap source mode

`mode` is now a required parameter with no default.

Signed-off-by: Jesse Szwedko <[email protected]>

* spelling

Signed-off-by: Jesse Szwedko <[email protected]>

---------

Signed-off-by: Jesse Szwedko <[email protected]>
Merge Databricks specific patches into v0.36.1
…ctordotdev#20192)

* fix(enrichment_tables): bring back support for `GeoLite2-City` db

Brings back support for `GeoLite2-City` DB after adding custom `mmdb`
type. The issue was that previously any unknown DB type was treated as a
City DB, which covered the case of `GeoLite2-City`. This now explicitly
adds it as a supported type.

Fixes: vectordotdev#20191
Related: vectordotdev#20054

* Add changelog
jszwedko and others added 25 commits April 8, 2024 08:32
We are seeing a lot of flakiness for this upgrade lately and I'm not really sure it is necessary to
be running this.

Signed-off-by: Jesse Szwedko <[email protected]>
These don't seem to be used anywhere anymore.

Signed-off-by: Jesse Szwedko <[email protected]>
…20210)

GHA is deprecating multi-label runners at the end of April.

Signed-off-by: Jesse Szwedko <[email protected]>
To resolve `RUSTSEC-2024-0332`.

Signed-off-by: Jesse Szwedko <[email protected]>
Update sink handling to retry more exceptions
Add AccessDenied to AWS Retry modes
Set databricks version to track custom changes
@andrewma2 andrewma2 merged commit 3f8b190 into databricks:v0.39 Aug 22, 2024
42 of 52 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.