Skip to content

Commit

Permalink
Rename Flint instances to S3 Glue (#1889)
Browse files Browse the repository at this point in the history
Signed-off-by: Simeon Widdis <[email protected]>
  • Loading branch information
Swiddis authored Jun 11, 2024
1 parent b99920d commit 81dd71c
Show file tree
Hide file tree
Showing 14 changed files with 19 additions and 19 deletions.
2 changes: 1 addition & 1 deletion docs/integrations/setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ the author in hindsight.
If working on S3-based integrations, it's worth noting that queries have some values
[substituted](https://github.com/opensearch-project/dashboards-observability/blob/4e1e0e585/public/components/integrations/components/setup_integration.tsx#L438) when installing. They are:

- `{table_name}` is the fully qualified name of the Flint table, typically `datasource.database.object_name`.
- `{table_name}` is the fully qualified name of the S3 Glue table, typically `datasource.database.object_name`.
This is also substituted in any linked Saved Queries when using S3-based integrations.
- `{s3_bucket_location}` to locate data.
- `{s3_checkpoint_location}` to store intermediate results, which is required by Spark.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ const labelFromDataSourceType = (dsType: DatasourceType): string | null => {
case 'SECURITYLAKE':
return 'Amazon Security Lake';
case 'S3GLUE':
return 'Flint S3';
return 'S3 Glue';
case 'PROMETHEUS':
return null; // TODO Prometheus integrations not supported so no label available
default:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"description": "Analyze access logs for Amazon CloudFront.",
"license": "Apache-2.0",
"type": "logs-aws_cloudfront",
"labels": ["Observability", "Logs", "AWS", "Cloud", "Flint S3"],
"labels": ["Observability", "Logs", "AWS", "Cloud", "S3 Glue"],
"author": "OpenSearch",
"sourceUrl": "https://github.com/opensearch-project/opensearch-catalog/releases/tag/amazon_cloudfront-1.0.0",
"statics": {
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"description": "Analyze access logs for Elastic Load Balancing.",
"license": "Apache-2.0",
"type": "logs_elb",
"labels": ["Observability", "Logs", "AWS", "Flint S3", "Cloud"],
"labels": ["Observability", "Logs", "AWS", "S3 Glue", "Cloud"],
"author": "OpenSearch",
"sourceUrl": "https://github.com/opensearch-project/opensearch-catalog/releases/tag/amazon_elb-1.0.0",
"workflows": [
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"description": "Analyze Amazon S3 server logs.",
"license": "Apache-2.0",
"type": "logs_s3",
"labels": ["Observability", "Logs", "AWS", "Cloud", "Flint S3"],
"labels": ["Observability", "Logs", "AWS", "Cloud", "S3 Glue"],
"author": "OpenSearch",
"sourceUrl": "https://github.com/opensearch-project/opensearch-catalog/releases/tag/amazon_s3_access-logs-1.1.0",
"workflows": [
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"description": "Monitor IP traffic with VPC Flow Logs.",
"license": "Apache-2.0",
"type": "logs_vpc",
"labels": ["Observability", "Logs", "AWS", "Cloud", "Flint S3"],
"labels": ["Observability", "Logs", "AWS", "Cloud", "S3 Glue"],
"author": "OpenSearch",
"sourceUrl": "https://github.com/opensearch-project/opensearch-catalog/releases/tag/amazon_vpc_flow_1.1.0",
"workflows": [
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -181,7 +181,7 @@ MSCK REPAIR TABLE vpc_flow_logs_parquet

## Projection Views Creation

The following statements creates a set of views (Materialized View, Covering Index, Skipping Index) that help the acceleration of queries using the flint based capability.
The following statements creates a set of views (Materialized View, Covering Index, Skipping Index) that help the acceleration of queries using the S3 Glue based capability.
The outcome of creating these acceleration tables is the synchronization of data being stored within opensearch index.

This data can be one of the following
Expand Down Expand Up @@ -645,4 +645,4 @@ TBLPROPERTIES (

VPC logs fields - https://docs.aws.amazon.com/vpc/latest/userguide/flow-logs.html

Flint integration Adaptation Tutorial - https://github.com/opensearch-project/opensearch-catalog/issues/144
S3 Glue integration Adaptation Tutorial - https://github.com/opensearch-project/opensearch-catalog/issues/144
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ Flow logs can help you with a number of tasks, such as:
Flow log data is collected outside of the path of your network traffic, and therefore does not affect network throughput or latency. You can create or delete flow logs without any risk of impact to network performance.

- See additional AWS Logs Info details [Here](https://docs.aws.amazon.com/vpc/latest/userguide/flow-logs.html).
- Flint S3 VPC integration [Readme](Flint-Integration.md)
- S3 Glue VPC integration [Readme](Flint-Integration.md)

## What is AWS VPC FLow Logs Integration ?

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"description": "Insights on applications using the standard Apache access log format.",
"license": "Apache-2.0",
"type": "logs_apache",
"labels": ["Observability", "Logs", "Flint S3"],
"labels": ["Observability", "Logs", "S3 Glue"],
"author": "OpenSearch",
"sourceUrl": "https://github.com/opensearch-project/opensearch-catalog/releases/tag/apache-1.0.0",
"workflows": [
Expand Down

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"description": "Analyze CloudTrail events.",
"license": "Apache-2.0",
"type": "logs-aws_cloudtrail",
"labels": ["Observability", "Logs", "AWS", "Cloud", "Flint S3"],
"labels": ["Observability", "Logs", "AWS", "Cloud", "S3 Glue"],
"author": "OpenSearch",
"sourceUrl": "https://github.com/opensearch-project/opensearch-catalog/releases/tag/aws_cloudtrail-1.1.0",
"workflows": [
Expand All @@ -17,14 +17,14 @@
},
{
"name": "dashboards-flint",
"label": "Dashboards & Visualizations & sample queries adapted to Flint",
"description": "Dashboards and visualizations adapted to Flint S3 datasource that enable you to easily visualize data residing on S3",
"label": "Dashboards & Visualizations & sample queries adapted to S3 Glue",
"description": "Dashboards and visualizations adapted to S3 Glue datasource that enable you to easily visualize data residing on S3",
"enabled_by_default": false
},
{
"name": "dashboards-flint-records",
"label": "Dashboards & Visualizations & sample queries adapted to Flint (Multi-Records Protocol)",
"description": "Dashboards and visualizations adapted to Flint S3 datasource that enable you to easily visualize data residing on S3 (Multi-Records Protocol)",
"label": "Dashboards & Visualizations & sample queries adapted to S3 Glue (Multi-Records Protocol)",
"description": "Dashboards and visualizations adapted to S3 Glue datasource that enable you to easily visualize data residing on S3 (Multi-Records Protocol)",
"enabled_by_default": true
}
],
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"description": "Analyze AWS WAF web ACL traffic.",
"license": "Apache-2.0",
"type": "logs_waf",
"labels": ["Observability", "Logs", "AWS", "Cloud", "Flint S3"],
"labels": ["Observability", "Logs", "AWS", "Cloud", "S3 Glue"],
"author": "OpenSearch",
"sourceUrl": "https://github.com/opensearch-project/opensearch-catalog/releases/tag/aws_waf-1.0.0",
"workflows": [
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"description": "Analyze HAProxy access logs.",
"license": "Apache-2.0",
"type": "logs",
"labels": ["Observability", "Logs", "Flint S3"],
"labels": ["Observability", "Logs", "S3 Glue"],
"author": "OpenSearch",
"sourceUrl": "https://github.com/opensearch-project/opensearch-catalog/releases/tag/haproxy-1.0.0",
"workflows": [
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"description": "Analyze Nginx access logs.",
"license": "Apache-2.0",
"type": "logs",
"labels": ["Observability", "Logs", "Flint S3"],
"labels": ["Observability", "Logs", "S3 Glue"],
"author": "OpenSearch",
"sourceUrl": "https://github.com/opensearch-project/opensearch-catalog/releases/tag/nginx-1.0.0",
"workflows": [
Expand Down

0 comments on commit 81dd71c

Please sign in to comment.