Skip to content

Commit

Permalink
Merge branch 'main' into artifact_collection
Browse files Browse the repository at this point in the history
  • Loading branch information
johndmulhausen authored Oct 3, 2024
2 parents f2b6047 + 3dc8259 commit 35b510d
Show file tree
Hide file tree
Showing 345 changed files with 7,204 additions and 24,187 deletions.
34 changes: 0 additions & 34 deletions .gcloudignore

This file was deleted.

4 changes: 2 additions & 2 deletions .github/workflows/build_docs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ jobs:
- name: Set up Node.js
uses: actions/setup-node@v3
with:
node-version: 18.0.0
node-version: 22.9.0

- name: Install yarn
run: npm install --global yarn
Expand All @@ -25,4 +25,4 @@ jobs:
run: yarn install

- name: Build the docs
run: yarn docusaurus build
run: yarn build:prod
7 changes: 7 additions & 0 deletions .github/workflows/dependabot.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
version: 2
updates:
- package-ecosystem: "github-actions"
directory: "/"
schedule:
# Check for updates to GitHub Actions every weekday
interval: "daily"
33 changes: 33 additions & 0 deletions .github/workflows/linkcheck.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
name: Lychee check
on:
pull_request:
paths:
- '**.md'

jobs:
lychee:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4

- name: Get changed files
id: changed-files
uses: tj-actions/changed-files@v45
with:
files: "**.md"

- name: Link Checker
id: lychee
uses: lycheeverse/[email protected]
with:
token: ${{ secrets.GITHUB_TOKEN }}
args: --scheme https --scheme http --verbose ${{ steps.changed-files.outputs.all_changed_files }}
env:
GITHUB_TOKEN: ${{secrets.GITHUB_TOKEN}}

- name: Create PR comment with link reults
uses: marocchino/sticky-pull-request-comment@v2
with:
header: lychee
recreate: true
path: ./lychee/out.md
19 changes: 14 additions & 5 deletions .github/workflows/reviewdog.yml
Original file line number Diff line number Diff line change
@@ -1,10 +1,19 @@
name: reviewdog
on: [pull_request]
name: Vale check
on:
pull_request:
paths:
- '**.md'

jobs:
vale:
name: runner / vale
name: Vale check
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
- uses: errata-ai/vale-action@reviewdog
- uses: actions/checkout@v4
- uses: errata-ai/vale-action@reviewdog
env:
REVIEWDOG_GITHUB_API_TOKEN: ${{ secrets.GITHUB_TOKEN }}
with:
fail_on_error: false
files: docs
reporter: github-pr-review
4 changes: 3 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -29,4 +29,6 @@ yarn-error.log*
#wandb
wandb/
translate_dev/
chatgpt*
chatgpt*yar
package-lock.json
.vale.ini.swp
5 changes: 4 additions & 1 deletion .vale.ini
Original file line number Diff line number Diff line change
Expand Up @@ -21,4 +21,7 @@ Packages = Google, Readability
[*.md]
BasedOnStyles = Vale, Google

Google.Contractions = No
Google.Contractions = No
Google.Semicolons = No
Google.Parens = No
Google.Acronyms = No
Binary file removed .vale.ini.swp
Binary file not shown.
3 changes: 0 additions & 3 deletions app-beta.yaml

This file was deleted.

3 changes: 0 additions & 3 deletions app.yaml

This file was deleted.

24 changes: 24 additions & 0 deletions data.json
Original file line number Diff line number Diff line change
Expand Up @@ -393,6 +393,30 @@
"from": "/guides/hosting/intro",
"to": "/guides/hosting"
},
{
"from": "/guides/self-hosted",
"to": "/guides/hosting/hosting-options/self-managed/"
},
{
"from": "/guides/self-hosted/local",
"to": "/guides/hosting/hosting-options/self-managed/"
},
{
"from": "/guides/self-hosted/local-common-questions",
"to": "/guides/hosting"
},
{
"from": "/guides/self-hosted/setup/private-cloud",
"to": "/guides/hosting/hosting-options/dedicated_cloud",
},
{
"from": "/self-hosted/setup/on-premise-baremetal",
"to": "/guides/hosting/hosting-options/self-managed",
},
{
"from": "/guides/self-hosted/setup/configuration",
"to": "/guides/hosting",
},
{
"from": "/guides/hosting/secure-storage-connector",
"to": "/guides/hosting/data-security/secure-storage-connector"
Expand Down
25 changes: 0 additions & 25 deletions dispatch.yaml

This file was deleted.

5 changes: 2 additions & 3 deletions docs/guides/app/features/anon.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
---
description: Log and visualize data without a W&B account
displayed_sidebar: default
title: Anonymous mode
---

# Anonymous mode

Are you publishing code that you want anyone to be able to run easily? Use anonymous mode to let someone run your code, see a W&B dashboard, and visualize results without needing to create a W&B account first.

Allow results to be logged in anonymous mode with:
Expand Down Expand Up @@ -54,7 +53,7 @@ If you set `anonymous="allow"` in your script, W&B checks to make sure there's n
* **No persistent data**: Runs are only saved for 7 days in an anonymous account. You can claim anonymous run data by saving it to a real account.


![](@site/static/images/app_ui/anon_mode_no_data.png)
![](/images/app_ui/anon_mode_no_data.png)

* **No artifact logging**: Runs print a warning on the command line that you can't log an artifact to an anonymous run:
```bash
Expand Down
48 changes: 23 additions & 25 deletions docs/guides/app/features/custom-charts/intro.md
Original file line number Diff line number Diff line change
@@ -1,19 +1,17 @@
---
slug: /guides/app/features/custom-charts
displayed_sidebar: default
title: Custom charts
---

import Tabs from '@theme/Tabs';
import TabItem from '@theme/TabItem';

# Custom Charts

Use **Custom Charts** to create charts that aren't possible right now in the default UI. Log arbitrary tables of data and visualize them exactly how you want. Control details of fonts, colors, and tooltips with the power of [Vega](https://vega.github.io/vega/).

* **What's possible**: Read the[ launch announcement](https://wandb.ai/wandb/posts/reports/Announcing-the-W-B-Machine-Learning-Visualization-IDE--VmlldzoyNjk3Nzg)
* **Code**: Try a live example in a[ hosted notebook](https://tiny.cc/custom-charts)
* **Video**: Watch a quick [walkthrough video](https://www.youtube.com/watch?v=3-N9OV6bkSM)
* **Example**: Quick Keras and Sklearn [demo notebook](https://colab.research.google.com/drive/1g-gNGokPWM2Qbc8p1Gofud0\_5AoZdoSD?usp=sharing)
* **What's possible**: Read the[ launch announcement](https://wandb.ai/wandb/posts/reports/Announcing-the-W-B-Machine-Learning-Visualization-IDE--VmlldzoyNjk3Nzg)
* **Code**: Try a live example in a[ hosted notebook](https://tiny.cc/custom-charts)
* **Video**: Watch a quick [walkthrough video](https://www.youtube.com/watch?v=3-N9OV6bkSM)
* **Example**: Quick Keras and Sklearn [demo notebook](https://colab.research.google.com/drive/1g-gNGokPWM2Qbc8p1Gofud0_5AoZdoSD?usp=sharing)

![Supported charts from vega.github.io/vega](/images/app_ui/supported_charts.png)

Expand Down Expand Up @@ -63,9 +61,9 @@ You can use this to log curves on any two dimensions. Note that if you're plotti

![](/images/app_ui/line_plot.png)

[See in the app](https://wandb.ai/wandb/plots/reports/Custom-Line-Plots--VmlldzoyNjk5NTA)
[See in the app](https://wandb.ai/wandb/plots/reports/Custom-Line-Plots--VmlldzoyNjk5NTA)

[Run the code](https://tiny.cc/custom-charts)
[Run the code](https://tiny.cc/custom-charts)

</TabItem>
<TabItem value="scatter-plot">
Expand All @@ -84,9 +82,9 @@ You can use this to log scatter points on any two dimensions. Note that if you'r

![](/images/app_ui/demo_scatter_plot.png)

[See in the app](https://wandb.ai/wandb/plots/reports/Custom-Scatter-Plots--VmlldzoyNjk5NDQ)
[See in the app](https://wandb.ai/wandb/plots/reports/Custom-Scatter-Plots--VmlldzoyNjk5NDQ)

[Run the code](https://tiny.cc/custom-charts)
[Run the code](https://tiny.cc/custom-charts)

</TabItem>
<TabItem value="bar-chart">
Expand All @@ -109,11 +107,11 @@ wandb.log(

You can use this to log arbitrary bar charts. Note that the number of labels and values in the lists must match exactly (i.e. each data point must have both).

![](@site/static/images/app_ui/line_plot_bar_chart.png)
![](/images/app_ui/line_plot_bar_chart.png)

[See in the app](https://wandb.ai/wandb/plots/reports/Custom-Bar-Charts--VmlldzoyNzExNzk)
[See in the app](https://wandb.ai/wandb/plots/reports/Custom-Bar-Charts--VmlldzoyNzExNzk)

[Run the code](https://tiny.cc/custom-charts)
[Run the code](https://tiny.cc/custom-charts)

</TabItem>
<TabItem value="histogram">
Expand All @@ -132,16 +130,16 @@ You can use this to log arbitrary histograms. Note that `data` is a list of list

![](/images/app_ui/demo_custom_chart_histogram.png)

[See in the app](https://wandb.ai/wandb/plots/reports/Custom-Histograms--VmlldzoyNzE0NzM)
[See in the app](https://wandb.ai/wandb/plots/reports/Custom-Histograms--VmlldzoyNzE0NzM)

[Run the code](https://tiny.cc/custom-charts)
[Run the code](https://tiny.cc/custom-charts)

</TabItem>
<TabItem value="pr-curve">

`wandb.plot.pr_curve()`

Create a [Precision-Recall curve](https://scikit-learn.org/stable/modules/generated/sklearn.metrics.precision\_recall\_curve.html#sklearn.metrics.precision\_recall\_curve) in one line:
Create a [Precision-Recall curve](https://scikit-learn.org/stable/modules/generated/sklearn.metrics.precision_recall_curve.html#sklearn.metrics.precision_recall_curve) in one line:

```python
plot = wandb.plot.pr_curve(ground_truth, predictions, labels=None, classes_to_plot=None)
Expand All @@ -159,16 +157,16 @@ You can log this whenever your code has access to:
![](/images/app_ui/demo_average_precision_lines.png)


[See in the app](https://wandb.ai/wandb/plots/reports/Plot-Precision-Recall-Curves--VmlldzoyNjk1ODY)
[See in the app](https://wandb.ai/wandb/plots/reports/Plot-Precision-Recall-Curves--VmlldzoyNjk1ODY)

[Run the code](https://colab.research.google.com/drive/1mS8ogA3LcZWOXchfJoMrboW3opY1A8BY?usp=sharing)
[Run the code](https://colab.research.google.com/drive/1mS8ogA3LcZWOXchfJoMrboW3opY1A8BY?usp=sharing)

</TabItem>
<TabItem value="roc-curve">

`wandb.plot.roc_curve()`

Create an [ROC curve](https://scikit-learn.org/stable/modules/generated/sklearn.metrics.roc\_curve.html#sklearn.metrics.roc\_curve) in one line:
Create an [ROC curve](https://scikit-learn.org/stable/modules/generated/sklearn.metrics.roc_curve.html#sklearn.metrics.roc_curve) in one line:

```python
plot = wandb.plot.roc_curve(
Expand All @@ -187,9 +185,9 @@ You can log this whenever your code has access to:

![](/images/app_ui/demo_custom_chart_roc_curve.png)

[See in the app](https://wandb.ai/wandb/plots/reports/Plot-ROC-Curves--VmlldzoyNjk3MDE)
[See in the app](https://wandb.ai/wandb/plots/reports/Plot-ROC-Curves--VmlldzoyNjk3MDE)

[Run the code](https://colab.research.google.com/drive/1\_RMppCqsA8XInV\_jhJz32NCZG6Z5t1RO?usp=sharing)
[Run the code](https://colab.research.google.com/drive/1_RMppCqsA8XInV_jhJz32NCZG6Z5t1RO?usp=sharing)

</TabItem>
</Tabs>
Expand All @@ -214,7 +212,7 @@ my_custom_chart = wandb.plot_table(
)
```

[Run the code](https://tiny.cc/custom-charts)
[Run the code](https://tiny.cc/custom-charts)

![](/images/app_ui/custom_presets.png)

Expand All @@ -230,9 +228,9 @@ Here are the data types you can log from your script and use in a custom chart:

### How to log a custom table

Use `wandb.Table()` to log your data as a 2D array. Typically each row of this table represents one data point, and each column denotes the relevant fields/dimensions for each data point which you'd like to plot. As you configure a custom panel, the whole table will be accessible via the named key passed to `wandb.log()`("custom\_data\_table" below), and the individual fields will be accessible via the column names ("x", "y", and "z"). You can log tables at multiple time steps throughout your experiment. The maximum size of each table is 10,000 rows.
Use `wandb.Table()` to log your data as a 2D array. Typically each row of this table represents one data point, and each column denotes the relevant fields/dimensions for each data point which you'd like to plot. As you configure a custom panel, the whole table will be accessible via the named key passed to `wandb.log()`("custom_data_table" below), and the individual fields will be accessible via the column names ("x", "y", and "z"). You can log tables at multiple time steps throughout your experiment. The maximum size of each table is 10,000 rows.

[Try it in a Google Colab](https://tiny.cc/custom-charts)
[Try it in a Google Colab](https://tiny.cc/custom-charts)

```python
# Logging a custom table of data
Expand Down
Loading

0 comments on commit 35b510d

Please sign in to comment.