initial cloud docs for data sources, knowledge bases, and structures

docs/griptape-cloud/data-sources/create-data-source.md

@@ -0,0 +1,27 @@
+# Data Sources
+
+Data Sources are the first step to Griptape's RAG pipeline. They allow you to bring your own data to ingest and transform. You can then make one or more Data Source available to your AI applications via [Knowledge Bases](../knowledge-bases/create-knowledge-base.md)
+
+## Create a Data Source
+
+You can [create a Data Source in the Griptape Cloud console](https://cloud.griptape.ai/data-sources/create) by specifying the required configuration for your chosen Data Source in the cloud console.
+
+### Web Page
+
+You can scrape and ingest a single, public web page by providing a URL. If you wish to scrape multiple pages, you must create multiple Data Sources. However, you can then add all of the pages to the same Knowledge Base if you wish to access all the pages together.
+
+### Google Drive
+
+You can ingest documents and spreadsheets stored in a Google Drive account. We support all standard file formats such as text, markdown, spreadsheets, and presentations.
+
+### Confluence
+
+You can connect to your personal or company Confluence by providing a URL, [Atlassian API Token](https://id.atlassian.com/manage-profile/security/api-tokens), and the email address for the token holder's account. Each Confluence Data Source can be limited to a single Space in Confluence by specifying the [specific URL for that Space](https://support.atlassian.com/confluence-cloud/docs/use-spaces-to-organize-your-work/).
+
+### Structure (Experimental)
+
+You can specify a [Structure](../structures/create-structure.md) to run as a Data Source as long as your Structure returns a [`TextArtifact` or `ListArtifact` from the Griptape Framework](../../griptape-framework/data/artifacts.md). You can use this as a way to build custom Data Sources.
+
+## Other Data Source Types
+
+If you do not see a Data Source configuration you'd wish to use, you can submit a request via [Discord](https://discord.gg/gnWRz88eym) or `[email protected]`.

docs/griptape-cloud/data-sources/refresh-data.md

@@ -0,0 +1,17 @@
+# Refresh a Data Source
+
+## Scheduled Refresh
+
+By default your Data Source will not refresh automatically. When creating a Data Source, you can enable scheduled refresh and specify a [CRON expression](https://crontab.guru/). For example, if you wish your Data Source to refresh every day at midnight PDT you can use the following expression: `0 7 * * *`.
+
+## Manual Refresh
+
+If you wish to manually refresh a Data Source you can do so either via the `Refresh` button in the cloud console or by API using the `Data Source ID` on the `Config` tab and a [Griptape Cloud API Key](https://cloud.griptape.ai/configuration/api-keys).
+
+The following shell commands will create a new data refresh job. You will need to specify your API key and data source id.
+
+```shell
+export GT_CLOUD_API_KEY=<your API key here>
+export DATA_SOURCE_ID=<your data source id here>
+curl -H "Authorization: Bearer ${GT_CLOUD_API_KEY}" --json '{}' https://cloud.griptape.ai/api/data-connectors/${DATA_SOURCE_ID}/data-jobs
+```

docs/griptape-cloud/index.md

@@ -1,5 +1,12 @@
 # Griptape Cloud
 
-Griptape Cloud provides managed services for your AI app stack. Deploy and scale end-to-end solutions, from LLM-powered data prep and retrieval to AI agents, pipelines and workflows.
+[Griptape Cloud](https://cloud.griptape.ai/) provides managed services for your AI app stack. Deploy and scale end-to-end solutions, from LLM-powered data prep and retrieval to AI Agents, Pipelines, and Workflows.
 
-To get started with AI Structures in the Cloud, check out the [managed-structure-template](https://github.com/griptape-ai/managed-structure-template) or deploy one of the [griptape-sample-structures](https://github.com/griptape-ai/griptape-sample-structures/tree/main).
+## Build Your Own RAG Pipeline
+Connect to your data with our [Data Sources](data-sources/create-data-source.md) and prepare them for retrieval with [Knowledge Bases](knowledge-bases/create-knowledge-base.md).
+
+## Host and Run Your Code
+Have Griptape code? Have existing code with another LLM framework? You can host your Python code using [Structures](structures/create-structure.md) whether it uses the Griptape Framework or not.
+
+## APIs
+All of our features can be called via API with a [Griptape Cloud API Key](https://cloud.griptape.ai/configuration/api-keys). See the [API Reference](api/api-reference.md) for detailed information.

docs/griptape-cloud/knowledge-bases/accessing-data.md

@@ -0,0 +1,33 @@
+# Accessing Data in a Knowledge Base
+
+You can `Search` or `Query` the Knowledge Base for information contained in your Data Sources. `Search` will return a natural language response while `Query` will return the individual entries. Use whichever one best fits your use case.
+
+## From the Cloud Console
+
+You can explore your data with a natural language question on the `Test` tab of your Knowledge Base. Compare and contrast the results of `Search` vs. `Query` to understand which is correct for your application.
+
+## From the API
+
+You can enact both `Search` and `Query` via the API by hitting their respective endpoints using a [Griptape Cloud API Key](https://cloud.griptape.ai/configuration/api-keys) and the Knowledge Base ID found on the `Config` tab of your Knowledge Base. 
+
+The following example commands will send the string `"test question"` and return the results from the Knowledge Base.
+
+### Search
+
+```shell
+export GT_CLOUD_API_KEY=<your API key here>
+export KNOWLEDGE_BASE_ID=<your knowledge base id here>
+curl -H "Authorization: Bearer ${GT_CLOUD_API_KEY}" --json '{"query": "test question"}' https://cloud.griptape.ai/api/knowledge-bases/${KNOWLEDGE_BASE_ID}/search
+```
+
+### Query
+
+```shell
+export GT_CLOUD_API_KEY=<your API key here>
+export KNOWLEDGE_BASE_ID=<your knowledge base id here>
+curl -H "Authorization: Bearer ${GT_CLOUD_API_KEY}" --json '{"query": "test question"}' https://cloud.griptape.ai/api/knowledge-bases/${KNOWLEDGE_BASE_ID}/query
+```
+
+## Using the Griptape Framework
+
+You can use the [GriptapeCloudKnowledgeBaseVectorStoreDriver](../../griptape-framework/drivers/vector-store-drivers.md/#griptape-cloud-knowledge-base) to query your Knowledge Base with Griptape and the [GriptapeCloudKnowledgeBaseTool](../../griptape-tools/official-tools/griptape-cloud-knowledge-base-tool.md) to search.

docs/griptape-cloud/knowledge-bases/create-knowledge-base.md

@@ -0,0 +1,7 @@
+# Knowledge Bases
+
+Knowledge Bases are the way to organize and access your data ingested from [Data Sources](../data-sources/create-data-source.md). You can specify multiple Data Sources per Knowledge Base in order to access data ingested from different sources all in one place.
+
+## Create a Knowledge Base
+
+You can [create a Knowledge Base in the Griptape Cloud console](https://cloud.griptape.ai/knowledge-bases/create) by specifying which Data Sources you wish to include. Once created, you can [access your data](accessing-data.md).

docs/griptape-cloud/structures/create-structure.md

@@ -0,0 +1,17 @@
+# Structures
+
+Structures are a primary component in Griptape for organizing and executing Tasks against a LLM.
+
+## Create a Structure
+
+1. [Connect Your GitHub Account in your Griptape Cloud account](https://cloud.griptape.ai/account)
+1. Install the [Griptape Cloud GitHub app to your GitHub account or organization](https://github.com/apps/griptape-cloud/installations/new/)
+    - Be sure to allow the app access to `All Repositories` or select the specific repositories you need
+1. Ensure your repository has a Structure Config YAML file
+    - To learn more see [Structure Config YAML](structure-config.md)
+
+You can now [create a Structure in the Griptape Cloud console](https://cloud.griptape.ai/structures/create) by providing your GitHub repository information.
+
+### Quickstart With Samples and Templates
+
+To get started with Structures in the Cloud, check out the [managed-structure-template on GitHub](https://github.com/griptape-ai/managed-structure-template) or deploy one of the [griptape-sample-structures from GitHub](https://github.com/griptape-ai/griptape-sample-structures/tree/main).

docs/griptape-cloud/structures/run-structure.md

@@ -0,0 +1,32 @@
+# Running a Structure
+
+Once your Structure is created and deployed, you can run your Structure one of three ways outlined below. You view the output of any of your runs, no matter how you created them, in the `Runs` tab of your Structure.
+
+## From the Cloud Console
+
+In the cloud console, click on the name of the Structure you wish to run and then go to the `Test` tab. Here you can specify arguments to pass to your Structure run and any run-specific environment variables you need.
+
+When passing arguments through the cloud console, pass each new argument on a new line. For example if your local code is ran with the inputs `-i input_file.txt` then the arguments you would pass in the cloud would be:
+
+```
+-i
+input_file.txt
+```
+
+## From the API
+
+You can run your Structure via the API using CURL or any other code that can make HTTP requests. You will need a [Griptape Cloud API Key](https://cloud.griptape.ai/configuration/api-keys) and the `Structure Invocation URL` which is located on the `Config` tab of your Structure. 
+
+The example below will kick off a run with the args you pass as a json object.
+
+```shell
+export GT_CLOUD_API_KEY=<your API key here>
+export INVOCATION_URL=<your structure invocation URL>
+curl -H "Authorization: Bearer ${GT_CLOUD_API_KEY}" --json '{"args": ["arg1"], ""env_vars"": [{"name":"var1", "value": "value"}]}' ${INVOCATION_URL}
+```
+
+For more information on other Structure run APIs, check out the [StructureRuns API docs](../api/api-reference.md/#/StructureRuns).
+
+## Using the Griptape Framework
+
+You can use [StructureRunDrivers](../../griptape-framework/drivers/structure-run-drivers.md/#griptape-cloud) to run your Structure with Griptape.

docs/index.md

@@ -8,7 +8,7 @@ Griptape Topic Guides discuss key topics at a high level and provide useful back
 
 ### Griptape Cloud
 
-[Griptape Cloud](griptape-cloud/api/api-reference.md) provides an overview of the APIs available in the managed cloud service. 
+[Griptape Cloud](griptape-cloud/index.md) provides an overview of the features in Griptape's cloud offering.
 
 ### Griptape Framework
 

mkdocs.yml

@@ -77,10 +77,18 @@ nav:
       - Contributing: "contributing.md"
   - Cloud:
       - Overview: "griptape-cloud/index.md"
+      - Data Sources:
+          - Create a Data Source: "griptape-cloud/data-sources/create-data-source.md"
+          - Refreshing Your Data: "griptape-cloud/data-sources/refresh-data.md"
+      - Knowledge Bases:
+          - Create a Knowledge Base: "griptape-cloud/knowledge-bases/create-knowledge-base.md"
+          - Accessing Your Data: "griptape-cloud/knowledge-bases/accessing-data.md"
+      - Structures:
+          - Create a Structure: "griptape-cloud/structures/create-structure.md"
+          - Structure Config YAML: "griptape-cloud/structures/structure-config.md"
+          - Running Your Structure: "griptape-cloud/structures/run-structure.md"
       - Cloud API:
           - API Reference: "griptape-cloud/api/api-reference.md"
-      - Structures:
-          - Structure Config: "griptape-cloud/structures/structure-config.md"
   - Framework:
       - Overview: "griptape-framework/index.md"
       - Structures: