Skip to content

Commit

Permalink
Merge branch 'main' into main
Browse files Browse the repository at this point in the history
  • Loading branch information
holtskinner authored Jan 27, 2025
2 parents d46fccb + 8580052 commit 8eb202b
Show file tree
Hide file tree
Showing 11 changed files with 476 additions and 914 deletions.
84 changes: 4 additions & 80 deletions .github/actions/spelling/allow.txt

Large diffs are not rendered by default.

6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ For more Vertex AI samples, please visit the [Vertex AI samples GitHub repositor
<br>
<a href="search/"><code>search/</code></a>
</td>
<td>Use this folder if you're interested in using <a href="https://cloud.google.com/enterprise-search">Vertex AI Search</a>, a Google-managed solution to help you rapidly build search engines for websites and across enterprise data. (Formerly known as Enterprise Search on Generative AI App Builder)</td>
<td>Use this folder if you're interested in using <a href="https://cloud.google.com/enterprise-search">Vertex AI Search</a>, a Google-managed solution to help you rapidly build search engines for websites and across enterprise data. (Formerly known as Enterprise Search on Generative AI App Builder).</td>
</tr>
<tr>
<td>
Expand All @@ -63,7 +63,7 @@ For more Vertex AI samples, please visit the [Vertex AI samples GitHub repositor
<br>
<a href="conversation/"><code>conversation/</code></a>
</td>
<td>Use this folder if you're interested in using <a href="https://cloud.google.com/generative-ai-app-builder">Vertex AI Conversation</a>, a Google-managed solution to help you rapidly build chat bots for websites and across enterprise data. (Formerly known as Chat Apps on Generative AI App Builder)</td>
<td>Use this folder if you're interested in using <a href="https://cloud.google.com/generative-ai-app-builder">Vertex AI Conversation</a>, a Google-managed solution to help you rapidly build chat bots for websites and across enterprise data. (Formerly known as Chat Apps on Generative AI App Builder).</td>
</tr>
<tr>
<td>
Expand Down Expand Up @@ -116,7 +116,7 @@ For more Vertex AI samples, please visit the [Vertex AI samples GitHub repositor
<br>
<a href="RESOURCES.md"><code>RESOURCES.md</code></a>
</td>
<td>Learning resources (e.g. blogs, YouTube playlists) about Generative AI on Google Cloud</td>
<td>Learning resources (e.g. blogs, YouTube playlists) about Generative AI on Google Cloud.</td>
</tr>
</table>
<!-- markdownlint-enable MD033 -->
Expand Down
6 changes: 3 additions & 3 deletions embeddings/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,14 +16,14 @@ This repository explores various techniques and use-cases for embedding in Machi

## Notebooks

- **[generate-embs-for-vvs.ipynb](generate-embs-for-vvs.ipynb):** Demonstrates large-scale embeddings generation for Vertex AI Vector Search.
- **[vector-search-quickstart.ipynb](vector-search-quickstart.ipynb):** Offers a quickstart guide to setting up and using vector search for finding semantically similar items.
- **[intro-textemb-vectorsearch.ipynb](intro-textemb-vectorsearch.ipynb):** Provides an introduction to text embeddings and their application in building vector search engines.
- **[hybrid-search.ipynb](hybrid-search.ipynb):** Demonstrates building a hybrid search system leveraging both keyword-based search and semantic similarity search with embeddings.
- **[embedding-similarity-visualization.ipynb](embedding-similarity-visualization.ipynb):** Visualizes similarity relationships between embeddings using dimensionality reduction techniques like PCA and t-SNE.
- **[intro-textemb-vectorsearch.ipynb](intro-textemb-vectorsearch.ipynb):** Provides an introduction to text embeddings and their application in building vector search engines.
- **[vector-search-quickstart.ipynb](vector-search-quickstart.ipynb):** Offers a quickstart guide to setting up and using vector search for finding semantically similar items.
- **[intro_multimodal_embeddings.ipynb](intro_multimodal_embeddings.ipynb):** Introduces the concept of multimodal embeddings, which combine information from different modalities like text and images.
- **[intro_embeddings_tuning.ipynb](intro_embeddings_tuning.ipynb):** Explores techniques for fine-tuning pre-trained embedding models to specific domains and tasks.
- **[task-type-embedding.ipynb](task-type-embedding.ipynb):** Explores techniques for creating embeddings specialized for different tasks.
- **[large-embs-generation-for-vvs.ipynb](large-embs-generation-for-vvs.ipynb):** Demonstrates large-scale embeddings generation for Vertex AI Vector Search.

## Use Cases

Expand Down
11 changes: 11 additions & 0 deletions embeddings/large-embs-generation-for-vvs.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -740,6 +740,17 @@
"print(f\"\\nCreated text embeddings on folder: gs://{GCS_BUCKET}/{GCS_TEXT_EMB_PATH}\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "306cc4861fc7"
},
"source": [
"### Tips for a long running job\n",
"\n",
"If you run the code for a long time, you might occasionally lose the connection between your browser and the runtime, making it difficult to track the job's progress. For these long-running jobs, you should convert this notebook to a `.py` file and run it as a Python process using the `nohup` command."
]
},
{
"cell_type": "markdown",
"metadata": {
Expand Down
Loading

0 comments on commit 8eb202b

Please sign in to comment.