From 40800b08480ddfdc588101087164e0747d59f0de Mon Sep 17 00:00:00 2001 From: Louie Tsai Date: Mon, 14 Oct 2024 20:00:14 -0700 Subject: [PATCH] Update MultiModal README.md for workflow (#905) Signed-off-by: Tsai, Louie --- MultimodalQnA/README.md | 51 +++++++++++++++-------------------------- 1 file changed, 19 insertions(+), 32 deletions(-) diff --git a/MultimodalQnA/README.md b/MultimodalQnA/README.md index 0224550421..95626aa78e 100644 --- a/MultimodalQnA/README.md +++ b/MultimodalQnA/README.md @@ -14,12 +14,11 @@ MultimodalQnA is implemented on top of [GenAIComps](https://github.com/opea-proj --- config: flowchart: - nodeSpacing: 100 + nodeSpacing: 400 rankSpacing: 100 curve: linear - theme: base themeVariables: - fontSize: 42px + fontSize: 50px --- flowchart LR %% Colors %% @@ -35,57 +34,45 @@ flowchart LR RET([Retrieval
]):::blue LVM([LVM
]):::blue end - subgraph User Interface - direction TB + subgraph UserInterface[" User Interface "] + direction LR a([User Input Query]):::orchid Ingest([Ingest data]):::orchid UI([UI server
]):::orchid end - subgraph MultimodalQnA GateWay - direction LR - invisible1[ ]:::invisible - GW([MultimodalQnA GateWay
]):::orange - end - subgraph . - X([OPEA Microservice]):::blue - Y{{Open Source Service}} - Z([OPEA Gateway]):::orange - Z1([UI]):::orchid - end TEI_EM{{Embedding service
}} VDB{{Vector DB

}} R_RET{{Retriever service
}} DP([Data Preparation
]):::blue LVM_gen{{LVM Service
}} + GW([MultimodalQnA GateWay
]):::orange %% Data Preparation flow %% Ingest data flow direction LR - Ingest[Ingest data] -->|a| UI - UI -->|b| DP - DP <-.->|c| TEI_EM + Ingest[Ingest data] --> UI + UI -->DP + DP <-.-> TEI_EM %% Questions interaction direction LR - a[User Input Query] -->|1| UI - UI -->|2| GW - GW <==>|3| MultimodalQnA-MegaService - EM ==>|4| RET - RET ==>|5| LVM - + a[User Input Query] --> UI + UI --> GW + GW <==> MultimodalQnA-MegaService + EM ==> RET + RET ==> LVM %% Embedding service flow - direction TB - EM <-.->|3'| TEI_EM - RET <-.->|4'| R_RET - LVM <-.->|5'| LVM_gen + direction LR + EM <-.-> TEI_EM + RET <-.-> R_RET + LVM <-.-> LVM_gen direction TB %% Vector DB interaction - R_RET <-.->|d|VDB - DP <-.->|e|VDB - + R_RET <-.->VDB + DP <-.->VDB