Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update integration test #210

Closed
wants to merge 5 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 14 additions & 3 deletions .github/workflows/k8s-snap-integration.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,15 +15,15 @@ concurrency:
jobs:
build:
name: K8s-snap Integration Test
runs-on: ubuntu-20.04
runs-on: self-hosted-linux-amd64-jammy-large

steps:
- name: Checking out repo
uses: actions/checkout@v4
- name: Setup Python
uses: actions/setup-python@v5
with:
python-version: "3.8"
python-version: "3.10"
- name: Install tox
run: pip install tox
- name: Install Go
Expand All @@ -39,6 +39,13 @@ jobs:
sudo lxd init --auto
sudo usermod --append --groups lxd $USER
sg lxd -c 'lxc version'
# Docker sets iptables rules that interfere with LXD.
# https://documentation.ubuntu.com/lxd/en/latest/howto/network_bridge_firewalld/#prevent-connectivity-issues-with-lxd-and-docker
- name: Apply Docker iptables workaround
shell: bash
run: |
sudo iptables -I DOCKER-USER -i lxdbr0 -j ACCEPT
sudo iptables -I DOCKER-USER -o lxdbr0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT
- name: Build k8s-dqlite
run: |
make static
Expand All @@ -58,9 +65,13 @@ jobs:
TEST_SUBSTRATE: lxd
TEST_LXD_IMAGE: ubuntu:22.04
TEST_INSPECTION_REPORTS_DIR: ${{ github.workspace }}/inspection-reports
# Test the latest (up to) 6 releases for the flavour
TEST_VERSION_UPGRADE_CHANNELS: "recent 6 classic"
# Upgrading from 1.30 is not supported.
TEST_VERSION_UPGRADE_MIN_RELEASE: "1.31"
run: |
git clone https://github.com/canonical/k8s-snap.git
cd k8s-snap/tests/integration && sg lxd -c 'tox -e integration'
cd k8s-snap/tests/integration && sg lxd -c 'tox -e integration -- --tags up_to_nightly'
- name: Prepare inspection reports
if: failure()
run: |
Expand Down
15 changes: 8 additions & 7 deletions .github/workflows/performance.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ env:
jobs:
build:
name: K8s-snap Performance Test
runs-on: ubuntu-20.04
runs-on: self-hosted-linux-amd64-jammy-large
steps:
- name: Harden Runner
uses: step-security/harden-runner@v2
Expand All @@ -42,20 +42,21 @@ jobs:
go-version: "1.22"
- name: Set-up R
run: |
sudo apt install r-base
sudo apt-get install r-base -y
sudo Rscript -e 'install.packages(c("ggplot2", "dplyr", "optparse"), repos="https://cloud.r-project.org")'
- name: Install lxd
run: |
sudo snap refresh lxd --channel 5.21/stable
sudo lxd init --auto
sudo usermod --append --groups lxd $USER
sg lxd -c 'lxc version'
- name: Ensure lxd network traffic flows by removing docker if installed
# Docker sets iptables rules that interfere with LXD.
# https://documentation.ubuntu.com/lxd/en/latest/howto/network_bridge_firewalld/#prevent-connectivity-issues-with-lxd-and-docker
- name: Apply Docker iptables workaround
shell: bash
run: |
if command -v docker >/dev/null 2>&1; then
echo "Docker is installed, purging it"
sudo apt-get purge -y docker-engine docker docker.io docker-ce docker-ce-cli containerd runc
fi
sudo iptables -I DOCKER-USER -i lxdbr0 -j ACCEPT
sudo iptables -I DOCKER-USER -o lxdbr0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT
- name: Download latest k8s-snap
run: |
sudo snap download k8s --channel=latest/edge --basename k8s
Expand Down
79 changes: 79 additions & 0 deletions pkg/kine/server/mett.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,79 @@


- initial brainstorm workshop

OPEA 30 minutes intro, micro services spin up agents show architecture.

graph, databases

afterwards canonical part of the workshop

having the deployment on microk8s,
neo4j, vanilla example but extend it to the edge

infrastructure provided no problem


90 minutes

30/40 minutes


environment, instructions, EKS,


cloud nighttag intel developer cloud
ipcs there
aipc

access to the environment

idc account


hardware: aipc

nvidia gpu
gaudi

run RAG with opensearch

cpu only with gpu its fast without its slow like 1minute per response


run RAG architecture


access gpu

pvcs or gaudis checking what arch we have

run RAG on gaudi accelerator

on cloud they dont have nvidia

what generation zion

24.04 ubuntu 16 cores 1 soket

aipc, gpu
training on dater center on the edge

probably nothing on gaudi more on zion


share overall architecture

chatqnA

opensearch,

graph rag deployed in our environment


OPEA - OpenPlatform for Enterprise AI (linux foundation project)
--> RAG - Retrieval Augmented Generation

ChatQnA - Chat Question and Answer bot


Loading