Skip to content

Commit

Permalink
Merge branch 'master' into renku-data-services-users-db
Browse files Browse the repository at this point in the history
  • Loading branch information
m-alisafaee authored Feb 8, 2024
2 parents d307bbc + 4f0ea8c commit 3935a2e
Show file tree
Hide file tree
Showing 37 changed files with 601 additions and 251 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/check-acceptance-test-code.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ jobs:
name: Scala dependencies and code check
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
- name: run test compile
run: |
cd acceptance-tests
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/check-acceptance-test-fmt.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ jobs:
name: Scala formatting check
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
- name: run scalafmt
run: |
cd acceptance-tests
Expand Down
12 changes: 7 additions & 5 deletions .github/workflows/create-release-branch.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ jobs:
create-release-pr:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3.6.0
- uses: actions/checkout@v4.1.1
with:
fetch-depth: 0
token: "${{ secrets.RENKUBOT_GITHUB_TOKEN }}"
Expand All @@ -42,9 +42,9 @@ jobs:
git commit -m "chore: create release ${{ github.event.inputs.version }}"
git push
- name: Create Pull Request
uses: actions/github-script@v6
uses: actions/github-script@v7
with:
token: ${{ secrets.RENKUBOT_GITHUB_TOKEN }}
github-token: ${{ secrets.RENKUBOT_GITHUB_TOKEN }}
script: |
const { repo, owner } = context.repo;
const result = await github.rest.pulls.create({
Expand All @@ -54,9 +54,11 @@ jobs:
head: 'release-${{ github.event.inputs.version }}',
base: '${{ github.event.inputs.target_branch }}',
body: [
'Release ${{ github.event.inputs.version }}',
'',
'This PR is auto-generated by [actions/github-script](https://github.com/actions/github-script).',
'',
'/deploy ',
'This PR is auto-generated by',
'[actions/github-script](https://github.com/actions/github-script).'
].join('\n')
});
github.rest.issues.addLabels({
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/cron-jobs.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ jobs:
runs-on: ubuntu-22.04
steps:
- name: renku teardown
uses: SwissDataScienceCenter/renku-actions/cleanup-renku-ci-deployments@v1.9.1
uses: SwissDataScienceCenter/renku-actions/cleanup-renku-ci-deployments@v1.10.0
env:
GITLAB_TOKEN: ${{ secrets.DEV_GITLAB_TOKEN }}
RENKUBOT_KUBECONFIG: ${{ secrets.RENKUBOT_DEV_KUBECONFIG }}
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/generate-values-script.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:
- os: macos-11
- os: ubuntu-20.04
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
with:
fetch-depth: 0
- uses: actions/setup-python@v5
Expand Down Expand Up @@ -49,7 +49,7 @@ jobs:
runs-on: ubuntu-20.04
needs: [test-script]
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
with:
fetch-depth: 0
- uses: Azure/docker-login@v1
Expand Down
8 changes: 4 additions & 4 deletions .github/workflows/publish-helm-chart.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,13 +9,13 @@ jobs:
publish-chart:
runs-on: ubuntu-20.04
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
with:
fetch-depth: 0
- name: Set version
id: vars
run: echo "tag=${GITHUB_REF#refs/*/}" >> $GITHUB_OUTPUT
- uses: SwissDataScienceCenter/renku-actions/publish-chart@v1.9.1
- uses: SwissDataScienceCenter/renku-actions/publish-chart@v1.10.0
env:
CHART_DIR: helm-chart/
CHART_NAME: renku
Expand Down Expand Up @@ -45,11 +45,11 @@ jobs:
needs:
- "publish-chart"
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
with:
fetch-depth: 0
- name: Rollout renku version
uses: SwissDataScienceCenter/renku-actions/rollout-renku-version@v1.9.1
uses: SwissDataScienceCenter/renku-actions/rollout-renku-version@v1.10.0
env:
CHART_VERSION: ${{ needs.publish-chart.outputs.chart-version }}
GITHUB_TOKEN: ${{ secrets.RENKUBOT_GITHUB_TOKEN }}
4 changes: 2 additions & 2 deletions .github/workflows/publish-master-merges.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ jobs:
publish-chart:
runs-on: ubuntu-20.04
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
with:
fetch-depth: 0
- uses: azure/setup-helm@v3
Expand All @@ -35,7 +35,7 @@ jobs:
- id: set-version
run: |
echo "publish_version=${{ steps.bump-semver.outputs.new_version }}.$(echo ${{ github.sha }} | cut -c 1-7)" >> $GITHUB_ENV
- uses: SwissDataScienceCenter/renku-actions/publish-chart@v1.9.1
- uses: SwissDataScienceCenter/renku-actions/publish-chart@v1.10.0
env:
CHART_DIR: helm-chart/
CHART_TAG: "--tag ${{env.publish_version}}"
Expand Down
44 changes: 23 additions & 21 deletions .github/workflows/pull-request-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,11 +18,11 @@ jobs:
if: github.event.action != 'closed'
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
- uses: actions/setup-java@v4
with:
distribution: 'temurin'
java-version: '17'
distribution: "temurin"
java-version: "17"
- uses: actions/setup-python@v5
with:
python-version: 3.9
Expand Down Expand Up @@ -60,9 +60,9 @@ jobs:
test-enabled: ${{ steps.deploy-comment.outputs.test-enabled}}
extra-values: ${{ steps.deploy-comment.outputs.extra-values}}
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
- id: deploy-comment
uses: SwissDataScienceCenter/renku-actions/check-pr-description@v1.9.1
uses: SwissDataScienceCenter/renku-actions/check-pr-description@v1.10.0
with:
string: /deploy
pr_ref: ${{ github.event.number }}
Expand All @@ -73,11 +73,12 @@ jobs:
runs-on: ubuntu-22.04
environment:
name: ci-renku-${{ github.event.number }}
url: https://ci-renku-${{ github.event.number }}.dev.renku.ch
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
- name: renku build and deploy
if: needs.check-deploy.outputs.pr-contains-string == 'true'
uses: SwissDataScienceCenter/renku-actions/deploy-renku@v1.9.1
uses: SwissDataScienceCenter/renku-actions/deploy-renku@v1.10.0
env:
DOCKER_PASSWORD: ${{ secrets.RENKU_DOCKER_PASSWORD }}
DOCKER_USERNAME: ${{ secrets.RENKU_DOCKER_USERNAME }}
Expand All @@ -99,15 +100,15 @@ jobs:
extra_values: "${{ needs.check-deploy.outputs.extra-values }}"
- name: Check existing renkubot comment
if: needs.check-deploy.outputs.pr-contains-string == 'true'
uses: peter-evans/find-comment@v2
uses: peter-evans/find-comment@v3
id: findcomment
with:
issue-number: ${{ github.event.pull_request.number }}
comment-author: "RenkuBot"
- name: Create comment pre deploy
if: ${{ steps.findcomment.outputs.comment-id == 0 &&
needs.check-deploy.outputs.pr-contains-string == 'true' }}
uses: peter-evans/create-or-update-comment@v3
uses: peter-evans/create-or-update-comment@v4
with:
token: ${{ secrets.RENKUBOT_GITHUB_TOKEN }}
issue-number: ${{ github.event.pull_request.number }}
Expand All @@ -119,7 +120,7 @@ jobs:
needs: [check-deploy, deploy-pr]
runs-on: ubuntu-22.04
steps:
- uses: SwissDataScienceCenter/renku-actions/test-renku@v1.9.1
- uses: SwissDataScienceCenter/renku-actions/test-renku@v1.10.0
with:
kubeconfig: ${{ secrets.RENKUBOT_DEV_KUBECONFIG }}
renku-release: ci-renku-${{ github.event.number }}
Expand All @@ -136,18 +137,19 @@ jobs:
fail-fast: false
max-parallel: 1
matrix:
tests: [
publicProject,
privateProject,
updateProjects,
testDatasets,
useSession,
checkWorkflows,
rstudioSession
]
tests:
[
publicProject,
privateProject,
updateProjects,
testDatasets,
useSession,
checkWorkflows,
rstudioSession,
]

steps:
- uses: SwissDataScienceCenter/renku-actions/test-renku-cypress@v1.9.1
- uses: SwissDataScienceCenter/renku-actions/test-renku-cypress@v1.10.0
if: github.event.action != 'closed' && needs.check-deploy.outputs.pr-contains-string == 'true' && needs.check-deploy.outputs.test-enabled == 'true'
with:
e2e-target: ${{ matrix.tests }}
Expand All @@ -160,7 +162,7 @@ jobs:
runs-on: ubuntu-22.04
steps:
- name: renku teardown
uses: SwissDataScienceCenter/renku-actions/cleanup-renku-ci-deployments@v1.9.1
uses: SwissDataScienceCenter/renku-actions/cleanup-renku-ci-deployments@v1.10.0
env:
HELM_RELEASE_REGEX: "^ci-renku-${{ github.event.number }}$"
GITLAB_TOKEN: ${{ secrets.DEV_GITLAB_TOKEN }}
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/renku-dev-test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ jobs:
github.event.client_payload.message == 'Helm test succeeded' }}
runs-on: ubuntu-20.04
steps:
- uses: SwissDataScienceCenter/renku-actions/test-renku@v1.9.1
- uses: SwissDataScienceCenter/renku-actions/test-renku@v1.10.0
with:
kubeconfig: ${{ secrets.RENKUBOT_DEV_KUBECONFIG }}
renku-release: renku
Expand All @@ -22,7 +22,7 @@ jobs:
github.event.client_payload.message == 'Helm test succeeded' }}
runs-on: ubuntu-20.04
steps:
- uses: actions/checkout@v4
- uses: actions/checkout@v4.1.1
- uses: cypress-io/github-action@v5
id: cypress
env:
Expand Down
94 changes: 89 additions & 5 deletions CHANGELOG.rst
Original file line number Diff line number Diff line change
@@ -1,5 +1,89 @@
.. _changelog:

0.47.1
------

This release only includes changes to the documentation and updates to the acceptance tests.
It doesn't bring any new features or bug fixes.

0.47.0
------

This release expands Renku's cloud storage functionality in two key ways: First, mounted storages
are now read **and write**, so you can use mounted storage as an active workspace for your data in a RenkuLab
session. Second, we have expanded the cloud storage services you can integrate with RenkuLab. You can now
mount not only S3 buckets, but also WebDAV-based storages and Azure Blobs.

If you use SSH sessions via the CLI, you can use cloud storage there too! Configure cloud storage for your
project on RenkuLab.io, and those storages will be mounted in your remote session. Support for cloud
storage in local Renku sessions is still on our roadmap.

This release also adds the ability to change which resource class your session uses when you unpause the
session, in case the original resource class is now full.

User-Facing Changes
~~~~~~~~~~~~~~~~~~~

**🌟 New Features**

- 🖋 **Notebooks,Data Services,CSI**: Support for read and write storage mounting in sessions using a new rclone based storage driver
(`#1707 <https://github.com/SwissDataScienceCenter/renku-notebooks/pull/1707>`_,
`#92 <https://github.com/SwissDataScienceCenter/renku-data-services/pull/92>`_,
`#1 <https://github.com/SwissDataScienceCenter/csi-rclone/pull/1>`_).
- 🔌 **UI**: add support for more storage services
(`#2908 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2908>`_,
`#2915 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2915>`_).

**✨ Improvements**

- 🖌️ **UI**: Improve the look and feel of the home page
(`#2968 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2968>`_,
`#2937 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2937>`_,
`#2927 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2927>`_).
- 🔐 **UI**: Use password fields for credentials
(`#2920 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2920>`_).
- 🔧 **UI**: Allow users to modify non running sessions
(`#2942 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2942>`_).
- 🛑 **UI**: Improve feedback when starting sessions on outdated projects
(`#2985 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2985>`_).
- 🖌️ **UI**: Update the Renku logo and Renku browser icons
(`#2848 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2848>`_).

**🐞 Bug Fixes**

- **UI**: Resize the feedback badge on the session settings page
(`#2953 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2953>`_).
- **UI**: Fix the environment dropdown on the Start session page
(`#2949 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2949>`_).
- **UI**: Improve string validation when trying to upload a dataset file by URL
(`#2834 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2834>`_).

Internal Changes
~~~~~~~~~~~~~~~~

**Improvements**

- **UI**: RenkuLab admins can now add tolerations and node affinities to resource classes
(`#2916 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2916>`_).
- **UI**: RenkuLab admins can add multiple users to a resource pool at once via a list of emails
(`#2910 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2910>`_).
- **UI**: Use the renku-core API for session options
(`#2947 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2947>`_).
- **UI**: Specify a branch every time a renku-core API is invoked
(`#2977 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2977>`_).

Individual Components
~~~~~~~~~~~~~~~~~~~~~

- `amalthea 0.11.0 <https://github.com/SwissDataScienceCenter/amalthea/releases/tag/0.11.0>`_
- `csi-rclone 0.1.5 <https://github.com/SwissDataScienceCenter/csi-rclone/releases/tag/v0.1.5>`_
- `renku-data-services 0.4.0 <https://github.com/SwissDataScienceCenter/renku-data-services/releases/tag/v0.4.0>`_
- `renku-notebooks 1.21.0 <https://github.com/SwissDataScienceCenter/renku-notebooks/releases/tag/1.21.0>`_
- `renku-ui 3.18.0 <https://github.com/SwissDataScienceCenter/renku-ui/releases/tag/3.18.0>`_
- `renku-ui 3.18.1 <https://github.com/SwissDataScienceCenter/renku-ui/releases/tag/3.18.1>`_
- `renku-ui 3.19.0 <https://github.com/SwissDataScienceCenter/renku-ui/releases/tag/3.19.0>`_


0.46.0
------

Expand All @@ -13,7 +97,7 @@ User-Facing Changes
- **UI**: Improve feedback when starting sessions on outdated projects
(`#2985 <https://github.com/SwissDataScienceCenter/renku-ui/pull/2985>`_).
- **CLI**: Allow specifying storage to mount when launching Renkulab sessions from the CLI
(`#3629 <https://github.com/SwissDataScienceCenter/renku-python/pull/3629>_`).
(`#3629 <https://github.com/SwissDataScienceCenter/renku-python/pull/3629>`_).
- **KG**: Remove the Free-Text Dataset Search API as improved functionality is offered by the Entities Search.
(`#1833 <https://github.com/SwissDataScienceCenter/renku-graph/pull/1833>`_).
- **KG**: Add support for specifying ``templateRef`` and ``templateParameters`` on the Project Create API.
Expand All @@ -25,7 +109,7 @@ User-Facing Changes
(`#3687 <https://github.com/SwissDataScienceCenter/renku-python/pull/3687>`_).

Internal Changes
----------------
~~~~~~~~~~~~~~~~

**✨ Improvements**

Expand All @@ -45,13 +129,13 @@ Individual Components
------

User-Facing Changes
-------------------
~~~~~~~~~~~~~~~~~~~

- **Core Service**: Removed support for metadata v9 projects in the UI. Migration to v10 is now required.
- **Core Service**: Fixed a bug where projects weren't cloned shallowly, leading to large projects not working properly on the platform.

Internal Changes
----------------
~~~~~~~~~~~~~~~~

**🐞 Bug Fixes**

Expand All @@ -78,7 +162,7 @@ are paused and resumed which caused resumed session to not be able to push to Gi
or also it caused some sessions to not be able to resume after they have been paused.

Internal Changes
----------------
~~~~~~~~~~~~~~~~

**🐞 Bug Fixes**

Expand Down
3 changes: 2 additions & 1 deletion RELEASE.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,8 +12,9 @@ This procedure should be followed for *any* release:

* Create a release branch (e.g. `0.46.x`), if one does not already exist, with the [release action](https://github.com/SwissDataScienceCenter/renku/actions/workflows/create-release-branch.yml).
* Create a `CHANGELOG` entry for the release and open a PR; create a deployment, this is the reference for the release.
* Note that any PR that should go into the release needs to target the release branch _not_ `master`.
* Note that any PR that should go into the release needs to target the release branch _not_ `master`.
* All release branches should be protected.
* Use the "Rebase and Merge" button to merge release branches into `master`; do not squash commits.

Acceptance tests have to pass on all release branches before merging.

Expand Down
Loading

0 comments on commit 3935a2e

Please sign in to comment.