Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add validation results comment bot #63

Merged
merged 4 commits into from
Feb 29, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 13 additions & 2 deletions .github/workflows/dea-intertidal-image.yml
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,9 @@ on:
types: [created, edited, published]

permissions:
id-token: write # This is required for requesting the JWT
contents: write # This is required for actions/checkout
id-token: write # Required for requesting Json web token
contents: write # Required for actions/checkout
pull-requests: write # Required for validation results comment bot

jobs:
test:
Expand Down Expand Up @@ -117,6 +118,16 @@ jobs:
commit_message: Automatically update integration test validation results
file_pattern: 'tests/validation.jpg tests/validation.csv tests/README.md'

# Post validation tesults as comment on PR
- name: Post validation results as comment
uses: mshick/add-pr-comment@v2
if: github.event_name == 'pull_request'
with:
message: |
![](https://github.com/GeoscienceAustralia/dea-intertidal/blob/${{ github.head_ref }}/tests/validation.jpg?raw=true")

For full integration test results, refer to the [Tests directory README](https://github.com/GeoscienceAustralia/dea-intertidal/tree/${{ github.head_ref }}/tests).

- name: Upload coverage reports to Codecov
uses: codecov/codecov-action@v3
env:
Expand Down
2 changes: 1 addition & 1 deletion tests/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ Integration tests

This directory contains tests that are run to verify that DEA Intertidal code runs correctly. The ``test_intertidal.py`` file runs a small-scale full workflow analysis over an intertidal flat in the Gulf of Carpentaria using the DEA Intertidal [Command Line Interface (CLI) tools](../notebooks/Intertidal_CLI.ipynb), and compares these results against a LiDAR validation DEM to produce some simple accuracy metrics.

The latest integration test completed at **2024-02-29 13:20**. Compared to the previous run, it had an:
The latest integration test completed at **2024-02-29 14:34**. Compared to the previous run, it had an:
- RMSE accuracy of **0.14 m ( :heavy_minus_sign: no change)**
- MAE accuracy of **0.12 m ( :heavy_minus_sign: no change)**
- Bias of **0.12 m ( :heavy_minus_sign: no change)**
Expand Down
2 changes: 2 additions & 0 deletions tests/validation.csv
Original file line number Diff line number Diff line change
Expand Up @@ -28,3 +28,5 @@ time,Correlation,RMSE,MAE,R-squared,Bias,Regression slope
2024-02-28 06:23:49.629097+00:00,0.976,0.141,0.121,0.952,0.117,1.109
2024-02-29 01:15:19.760601+00:00,0.976,0.141,0.121,0.952,0.117,1.109
2024-02-29 02:20:40.647169+00:00,0.976,0.141,0.121,0.952,0.117,1.109
2024-02-29 03:11:40.503223+00:00,0.976,0.141,0.121,0.952,0.117,1.109
2024-02-29 03:34:20.070327+00:00,0.976,0.141,0.121,0.952,0.117,1.109
Binary file modified tests/validation.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.