Skip to content

Commit

Permalink
progress meeting
Browse files Browse the repository at this point in the history
  • Loading branch information
pat-alt committed Oct 31, 2023
1 parent 405a981 commit 8d8fea9
Show file tree
Hide file tree
Showing 4 changed files with 157 additions and 0 deletions.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
11 changes: 11 additions & 0 deletions content/talks/posts/2023-progress/index.qmd
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
---
title: Progress meeting PhD
subtitle: Trustworthy AI
description: >-
Slides for my presentation at JuliaCon 2023.
image: www/delft_logo.png
date: 2023-10-31
draft: true
---

[Slides](presentation.qmd) for my PhD progress meeting in November 2023.
146 changes: 146 additions & 0 deletions content/talks/posts/2023-progress/presentation.qmd
Original file line number Diff line number Diff line change
@@ -0,0 +1,146 @@
---
title: "2nd Year Progress Meeting"
subtitle: PhD in Trustworthy AI
author:
- name: "Patrick Altmeyer"
url: https://www.paltmeyer.com/
institute: Delft University of Technology
date: today
date-format: long
format:
julia-revealjs:
theme: custom.scss
self-contained: true
smaller: false
scrollable: true
preview-links: auto
slide-number: true
transition: slide
background-transition: fade
fig-align: center
html-math-method: mathjax
include-in-header:
- text: |
<script>
MathJax = {
options: {
menuOptions: {
settings: {
assistiveMml: false
}
}
}
};
</script>
revealjs-plugins:
- pointer
crossref:
prp-title: RQ
prp-prefix: RQ
---

## Agenda

1. Stocktaking
2. Reflection on the past year
3. Next steps

# Stocktaking

## Papers {.smaller}

- 1 paper published and presented (SaTML: [*Ch2*]), 1 published in proceedings (JuliaCon: [*Ch1.1*])
- 1 paper submitted (ECCCo: [*Ch3*])
- 1 paper in preparation (`LaplaceRedux.jl`: [*Ch1.2*]), 1 about to start (`ConformalPrediction.jl` [*Ch1.3*])
- 1 paper co-authored (Conformal Intent Recognition)

## Open Source and Science {.smaller}

- 2 new Julia packages published: `ConformalPrediction.jl` and `JointEnergyModels.jl`.
- Major updates to `CounterfactualExplanations.jl` and `LaplaceRedux.jl`.
- First steps towards a unified ecosystem for Trustworthy AI in Julia: `Taija.jl`.
- Published 7 blog posts.
- Some work on Quarto extensions.

## Talks

A total of 8 talks:

- Companies (3): DSCC (ING), Bank of England, Verbond van Verzekeraars
- Software community (2): Julia Eindhoven, JuliaCon
- Academia (3): SaTML, ICT.Open (demo), Mondai

## Graduate School

- Summer School in Barcelona (5 ECTS: *discipline*)
- Software project (2nd year BSc): `CounterfactualExplanations.jl` (2 ECTS: *research*)
- Software project (2nd year BSc): `LaplaceRedux.jl` (2 ECTS: *research*)
- SaTML and JuliaCon (4 ECTS: *research*)

## Other

- 1st Price at ING Experiment Week
- 2nd Price at JuliaCon 2023 Pluto Notebook Competition
- First person at TU Delft to do serious work in Julia on a HPC cluster (as far as I know).

# Reflection

## What went well?

- Very happy with the progress on the open-source projects.
- Generally also happy with the progress on the papers.
- Research ideas are becoming more refined and interesting.
- I am enjoying the work and the people I am working with.

## What could have gone better? {.smaller}

- I am struggling with the balance between research and open-source.
- I have come to realise that writing truly solid technical papers takes more time than I thought.
- Camera-ready version of SaTML paper took about 1 month.
- ECCCo took about 2-3 additional months of work after initial submission.
- At times, seriously overwhelmed, to the extent that I was genuinely concerned about my mental health for the first time in my life.
- Nobody's fault if not my own, but not going back to that place again.

## What did I learn?

- You can't have it all.
- I need to be more selective about what I work on.
- I need to be more realistic about what I can achieve.

# Next Steps

## Ongoing Papers

- ECCCo [*Ch3*]: only minor revisions left.
- Conformal Prediction [*Ch1.3*]: start writing.
- LaplaceRedux [*Ch1.2*]: turn into full paper.

## Planned Papers {.smaller}

- 3rd research paper [*Ch4*]: *What makes models explainable?*
- Involve students (ECCCo for trees and model-agnostic).
- Candidate venues: NeuRIPS Datasets and Benchmarks (2024/2025), journal paper.
- 4th research paper [*Ch5*]:
1. *The Cost of Unfaithful Model Explanations*: agent-based simulation of the impact of unfaithful model explanations on human decision-making.
2. *Causal ECCCo*: combining ECCCo with Causal Abstraction.

## Open Source

- Maybe: Lightening talk on `JointEnergyModels.jl` at JuliaCon 2024 [*Ch1.4*].
- Then: "`Taija.jl` 4 years" later at JuliaCon 2025.

## Time Management {.smaller}

- I think it is feasible to have the following papers in (near-) final form by the end of year 3: ECCCo [*Ch3*], LaplaceRedux [*Ch1.2*], Conformal Prediction [*Ch1.3*], 3rd research paper [*Ch4*].
- At that point, we are looking at a comprehensive thesis: 3 software papers forming the extended introduction and 3 research papers forming the core.
- 4th year can then be used to:
- Collate chapters (thesis).
- Write paper on `JointEnergyModels.jl` [potentially *Ch1.4*].
- Tackle the 4th research paper without pressure to get it published in time [potentially *Ch5*].
- Ensure `Taija.jl` is in a good state.
- Job hunting.
- Google Summer of Code?
- Teaching?
- Other?

## References
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 8d8fea9

Please sign in to comment.