Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(pipeline) : Add raise_for_status #153

Merged
merged 6 commits into from
Nov 16, 2023
Merged

Conversation

vperron
Copy link
Contributor

@vperron vperron commented Nov 14, 2023

L'histoire d'une PR qui commence bien, puis je veux ajouter un test, et là je me retrouve à faire une MAJ complète de la version de Python de tous les packages.

Ce qui est de toutes façons une bonne chose, ça nous met à jour, mais bon ^^ Ca résout au passage quelques petits soucis de sécurité.

Les commits sont normalement bien séparés.

Il faudra surveiller un peu plus le déploiement. RAS pour les tests, les images docker, le lancement des DAGs en local, etc.

Cf #145 .

@vperron vperron added documentation Improvements or additions to documentation enhancement New feature or request dependencies Pull requests that update a dependency file debt Something needs to be refactored labels Nov 14, 2023
@vperron vperron self-assigned this Nov 14, 2023
@vperron vperron requested a review from vmttn as a code owner November 14, 2023 19:12
Copy link
Contributor

@vmttn vmttn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmmm 😁 plus simple de séparer, notamment si les prios sont pas les mêmes

Sinon top, il me semble que les perfs devront s'améliorer !

J'ai simplement mis à jour le fichier de contraintes airflow

Recent versions of Linux all ship Python 3.11 which is out since October
2022.

Drop tox's envlist that makes it mandatory to have __that__ version
to run the tests.

There is very little chance that the few Python tests we have will be
sensitive to the version or Python, or we'd be doing some pretty nasty
code.
vperron and others added 5 commits November 15, 2023 17:41
It is not __that__ required for the development process and might be
confusing. Assume that "a recent Python version" will work.
py311 is out since a solid year, is the default on almost all recent
Linux versions, and it's not very nice to have to hack my environment
to downgrade my Python setup (or use pyvenv, or other things)

There is very little chance that we break things with this upgrade but
we might increase our security and maintanability as some packages might
drop Python3.10 someday.

Also it will fix a security warning that Scalingo gives us upon
deployments:

 !     A Python security update is available! Upgrade as soon as possible to: python-3.10.12
 !     See: https://doc.scalingo.com/languages/python/start
Enables testing the HTTP requests reliably.
Be able to know much sooner when something goes wrong.
@vmttn
Copy link
Contributor

vmttn commented Nov 16, 2023

à priori tout est ok sur le staging, on peut merge

@vperron vperron merged commit d7938d8 into main Nov 16, 2023
6 checks passed
@vperron vperron deleted the vperron/raise-for-status branch November 16, 2023 08:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
debt Something needs to be refactored dependencies Pull requests that update a dependency file documentation Improvements or additions to documentation enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants