Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Twins importer #360

Merged
merged 6 commits into from
Jan 15, 2024
Merged

Twins importer #360

merged 6 commits into from
Jan 15, 2024

Conversation

DemonNSK
Copy link
Contributor

No description provided.

@DemonNSK DemonNSK changed the title Twins importer WIP: Twins importer Nov 29, 2023
@Lolimpo Lolimpo changed the title WIP: Twins importer Twins importer Dec 8, 2023
accessKey: ''
secretKey: ''
manifest: ''

image:
repository: 2gis-on-premise/twins-api
tag: 1.6.0
Copy link
Collaborator

@denrockit denrockit Dec 8, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1.7.3

@endryhold
Copy link
Contributor

endryhold commented Dec 8, 2023

Задача на проверку
https://jira.2gis.ru/browse/ONPREM-566

@dbelyaev-nsk
Copy link
Contributor

надо попровить имя джобы миграций (убрать migrate)

metadata:
  name: {{ include "twins.migrate.name" . }}-migrate

в темплейтах уже прописано migrate

{{- define "twins.migrate.name" -}}
{{ include "twins.name" . }}-migrate
{{- end }}

@dbelyaev-nsk
Copy link
Contributor

dbelyaev-nsk commented Jan 10, 2024

создается секрет secret-jobs.yaml, запускается джоба импорта, импорт проходит, джоба удаляется, удаляется и секрет, после этого запускается джоба очистки и падает, т.к. не может найти этот секрет, нужно, чтобы джоба очистки смотрела в secret-deploys.yaml, т.к. она запускается после деплоя

labels:
{{- include "twins.labels" . | nindent 4 }}
annotations:
"helm.sh/hook": post-install,post-upgrade
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Мы не стали использовать чтобы в secret-deploys не было лишних переменных и/или такая практика среди остальных проектов?

@dbelyaev-nsk dbelyaev-nsk merged commit 5d5cad8 into develop Jan 15, 2024
1 check passed
@dbelyaev-nsk dbelyaev-nsk deleted the twins-importer branch January 15, 2024 03:40
dbelyaev-nsk added a commit that referenced this pull request Mar 18, 2024
* Twins importer (#360)

* Twins importer

* Twins importer add dgctlStorage settings

* Twins importer fix chart

* fix chart

* small fix

* add logs

* [keys-api] up keys-backend. Support truck, map-matching api keys (#386)

* Update citylens to 1.4.0 (#388)

* Update citylens to 1.4.0

* bump to 1.4.1

* Feature: add codeowners file (#383)

* [license] Reworked securityContext for license type 2 (#387)

* [PRO-4361] Обновление pro-api до версии 1.1.79 (#382)

* [PRO-4361] Обновление pro-api до версии 1.1.74

* PRO-4361: update to 1.1.77

* PRO-4371: update to 1.1.78

* PRO-4361: update to 1.1.79

* PRO-4176: add auth scopes (#365)

* PRO-4176: add auth scopes

* PRO-4176: update pro-ui version

* PRO-4176: update app version

* PRO-4176: update to 1.7.5

* navi-castle: bugfix (#393)

- scheduled tasks without PV
- configuration parameters mistaken

* navi-restrictions-api 1.0.1 release (#392)

* navi-restrictions-api 1.0.1 release

* readme upd

* [DEVOPS-982] navi-front: update default locations (#389)

* [DEVOPS-982] navi-front: Add pedestrian location (#396)

* [platform] Upgrade version (#381)

* PRO-3766: update platform to 0.8.1

* Fix Breaking-Changes (#401)

* generic-chart added (#398)

* PRO-3609: upgrade pro ui to 1.9.0 (#399)

* navi-back: upstream update 7.15.2.4 (#402)

* [PRO-4517] обновил хелм-чарт pro-api в onprem до версии 1.5.0 (#394)

* PRO-0: upgrade PRO API to 1.5.1 (#404)

* Feature: add PR template (#410)

* PRO-4774: upgraded PRO API to 1.6.0 (#407)

* [PRO-4635] pro-ui, версия 2.1.1 (#405)

* Citylens 1.6.0 (#406)

* Update citylens to 1.5.0

* Bump appversion

* Fix citylens-api configmap

* Fix license server url template

* Fix review notes

* Update headerLinks

* Add camcom to headerLinks

* Fix page name in configmap

* Bump to 1.5.1

* Bump to 1.6.0

* Update breaking changes & bump app version in chart

* [navi-router] rename router.keyManagementServices to keys (#409)

* [navi-router] Remove trailing dots in param descriptions

* [navi-router] Rename router.keyManagementService -> keys

* [navi-router] Rename router.castleHost -> router.castleUrl

* release-1.20.0

* add breacking-changes to template
dbelyaev-nsk added a commit that referenced this pull request Mar 20, 2024
* Twins importer (#360)

* Twins importer

* Twins importer add dgctlStorage settings

* Twins importer fix chart

* fix chart

* small fix

* add logs

* [keys-api] up keys-backend. Support truck, map-matching api keys (#386)

* Update citylens to 1.4.0 (#388)

* Update citylens to 1.4.0

* bump to 1.4.1

* Feature: add codeowners file (#383)

* [license] Reworked securityContext for license type 2 (#387)

* [PRO-4361] Обновление pro-api до версии 1.1.79 (#382)

* [PRO-4361] Обновление pro-api до версии 1.1.74

* PRO-4361: update to 1.1.77

* PRO-4371: update to 1.1.78

* PRO-4361: update to 1.1.79

* PRO-4176: add auth scopes (#365)

* PRO-4176: add auth scopes

* PRO-4176: update pro-ui version

* PRO-4176: update app version

* PRO-4176: update to 1.7.5

* navi-castle: bugfix (#393)

- scheduled tasks without PV
- configuration parameters mistaken

* navi-restrictions-api 1.0.1 release (#392)

* navi-restrictions-api 1.0.1 release

* readme upd

* [DEVOPS-982] navi-front: update default locations (#389)

* [DEVOPS-982] navi-front: Add pedestrian location (#396)

* [platform] Upgrade version (#381)

* PRO-3766: update platform to 0.8.1

* Fix Breaking-Changes (#401)

* generic-chart added (#398)

* PRO-3609: upgrade pro ui to 1.9.0 (#399)

* navi-back: upstream update 7.15.2.4 (#402)

* [PRO-4517] обновил хелм-чарт pro-api в onprem до версии 1.5.0 (#394)

* PRO-0: upgrade PRO API to 1.5.1 (#404)

* Feature: add PR template (#410)

* PRO-4774: upgraded PRO API to 1.6.0 (#407)

* [PRO-4635] pro-ui, версия 2.1.1 (#405)

* Citylens 1.6.0 (#406)

* Update citylens to 1.5.0

* Bump appversion

* Fix citylens-api configmap

* Fix license server url template

* Fix review notes

* Update headerLinks

* Add camcom to headerLinks

* Fix page name in configmap

* Bump to 1.5.1

* Bump to 1.6.0

* Update breaking changes & bump app version in chart

* [navi-router] rename router.keyManagementServices to keys (#409)

* [navi-router] Remove trailing dots in param descriptions

* [navi-router] Rename router.keyManagementService -> keys

* [navi-router] Rename router.castleHost -> router.castleUrl

* WAPI-23469 Add configuration for audit logging (#414)

* WAPI-23469 Add configuration for audit logging

* fixes

* upd version tag

* release-1.20.2
Efber added a commit that referenced this pull request Apr 2, 2024
* Twins importer (#360)

* Twins importer

* Twins importer add dgctlStorage settings

* Twins importer fix chart

* fix chart

* small fix

* add logs

* [keys-api] up keys-backend. Support truck, map-matching api keys (#386)

* Update citylens to 1.4.0 (#388)

* Update citylens to 1.4.0

* bump to 1.4.1

* Feature: add codeowners file (#383)

* [license] Reworked securityContext for license type 2 (#387)

* [PRO-4361] Обновление pro-api до версии 1.1.79 (#382)

* [PRO-4361] Обновление pro-api до версии 1.1.74

* PRO-4361: update to 1.1.77

* PRO-4371: update to 1.1.78

* PRO-4361: update to 1.1.79

* PRO-4176: add auth scopes (#365)

* PRO-4176: add auth scopes

* PRO-4176: update pro-ui version

* PRO-4176: update app version

* PRO-4176: update to 1.7.5

* navi-castle: bugfix (#393)

- scheduled tasks without PV
- configuration parameters mistaken

* navi-restrictions-api 1.0.1 release (#392)

* navi-restrictions-api 1.0.1 release

* readme upd

* [DEVOPS-982] navi-front: update default locations (#389)

* [DEVOPS-982] navi-front: Add pedestrian location (#396)

* [platform] Upgrade version (#381)

* PRO-3766: update platform to 0.8.1

* Fix Breaking-Changes (#401)

* generic-chart added (#398)

* PRO-3609: upgrade pro ui to 1.9.0 (#399)

* navi-back: upstream update 7.15.2.4 (#402)

* [PRO-4517] обновил хелм-чарт pro-api в onprem до версии 1.5.0 (#394)

* PRO-0: upgrade PRO API to 1.5.1 (#404)

* Feature: add PR template (#410)

* PRO-4774: upgraded PRO API to 1.6.0 (#407)

* [PRO-4635] pro-ui, версия 2.1.1 (#405)

* Citylens 1.6.0 (#406)

* Update citylens to 1.5.0

* Bump appversion

* Fix citylens-api configmap

* Fix license server url template

* Fix review notes

* Update headerLinks

* Add camcom to headerLinks

* Fix page name in configmap

* Bump to 1.5.1

* Bump to 1.6.0

* Update breaking changes & bump app version in chart

* [navi-router] rename router.keyManagementServices to keys (#409)

* [navi-router] Remove trailing dots in param descriptions

* [navi-router] Rename router.keyManagementService -> keys

* [navi-router] Rename router.castleHost -> router.castleUrl

* WAPI-23469 Add configuration for audit logging (#414)

* WAPI-23469 Add configuration for audit logging

* fixes

* upd version tag

* fix duplication key

* [navi-restrictions] update to style guide (#408)

* [tiles-api] Upgrade to 4.52.8 (#416)

* WAPI-23326 Add new s3 params, custom ca configuration (#390)

* WAPI-23326 Add new s3 config params to keys and catalog-api charts

* WAPI-23326 Add custom certs configuration to keys, catalog-api charts

* fix typos

* more fixes

* fix configmap deploy

* split configmap config for jobs and deploys

* upd config for keys

* fix to keys chart

* upd image tags

* upd docs

* Chore: fix PR template (#418)

* [PRO-4789] поправили values для сервиса ключей

* Citylens 1.7.0 (#422)

* Citylens 1.7.0

* bump version to 1.7.1

* Make reporterProTracks deploy one or no replicas

* Bump version to 1.7.2

* [tiles-api] Upgrade to 4.52.9 (#421)

* [+] release 1.21.0 branch

* mapgl values fix

---------

Co-authored-by: Dmitriy Donov <[email protected]>
Co-authored-by: Voronkov Alexander <[email protected]>
Co-authored-by: Петр Беклемишев <[email protected]>
Co-authored-by: Andrey Morozov <[email protected]>
Co-authored-by: Vladimir Popov <[email protected]>
Co-authored-by: Dmitrii Molochnikov <[email protected]>
Co-authored-by: Artem Malko <[email protected]>
Co-authored-by: Alexander Voronkov <[email protected]>
Co-authored-by: i-bogomazov <[email protected]>
Co-authored-by: vgivanov <[email protected]>
Co-authored-by: Dmitry Milov <[email protected]>
Co-authored-by: ostrovskiy2gis <[email protected]>
Co-authored-by: Andrew Mikhailov <[email protected]>
Co-authored-by: Денис Беляев <[email protected]>
Co-authored-by: Kirill Salnikov <[email protected]>
Co-authored-by: Власов Сергей Сергеевич <[email protected]>
Ashigo added a commit that referenced this pull request May 3, 2024
* Twins importer (#360)

* Twins importer

* Twins importer add dgctlStorage settings

* Twins importer fix chart

* fix chart

* small fix

* add logs

* [keys-api] up keys-backend. Support truck, map-matching api keys (#386)

* Update citylens to 1.4.0 (#388)

* Update citylens to 1.4.0

* bump to 1.4.1

* Feature: add codeowners file (#383)

* [license] Reworked securityContext for license type 2 (#387)

* [PRO-4361] Обновление pro-api до версии 1.1.79 (#382)

* [PRO-4361] Обновление pro-api до версии 1.1.74

* PRO-4361: update to 1.1.77

* PRO-4371: update to 1.1.78

* PRO-4361: update to 1.1.79

* PRO-4176: add auth scopes (#365)

* PRO-4176: add auth scopes

* PRO-4176: update pro-ui version

* PRO-4176: update app version

* PRO-4176: update to 1.7.5

* navi-castle: bugfix (#393)

- scheduled tasks without PV
- configuration parameters mistaken

* navi-restrictions-api 1.0.1 release (#392)

* navi-restrictions-api 1.0.1 release

* readme upd

* [DEVOPS-982] navi-front: update default locations (#389)

* [DEVOPS-982] navi-front: Add pedestrian location (#396)

* [platform] Upgrade version (#381)

* PRO-3766: update platform to 0.8.1

* Fix Breaking-Changes (#401)

* generic-chart added (#398)

* PRO-3609: upgrade pro ui to 1.9.0 (#399)

* navi-back: upstream update 7.15.2.4 (#402)

* [PRO-4517] обновил хелм-чарт pro-api в onprem до версии 1.5.0 (#394)

* PRO-0: upgrade PRO API to 1.5.1 (#404)

* Feature: add PR template (#410)

* PRO-4774: upgraded PRO API to 1.6.0 (#407)

* [PRO-4635] pro-ui, версия 2.1.1 (#405)

* Citylens 1.6.0 (#406)

* Update citylens to 1.5.0

* Bump appversion

* Fix citylens-api configmap

* Fix license server url template

* Fix review notes

* Update headerLinks

* Add camcom to headerLinks

* Fix page name in configmap

* Bump to 1.5.1

* Bump to 1.6.0

* Update breaking changes & bump app version in chart

* [navi-router] rename router.keyManagementServices to keys (#409)

* [navi-router] Remove trailing dots in param descriptions

* [navi-router] Rename router.keyManagementService -> keys

* [navi-router] Rename router.castleHost -> router.castleUrl

* WAPI-23469 Add configuration for audit logging (#414)

* WAPI-23469 Add configuration for audit logging

* fixes

* upd version tag

* fix duplication key

* [navi-restrictions] update to style guide (#408)

* [tiles-api] Upgrade to 4.52.8 (#416)

* WAPI-23326 Add new s3 params, custom ca configuration (#390)

* WAPI-23326 Add new s3 config params to keys and catalog-api charts

* WAPI-23326 Add custom certs configuration to keys, catalog-api charts

* fix typos

* more fixes

* fix configmap deploy

* split configmap config for jobs and deploys

* upd config for keys

* fix to keys chart

* upd image tags

* upd docs

* Chore: fix PR template (#418)

* [PRO-4789] поправили values для сервиса ключей

* Citylens 1.7.0 (#422)

* Citylens 1.7.0

* bump version to 1.7.1

* Make reporterProTracks deploy one or no replicas

* Bump version to 1.7.2

* [tiles-api] Upgrade to 4.52.9 (#421)

* Чек-лист код-ревью для описания PR (#424)

* [PRO-4789] Change PRO UI to 2.5.1 version and PRO API to 1.11.2 version (#419)

* [PRO-4789] обновил PRO API до версии 1.11.2
Change UI and API Version

* [PRO-4789] поправили values для сервиса ключей

* [PRO-4789] добавлена обязательность параметров kafka.eventsTopic.name и kafka.eventsTopic.readerGroupId

* [PRO-4789] добавлен хук удаления в asset-importer-starter

* WAPI-23416 поддержка tls для коннектов к postgres в catalog (#395)

* WAPI-23417 возможность указать кол-во ретраев на коннект к базе в twi… (#397)

* WAPI-23417 возможность указать кол-во ретраев на коннект к базе в twins api

* WAPI-23417 возможность указать кол-во ретраев на коннект к базе в twins api

* PRO-4936: upgrade keys-ui to 0.7.0 (#425)

* [DEVOPS-1025] Upgrade castle version (#417)

* Update citylens chart to 1.8.0 version (#427)

* Update citylens chart to 1.8.0 version

* Fix typo in pull request template

* Fix kafka.predictorsExtraTopics description

* Simplify chart

* update values

---------

Co-authored-by: Dmitriy Donov <[email protected]>
Co-authored-by: Voronkov Alexander <[email protected]>
Co-authored-by: Петр Беклемишев <[email protected]>
Co-authored-by: Andrey Morozov <[email protected]>
Co-authored-by: Vladimir Popov <[email protected]>
Co-authored-by: Dmitrii Molochnikov <[email protected]>
Co-authored-by: Artem Malko <[email protected]>
Co-authored-by: Alexander Voronkov <[email protected]>
Co-authored-by: i-bogomazov <[email protected]>
Co-authored-by: vgivanov <[email protected]>
Co-authored-by: Dmitry Milov <[email protected]>
Co-authored-by: ostrovskiy2gis <[email protected]>
Co-authored-by: Andrew Mikhailov <[email protected]>
Co-authored-by: Денис Беляев <[email protected]>
Co-authored-by: Kirill Salnikov <[email protected]>
Co-authored-by: Власов Сергей Сергеевич <[email protected]>
Co-authored-by: Aveldin1 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants