Skip to content

Releases: Flowminder/FlowKit

1.32.0

31 Jan 16:56
@jc-harrison jc-harrison
1.32.0
4c06510
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
1.32.0 Latest
Latest

Changed

  • Modified FlowETL count_duplicates and count_duplicated QA check queries to improve performance, without changing the results. #6935
  • Columns msisdn, msisdn_counterpart, imsi and imei in the FlowDB events/interactions tables now use "C" collation. This change requires reindexing affected columns. #6941

What's Changed

Full Changelog: 1.31.0...1.32.0

Contributors

jc-harrison, mergify, and dependabot
Assets 2
Loading

1.31.0

31 Jan 15:56
@jc-harrison jc-harrison
1.31.0
8b3faad
Compare
Choose a tag to compare
1.31.0

Changed

  • Mode is now available for use with categorical metrics when running joined spatial aggregates via api. #2021
  • Flowmachine now includes the version number in query ids which means cache entries are per-version. #4489

Fixed

  • Fixed dangling async tasks not being properly cancelled during server shutdown #6833
Assets 2
Loading

1.30.0

16 Oct 10:34
@greenape greenape
1.30.0
bf23323
Compare
Choose a tag to compare
1.30.0

Changed

  • FlowMachine now requires python >= 3.11

Fixed

  • Direction enum not being recognised #6787

Removed

  • Removed Oracle fdw

What's Changed

Full Changelog: 1.29.0...1.30.0

Contributors

greenape and dependabot
Assets 2
Loading

1.29.0

15 Aug 15:14
@greenape greenape
1.29.0
3e98904
Compare
Choose a tag to compare
1.29.0

Added

  • New flowmachine query CalendarActivity, which retrives subscribers pattern of active days
  • New flowmachine queries PerValueAggregate and RedactedPerValueAggregate, which group by the value column of another query and apply an aggregate to subscribers with that grouping.
  • New flowapi queries and flowclient functions for calendar_activity and localised_calendar_activity, which return counts of subscribers per sequence of active days, and per sequence of active days additionally grouped by the subscribers reference location
  • Added new StringStatistic enum, which enumerates valid statistics for use with postgres string types

Changed

  • HistogramAggregation has moved to flowmachine.features.nonspatial_aggregates
  • Statistic moved to flowmachine.core.statistic_types
  • TotalActivePeriodsSubscriber no longer returns an extra inactive_periods column

What's Changed

Full Changelog: 1.28.1...1.29.0

Contributors

greenape, jc-harrison, and dependabot
Assets 2
Loading

1.28.1

05 Jul 10:57
@greenape greenape
1.28.1
5dc1c47
Compare
Choose a tag to compare
1.28.1

Fixed

  • Fixed 500 error when getting api spec from FlowAPI #6686

What's Changed

Full Changelog: 1.28.0...1.28.1

Contributors

greenape
Assets 2
Loading

1.28.0

04 Jul 15:34
@Thingus Thingus
1.28.0
24e0cb5
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
1.28.0

Added

  • Added support for Parquet foreign tables using parquet_fdw

Changed

  • FlowKit test and synthetic data now uses parquet foreign tables.

Warning

The location of the parquet files in the container is /parquet_data, if you are testing with larger amounts of data you may wish to add an additional bind mount for this location.

Warning

This change is not backwards compatible with earlier releases of FlowDB, and you will need to repopulate your deployment. We recommend combining this change with the new parquet support.

  • FlowETL is now built on Airflow 2.9.2

Fixed

Removed

What's Changed

Full Changelog: 1.27.0...1.28.0

Contributors

greenape, Thingus, and dependabot
Assets 2
Loading

1.27.0

17 Jun 08:03
@Thingus Thingus
1.27.0
c7ef0a9
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
1.27.0

Changelog

All notable changes to FlowKit will be documented in this file.

The format is based on Keep a Changelog.

1.27.0

Added

  • Added FlowDB table infrastructure.invalid_cell_info for recording cell information that could not be included in infrastructure.cell_info (including cells with null or duplicate cell IDs). #6626
  • The file name of FlowDB's automatically generated at init config file can now be specified by setting the AUTO_CONFIG_FILE_NAME environment variable. By default this is postgresql.configurator.conf.

Changed

  • FlowDB now triggers an ANALYZE on newly created cache tables to generate statistics rather than waiting for autovacuum
  • FlowDB now produces JSON formatted logs by default. Set FLOWDB_LOG_DEST=csvlog for the old default behaviour.
  • The logging destination of FlowDB can now be configured at init by setting the FLOWDB_LOG_DEST environment variable, valid options are stderr, csvlog, and jsonlog.
  • The location inside the container of FlowDB's automatically generated config file has changed to /flowdb_autoconf/$AUTO_CONFIG_FILE_NAME.

What's Changed

Full Changelog: 1.26.0...1.27.0

Contributors

greenape, jc-harrison, and dependabot
Assets 2
Loading

1.26.0

10 Jun 15:24
@greenape greenape
1.26.0
bd99a72
Compare
Choose a tag to compare
1.26.0

Changed

  • FlowDB now enables partitionwise aggregation planning by default
  • FlowDB now uses a default fillfactor of 100 for cache table indexes

Fixed

  • Queries that have multiple of the same subquery with different parameters no longer cause duplicate scopes in tokens. #6580
  • FlowETL QA checks count_imeis, count_imsis, max_msisdns_per_imei and max_msisdns_per_imsi now only count non-null IMEIs/IMSIs. #6619

What's Changed

Read more

Contributors

greenape, Thingus, and 2 other contributors
Assets 2
Loading

1.25.0

24 Apr 12:16
@jc-harrison jc-harrison
1.25.0
03ed8a7
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
1.25.0

Fixed

  • FlowETL get_qa_checks no longer attempts to create duplicate tasks for QA checks defined in the DAG folder. #6494

Removed

  • Removed flowpyter-task from the FlowETL Docker image. For a Docker image with flowpyter-task included, see flowminder/flowbot.
Assets 2
Loading

1.24.0

03 Apr 13:42
@greenape greenape
1.24.0
09a98be
Compare
Choose a tag to compare
1.24.0

Added

  • Test and synthetic data generators now perform QA checks on the generated data. #6467
  • Added new /qa endpoint to FlowAPI and FlowClient, which supports getting the results of QA checks run by FlowETL #2704
  • Added new available_qa_checks property to flowmachine Connection objects #2704
  • Added new get_qa_checks method to flowmachine Connection objects #2704

Fixed

  • Test QA check IDs are now of the same format as those produced by FlowETL. #6472
  • FlowAuth now runs migrations correctly on startup. #6480

What's Changed

Full Changelog: 1.23.0...1.24.0

Contributors

greenape, Thingus, and dependabot
Assets 2
Loading