All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog.
cloudly.gcp.bigquery
finetune.
- Minor fixes
cloudly.gcp.bigquery._Table
gets new propertylabels
and new methodupdate_labels
.cloudly.gcp.bigquery
gets new module-level functiontable
, analogous todataset
.- Finetuned and enhanced
cloudly.gcp.bigquery.read_streams
with new parametersnum_workers
,as_dict
, andqueue_cls
. cloudly.biglist.parquet.ParquetBatchData
behavior change: the values produced by__getitem__
and__iter__
no longer collapse single columns; added attributerow_as_dict
default toTrue
, hence producing dicts by default (as it has been doing up to this release), whereasrow_as_dict=False
would produce tuples.- New module
cloudly.gcp.ai_vector_search
(work in progress).
- Finetune
cloudly.gcp.bigquery
.
- Enhancements to
cloudly.gcp.bigquery
.
- New module
cloudly.gcp.bigquery
. - More tests.
- New classes
cloudly.utpathlib.serializer.{NewlineDelimitedOrjsonSerializer, CsvSerializer, AvroSerializer}
; all are usable by "biglist". Biglist.new
gets a new parameterdatafile_ext
to specify the extension of the data files.- New class
cloudly.biglist.ExternalBiglist
, replacing the previousParquetBiglist
. - Removed some backcompat code in
cloudly.biglist
that was introduced inbiglist
versions 0.7.4--0.7.7 (2022-02 - 2023-03).
- Fixes and improvements to
cloudly.gcp.{batch, compute, workflows, scheduler}
.
- Fixes and improvements to
cloudly.gcp.{batch, compute, workflows, scheduler}
.
- Move
versioned_uploadable
fromutil
toupathlib
, keeping a reference inutil
for short-term backcompat. - Move
ParquetSerializer
fromcloudly.biglist.parquet
tocloudly.upathlib.serializer
; add methodsread_parquet
,write_parquet
toUpath
. - Finetune log formatting.
- New module
cloudly.gcp.batch
. - New module
cloudly.gcp.compute
. - New moudle
cloudly.gcp.scheduler
. - New module
cloudly.gcp.workflows
. - New module
cloudly.util.timer
.
- Improvements to Sphinx-generated documentation.
- Re-arrangements of file org and import paths related to
biglist
,upathlib
,serializer
,parquet
.
- Some cleanup and file re-arrangements.
- Merged package
biglist
intocloudly
. For changelog of thebiglist
code up to this point, see the originalbiglist
repo.
- Merged package
upathlib
intocloudly
. For changelog of theupathlib
code up to this point, see the originalupathlib
repo. - New module
cloudly.gcp.logging
.
- Bug fix related to
datetime.UTC
. This is available in Python 3.11+ while this package requires Python 3.10+. Downgraded the development environment from 3.12 to 3.10 and fixed the bug.
- New module
cloudly.util.ratelimit
. - New module
cloudly.util.logging
. - New module
cloudly.util.datetime
. - New module
cloudly.util.docker
.
- Bug fix and minor enhancements in
cloudly.gcp.auth
.
- Improve import.
Initial release.
- GCP credentials and secret manager.