Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Python] Support replacement scan on table method #76

Closed
wants to merge 339 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
339 commits
Select commit Hold shift + click to select a range
2649516
generate json from 'import.py' file
Tishj Sep 7, 2023
f457617
add missing modules+attributes
Tishj Sep 7, 2023
74e2c93
use the full_path as dict key to ensure uniqueness, i.e datetime.date…
Tishj Sep 7, 2023
39d7fd7
fix missing attributes
Tishj Sep 7, 2023
fa787d4
generate import cache HPP from json
Tishj Sep 7, 2023
4947465
deal with the 'short' and 'ushort' cases we need to avoid in cpp vari…
Tishj Sep 7, 2023
d8fd66c
write the includes_file, import_cache and write the files
Tishj Sep 7, 2023
4c6ab38
revisions
Tishj Sep 7, 2023
f0deefd
Merge branch 'partition-order' into exclude
Sep 7, 2023
091b31e
renamed arrow -> pyarrow
Tishj Sep 7, 2023
ddf9630
preserve manually added 'required' flags in the json
Tishj Sep 7, 2023
ff60481
Internal #202: Custom Window Exclude
Sep 8, 2023
afffd0d
cleaning up the code and minor fixes
taniabogatsch Sep 8, 2023
812258e
Merge branch 'main' into binary_lambdas
taniabogatsch Sep 8, 2023
3bfec2a
fixing ambiguity with json binding
taniabogatsch Sep 8, 2023
af804ca
serialization fix
taniabogatsch Sep 8, 2023
3592edb
Merge branch 'main' into binary_lambdas
taniabogatsch Sep 8, 2023
0fe7e0f
Internal #202: Count Star Exclude
Sep 9, 2023
53eb947
Internal #202: Constant Window Exclude
Sep 9, 2023
9a6ffce
Merge branch 'partition-order' into exclude
Sep 10, 2023
7ee48ef
merge with main
Maxxen Sep 10, 2023
496d286
fix storage de/serialization
Maxxen Sep 10, 2023
b032cc8
update test order
Maxxen Sep 10, 2023
e2729a9
fix storage when child vector is larget than vector size
Maxxen Sep 10, 2023
1d9d617
format fix
Maxxen Sep 10, 2023
d1138cf
fix include, coverage
Maxxen Sep 10, 2023
f119650
Merge branch 'main' into partition-order
Sep 11, 2023
538b6fb
Merge branch 'partition-order' into exclude
Sep 11, 2023
55c8902
Internal #202: Windowed LIST Exclude
Sep 11, 2023
b9ebb36
Merge branch 'main' into binary_lambdas
taniabogatsch Sep 11, 2023
92a0d44
merge conflicts
taniabogatsch Sep 11, 2023
c0d946a
more tests for group by functionality and lambdas
taniabogatsch Sep 11, 2023
8f2d238
Merge branch 'main' into exclude
Sep 11, 2023
1520569
Internal #202: Windowed MODE Exclude
Sep 12, 2023
264eccd
Merge branch 'main' into binary_lambdas
taniabogatsch Sep 12, 2023
69bdc6e
making code cov and tidy happy
taniabogatsch Sep 12, 2023
e1969af
Merge branch 'main' into exclude
Sep 12, 2023
0a0914a
Merge branch 'main' into binary_lambdas
taniabogatsch Sep 13, 2023
336e4c3
Internal #215: QUANTILE Frame Refactor
Sep 14, 2023
7052fd2
Merge branch 'main' into types/fixedsizelist
Maxxen Sep 14, 2023
b636da8
rework array functions
Maxxen Sep 14, 2023
2f23b37
format
Maxxen Sep 14, 2023
6a56289
add more coverage, fix verification, fix validity
Maxxen Sep 15, 2023
cb54b16
Merge branch 'main' into exclude
Sep 16, 2023
a6580a5
Internal #202: Windowed MODE Exclude
Sep 16, 2023
fd03638
Internal #215: QUANTILE Reuse Refactor
Sep 16, 2023
b339dee
Merge remote-tracking branch 'upstream/main' into python_import_cache…
Tishj Sep 16, 2023
4d34976
fix fauly checking for child element validity in array functions
Maxxen Sep 16, 2023
ef5439a
ci
Maxxen Sep 16, 2023
ef821e8
merge with main
Maxxen Sep 16, 2023
955251b
Merge branch 'main' into exclude
Sep 16, 2023
596680d
Internal #215: QUANTILE Reuse Restriction
Sep 16, 2023
65082ee
Internal #215: QUANTILE Exclude Tests
Sep 17, 2023
d7f92ca
fix storage info test
Maxxen Sep 17, 2023
66c9d17
add array_length
Maxxen Sep 17, 2023
d574aaf
accept a Value in ReadCSVRelation instead of just a string
Tishj Sep 17, 2023
3423c98
exiting code still works, added logic for multiple files, needs tests…
Tishj Sep 17, 2023
8bb2bd0
add test for multi files
Tishj Sep 17, 2023
b1313a5
Merge branch 'python_readcsv_multi' into python_readcsv_multi_v2
Tishj Sep 17, 2023
b3122af
coverage
Maxxen Sep 17, 2023
fa8c4a6
Merge branch 'main' into types/fixedsizelist
Maxxen Sep 17, 2023
95fde0d
stop CI
Tishj Sep 18, 2023
57621db
add back stackcheck in typename transform - why did I ever remove this?
Maxxen Sep 18, 2023
782c7ec
coverage
Maxxen Sep 18, 2023
5cad01f
add casts in list functions
Maxxen Sep 18, 2023
0e3fb59
remove todos
Maxxen Sep 18, 2023
3087c58
fix moves
Maxxen Sep 18, 2023
7a169bc
first steps schema argument for parquet files
lnkuiper Sep 18, 2023
807d8b9
starting to get create statements working. need to implement to strin…
Tmonster Sep 18, 2023
5728302
coverage
Maxxen Sep 18, 2023
7bd8778
Merge branch 'main' into exclude
Sep 19, 2023
e5db8d0
Merge branch 'main' into parquet_schema
lnkuiper Sep 19, 2023
00b31e8
add support for creating a view
Tmonster Sep 19, 2023
5daa54e
adding support to create new tables
Tmonster Sep 19, 2023
3c62835
some progress on parquet schema
lnkuiper Sep 19, 2023
02994fb
fix tidy issue
Tishj Sep 19, 2023
a5da9f7
can generate create table statement but 99/100 times it errors out be…
Tmonster Sep 19, 2023
1d43f03
make error deterministic - use a set so the order is not undefined
Tishj Sep 19, 2023
cc8434d
create type works. might need to tweak the percentages later
Tmonster Sep 19, 2023
5adf365
Merge branch 'main' into add_create_statement_support_to_fuzzer
Tmonster Sep 19, 2023
9259d71
should add support for some create statements
Tmonster Sep 19, 2023
7ab3086
Internal #202: Windowed Exclude Serialisation
Sep 19, 2023
9923ac4
make format-fix
Tmonster Sep 20, 2023
f288f07
add unhappy path tests
Tishj Sep 20, 2023
98ebbc3
Add GenerateSchemaIdentifier and GenerateViewIdentifier
Tmonster Sep 20, 2023
b06cdcd
make format-fix
Tmonster Sep 20, 2023
89269db
only keep as Value when necessary, unwrap to vector<string> inbetween
Tishj Sep 20, 2023
843755f
Merge branch 'main' into parquet_schema
lnkuiper Sep 21, 2023
44be331
this was an infinite recursion stack overflow, {csv_file} apparently …
Tishj Sep 21, 2023
2f9b8fa
Merge remote-tracking branch 'upstream/main' into python_readcsv_mult…
Tishj Sep 21, 2023
f62dcc2
Merge remote-tracking branch 'upstream/main' into python_readcsv_mult…
Tishj Sep 25, 2023
b52b464
default to JSON if inconsistent structure
lnkuiper Sep 25, 2023
6579b5a
add benchmark file so we don't regress in the future
lnkuiper Sep 25, 2023
a45f6be
Merge branch 'main' into parquet_schema
lnkuiper Sep 25, 2023
439a865
format check
lnkuiper Sep 25, 2023
499919f
add threshold as a parameter
lnkuiper Sep 25, 2023
28f58af
add full error message
lnkuiper Sep 25, 2023
1d2044f
parquet schema progress
lnkuiper Sep 25, 2023
b9d2208
Merge remote-tracking branch 'upstream/main' into python_readcsv_mult…
Tishj Sep 26, 2023
b2066af
Merge branch 'main' into parquet_schema
lnkuiper Sep 26, 2023
6db4d61
parquet schema working end-to-end now
lnkuiper Sep 26, 2023
299337e
check isset and add another test
lnkuiper Sep 26, 2023
0d2f941
Merge branch 'main' into parquet_schema
lnkuiper Sep 27, 2023
64e58e6
more tests for parquet schema and some code cleanup
lnkuiper Sep 27, 2023
c4a3e8b
add parquet KV metadata support
Maxxen Sep 27, 2023
c7e5bae
make kv_metadata return blobs instead
Maxxen Sep 27, 2023
21a3076
implement pr feedback
lnkuiper Sep 27, 2023
19b106b
Merge remote-tracking branch 'upstream/main' into python_readcsv_mult…
Tishj Sep 27, 2023
24722ae
Merge branch 'feature' into exclude
Sep 27, 2023
2b0d075
Internal #202: Windowed Exclude Serialisation
Sep 27, 2023
76d6fcb
feat(jdbc): UUID param support
Mause Sep 28, 2023
28ccbde
add parquet_kv_metadata to extension entries
Maxxen Sep 29, 2023
0954a79
Merge branch 'main' into parquet-kv-metadata
Maxxen Sep 29, 2023
cc2e77c
Merge pull request #9164 from Mause/feature/jdbc-uuid-param
Mytherin Sep 29, 2023
d302eb4
fix projection pushdown and count(*)
samansmink Sep 29, 2023
269d61d
Merge branch 'feature' into exclude
Oct 2, 2023
1514153
Internal #202: Windowed Exclude Serialisation
Oct 2, 2023
72fc2a2
Merge branch 'main' into binary_lambdas
taniabogatsch Oct 2, 2023
41fd86b
merging
taniabogatsch Oct 2, 2023
144c555
Merge remote-tracking branch 'upstream/main' into python_import_cache…
Tishj Oct 2, 2023
0f4e5a7
Starting to change CSV Api
pdet Oct 2, 2023
526648f
review feedback
taniabogatsch Oct 2, 2023
0e697ab
clean up the code here
Tishj Oct 2, 2023
5d8e3d0
merge with main
Maxxen Oct 2, 2023
f75bb4b
test and format
Maxxen Oct 2, 2023
2710e61
Updating ADBC to 0.7
pdet Oct 2, 2023
aa34785
Merge remote-tracking branch 'upstream/main' into add_create_statemen…
Tmonster Oct 2, 2023
4246233
More on adbc new version
pdet Oct 2, 2023
1cc11f4
working on updating this
Tmonster Oct 2, 2023
8422779
Internal #215: Deterministic EXCLUDE Tests
Oct 2, 2023
ea29b8f
Internal #358: Exclude API Polishing
Oct 2, 2023
0b5e433
Internal #358: Frame Intersection Template
Oct 2, 2023
8ac840f
Internal #358: MODE State Destructor
Oct 3, 2023
459e6cf
merge catalog entry (table/schema/type) ToSQL with create info table/…
Tmonster Oct 3, 2023
ede8d7e
Check for too many parameters on adbc, move adbc tests to adbc folder
pdet Oct 3, 2023
b89f078
Merge branch 'feature' into binary_lambdas
taniabogatsch Oct 3, 2023
1b467c2
deterministic test'
taniabogatsch Oct 3, 2023
1f029d1
fix list aggregate for arrays, add more tests
Maxxen Oct 3, 2023
4bd6cee
Merge branch 'feature' of github.com:duckdb/duckdb into feature
lnkuiper Oct 3, 2023
ed90a1b
Internal #358: MODE Memory Leak
Oct 3, 2023
5b3159e
ADBC is already defined in the parser
pdet Oct 3, 2023
8b2d3a5
grr
pdet Oct 3, 2023
98170fb
Merge branch 'feature' into parquet_schema
lnkuiper Oct 4, 2023
218a1a2
implement thijs feedback
lnkuiper Oct 4, 2023
aa06cdd
Merge branch 'parquet-schema-fix' of github.com:samansmink/duckdb int…
lnkuiper Oct 4, 2023
f279137
re-generate serialization to resolve merge conflict
lnkuiper Oct 4, 2023
8c03e74
Merge branch 'main' into feature
Mytherin Oct 4, 2023
e6bc865
grr
pdet Oct 4, 2023
3e4df48
Adding SetColumns struct with information set by the suer
pdet Oct 4, 2023
7c00440
merge
pdet Oct 4, 2023
c7c4e8f
Implement ignore errors in dialect detection
pdet Oct 4, 2023
19bc66f
Merge branch 'main' into json_inconsistent_structure
lnkuiper Oct 4, 2023
69540b9
modify serialization in a backwards-compatible way
lnkuiper Oct 4, 2023
718cfb2
add default value
lnkuiper Oct 4, 2023
f1347e5
Merge pull request #9185 from pdet/adbc_07
Mytherin Oct 5, 2023
5d4eaad
Merge branch 'python_import_cache_upgrade_v2' into python_import_cach…
Tishj Oct 5, 2023
f6d6342
Merge remote-tracking branch 'upstream/feature' into python_import_ca…
Tishj Oct 5, 2023
b8aede5
pyduckdb -> duckdb
Tishj Oct 5, 2023
c46a727
Make sure to properly use user settings on quote and header
pdet Oct 5, 2023
57a8730
cant implicitly cast to parent class, use move
Tishj Oct 5, 2023
3f91a7e
dont cast blobs when writing, more tests
Maxxen Oct 5, 2023
36a30cb
create a Relation, then get the TableRef through GetTableRef - we hav…
Tishj Oct 5, 2023
3b1c07a
simplification of read csv relation code and test adjustments
pdet Oct 5, 2023
40b099a
add json_serialize_plan, json_serialize_sql tweaks
Maxxen Oct 5, 2023
b52f428
dialect detection must be a perfect match with given columns
pdet Oct 5, 2023
d70d6ee
make test detirministic
Maxxen Oct 5, 2023
eb9d61c
test adjustments
pdet Oct 5, 2023
244a956
more test adjustments
pdet Oct 5, 2023
e6154e8
add to json_config.py
Maxxen Oct 5, 2023
3aa2d96
Merge pull request #9126 from Maxxen/parquet-kv-metadata
Mytherin Oct 5, 2023
1f36ed7
Merge branch 'main' into feature
Mytherin Oct 5, 2023
a45e2b5
Merge pull request #9086 from lnkuiper/json_inconsistent_structure
Mytherin Oct 5, 2023
c3aa759
Merge pull request #9123 from lnkuiper/parquet_schema
Mytherin Oct 5, 2023
754cfc0
skip force-storage
Maxxen Oct 5, 2023
bf8c8ab
Internal #215: Window EXCLUDE Feedback
hawkfish Oct 5, 2023
96f2828
Test adjustment and more restrictive sniffing when columns are set
pdet Oct 6, 2023
bb36133
Merge pull request #8977 from Tishj/python_readcsv_multi_v2
Mytherin Oct 6, 2023
8eab8f0
Merge branch 'main' into types/fixedsizelist
Maxxen Oct 6, 2023
41cf597
More adjustments
pdet Oct 6, 2023
c613752
update count properly in columndata, flatten array vectors before ser…
Maxxen Oct 6, 2023
e7de722
Adjustments to ignore errors in sniffing
pdet Oct 6, 2023
5a26a25
We need to set dialect options otherwise they don't get converted to …
pdet Oct 6, 2023
9fc77c1
Uncomment tests
pdet Oct 6, 2023
0c1a5a2
allow arrays of 'any' size, improve casts, fix list_concat /w array, …
Maxxen Oct 6, 2023
6ac04a5
merge
pdet Oct 6, 2023
25dafe2
more merge
pdet Oct 6, 2023
d0fc4af
Merge remote-tracking branch 'upstream/feature' into python_import_ca…
Tishj Oct 7, 2023
7d36ffd
fix try_cast, enable varchar to array casting
Maxxen Oct 9, 2023
c0053cf
more list functions
Maxxen Oct 9, 2023
532d86e
Being more acceptive of broken csv files
pdet Oct 9, 2023
1cfcaca
Merge branch 'main' into feature
Mytherin Oct 9, 2023
6b094bc
fix minmax that was bonkers broken
Maxxen Oct 9, 2023
49da0a6
fix roundtripping in csv/parquet/json, add json casts
Maxxen Oct 9, 2023
867b9fb
format fix
Tmonster Oct 9, 2023
fcd8588
Merge branch 'main' into add_create_statement_support_to_fuzzer
Tmonster Oct 9, 2023
5a54175
Issue #7672: TIMESTAMP_XX to DATE
hawkfish Oct 9, 2023
95665b4
fix test errors
Tmonster Oct 9, 2023
61907bb
Merge branch 'main' into feature
Mytherin Oct 10, 2023
9a8f2ff
Merge pull request #9279 from hawkfish/nsdate-cast
Mytherin Oct 10, 2023
38a58d2
fix to support file_row_number with parquet schema
samansmink Oct 10, 2023
45a9b27
Merge branch 'feature' into binary_lambdas
taniabogatsch Oct 10, 2023
d3f1ceb
add test for file_row_number with schema param
samansmink Oct 10, 2023
3a91d59
format
samansmink Oct 10, 2023
01aa1ce
revert json file changes
taniabogatsch Oct 10, 2023
4c2b0ce
Keep best option if columns are set
pdet Oct 10, 2023
967212b
more list funcs, fix child validity not being set in Vector::Referenc…
Maxxen Oct 10, 2023
f381e11
dont modify extension config
Maxxen Oct 10, 2023
9a61846
add ';' after create schema statements
Tmonster Oct 10, 2023
06538bd
dont set child validity unneccessarily
Maxxen Oct 10, 2023
f631e51
add missing header
Maxxen Oct 10, 2023
c4a4029
Merge branch 'main' into feature
Mytherin Oct 10, 2023
e4b4727
merge
Maxxen Oct 10, 2023
0d216e3
Merge branch 'main' into feature
Mytherin Oct 11, 2023
5e192ec
lambda serialization
taniabogatsch Oct 11, 2023
db51712
incorporate tanias feedback
Maxxen Oct 11, 2023
ffc5ee2
Merge remote-tracking branch 'origin/feature' into csv_api
pdet Oct 11, 2023
470b96a
Merge pull request #8851 from taniabogatsch/binary_lambdas
Mytherin Oct 11, 2023
6189a52
add back array size limit, loosen child const vector
Maxxen Oct 11, 2023
6497a3b
merge
Maxxen Oct 11, 2023
7322a64
more headers
Maxxen Oct 11, 2023
56a08aa
fix unused warning
Maxxen Oct 11, 2023
33d3f53
Merge branch 'feature' into lambda-ser
taniabogatsch Oct 12, 2023
1ed4d5a
Merge pull request #8983 from Maxxen/types/fixedsizelist
Mytherin Oct 12, 2023
f642a7b
Merge branch 'main' into feature
Mytherin Oct 12, 2023
a00428d
Merge pull request #9318 from Maxxen/fix-unused
Mytherin Oct 12, 2023
493368c
Merge branch 'feature' into exclude
hawkfish Oct 12, 2023
96883c1
Check if lambda has side effects not just function
maiadegraaf Oct 16, 2023
e47be52
Merge pull request #9220 from hawkfish/exclude
Mytherin Oct 16, 2023
0fe1b77
Merge pull request #9230 from Maxxen/json-plan-serialization
Mytherin Oct 16, 2023
0c7e625
Merge pull request #9011 from Tmonster/add_create_statement_support_t…
Mytherin Oct 16, 2023
7d813b3
Merge branch 'main' into feature
Mytherin Oct 16, 2023
ebeab38
Merge branch 'feature' into lambda-ser
taniabogatsch Oct 16, 2023
af29e34
Merge pull request #9353 from maiadegraaf/list_random_lambda
Mytherin Oct 16, 2023
844b982
We can't write and read the same file at the same time
pdet Oct 16, 2023
8e698ae
Merge pull request #9323 from taniabogatsch/lambda-ser
Mytherin Oct 17, 2023
6530e70
fix issue with passing a reference to destroyed object
samansmink Oct 18, 2023
d59baf7
format
samansmink Oct 18, 2023
bc4a9ae
separate the verification/pre-binding of Relations from the constructor
Tishj Oct 18, 2023
9804c4a
fix some issues and make sure relations are verified everywhere
Tishj Oct 18, 2023
0a941e3
make sure verify is never called multiple times
Tishj Oct 18, 2023
3d1f36b
use a variation of ScanReplacement in the table method to support rep…
Tishj Oct 18, 2023
2f4425c
Merge pull request #9290 from samansmink/parquet-schema-param-fix
Mytherin Oct 19, 2023
de73089
Merge pull request #9250 from pdet/csv_api
Mytherin Oct 19, 2023
46c45fc
compile error
Tishj Oct 19, 2023
e45d049
compilation error: unused variable
Tishj Oct 19, 2023
8c2a69a
Merge branch 'main' into feature
Mytherin Oct 20, 2023
a3c8ea6
Merge branch 'feature' of github.com:duckdb/duckdb into feature
Mytherin Oct 20, 2023
e72ab94
Merge pull request #8741 from Tishj/python_import_cache_upgrade
Mytherin Oct 20, 2023
2e7eab8
add replacement scan for 'table'
Tishj Oct 21, 2023
15473f1
Merge branch 'python_try_replacement_relation' of https://github.com/…
Tishj Oct 21, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
22 changes: 15 additions & 7 deletions .github/config/uncovered_files.csv
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ common/serializer/buffered_file_reader.cpp 11
common/serializer/buffered_file_writer.cpp 2
common/serializer/binary_serializer.cpp 11
common/serializer/memory_stream.cpp 5
common/sort/comparators.cpp 72
common/sort/comparators.cpp 103
common/sort/merge_sorter.cpp 100
common/sort/partition_state.cpp 44
common/sort/sort_state.cpp 10
Expand Down Expand Up @@ -91,7 +91,7 @@ common/types/row/row_layout.cpp 4
common/types/row/tuple_data_allocator.cpp 23
common/types/row/tuple_data_collection.cpp 76
common/types/row/tuple_data_iterator.cpp 5
common/types/row/tuple_data_scatter_gather.cpp 17
common/types/row/tuple_data_scatter_gather.cpp 19
common/types/row/tuple_data_segment.cpp 10
common/types/string_heap.cpp 11
common/types/time.cpp 25
Expand All @@ -100,7 +100,7 @@ common/types/uuid.cpp 3
common/types/validity_mask.cpp 13
common/types/value.cpp 180
common/types/vector.cpp 153
common/value_operations/comparison_operations.cpp 32
common/value_operations/comparison_operations.cpp 33
common/vector_operations/generators.cpp 31
common/vector_operations/is_distinct_from.cpp 49
common/vector_operations/null_operations.cpp 15
Expand All @@ -114,7 +114,7 @@ core_functions/aggregate/distributive/bitagg.cpp 8
core_functions/aggregate/distributive/bitstring_agg.cpp 6
core_functions/aggregate/distributive/entropy.cpp 9
core_functions/aggregate/distributive/kurtosis.cpp 3
core_functions/aggregate/distributive/minmax.cpp 2
core_functions/aggregate/distributive/minmax.cpp 3
core_functions/aggregate/distributive/skew.cpp 2
core_functions/aggregate/distributive/sum.cpp 10
core_functions/aggregate/holistic/approximate_quantile.cpp 29
Expand All @@ -123,6 +123,9 @@ core_functions/aggregate/holistic/quantile.cpp 14
core_functions/aggregate/holistic/reservoir_quantile.cpp 39
core_functions/aggregate/nested/histogram.cpp 1
core_functions/aggregate/nested/list.cpp 4
core_functions/scalar/array/array_value.cpp 2
core_functions/scalar/string/length.cpp 2
core_functions/lambda_functions.cpp 1
core_functions/scalar/bit/bitstring.cpp 3
core_functions/scalar/date/date_diff.cpp 124
core_functions/scalar/date/date_part.cpp 17
Expand All @@ -136,7 +139,7 @@ core_functions/scalar/generic/least.cpp 2
core_functions/scalar/generic/system_functions.cpp 4
core_functions/scalar/list/array_slice.cpp 3
core_functions/scalar/list/flatten.cpp 6
core_functions/scalar/list/list_aggregates.cpp 2
core_functions/scalar/list/list_aggregates.cpp 6
core_functions/scalar/list/list_lambdas.cpp 2
core_functions/scalar/list/list_sort.cpp 7
core_functions/scalar/list/range.cpp 6
Expand Down Expand Up @@ -255,7 +258,7 @@ function/cast/union_casts.cpp 4
function/cast/uuid_casts.cpp 2
function/cast/union/from_struct.cpp 0
function/cast/vector_cast_helpers.cpp 9
function/cast_rules.cpp 18
function/cast_rules.cpp 19
function/function.cpp 8
function/function_binder.cpp 18
function/function_set.cpp 8
Expand All @@ -270,6 +273,7 @@ function/scalar/operators/arithmetic.cpp 23
function/scalar/operators/multiply.cpp 3
function/scalar/operators/subtract.cpp 5
function/scalar/strftime_format.cpp 31
function/scalar/string/length.cpp 2
function/scalar/string/regexp.cpp 5
function/scalar/string/regexp/regexp_extract_all.cpp 5
function/scalar/string/substring.cpp 8
Expand Down Expand Up @@ -391,6 +395,7 @@ include/duckdb/common/types/string_type.hpp 5
include/duckdb/common/types/uuid.hpp 4
include/duckdb/common/types/validity_mask.hpp 5
include/duckdb/common/types/value.hpp 6
include/duckdb/common/types/vector_buffer.hpp 1
include/duckdb/common/vector_operations/aggregate_executor.hpp 17
include/duckdb/common/vector_operations/binary_executor.hpp 15
include/duckdb/common/vector_operations/generic_executor.hpp 9
Expand Down Expand Up @@ -581,6 +586,7 @@ parser/expression/case_expression.cpp 3
parser/expression/collate_expression.cpp 3
parser/expression/default_expression.cpp 8
parser/expression/function_expression.cpp 2
parser/expression/lambdaref_expression.cpp 3
parser/expression/star_expression.cpp 5
parser/expression/subquery_expression.cpp 5
parser/expression/window_expression.cpp 8
Expand Down Expand Up @@ -707,7 +713,7 @@ planner/expression/bound_lambdaref_expression.cpp 38
planner/expression/bound_reference_expression.cpp 12
planner/expression/bound_subquery_expression.cpp 5
planner/expression/bound_window_expression.cpp 7
planner/expression_binder.cpp 7
planner/expression_binder.cpp 9
planner/expression_binder/aggregate_binder.cpp 3
planner/expression_binder/alter_binder.cpp 3
planner/expression_binder/base_select_binder.cpp 3
Expand Down Expand Up @@ -794,6 +800,7 @@ storage/standard_buffer_manager.cpp 128
storage/statistics/base_statistics.cpp 48
storage/statistics/column_statistics.cpp 8
storage/statistics/distinct_statistics.cpp 12
storage/statistics/array_stats.cpp 1
storage/statistics/list_stats.cpp 13
storage/statistics/numeric_stats.cpp 117
storage/statistics/numeric_stats_union.cpp 3
Expand All @@ -812,6 +819,7 @@ storage/table/column_data.cpp 16
storage/table/column_data_checkpointer.cpp 4
storage/table/column_segment.cpp 62
storage/table/list_column_data.cpp 28
storage/table/array_column_data.cpp 25
storage/table/row_group.cpp 54
storage/table/row_group_collection.cpp 7
storage/table/row_version_manager.cpp 6
Expand Down
14 changes: 14 additions & 0 deletions benchmark/micro/json/inconsistent_schema.benchmark
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# name: benchmark/micro/json/inconsistent_schema.benchmark
# description: Read JSON file with inconsistent schema
# group: [json]

name JSON inconsistent schema
group json

require json

run
CREATE OR REPLACE TABLE test AS SELECT * FROM 'data/json/5000.jsonl'

result I
5000
Loading
Loading