Code

feat: support python submissions#248

Code

Merged

nicor88 merged 102 commits intodbt-labs:maindbt-labs/dbt-athena:mainfrom Avinash-1394:support-python-submissionsAvinash-1394/dbt-athena-1:support-python-submissionsCopy head branch name to clipboardFeb 6, 2024

+1,753-118

Commits

Commits on Mar 27, 2023

• Submitted python model successfully

  Avinash-1394

  committed
  751c84c

  Copy full SHA for 751c84c

• Rebase and resolved conflicts

  Avinash-1394

  committed
  7737000

  Copy full SHA for 7737000

• Execution successful but table not saved

  Avinash-1394

  committed
  c1d1ab2

  Copy full SHA for c1d1ab2

• Add incremental model support

  Avinash-1394

  committed
  fd6a135

  Copy full SHA for fd6a135

• Merge branch 'main' into add-python-model-support

  Avinash-1394

  authored
  ed72a5b

  Copy full SHA for ed72a5b

Commits on Apr 2, 2023

• Merge branch 'main' into add-python-model-support

  Avinash-1394

  authored
  514ad5c

  Copy full SHA for 514ad5c

Commits on Apr 3, 2023

• Fixed location and incremental model rerun

  Avinash-1394

  committed
  7913646

  Copy full SHA for 7913646

Commits on Apr 5, 2023

• Added docs

  Avinash-1394

  committed
  233ab98

  Copy full SHA for 233ab98

• Updated README

  Avinash-1394

  committed
  d2ad09e

  Copy full SHA for d2ad09e

• Merge branch 'main' into add-python-model-support

  Avinash-1394

  authored
  af38061

  Copy full SHA for af38061

Commits on Apr 16, 2023

• fix: return empty if table does not exist in get_columns (dbt-labs#199)

  

  Jrmyy

  authored and

  Avinash-1394

  committed
  fed0dfa

  Copy full SHA for fed0dfa

• fix: check for empty workgroup in profiles (dbt-labs#194)

  

  nicor88

  authored and

  Avinash-1394

  committed
  f5c8167

  Copy full SHA for f5c8167

• chore: add credits section (dbt-labs#201)

  

  mattiamatrix

  authored and

  Avinash-1394

  committed
  785ba5f

  Copy full SHA for 785ba5f

• fix: enable database in policy to support cross-account queries (dbt-labs#200)

  Show description for ee8bf95
  

  2 peopleauthored and

  Avinash-1394

  committed
  ee8bf95

  Copy full SHA for ee8bf95

• fix: glue column types (dbt-labs#196)

  Show description for 414c739
  

  3 peopleauthored and

  Avinash-1394

  committed
  414c739

  Copy full SHA for 414c739

• docs: add nicor88 as a contributor for code (dbt-labs#205)

  Show description for 6ad67e7
  

  allcontributors[bot]

  authored and

  Avinash-1394

  committed
  6ad67e7

  Copy full SHA for 6ad67e7

• docs: add jessedobbelaere as a contributor for bug (dbt-labs#210)

  Show description for 1c35b6e
  

  allcontributors[bot]

  authored and

  Avinash-1394

  committed
  1c35b6e

  Copy full SHA for 1c35b6e

• docs: add lemiffe as a contributor for design (dbt-labs#209)

  Show description for 3150170
  

  2 peopleauthored and

  Avinash-1394

  committed
  3150170

  Copy full SHA for 3150170

• docs: add jessedobbelaere as a contributor for maintenance (dbt-labs#212)

  Show description for 4074bc7
  

  allcontributors[bot]

  authored and

  Avinash-1394

  committed
  4074bc7

  Copy full SHA for 4074bc7

• docs: add Jrmyy as a contributor for maintenance (dbt-labs#207)

  Show description for 439bc75
  

  2 peopleauthored and

  Avinash-1394

  committed
  439bc75

  Copy full SHA for 439bc75

• docs: add dbt-athena-logo (dbt-labs#211)

  

  mattiamatrix

  authored and

  Avinash-1394

  committed
  3d31ab9

  Copy full SHA for 3d31ab9

• docs: update readme (dbt-labs#204)

  

  mattiamatrix

  authored and

  Avinash-1394

  committed
  02c21a3

  Copy full SHA for 02c21a3

• docs: add Tomme as a contributor for maintenance (dbt-labs#214)

  Show description for 8c850a9
  

  allcontributors[bot]

  authored and

  Avinash-1394

  committed
  8c850a9

  Copy full SHA for 8c850a9

• docs: add mattiamatrix as a contributor for maintenance (dbt-labs#216)

  Show description for 0f50a01
  

  allcontributors[bot]

  authored and

  Avinash-1394

  committed
  0f50a01

  Copy full SHA for 0f50a01

• chore: Update pytest requirement from ~=7.2 to ~=7.3 (dbt-labs#218)

  Show description for e73ef90
  

  dependabot[bot]

  authored and

  Avinash-1394

  committed
  e73ef90

  Copy full SHA for e73ef90

• chore: Update pyathena requirement from ~=2.23 to ~=2.24 (dbt-labs#217)

  Show description for 8f17ea9
  

  3 peopleauthored and

  Avinash-1394

  committed
  8f17ea9

  Copy full SHA for 8f17ea9

• fix: broken drop view query (dbt-labs#221)

  Show description for e461f0a
  

  2 peopleauthored and

  Avinash-1394

  committed
  e461f0a

  Copy full SHA for e461f0a

• fix: allow to set table location when output location is configured but not enforced (dbt-labs#223)

  Show description for 386ec47
  

  2 peopleauthored and

  Avinash-1394

  committed
  386ec47

  Copy full SHA for 386ec47

• fix: reading README.md (dbt-labs#225)

  

  CommonCrisis

  authored and

  Avinash-1394

  committed
  067d66f

  Copy full SHA for 067d66f

Commits on Apr 20, 2023

• Merge branch 'main' into add-python-model-support

  Avinash-1394

  committed
  8e21fcb

  Copy full SHA for 8e21fcb

Commits on Apr 21, 2023

• Added tests

  Avinash-1394

  committed
  1beb024

  Copy full SHA for 1beb024

• Added more tests

  Avinash-1394

  committed
  84c9d50

  Copy full SHA for 84c9d50

• Merge branch 'main' into add-python-model-support

  Avinash-1394

  committed
  355948a

  Copy full SHA for 355948a

• Fixed mypy errors

  Avinash-1394

  committed
  0693fa9

  Copy full SHA for 0693fa9

• Formatting

  Avinash-1394

  committed
  eac0504

  Copy full SHA for eac0504

• Simplified patches

  Avinash-1394

  committed
  589715e

  Copy full SHA for 589715e

• Fixed imports

  Avinash-1394

  committed
  4c43d49

  Copy full SHA for 4c43d49

Commits on Apr 23, 2023

• Added docs to tests and added kwargs

  Avinash-1394

  committed
  de12fd2

  Copy full SHA for de12fd2

• Fixed whitespace

  Avinash-1394

  committed
  8e1bf6f

  Copy full SHA for 8e1bf6f

• Fixed whitespace

  Avinash-1394

  committed
  352e1f6

  Copy full SHA for 352e1f6

• Added overrides to source and ref

  Avinash-1394

  committed
  25531c9

  Copy full SHA for 25531c9

Commits on Apr 24, 2023

• Added support for configuring table output

  Avinash-1394

  committed
  f86159d

  Copy full SHA for f86159d

• Renamed functions and fixed minor bugs

  Avinash-1394

  committed
  883519e

  Copy full SHA for 883519e

• Fixed CI

  Avinash-1394

  committed
  890b601

  Copy full SHA for 890b601

• Fix names in test

  Avinash-1394

  committed
  ee9bfd8

  Copy full SHA for ee9bfd8

Commits on Apr 26, 2023

• Handle botocore client error

  Avinash-1394

  committed
  24cb7ff

  Copy full SHA for 24cb7ff

Commits on Apr 30, 2023

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  e1b19e4

  Copy full SHA for e1b19e4

• Fix conflict

  Avinash-1394

  committed
  08ec29f

  Copy full SHA for 08ec29f

Commits on May 3, 2023

• Added threading support

  Avinash-1394

  committed
  2720dfc

  Copy full SHA for 2720dfc

Commits on May 5, 2023

• Added tests for python job helper

  Avinash-1394

  committed
  71cd4ee

  Copy full SHA for 71cd4ee

• Fix flake8 tests

  Avinash-1394

  committed
  e61c4d9

  Copy full SHA for e61c4d9

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  82296ab

  Copy full SHA for 82296ab

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  edfec3f

  Copy full SHA for edfec3f

Commits on May 7, 2023

• Added tests for listing and updating sessions

  Avinash-1394

  committed
  2dc8afd

  Copy full SHA for 2dc8afd

Commits on May 8, 2023

• Added docs to tests

  Avinash-1394

  committed
  f281a06

  Copy full SHA for f281a06

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  authored
  22ce37b

  Copy full SHA for 22ce37b

Commits on May 26, 2023

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  10461ed

  Copy full SHA for 10461ed

Commits on May 28, 2023

• Split the class objects into separate modules. Handled threading deadlocks.

  Avinash-1394

  committed
  0038628

  Copy full SHA for 0038628

Commits on Jun 7, 2023

• Merge branch 'main' into support-python-submissions

  Jrmyy

  authored
  3a33445

  Copy full SHA for 3a33445

Commits on Jun 11, 2023

• Extracted session_count and spark work group methods

  Avinash-1394

  committed
  76c5c88

  Copy full SHA for 76c5c88

• fix: BatchDeletePartitions only accepts up to 25 partitions (dbt-labs#328)

  

  juliansteger-sc

  authored and

  Avinash-1394

  committed
  1fd436e

  Copy full SHA for 1fd436e

• feat: enable mypy pre-commit check (dbt-labs#329)

  

  svdimchenko

  authored and

  Avinash-1394

  committed
  0bdaa7e

  Copy full SHA for 0bdaa7e

• chore: Update dbt-tests-adapter requirement from ~=1.5.0 to ~=1.5.1 (dbt-labs#325)

  Show description for ed56cfe
  

  dependabot[bot]

  authored and

  Avinash-1394

  committed
  ed56cfe

  Copy full SHA for ed56cfe

• Fixed readme. Moved some defaults to constants.

  Avinash-1394

  committed
  c24d65a

  Copy full SHA for c24d65a

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  49ba924

  Copy full SHA for 49ba924

Commits on Jun 14, 2023

• Add more docs and functional tests.

  Avinash-1394

  committed
  209e02c

  Copy full SHA for 209e02c

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  d044c35

  Copy full SHA for d044c35

Commits on Sep 26, 2023

• Merge branch 'main' into support-python-submissions

  

  Personal

  authored and

  Personal

  committed
  cad13db

  Copy full SHA for cad13db

Commits on Sep 28, 2023

• Used default logger

  

  Personal

  authored and

  Personal

  committed
  f56c2e8

  Copy full SHA for f56c2e8

• Used default logger

  

  Personal

  authored and

  Personal

  committed
  81d499a

  Copy full SHA for 81d499a

• Fix isort

  

  Personal

  authored and

  Personal

  committed
  213ee65

  Copy full SHA for 213ee65

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  authored
  9aead54

  Copy full SHA for 9aead54

Commits on Oct 5, 2023

• Merge branch 'main' into support-python-submissions

  nicor88

  authored
  a3da02b

  Copy full SHA for a3da02b

Commits on Oct 6, 2023

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  6c72e7d

  Copy full SHA for 6c72e7d

Commits on Oct 10, 2023

• Support additional arguments for create_table_as with dispatch. Call python code only from main call due to core restriction.

  Avinash-1394

  committed
  ea38eee

  Copy full SHA for ea38eee

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  8d1848d

  Copy full SHA for 8d1848d

• Provide language as argument instead of kwarg. Reduce diff in connections aftr merge

  Avinash-1394

  committed
  5060ae5

  Copy full SHA for 5060ae5

• Restore diff in connections and fix functional test for constraint

  Avinash-1394

  committed
  88e8e44

  Copy full SHA for 88e8e44

• Restore test_constraint

  Avinash-1394

  committed
  855bd6d

  Copy full SHA for 855bd6d

• Disable python functional test until spark work group is added and IAM is modified

  Avinash-1394

  committed
  8153d20

  Copy full SHA for 8153d20

• Reduce diff in connections

  Avinash-1394

  committed
  1effdbc

  Copy full SHA for 1effdbc

Commits on Nov 23, 2023

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  a49102a

  Copy full SHA for a49102a

• Break engine config into three variables

  Avinash-1394

  committed
  9edb519

  Copy full SHA for 9edb519

• Add method to create session from credentials. Supply boto3 config to athena client

  Avinash-1394

  committed
  eb2d92d

  Copy full SHA for eb2d92d

Commits on Nov 29, 2023

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  6e16e45

  Copy full SHA for 6e16e45

Commits on Jan 2, 2024

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  c2efdb2

  Copy full SHA for c2efdb2

Commits on Jan 3, 2024

• feat: enable iceberg table format for athena spark

  

  snagapuri

  committed
  4dd9f94

  Copy full SHA for 4dd9f94

• fix: empty code submissions

  Show description for 200a8fe
  

  snagapuri

  committed
  200a8fe

  Copy full SHA for 200a8fe

• Merge branch 'support-python-submissions' into support-python-submissions

  sankeerthnagapuri

  authored
  a24b1fe

  Copy full SHA for a24b1fe

Commits on Jan 10, 2024

• fix: remove references to obsolete config - spark_threads

  

  snagapuri

  committed
  89d2d92

  Copy full SHA for 89d2d92

• Merge branch 'support-python-submissions' of https://github.com/sankeerthnagapuri/dbt-athena-py-model into support-python-submissions

  

  snagapuri

  committed
  9de42be

  Copy full SHA for 9de42be

Commits on Jan 11, 2024

• fix: precommit

  

  snagapuri

  committed
  217d751

  Copy full SHA for 217d751

Commits on Jan 13, 2024

• fix: 3.9 compatability

  

  snagapuri

  committed
  5368981

  Copy full SHA for 5368981

• chore: readme update config for spark iceberg model example

  

  snagapuri

  committed
  e1e80dc

  Copy full SHA for e1e80dc

Commits on Jan 15, 2024

• fix: test config and remove obselete functions' tests

  

  snagapuri

  committed
  e3eb149

  Copy full SHA for e3eb149

• fix: precommit

  

  snagapuri

  committed
  7c45844

  Copy full SHA for 7c45844

Commits on Jan 17, 2024

• fix: unit tests

  

  snagapuri

  committed
  e571f6a

  Copy full SHA for e571f6a

• Merge pull request #1 from sankeerthnagapuri/support-python-submissions

  Show description for c6fcf80
  Avinash-1394

  authored
  c6fcf80

  Copy full SHA for c6fcf80

Commits on Jan 20, 2024

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  committed
  65625ab

  Copy full SHA for 65625ab

• Comment out python submissions functional test

  Avinash-1394

  committed
  cb4a999

  Copy full SHA for cb4a999

Commits on Feb 5, 2024

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  authored
  016f5f5

  Copy full SHA for 016f5f5

• Merge branch 'main' into support-python-submissions

  Avinash-1394

  authored
  c256e9e

  Copy full SHA for c256e9e