Skip to content

Commit

Permalink
Merge pull request #23 from calogica/remove-spark-utils
Browse files Browse the repository at this point in the history
Removes spark-utils and updates README
  • Loading branch information
clausherther authored May 4, 2021
2 parents d48a0dc + ad83cf0 commit 9047404
Show file tree
Hide file tree
Showing 3 changed files with 17 additions and 5 deletions.
17 changes: 16 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,28 @@ FYI: this package includes [**dbt-utils**](https://github.com/fishtown-analytics

Include in `packages.yml`

```
```yaml
packages:
- package: calogica/dbt_date
version: [">=0.2.0", "<0.3.0"]
# <see https://github.com/calogica/dbt-date/releases/latest> for the latest version tag
```

Note: we no longer include `spark_utils` in this package to avoid versioning conflicts. If you are running this package on non-core (Snowflake, BigQuery, Redshift, Postgres) platforms, you will need to use a package like `spark_utils` to shim macros.

For example, in `packages.yml`, you will need to include the relevant package:

```yaml
- package: fishtown-analytics/spark_utils
version: <latest or range>
```
And reference in the dispatch list for `dbt_utils` in `dbt_project.yml`:
```yaml
vars:
dbt_utils_dispatch_list: [spark_utils]
```

## Variables
The following variables need to be defined in your `dbt_project.yml` file:

Expand Down
3 changes: 1 addition & 2 deletions integration_tests/dbt_project.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,6 @@ require-dbt-version: ">=0.18.1"

vars:
'dbt_date:time_zone': 'America/Los_Angeles'
dbt_utils_dispatch_list: [spark_utils]

quoting:
database: false
Expand All @@ -32,4 +31,4 @@ quoting:

models:
schema: dbt_date_integration_tests
materialized: table
materialized: table
2 changes: 0 additions & 2 deletions packages.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
packages:
- package: fishtown-analytics/dbt_utils
version: [">=0.6.0", "<0.7.0"]
- package: fishtown-analytics/spark_utils
version: 0.1.0

0 comments on commit 9047404

Please sign in to comment.