PR #45 includes the following updates:
- Added the following variables to account for potentially missing tables. For dbt Core users, each is
Trueby default and will need to be set toFalsein the root project'sdbt_project.yml. For Fivetran Quickstart users, they will be dynamically enabled/disabled based on the presence of the associated source table.github__using_issue_assignee: Disable if missingISSUE_ASSIGNEEgithub__using_issue_label: Disable if missingISSUE_LABELgithub__using_label: Disable if missingLABELgithub__using_requested_reviewer_history: Disable if missingREQUESTED_REVIEWER_HISTORY
- Updated package maintainer PR template.
PR #44 includes the following updates:
Note: This is not relevant to Fivetran Quickstart users.
Migrated freshness from a top-level source property to a source config in alignment with recent updates from dbt Core. This will resolve the following deprecation warning that users running dbt >= 1.9.6 may have received:
[WARNING]: Deprecated functionality
Found `freshness` as a top-level property of `github` in file
`models/src_github.yml`. The `freshness` top-level property should be moved
into the `config` of `github`.
IMPORTANT: Users running dbt Core < 1.9.6 will not be able to utilize freshness tests in this release or any subsequent releases, as older versions of dbt will not recognize freshness as a source config and therefore not run the tests.
If you are using dbt Core < 1.9.6 and want to continue running Github Source freshness tests, please elect one of the following options:
- (Recommended) Upgrade to dbt Core >= 1.9.6
- Do not upgrade your installed version of the
github_sourcepackage. Pin your dependency on v0.8.0 in yourpackages.ymlfile. - Utilize a dbt override to overwrite the package's
githubsource and apply freshness via the previous release top-level property route. This will require you to copy and paste the entirety of the previous releasesrc_github.ymlfile and add anoverrides: github_sourceproperty.
- Corrected references to connectors and connections in the README. (#42)
- Updates to ensure integration tests use latest version of dbt.
PR #39 contains the following updates:
- For consistency with other Fivetran packages, added default target schemas in
dbt_project.yml. This is a breaking change since the model outputs will now be stored in a schema called<your target schema>_github_sourceby default. You will need to update any of your downstream use cases to point to the new schema.- Refer to the Change the Build Schema section of the README for instructions on how to adjust the output schema.
- Added field
created_atto modelstg_github__issue_comment. - Updated the source freshness test enablement/disablement to leverage the dbt-core
config: enabledarchitecture.
- Updated
src_github.ymlto capitalize Fivetran in the loader definition, to mirror use in other Fivetran packages. (PR #37)
- Incorporated the new
fivetran_utils.drop_schemas_automationmacro into the end of each Buildkite integration test job. (PR #34) - Updated the pull request templates. (PR #34)
- Expanded the variable
github__using_repo_teamto also toggle on/off theTEAMtable along with and in addition to theREPO_TEAMtable. This was done to fix issues with dependent models in our transform package, whereTEAMis only ever used in conjunction withREPO_TEAM. (#32)
- PostgreSQL compatibility! (#32)
PR #26 includes the following breaking changes:
- Dispatch update for dbt-utils to dbt-core cross-db macros migration. Specifically
{{ dbt_utils.<macro> }}have been updated to{{ dbt.<macro> }}for the below macros:any_valuebool_orcast_bool_to_textconcatdate_truncdateadddatediffescape_single_quotesexcepthashintersectlast_daylengthlistaggpositionreplacerightsafe_castsplit_partstring_literaltype_biginttype_floattype_inttype_numerictype_stringtype_timestamparray_appendarray_concatarray_construct
- For
current_timestampandcurrent_timestamp_in_utcmacros, the dispatch AND the macro names have been updated to the below, respectively:dbt.current_timestamp_backcompatdbt.current_timestamp_in_utc_backcompat
- Dependencies on
fivetran/fivetran_utilshave been upgraded, previously[">=0.3.0", "<0.4.0"]now[">=0.4.0", "<0.5.0"].
- Updated README documentation for easier navigation and dbt package setup #26.
- Included the
github_[source_table_name]_identifiervariables for easier flexibility of the package models to refer to differently named sources tables #26. - Added Databricks compatibility #29.
- Addition of the
labelsource table. This was necessary as theissue_labeldepreciated thelabelcolumn. The respective label information will now be synced within thelabeltable. (#22)- If you do not have the new
labeltable in your source, we highly recommend you enable schema changes on your connector and kick off a resync to see the new tables reflected in your source.
- If you do not have the new
- Added the
{{ dbt_utils.type_timestamp() }}cast function to timestamp fields within the staging models. This is required for Redshift users that have the fields originally synced astimestamptz. Without the casting of fields the downstream date functions will fail. (#19)
🎉 dbt v1.0.0 Compatibility 🎉
- Adjusts the
require-dbt-versionto now be within the range [">=1.0.0", "<2.0.0"]. Additionally, the package has been updated for dbt v1.0.0 compatibility. If you are using a dbt version <1.0.0, you will need to upgrade in order to leverage the latest version of the package.- For help upgrading your package, I recommend reviewing this GitHub repo's Release Notes on what changes have been implemented since your last upgrade.
- For help upgrading your dbt project to dbt v1.0.0, I recommend reviewing dbt-labs upgrading to 1.0.0 docs for more details on what changes must be made.
- Upgrades the package dependency to refer to the latest
dbt_fivetran_utils. The latestdbt_fivetran_utilspackage also has a dependency ondbt_utils[">=0.8.0", "<0.9.0"].- Please note, if you are installing a version of
dbt_utilsin yourpackages.ymlthat is not in the range above then you will encounter a package dependency error.
- Please note, if you are installing a version of
Refer to the relevant release notes on the Github repository for specific details for the previous releases. Thank you!