Manifest Checks: Models#
Note
The below checks require manifest.json
to be present.
Classes:
Name | Description |
---|---|
CheckModelAccess |
Models must have the specified access attribute. Requires dbt 1.7+. |
CheckModelCodeDoesNotContainRegexpPattern |
The raw code for a model must not match the specified regexp pattern. |
CheckModelContractsEnforcedForPublicModel |
Public models must have contracts enforced. |
CheckModelDependsOnMacros |
Models must depend on the specified macros. |
CheckModelDependsOnMultipleSources |
Models cannot reference more than one source. |
CheckModelDescriptionContainsRegexPattern |
Models must have a description that matches the provided pattern. |
CheckModelDescriptionPopulated |
Models must have a populated description. |
CheckModelDirectories |
Only specified sub-directories are permitted. |
CheckModelDocumentedInSameDirectory |
Models must be documented in the same directory where they are defined (i.e. |
CheckModelGrantPrivilege |
Model can have grant privileges that match the specified pattern. |
CheckModelGrantPrivilegeRequired |
Model must have the specified grant privilege. |
CheckModelHasContractsEnforced |
Model must have contracts enforced. |
CheckModelHasMetaKeys |
The |
CheckModelHasNoUpstreamDependencies |
Identify if models have no upstream dependencies as this likely indicates hard-coded tables references. |
CheckModelHasSemiColon |
Model may not end with a semi-colon ( |
CheckModelHasTags |
Models must have the specified tags. |
CheckModelHasUniqueTest |
Models must have a test for uniqueness of a column. |
CheckModelHasUnitTests |
Models must have more than the specified number of unit tests. |
CheckModelLatestVersionSpecified |
Check that the |
CheckModelMaxChainedViews |
Models cannot have more than the specified number of upstream dependents that are not tables. |
CheckModelMaxFanout |
Models cannot have more than the specified number of downstream models. |
CheckModelMaxNumberOfLines |
Models may not have more than the specified number of lines. |
CheckModelMaxUpstreamDependencies |
Limit the number of upstream dependencies a model has. |
CheckModelNames |
Models must have a name that matches the supplied regex. |
CheckModelNumberOfGrants |
Model can have the specified number of privileges. |
CheckModelPropertyFileLocation |
Model properties files must follow the guidance provided by dbt here. |
CheckModelSchemaName |
Models must have a schema name that matches the supplied regex. |
CheckModelVersionAllowed |
Check that the version of the model matches the supplied regex pattern. |
CheckModelVersionPinnedInRef |
Check that the version of the model is always specified in downstream nodes. |
CheckModelsDocumentationCoverage |
Set the minimum percentage of models that have a populated description. |
CheckModelsTestCoverage |
Set the minimum percentage of models that have at least one test. |
CheckModelAccess
#
Models must have the specified access attribute. Requires dbt 1.7+.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
access
|
Literal['private', 'protected', 'public']
|
The access level to check for. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
# Align with dbt best practices that marts should be `public`, everything else should be `protected`
- name: check_model_access
access: protected
include: ^models/intermediate
- name: check_model_access
access: public
include: ^models/marts
- name: check_model_access
access: protected
include: ^models/staging
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelCodeDoesNotContainRegexpPattern
#
The raw code for a model must not match the specified regexp pattern.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
regexp_pattern
|
str
|
The regexp pattern that should not be matched by the model code. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
# Prefer `coalesce` over `ifnull`: https://docs.sqlfluff.com/en/stable/rules.html#sqlfluff.rules.sphinx.Rule_CV02
- name: check_model_code_does_not_contain_regexp_pattern
regexp_pattern: .*[i][f][n][u][l][l].*
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelContractsEnforcedForPublicModel
#
Public models must have contracts enforced.
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelDependsOnMacros
#
Models must depend on the specified macros.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
criteria
|
(Optional[Literal["any", "all", "one"]]): Whether the model must depend on any, all, or exactly one of the specified macros. Default: |
required | |
required_macros
|
(List[str]): List of macros the model must depend on. All macros must specify a namespace, e.g. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_depends_on_macros
required_macros:
- dbt.is_incremental
- name: check_model_depends_on_macros
criteria: one
required_macros:
- my_package.sampler
- my_package.sampling
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelDependsOnMultipleSources
#
Models cannot reference more than one source.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
model
|
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
required |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelDescriptionContainsRegexPattern
#
Models must have a description that matches the provided pattern.
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
regexp_pattern |
str
|
The regexp pattern that should match the model description. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_description_contains_regex_pattern
- regex_pattern: .*pattern_to_match.*
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelDescriptionPopulated
#
Models must have a populated description.
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelDirectories
#
Only specified sub-directories are permitted.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
include
|
str
|
Regex pattern to the directory to check. |
required |
permitted_sub_directories
|
List[str]
|
List of permitted sub-directories. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_directories
include: models
permitted_sub_directories:
- intermediate
- marts
- staging
# Restrict sub-directories within `./models/staging`
- name: check_model_directories
include: ^models/staging
permitted_sub_directories:
- crm
- payments
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelDocumentedInSameDirectory
#
Models must be documented in the same directory where they are defined (i.e. .yml
and .sql
files are in the same directory).
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelGrantPrivilege
#
Model can have grant privileges that match the specified pattern.
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
privilege_pattern |
str
|
Regex pattern to match the privilege. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_grant_privilege
include: ^models/marts
privilege_pattern: ^select
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelGrantPrivilegeRequired
#
Model must have the specified grant privilege.
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
privilege |
str
|
The privilege that is required. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_grant_privilege_required
include: ^models/marts
privilege: select
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelHasContractsEnforced
#
Model must have contracts enforced.
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelHasMetaKeys
#
The meta
config for models must have the specified keys.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
keys
|
NestedDict
|
A list (that may contain sub-lists) of required keys. |
required |
model
|
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
required |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelHasNoUpstreamDependencies
#
Identify if models have no upstream dependencies as this likely indicates hard-coded tables references.
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelHasSemiColon
#
Model may not end with a semi-colon (;
).
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelHasTags
#
Models must have the specified tags.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
criteria
|
(Optional[Literal["any", "all", "one"]]): Whether the model must have any, all, or exactly one of the specified tags. Default: |
required | |
model
|
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
required |
tags
|
List[str]
|
List of tags to check for. |
required |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelHasUniqueTest
#
Models must have a test for uniqueness of a column.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
accepted_uniqueness_tests
|
Optional[List[str]]
|
List of tests that are accepted as uniqueness tests. |
required |
model
|
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
required |
tests
|
List[DbtBouncerTestBase]
|
List of DbtBouncerTestBase objects parsed from |
required |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
# Example of allowing a custom uniqueness test
- name: check_model_has_unique_test
accepted_uniqueness_tests:
- dbt_expectations.expect_compound_columns_to_be_unique # i.e. tests from packages must include package name
- my_custom_uniqueness_test
- unique
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelHasUnitTests
#
Models must have more than the specified number of unit tests.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
min_number_of_unit_tests
|
Optional[int]
|
The minimum number of unit tests that a model must have. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
manifest_obj |
DbtBouncerManifest
|
The DbtBouncerManifest object parsed from |
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
unit_tests |
List[UnitTests]
|
List of UnitTests objects parsed from |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Warning
This check is only supported for dbt 1.8.0 and above.
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelLatestVersionSpecified
#
Check that the latest_version
attribute of the model is set.
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelMaxChainedViews
#
Models cannot have more than the specified number of upstream dependents that are not tables.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
materializations_to_include
|
Optional[List[str]]
|
List of materializations to include in the check. |
required |
max_chained_views
|
Optional[int]
|
The maximum number of upstream dependents that are not tables. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
models |
List[DbtBouncerModelBase]
|
List of DbtBouncerModelBase objects parsed from |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_max_chained_views
materializations_to_include:
- ephemeral
- my_custom_materialization
- view
max_chained_views: 5
Source code in src/dbt_bouncer/checks/manifest/check_models.py
838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 |
|
CheckModelMaxFanout
#
Models cannot have more than the specified number of downstream models.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
max_downstream_models
|
Optional[int]
|
The maximum number of permitted downstream models. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
models |
List[DbtBouncerModelBase]
|
List of DbtBouncerModelBase objects parsed from |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelMaxNumberOfLines
#
Models may not have more than the specified number of lines.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
max_number_of_lines
|
int
|
The maximum number of permitted lines. |
required |
model
|
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
required |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelMaxUpstreamDependencies
#
Limit the number of upstream dependencies a model has.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
max_upstream_macros
|
Optional[int]
|
The maximum number of permitted upstream macros. |
required |
max_upstream_models
|
Optional[int]
|
The maximum number of permitted upstream models. |
required |
max_upstream_sources
|
Optional[int]
|
The maximum number of permitted upstream sources. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelNames
#
Models must have a name that matches the supplied regex.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
model_name_pattern
|
str
|
Regexp the model name must match. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_names
include: ^models/intermediate
model_name_pattern: ^int_
- name: check_model_names
include: ^models/staging
model_name_pattern: ^stg_
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelNumberOfGrants
#
Model can have the specified number of privileges.
Receives at execution time:
Name | Type | Description |
---|---|---|
max_number_of_privileges |
Optional(int)
|
Maximum number of privileges, inclusive. |
min_number_of_privileges |
Optional(int)
|
Minimum number of privileges, inclusive. |
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_number_of_grants
include: ^models/marts
max_number_of_privileges: 1 # Optional
min_number_of_privileges: 0 # Optional
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelPropertyFileLocation
#
Model properties files must follow the guidance provided by dbt here.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
model
|
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
required |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelSchemaName
#
Models must have a schema name that matches the supplied regex.
Note that most setups will use schema names in development that are prefixed, for example: * dbt_jdoe_stg_payments * mary_stg_payments
Please account for this if you wish to run dbt-bouncer
against locally generated manifests.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
schema_name_pattern
|
str
|
Regexp the schema name must match. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_schema_name
include: ^models/intermediate
schema_name_pattern: .*intermediate # Accounting for schemas like `dbt_jdoe_intermediate`.
- name: check_model_schema_name
include: ^models/staging
schema_name_pattern: .*stg_.*
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelVersionAllowed
#
Check that the version of the model matches the supplied regex pattern.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
version_pattern
|
str
|
Regexp the version must match. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_version_allowed
include: ^models/marts
version_pattern: >- # Versions must be numeric
[0-9]\d*
- name: check_model_version_allowed
include: ^models/marts
version_pattern: ^(stable|latest)$ # Version can be "stable" or "latest", nothing else is permitted
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelVersionPinnedInRef
#
Check that the version of the model is always specified in downstream nodes.
Receives at execution time:
Name | Type | Description |
---|---|---|
manifest_obj |
DbtBouncerManifest
|
The DbtBouncerManifest object parsed from |
model |
DbtBouncerModelBase
|
The DbtBouncerModelBase object to check. |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
exclude |
Optional[str]
|
Regex pattern to match the model path. Model paths that match the pattern will not be checked. |
include |
Optional[str]
|
Regex pattern to match the model path. Only model paths that match the pattern will be checked. |
materialization |
Optional[Literal['ephemeral', 'incremental', 'table', 'view']]
|
Limit check to models with the specified materialization. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
Source code in src/dbt_bouncer/checks/manifest/check_models.py
CheckModelsDocumentationCoverage
#
Set the minimum percentage of models that have a populated description.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
min_model_documentation_coverage_pct
|
float
|
The minimum percentage of models that must have a populated description. |
required |
Receives at execution time:
Name | Type | Description |
---|---|---|
models |
List[DbtBouncerModelBase]
|
List of DbtBouncerModelBase objects parsed from |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):
manifest_checks:
- name: check_model_documentation_coverage
min_model_documentation_coverage_pct: 90
Source code in src/dbt_bouncer/checks/manifest/check_models.py
1384 1385 1386 1387 1388 1389 1390 1391 1392 1393 1394 1395 1396 1397 1398 1399 1400 1401 1402 1403 1404 1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416 1417 1418 1419 1420 1421 1422 1423 1424 1425 1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438 1439 1440 1441 1442 1443 1444 1445 |
|
CheckModelsTestCoverage
#
Set the minimum percentage of models that have at least one test.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
min_model_test_coverage_pct
|
float
|
The minimum percentage of models that must have at least one test. |
required |
models
|
List[DbtBouncerModelBase]
|
List of DbtBouncerModelBase objects parsed from |
required |
tests
|
List[DbtBouncerTestBase]
|
List of DbtBouncerTestBase objects parsed from |
required |
Other Parameters (passed via config file):
Name | Type | Description |
---|---|---|
description |
Optional[str]
|
Description of what the check does and why it is implemented. |
severity |
Optional[Literal['error', 'warn']]
|
Severity level of the check. Default: |
Example(s):