Data Lake (Snowflake)

Technical Description of Data Lake (Snowflake) within Prod OMNIA Partners EDW at 25-Mar-2025 12:24:42

Connection Type
Database
Connection Method
IP
Odbc Source
Snowflake_Data_Lake
Provider Name
Database Id
OPDATALAKE
Database Link Id
Extract User Id
WHERESCAPEHELPER
Admin User Id
Enable Automatic Index Creation
No

DB Type
SNOWFLAKE*
Default Load Type
Database link
Default Load Script Connection
Runtime Connection for Scripts
Default Load Schema
Default Update Script Connection
Runtime Connection for Scripts
Notes
OMNIA's data lake (in Snowflake). Our intent is to land all data from various systems into this database.

Template Defaults

Object Type	Object Subtype	Operation Type	Default Template Name
Export		Export Script	wsl_snowflake_pscript_export
Stage Table	Stage	Update Procedure	wsl_snowflake_pscript_stage
Stage Table	Data Vault Stage	Update Procedure	wsl_snowflake_pscript_dv_stage
Stage Table	Work Table	Update Procedure	wsl_snowflake_pscript_stage
Data Store	Data Store	Update Procedure	wsl_snowflake_pscript_perm
Data Store	History	Update Procedure	wsl_snowflake_pscript_hist
Hub	Detail	Update Procedure	wsl_snowflake_pscript_dv_perm
Link	Detail	Update Procedure	wsl_snowflake_pscript_dv_perm
Satellite	History	Update Procedure	wsl_snowflake_pscript_dv_perm
EDW 3NF	Normalized	Update Procedure	wsl_snowflake_pscript_perm
EDW 3NF	History	Update Procedure	wsl_snowflake_pscript_hist
Dimension	Dimension	Update Procedure	wsl_snowflake_pscript_perm
Dimension	Changing Dimension	Update Procedure	wsl_snowflake_pscript_hist
Dimension	Previous Dimension	Update Procedure	wsl_snowflake_pscript_perm
Dimension	Ranged Dimension	Update Procedure	wsl_snowflake_pscript_perm
Dimension	Time Dimension	Update Procedure	wsl_snowflake_pscript_perm
Dimension	Mapping Table	Update Procedure	wsl_snowflake_pscript_perm
Dimension	Work Table	Update Procedure	wsl_snowflake_pscript_perm
Fact Table	Detail	Update Procedure	wsl_snowflake_pscript_perm
Aggregate	Aggregate	Update Procedure	wsl_snowflake_pscript_perm
Aggregate	Summary	Update Procedure	wsl_snowflake_pscript_perm
Aggregate	Work Table	Update Procedure	wsl_snowflake_pscript_perm
Extensions	Detail	Update Procedure	wsl_snowflake_pscript_perm
Load Table		Custom Procedure	wsl_snowflake_pscript_set_inc_param

Extended Properties

Display Name	Variable Name	Value
DEBUG_MODE	SF_DEBUG_MODE	FALSE
SNOWSQL_ACCOUNT	SF_SNOWSQL_ACCOUNT	YW30645.EAST-US-2.AZURE
SNOWSQL_DATABASE	SF_SNOWSQL_DATABASE	OMNIAPARTNERSDW
SNOWSQL_WAREHOUSE	SF_SNOWSQL_WAREHOUSE	WHERESCAPE
ACCESS_KEY	SF_ACCESS_KEY
SECRET_KEY	SF_SECRET_KEY
FILE_FORMAT	SF_FILE_FORMAT	FMT_RED_CSV_NOSKIP_GZIP_PIPE
SEND_FILES_ZIPPED	SF_SEND_FILES_ZIPPED	TRUE
SPLIT_FILE_THRESHOLD	SF_SPLIT_THRESHOLD	1000000
SPLIT_FILE_COUNT	SF_SPLIT_COUNT	100
UNICODE_SUPPORT	SF_UNICODE_SUPPORT	FALSE
TIMEZONE	SF_TIMEZONE
UNLOAD_DELIMITER	SF_UNLOAD_DELIMITER	\|
UNLOAD_ENCLOSED_BY	SF_UNLOAD_ENCLOSED_BY	"
UNLOAD_ESCAPE_CHAR	SF_UNLOAD_ESCAPE_CHAR	#
RANGE_CONCATWORD	RANGE_CONCATWORD	+
RANGE_EXTRACT_CHARSET	RANGE_EXTRACT_CHARSET	ASCII
RANGE_FAIL_ON_THREAD_FAILURE	RANGE_FAIL_ON_THREAD_FAILURE	FALSE
RANGE_MAX_THREAD_FAILURES	RANGE_MAX_THREAD_FAILURES	10
RANGE_THREAD_COUNT	RANGE_THREAD_COUNT	4
RANGE_UNLOAD_GZIP	RANGE_UNLOAD_GZIP	TRUE
RANGE_UPLOAD_MAX_RETRIES	RANGE_UPLOAD_MAX_RETRIES	3

Return to Top

Connection Type	Database
Connection Method	IP
Odbc Source	Snowflake_Data_Lake
Provider Name
Database Id	OPDATALAKE
Database Link Id
Extract User Id	WHERESCAPEHELPER
Admin User Id
Enable Automatic Index Creation	No

DB Type	SNOWFLAKE*
Default Load Type	Database link
Default Load Script Connection	Runtime Connection for Scripts
Default Load Schema
Default Update Script Connection	Runtime Connection for Scripts
Notes	OMNIA's data lake (in Snowflake). Our intent is to land all data from various systems into this database.