Versions Compared

Old Version 18

changes.mady.by.user user-c32a8

Saved on

compared with

New Version Current

changes.mady.by.user Wes Johnson

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Warning
titleNew IoT Bridge for Snowflake Available

This document covers v2.0.0 and older versions of IoT Bridge for Snowflake. It now ships as part of Chariot. To see the latest IoT Bridge for Snowflake documentation, go to IoT Bridge for Snowflake in Chariot.

General

I am interested in IoT Bridge for Snowflake. How do I set it up?

...

  • Review our config docs and sanity check your configuration
  • Make sure Ingest user doesn’t have ‘must change password’ set to true
  • Ingest user has been granted the CL_BRIDGE_PROCESS_RL role

I am seeing "Throttled due to memory pressure" warnings in the log

The usual cause for this error is that Snowflake is throttling the data throughput because too much data is trying to be pushed through too few channels.

By default, in the ibsnow.properties configuration file, we use 'snowflake_streaming_channel_scheme = EDGE_ID' which means there is a channel per Sparkplug Edge Node.

We can increase the number of 'streaming channels' available for pushing to Snowflake streaming ingest services by modifying the schema to read 'snowflake_streaming_channel_scheme = DEVICE_ID' which will create a channel on a per Sparkplug Device basis.

By increasing the number of channels, we should be able to increase the throughput and free up the memory backup.