Packages

  • package root

    Snowpark by itself is a powerful library, but still some utility functions can always help.

    Snowpark by itself is a powerful library, but still some utility functions can always help.

    snowpark-extensions

    Snowpark by itself is a powerful library, but still some utility functions can always help.

    The source code for this library is available here

    Installation

    With Maven you can add something like this to your POM:

    <dependency>
    <groupId>net.mobilize.snowpark-extensions</groupId>
    <artifactId>snowparkextensions</artifactId>
    <version>0.0.9</version>
</dependency>

    or with sbt use

    libraryDependencies += "net.mobilize.snowpark-extensions" % "snowparkextensions" % "0.0.16"

    Usage

    just import it at the top of your file and it will automatically extend your snowpark package.

    For example: 

    


    import com.snowflake.snowpark_extensions.Extensions._
import com.snowflake.snowpark.Session

val new_session = Session.builder.from_snowsql().appName("app1").create()

    Extensions

    See Session Extensions
    See Session Builder Extensions
    See DataFrame Extensions
    See Column Extensions
    See Function Extensions

    Definition Classes
    root
  • package com
    Definition Classes
    root
  • package snowflake
    Definition Classes
    com
  • package snowpark_extensions
    Definition Classes
    snowflake
  • package helpers
    Definition Classes
    snowpark_extensions
  • BuiltinOverrides
  • ColumnsSimplifier
  • package implicits
    Definition Classes
    snowpark_extensions

package helpers

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. class ColumnsSimplifier extends AnyRef

    Column simplifier helper class.

    Column simplifier helper class. Abstracts some column operations for a dataframe. Applied automatically to a dataframe when using the DataframeExtensions implicit class.

    Its purpose is to provide a helper to increase performance when performing multiple withColumn operations. This because Snowpark performs these operations immediately when executing, contrary to Spark that performs the operations when a .show(), .collect() or other functions are called.

    What this class do is collect a series of withColumn operations that should be applied to a DataFrame, and groups them to execute them in bulk when the .endCols function is called.

Value Members

  1. object BuiltinOverrides

    Object that contains override for Snowflake built-in functions that do not have the same behavior as Spark.

Ungrouped