Today Mobilize.Net announced SnowConvert for PySpark Code Conversion Tool. This tool automatically converts Spark workloads written in Python to Snowpark and greatly reduces the time, cost, and risk to migration from Spark to Snowflake using Snowpark. More information on SnowConvert for PySpark can be found at https://www.mobilize.net/products/database-migrations/pyspark-to-snowflake.
SnowConvert for PySpark Technical Specifications
The migration experts at Mobilize.Net are available to transfer Apache Spark Python code (and any proprietary scripts) over to Snowflake. Specifically:
- Python functions utilizing the Spark API are converted to an equivalent that works inside of Snowflake utilizing the Snowpark API
- Spark SQL functions converted to UDF's in Snowflake SQL as either:
- Snowflake Scripting
Note that the source to target code pairs were developed in partnership with Snowflake Professional Services and are continuously refined. Read more about Snowflake's take on using SnowConvert for PySpark for assessment on their blog.
- SnowConvert for Python Product Page: https://www.mobilize.net/products/database-migrations/pyspark-to-snowflake
- SnowConvert for Spark Qualification Tool documentation page: https://docs.mobilize.net/snowconvert/for-spark-python/introduction