10
Stop mocking me! Unit tests in PySpark using Python’s mock library

Stop mocking me! Unit tests in PySpark using Python’s mock library

6 years ago
Anonymous $L9wC17otzH

https://towardsdatascience.com/stop-mocking-me-unit-tests-in-pyspark-using-pythons-mock-library-a4b5cd019d7e

Fundamental in software development, and often overlooked by data scientists, but important. In this post, I’ll show how to do unit testing in PySpark using Python’s unittest.mock library. I’ll do this from a data scientist’s perspective- to me that means that I won’t go into the software engineering details. I present just what you need to know.

First, a (semi) relevant clip from Family Guy:

Stop mocking me! Unit tests in PySpark using Python’s mock library

Nov 11, 2018, 11:14am UTC
https://towardsdatascience.com/stop-mocking-me-unit-tests-in-pyspark-using-pythons-mock-library-a4b5cd019d7e > Fundamental in software development, and often overlooked by data scientists, but important. In this post, I’ll show how to do unit testing in PySpark using Python’s unittest.mock library. I’ll do this from a data scientist’s perspective- to me that means that I won’t go into the software engineering details. I present just what you need to know. > First, a (semi) relevant clip from Family Guy: