How to do it...

When working with PySpark, a SparkSession must first be imported and initialized before any dataframe creation can occur:

1. Import a SparkSession using the following script:

from pyspark.sql import SparkSession

2. Configure a SparkSession:

spark = SparkSession.builder \
         .master("local") \
         .appName("Neural Network Model") \
         .config("spark.executor.memory", "6gb") \
         .getOrCreate()
sc = spark.sparkContext

3. In this situation, the SparkSession appName has been named Neural Network Model and 6gb has been assigned to the session memory.