as a work around you either need to adjust the initial value of PYSPARK_SUBMIT_ARGS to have your packages or our jars but you cannot use both functions and construct a correct PYSPARK_SUBMIT_ARGS as both function add the fixed value of pyspark-shell to the end of the string when they are called.
as a work around you either need to adjust the initial value of PYSPARK_SUBMIT_ARGS to have your packages or our jars but you cannot use both functions and construct a correct PYSPARK_SUBMIT_ARGS as both function add the fixed value of pyspark-shell to the end of the string when they are called.