myspark still calls start-master.sh

[glennklockwood]

myspark still starts the master daemon using start-master.sh which contains the following code:

. "$sbin/spark-config.sh"

if [ -f "${SPARK_CONF_DIR}/spark-env.sh" ]; then
  . "${SPARK_CONF_DIR}/spark-env.sh"
fi

This causes start-master.sh to always ignore SPARK_CONF_DIR passed from the user environment, which can cause unexpected behavior within the myHadoop framework.