用ipython 写spark

只需要在pyspark文件里做出如下修改就行:

# Default to standard python interpreter unless told otherwise
if [[ -z "$PYSPARK_DRIVER_PYTHON" ]]; then
  PYSPARK_DRIVER_PYTHON="${PYSPARK_PYTHON:-"ipython"}"
fi

这里写图片描述

posted @ 2022-08-19 22:59  luoganttcc  阅读(20)  评论(0)    收藏  举报