用spark-submit将py提交到yarn时警告
WARN Client: Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME.
解决办法
到SPARK_HOME中找到jars文件夹，将它们打包
jar cv0f spark-libs.jar -C $SPARK_HOME/jars/ .
hdfs dfs -put spark-libs.jar /spark/jars
然后再到$SPARK_HOME/conf/spark-env.sh中添加
spark.yarn.archive hdfs://localhost:8020/spark/jars/spark-libs.jar
保存即可
