spark例子

https://www.union.ai/docs/v1/flyte/tutorials/model-training/forecasting-sales/

 

部署spark

https://blog.csdn.net/weixin_42478365/article/details/132810526

https://xuyinyin.cn/2025/07/08/spark-on-k8s/

https://www.cnblogs.com/regis-code/p/15470867.html

minikube 部署spark

https://www.cnblogs.com/moonlight-lin/p/15782301.html

 

https://wkbse.com/2025/05/07/%E5%A6%82%E4%BD%95%E9%AB%98%E6%95%88%E8%BF%90%E8%A1%8C-spark-on-k8s%EF%BC%9A%E9%85%8D%E7%BD%AE%E4%B8%8E%E8%B0%83%E4%BC%98%E7%A7%98%E7%B1%8D-wiki%E5%9F%BA%E5%9C%B0/

 

spark 大数据开发

https://zhuanlan.zhihu.com/p/667436952

RDD操作

https://zhuanlan.zhihu.com/p/657530614

MLOPs, kubeflow
https://zhuanlan.zhihu.com/p/667799845

https://zhuanlan.zhihu.com/p/395431025 

 

spark operator
https://kubeflow.org.cn/docs/components/spark-operator/performance/benchmarking/ 

 spark sql operator 封装

https://zhuanlan.zhihu.com/p/345214051

pyspark提交

https://zhuanlan.zhihu.com/p/101740397 

pyspark-client

https://spark.apache.ac.cn/docs/latest/api/python/getting_started/quickstart_connect.html 

spark-connect , kubernetes 

https://www.soinside.com/question/UdB8BfrczAkbuy3LdEqrcX

 

部署ray

pip install -U "ray[default,data]"

启动dashboard

ray start --head --dashboard-host=0.0.0.0 --dashboard-port=8265

ray status

停止服务

ray stop

 

cat /home/xiaof/.proxyrc

#!/bin/bash
host_ip=192.168.31.71
export ALL_PROXY="http://$host_ip:7901"
export NO_PROXY="localhost,127.0.0.1,::1,172.31.29.133/20"

 https://zhaojiew10.github.io/neonote/learning_ray/10ray%E9%9B%86%E7%BE%A4%E7%AE%A1%E7%90%86%E4%B8%8E%E9%83%A8%E7%BD%B2.html