摘要:
pip install apache-airflow-providers-apache-spark Got below error when ran the above command: pip._vendor.resolvelib.resolvers.ResolutionTooDeep: 2000
阅读全文
posted @ 2025-12-16 23:20
ZhangZhihuiAAA
阅读(5)
推荐(0)
摘要:
The SparkOperator in Apache Airflow is used to submit Spark applications (usually via spark-submit) from an Airflow DAG. Below is a clear, practical g
阅读全文
posted @ 2025-12-16 21:55
ZhangZhihuiAAA
阅读(4)
推荐(0)
摘要:
ZhangZhihui@ZZHPC MINGW64 /e/WeChatProjects/MySongList $ git init Initialized empty Git repository in E:/WeChatProjects/MySongList/.git/ ZhangZhihui@Z
阅读全文
posted @ 2025-12-16 19:10
ZhangZhihuiAAA
阅读(4)
推荐(0)
摘要:
from __future__ import annotations import datetime from airflow.providers.standard.operators.empty import EmptyOperator from airflow.providers.standar
阅读全文
posted @ 2025-12-16 15:58
ZhangZhihuiAAA
阅读(4)
推荐(0)
摘要:
In Airflow, what's the difference between TaskMarker and TaskSensor? In Airflow, TaskSensor and TaskMarker both relate to dependencies between DAGs, b
阅读全文
posted @ 2025-12-16 11:24
ZhangZhihuiAAA
阅读(3)
推荐(0)
摘要:
""" Example DAG demonstrating the usage of dynamic task mapping with non-TaskFlow operators. """ from __future__ import annotations from datetime impo
阅读全文
posted @ 2025-12-16 10:07
ZhangZhihuiAAA
阅读(7)
推荐(0)
摘要:
from __future__ import annotations from datetime import datetime from airflow.sdk import DAG, task with DAG( dag_id='example_dynamic_task_mapping', st
阅读全文
posted @ 2025-12-16 09:34
ZhangZhihuiAAA
阅读(4)
推荐(0)