ZhangZhihui's Blog  

2025年12月16日

摘要: pip install apache-airflow-providers-apache-spark Got below error when ran the above command: pip._vendor.resolvelib.resolvers.ResolutionTooDeep: 2000 阅读全文
posted @ 2025-12-16 23:20 ZhangZhihuiAAA 阅读(5) 评论(0) 推荐(0)
 
摘要: The SparkOperator in Apache Airflow is used to submit Spark applications (usually via spark-submit) from an Airflow DAG. Below is a clear, practical g 阅读全文
posted @ 2025-12-16 21:55 ZhangZhihuiAAA 阅读(4) 评论(0) 推荐(0)
 
摘要: ZhangZhihui@ZZHPC MINGW64 /e/WeChatProjects/MySongList $ git init Initialized empty Git repository in E:/WeChatProjects/MySongList/.git/ ZhangZhihui@Z 阅读全文
posted @ 2025-12-16 19:10 ZhangZhihuiAAA 阅读(4) 评论(0) 推荐(0)
 
摘要: from __future__ import annotations import datetime from airflow.providers.standard.operators.empty import EmptyOperator from airflow.providers.standar 阅读全文
posted @ 2025-12-16 15:58 ZhangZhihuiAAA 阅读(4) 评论(0) 推荐(0)
 
摘要: In Airflow, what's the difference between TaskMarker and TaskSensor? In Airflow, TaskSensor and TaskMarker both relate to dependencies between DAGs, b 阅读全文
posted @ 2025-12-16 11:24 ZhangZhihuiAAA 阅读(3) 评论(0) 推荐(0)
 
摘要: """ Example DAG demonstrating the usage of dynamic task mapping with non-TaskFlow operators. """ from __future__ import annotations from datetime impo 阅读全文
posted @ 2025-12-16 10:07 ZhangZhihuiAAA 阅读(7) 评论(0) 推荐(0)
 
摘要: from __future__ import annotations from datetime import datetime from airflow.sdk import DAG, task with DAG( dag_id='example_dynamic_task_mapping', st 阅读全文
posted @ 2025-12-16 09:34 ZhangZhihuiAAA 阅读(4) 评论(0) 推荐(0)