摘要:
from __future__ import annotations import datetime from airflow.providers.standard.operators.empty import EmptyOperator from airflow.providers.standar
阅读全文
posted @ 2025-12-16 15:58
ZhangZhihuiAAA
阅读(4)
推荐(0)
摘要:
In Airflow, what's the difference between TaskMarker and TaskSensor? In Airflow, TaskSensor and TaskMarker both relate to dependencies between DAGs, b
阅读全文
posted @ 2025-12-16 11:24
ZhangZhihuiAAA
阅读(3)
推荐(0)
摘要:
""" Example DAG demonstrating the usage of dynamic task mapping with non-TaskFlow operators. """ from __future__ import annotations from datetime impo
阅读全文
posted @ 2025-12-16 10:07
ZhangZhihuiAAA
阅读(7)
推荐(0)
摘要:
from __future__ import annotations from datetime import datetime from airflow.sdk import DAG, task with DAG( dag_id='example_dynamic_task_mapping', st
阅读全文
posted @ 2025-12-16 09:34
ZhangZhihuiAAA
阅读(4)
推荐(0)
摘要:
In shell (especially POSIX shells like sh, bash, dash, zsh), : is a builtin command called the null command. What it does Does nothing Always succeeds
阅读全文
posted @ 2025-12-15 23:29
ZhangZhihuiAAA
阅读(4)
推荐(0)
摘要:
""" Example DAG for demonstrating the usage of event driven scheduling using assets and triggers. """ from __future__ import annotations from airflow.
阅读全文
posted @ 2025-12-15 22:30
ZhangZhihuiAAA
阅读(7)
推荐(0)
摘要:
dag1_asset = Asset('s3://dag1/output_1.txt', extra={"hi": "bye"}) In Airflow, the extra parameter on an Asset is free-form metadata you can attach to
阅读全文
posted @ 2025-12-15 20:46
ZhangZhihuiAAA
阅读(4)
推荐(0)
摘要:
In Airflow, AssetAlias is a way to define a logical alias (group name) for one or more assets, so that producers and consumers can be loosely coupled
阅读全文
posted @ 2025-12-15 17:48
ZhangZhihuiAAA
阅读(5)
推荐(0)
摘要:
In Apache Airflow, an asset is a logical representation of a piece of data that your workflows produce or consume, independent of where that data live
阅读全文
posted @ 2025-12-15 15:56
ZhangZhihuiAAA
阅读(6)
推荐(0)
摘要:
from __future__ import annotations import logging from datetime import datetime from airflow.sdk import dag, task log = logging.getLogger(__name__) @d
阅读全文
posted @ 2025-12-15 11:11
ZhangZhihuiAAA
阅读(2)
推荐(0)