摘要：
To create a new connection, select the + to add a new record. from airflow.decorators import ( dag, task, ) from pendulum import datetime @dag( start_
阅读全文
posted @ 2025-01-19 22:38
ZhangZhihuiAAA
阅读(12)
推荐(0)
摘要：
To retrieve these images, I frequently make use of the NASA Astronomy Picture of the Day API (https://apod.nasa.gov/apod/astropix.html) to gather a ne
阅读全文
posted @ 2025-01-19 15:35
ZhangZhihuiAAA
阅读(36)
推荐(0)
摘要：
(.venv) frank@ZZHUBT:~/venvs/my_airflow_project$ airflow config get-value core executor SequentialExecutor
阅读全文
posted @ 2025-01-19 13:46
ZhangZhihuiAAA
阅读(15)
推荐(0)
摘要：
rank@ZZHUBT:~$ pip install airflowctl rank@ZZHUBT:~$ airflowctl init my_airflow_project --build-start ...... ebserver | [2025-01-18 20:46:08 +0800] [1
阅读全文
posted @ 2025-01-18 21:51
ZhangZhihuiAAA
阅读(34)
推荐(0)
摘要：
Apache Airflow is known within the data engineering community as the go-to open source platform for “developing, scheduling, and monitoring batch-orie
阅读全文
posted @ 2025-01-18 20:16
ZhangZhihuiAAA
阅读(16)
推荐(0)
摘要：
For the purpose of this book, we use the Docker version of PySpark, running on a single machine. If you have a version of PySpark installed on a distr
阅读全文
posted @ 2025-01-18 11:16
ZhangZhihuiAAA
阅读(21)
推荐(0)
摘要：
frank@ZZHUBT:~$ docker pull jupyter/pyspark-notebook docker run --name pyspark-notebook -p 8888:8888 -v ~/dkvols/pyspark-notebook/:/home/jovyan/work/
阅读全文
posted @ 2025-01-17 21:20
ZhangZhihuiAAA
阅读(50)
推荐(0)
摘要：
(zpy310) frank@ZZHUBT:~$ pip install duckdb (zpy310) frank@ZZHUBT:~$ pip install harlequin ...... Successfully installed MarkupSafe-3.0.2 click-8.1.8
阅读全文
posted @ 2025-01-17 13:19
ZhangZhihuiAAA
阅读(62)
推荐(0)
摘要：
import duckdb records = duckdb.read_csv("data/C11/Pedestrian_Counting_System_Monthly_counts_per_hour_may_2009_to_14_dec_2022.csv") records.show(max_wi
阅读全文
posted @ 2025-01-16 21:53
ZhangZhihuiAAA
阅读(43)
推荐(0)
摘要：
In this section, we are going to explore some of the DuckDB niceties – little shortcuts and tweaks to make your use of DuckDB easier. D CREATE OR REPL
阅读全文
posted @ 2025-01-16 18:03
ZhangZhihuiAAA
阅读(54)
推荐(0)
浙公网安备 33010602011771号
浙ICP备2021040463号-3
