crawl4ai 应用

 

项目地址:https://gitee.com/markets2022/crawl4ai

image

 

 

在虚拟环境中 pip安装脚本 

脚本地址;https://gitee.com/markets2022/pgai/blob/master/install_crawl4ai.sh

 

image

 

 

 

网址转换成 md

 

import asyncio
from crawl4ai import AsyncWebCrawler, CrawlerRunConfig, CacheMode
from crawl4ai.content_filter_strategy import PruningContentFilter
from crawl4ai.markdown_generation_strategy import DefaultMarkdownGenerator

# 定义异步函数
async def main():
    md_generator = DefaultMarkdownGenerator(
        content_filter=PruningContentFilter(threshold=0.4, threshold_type="fixed")
    )

    config = CrawlerRunConfig(
        cache_mode=CacheMode.BYPASS,
        markdown_generator=md_generator
    )

    async with AsyncWebCrawler() as crawler:
        result = await crawler.arun("https://www.cnblogs.com/flyingsir/p/19048571", config=config)
        print("Raw Markdown length:", len(result.markdown.raw_markdown))
        print("Fit Markdown length:", len(result.markdown.fit_markdown))

# 运行异步函数
if __name__ == "__main__":
    asyncio.run(main())

 

 

image

 

 

 html 连接 转 md文件;

 

import asyncio
from crawl4ai import AsyncWebCrawler, CrawlerRunConfig
from crawl4ai.markdown_generation_strategy import DefaultMarkdownGenerator

async def main():
    config = CrawlerRunConfig(
        markdown_generator=DefaultMarkdownGenerator()
    )
    async with AsyncWebCrawler() as crawler:
        result = await crawler.arun("https://www.cnblogs.com/flyingsir/p/19048571", config=config)

        if result.success:
            # 获取生成的 Markdown 内容
            markdown_content = result.markdown.raw_markdown

            # 保存到文件
            with open("output.md", "w", encoding="utf-8") as file:
                file.write(markdown_content)

            print("Markdown content has been saved to 'output.md'")
        else:
            print("Crawl failed:", result.error_message)

if __name__ == "__main__":
    asyncio.run(main())

  

image

 

image

 

 

 

[ ![](https://img2024.cnblogs.com/blog/35695/202506/35695-20250620221146444-645204917.webp) ](https://www.doubao.com?channel=cnblogs&source=hw_db_cnblogs&type=lunt&theme=bianc)
  * [ ![博客园logo](https://assets.cnblogs.com/logo.svg) ](https://www.cnblogs.com/ "开发者的网上家园")
  * [会员](https://cnblogs.vip/)
  * [众包](https://www.cnblogs.com/cmt/p/18500368)
  * [新闻](https://news.cnblogs.com/)
  * [博问](https://q.cnblogs.com/)
  * [闪存](https://ing.cnblogs.com/)
  * [赞助商](https://www.cnblogs.com/cmt/p/18341478)
  * [Trae](https://trae.cnblogs.com/)
  * [Chat2DB](https://chat2db-ai.com/)


  * ![搜索](https://assets.cnblogs.com/icons/search.svg) ![搜索](https://assets.cnblogs.com/icons/enter.svg)
    * ![搜索](https://assets.cnblogs.com/icons/search.svg)
所有博客
    * ![搜索](https://assets.cnblogs.com/icons/search.svg)
当前博客
  * [ ![写随笔](https://assets.cnblogs.com/icons/newpost.svg) ](https://i.cnblogs.com/EditPosts.aspx?opt=1 "写随笔") [ ![我的博客](https://assets.cnblogs.com/icons/myblog.svg) ](https://passport.cnblogs.com/GetBlogApplyStatus.aspx "我的博客") [ ![短消息](https://assets.cnblogs.com/icons/message.svg) ](https://msg.cnblogs.com/ "短消息") [ ![简洁模式](https://assets.cnblogs.com/icons/lite-mode-on.svg) ](javascript:void\(0\) "简洁模式启用,您在访问他人博客时会使用简洁款皮肤展示")
[ ![用户头像](https://assets.cnblogs.com/icons/avatar-default.svg) ](https://home.cnblogs.com/)
[我的博客](https://passport.cnblogs.com/GetBlogApplyStatus.aspx) [我的园子](https://home.cnblogs.com/) [账号设置](https://account.cnblogs.com/settings/account) [会员中心](https://vip.cnblogs.com/my) [ 简洁模式 ... ](javascript:void\(0\) "简洁模式会使用简洁款皮肤显示所有博客") [退出登录](javascript:void\(0\))
[注册](https://account.cnblogs.com/signup) [登录](javascript:void\(0\);)


[![返回主页](https://www.cnblogs.com/skins/custom/images/logo.gif)](https://www.cnblogs.com/flyingsir/)
#  [DN](https://www.cnblogs.com/flyingsir)
  * [ 博客园](https://www.cnblogs.com/)
  * [ 首页](https://www.cnblogs.com/flyingsir/)
  * [ 新随笔](https://i.cnblogs.com/EditPosts.aspx?opt=1)
  * [ 联系](https://msg.cnblogs.com/send/aiplus)
  * [ 订阅](javascript:void\(0\))
  * [ 管理](https://i.cnblogs.com/)


随笔 - 1259  文章 - 29  评论 - 112  阅读 -  48万
#  [ Python环境检测,人工智能编程环境 ](https://www.cnblogs.com/flyingsir/p/19048571 "发布于 2025-08-20 13:56")
# [天池](https://tianchi.aliyun.com/s/056772b3547ac174de2cfc99ef0d0ac5)
|   
---|---  
# Python环境检测
|   
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") ```
# 1.1 系统 & 硬件
!uname -a                    # OS / 内核
!lscpu | head -10            # CPU 型号 & 核数
!free -h                     # 内存
!df -h | grep '/'            # 磁盘剩余
!nvidia-smi 2>/dev/null || echo "No GPU"   # GPU 型号 / 显存

# 1.2 预装软件版本
!python --version
!python3 --version
!pip --version
!git --version
!which gcc && gcc --version  # 编译器

# 1.3 网络连通性(可选)
!ping -c 2 gitee.com
```
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") [?](https://www.cnblogs.com/flyingsir/p/19048571) |  1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 |  `Linux dsw-536437-89dcd8865-mzwzh 4.19.91-012.ali4000.alios7.x86_64 ``#1 SMP Wed Sep 15 17:27:09 CST 2021 x86_64 x86_64 x86_64 GNU/Linux` `架构:                           x86_64` `CPU 运行模式:                   32-bit, 64-bit` `字节序:                         Little Endian` `Address sizes:                   46 bits physical, 48 bits virtual` `CPU:                             32` `在线 CPU 列表:                  0-31` `每个核的线程数:                 2` `每个座的核数:                   16` `座:                             1` `NUMA 节点:                      1` `总计         已用        空闲      共享    缓冲/缓存    可用` `内存:       6.0Gi       477Mi       5.2Gi          0B       368Mi       5.5Gi` `交换:          0B          0B          0B` `overlay         492G  117G  355G   25% /` `tmpfs            64M     0   64M    0% ``/dev` `tmpfs            62G     0   62G    0% ``/sys/fs/cgroup` `/dev/vda2` `492G  117G  355G   25% ``/tmp` `shm              64M     0   64M    0% ``/dev/shm` `overlay         492G  117G  355G   25% ``/etc/dsw` `tmpfs           124G   12K  124G    1% ``/run/secrets/kubernetes``.io``/serviceaccount` `tmpfs            62G     0   62G    0% ``/proc/acpi` `tmpfs            62G     0   62G    0% ``/proc/scsi` `tmpfs            62G     0   62G    0% ``/sys/firmware` `No GPU` `Python 3.7.13` `Python 3.7.13` `pip 24.0 from ``/opt/conda/lib/python3``.7``/site-packages/pip` `(python 3.7)` `git version 2.25.1` `/usr/bin/gcc` `gcc` `(Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0` `Copyright (C) 2019 Free Software Foundation, Inc.` `This is ``free` `software; see the ``source` `for` `copying conditions.  There is NO` `warranty; not even ``for` `MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.` `/bin/bash``: ``ping``:未找到命令`  
---|---  
[?](https://www.cnblogs.com/flyingsir/p/19048571) |  1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 |  `import` `sys, os, platform, subprocess, pkg_resources, psutil, torch` `print(``"="` `* 60)` `print(``"🔍 Python 运行环境"``)` `print(``"="` `* 60)` `print(``"Python:"``, sys.version)` `print(``"Platform:"``, platform.platform())` `print(``"PWD:"``, os.getcwd())` `print(``"="` `* 60)` `# 2.1 关键库版本` `libs = [``"torch"``, ``"transformers"``, ``"accelerate"``, ``"sentencepiece"``, ``"modelscope"``]` `for` `lib ``in` `libs:` `try:` `ver = pkg_resources.get_distribution(lib).version` `print(f``"{lib:<15} {ver}"``)` `except:` `print(f``"{lib:<15} ❌ 未安装"``)` `# 2.2 硬件资源` `mem = psutil.virtual_memory()` `print(``"\n🔍 资源快照"``)` `print(f``"Memory Total   : {mem.total/1024**3:.1f} GB"``)` `print(f``"Memory Free    : {mem.available/1024**3:.1f} GB"``)` `print(f``"GPU Available  : {torch.cuda.is_available()}"``)` `if` `torch.cuda.is_available():` `for` `i ``in` `range(torch.cuda.device_count()):` `print(f``"  - GPU {i}     : {torch.cuda.get_device_name(i)} "` `f``"{torch.cuda.memory_reserved(i)/1024**3:.1f} GB"``)` `print(``"="` `* 60)`  
---|---  
[?](https://www.cnblogs.com/flyingsir/p/19048571)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 |  `============================================================` `🔍 Python 运行环境` `============================================================` `Python: 3.7.13 (default, Mar 29 2022, 02:18:16) ` `[GCC 7.5.0]` `Platform: Linux-4.19.91-012.ali4000.alios7.x86_64-x86_64-with-debian-bullseye-sid` `PWD: ``/mnt/workspace` `============================================================` `torch           1.11.0+cpu` `transformers    4.24.0` `accelerate      0.20.3` `sentencepiece   0.1.97` `modelscope      1.28.1` `🔍 资源快照` `Memory Total   : 6.0 GB` `Memory Free    : 5.5 GB` `GPU Available  : False` `============================================================`  
---|---  
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码")
```
def llm_ready():
    ok = True
    if sys.version_info < (3, 7):
        print("❌ Python 版本过低,建议 ≥3.8")
        ok = False
    if torch.__version__ < "1.10":
        print("⚠️  PyTorch 版本较低,可能影响性能")
    if not torch.cuda.is_available():
        print("⚠️  无 GPU,仅 CPU 推理,速度会慢")
    try:
        from transformers import AutoTokenizer, AutoModel
        print("✅ transformers 可用")
    except ImportError:
        print("❌ 未安装 transformers")
        ok = False
    return ok

print("LLM 环境就绪?" , "✅ 可以跑" if llm_ready() else "❌ 需升级/安装")
```

[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码")
[?](https://www.cnblogs.com/flyingsir/p/19048571)
1 2 3 |  `⚠️  无 GPU,仅 CPU 推理,速度会慢` `✅ transformers 可用` `LLM 环境就绪? ✅ 可以跑`  
---|---  
|   
# [ 浙大平台](https://mo.zju.edu.cn/workspace/68a55fe9b0a1e361589b21a4/app)
|   
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") ```
# 1.1 系统 & 硬件
!uname -a                    # OS / 内核
!lscpu | head -10            # CPU 型号 & 核数
!free -h                     # 内存
!df -h | grep '/'            # 磁盘剩余
!nvidia-smi 2>/dev/null || echo "No GPU"   # GPU 型号 / 显存

# 1.2 预装软件版本
!python --version
!python3 --version
!pip --version
!git --version
!which gcc && gcc --version  # 编译器

# 1.3 网络连通性(可选)
!ping -c 2 gitee.com
```
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") [?](https://www.cnblogs.com/flyingsir/p/19048571) |  1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |  `Linux notebook 3.10.0-1127.el7.x86_64 ``#1 SMP Tue Mar 31 23:36:51 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux` `Architecture:        x86_64` `CPU ``op``-mode(s):      32-bit, 64-bit` `Byte Order:          Little Endian` `CPU(s):              64` `On-line CPU(s) list: 0-63` `Thread(s) per core:  2` `Core(s) per socket:  16` `Socket(s):           2` `NUMA node(s):        2` `Vendor ID:           GenuineIntel` `total        used        ``free` `shared  buff``/cache` `available` `Mem:           187G         13G        150G        4.1G         23G        169G` `Swap:            0B          0B          0B` `overlay                                                                              503G  289G  215G  58% /` `tmpfs                                                                                 64M     0   64M   0% ``/dev` `tmpfs                                                                                 94G     0   94G   0% ``/sys/fs/cgroup` `/dev/mapper/centos-root` `50G   35G   16G  70% ``/etc/hosts` `/dev/mapper/centos-home` `503G  289G  215G  58% ``/etc/hostname` `shm                                                                                   64M     0   64M   0% ``/dev/shm` `10.203.10.174:``/mnt/user_directory/68a555116eba6373f7fd90d3/68a55fe9b0a1e361589b21a3` `28T   28T  411G  99% ``/home/jovyan/work` `tmpfs                                                                                 94G   12K   94G   1% ``/run/secrets/kubernetes``.io``/serviceaccount` `tmpfs                                                                                 94G     0   94G   0% ``/proc/acpi` `tmpfs                                                                                 94G     0   94G   0% ``/proc/scsi` `tmpfs                                                                                 94G     0   94G   0% ``/sys/firmware` `No GPU` `Python 3.7.5` `Python 3.7.5` `pip 21.1.3 from ``/home/jovyan/``.virtualenvs``/basenv/lib/python3``.7``/site-packages/pip` `(python 3.7)` `git version 2.17.1` `/usr/bin/gcc` `gcc` `(Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0` `Copyright (C) 2017 Free Software Foundation, Inc.` `This is ``free` `software; see the ``source` `for` `copying conditions.  There is NO` `warranty; not even ``for` `MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.` `PING gitee.com-31ba39d0fd3.baiduads.com (180.76.199.13) 56(84) bytes of data.` `--- gitee.com-31ba39d0fd3.baiduads.com ``ping` `statistics ---` `2 packets transmitted, 0 received, 100% packet loss, ``time` `999ms`  
---|---  
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") ```
import sys, os, platform, subprocess, pkg_resources, psutil, torch

print("=" * 60)
print("🔍 Python 运行环境")
print("=" * 60)
print("Python:", sys.version)
print("Platform:", platform.platform())
print("PWD:", os.getcwd())
print("=" * 60)

# 2.1 关键库版本
libs = ["torch", "transformers", "accelerate", "sentencepiece", "modelscope"]
for lib in libs:
    try:
        ver = pkg_resources.get_distribution(lib).version
        print(f"{lib:<15} {ver}")
    except:
        print(f"{lib:<15} ❌ 未安装")

# 2.2 硬件资源
mem = psutil.virtual_memory()
print("\n🔍 资源快照")
print(f"Memory Total   : {mem.total/1024**3:.1f} GB")
print(f"Memory Free    : {mem.available/1024**3:.1f} GB")
print(f"GPU Available  : {torch.cuda.is_available()}")
if torch.cuda.is_available():
    for i in range(torch.cuda.device_count()):
        print(f"  - GPU {i}     : {torch.cuda.get_device_name(i)} "
              f"{torch.cuda.memory_reserved(i)/1024**3:.1f} GB")

print("=" * 60)
```
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") [![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") ```
============================================================
🔍 Python 运行环境
============================================================
Python: 3.7.5 (default, Dec  9 2021, 17:04:37) 
[GCC 8.4.0]
Platform: Linux-3.10.0-1127.el7.x86_64-x86_64-with-Ubuntu-18.04-bionic
PWD: /home/jovyan/work
============================================================
torch           1.8.1+cpu
transformers    4.1.1
accelerate      ❌ 未安装
sentencepiece   0.1.91
modelscope      ❌ 未安装

🔍 资源快照
Memory Total   : 187.4 GB
Memory Free    : 169.1 GB
GPU Available  : False
============================================================
```
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") |   
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") ```
def llm_ready():
    ok = True
    if sys.version_info < (3, 7):
        print("❌ Python 版本过低,建议 ≥3.8")
        ok = False
    if torch.__version__ < "1.10":
        print("⚠️  PyTorch 版本较低,可能影响性能")
    if not torch.cuda.is_available():
        print("⚠️  无 GPU,仅 CPU 推理,速度会慢")
    try:
        from transformers import AutoTokenizer, AutoModel
        print("✅ transformers 可用")
    except ImportError:
        print("❌ 未安装 transformers")
        ok = False
    return ok

print("LLM 环境就绪?" , "✅ 可以跑" if llm_ready() else "❌ 需升级/安装")
```
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") [![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") ```
⚠️  无 GPU,仅 CPU 推理,速度会慢
2025-08-20 13:47:59.415739: W tensorflow/stream_executor/platform/default/dso_loader.cc:59] Could not load dynamic library 'libcudart.so.10.1'; dlerror: libcudart.so.10.1: cannot open shared object file: No such file or directory
2025-08-20 13:47:59.415772: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
✅ transformers 可用
LLM 环境就绪? ✅ 可以跑
​
```
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") |   
|   
|   
XEdu |   
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") ```
import sys, os, platform, subprocess, pkg_resources, psutil, torch

print("=" * 60)
print("🔍 Python 运行环境")
print("=" * 60)
print("Python:", sys.version)
print("Platform:", platform.platform())
print("PWD:", os.getcwd())
print("=" * 60)

# 2.1 关键库版本
libs = ["torch", "transformers", "accelerate", "sentencepiece", "modelscope"]
for lib in libs:
    try:
        ver = pkg_resources.get_distribution(lib).version
        print(f"{lib:<15} {ver}")
    except:
        print(f"{lib:<15} ❌ 未安装")

# 2.2 硬件资源
mem = psutil.virtual_memory()
print("\n🔍 资源快照")
print(f"Memory Total   : {mem.total/1024**3:.1f} GB")
print(f"Memory Free    : {mem.available/1024**3:.1f} GB")
print(f"GPU Available  : {torch.cuda.is_available()}")
if torch.cuda.is_available():
    for i in range(torch.cuda.device_count()):
        print(f"  - GPU {i}     : {torch.cuda.get_device_name(i)} "
              f"{torch.cuda.memory_reserved(i)/1024**3:.1f} GB")

print("=" * 60)
```
[![复制代码](https://assets.cnblogs.com/images/copycode.gif)](javascript:void\(0\); "复制代码") [?](https://www.cnblogs.com/flyingsir/p/19048571) |  1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |  `============================================================` `🔍 Python 运行环境` `============================================================` `Python: 3.8.3 (default, Jul  2 2020, 17:30:36) [MSC ``v``.1916 64 bit (AMD64)]` `Platform: Windows-10-10.0.22621-SP0` `PWD: D:\XEdu\人工智能 ` `============================================================` `torch           2.4.1` `transformers    4.46.3` `accelerate      1.0.1` `sentencepiece   ❌ 未安装` `modelscope      1.22.3` `🔍 资源快照` `Memory Total   : 15.7 GB` `Memory Free    : 0.3 GB` `GPU Available  : False` `============================================================`  
---|---  
#  requirements.txt
|   
[?](https://www.cnblogs.com/flyingsir/p/19048571) |  1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 |  `absl-py==0.9.0` `alembic==1.12.1` `argon2-cffi==23.1.0` `argon2-cffi-bindings==21.2.0` `ase==3.21.1` `astor==0.8.1` `asttokens==2.4.1` `astunparse==1.6.3` `async-generator==1.10` `attrs==19.3.0` `Augmentor==0.2.8` `backcall==0.2.0` `baytune==0.4.0` `bleach==5.0.0` `blis==0.4.1` `boto3==1.16.25` `botocore==1.19.25` `cachetools==3.1.1` `cairocffi==1.3.0` `CairoSVG==2.5.2` `calysto==1.0.6` `catalogue==1.0.0` `certifi==2022.9.24` `certipy==0.1.3` `cffi==1.15.0` `charset-normalizer==2.1.1` `click==8.1.2` `cloudpickle==1.2.2` `cmake==3.21.1` `configparser==5.2.0` `copulas==0.3.3` `cryptography==36.0.2` `cssselect2==0.5.0` `cycler==0.11.0` `cymem==2.0.6` `Cython==0.29.20` `debugpy==1.6.0` `decorator==4.4.2` `defusedxml==0.7.1` `distlib==0.3.4` `dlib==19.22.0` `dm-tree==0.1.7` `easydict==1.9` `en-core-web-sm @ https:``//files.momodel.cn/en_core_web_sm-2.3.0.tar.gz` `entrypoints==0.4` `et-xmlfile==1.1.0` `fastjsonschema==2.15.3` `filelock==3.6.0` `func-timeout==4.3.5` `future==0.18.2` `gast==0.3.3` `gensim==3.8.3` `google-auth==2.14.0` `google-auth-oauthlib==0.4.6` `google-pasta==0.2.0` `googledrivedownloader==0.4` `graphviz==0.14` `greenlet==1.1.2` `grpcio==1.29.0` `gym==0.15.7` `h5py==2.10.0` `idna==3.4` `imageio==2.8.0` `imageio-ffmpeg==0.5.1` `imbalanced-learn==0.6.2` `imgaug==0.4.0` `importlib-metadata==4.13.0` `importlib-resources==5.7.0` `ipdb==0.13.2` `ipykernel==6.13.0` `ipython==7.32.0` `ipython-genutils==0.2.0` `ipywidgets==7.4.0` `isodate==0.6.1` `jdcal==1.4.1` `jedi==0.18.1` `jieba==0.42.1` `Jinja2==3.0.3` `jmespath==0.10.0` `joblib==1.1.0` `jsonschema==4.4.0` `jupyter-client==7.2.2` `jupyter-core==4.9.2` `jupyter-telemetry==0.1.0` `jupyterhub==1.4.2` `jupyterlab==1.0.0a1` `jupyterlab-server==0.2.0` `kanren==0.2.3` `Keras==2.4.3` `Keras-Preprocessing==1.1.2` `kiwisolver==1.3.2` `llvmlite==0.39.1` `Mako==1.2.0` `Markdown==3.4.1` `MarkupSafe==2.1.1` `matplotlib==3.0.3` `matplotlib-inline==0.1.3` `metakernel==0.29.0` `mindspore @ https:``//ms-release.obs.cn-north-4.myhuaweicloud.com/2.2.14/MindSpore/unified/x86_64/mindspore-2.2.14-cp37-cp37m-linux_x86_64.whl` `minepy==1.2.4` `minio==5.0.10` `mistune==0.8.4` `mock==5.2.0` `moviepy==1.0.3` `mpmath==1.2.1` `multipledispatch==0.6.0` `murmurhash==1.0.6` `nbconvert==5.6.1` `nbformat==5.3.0` `nest-asyncio==1.5.5` `networkx==2.6.3` `nltk==3.5` `notebook==6.2.0` `numba==0.56.4` `numexpr==2.8.6` `numpy==1.18.5` `numpyencoder==0.3.0` `oauthlib==3.2.2` `opencv-python==4.5.1.48` `openpyxl==3.0.9` `opt-einsum==3.3.0` `packaging==21.3` `paddlepaddle==2.0.1` `pamela==1.0.0` `pandas==1.3.5` `pandocfilters==1.5.0` `parso==0.8.3` `pbr==5.8.1` `pexpect==4.8.0` `pickleshare==0.7.5` `Pillow==8.1.0` `plac==1.1.3` `platformdirs==2.5.1` `plotly==4.8.1` `portpicker==1.3.9` `preshed==3.0.6` `proglog==0.1.10` `prometheus-client==0.14.1` `prompt-toolkit==3.0.29` `protobuf==3.20.3` `psutil==5.9.0` `ptyprocess==0.7.0` `pyasn1==0.4.8` `pyasn1-modules==0.2.8` `PyAudio==0.2.11` `pycparser==2.21` `pydot==1.4.1` `pyenchant==3.1.1` `pygame==2.0.1` `pyglet==1.5.0` `Pygments==2.11.2` `pyOpenSSL==22.0.0` `pyparsing==3.0.7` `pyrsistent==0.18.1` `python-dateutil==2.8.2` `python-json-logger==2.0.2` `python-louvain==0.16` `pytorch-pretrained-bert==0.6.2` `pytorch-transformers==1.2.0` `pytz==2022.1` `PyWavelets==1.3.0` `PyYAML==6.0` `pyzmq==22.3.0` `rdflib==6.3.2` `regex==2022.3.15` `requests==2.28.1` `requests-oauthlib==1.3.1` `retrying==1.3.3` `rouge==1.0.0` `rsa==4.9` `ruamel.yaml==0.17.21` `ruamel.yaml.clib==0.2.6` `s3transfer==0.3.3` `sacremoses==0.0.49` `scikit-image==0.15.0` `scikit-learn==0.22.2.post1` `scipy==1.7.3` `seaborn==0.10.1` `semantic-version==2.8.5` `Send2Trash==1.8.0` `sentencepiece==0.1.91` `Shapely==1.7.0` `six==1.16.0` `smart-open==5.2.1` `spacy==2.3.2` `SQLAlchemy==1.4.35` `srsly==1.0.5` `stevedore==3.5.0` `svgwrite==1.4.2` `sympy==1.6.2` `tables==3.5.1` `tensorboard==2.11.0` `tensorboard-data-server==0.6.1` `tensorboard-plugin-wit==1.8.1` `tensorboardX==2.0` `tensorflow==2.3.1` `tensorflow-addons==0.11.2` `tensorflow-estimator==2.3.0` `tensorflow-federated==0.17.0` `tensorflow-model-optimization==0.4.1` `tensorflow-privacy==0.5.2` `termcolor==2.1.1` `terminado==0.13.3` `testpath==0.6.0` `tf-slim==1.1.0` `thinc==7.4.1` `tinycss2==1.1.1` `tokenizers==0.9.4` `toolz==0.11.2` `torch @ https:``//download.pytorch.org/whl/cpu/torch-1.8.1%2Bcpu-cp37-cp37m-linux_x86_64.whl` `torch-geometric==1.7.0` `torch-scatter @ https:``//data.pyg.org/whl/torch-1.8.0%2Bcpu/torch_scatter-2.0.8-cp37-cp37m-linux_x86_64.whl` `torch-sparse @ https:``//data.pyg.org/whl/torch-1.8.0%2Bcpu/torch_sparse-0.6.12-cp37-cp37m-linux_x86_64.whl` `torch-spline-conv @ https:``//data.pyg.org/whl/torch-1.8.0%2Bcpu/torch_spline_conv-1.2.1-cp37-cp37m-linux_x86_64.whl` `torchinfo==1.7.2` `torchtext==0.6.0` `torchvision @ https:``//download.pytorch.org/whl/cpu/torchvision-0.9.1%2Bcpu-cp37-cp37m-linux_x86_64.whl` `tornado==6.1` `tqdm==4.46.1` `traitlets==5.1.1` `transformers==4.1.1` `typeguard==2.13.3` `typing-extensions==4.1.1` `unification==0.2.2` `urllib3==1.26.13` `virtualenv==20.13.1` `virtualenv-clone==0.5.7` `virtualenvwrapper==4.7.0` `wasabi==0.9.1` `wcwidth==0.2.5` `webencodings==0.5.1` `Werkzeug==2.2.2` `widgetsnbextension==3.4.2` `word2vec==0.11.1` `wrapt==1.14.1` `xlrd==1.2.0` `XlsxWriter==1.4.3` `yellowbrick==1.1` `zipp==3.11.0`  
---|---  
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
|   
[好文要顶](javascript:void\(0\);) [关注我](javascript:void\(0\);) [收藏该文](javascript:void\(0\);) [微信分享](javascript:void\(0\);)
[![](https://pic.cnblogs.com/face/332984/20140920210941.png)](https://home.cnblogs.com/u/flyingsir/)
[aiplus](https://home.cnblogs.com/u/flyingsir/)   
[粉丝 - 22](https://home.cnblogs.com/u/flyingsir/followers/) [关注 - 12](https://home.cnblogs.com/u/flyingsir/followees/)  

[+加关注](javascript:void\(0\);)
0
0
[« ](https://www.cnblogs.com/flyingsir/p/19042040) 上一篇: [服务器部署notebook+xedu+机器学习编程环境多用户登录](https://www.cnblogs.com/flyingsir/p/19042040 "发布于 2025-08-16 15:30")   
[» ](https://www.cnblogs.com/flyingsir/p/19050157) 下一篇: [Ro-E_v.1.1.6.exe 安装](https://www.cnblogs.com/flyingsir/p/19050157 "发布于 2025-08-21 10:48")
posted @ 2025-08-20 13:56 [aiplus](https://www.cnblogs.com/flyingsir) 阅读(7) 评论(0) [收藏](javascript:void\(0\)) [举报](javascript:void\(0\))
[刷新页面](https://www.cnblogs.com/flyingsir/p/19048571)[返回顶部](https://www.cnblogs.com/flyingsir/p/19048571#top)
登录后才能查看或发表评论,立即 [登录](javascript:void\(0\);) 或者 [逛逛](https://www.cnblogs.com/) 博客园首页 
[【推荐】注册飞算 JavaAI 开发助手,立得京东e卡!分享体验再领30元](https://www.cnblogs.com/cmt/p/19038269)  
[【推荐】100%开源!大型工业跨平台软件C++源码提供,建模,组态!](http://www.uccpsoft.com/index.htm)  
[【推荐】AI 的力量,开发者的翅膀:欢迎使用 AI 原生开发工具 TRAE](https://www.cnblogs.com/cmt/p/19004092)  
[【推荐】2025 HarmonyOS 鸿蒙创新赛正式启动,百万大奖等你挑战](https://www.cnblogs.com/cmt/p/19058738)  

[ ![](https://img2024.cnblogs.com/blog/35695/202508/35695-20250825190531076-1818435893.jpg) ](https://developer.huawei.com/consumer/cn/activity/digixActivity/digixcmsdetail/101750143863263087?ha_source=BKYQ3&ha_sourceId=89000408)
**相关博文:**  

·  [人工智能训练线上算力实验环境](https://www.cnblogs.com/flyingsir/p/18702378 "人工智能训练线上算力实验环境")
·  [01人工智能创新型教师培育计划(第一期)0125](https://www.cnblogs.com/flyingsir/p/18691251 "01人工智能创新型教师培育计划(第一期)0125")
·  [Python开发环境【人工智能开发环境】](https://www.cnblogs.com/chihaoyuIsnotHere/p/17004487.html "Python开发环境【人工智能开发环境】")
·  [python运行时:ModuleNotFoundError: No module named ‘tensorflow‘](https://www.cnblogs.com/chinasoft/p/16303908.html "python运行时:ModuleNotFoundError: No module named ‘tensorflow‘")
·  [大服务器配置tensorflow环境](https://www.cnblogs.com/herd/p/16282297.html "大服务器配置tensorflow环境")
**阅读排行:**   
· [Nginx UI - 可视化管理平台](https://www.cnblogs.com/xiao987334176/p/19057214)   
· [上位机开发之假装有设备,使用 C# 模拟串口设备](https://www.cnblogs.com/deali/p/19058276/cuprinter-develop-fake-device-use-csharp-simulate)   
· [DeepSeek-V3.1发布,Agent 时代彻底来了](https://www.cnblogs.com/tangshiye/p/19058296)   
· [婶可忍叔不可忍的AutoMapper,你还用吗?](https://www.cnblogs.com/xiangji/p/19059979)   
· [爆肝三周,我终于上线了自己的第一个小程序](https://www.cnblogs.com/jvxiao/p/19059712)   

**历史上的今天:**   
2024-08-20 [国优计划 中小学教师计划 STEM](https://www.cnblogs.com/flyingsir/p/18369847)   
2023-08-20 [课程研发降本增效](https://www.cnblogs.com/flyingsir/p/17643684.html)   

### 公告
昵称: [ aiplus ](https://home.cnblogs.com/u/flyingsir/)   
园龄: [ 13年11个月 ](https://home.cnblogs.com/u/flyingsir/ "入园时间:2011-09-16")   
粉丝: [ 22 ](https://home.cnblogs.com/u/flyingsir/followers/)   
关注: [ 12 ](https://home.cnblogs.com/u/flyingsir/followees/)
[+加关注](javascript:void\(0\))
|  [<](javascript:void\(0\);) | 2025年8月 |  [>](javascript:void\(0\);)  
---|---|---  
日 | 一 | 二 | 三 | 四 | 五 | 六  
27 | 28 | 29 | 30 | 31 |  1  |  [_2_](https://www.cnblogs.com/flyingsir/p/archive/2025/08/02)  
3  |  4  |  5  |  6  |  7  |  8  |  9   
10  |  11  |  12  |  13  |  14  |  [_15_](https://www.cnblogs.com/flyingsir/p/archive/2025/08/15) |  [_16_](https://www.cnblogs.com/flyingsir/p/archive/2025/08/16)  
17  |  18  |  19  |  [_20_](https://www.cnblogs.com/flyingsir/p/archive/2025/08/20) |  [_21_](https://www.cnblogs.com/flyingsir/p/archive/2025/08/21) |  22  |  23   
[_24_](https://www.cnblogs.com/flyingsir/p/archive/2025/08/24) |  [_25_](https://www.cnblogs.com/flyingsir/p/archive/2025/08/25) |  26  |  27  |  28  |  29  |  30   
31  |  1  |  2  |  3  |  4  |  5  |  6   
[博客园](https://www.cnblogs.com/) © 2004-2025   
[![](https://assets.cnblogs.com/images/ghs.png)浙公网安备 33010602011771号](http://www.beian.gov.cn/portal/registerSystemInfo?recordcode=33010602011771) [浙ICP备2021040463号-3](https://beian.miit.gov.cn)
悬浮按钮示例
↑ ↓
点击右上角即可分享
![微信分享提示](https://img2023.cnblogs.com/blog/35695/202309/35695-20230906145857937-1471873834.gif)

  

 

 

   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
  安装脚本;  https://gitee.com/markets2022/pgai/blob/master/install_crawl4ai.sh#
 

安装 crawl4ai 及其依赖项...
Looking in indexes: https://mirrors.cloud.aliyuncs.com/pypi/simple
Requirement already satisfied: crawl4ai in ./myenv/lib/python3.11/site-packages (0.7.4)
Requirement already satisfied: aiofiles>=24.1.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (24.1.0)
Requirement already satisfied: aiohttp>=3.11.11 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (3.12.15)
Requirement already satisfied: aiosqlite~=0.20 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (0.21.0)
Requirement already satisfied: anyio>=4.0.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (4.10.0)
Requirement already satisfied: lxml~=5.3 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (5.4.0)
Requirement already satisfied: litellm>=1.53.1 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.76.0)
Requirement already satisfied: numpy<3,>=1.26.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.3.2)
Requirement already satisfied: pillow>=10.4 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (11.3.0)
Requirement already satisfied: playwright>=1.49.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.54.0)
Requirement already satisfied: patchright>=1.49.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.52.5)
Requirement already satisfied: python-dotenv~=1.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.1.1)
Requirement already satisfied: requests~=2.26 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.32.5)
Requirement already satisfied: beautifulsoup4~=4.12 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (4.13.5)
Requirement already satisfied: tf-playwright-stealth>=1.1.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.2.0)
Requirement already satisfied: xxhash~=3.4 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (3.5.0)
Requirement already satisfied: rank-bm25~=0.2 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (0.2.2)
Requirement already satisfied: snowballstemmer~=2.2 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.2.0)
Requirement already satisfied: pydantic>=2.10 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.11.7)
Requirement already satisfied: pyOpenSSL>=24.3.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (25.1.0)
Requirement already satisfied: psutil>=6.1.1 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (7.0.0)
Requirement already satisfied: PyYAML>=6.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (6.0.2)
Requirement already satisfied: nltk>=3.9.1 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (3.9.1)
Requirement already satisfied: rich>=13.9.4 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (14.1.0)
Requirement already satisfied: httpx>=0.27.2 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (0.28.1)
Requirement already satisfied: fake-useragent>=2.0.3 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.2.0)
Requirement already satisfied: click>=8.1.7 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (8.2.1)
Requirement already satisfied: chardet>=5.2.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (5.2.0)
Requirement already satisfied: brotli>=1.1.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.1.0)
Requirement already satisfied: humanize>=4.10.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (4.13.0)
Requirement already satisfied: lark>=1.2.2 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.2.2)
Requirement already satisfied: alphashape>=1.3.1 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.3.1)
Requirement already satisfied: shapely>=2.0.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.1.1)
Requirement already satisfied: typing_extensions>=4.0 in ./myenv/lib/python3.11/site-packages (from aiosqlite~=0.20->crawl4ai) (4.15.0)
Requirement already satisfied: soupsieve>1.2 in ./myenv/lib/python3.11/site-packages (from beautifulsoup4~=4.12->crawl4ai) (2.7)
Requirement already satisfied: charset_normalizer<4,>=2 in ./myenv/lib/python3.11/site-packages (from requests~=2.26->crawl4ai) (3.4.3)
Requirement already satisfied: idna<4,>=2.5 in ./myenv/lib/python3.11/site-packages (from requests~=2.26->crawl4ai) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./myenv/lib/python3.11/site-packages (from requests~=2.26->crawl4ai) (2.5.0)
Requirement already satisfied: certifi>=2017.4.17 in ./myenv/lib/python3.11/site-packages (from requests~=2.26->crawl4ai) (2025.8.3)
Requirement already satisfied: aiohappyeyeballs>=2.5.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (2.6.1)
Requirement already satisfied: aiosignal>=1.4.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (1.4.0)
Requirement already satisfied: attrs>=17.3.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (25.3.0)
Requirement already satisfied: frozenlist>=1.1.1 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (1.7.0)
Requirement already satisfied: multidict<7.0,>=4.5 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (6.6.4)
Requirement already satisfied: propcache>=0.2.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (0.3.2)
Requirement already satisfied: yarl<2.0,>=1.17.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (1.20.1)
Requirement already satisfied: click-log>=0.3.2 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (0.4.0)
Requirement already satisfied: trimesh>=3.9.8 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (4.7.4)
Requirement already satisfied: networkx>=2.5 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (3.5)
Requirement already satisfied: rtree>=0.9.7 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (1.4.1)
Requirement already satisfied: scipy>=1.0.0 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (1.16.1)
Requirement already satisfied: sniffio>=1.1 in ./myenv/lib/python3.11/site-packages (from anyio>=4.0.0->crawl4ai) (1.3.1)
Requirement already satisfied: httpcore==1.* in ./myenv/lib/python3.11/site-packages (from httpx>=0.27.2->crawl4ai) (1.0.9)
Requirement already satisfied: h11>=0.16 in ./myenv/lib/python3.11/site-packages (from httpcore==1.*->httpx>=0.27.2->crawl4ai) (0.16.0)
Requirement already satisfied: h2<5,>=3 in ./myenv/lib/python3.11/site-packages (from httpx[http2]>=0.27.2->crawl4ai) (4.3.0)
Requirement already satisfied: hyperframe<7,>=6.1 in ./myenv/lib/python3.11/site-packages (from h2<5,>=3->httpx[http2]>=0.27.2->crawl4ai) (6.1.0)
Requirement already satisfied: hpack<5,>=4.1 in ./myenv/lib/python3.11/site-packages (from h2<5,>=3->httpx[http2]>=0.27.2->crawl4ai) (4.1.0)
Requirement already satisfied: importlib-metadata>=6.8.0 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (8.7.0)
Requirement already satisfied: jinja2<4.0.0,>=3.1.2 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (3.1.6)
Requirement already satisfied: jsonschema<5.0.0,>=4.22.0 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (4.25.1)
Requirement already satisfied: openai>=1.99.5 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (1.102.0)
Requirement already satisfied: tiktoken>=0.7.0 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (0.11.0)
Requirement already satisfied: tokenizers in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (0.21.4)
Requirement already satisfied: MarkupSafe>=2.0 in ./myenv/lib/python3.11/site-packages (from jinja2<4.0.0,>=3.1.2->litellm>=1.53.1->crawl4ai) (3.0.2)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in ./myenv/lib/python3.11/site-packages (from jsonschema<5.0.0,>=4.22.0->litellm>=1.53.1->crawl4ai) (2025.4.1)
Requirement already satisfied: referencing>=0.28.4 in ./myenv/lib/python3.11/site-packages (from jsonschema<5.0.0,>=4.22.0->litellm>=1.53.1->crawl4ai) (0.36.2)
Requirement already satisfied: rpds-py>=0.7.1 in ./myenv/lib/python3.11/site-packages (from jsonschema<5.0.0,>=4.22.0->litellm>=1.53.1->crawl4ai) (0.27.0)
Requirement already satisfied: annotated-types>=0.6.0 in ./myenv/lib/python3.11/site-packages (from pydantic>=2.10->crawl4ai) (0.7.0)
Requirement already satisfied: pydantic-core==2.33.2 in ./myenv/lib/python3.11/site-packages (from pydantic>=2.10->crawl4ai) (2.33.2)
Requirement already satisfied: typing-inspection>=0.4.0 in ./myenv/lib/python3.11/site-packages (from pydantic>=2.10->crawl4ai) (0.4.1)
Requirement already satisfied: zipp>=3.20 in ./myenv/lib/python3.11/site-packages (from importlib-metadata>=6.8.0->litellm>=1.53.1->crawl4ai) (3.23.0)
Requirement already satisfied: joblib in ./myenv/lib/python3.11/site-packages (from nltk>=3.9.1->crawl4ai) (1.5.1)
Requirement already satisfied: regex>=2021.8.3 in ./myenv/lib/python3.11/site-packages (from nltk>=3.9.1->crawl4ai) (2025.7.33)
Requirement already satisfied: tqdm in ./myenv/lib/python3.11/site-packages (from nltk>=3.9.1->crawl4ai) (4.67.1)
Requirement already satisfied: distro<2,>=1.7.0 in ./myenv/lib/python3.11/site-packages (from openai>=1.99.5->litellm>=1.53.1->crawl4ai) (1.9.0)
Requirement already satisfied: jiter<1,>=0.4.0 in ./myenv/lib/python3.11/site-packages (from openai>=1.99.5->litellm>=1.53.1->crawl4ai) (0.10.0)
Requirement already satisfied: pyee<14,>=13 in ./myenv/lib/python3.11/site-packages (from patchright>=1.49.0->crawl4ai) (13.0.0)
Requirement already satisfied: greenlet<4.0.0,>=3.1.1 in ./myenv/lib/python3.11/site-packages (from patchright>=1.49.0->crawl4ai) (3.2.4)
Requirement already satisfied: cryptography<46,>=41.0.5 in ./myenv/lib/python3.11/site-packages (from pyOpenSSL>=24.3.0->crawl4ai) (45.0.6)
Requirement already satisfied: cffi>=1.14 in ./myenv/lib/python3.11/site-packages (from cryptography<46,>=41.0.5->pyOpenSSL>=24.3.0->crawl4ai) (1.17.1)
Requirement already satisfied: pycparser in ./myenv/lib/python3.11/site-packages (from cffi>=1.14->cryptography<46,>=41.0.5->pyOpenSSL>=24.3.0->crawl4ai) (2.22)
Requirement already satisfied: markdown-it-py>=2.2.0 in ./myenv/lib/python3.11/site-packages (from rich>=13.9.4->crawl4ai) (4.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in ./myenv/lib/python3.11/site-packages (from rich>=13.9.4->crawl4ai) (2.19.2)
Requirement already satisfied: mdurl~=0.1 in ./myenv/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.9.4->crawl4ai) (0.1.2)
Requirement already satisfied: fake-http-header<0.4.0,>=0.3.5 in ./myenv/lib/python3.11/site-packages (from tf-playwright-stealth>=1.1.0->crawl4ai) (0.3.5)
Requirement already satisfied: huggingface-hub<1.0,>=0.16.4 in ./myenv/lib/python3.11/site-packages (from tokenizers->litellm>=1.53.1->crawl4ai) (0.34.4)
Requirement already satisfied: filelock in ./myenv/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers->litellm>=1.53.1->crawl4ai) (3.19.1)
Requirement already satisfied: fsspec>=2023.5.0 in ./myenv/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers->litellm>=1.53.1->crawl4ai) (2025.7.0)
Requirement already satisfied: packaging>=20.9 in ./myenv/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers->litellm>=1.53.1->crawl4ai) (25.0)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in ./myenv/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers->litellm>=1.53.1->crawl4ai) (1.1.8)
Looking in indexes: https://mirrors.cloud.aliyuncs.com/pypi/simple
Requirement already satisfied: crawl4ai in ./myenv/lib/python3.11/site-packages (0.7.4)
Requirement already satisfied: aiofiles>=24.1.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (24.1.0)
Requirement already satisfied: aiohttp>=3.11.11 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (3.12.15)
Requirement already satisfied: aiosqlite~=0.20 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (0.21.0)
Requirement already satisfied: anyio>=4.0.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (4.10.0)
Requirement already satisfied: lxml~=5.3 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (5.4.0)
Requirement already satisfied: litellm>=1.53.1 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.76.0)
Requirement already satisfied: numpy<3,>=1.26.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.3.2)
Requirement already satisfied: pillow>=10.4 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (11.3.0)
Requirement already satisfied: playwright>=1.49.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.54.0)
Requirement already satisfied: patchright>=1.49.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.52.5)
Requirement already satisfied: python-dotenv~=1.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.1.1)
Requirement already satisfied: requests~=2.26 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.32.5)
Requirement already satisfied: beautifulsoup4~=4.12 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (4.13.5)
Requirement already satisfied: tf-playwright-stealth>=1.1.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.2.0)
Requirement already satisfied: xxhash~=3.4 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (3.5.0)
Requirement already satisfied: rank-bm25~=0.2 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (0.2.2)
Requirement already satisfied: snowballstemmer~=2.2 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.2.0)
Requirement already satisfied: pydantic>=2.10 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.11.7)
Requirement already satisfied: pyOpenSSL>=24.3.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (25.1.0)
Requirement already satisfied: psutil>=6.1.1 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (7.0.0)
Requirement already satisfied: PyYAML>=6.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (6.0.2)
Requirement already satisfied: nltk>=3.9.1 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (3.9.1)
Requirement already satisfied: rich>=13.9.4 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (14.1.0)
Requirement already satisfied: httpx>=0.27.2 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (0.28.1)
Requirement already satisfied: fake-useragent>=2.0.3 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.2.0)
Requirement already satisfied: click>=8.1.7 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (8.2.1)
Requirement already satisfied: chardet>=5.2.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (5.2.0)
Requirement already satisfied: brotli>=1.1.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.1.0)
Requirement already satisfied: humanize>=4.10.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (4.13.0)
Requirement already satisfied: lark>=1.2.2 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.2.2)
Requirement already satisfied: alphashape>=1.3.1 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (1.3.1)
Requirement already satisfied: shapely>=2.0.0 in ./myenv/lib/python3.11/site-packages (from crawl4ai) (2.1.1)
Requirement already satisfied: typing_extensions>=4.0 in ./myenv/lib/python3.11/site-packages (from aiosqlite~=0.20->crawl4ai) (4.15.0)
Requirement already satisfied: soupsieve>1.2 in ./myenv/lib/python3.11/site-packages (from beautifulsoup4~=4.12->crawl4ai) (2.7)
Requirement already satisfied: charset_normalizer<4,>=2 in ./myenv/lib/python3.11/site-packages (from requests~=2.26->crawl4ai) (3.4.3)
Requirement already satisfied: idna<4,>=2.5 in ./myenv/lib/python3.11/site-packages (from requests~=2.26->crawl4ai) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./myenv/lib/python3.11/site-packages (from requests~=2.26->crawl4ai) (2.5.0)
Requirement already satisfied: certifi>=2017.4.17 in ./myenv/lib/python3.11/site-packages (from requests~=2.26->crawl4ai) (2025.8.3)
Requirement already satisfied: aiohappyeyeballs>=2.5.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (2.6.1)
Requirement already satisfied: aiosignal>=1.4.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (1.4.0)
Requirement already satisfied: attrs>=17.3.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (25.3.0)
Requirement already satisfied: frozenlist>=1.1.1 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (1.7.0)
Requirement already satisfied: multidict<7.0,>=4.5 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (6.6.4)
Requirement already satisfied: propcache>=0.2.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (0.3.2)
Requirement already satisfied: yarl<2.0,>=1.17.0 in ./myenv/lib/python3.11/site-packages (from aiohttp>=3.11.11->crawl4ai) (1.20.1)
Requirement already satisfied: click-log>=0.3.2 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (0.4.0)
Requirement already satisfied: trimesh>=3.9.8 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (4.7.4)
Requirement already satisfied: networkx>=2.5 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (3.5)
Requirement already satisfied: rtree>=0.9.7 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (1.4.1)
Requirement already satisfied: scipy>=1.0.0 in ./myenv/lib/python3.11/site-packages (from alphashape>=1.3.1->crawl4ai) (1.16.1)
Requirement already satisfied: sniffio>=1.1 in ./myenv/lib/python3.11/site-packages (from anyio>=4.0.0->crawl4ai) (1.3.1)
Requirement already satisfied: httpcore==1.* in ./myenv/lib/python3.11/site-packages (from httpx>=0.27.2->crawl4ai) (1.0.9)
Requirement already satisfied: h11>=0.16 in ./myenv/lib/python3.11/site-packages (from httpcore==1.*->httpx>=0.27.2->crawl4ai) (0.16.0)
Requirement already satisfied: h2<5,>=3 in ./myenv/lib/python3.11/site-packages (from httpx[http2]>=0.27.2->crawl4ai) (4.3.0)
Requirement already satisfied: hyperframe<7,>=6.1 in ./myenv/lib/python3.11/site-packages (from h2<5,>=3->httpx[http2]>=0.27.2->crawl4ai) (6.1.0)
Requirement already satisfied: hpack<5,>=4.1 in ./myenv/lib/python3.11/site-packages (from h2<5,>=3->httpx[http2]>=0.27.2->crawl4ai) (4.1.0)
Requirement already satisfied: importlib-metadata>=6.8.0 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (8.7.0)
Requirement already satisfied: jinja2<4.0.0,>=3.1.2 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (3.1.6)
Requirement already satisfied: jsonschema<5.0.0,>=4.22.0 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (4.25.1)
Requirement already satisfied: openai>=1.99.5 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (1.102.0)
Requirement already satisfied: tiktoken>=0.7.0 in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (0.11.0)
Requirement already satisfied: tokenizers in ./myenv/lib/python3.11/site-packages (from litellm>=1.53.1->crawl4ai) (0.21.4)
Requirement already satisfied: MarkupSafe>=2.0 in ./myenv/lib/python3.11/site-packages (from jinja2<4.0.0,>=3.1.2->litellm>=1.53.1->crawl4ai) (3.0.2)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in ./myenv/lib/python3.11/site-packages (from jsonschema<5.0.0,>=4.22.0->litellm>=1.53.1->crawl4ai) (2025.4.1)
Requirement already satisfied: referencing>=0.28.4 in ./myenv/lib/python3.11/site-packages (from jsonschema<5.0.0,>=4.22.0->litellm>=1.53.1->crawl4ai) (0.36.2)
Requirement already satisfied: rpds-py>=0.7.1 in ./myenv/lib/python3.11/site-packages (from jsonschema<5.0.0,>=4.22.0->litellm>=1.53.1->crawl4ai) (0.27.0)
Requirement already satisfied: annotated-types>=0.6.0 in ./myenv/lib/python3.11/site-packages (from pydantic>=2.10->crawl4ai) (0.7.0)
Requirement already satisfied: pydantic-core==2.33.2 in ./myenv/lib/python3.11/site-packages (from pydantic>=2.10->crawl4ai) (2.33.2)
Requirement already satisfied: typing-inspection>=0.4.0 in ./myenv/lib/python3.11/site-packages (from pydantic>=2.10->crawl4ai) (0.4.1)
Requirement already satisfied: zipp>=3.20 in ./myenv/lib/python3.11/site-packages (from importlib-metadata>=6.8.0->litellm>=1.53.1->crawl4ai) (3.23.0)
Requirement already satisfied: joblib in ./myenv/lib/python3.11/site-packages (from nltk>=3.9.1->crawl4ai) (1.5.1)
Requirement already satisfied: regex>=2021.8.3 in ./myenv/lib/python3.11/site-packages (from nltk>=3.9.1->crawl4ai) (2025.7.33)
Requirement already satisfied: tqdm in ./myenv/lib/python3.11/site-packages (from nltk>=3.9.1->crawl4ai) (4.67.1)
Requirement already satisfied: distro<2,>=1.7.0 in ./myenv/lib/python3.11/site-packages (from openai>=1.99.5->litellm>=1.53.1->crawl4ai) (1.9.0)
Requirement already satisfied: jiter<1,>=0.4.0 in ./myenv/lib/python3.11/site-packages (from openai>=1.99.5->litellm>=1.53.1->crawl4ai) (0.10.0)
Requirement already satisfied: pyee<14,>=13 in ./myenv/lib/python3.11/site-packages (from patchright>=1.49.0->crawl4ai) (13.0.0)
Requirement already satisfied: greenlet<4.0.0,>=3.1.1 in ./myenv/lib/python3.11/site-packages (from patchright>=1.49.0->crawl4ai) (3.2.4)
Requirement already satisfied: cryptography<46,>=41.0.5 in ./myenv/lib/python3.11/site-packages (from pyOpenSSL>=24.3.0->crawl4ai) (45.0.6)
Requirement already satisfied: cffi>=1.14 in ./myenv/lib/python3.11/site-packages (from cryptography<46,>=41.0.5->pyOpenSSL>=24.3.0->crawl4ai) (1.17.1)
Requirement already satisfied: pycparser in ./myenv/lib/python3.11/site-packages (from cffi>=1.14->cryptography<46,>=41.0.5->pyOpenSSL>=24.3.0->crawl4ai) (2.22)
Requirement already satisfied: markdown-it-py>=2.2.0 in ./myenv/lib/python3.11/site-packages (from rich>=13.9.4->crawl4ai) (4.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in ./myenv/lib/python3.11/site-packages (from rich>=13.9.4->crawl4ai) (2.19.2)
Requirement already satisfied: mdurl~=0.1 in ./myenv/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.9.4->crawl4ai) (0.1.2)
Requirement already satisfied: fake-http-header<0.4.0,>=0.3.5 in ./myenv/lib/python3.11/site-packages (from tf-playwright-stealth>=1.1.0->crawl4ai) (0.3.5)
Requirement already satisfied: huggingface-hub<1.0,>=0.16.4 in ./myenv/lib/python3.11/site-packages (from tokenizers->litellm>=1.53.1->crawl4ai) (0.34.4)
Requirement already satisfied: filelock in ./myenv/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers->litellm>=1.53.1->crawl4ai) (3.19.1)
Requirement already satisfied: fsspec>=2023.5.0 in ./myenv/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers->litellm>=1.53.1->crawl4ai) (2025.7.0)
Requirement already satisfied: packaging>=20.9 in ./myenv/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers->litellm>=1.53.1->crawl4ai) (25.0)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in ./myenv/lib/python3.11/site-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers->litellm>=1.53.1->crawl4ai) (1.1.8)
运行 crawl4ai 的设置脚本...
[INIT].... → Running post-installation setup...
[INIT].... → Installing Playwright browsers...
Installing dependencies...
命中:1 http://mirrors.aliyun.com/ubuntu jammy InRelease
命中:2 http://mirrors.aliyun.com/ubuntu jammy-security InRelease
命中:3 http://mirrors.aliyun.com/ubuntu jammy-updates InRelease
命中:4 http://mirrors.aliyun.com/ubuntu jammy-backports InRelease
命中:5 https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu2204/x86_64 InRelease
正在读取软件包列表... 完成
正在读取软件包列表... 完成
正在分析软件包的依赖关系树... 完成
正在读取状态信息... 完成
fonts-freefont-ttf 已经是最新版 (20120503-10build1)。
fonts-liberation 已经是最新版 (1:1.07.4-11)。
libasound2 已经是最新版 (1.2.6.1-1ubuntu1)。
libatk-bridge2.0-0 已经是最新版 (2.38.0-3)。
libatk1.0-0 已经是最新版 (2.36.0-3build1)。
libatspi2.0-0 已经是最新版 (2.44.0-3)。
libcairo2 已经是最新版 (1.16.0-5ubuntu2)。
libfontconfig1 已经是最新版 (2.13.1-4.2ubuntu5)。
libxcb1 已经是最新版 (1.14-3ubuntu3)。
libxcomposite1 已经是最新版 (1:0.4.5-1build2)。
libxdamage1 已经是最新版 (1:1.1.5-2build2)。
libxext6 已经是最新版 (2:1.3.4-1build1)。
libxfixes3 已经是最新版 (1:6.0.0-1)。
libxkbcommon0 已经是最新版 (1.4.0-1)。
libxrandr2 已经是最新版 (2:1.5.2-1build1)。
xfonts-scalable 已经是最新版 (1:1.0.3-1.2ubuntu1)。
fonts-ipafont-gothic 已经是最新版 (00303-21ubuntu1)。
fonts-tlwg-loma-otf 已经是最新版 (1:0.7.3-1)。
fonts-unifont 已经是最新版 (1:14.0.01-1)。
fonts-wqy-zenhei 已经是最新版 (0.9.45-8)。
xfonts-cyrillic 已经是最新版 (1:1.0.5)。
libcups2 已经是最新版 (2.4.1op1-1ubuntu4.11)。
libdbus-1-3 已经是最新版 (1.12.20-2ubuntu4.1)。
libfreetype6 已经是最新版 (2.11.1+dfsg-1ubuntu0.3)。
libnspr4 已经是最新版 (2:4.35-0ubuntu0.22.04.1)。
libnss3 已经是最新版 (2:3.98-0ubuntu0.22.04.2)。
libwayland-client0 已经是最新版 (1.20.0-1ubuntu0.1)。
libx11-6 已经是最新版 (2:1.7.5-1ubuntu0.3)。
xvfb 已经是最新版 (2:21.1.4-2ubuntu1.7~22.04.15)。
fonts-noto-color-emoji 已经是最新版 (2.047-0ubuntu0.22.04.1)。
libdrm2 已经是最新版 (2.4.113-2~ubuntu0.22.04.1)。
libgbm1 已经是最新版 (23.2.1-1ubuntu3.1~22.04.3)。
libglib2.0-0 已经是最新版 (2.72.4-0ubuntu2.6)。
libpango-1.0-0 已经是最新版 (1.50.6+ds-2ubuntu1)。
升级了 0 个软件包,新安装了 0 个软件包, 要卸载 0 个软件包,有 151 个软件包未被升级。
[COMPLETE] ● Playwright installation completed successfully.
[INIT].... → Installing Patchright browsers for undetected mode...
Installing dependencies...
命中:1 http://mirrors.aliyun.com/ubuntu jammy InRelease
命中:2 http://mirrors.aliyun.com/ubuntu jammy-security InRelease
命中:3 http://mirrors.aliyun.com/ubuntu jammy-updates InRelease
命中:4 http://mirrors.aliyun.com/ubuntu jammy-backports InRelease
命中:5 https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu2204/x86_64 InRelease
正在读取软件包列表... 完成
正在读取软件包列表... 完成
正在分析软件包的依赖关系树... 完成
正在读取状态信息... 完成
fonts-freefont-ttf 已经是最新版 (20120503-10build1)。
fonts-liberation 已经是最新版 (1:1.07.4-11)。
libasound2 已经是最新版 (1.2.6.1-1ubuntu1)。
libatk-bridge2.0-0 已经是最新版 (2.38.0-3)。
libatk1.0-0 已经是最新版 (2.36.0-3build1)。
libatspi2.0-0 已经是最新版 (2.44.0-3)。
libcairo2 已经是最新版 (1.16.0-5ubuntu2)。
libfontconfig1 已经是最新版 (2.13.1-4.2ubuntu5)。
libxcb1 已经是最新版 (1.14-3ubuntu3)。
libxcomposite1 已经是最新版 (1:0.4.5-1build2)。
libxdamage1 已经是最新版 (1:1.1.5-2build2)。
libxext6 已经是最新版 (2:1.3.4-1build1)。
libxfixes3 已经是最新版 (1:6.0.0-1)。
libxkbcommon0 已经是最新版 (1.4.0-1)。
libxrandr2 已经是最新版 (2:1.5.2-1build1)。
xfonts-scalable 已经是最新版 (1:1.0.3-1.2ubuntu1)。
fonts-ipafont-gothic 已经是最新版 (00303-21ubuntu1)。
fonts-tlwg-loma-otf 已经是最新版 (1:0.7.3-1)。
fonts-unifont 已经是最新版 (1:14.0.01-1)。
fonts-wqy-zenhei 已经是最新版 (0.9.45-8)。
xfonts-cyrillic 已经是最新版 (1:1.0.5)。
libcups2 已经是最新版 (2.4.1op1-1ubuntu4.11)。
libdbus-1-3 已经是最新版 (1.12.20-2ubuntu4.1)。
libfreetype6 已经是最新版 (2.11.1+dfsg-1ubuntu0.3)。
libnspr4 已经是最新版 (2:4.35-0ubuntu0.22.04.1)。
libnss3 已经是最新版 (2:3.98-0ubuntu0.22.04.2)。
libwayland-client0 已经是最新版 (1.20.0-1ubuntu0.1)。
libx11-6 已经是最新版 (2:1.7.5-1ubuntu0.3)。
xvfb 已经是最新版 (2:21.1.4-2ubuntu1.7~22.04.15)。
fonts-noto-color-emoji 已经是最新版 (2.047-0ubuntu0.22.04.1)。
libdrm2 已经是最新版 (2.4.113-2~ubuntu0.22.04.1)。
libgbm1 已经是最新版 (23.2.1-1ubuntu3.1~22.04.3)。
libglib2.0-0 已经是最新版 (2.72.4-0ubuntu2.6)。
libpango-1.0-0 已经是最新版 (1.50.6+ds-2ubuntu1)。
升级了 0 个软件包,新安装了 0 个软件包, 要卸载 0 个软件包,有 151 个软件包未被升级。
[COMPLETE] ● Patchright installation completed successfully.
[INIT].... → Starting database initialization...
[COMPLETE] ● Database initialization completed successfully.
[COMPLETE] ● Post-installation setup completed!
运行 crawl4ai 的检查脚本...
[INIT].... → Running Crawl4AI health check...
[INIT].... → Crawl4AI 0.7.4
[TEST].... ℹ Testing crawling capabilities...
[ERROR]... × https://crawl4ai.com | Error: Unexpected error in _crawl_web at line 696 in _crawl_web
(myenv/lib/python3.11/site-packages/crawl4ai/async_crawler_strategy.py):
Error: Failed on navigating ACS-GOTO:
Page.goto: Timeout 60000ms exceeded.
Call log:
- navigating to "https://crawl4ai.com/", waiting until "domcontentloaded"


Code context:
691 tag="GOTO",
692 params={"url": url},
693 )
694 response = None
695 else:
696 → raise RuntimeError(f"Failed on navigating ACS-GOTO:\n{str(e)}")
697
698 await self.execute_hook(
699 "after_goto", page, context=context, url=url, response=response, config=config
700 )
701
[ERROR]... × ❌ Test failed: Failed to get content
安装 Playwright 的 Chromium 依赖...
Installing dependencies...
命中:1 http://mirrors.aliyun.com/ubuntu jammy InRelease
命中:2 http://mirrors.aliyun.com/ubuntu jammy-security InRelease
命中:3 http://mirrors.aliyun.com/ubuntu jammy-updates InRelease
命中:4 http://mirrors.aliyun.com/ubuntu jammy-backports InRelease
命中:5 https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu2204/x86_64 InRelease
正在读取软件包列表... 完成
正在读取软件包列表... 完成
正在分析软件包的依赖关系树... 完成
正在读取状态信息... 完成
fonts-freefont-ttf 已经是最新版 (20120503-10build1)。
fonts-liberation 已经是最新版 (1:1.07.4-11)。
libasound2 已经是最新版 (1.2.6.1-1ubuntu1)。
libatk-bridge2.0-0 已经是最新版 (2.38.0-3)。
libatk1.0-0 已经是最新版 (2.36.0-3build1)。
libatspi2.0-0 已经是最新版 (2.44.0-3)。
libcairo2 已经是最新版 (1.16.0-5ubuntu2)。
libfontconfig1 已经是最新版 (2.13.1-4.2ubuntu5)。
libxcb1 已经是最新版 (1.14-3ubuntu3)。
libxcomposite1 已经是最新版 (1:0.4.5-1build2)。
libxdamage1 已经是最新版 (1:1.1.5-2build2)。
libxext6 已经是最新版 (2:1.3.4-1build1)。
libxfixes3 已经是最新版 (1:6.0.0-1)。
libxkbcommon0 已经是最新版 (1.4.0-1)。
libxrandr2 已经是最新版 (2:1.5.2-1build1)。
xfonts-scalable 已经是最新版 (1:1.0.3-1.2ubuntu1)。
fonts-ipafont-gothic 已经是最新版 (00303-21ubuntu1)。
fonts-tlwg-loma-otf 已经是最新版 (1:0.7.3-1)。
fonts-unifont 已经是最新版 (1:14.0.01-1)。
fonts-wqy-zenhei 已经是最新版 (0.9.45-8)。
xfonts-cyrillic 已经是最新版 (1:1.0.5)。
libcups2 已经是最新版 (2.4.1op1-1ubuntu4.11)。
libdbus-1-3 已经是最新版 (1.12.20-2ubuntu4.1)。
libfreetype6 已经是最新版 (2.11.1+dfsg-1ubuntu0.3)。
libnspr4 已经是最新版 (2:4.35-0ubuntu0.22.04.1)。
libnss3 已经是最新版 (2:3.98-0ubuntu0.22.04.2)。
libwayland-client0 已经是最新版 (1.20.0-1ubuntu0.1)。
libx11-6 已经是最新版 (2:1.7.5-1ubuntu0.3)。
xvfb 已经是最新版 (2:21.1.4-2ubuntu1.7~22.04.15)。
fonts-noto-color-emoji 已经是最新版 (2.047-0ubuntu0.22.04.1)。
libdrm2 已经是最新版 (2.4.113-2~ubuntu0.22.04.1)。
libgbm1 已经是最新版 (23.2.1-1ubuntu3.1~22.04.3)。
libglib2.0-0 已经是最新版 (2.72.4-0ubuntu2.6)。
libpango-1.0-0 已经是最新版 (1.50.6+ds-2ubuntu1)。
升级了 0 个软件包,新安装了 0 个软件包, 要卸载 0 个软件包,有 151 个软件包未被升级。
安装完成!

   
posted @ 2025-08-28 07:51  aiplus  阅读(22)  评论(0)    收藏  举报
悬浮按钮示例