ERROR: zbar等

 

1 数据源视频类型不一致

问题描述：原始数据es和写入数据es,时间上不对等， 前者进了数据，后者迟迟没有

问题解决：观察视频日志查看是否异常，检查写入es的脚本，查看是否异常

原始数据源： xxx_raw_data

处理后数据源： xxx_raw_data_full

 

GET xxx_raw_data/_search
{
    "query": {
        "bool": {
            "must": [
                {
                    "term": {
                        "data_source_key.keyword": {
                            "value": "YLZX-JRTT"
 }
                    }
                },
                {
                    "term": {
                        "article_genre": {
                            "value": "video"
 }
                    }
                }
            ]
        }
    },
    "sort": [
        {
            "timestamp": {
                "order": "desc"
 }
        }
    ]
}


其中value=3为视频

GET gnews_raw_data_full/_search
{
    "query": {
        "bool": {
            "must": [
                {
                    "term": {
                        "data_source_key.keyword": {
                            "value": "YLZX-JRTT"
 }
                    }
                },{
                    "term": {
                        "newsmode": {
                            "value": 3
 }
                    }
                }
            ]
        }
    },"sort": [
    {
        "timestamp": {
            "order": "desc"
 }
    }
]
}

2. 日志没有发现root

 

今天：**python src/mysql_statistics.py current**
昨天：**python src/mysql_statistics.py last**
所有存在的： **python src/mysql_statistics.py all**

No handlers could be found for logger "root"
解决方案：
import logging
logging.basicConfig()

 

3. zbar问题

raise ImportError('Unable to find zbar shared library')
ImportError: Unable to find zbar shared library
主要是这个包的问题, 安装好即可解决：
sudo yum install zbar-devel

 

4. cmake问题

/data/pyuser/anaconda2/bin/pip install dlib
RuntimeError:
*******************************************************************
CMake must be installed to build the following extensions: dlib
******************************************************************

SOLUTION: /data/pyuser/anaconda2/bin/pip install cmake

 

5. PIL问题

from PIL.WebPImagePlugin import WebPImageFile
File "/data/pyuser/anaconda2/lib/python2.7/site-packages/PIL/WebPImagePlugin.py", line 1, in <module>
from . import Image, ImageFile, _webp
ImportError: cannot import name _webp

SOLUTION: /data/pyuser/anaconda2/bin/pip install pillow==2.1.6

 

6.redis版本问题

redis版本两者不匹配会造成redis连接报错
SOLUTION：
redis 2.10.6 
redis-py-cluster 1.3.4

 

7. tensorflow和gc++问题

安装tf报错：
gcc: error trying to exec 'cc1plus': execvp: No such file or directory
commands.CommandError: Failed `build_ext` step:
CompileError: command 'gcc' failed with exit status 1

SOLUTION：
yum install gcc
yum install gcc-c++