随笔分类 -  hive&hbase

摘要:基本排序函数语法:rank()over([partition by col1] order by col2)dense_rank()over([partition by col1] order by col2)row_number()over([partition by col1] order by... 阅读全文
posted @ 2014-10-09 16:59 晋心 阅读(3030) 评论(0) 推荐(0)
摘要:参考hive常用运算。•If函数: if•非空查找函数: COALESCE•条件判断函数:CASE•If函数: if语法: if(boolean testCondition, T valueTrue, T valueFalseOrNull)返回值: T说明: 当条件testCondition为TRU... 阅读全文
posted @ 2014-10-09 15:37 晋心 阅读(37735) 评论(0) 推荐(0)
摘要:insert overwrite table canal_amt1......2014-10-09 10:40:27,368 Stage-1 map = 100%, reduce = 32%, Cumulative CPU 2772.48 sec2014-10-09 10:40:28,426 St... 阅读全文
posted @ 2014-10-09 10:51 晋心 阅读(6995) 评论(0) 推荐(0)
摘要:1.Select 语法SELECT [ALL | DISTINCT] select_expr, select_expr, ...FROM table_reference[WHERE where_condition][GROUP BY col_list][CLUSTER BY col_list | ... 阅读全文
posted @ 2014-09-24 22:39 晋心 阅读(378) 评论(0) 推荐(0)
摘要:1.修改windows配置文件C:\WINDOWS\system32\drivers\etc\hosts将远程hbase和zookeeper主机的IP地址加进去54.0.88.53 HADOOP154.0.88.54 HADOOP22.加入jar包3.加载配置文件问题:网上很多都是自定义配置... 阅读全文
posted @ 2014-09-24 11:01 晋心 阅读(7087) 评论(0) 推荐(1)
摘要:1.hive表操作复制表结构create table denserank_amt like otheravgrank_amt;修改表名alter table tmp rename to credit_card; 修改表结构修改column属性ALTER TABLE table_name ... 阅读全文
posted @ 2014-09-23 23:12 晋心 阅读(748) 评论(0) 推荐(0)
摘要:1.安装sqoop请参考http://www.cnblogs.com/Richardzhu/p/3322635.html增加了SQOOP_HOME相关环境变量:source~/.bashrc /etq/profilesqoop help检测sqoop是否安装好了,没有error表示安装好了2.互导数... 阅读全文
posted @ 2014-09-23 22:25 晋心 阅读(3609) 评论(0) 推荐(0)