goldengate过滤特性例子

 

1.字符串类型字段过滤

FILTER (@STRFIND(APP,'app52') > 0)

 

2.时间类型过滤

TABLE hxl.metric,FILTER (@DATEDIFF('DD',timestamp, @DATENOW ())<1);
timestamp距离现在时间的天数

 

 

table hxl.tb_ogg_test,filter(
@streq(@DATE('YYYY-MM-DD', 'YYYY-MM-DD',CREATE_TIME),'2023-03-10') or
@streq(@DATE('YYYY-MM-DD', 'YYYY-MM-DD',CREATE_TIME),'2023-03-11')
);

 

 

 

3.使用SQLPREDICATE
TABLE hxl.metric,SQLPREDICATE "where to_char(timestamp,'YYYYMMDD')='20230310'";

TABLE hxl.metric,SQLPREDICATE "where timestamp>sysdate-1";

 

extract进程配置(pg)

table public.tb_test01,SQLPREDICATE "where to_char(createtime,'YYYYMM')='202504'";  
table public.tb_test01,SQLPREDICATE "where to_char(createtime,'YYYYMM') in ('202504','202505')"; 
table public.tb_test01,SQLPREDICATE "where to_char(createtime,'YYYYMM')='202504' and id<=1000";

 table public.tb_test01,SQLPREDICATE "where to_char(createtime,'YYYYMM')='202504' and name1 like '%5000%'";

 

4.整型比较

 

GGSCI (localhost as goldengate@SRCDB) 203> view params ext_a

EXTRACT ext_a
setenv(PGCLIENTENCODING = "UTF8")
setenv(ODBCINI="/goldengate_pg/odbc.ini" )
sourcedb SRCDB,userid goldengate, password goldengate
RMTHOST 192.168.1.135, MGRPORT 7819
rmtfile ./dirdat/ea, megabytes 1500, append
table public.tb_test01,filter(id>=1 and id<=50000);

 

我这里放在抽取进程中