[置顶]推荐工作机会

正文内容加载中...
posted @ 2014-11-28 11:11 fxjwind 阅读(577) 评论(0) 编辑

Flink – CEP NFA

摘要: 看看Flink cep如何将pattern转换为NFA? 当来了一条event,如果在NFA中执行的? 前面的链路,CEP –> PatternStream –> select –> CEPOperatorUtils.createPatternStream 1. 产生NFACompiler.compileFactory,完成pattern到state的转换final NFACompiler...阅读全文
posted @ 2017-09-26 16:02 fxjwind 阅读(2) 评论(0) 编辑

cruise-control

摘要: https://github.com/linkedin/cruise-control https://engineering.linkedin.com/blog/2017/08/open-sourcing-kafka-cruise-control mark阅读全文
posted @ 2017-08-29 15:24 fxjwind 阅读(16) 评论(0) 编辑

FlinkCEP - Complex event processing for Flink

摘要: https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/libs/cep.html 首先目的是匹配pattern sequence pattern Sequence是由多个pattern构成 DataStream input = ... Pattern pattern = Pattern.begin("start").w...阅读全文
posted @ 2017-08-08 16:31 fxjwind 阅读(38) 评论(0) 编辑

Flink - CoGroup

摘要: 使用方式, dataStream.coGroup(otherStream) .where(0).equalTo(1) .window(TumblingEventTimeWindows.of(Time.seconds(3))) .apply (new CoGroupFunction () {...}); 可以看到coGroup只是产生CoGroupedStr...阅读全文
posted @ 2017-07-21 12:00 fxjwind 阅读(32) 评论(0) 编辑

SQL Join

摘要: mark,很清晰的图 https://www.codeproject.com/Articles/33052/Visual-Representation-of-SQL-Joins阅读全文
posted @ 2017-07-20 17:22 fxjwind 阅读(21) 评论(0) 编辑

Flink – Stream Task执行过程

摘要: Task.runif (invokable instanceof StatefulTask) { StatefulTask op = (StatefulTask) invokable; op.setInitialState(taskStateHandles);}// run the invokableinvokable.invoke(); invokable是StreamTask Str...阅读全文
posted @ 2017-07-06 20:21 fxjwind 阅读(48) 评论(0) 编辑

Flink - Asynchronous I/O

摘要: https://docs.google.com/document/d/1Lr9UYXEz6s6R_3PWg3bZQLF3upGaNEkc0rQCFSzaYDI/edit // create the original stream DataStream stream = ...; // apply the async I/O transformation DataStream> re...阅读全文
posted @ 2017-06-15 17:55 fxjwind 阅读(46) 评论(0) 编辑

Java8 - optional使用

摘要: http://geekabyte.blogspot.com/2015/01/using-optional-effectively-in-java-8.html mark阅读全文
posted @ 2017-06-14 12:37 fxjwind 阅读(22) 评论(0) 编辑

Flink - FlinkKafkaConsumer010

摘要: Properties properties = new Properties(); properties.setProperty("bootstrap.servers", "localhost:9092"); // only required for Kafka 0.8 properties.setProperty("zookeeper.connect", "localhost:2181"); p...阅读全文
posted @ 2017-06-07 16:43 fxjwind 阅读(198) 评论(0) 编辑

Flink - FlinkKafkaProducer010

摘要: https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/connectors/kafka.html 使用的方式, DataStream stream = ...; FlinkKafkaProducer010Configuration myProducerConfig = FlinkKafkaProducer010....阅读全文
posted @ 2017-06-07 11:36 fxjwind 阅读(72) 评论(0) 编辑

公告

统计

  • 随笔 - 376
  • 文章 - 0
  • 评论 - 189