[置顶]推荐工作机会

正文内容加载中...
posted @ 2014-11-28 11:11 fxjwind 阅读(558) 评论(0) 编辑

Flink - CoGroup

摘要: 使用方式, dataStream.coGroup(otherStream) .where(0).equalTo(1) .window(TumblingEventTimeWindows.of(Time.seconds(3))) .apply (new CoGroupFunction () {...}); 可以看到coGroup只是产生CoGroupedStr...阅读全文
posted @ 2017-07-21 12:00 fxjwind 阅读(8) 评论(0) 编辑

SQL Join

摘要: mark,很清晰的图 https://www.codeproject.com/Articles/33052/Visual-Representation-of-SQL-Joins阅读全文
posted @ 2017-07-20 17:22 fxjwind 阅读(8) 评论(0) 编辑

Flink – Stream Task执行过程

摘要: Task.runif (invokable instanceof StatefulTask) { StatefulTask op = (StatefulTask) invokable; op.setInitialState(taskStateHandles);}// run the invokableinvokable.invoke(); invokable是StreamTask Str...阅读全文
posted @ 2017-07-06 20:21 fxjwind 阅读(20) 评论(0) 编辑

Flink - Asynchronous I/O

摘要: https://docs.google.com/document/d/1Lr9UYXEz6s6R_3PWg3bZQLF3upGaNEkc0rQCFSzaYDI/edit // create the original stream DataStream stream = ...; // apply the async I/O transformation DataStream> re...阅读全文
posted @ 2017-06-15 17:55 fxjwind 阅读(29) 评论(0) 编辑

Java8 - optional使用

摘要: http://geekabyte.blogspot.com/2015/01/using-optional-effectively-in-java-8.html mark阅读全文
posted @ 2017-06-14 12:37 fxjwind 阅读(16) 评论(0) 编辑

Flink - FlinkKafkaConsumer010

摘要: Properties properties = new Properties(); properties.setProperty("bootstrap.servers", "localhost:9092"); // only required for Kafka 0.8 properties.setProperty("zookeeper.connect", "localhost:2181"); p...阅读全文
posted @ 2017-06-07 16:43 fxjwind 阅读(63) 评论(0) 编辑

Flink - FlinkKafkaProducer010

摘要: https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/connectors/kafka.html 使用的方式, DataStream stream = ...; FlinkKafkaProducer010Configuration myProducerConfig = FlinkKafkaProducer010....阅读全文
posted @ 2017-06-07 11:36 fxjwind 阅读(42) 评论(0) 编辑

Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases

摘要: INTRODUCTION In modern distributed cloud services, resilience and scalability are increasingly achieved by decoupling compute from storage [10][24][36][38][39] and by replicating storage across mu...阅读全文
posted @ 2017-05-25 15:35 fxjwind 阅读(272) 评论(0) 编辑

Calcite - StreamingSQL

摘要: https://calcite.apache.org/docs/stream.html Calcite’s SQL is an extension to standard SQL, not another ‘SQL-like’ language. The distinction is important, for several reasons: Streaming SQL is ...阅读全文
posted @ 2017-04-27 17:17 fxjwind 阅读(84) 评论(0) 编辑

Flink - ShipStrategyType

摘要: 对于DataStream,可以选择如下的Strategy, /** * Sets the partitioning of the {@link DataStream} so that the output elements * are broadcasted to every parallel instance of the next operation. ...阅读全文
posted @ 2017-04-14 10:55 fxjwind 阅读(32) 评论(0) 编辑

公告

统计

  • 随笔 - 374
  • 文章 - 0
  • 评论 - 187