19-02-16(19-02-19补)

Apache Hadoop YARN:state of the Union In Alibaba_杨巍威

1 Year Timeline: GA Release

Unified Data Operative System

Focus area:Continue to evolve at large scale,Unified platform

Scale at Today

Global Scheduling:takeaways,Docker Container

YARN Service,Service-UI,Placement Constraints,Node Attributes

Submarine: TF Hello world,Architecture

The Adaption of CSI,Volume Resource,Deployment

19-02-17(19-02-19补)

大数据高压下Hadoop在字节跳动的应用演化_徐鹏

Hadoop Ecosystem @ByteDance

HDFS Challenge

NameNode Memory Pressure

Our Solution - NNProxy(NameNode Proxy),FastCopy

NameNode Lock Contention——Solution:Dance NN

DataNode decommission

Increment data->Compress Pipeline

Scheduling Optimization,Utilization Optimization,Preemption Optimization,Stability Optimization

Ease of Use,Management

19-02-18(19-02-20补)

Uber搭建基于Kafka的跨数据中心拷贝平台_徐宏亮

Apache Kafka Pipeline @ Uber

Aggregation,Cross-Data Center Failover,Topic Migration

Motivation-MirrorMaker,Requirements

Design-uReplicator

Performance Issues

Problem:Full Speed Phase

Solution 1:Increase Batch Size,Solution 2:1-1 Partition Mapping

Problem 2:Long Tail Phase

Solution 1:Dynamic Workload Balance,Solution 2:Lag-Feedback Rebalances

Dynamic Workload Rebalance

More Issues,Design-Federated uReplicator

Detect data loss

19-02-19(19-02-20补)

Keep技术战略的推进和落地_彭跃辉

三大战略和五力模型

矩阵分析,VRIO,微观分析

Keep战略:家庭->运动社区->运动空间

技术战略的制定

基于lot和AI的虚拟教练:学-练-测

技术战略的实施

Scene搭建场景->Content建设内容->Data数据挖掘

用户画像,课程可视化

技术战略重要吗

19-02-20(19-02-21补)

知识内容平台AI技术应用思考_李大海

信息过载——个性化推荐——搜索

内容消费升级——问题路由、瓦力机器人

人机结合——泰戈尔计划

社区特有的问题:如何连接人与人

知乎特有的问题:如何连接内容与内容——知识图谱

知乎的网络:智能社区

19-02-21

构建动态并相应实时用户行为的Pinterest_刘波

Pinterest Products

Some Pinterest Numbers

Weak Points in 2015 Architecture

Requirements to Go Fully Online

Technical Decisions to solve the problems

Common Architecture of Rocksplicator Powered Systems

Replication Implementation,Slave Side Workflow

Master Side Workflow,Replication Performance in Production

Problems with Manual Cluster Management

Helix+Rocksplicator.Automated Cluster Management.Implement State Transition Command.

Unified ML Serving Platform

Scorpion Serving,Featurization

19-02-22

技术选型,技术委员会必须的思考_沈剑

组织人才相关,技术战略,技术落地+其他,一些实践

职级评审:一些问题,职级评审的目的,评什么?谁来评?怎么评?

能力模型是核心,能力模型怎么来?

依据什么评?谁来评?怎么评?强调:成长报告!

为什么早期不建议自研,为什么技术栈建议收敛

随着规模增大,为什么建议造一些轮子?

哪些事情应该先做?你真的了解一线同学的主要痛点么?