19-02-16(19-02-19补)
Apache Hadoop YARN:state of the Union In Alibaba_杨巍威
1 Year Timeline: GA Release
Unified Data Operative System
Focus area:Continue to evolve at large scale,Unified platform
Scale at Today
Global Scheduling:takeaways,Docker Container
YARN Service,Service-UI,Placement Constraints,Node Attributes
Submarine: TF Hello world,Architecture
The Adaption of CSI,Volume Resource,Deployment
19-02-17(19-02-19补)
大数据高压下Hadoop在字节跳动的应用演化_徐鹏
Hadoop Ecosystem @ByteDance
HDFS Challenge
NameNode Memory Pressure
Our Solution - NNProxy(NameNode Proxy),FastCopy
NameNode Lock Contention——Solution:Dance NN
DataNode decommission
Increment data->Compress Pipeline
Scheduling Optimization,Utilization Optimization,Preemption Optimization,Stability Optimization
Ease of Use,Management
19-02-18(19-02-20补)
Uber搭建基于Kafka的跨数据中心拷贝平台_徐宏亮
Apache Kafka Pipeline @ Uber
Aggregation,Cross-Data Center Failover,Topic Migration
Motivation-MirrorMaker,Requirements
Design-uReplicator
Performance Issues
Problem:Full Speed Phase
Solution 1:Increase Batch Size,Solution 2:1-1 Partition Mapping
Problem 2:Long Tail Phase
Solution 1:Dynamic Workload Balance,Solution 2:Lag-Feedback Rebalances
Dynamic Workload Rebalance
More Issues,Design-Federated uReplicator
Detect data loss
19-02-19(19-02-20补)
Keep技术战略的推进和落地_彭跃辉
三大战略和五力模型
矩阵分析,VRIO,微观分析
Keep战略:家庭->运动社区->运动空间
技术战略的制定
基于lot和AI的虚拟教练:学-练-测
技术战略的实施
Scene搭建场景->Content建设内容->Data数据挖掘
用户画像,课程可视化
技术战略重要吗
19-02-20(19-02-21补)
知识内容平台AI技术应用思考_李大海
信息过载——个性化推荐——搜索
内容消费升级——问题路由、瓦力机器人
人机结合——泰戈尔计划
社区特有的问题:如何连接人与人
知乎特有的问题:如何连接内容与内容——知识图谱
知乎的网络:智能社区
19-02-21
构建动态并相应实时用户行为的Pinterest_刘波
Pinterest Products
Some Pinterest Numbers
Weak Points in 2015 Architecture
Requirements to Go Fully Online
Technical Decisions to solve the problems
Common Architecture of Rocksplicator Powered Systems
Replication Implementation,Slave Side Workflow
Master Side Workflow,Replication Performance in Production
Problems with Manual Cluster Management
Helix+Rocksplicator.Automated Cluster Management.Implement State Transition Command.
Unified ML Serving Platform
Scorpion Serving,Featurization
19-02-22
技术选型,技术委员会必须的思考_沈剑
组织人才相关,技术战略,技术落地+其他,一些实践
职级评审:一些问题,职级评审的目的,评什么?谁来评?怎么评?
能力模型是核心,能力模型怎么来?
依据什么评?谁来评?怎么评?强调:成长报告!
为什么早期不建议自研,为什么技术栈建议收敛
随着规模增大,为什么建议造一些轮子?
哪些事情应该先做?你真的了解一线同学的主要痛点么?