線技術(shù)峰會線技術(shù)峰會–阿里開源項目最佳實踐線技術(shù)峰會–阿里開源項目最佳實踐阿里巴巴技術(shù)專家–淘寶足跡–推薦系統(tǒng)線技術(shù)峰會–阿里開源項目最佳實踐?團(tuán)隊職責(zé)–應(yīng)用開發(fā)–技術(shù)支持–集群運(yùn)維管理–平臺/框架演進(jìn)–開源社區(qū)線技術(shù)峰會–阿里開源項目最佳實踐?發(fā)展歷史?使用場景?架構(gòu)?JStorm增強(qiáng)–性能–穩(wěn)定性–新特性?開源社區(qū)mFuture線技術(shù)峰會–阿里開源項目最佳實踐線技術(shù)峰會–阿里開源項目最佳實踐線技術(shù)峰會–阿里開源項目最佳實踐?從2013-04-30起發(fā)布了超過25個版本2016/5/312015/11/122.2.0ImproveImproveperformanceSlidingWindowShadeDependencyackpressureDonatetoapacheSupportStorm0.10binary2013/4/301Java2013/4/301JavacoreScheduler2013/12/300ackpressureScheduler2.0Koala3.02014/10/112015/10/270.9.6.38.18.1Scheduler4.0ackpressureasterScheduler3.0UserDefinedLogUserDefinedMetrics線技術(shù)峰會–阿里開源項目最佳實踐線技術(shù)峰會–阿里開源項目最佳實踐–4000+機(jī)器?StandalonermonYARN?JStorm-on-docker2PB+數(shù)據(jù)/天線技術(shù)峰會–阿里開源項目最佳實踐場景erloopTPP線技術(shù)峰會–阿里開源項目最佳實踐線技術(shù)峰會–阿里開源項目最佳實踐ARM…Portal(Koala)Plugin(Kafka/Metaq/TT/Mysql/HDFS/Hbase/…)CEPPluginTridentExtensionAPIRawStormAPIJStormCoreS線技術(shù)峰會–阿里開源項目最佳實踐ion線技術(shù)峰會–阿里開源項目最佳實踐ion線技術(shù)峰會–阿里開源項目最佳實踐?Worker:6GRAM86rmStorm864202worker,1spout,210worker,5spout,2010worker,10spout,4020worker,10spout,8040worker,10spout,80worker，10spout，split,2countsplit,20countsplit,40countsplit,80count160split,160count320split，320count線技術(shù)峰會–阿里開源項目最佳實踐TaskPipelineTuningUserDefinedschedulerleImproveefficiencyResolveTaskPipelineTuningUserDefinedschedulerleImproveefficiencyResolvebottleneckImproveparallelSerializationTuningsend/recvSeparatespoutnOverheadReductionOptimiOptimizationCoreCoreApplicaApplication升級/降級監(jiān)控升級/降級監(jiān)控多集群部署線技術(shù)峰會–阿里開源項目最佳實踐性?反壓?熱部署/灰度發(fā)布Tuplelifecycle?自定義metrics?監(jiān)控報警(Koala)??單點(diǎn)故障:nimbusHA?節(jié)點(diǎn)自檢:checkhealth?超大規(guī)模拓?fù)?topology-master??跨集群:jstorm-on-docker/standalone?單集群:jstorm-on-yarn/cgroup房:zk線技術(shù)峰會–阿里開源項目最佳實踐線技術(shù)峰會–阿里開源項目最佳實踐asterTaskheartbeatControleventTopologyasterTaskheartbeatControleventTopologyMasterTopologyMasterTopologyMaster線技術(shù)峰會–阿里開源項目最佳實踐ZZKterNettyserver線技術(shù)峰會–阿里開源項目最佳實踐Nettyserver線技術(shù)峰會–阿里開源項目最佳實踐xceedThresholdycacheentInoneworker線技術(shù)峰會–阿里開源項目最佳實踐度發(fā)布&熱升級線技術(shù)峰會線技術(shù)峰會–阿里開源項目最佳實踐2017年在線技術(shù)峰會–阿里開源項目最佳實踐TopologyMasterCommitoffsetupleCommitoffsetupleCommiteNormalbatchCheckpointbarrierSpoutControllerControllerCheckpointbarrierJstormcheckpointeJStormcheckpoint(optional)CheckpointbarrierCheckpointCheckpointbarrierJstormcheckpointeJStormcheckpoint(optional)CheckpointbarrierCheckpointbarrierHdfs/hbaseeCommitdbCheckpointandclearoldcheckpointedb線技術(shù)峰會–阿里開源項目最佳實踐TopologyMasterControllerupleRollbackeRollbackbarrierRollbackControllerupleRollbackeRollbackbarrierRollbackdbHdfs/hbaseastsuccesscheckpointandcleanuselesscheckpointedbRollbackbarrierStatelessboltRollbackbarriereRollbackbarrierEndingRollbackbarriereRollbackRollbackbarrier線技術(shù)峰會–阿里開源項目最佳實踐re?動態(tài)調(diào)整日志級別?用戶自定義metrics?優(yōu)雅shutdown?動態(tài)擴(kuò)容、更新配置線技術(shù)峰會–阿里開源項目最佳實踐?重構(gòu)的窗口機(jī)制，支持：–Processingtime–Ingestiontime–