Angel - MemoryDataBlock - angel.task.estimize.sample.number

angel.task.estimize.sample.number

val validData = new MemoryDataBlockLabeledData
trainData.resetReadIndex()
try {
val validSample = (0 until isVali).map(i => validData.put(trainData.read()))
validData.flush()
} catch {
case e: Exception =>
throw new AngelException("Create validData found Error.", e);
} finally {
validData.clean()
}

  • in

val validData = new MemoryDataBlock[LabeledData](isVali)

there has a angel config parameter to set the size of vList as a ArrayList

this.estimateSampleNumber = conf.getInt("angel.task.estimize.sample.number", 100);

posted @ 2018-07-28 17:22  澄轶(程毅)  阅读(215)  评论(0)    收藏  举报