Skip to content

spark-bypass-common/common-data-transmit

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

common-data-transmit


data-transmit-client

使用case如下:

    val taskBuilder = Task.builder

    val task = taskBuilder
      .setTaskName("tc_order_transaction")
      // export phase
      .elasticsearchExportPhaseBuilder
      .setIndex("tc_order_transaction_idx")
      .setType("tcOrderTransaction")
      .rangeFetchBuilder[Long](LogicOperatorType.MUST)
      .setRangeFieldName("updateTime").setStartValue(0L).setEndValue(System.currentTimeMillis)
      // import phase
      .hdfsImportPhaseBuilder.setPath("/esdata/lzo/tc_order_idx/")
      // build
      .buildTask

    task.transmitData()

data-transmit-daemon:

more later...

About

通用数据(流转)传输daemon服务

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages