BDS OPEN API 使用说明
前置条件
- 购买BDS数据迁移同步服务
- 确保客户端和BDS网络互通
- 添加BDS白名单
- telnet {{ BDSMaster }} 12311
HBase全量数据迁移接口说明
创建任务
接口(POST):http://{BDSMaster}:12311/hbase/fulldata/create
参数:
@FormParam(“src”) String srcName -> 源集群名
@FormParam(“dst”) String sinkName -> 目标集群名
@FormParam(“tableNames”) String tableNames -> 迁移的表(支持多张表”,”号分割)
@FormParam(“bulkload”) boolean bulkload -> 是否需要进行bulkload
@FormParam(“createTable”) boolean createTable -> 是否要创建目标表
@FormParam(“extraAttrs”) String extraAttrs -> 高级配置,可不填
例子:
curl -d "src=hbase1&dst=hbase2&tableNames=t1,t2,t3&bulkload=true&createTable=true" -H "Content-Type: application/x-www-form-urlencoded" -X POST http://{BDSMaster}:12311/hbase/fulldata/create
返回值:
{
"success":"true", // 请求是否成功
"message":"workflow-36c61d1240f84ecfbb472751a29b6deb" //任务id
}
查看所有任务
接口(GET):http://{BDSMaster}:12311/hbase/fulldata
例子:curl http://{BDSMaster}:12311/hbase/fulldata
返回值:
{
"tunnels": [ // 罗列出所有的任务信息
{
"jobName": "workflow-779298e682a44d5f9c226cea0e6f4dfd",
"tableNames": [
"t1"
],
"dst": "100.81.140.116",
"fullJobs": [
{
"jobName": "fulldata-104f42d9bbf341099ae02c0b61a70f4c",
"state": "SUCCEEDED",
"table": "t1"
}
],
"bulkloadJobs": [
{
"TaskName": "bulkload-73bf97f03f6140da91c3183e3d4fc1d8",
"state": "SUCCEEDED"
}
],
"src": "11.164.87.151",
"mergeTasks": [],
"state": "SUCCEEDED",
"inrcJobs": [],
"schemeTasks": [
{
"TaskName": "360338ff-abfb-4f78-9b73-580cc9fd48be",
"state": "SKIPPED",
"table": "t1"
}
]
},
{
"jobName": "workflow-36c61d1240f84ecfbb472751a29b6deb",
"tableNames": [
"t1",
"t2"
],
"dst": "100.81.140.116",
"fullJobs": [
{
"jobName": "fulldata-9014e168fccd433dbd56bcc61ba4ccbb",
"state": "SUCCEEDED",
"table": "t2"
},
{
"jobName": "fulldata-114cc535693344238572583268ae4c67",
"state": "SUCCEEDED",
"table": "t1"
}
],
"bulkloadJobs": [
{
"TaskName": "bulkload-92402af7ef544f6182af892fe4b35c65",
"state": "SUCCEEDED"
},
{
"TaskName": "bulkload-f7580e9ebf734c999656c1aaad41f67b",
"state": "SUCCEEDED"
}
],
"src": "11.164.87.151",
"mergeTasks": [],
"state": "SUCCEEDED",
"inrcJobs": [],
"schemeTasks": [
{
"TaskName": "b31b8f7c-9a74-4840-814a-6cd62d2b08c9",
"state": "SKIPPED",
"table": "t1"
},
{
"TaskName": "b1968a67-6684-4dd5-ba07-dbd7a52af24f",
"state": "SKIPPED",
"table": "t2"
}
]
}
],
"success": "true",
"message": "ok"
}
查看指定任务id的任务
接口(GET):http://{BDSMaster}:12311/hbase/fulldata/{jobId}/detail
暂停任务
接口(GET):http://{BDSMaster}:12311/hbase/fulldata/{jobId}/abort
返回值:
{
"success": "true",
"message": "ok"
}
删除任务
接口(GET):http://{BDSMaster}:12311/hbase/fulldata/{jobId}/del
返回值:
{
"success": "true",
"message": "ok"
}
重试任务
接口(GET):http://{BDSMaster}:12311/hbase/fulldata/{jobId}/retry
返回值:
{
"success": "true",
"message": "ok"
}
HBase增量任务同步接口
创建任务
接口(POST):http://{BDSMaster}:12311/hbase/incr/create
参数:
@FormParam(“name”) String name -> 同步通道的名称
@FormParam(“src”) String srcName -> 源集群名
@FormParam(“dst”) String sinkName -> 目标集群名
@FormParam(“tableNames”) String tableNames -> 迁移的表(支持多张表”,”号分割)
@FormParam(“createTable”) boolean createTable -> 是否要创建目标表
@FormParam(“extraAttrs”) String extraAttrs -> 高级配置,可不填
例子:
curl -d "name=test1&src=hbase1&dst=hbase2&tableNames=t1,t2,t3&createTable=true" -H "Content-Type: application/x-www-form-urlencoded" -X POST http://{BDSMaster}:12311/hbase/incr/create
返回值:
{
"success":"true",
"message":"wal-08a087da488349969ff4a4b78efbceba" // 同步通道的id
}
更新任务
接口(POST):http://{BDSMaster}:12311/hbase/incr/update
参数:
@FormParam(“jobId”) final String jobId
@FormParam(“tableNames”) final String tableNames
例子:
curl -d "jobId=xxx&tableNames=t1,t2,t3" -H "Content-Type: application/x-www-form-urlencoded" -X POST http://{BDSMaster}:12311/hbase/incr/update
查看所有任务
接口(GET):http://{BDSMaster}:12311/hbase/incr
返回值:
{
"tunnels": [
{
"jobId": "wal-2be4c2c89b7140a7b42c050916b3f5bb",
"tableNames": [
"default:t1"
],
"dst": "100.81.140.116",
"offset": 1573560272951,
"src": "11.164.87.151",
"name": "wal-2be4c2c89b7140a7b42c050916b3f5bb",
"syncDate": "2019-11-12 20:04:32",
"state": "KILLED",
"synctime": 1573560272951
},
{
"jobId": "wal-08a087da488349969ff4a4b78efbceba",
"tableNames": [
"default:t1",
"default:t2",
"default:t3"
],
"dst": "100.81.140.116",
"offset": 1573651478405,
"src": "11.164.87.151",
"name": "test1",
"syncDate": "2019-11-13 21:31:46",
"state": "RUNNING",
"synctime": 1573651906518
}
],
"success": "true",
"message": "ok"
}
查看指定id的任务
接口(GET):http://{BDSMaster}:12311/hbase/incr/{jobId}/detail
暂停任务
接口(GET):http://{BDSMaster}:12311/hbase/incr/{jobId}/abort
返回值:
{
"success": "true",
"message": "ok"
}
删除任务
接口(GET):http://{BDSMaster}:12311/hbase/incr/{jobId}/del
返回值:
{
"success": "true",
"message": "ok"
}
重试任务
接口(GET):http://{BDSMaster}:12311/hbase/incr/{jobId}/retry
返回值:
{
"success": "true",
"message": "ok"
}
版权声明
本文仅代表作者观点,不代表本站立场。
本文系作者授权发表,未经许可,不得转载。
评论