Data Sharing API
One API for data sharing
A scalable way to share data between platforms. Build apps and workflows that share data between data lakes and warehouses seamlessly.
POST
/api/v1/source/
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
{
"data": {
"source": {
"name": "Historical Data",
"cloud": "aws",
"product": "s3",
"region": "us-east-1",
"bucketName": 'acme-historical-data',
"path": '/',
"config": [
"arn:aws:iam::012345678912:role/bobsled"
]
}
}
}
POST
/api/v1/shares/
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
{
"data": {
"share": {
"name": "My share",
"destinationLocation": {
"cloud": "aws",
"product": "s3",
"region": "eu-west-1",
"accessIdentifiers": [
{
"arn": "arn:aws:iam::987654321987:user/customer_a"
}
]
},
"description": "This is my share",
"consumerOrganizationName": "Consumer A",
"sourceLocationId": "68302e9b-9cc2-4885-b43a-11c6b642fc86"
}
}
}
POST
/api/v1/shares/{shareId}/transfers/
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
{
"data": {
"type": "oneTime",
"transferEntity": [
{
"entityType": "table",
"pathNames": [
"s3://mybucket/folder1/"
],
"loadingBehavior": {
"pattern": "appendOnly"
},
"fileType": "PARQUET",
"tableName": "SHARED_TABLE_1"
},
{
"entityType": "table",
"pathNames": [
"s3://mybucket/folder2/",
"s3://mybucket/folder3/"
],
"loadingBehavior": {
"pattern": "updateAndAppend",
"uniqueIdentifiers": [
"id"
],
"lastModifiedAt": [
"updated_at"
]
},
"fileType": "PARQUET",
"tableName": "SHARED_TABLE_2"
}
],
"options": {
"transferNow": true
}
}
}
POST
/api/v1/shares/{shareId}/transfers/
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
{
"data": {
"type": "automated",
"transferEntity": [
{
"entityType": "table",
"pathNames": [
"s3://mybucket/folder1/"
],
"loadingBehavior": {
"pattern": "appendOnly"
},
"fileType": "PARQUET",
"tableName": "SHARED_TABLE_1"
},
{
"entityType": "table",
"pathNames": [
"s3://mybucket/folder2/",
"s3://mybucket/folder3/"
],
"loadingBehavior": {
"pattern": "updateAndAppend",
"uniqueIdentifiers": [
"id"
],
"lastModifiedAt": [
"updated_at"
]
},
"fileType": "PARQUET",
"tableName": "SHARED_TABLE_2"
}
],
"options": {
"transferNow": true
}
}
}
Use Cases
Making data products available to CoreLogic clients in the platforms where they work is an essential part of the modern data business – and Bobsled is the technology that helps us get there.
Brian Battaglia
GM Property Solutions, Corelogic
