Skip to content

30M test run #40

Description

@pdgetrf

YCSB Config

threadcount=4
fieldlength=160   #intended 500; due to the encoding, 160 length would yield about 500 payload
recordcount=30000000
operationcount=30000000
workload=core

YCSB Setup

***************** properties *****************
"requestdistribution"="uniform"
"recordcount"="30000000"
"readproportion"="0.5"
"scanproportion"="0"
"workload"="core"
"insertproportion"="0"
"updateproportion"="0.5"
"fieldlength"="160   #intended 500; due to the encoding, 160 length would yield about 500 payload"
"operationcount"="30000000"
"dotransactions"="false"
"threadcount"="4"
"readallfields"="true"
**********************************************

AWS Instances

image

image

Yaeger crashed due to out of memory.

YCSB "Load"

Data

Run finished, takes 28h4m22.484828118s
INSERT - Takes(s): 101062.5, Count: 29999999, OPS: 296.8, Avg(us): 13438, Min(us): 4116, Max(us): 3053567, 99th(us): 22319, 99.9th(us): 29327, 99.99th(us): 37087

RKV Memory

ubuntu@ip-172-31-2-182:~$ free -g
               total        used        free      shared  buff/cache   available
Mem:              31          11          18           0           1          19
Swap:              0           0           0

SI Memory

Spot-checked a few SI, all have the following:

ubuntu@ip-172-31-11-22:~$  free -g
               total        used        free      shared  buff/cache   available
Mem:              31          15          14           0           1          15
Swap:              0           0           0

CPU

image

Jaeger

image

YCAB Run

PUT 50%/GET 50%, 3M

***************** properties *****************
"recordcount"="300000"
"threadcount"="4"
"operationcount"="300000"
"readallfields"="true"
"insertproportion"="0"
"scanproportion"="0"
"requestdistribution"="uniform"
"dotransactions"="true"
"fieldlength"="160   #intended 500; due to the encoding, 160 length would yield about 500 payload"
"workload"="core"
"readproportion"="0.5"
"updateproportion"="0.5"
**********************************************

Run finished, takes 11m21.721168971s
READ   - Takes(s): 681.7, Count: 149873, OPS: 219.8, Avg(us): 8072, Min(us): 1878, Max(us): 58815, 99th(us): 17807, 99.9th(us): 25311, 99.99th(us): 33727
UPDATE - Takes(s): 681.7, Count: 150127, OPS: 220.2, Avg(us): 10081, Min(us): 3522, Max(us): 81407, 99th(us): 20447, 99.9th(us): 28575, 99.99th(us): 36383

PUT 0%/GET 100%

***************** properties *****************
"threadcount"="4"
"requestdistribution"="uniform"
"fieldlength"="160   #intended 500; due to the encoding, 160 length would yield about 500 payload"
"updateproportion"="0"
"insertproportion"="0"
"recordcount"="300000"
"dotransactions"="true"
"scanproportion"="0"
"operationcount"="300000"
"readallfields"="true"
"workload"="core"
"readproportion"="1"
**********************************************
READ   - Takes(s): 10.0, Count: 8002, OPS: 800.4, Avg(us): 4989, Min(us): 1865, Max(us): 31775, 99th(us): 14679, 99.9th(us): 19391, 99.99th(us): 31727
READ   - Takes(s): 20.0, Count: 15952, OPS: 797.7, Avg(us): 5006, Min(us): 1865, Max(us): 31775, 99th(us): 14687, 99.9th(us): 21887, 99.99th(us): 26927
READ   - Takes(s): 30.0, Count: 24022, OPS: 800.8, Avg(us): 4987, Min(us): 1865, Max(us): 31775, 99th(us): 14607, 99.9th(us): 22383, 99.99th(us): 26927
key is user8077940190266422784 and error is Get "http://rkv:8090/kv?key=user8077940190266422784": dial tcp 52.42.125.43:8090: connect: cannot assign requested address
key is user6962341607726016868 and error is Get "http://rkv:8090/kv?key=user6962341607726016868": dial tcp 52.42.125.43:8090: connect: cannot assign requested address
key is user6337301133090096462 and error is Get "http://rkv:8090/kv?key=user6337301133090096462": dial tcp 52.42.125.43:8090: connect: cannot assign requested address
key is user6971927150098868116 and error is Get "http://rkv:8090/kv?key=user6971927150098868116": dial tcp 52.42.125.43:8090: connect: cannot assign requested address
key is user6266626724665952454 and error is Get "http://rkv:8090/kv?key=user6266626724665952454": dial tcp 52.42.125.43:8090: connect: cannot assign requested address
key is user6298913883621934819 and error is Get "http://rkv:8090/kv?key=user6298913883621934819": dial tcp 52.42.125.43:8090: connect: cannot assign requested address
key is user7551286215126588905 and error is Get "http://rkv:8090/kv?key=user7551286215126588905": dial tcp 52.42.125.43:8090: connect: cannot assign requested address

52.42.125.43:8090 is the RKV server

PUT 100%/GET 0%

***************** properties *****************
"insertproportion"="0"
"readproportion"="0"
"requestdistribution"="uniform"
"operationcount"="300000"
"recordcount"="300000"
"dotransactions"="true"
"updateproportion"="1"
"scanproportion"="0"
"readallfields"="true"
"workload"="core"
"threadcount"="4"
"fieldlength"="160   #intended 500; due to the encoding, 160 length would yield about 500 payload"
**********************************************
UPDATE - Takes(s): 10.0, Count: 3030, OPS: 303.1, Avg(us): 13181, Min(us): 5500, Max(us): 32831, 99th(us): 22431, 99.9th(us): 27423, 99.99th(us): 32831
UPDATE - Takes(s): 20.0, Count: 6147, OPS: 307.4, Avg(us): 12997, Min(us): 5500, Max(us): 32831, 99th(us): 22399, 99.9th(us): 27055, 99.99th(us): 29855
UPDATE - Takes(s): 30.0, Count: 9277, OPS: 309.3, Avg(us): 12918, Min(us): 5500, Max(us): 32831, 99th(us): 22207, 99.9th(us): 27727, 99.99th(us): 32063
...
...
Run finished, takes 16m11.70180699s
UPDATE - Takes(s): 971.7, Count: 300000, OPS: 308.7, Avg(us): 12936, Min(us): 3868, Max(us): 1020415, 99th(us): 22831, 99.9th(us): 29535, 99.99th(us): 35679

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions