Too many OFFSET_OUT_OF_RANGE errors

I have a 5-broker Kafka cluster with ~100 topics, and I'm using KafkaJS to subscribe from 2 topics (1 with 400 partitions and 1 with 10), and I'm always stuck at "The requested offset is not within the range of offsets maintained by the server" errors.
I know this is very little information, but can you help me understand what circumstances can cause this error? I can provide more info about my setup and code.

I've redacted broker node address and Buffer data, and here's a debug trace —
{"level":"DEBUG","timestamp":"2018-10-05T09:30:31.483Z","logger":"kafkajs","message":"[Connection] Connecting","broker":"kafka1.com:9092","clientId":"kafka-reader-local","ssl":false,"sasl":false}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:32.112Z","logger":"kafkajs","message":"[Connection] Request ApiVersions(key: 18, version: 0)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":41}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:32.386Z","logger":"kafkajs","message":"[Connection] Response ApiVersions(key: 18, version: 0)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":268,"data":{"errorCode":0,"apiVersions":[{"apiKey":0,"minVersion":0,"maxVersion":5},{"apiKey":1,"minVersion":0,"maxVersion":7},{"apiKey":2,"minVersion":0,"maxVersion":2},{"apiKey":3,"minVersion":0,"maxVersion":5},{"apiKey":4,"minVersion":0,"maxVersion":1},{"apiKey":5,"minVersion":0,"maxVersion":0},{"apiKey":6,"minVersion":0,"maxVersion":4},{"apiKey":7,"minVersion":0,"maxVersion":1},{"apiKey":8,"minVersion":0,"maxVersion":3},{"apiKey":9,"minVersion":0,"maxVersion":3},{"apiKey":10,"minVersion":0,"maxVersion":1},{"apiKey":11,"minVersion":0,"maxVersion":2},{"apiKey":12,"minVersion":0,"maxVersion":1},{"apiKey":13,"minVersion":0,"maxVersion":1},{"apiKey":14,"minVersion":0,"maxVersion":1},{"apiKey":15,"minVersion":0,"maxVersion":1},{"apiKey":16,"minVersion":0,"maxVersion":1},{"apiKey":17,"minVersion":0,"maxVersion":1},{"apiKey":18,"minVersion":0,"maxVersion":1},{"apiKey":19,"minVersion":0,"maxVersion":2},{"apiKey":20,"minVersion":0,"maxVersion":1},{"apiKey":21,"minVersion":0,"maxVersion":0},{"apiKey":22,"minVersion":0,"maxVersion":0},{"apiKey":23,"minVersion":0,"maxVersion":0},{"apiKey":24,"minVersion":0,"maxVersion":0},{"apiKey":25,"minVersion":0,"maxVersion":0},{"apiKey":26,"minVersion":0,"maxVersion":0},{"apiKey":27,"minVersion":0,"maxVersion":0},{"apiKey":28,"minVersion":0,"maxVersion":0},{"apiKey":29,"minVersion":0,"maxVersion":0},{"apiKey":30,"minVersion":0,"maxVersion":0},{"apiKey":31,"minVersion":0,"maxVersion":0},{"apiKey":32,"minVersion":0,"maxVersion":1},{"apiKey":33,"minVersion":0,"maxVersion":0},{"apiKey":34,"minVersion":0,"maxVersion":0},{"apiKey":35,"minVersion":0,"maxVersion":0},{"apiKey":36,"minVersion":0,"maxVersion":0},{"apiKey":37,"minVersion":0,"maxVersion":0},{"apiKey":38,"minVersion":0,"maxVersion":0},{"apiKey":39,"minVersion":0,"maxVersion":0},{"apiKey":40,"minVersion":0,"maxVersion":0},{"apiKey":41,"minVersion":0,"maxVersion":0},{"apiKey":42,"minVersion":0,"maxVersion":0}]}}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:32.387Z","logger":"kafkajs","message":"[Connection] Connecting","broker":"kafka1.com:9092","clientId":"kafka-reader-local","ssl":false,"sasl":false}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:32.647Z","logger":"kafkajs","message":"[Connection] Request ApiVersions(key: 18, version: 0)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":41}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:32.909Z","logger":"kafkajs","message":"[Connection] Response ApiVersions(key: 18, version: 0)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":268,"data":{"errorCode":0,"apiVersions":[{"apiKey":0,"minVersion":0,"maxVersion":5},{"apiKey":1,"minVersion":0,"maxVersion":7},{"apiKey":2,"minVersion":0,"maxVersion":2},{"apiKey":3,"minVersion":0,"maxVersion":5},{"apiKey":4,"minVersion":0,"maxVersion":1},{"apiKey":5,"minVersion":0,"maxVersion":0},{"apiKey":6,"minVersion":0,"maxVersion":4},{"apiKey":7,"minVersion":0,"maxVersion":1},{"apiKey":8,"minVersion":0,"maxVersion":3},{"apiKey":9,"minVersion":0,"maxVersion":3},{"apiKey":10,"minVersion":0,"maxVersion":1},{"apiKey":11,"minVersion":0,"maxVersion":2},{"apiKey":12,"minVersion":0,"maxVersion":1},{"apiKey":13,"minVersion":0,"maxVersion":1},{"apiKey":14,"minVersion":0,"maxVersion":1},{"apiKey":15,"minVersion":0,"maxVersion":1},{"apiKey":16,"minVersion":0,"maxVersion":1},{"apiKey":17,"minVersion":0,"maxVersion":1},{"apiKey":18,"minVersion":0,"maxVersion":1},{"apiKey":19,"minVersion":0,"maxVersion":2},{"apiKey":20,"minVersion":0,"maxVersion":1},{"apiKey":21,"minVersion":0,"maxVersion":0},{"apiKey":22,"minVersion":0,"maxVersion":0},{"apiKey":23,"minVersion":0,"maxVersion":0},{"apiKey":24,"minVersion":0,"maxVersion":0},{"apiKey":25,"minVersion":0,"maxVersion":0},{"apiKey":26,"minVersion":0,"maxVersion":0},{"apiKey":27,"minVersion":0,"maxVersion":0},{"apiKey":28,"minVersion":0,"maxVersion":0},{"apiKey":29,"minVersion":0,"maxVersion":0},{"apiKey":30,"minVersion":0,"maxVersion":0},{"apiKey":31,"minVersion":0,"maxVersion":0},{"apiKey":32,"minVersion":0,"maxVersion":1},{"apiKey":33,"minVersion":0,"maxVersion":0},{"apiKey":34,"minVersion":0,"maxVersion":0},{"apiKey":35,"minVersion":0,"maxVersion":0},{"apiKey":36,"minVersion":0,"maxVersion":0},{"apiKey":37,"minVersion":0,"maxVersion":0},{"apiKey":38,"minVersion":0,"maxVersion":0},{"apiKey":39,"minVersion":0,"maxVersion":0},{"apiKey":40,"minVersion":0,"maxVersion":0},{"apiKey":41,"minVersion":0,"maxVersion":0},{"apiKey":42,"minVersion":0,"maxVersion":0}]}}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:32.915Z","logger":"kafkajs","message":"[Connection] Request Metadata(key: 3, version: 2)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":1,"size":62}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:33.443Z","logger":"kafkajs","message":"[Connection] Response Metadata(key: 3, version: 2)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":1,"size":13677,"data":{"brokers":[{"nodeId":2,"host":"kafka2.com","port":9092,"rack":null},{"nodeId":5,"host":"kafka5.com","port":9092,"rack":null},{"nodeId":4,"host":"kafka4.com","port":9092,"rack":null},{"nodeId":1,"host":"kafka1.com","port":9092,"rack":null},{"nodeId":3,"host":"kafka3.com","port":9092,"rack":null}],"clusterId":"7QRYYnVdScOZOZEEj9pdpw","controllerId":3,"topicMetadata":[...]}]}}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:33.446Z","logger":"kafkajs","message":"[Connection] Request Metadata(key: 3, version: 2)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":2,"size":82}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:33.731Z","logger":"kafkajs","message":"[Connection] Response Metadata(key: 3, version: 2)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":2,"size":15380,"data":{"brokers":[{"nodeId":2,"host":"kafka2.com","port":9092,"rack":null},{"nodeId":5,"host":"kafka5.com","port":9092,"rack":null},{"nodeId":4,"host":"kafka4.com","port":9092,"rack":null},{"nodeId":1,"host":"kafka1.com","port":9092,"rack":null},{"nodeId":3,"host":"kafka3.com","port":9092,"rack":null}],"clusterId":"7QRYYnVdScOZOZEEj9pdpw","controllerId":3,"topicMetadata":[....]}]}}

{"level":"INFO","timestamp":"2018-10-05T09:30:33.735Z","logger":"kafkajs","message":"[Consumer] Starting","groupId":"kafka-reader-local"}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:33.735Z","logger":"kafkajs","message":"[Connection] Connecting","broker":"kafka3.com:9092","clientId":"kafka-reader-local","ssl":false,"sasl":false}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:33.999Z","logger":"kafkajs","message":"[Connection] Request GroupCoordinator(key: 10, version: 0)","broker":"kafka3.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":70}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:34.261Z","logger":"kafkajs","message":"[Connection] Response GroupCoordinator(key: 10, version: 0)","broker":"kafka3.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":45,"data":{"errorCode":0,"coordinator":{"nodeId":4,"host":"kafka4.com","port":9092}}}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:34.261Z","logger":"kafkajs","message":"[Cluster] Found group coordinator","nodeId":4}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:34.261Z","logger":"kafkajs","message":"[Connection] Connecting","broker":"kafka4.com:9092","clientId":"kafka-reader-local","ssl":false,"sasl":false}

{"level":"DEBUG","timestamp":"2018-10-05T09:30:34.791Z","logger":"kafkajs","message":"[Connection] Request JoinGroup(key: 11, version: 0)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":161}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:32.754Z","logger":"kafkajs","message":"[Connection] Response JoinGroup(key: 11, version: 0)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":283,"data":{"errorCode":0,"generationId":35,"groupProtocol":"RoundRobinAssigner","leaderId":"kafka-reader-local-d994b0c2-c6f9-4d63-800c-b3e285b710ab","memberId":"kafka-reader-local-d994b0c2-c6f9-4d63-800c-b3e285b710ab","members":[{"memberId":"kafka-reader-local-d994b0c2-c6f9-4d63-800c-b3e285b710ab","memberMetadata":{"type":"Buffer","data":[.....]}}]}}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:32.755Z","logger":"kafkajs","message":"[ConsumerGroup] Chosen as group leader","groupId":"kafka-reader-local","generationId":35,"memberId":"kafka-reader-local-d994b0c2-c6f9-4d63-800c-b3e285b710ab","topics":["topic1","topic2"]}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:32.758Z","logger":"kafkajs","message":"[ConsumerGroup] Group assignment","groupId":"kafka-reader-local","generationId":35,"topics":["topic1","topic2"],"groupProtocol":"RoundRobinAssigner","assignment":[{"memberId":"kafka-reader-local-d994b0c2-c6f9-4d63-800c-b3e285b710ab","memberAssignment":{"type":"Buffer","data":[....]}}]}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:32.785Z","logger":"kafkajs","message":"[Connection] Request SyncGroup(key: 14, version: 0)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":1,"size":2069}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.062Z","logger":"kafkajs","message":"[Connection] Response SyncGroup(key: 14, version: 0)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":1,"size":1865,"data":{"errorCode":0,"memberAssignment":{"type":"Buffer","data":[.....]}}}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.063Z","logger":"kafkajs","message":"[ConsumerGroup] Received assignment","groupId":"kafka-reader-local","generationId":35,"memberId":"kafka-reader-local-d994b0c2-c6f9-4d63-800c-b3e285b710ab","memberAssignment":{"topic1":[......]}}

{"level":"INFO","timestamp":"2018-10-05T09:32:33.063Z","logger":"kafkajs","message":"[Runner] Consumer has joined the group","groupId":"kafka-reader-local","memberId":"kafka-reader-local-d994b0c2-c6f9-4d63-800c-b3e285b710ab","leaderId":"kafka-reader-local-d994b0c2-c6f9-4d63-800c-b3e285b710ab","isLeader":true,"duration":119328}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.073Z","logger":"kafkajs","message":"[Connection] Request OffsetFetch(key: 9, version: 2)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":2,"size":1919}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.343Z","logger":"kafkajs","message":"[Connection] Response OffsetFetch(key: 9, version: 2)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":2,"size":7255,"data":{.....}}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.351Z","logger":"kafkajs","message":"[Connection] Connecting","broker":"kafka2.com:9092","clientId":"kafka-reader-local","ssl":false,"sasl":false}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.351Z","logger":"kafkajs","message":"[Connection] Connecting","broker":"kafka5.com:9092","clientId":"kafka-reader-local","ssl":false,"sasl":false}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.359Z","logger":"kafkajs","message":"[Connection] Request ListOffsets(key: 2, version: 0)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":3,"size":86}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.359Z","logger":"kafkajs","message":"[Connection] Request ListOffsets(key: 2, version: 0)","broker":"kafka3.com:9092","clientId":"kafka-reader-local","correlationId":1,"size":118}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.359Z","logger":"kafkajs","message":"[Connection] Request ListOffsets(key: 2, version: 0)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":3,"size":102}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.618Z","logger":"kafkajs","message":"[Connection] Request ListOffsets(key: 2, version: 0)","broker":"kafka5.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":86}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.618Z","logger":"kafkajs","message":"[Connection] Response ListOffsets(key: 2, version: 0)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":3,"size":47,"data":{"responses":[{"topic":"topic1","partitions":[{"partition":110,"errorCode":0,"offsets":["4257512"]}]}]}}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.619Z","logger":"kafkajs","message":"[Connection] Response ListOffsets(key: 2, version: 0)","broker":"kafka3.com:9092","clientId":"kafka-reader-local","correlationId":1,"size":83,"data":{"responses":[{"topic":"topic1","partitions":[{"partition":102,"errorCode":0,"offsets":["3978846"]},{"partition":92,"errorCode":0,"offsets":["4129268"]},{"partition":77,"errorCode":0,"offsets":["4269084"]}]}]}}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.619Z","logger":"kafkajs","message":"[Connection] Response ListOffsets(key: 2, version: 0)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":3,"size":65,"data":{"responses":[{"topic":"topic1","partitions":[{"partition":128,"errorCode":0,"offsets":["4016637"]},{"partition":158,"errorCode":0,"offsets":["4366767"]}]}]}}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.878Z","logger":"kafkajs","message":"[Connection] Response ListOffsets(key: 2, version: 0)","broker":"kafka5.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":47,"data":{"responses":[{"topic":"topic1","partitions":[{"partition":29,"errorCode":0,"offsets":["4285790"]}]}]}}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:33.883Z","logger":"kafkajs","message":"[Connection] Request ListOffsets(key: 2, version: 0)","broker":"kafka2.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":118}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:34.144Z","logger":"kafkajs","message":"[Connection] Response ListOffsets(key: 2, version: 0)","broker":"kafka2.com:9092","clientId":"kafka-reader-local","correlationId":0,"size":83,"data":{"responses":[{"topic":"topic1","partitions":[{"partition":226,"errorCode":0,"offsets":["4272587"]},{"partition":86,"errorCode":0,"offsets":["3881085"]},{"partition":346,"errorCode":0,"offsets":["3913838"]}]}]}}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:34.152Z","logger":"kafkajs","message":"[ConsumerGroup] Fetching from 2 out of 2 topics","topics":["topic1","topic2"],"activeTopics":["topic1","topic2"],"pausedTopics":[]}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:34.324Z","logger":"kafkajs","message":"[Connection] Request Fetch(key: 1, version: 3)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","correlationId":4,"size":1546}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:34.324Z","logger":"kafkajs","message":"[Connection] Request Fetch(key: 1, version: 3)","broker":"kafka2.com:9092","clientId":"kafka-reader-local","correlationId":1,"size":1546}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:34.324Z","logger":"kafkajs","message":"[Connection] Request Fetch(key: 1, version: 3)","broker":"kafka3.com:9092","clientId":"kafka-reader-local","correlationId":2,"size":1546}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:34.324Z","logger":"kafkajs","message":"[Connection] Request Fetch(key: 1, version: 3)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":4,"size":1546}

{"level":"DEBUG","timestamp":"2018-10-05T09:32:34.325Z","logger":"kafkajs","message":"[Connection] Request Fetch(key: 1, version: 3)","broker":"kafka5.com:9092","clientId":"kafka-reader-local","correlationId":1,"size":1546}

{"level":"ERROR","timestamp":"2018-10-05T09:33:56.435Z","logger":"kafkajs","message":"[Connection] Response Fetch(key: 1, version: 3)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","error":"The requested offset is not within the range of offsets maintained by the server","correlationId":4,"size":20349652}

{"level":"DEBUG","timestamp":"2018-10-05T09:33:56.435Z","logger":"kafkajs","message":"[Connection] Response Fetch(key: 1, version: 3)","broker":"kafka1.com:9092","clientId":"kafka-reader-local","error":"The requested offset is not within the range of offsets maintained by the server","correlationId":4,"payload":{"type":"Buffer","data":

{"level":"ERROR","timestamp":"2018-10-05T09:54:25.481Z","logger":"kafkajs","message":"[ConsumerGroup] Offset out of range, resetting to default offset","topic":"topic1","partition":355,"groupId":"kafka-reader-local","memberId":"kafka-reader-local-d994b0c2-c6f9-4d63-800c-b3e285b710ab"}

It is also available as a gist — https://gist.github.com/paambaati/7ee798fc2af5c8bc397299bdb07b8b33#file-kafkajs-log

Sure, let's debug this.
This error can happen in two situations:

It's the first time the consumer group is fetching the topic, so it has to apply the default offset (fromBeginning)
The consumer group hasn't been active for a while and the offsets "expired", which forces the consumer group to apply the default offset logic again

Do you know if the groupId is unique? no other consumer is active with the same id
Do you know if this is a compacted topic?
Have you tried subscribing to only one topic? Same issue?
We have been using KafkaJS with topics around 50 partitions, it's the first time I see 400 partition topics, but it should work just fine. I've set up a local environment with 5 nodes, and 1 topic with 400 partitions and I can consume just fine. I think this is a compacted topic, can you confirm?

Do you know if the groupId is unique? no other consumer is active with the same id

It is, yes.

Do you know if this is a compacted topic?

It is not. The topic's default cleanup policy is delete.

Have you tried subscribing to only one topic? Same issue?

I did, yes. I still see the same issue.
@tulios Also, a quick question about this —

apply the default offset

If the topic is pretty huge in size (say ~4 GB with 1.6B summed offsets), is that a possible bottleneck? What exactly happens when applying the default offset? I also tried the same thing with fromBeginning: false, but I still see it happening. Also, FWIW, I'm running Kafka 1.1.1.

@tulios Response OffsetFetch —
{"level":"DEBUG","timestamp":"2018-10-08T07:14:02.330Z","logger":"kafkajs","message":"[Connection] Response OffsetFetch(key: 9, version: 2)","broker":"kafka4.com:9092","clientId":"kafka-reader-local","correlationId":2,"size":6431,"data":{"responses":[{"topic":"topic1","partitions":[{"partition":0,"offset":"4143806","metadata":"","errorCode":0},{"partition":1,"offset":"4543306","metadata":"","errorCode":0},{"partition":2,"offset":"4239347","metadata":"","errorCode":0},{"partition":3,"offset":"4239104","metadata":"","errorCode":0},{"partition":4,"offset":"4094933","metadata":"","errorCode":0},{"partition":5,"offset":"4241632","metadata":"","errorCode":0},{"partition":6,"offset":"3966991","metadata":"","errorCode":0},{"partition":7,"offset":"4169178","metadata":"","errorCode":0},{"partition":8,"offset":"3905377","metadata":"","errorCode":0},{"partition":9,"offset":"4296918","metadata":"","errorCode":0},{"partition":10,"offset":"4065167","metadata":"","errorCode":0},{"partition":11,"offset":"4043429","metadata":"","errorCode":0},{"partition":12,"offset":"4326236","metadata":"","errorCode":0},{"partition":13,"offset":"4176365","metadata":"","errorCode":0},{"partition":14,"offset":"4454786","metadata":"","errorCode":0},{"partition":15,"offset":"4378623","metadata":"","errorCode":0},{"partition":16,"offset":"4195897","metadata":"","errorCode":0},{"partition":17,"offset":"4321289","metadata":"","errorCode":0},{"partition":18,"offset":"5046350","metadata":"","errorCode":0},{"partition":19,"offset":"4056064","metadata":"","errorCode":0},{"partition":20,"offset":"4277506","metadata":"","errorCode":0},{"partition":21,"offset":"4108382","metadata":"","errorCode":0},{"partition":22,"offset":"4070376","metadata":"","errorCode":0},{"partition":23,"offset":"4135697","metadata":"","errorCode":0},{"partition":24,"offset":"4246050","metadata":"","errorCode":0},{"partition":25,"offset":"4014287","metadata":"","errorCode":0},{"partition":26,"offset":"4017851","metadata":"","errorCode":0},{"partition":27,"offset":"4214520","metadata":"","errorCode":0},{"partition":28,"offset":"4264264","metadata":"","errorCode":0},{"partition":29,"offset":"4398252","metadata":"","errorCode":0},{"partition":30,"offset":"4367232","metadata":"","errorCode":0},{"partition":31,"offset":"4311537","metadata":"","errorCode":0},{"partition":32,"offset":"4158827","metadata":"","errorCode":0},{"partition":33,"offset":"4062001","metadata":"","errorCode":0},{"partition":34,"offset":"4221490","metadata":"","errorCode":0},{"partition":35,"offset":"4194665","metadata":"","errorCode":0},{"partition":36,"offset":"4218629","metadata":"","errorCode":0},{"partition":37,"offset":"3959108","metadata":"","errorCode":0},{"partition":38,"offset":"4229934","metadata":"","errorCode":0},{"partition":39,"offset":"4182472","metadata":"","errorCode":0},{"partition":40,"offset":"3939164","metadata":"","errorCode":0},{"partition":41,"offset":"4005374","metadata":"","errorCode":0},{"partition":42,"offset":"4035521","metadata":"","errorCode":0},{"partition":43,"offset":"4031915","metadata":"","errorCode":0},{"partition":44,"offset":"4126694","metadata":"","errorCode":0},{"partition":45,"offset":"4686288","metadata":"","errorCode":0},{"partition":46,"offset":"4246617","metadata":"","errorCode":0},{"partition":47,"offset":"4531681","metadata":"","errorCode":0},{"partition":48,"offset":"4353415","metadata":"","errorCode":0},{"partition":49,"offset":"4696009","metadata":"","errorCode":0},{"partition":50,"offset":"5139969","metadata":"","errorCode":0},{"partition":51,"offset":"4330594","metadata":"","errorCode":0},{"partition":52,"offset":"4292130","metadata":"","errorCode":0},{"partition":53,"offset":"4312174","metadata":"","errorCode":0},{"partition":54,"offset":"4358696","metadata":"","errorCode":0},{"partition":55,"offset":"4286961","metadata":"","errorCode":0},{"partition":56,"offset":"4395033","metadata":"","errorCode":0},{"partition":57,"offset":"4386532","metadata":"","errorCode":0},{"partition":58,"offset":"4363004","metadata":"","errorCode":0},{"partition":59,"offset":"4384583","metadata":"","errorCode":0},{"partition":60,"offset":"4165821","metadata":"","errorCode":0},{"partition":61,"offset":"4411646","metadata":"","errorCode":0},{"partition":62,"offset":"4571086","metadata":"","errorCode":0},{"partition":63,"offset":"4359393","metadata":"","errorCode":0},{"partition":64,"offset":"4468544","metadata":"","errorCode":0},{"partition":65,"offset":"4315484","metadata":"","errorCode":0},{"partition":66,"offset":"4380958","metadata":"","errorCode":0},{"partition":67,"offset":"4298407","metadata":"","errorCode":0},{"partition":68,"offset":"4176735","metadata":"","errorCode":0},{"partition":69,"offset":"4353334","metadata":"","errorCode":0},{"partition":70,"offset":"4232500","metadata":"","errorCode":0},{"partition":71,"offset":"4230631","metadata":"","errorCode":0},{"partition":72,"offset":"4243995","metadata":"","errorCode":0},{"partition":73,"offset":"4261817","metadata":"","errorCode":0},{"partition":74,"offset":"4461557","metadata":"","errorCode":0},{"partition":75,"offset":"4556539","metadata":"","errorCode":0},{"partition":76,"offset":"4363875","metadata":"","errorCode":0},{"partition":77,"offset":"4379406","metadata":"","errorCode":0},{"partition":78,"offset":"4448660","metadata":"","errorCode":0},{"partition":79,"offset":"4882099","metadata":"","errorCode":0},{"partition":80,"offset":"4132075","metadata":"","errorCode":0},{"partition":81,"offset":"4218184","metadata":"","errorCode":0},{"partition":82,"offset":"4444150","metadata":"","errorCode":0},{"partition":83,"offset":"4078831","metadata":"","errorCode":0},{"partition":84,"offset":"4178886","metadata":"","errorCode":0},{"partition":85,"offset":"4186120","metadata":"","errorCode":0},{"partition":86,"offset":"3985108","metadata":"","errorCode":0},{"partition":87,"offset":"4159917","metadata":"","errorCode":0},{"partition":88,"offset":"3918527","metadata":"","errorCode":0},{"partition":89,"offset":"4182537","metadata":"","errorCode":0},{"partition":90,"offset":"4215847","metadata":"","errorCode":0},{"partition":91,"offset":"3948145","metadata":"","errorCode":0},{"partition":92,"offset":"4259462","metadata":"","errorCode":0},{"partition":93,"offset":"4679522","metadata":"","errorCode":0},{"partition":94,"offset":"4257683","metadata":"","errorCode":0},{"partition":95,"offset":"4196914","metadata":"","errorCode":0},{"partition":96,"offset":"4318679","metadata":"","errorCode":0},{"partition":97,"offset":"4118215","metadata":"","errorCode":0},{"partition":98,"offset":"4505640","metadata":"","errorCode":0},{"partition":99,"offset":"4196707","metadata":"","errorCode":0},{"partition":100,"offset":"4305901","metadata":"","errorCode":0},{"partition":101,"offset":"4260613","metadata":"","errorCode":0},{"partition":102,"offset":"4076424","metadata":"","errorCode":0},{"partition":103,"offset":"4758172","metadata":"","errorCode":0},{"partition":104,"offset":"4304107","metadata":"","errorCode":0},{"partition":105,"offset":"4098768","metadata":"","errorCode":0},{"partition":106,"offset":"4278445","metadata":"","errorCode":0},{"partition":107,"offset":"4098085","metadata":"","errorCode":0},{"partition":108,"offset":"4100691","metadata":"","errorCode":0},{"partition":109,"offset":"4153436","metadata":"","errorCode":0},{"partition":110,"offset":"4358286","metadata":"","errorCode":0},{"partition":111,"offset":"4248626","metadata":"","errorCode":0},{"partition":112,"offset":"4195626","metadata":"","errorCode":0},{"partition":113,"offset":"4063304","metadata":"","errorCode":0},{"partition":114,"offset":"4288514","metadata":"","errorCode":0},{"partition":115,"offset":"4178976","metadata":"","errorCode":0},{"partition":116,"offset":"4099960","metadata":"","errorCode":0},{"partition":117,"offset":"3971248","metadata":"","errorCode":0},{"partition":118,"offset":"4206855","metadata":"","errorCode":0},{"partition":119,"offset":"4170588","metadata":"","errorCode":0},{"partition":120,"offset":"4154023","metadata":"","errorCode":0},{"partition":121,"offset":"4175692","metadata":"","errorCode":0},{"partition":122,"offset":"4075610","metadata":"","errorCode":0},{"partition":123,"offset":"4086194","metadata":"","errorCode":0},{"partition":124,"offset":"4254846","metadata":"","errorCode":0},{"partition":125,"offset":"4102456","metadata":"","errorCode":0},{"partition":126,"offset":"4433427","metadata":"","errorCode":0},{"partition":127,"offset":"4219314","metadata":"","errorCode":0},{"partition":128,"offset":"4133069","metadata":"","errorCode":0},{"partition":129,"offset":"4904696","metadata":"","errorCode":0},{"partition":130,"offset":"4424735","metadata":"","errorCode":0},{"partition":131,"offset":"4205430","metadata":"","errorCode":0},{"partition":132,"offset":"4332141","metadata":"","errorCode":0},{"partition":133,"offset":"4577976","metadata":"","errorCode":0},{"partition":134,"offset":"4589327","metadata":"","errorCode":0},{"partition":135,"offset":"4456593","metadata":"","errorCode":0},{"partition":136,"offset":"4315571","metadata":"","errorCode":0},{"partition":137,"offset":"4238763","metadata":"","errorCode":0},{"partition":138,"offset":"4234114","metadata":"","errorCode":0},{"partition":139,"offset":"4463620","metadata":"","errorCode":0},{"partition":140,"offset":"4322010","metadata":"","errorCode":0},{"partition":141,"offset":"4204710","metadata":"","errorCode":0},{"partition":142,"offset":"4408544","metadata":"","errorCode":0},{"partition":143,"offset":"4270629","metadata":"","errorCode":0},{"partition":144,"offset":"4302026","metadata":"","errorCode":0},{"partition":145,"offset":"4602491","metadata":"","errorCode":0},{"partition":146,"offset":"4483332","metadata":"","errorCode":0},{"partition":147,"offset":"4447752","metadata":"","errorCode":0},{"partition":148,"offset":"4277824","metadata":"","errorCode":0},{"partition":149,"offset":"4328324","metadata":"","errorCode":0},{"partition":150,"offset":"4256433","metadata":"","errorCode":0},{"partition":151,"offset":"4365755","metadata":"","errorCode":0},{"partition":152,"offset":"4207938","metadata":"","errorCode":0},{"partition":153,"offset":"4419041","metadata":"","errorCode":0},{"partition":154,"offset":"4286773","metadata":"","errorCode":0},{"partition":155,"offset":"4345355","metadata":"","errorCode":0},{"partition":156,"offset":"4315367","metadata":"","errorCode":0},{"partition":157,"offset":"4357796","metadata":"","errorCode":0},{"partition":158,"offset":"4463591","metadata":"","errorCode":0},{"partition":159,"offset":"4579069","metadata":"","errorCode":0},{"partition":160,"offset":"4190007","metadata":"","errorCode":0},{"partition":161,"offset":"4433907","metadata":"","errorCode":0},{"partition":162,"offset":"4268577","metadata":"","errorCode":0},{"partition":163,"offset":"4250718","metadata":"","errorCode":0},{"partition":164,"offset":"4782866","metadata":"","errorCode":0},{"partition":165,"offset":"4053916","metadata":"","errorCode":0},{"partition":166,"offset":"4064074","metadata":"","errorCode":0},{"partition":167,"offset":"4030281","metadata":"","errorCode":0},{"partition":168,"offset":"4119845","metadata":"","errorCode":0},{"partition":169,"offset":"4104712","metadata":"","errorCode":0},{"partition":170,"offset":"4630939","metadata":"","errorCode":0},{"partition":171,"offset":"3939364","metadata":"","errorCode":0},{"partition":172,"offset":"4118605","metadata":"","errorCode":0},{"partition":173,"offset":"4319904","metadata":"","errorCode":0},{"partition":174,"offset":"4218449","metadata":"","errorCode":0},{"partition":175,"offset":"4081479","metadata":"","errorCode":0},{"partition":176,"offset":"4461242","metadata":"","errorCode":0},{"partition":177,"offset":"4026870","metadata":"","errorCode":0},{"partition":178,"offset":"4327250","metadata":"","errorCode":0},{"partition":179,"offset":"4196801","metadata":"","errorCode":0},{"partition":180,"offset":"4061231","metadata":"","errorCode":0},{"partition":181,"offset":"4214169","metadata":"","errorCode":0},{"partition":182,"offset":"4045195","metadata":"","errorCode":0},{"partition":183,"offset":"4294172","metadata":"","errorCode":0},{"partition":184,"offset":"5021050","metadata":"","errorCode":0},{"partition":185,"offset":"4067222","metadata":"","errorCode":0},{"partition":186,"offset":"4028025","metadata":"","errorCode":0},{"partition":187,"offset":"4296363","metadata":"","errorCode":0},{"partition":188,"offset":"4062582","metadata":"","errorCode":0},{"partition":189,"offset":"4006191","metadata":"","errorCode":0},{"partition":190,"offset":"4357589","metadata":"","errorCode":0},{"partition":191,"offset":"4018866","metadata":"","errorCode":0},{"partition":192,"offset":"4648355","metadata":"","errorCode":0},{"partition":193,"offset":"4020316","metadata":"","errorCode":0},{"partition":194,"offset":"4431831","metadata":"","errorCode":0},{"partition":195,"offset":"4193969","metadata":"","errorCode":0},{"partition":196,"offset":"4144379","metadata":"","errorCode":0},{"partition":197,"offset":"4170125","metadata":"","errorCode":0},{"partition":198,"offset":"4013964","metadata":"","errorCode":0},{"partition":199,"offset":"4266347","metadata":"","errorCode":0},{"partition":200,"offset":"4423347","metadata":"","errorCode":0},{"partition":201,"offset":"4011060","metadata":"","errorCode":0},{"partition":202,"offset":"4017696","metadata":"","errorCode":0},{"partition":203,"offset":"3994815","metadata":"","errorCode":0},{"partition":204,"offset":"4284836","metadata":"","errorCode":0},{"partition":205,"offset":"4219642","metadata":"","errorCode":0},{"partition":206,"offset":"4157424","metadata":"","errorCode":0},{"partition":207,"offset":"4400954","metadata":"","errorCode":0},{"partition":208,"offset":"4110524","metadata":"","errorCode":0},{"partition":209,"offset":"4619305","metadata":"","errorCode":0},{"partition":210,"offset":"4451566","metadata":"","errorCode":0},{"partition":211,"offset":"4403045","metadata":"","errorCode":0},{"partition":212,"offset":"4297510","metadata":"","errorCode":0},{"partition":213,"offset":"4543194","metadata":"","errorCode":0},{"partition":214,"offset":"4264254","metadata":"","errorCode":0},{"partition":215,"offset":"4271298","metadata":"","errorCode":0},{"partition":216,"offset":"4212428","metadata":"","errorCode":0},{"partition":217,"offset":"4372271","metadata":"","errorCode":0},{"partition":218,"offset":"4170314","metadata":"","errorCode":0},{"partition":219,"offset":"4380736","metadata":"","errorCode":0},{"partition":220,"offset":"4167339","metadata":"","errorCode":0},{"partition":221,"offset":"4193126","metadata":"","errorCode":0},{"partition":222,"offset":"4297119","metadata":"","errorCode":0},{"partition":223,"offset":"4307652","metadata":"","errorCode":0},{"partition":224,"offset":"4217688","metadata":"","errorCode":0},{"partition":225,"offset":"4356789","metadata":"","errorCode":0},{"partition":226,"offset":"4373229","metadata":"","errorCode":0},{"partition":227,"offset":"4509992","metadata":"","errorCode":0},{"partition":228,"offset":"4743873","metadata":"","errorCode":0},{"partition":229,"offset":"4853283","metadata":"","errorCode":0},{"partition":230,"offset":"4317316","metadata":"","errorCode":0},{"partition":231,"offset":"4226691","metadata":"","errorCode":0},{"partition":232,"offset":"4508335","metadata":"","errorCode":0},{"partition":233,"offset":"4248126","metadata":"","errorCode":0},{"partition":234,"offset":"4289605","metadata":"","errorCode":0},{"partition":235,"offset":"4329781","metadata":"","errorCode":0},{"partition":236,"offset":"4584730","metadata":"","errorCode":0},{"partition":237,"offset":"4129646","metadata":"","errorCode":0},{"partition":238,"offset":"4630292","metadata":"","errorCode":0},{"partition":239,"offset":"4389623","metadata":"","errorCode":0},{"partition":240,"offset":"4071017","metadata":"","errorCode":0},{"partition":241,"offset":"4353675","metadata":"","errorCode":0},{"partition":242,"offset":"4330661","metadata":"","errorCode":0},{"partition":243,"offset":"4244655","metadata":"","errorCode":0},{"partition":244,"offset":"4272362","metadata":"","errorCode":0},{"partition":245,"offset":"4040136","metadata":"","errorCode":0},{"partition":246,"offset":"4002945","metadata":"","errorCode":0},{"partition":247,"offset":"3995715","metadata":"","errorCode":0},{"partition":248,"offset":"3887859","metadata":"","errorCode":0},{"partition":249,"offset":"4188879","metadata":"","errorCode":0},{"partition":250,"offset":"4301774","metadata":"","errorCode":0},{"partition":251,"offset":"3929527","metadata":"","errorCode":0},{"partition":252,"offset":"4112764","metadata":"","errorCode":0},{"partition":253,"offset":"4168407","metadata":"","errorCode":0},{"partition":254,"offset":"4192349","metadata":"","errorCode":0},{"partition":255,"offset":"4661344","metadata":"","errorCode":0},{"partition":256,"offset":"4309525","metadata":"","errorCode":0},{"partition":257,"offset":"4048270","metadata":"","errorCode":0},{"partition":258,"offset":"4289149","metadata":"","errorCode":0},{"partition":259,"offset":"4148801","metadata":"","errorCode":0},{"partition":260,"offset":"4636987","metadata":"","errorCode":0},{"partition":261,"offset":"3965969","metadata":"","errorCode":0},{"partition":262,"offset":"4007979","metadata":"","errorCode":0},{"partition":263,"offset":"4087887","metadata":"","errorCode":0},{"partition":264,"offset":"4430699","metadata":"","errorCode":0},{"partition":265,"offset":"4048145","metadata":"","errorCode":0},{"partition":266,"offset":"3952356","metadata":"","errorCode":0},{"partition":267,"offset":"4262144","metadata":"","errorCode":0},{"partition":268,"offset":"4282185","metadata":"","errorCode":0},{"partition":269,"offset":"3960399","metadata":"","errorCode":0},{"partition":270,"offset":"4377788","metadata":"","errorCode":0},{"partition":271,"offset":"4081678","metadata":"","errorCode":0},{"partition":272,"offset":"4340216","metadata":"","errorCode":0},{"partition":273,"offset":"4061145","metadata":"","errorCode":0},{"partition":274,"offset":"4366566","metadata":"","errorCode":0},{"partition":275,"offset":"4233358","metadata":"","errorCode":0},{"partition":276,"offset":"4350881","metadata":"","errorCode":0},{"partition":277,"offset":"3910214","metadata":"","errorCode":0},{"partition":278,"offset":"4240990","metadata":"","errorCode":0},{"partition":279,"offset":"4359340","metadata":"","errorCode":0},{"partition":280,"offset":"4042984","metadata":"","errorCode":0},{"partition":281,"offset":"4027849","metadata":"","errorCode":0},{"partition":282,"offset":"4239078","metadata":"","errorCode":0},{"partition":283,"offset":"4033785","metadata":"","errorCode":0},{"partition":284,"offset":"4121837","metadata":"","errorCode":0},{"partition":285,"offset":"4207110","metadata":"","errorCode":0},{"partition":286,"offset":"4249362","metadata":"","errorCode":0},{"partition":287,"offset":"4302953","metadata":"","errorCode":0},{"partition":288,"offset":"4295662","metadata":"","errorCode":0},{"partition":289,"offset":"4673452","metadata":"","errorCode":0},{"partition":290,"offset":"4643085","metadata":"","errorCode":0},{"partition":291,"offset":"4287895","metadata":"","errorCode":0},{"partition":292,"offset":"4247709","metadata":"","errorCode":0},{"partition":293,"offset":"4269601","metadata":"","errorCode":0},{"partition":294,"offset":"4536538","metadata":"","errorCode":0},{"partition":295,"offset":"4295158","metadata":"","errorCode":0},{"partition":296,"offset":"4175888","metadata":"","errorCode":0},{"partition":297,"offset":"4163881","metadata":"","errorCode":0},{"partition":298,"offset":"4209662","metadata":"","errorCode":0},{"partition":299,"offset":"4535307","metadata":"","errorCode":0},{"partition":300,"offset":"4353436","metadata":"","errorCode":0},{"partition":301,"offset":"4422951","metadata":"","errorCode":0},{"partition":302,"offset":"4628994","metadata":"","errorCode":0},{"partition":303,"offset":"4941813","metadata":"","errorCode":0},{"partition":304,"offset":"4209047","metadata":"","errorCode":0},{"partition":305,"offset":"4288423","metadata":"","errorCode":0},{"partition":306,"offset":"4357978","metadata":"","errorCode":0},{"partition":307,"offset":"4268242","metadata":"","errorCode":0},{"partition":308,"offset":"4103082","metadata":"","errorCode":0},{"partition":309,"offset":"4350084","metadata":"","errorCode":0},{"partition":310,"offset":"4171759","metadata":"","errorCode":0},{"partition":311,"offset":"4420239","metadata":"","errorCode":0},{"partition":312,"offset":"4318585","metadata":"","errorCode":0},{"partition":313,"offset":"4924603","metadata":"","errorCode":0},{"partition":314,"offset":"4610633","metadata":"","errorCode":0},{"partition":315,"offset":"4650104","metadata":"","errorCode":0},{"partition":316,"offset":"4397625","metadata":"","errorCode":0},{"partition":317,"offset":"4309193","metadata":"","errorCode":0},{"partition":318,"offset":"4405438","metadata":"","errorCode":0},{"partition":319,"offset":"4622441","metadata":"","errorCode":0},{"partition":320,"offset":"4076969","metadata":"","errorCode":0},{"partition":321,"offset":"4185678","metadata":"","errorCode":0},{"partition":322,"offset":"4323609","metadata":"","errorCode":0},{"partition":323,"offset":"4045732","metadata":"","errorCode":0},{"partition":324,"offset":"4075433","metadata":"","errorCode":0},{"partition":325,"offset":"4040001","metadata":"","errorCode":0},{"partition":326,"offset":"4512583","metadata":"","errorCode":0},{"partition":327,"offset":"3980622","metadata":"","errorCode":0},{"partition":328,"offset":"4059095","metadata":"","errorCode":0},{"partition":329,"offset":"4569165","metadata":"","errorCode":0},{"partition":330,"offset":"4216439","metadata":"","errorCode":0},{"partition":331,"offset":"4014687","metadata":"","errorCode":0},{"partition":332,"offset":"4116875","metadata":"","errorCode":0},{"partition":333,"offset":"4123118","metadata":"","errorCode":0},{"partition":334,"offset":"4192440","metadata":"","errorCode":0},{"partition":335,"offset":"4089810","metadata":"","errorCode":0},{"partition":336,"offset":"4145773","metadata":"","errorCode":0},{"partition":337,"offset":"4062896","metadata":"","errorCode":0},{"partition":338,"offset":"4365087","metadata":"","errorCode":0},{"partition":339,"offset":"4094258","metadata":"","errorCode":0},{"partition":340,"offset":"4045113","metadata":"","errorCode":0},{"partition":341,"offset":"4208275","metadata":"","errorCode":0},{"partition":342,"offset":"4005344","metadata":"","errorCode":0},{"partition":343,"offset":"4241314","metadata":"","errorCode":0},{"partition":344,"offset":"4241771","metadata":"","errorCode":0},{"partition":345,"offset":"4081372","metadata":"","errorCode":0},{"partition":346,"offset":"4011740","metadata":"","errorCode":0},{"partition":347,"offset":"3970434","metadata":"","errorCode":0},{"partition":348,"offset":"4071969","metadata":"","errorCode":0},{"partition":349,"offset":"3928435","metadata":"","errorCode":0},{"partition":350,"offset":"4347569","metadata":"","errorCode":0},{"partition":351,"offset":"4051655","metadata":"","errorCode":0},{"partition":352,"offset":"4245402","metadata":"","errorCode":0},{"partition":353,"offset":"4044264","metadata":"","errorCode":0},{"partition":354,"offset":"4232091","metadata":"","errorCode":0},{"partition":355,"offset":"4341300","metadata":"","errorCode":0},{"partition":356,"offset":"4277074","metadata":"","errorCode":0},{"partition":357,"offset":"3958455","metadata":"","errorCode":0},{"partition":358,"offset":"4280375","metadata":"","errorCode":0},{"partition":359,"offset":"4256611","metadata":"","errorCode":0},{"partition":360,"offset":"3984831","metadata":"","errorCode":0},{"partition":361,"offset":"4203157","metadata":"","errorCode":0},{"partition":362,"offset":"4178418","metadata":"","errorCode":0},{"partition":363,"offset":"4295067","metadata":"","errorCode":0},{"partition":364,"offset":"4073118","metadata":"","errorCode":0},{"partition":365,"offset":"4189380","metadata":"","errorCode":0},{"partition":366,"offset":"4227132","metadata":"","errorCode":0},{"partition":367,"offset":"4479021","metadata":"","errorCode":0},{"partition":368,"offset":"4135142","metadata":"","errorCode":0},{"partition":369,"offset":"4405261","metadata":"","errorCode":0},{"partition":370,"offset":"4454544","metadata":"","errorCode":0},{"partition":371,"offset":"4146130","metadata":"","errorCode":0},{"partition":372,"offset":"4311696","metadata":"","errorCode":0},{"partition":373,"offset":"4523487","metadata":"","errorCode":0},{"partition":374,"offset":"4984792","metadata":"","errorCode":0},{"partition":375,"offset":"4279559","metadata":"","errorCode":0},{"partition":376,"offset":"4276791","metadata":"","errorCode":0},{"partition":377,"offset":"4218485","metadata":"","errorCode":0},{"partition":378,"offset":"4146955","metadata":"","errorCode":0},{"partition":379,"offset":"4814863","metadata":"","errorCode":0},{"partition":380,"offset":"4667292","metadata":"","errorCode":0},{"partition":381,"offset":"4225096","metadata":"","errorCode":0},{"partition":382,"offset":"4459614","metadata":"","errorCode":0},{"partition":383,"offset":"4354949","metadata":"","errorCode":0},{"partition":384,"offset":"4472844","metadata":"","errorCode":0},{"partition":385,"offset":"4372398","metadata":"","errorCode":0},{"partition":386,"offset":"4570275","metadata":"","errorCode":0},{"partition":387,"offset":"4375883","metadata":"","errorCode":0},{"partition":388,"offset":"4358042","metadata":"","errorCode":0},{"partition":389,"offset":"4515120","metadata":"","errorCode":0},{"partition":390,"offset":"4348105","metadata":"","errorCode":0},{"partition":391,"offset":"4503478","metadata":"","errorCode":0},{"partition":392,"offset":"4481445","metadata":"","errorCode":0},{"partition":393,"offset":"4457423","metadata":"","errorCode":0},{"partition":394,"offset":"4298071","metadata":"","errorCode":0},{"partition":395,"offset":"4379361","metadata":"","errorCode":0},{"partition":396,"offset":"4374381","metadata":"","errorCode":0},{"partition":397,"offset":"4276741","metadata":"","errorCode":0},{"partition":398,"offset":"4410934","metadata":"","errorCode":0},{"partition":399,"offset":"4630902","metadata":"","errorCode":0}]}],"errorCode":0}}

@tulios More info!

the code in master

I don't see this problem, but all reads throw an error from my kafkajs-lz4 codec, saying "Invalid magic byte 0". This might be a whole different issue.

and a different group id?

A different group ID seems to fix the issue! The original group ID must've been stale because I was doing a lot of local test runs. Is this expected? I do have a SIGINT handler that calls disconnect() on both the consumer and the producer.

Nice, at least you can move on. You can reset the offsets of the consumer group and see if it works:
await admin.resetOffsets({ groupId, topic }) // latest by default
// await admin.resetOffsets({ groupId, topic, earliest: true })

On the LZ4, it's probably not handling the new RecordBatch of Kafka v0.11. I can take a look.

@tulios Thanks! Do you have any guesses about why those MaxListenersExceededWarning (see https://github.com/tulios/kafkajs/issues/149#issuecomment-427741795) could occur?
My guess is there's some event emitter that is being set up inside a loop.

@paambaati there are a couple of fixes in master for this issue, you can use master disabling the v0.11 APIs:
new Kafka({ ... allowExperimentalV011: false })

The MaxListenersExceededWarning it's a silly bug, it isn't leaking any memory, it is just that node.js has this value hardcoded to 11 and you probably have a higher concurrency. I will create a new issue and fix this right away. It shouldn't cause any issues besides the annoying warning.
If you are producing in parallel you can also consider using the producer.sendBatch:
await producer.sendBatch({
  topicMessages: <TopicMessages[]>,
  acks: <Number>,
  timeout: <Number>,
  compression: <CompressionTypes>,
})

Feel free to re-open this issue if you need.
Thanks again for the report, this is great for new users.

For reference, here is the issue about MaxListenersExceededWarning #153


SplitViewController doesn't implement Layout (or super-trait ObjcAccess) - example code?

I'm impressed with what I've been able to do with cacao, thank you for the hard work you've put into this:
I'm trying to scaffold an app with the SplitViewController three column setup as a candidate for using this for one of our internal apps, and have gotten stuck on instantiating a SuperViewController in a simple test app.
If there is an example of a SplitViewController being instantiated and presented in a cacao example (or other) app. I've searched thoroughly, to no avail, but would be happy to get a referral and if it is working, I'll thank you and consider this closed and will focus on analyzing what the example did that I'm missing.
Without an example, though, here is what I tried:
mod views;

use cacao::appkit::{App, AppDelegate};
use cacao::button::Button;
use cacao::appkit::window::{Window, WindowConfig, WindowStyle};
use cacao::geometry::Rect;
use cacao::appkit::window::WindowToolbarStyle;
use cacao::foundation::NSUInteger;
use cacao::view::{SplitViewController, View};
use crate::views::sidebar_view::SidebarView;
use crate::views::content_view::ContentView;
use crate::views::detail_view::DetailView;

struct CacaoTest2 {
  window: Window,
}

impl AppDelegate for CacaoTest2 {
  fn did_finish_launching(&self) {
    self.window.show();
  }
}

fn main() {
  let button = Button::new("Click me!");
  // let main_view = MainView::default();
  let window_config = WindowConfig {
    style: (WindowStyle::Titled as NSUInteger
      | WindowStyle::Closable as NSUInteger
      | WindowStyle::Resizable as NSUInteger) as NSUInteger,
    initial_dimensions: Rect::new(0.0, 0.0, 800.0, 600.0),
    defer: false,
    toolbar_style: WindowToolbarStyle::Automatic,
  };

  let window = Window::new(window_config);
  let split_view_controller = SplitViewController::new(SidebarView::default(),
                                                       ContentView::default(),
                                                       Some(DetailView::default()));
  window.set_content_view(&split_view_controller);

  App::new("net.xdix.cacao_test_2", CacaoTest2 { window }).run();
}

I have the SidebarView, ContentView and DetailView views defined and usable as simple (just a Label) views that work on their own just fine.
I've tried embedding the SplitControllerView in an enclosing MainView, and calling add_subview(splitViewController) in the did_load() override for that MainView  -- same error:
error[E0277]: the trait bound `SplitViewController<SidebarView, ContentView, DetailView>: cacao::layout::Layout` is not satisfied
   --> src/main.rs:25:36
    |
25  |       self.window.set_content_view(&split_view_controller);
    |                   ---------------- ^^^^^^^^^^^^^^^^^^^^^^ the trait `cacao::layout::Layout` is not implemented for `SplitViewController<SidebarView, ContentView, DetailView>`
    |                   |
    |                   required by a bound introduced by this call

I can upload a zip of the entire (small) project if it helps, but I'm guessing I just have a conceptual problem here in terms of the specific recipe needed for getting a SplitViewController working.

It's been a minute since I've touched that, but at a glance - you want window.set_content_view_controller, not window.set_content_view.
If that doesn't work, let me know and we can debug further. :)

It's been a minute since I've touched that, but at a glance - you want window.set_content_view_controller, not window.set_content_view.
If that doesn't work, let me know and we can debug further. :)

Thank you, will try that!

It's been a minute since I've touched that, but at a glance - you want window.set_content_view_controller, not window.set_content_view.
If that doesn't work, let me know and we can debug further. :)

That worked, thanks for the tip.  Actually, it wasn't  just window.set_content_view_controller(), got a hang when just had it inserted after the window creation in main().
What made it work is creating a WindowDelegate and using did_load() to crate the SplitViewController.  Here's the WindowDelegate and the main sources for any who may want to see how it works:
main.rs
mod main_window;
use cacao::appkit::{App, AppDelegate};
use cacao::appkit::window::{Window, WindowConfig, WindowController, WindowStyle};
use crate::main_window::MainWindow;

struct MyApp {
  window: WindowController<MainWindow>,
}

impl AppDelegate for MyApp {
  fn did_finish_launching(&self) {
    App::activate();
    self.window.show();
  }
  fn should_terminate_after_last_window_closed(&self) -> bool {
    true
  }
}

fn main() {
  App::new("net.groupmg.cacao-test", MyApp {
    window: WindowController::with(WindowConfig::default(), MainWindow::default())
  })
    .run();
}

main_window.rs
use cacao::appkit::window::{Window, WindowDelegate};
use cacao::view::SplitViewController;
use crate::views::content_view::ContentView;
use crate::views::detail_view::DetailView;
use crate::views::sidebar_view::SidebarView;

#[derive(Default)]
pub struct MainWindow {
  controller: Option<SplitViewController<SidebarView, ContentView, DetailView>>
}

impl WindowDelegate for MainWindow {
  const NAME: &'static str = "MainWindow";

  fn did_load(&mut self, window: Window) {
    window.set_minimum_content_size(400., 400.);
    window.set_title("MyApp");
    let sidebar = SidebarView::default();
    let content = ContentView::default();
    let detail = DetailView::default();

    let split_view_controller = SplitViewController::new(sidebar, content, Some(detail));
    window.set_content_view_controller(&split_view_controller);
    self.controller = Some(split_view_controller);
  }

  fn will_close(&self) {
    println!("Closing now!");
  }
}

Your comment was all I needed to get pointed in the right direction. Much appreciated!

Ah yeah - you def want to be creating things after did_finish_launching since that ensures all the macOS-isms are set up in the background. :)
Glad it works! Should probably add an example to the repo at some point... closing this now but feel free to reopen if you hit further issues.


Upgrade to Cats 1.0.0-RC1

This is my attempt at migrating the master branch (v3.0.0) to the latest version of Cats and Cats Effect.
Fixes #456

Thanks @alonsodomin,
There is a test failing and because this PR can't wait for much longer, I'm taking the liberty of modifying it myself before merging.
I will also add you to the AUTHORS file, thanks for your first time contrib :)

Btw @alonsodomin, the tests failing are a problem of changed laws in cats-effect, I've opened an issue for that and I'm currently thinking what to do about it: https://github.com/typelevel/cats-effect/issues/82

thanks @alexandru, truth is that those failures took me by surprise as most of the changes I made weren't really related with cats-effect. Good spot and keep up the good work in this library.


Question about GitHub labels

Some of the custom labels in this repository have a space in them, other don't.
For example:

type: maintenance
effort:huge

I saw that I used "type:maintenance" for the dependabot config, because I did not see the space. Now it fails to label its PRs.
Where should we fix here? Rename the label or change the dependabot config?

I'm not sure, is type: maintenance or type:maintenance more readable in the issues page?
I would say without space, so to remove the space from the labels

I don't really care, I just wanted to point it out, after seeing the dependabot complaining.

Can you rename a label? Feel free to close then.

thanks! Ive renamed the labels and removed the whitespaces! so the dependabot config can stay the same


added Craft Installer cask

I am not sure if this qualifies to be an official cask since it is an installer, but this should satisfy #18247.

It'd have to be installer :manual, which we don't really prefer. However, it looks like all this is doing is copying files to a given directory.
Leaving it open for opinions.

@sbdchd Like @adidalal mentioned, this needs to use installer :manual (and hence uninstall as well. However, this is also a walled build, so it belongs in caskroom/unofficial, not here.


Fix the cli parser for the --redeemer-value --execution-units flags

The cli parser apparently cannot cope with the same flag name being
reused in different contexts, so fix it by prefix these flags with the
context, so instead of just --redeemer-file or --redeemer-value, it's
--tx-in-redeemer-file or --tx-in-redeemer-value.
Similarly for --mint-redeemer-value --mint-execution-units etc.

bors r+


Merge dropzoneOptions without "use-custom-dropzone-options"

Hi,
first of all, great package.
Anyway, what I want is to change the paramName using the defaults options too, is is possible?
<v-dropzone id="dz-photos" url="/api/upload"
	@vdropzone-success="photoUploaded"
	:thumbnail-width="144" :thumbnail-height="144"
	:headers="dzOptions.headers"
	:dropzone-options="dzOptions.paramName"
	:accepted-file-types="'.jpg,.jpeg,.png'"
	use-font-awesome></v-dropzone>

Thx.

Hi @Luddinus
To do this you'd need to do something like
<v-dropzone id="dz-photos" url="/api/upload"
	@vdropzone-success="photoUploaded"
        use-custom-dropzone-options="true"
	:dropzone-options="dzOptions"
></v-dropzone>

  export default {
     data (){
       return {
          dzoptions: {
              paramName: 'something else'
              acceptedFiles: '.jpg,.jpeg,.png'
         }
       }
    }
  }

Hope that helps, let me know how you get on

Also @liyu456 has just put through a pull request which adds paramName as a property which you can pass to the component so that might help. Im just in the midst of releasing a new version to NPM so I'll post a new version number when it's available

@rowanwins Thx,
but in your case, I think all the options are overrided, I would like to merge the options passed via "dz-options" and the default options of the package.
Is that the case or am I missunderstanding?

ah I think I see where you're heading @Luddinus
If I understand correctly you want to use some of the existing props but also merge in a custom options object that only contains a couple of params.

@rowanwins That's it.

@Luddinus I encountered same issue. I was able to solve it using setOption() method.
Add reference to your component using ref="" as below
<v-dropzone id="dz-photos" url="/api/upload"
    ref="mydz"
    @vdropzone-success="photoUploaded"
    :thumbnail-width="144" :thumbnail-height="144"
    :headers="dzOptions.headers"
    :accepted-file-types="'.jpg,.jpeg,.png'"
    use-font-awesome></v-dropzone>

I added ref="mydz" and removed dropzone-options from your component.
Now you can change it as below from any where,
this.$refs.mydz.setOption("paramName","your_file_name")
//your_file_name can be dynamic.

Above code will change only perticular option, it will not override all options. For updating multiple options, just duplicate above statement.
Hope it helps you!

I've decided the the setOption method is probably the best mechanism for this, it's quite explicit as to what is happening and will hopefully have less confusion compared to merging objects

the .setOption method is not working

@mazeeblanke What errors are you getting? Could you provide the error logs?

okay its working, i thought the 'dropzoneOptions' computed property would reflect the newly added options. thanks

@rowanwins How would you make dropzone options available to the dropzone vue component, without using 'export default'?
Not everybody uses node. I have no idea how to translate this into plain, vanilla js.


Using classNames instead of props

Recently attempting the switch to styled components. Loving it so far, with a few quibbles. Here's one.
In my previous workflow, with plain old scss, I'd often do something like this:
//component.js
import './component.scss';
import cx from 'classnames';

const Component = (props) => {
  const className = cx(props.className, 'component', {
    off: props.off,
    active: props.id == 0,
  });
  return (

'Some text'

  );
}

//component.scss
.component {
  font-size: 20px;
  background: black;
  color: white;
  width: 20em;
  height: 10em;
  &.off {
    color: black;
    height: 0em;
  }
  &.active {
    background: blue;
    outline: 1px solid white;
    width: 30em;
    height: 20em;
  }
}

In styled components, all the examples look like this:
//component.js
import styled from 'styled-components';

const height = (props) => {
  if (props.active) {
    return '20em';
  }
  else if (props.off) {
    return '0em';
  }
  return '10em';
}
const StyledComponent = styled.div`
  font-size: 20px;
  background: ${p => p.active ? 'blue' : 'black'};
  color: ${p => p.off ? 'black' : 'white'};
  width: ${p => p.active ? '30em' : '20em'};
  height: ${height};
  outline: ${p => p.active ? '1px solid white' : 'unset'};
`
const Component = (props) => {
  return (


Add stability gotcha to mutations.md

From TkDodo on Stack Overflow: https://stackoverflow.com/a/68924092

Yeehaw! Looks like we got there: https://tanstack.com/query/v5/docs/framework/react/guides/render-optimizations#referential-identity


120k, the generate wav is not good

how many steps do you got clear wav without noise?

[
](url)

Please check issue https://github.com/NVIDIA/waveglow/issues/12

@rafaelvalle I have check it, but It think their result is not good. Does this model just so so?

@rafaelvalle can I reopen this issue?

Let's carry on this discussion here https://github.com/NVIDIA/waveglow/issues/12.


feature/improvements

Move JAVA_OPTS to Dockerfile and remove volume mapping
Disable plugin setup wizard for good
Improve Windows startup scripts echos

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Jyri Ilama seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


[BUG] Idempotency issue with new v0.10.0 Satellite Loading approach

Describe the bug
When loading true duplicates into the v0.10.0 Satellites, duplicate data is not ignored
Environment
dbt version: v1.4.7
automate_dv version: v0.10.0
Database/Platform: All
To Reproduce
Scenario: [SAT-PM-IM-13] Idempotent intra day satellite load
    Given the SATELLITE_TZ table does not exist
    And the RAW_STAGE_TZ table contains data
      | CUSTOMER_ID | CUSTOMER_NAME | CUSTOMER_DOB | CUSTOMER_PHONE  | EFFECTIVE_FROM             | LOAD_DATE                  | SOURCE |
      | 1002        | Beth          | 1995-08-07   | 17-214-233-1215 | 2019-05-03 12:00:00.000000 | 2019-05-03 12:00:00.000000 | *      |
      | 1002        | Beth          | 1995-08-08   | 17-214-233-1215 | 2019-05-03 12:00:01.000000 | 2019-05-03 12:00:01.000000 | *      |
    And I stage the STG_CUSTOMER_TZ data
    When I load the SATELLITE_TZ sat
    Then the SATELLITE_TZ table should contain expected data
      | CUSTOMER_PK | HASHDIFF                                             | CUSTOMER_NAME | CUSTOMER_DOB | CUSTOMER_PHONE  | EFFECTIVE_FROM             | LOAD_DATE                  | SOURCE |
      | md5('1002') | md5('1995-08-07\|\|1002\|\|BETH\|\|17-214-233-1215') | Beth          | 1995-08-07   | 17-214-233-1215 | 2019-05-03 12:00:00.000000 | 2019-05-03 12:00:00.000000 | *      |
      | md5('1002') | md5('1995-08-08\|\|1002\|\|BETH\|\|17-214-233-1215') | Beth          | 1995-08-08   | 17-214-233-1215 | 2019-05-03 12:00:01.000000 | 2019-05-03 12:00:01.000000 | *      |
    And I load the SATELLITE_TZ sat
    Then the SATELLITE_TZ table should contain expected data
      | CUSTOMER_PK | HASHDIFF                                             | CUSTOMER_NAME | CUSTOMER_DOB | CUSTOMER_PHONE  | EFFECTIVE_FROM             | LOAD_DATE                  | SOURCE |
      | md5('1002') | md5('1995-08-07\|\|1002\|\|BETH\|\|17-214-233-1215') | Beth          | 1995-08-07   | 17-214-233-1215 | 2019-05-03 12:00:00.000000 | 2019-05-03 12:00:00.000000 | *      |
      | md5('1002') | md5('1995-08-08\|\|1002\|\|BETH\|\|17-214-233-1215') | Beth          | 1995-08-08   | 17-214-233-1215 | 2019-05-03 12:00:01.000000 | 2019-05-03 12:00:01.000000 | *      |

The above scenario ends up loading 4 records instead of the expected 2.
Expected behavior
Only 2 records are loaded instead of 4. See the scenario above.
Additional context
This was raised by a user on Slack and we are reporting this here to make the community aware.
We are actively working on a hotfix for release as soon as possible. Thank you to the community for reporting this!
How was this missed in your testing?
We have about 100 tests just for Satellites, around 20 of which were added for the new load approach.
Previously existing tests were passing and proved we had not broken the old behaviour for Satellites.
Whilst we had many test for idempotency, this exact situation was not being tested for.

Hi All! Just an update.
After some investigation this is not a bug as such. It comes from the fact the user was loading the exact same stage data twice.
We will be putting some checks and changes in place to avoid loading the data again should this occur, however we recommend loading and staging Data according to the Data Vault standards; try to load different data in each load, using delta feeds ideally.
We'll keep this issue updated! Thanks

Hi everyone! Just a quick update. We have a fix and will be releasing this early next week after some further testing.
We will be releasing the fix as a config option which users will need to enable, rather than it being default behaviour. This is because it may have an impact on performance, and a future addition (water-levels) to AutomateDV will make this feature unnecessary in most use cases.

Fixed in v0.10.1


[Bug] Property pane state does not get reset between two instances

Description
This seems specific to the table widget, where navigating to the column properties retains that state after switching to the property pane for another widget.
https://user-images.githubusercontent.com/5298848/109287471-9bfe1d80-7849-11eb-9047-c1c9984e36ed.mov
Important Details

Version: Cloud
OS: MacOSX
Browser: chrome

@vicky-primathon can you please pick this up


Evaluating phenotype databases scrambled

Procedure
Adding randomness into the phenotypic database species mappings

HP_HP_MAPPINGS
HP_MP_MAPPINGS
HP_ZP_MAPPINGS

Check how the randomness affects the gene prioritisation in Exomiser CLI

@souzadevinicius thank you for making this issue! Please provide a tiny bit more detail:

Why do we do this
What values should be scrambled
How are we going to "check the effects"

completed in #147


Limitations with block naming

Hi,
Thank you for all your work. I use react-streamfield since about 18 month and I built some websites using exotic names containing '+' (plus) or '.' (dots).
It seems that theses names now break react streamfield.
Btw there is no advertising about it. Block._check_name don't refers to plus or dots.
Prior moving to wagtail-2.7, it worked (last known working version from pip : 1.3.5).
(Actually I am not sure if I should report this as a Wagtail bug.)

Ping ? (I am still not sure if I should report this as a Wagtail bug.)

Thanks for the report, I am going to investigate this, I don’t immediately know why it’s failing.

Could you elaborate more? I tested with Wagtail 2.9.3 & wagtail-react-streamfield 1.3.6, and didn’t face the issue with a rather tricky name, as you can see below. It correctly rendered and saved:

Hi,
Very thanks for your attention.
Unfortunately I am able to reproduce it in wagtail 2.7 and wagtail 2.9.
I started a repo here : https://forge.cliss21.org/fpoulain/issue54
After cloning it you can:

make init
an editor will open; uncomment "ENV=development", save and quit
./manage.py createsuperuser
make serve
visit http://<IP_ADDRESS>:8000/admin/pages/3/edit/

I could see the issue when using your project but… Your project is not using wagtail-react-streamfield!
The issue is really with Wagtail itself. It may seem that Wagtail now uses wagtail-react-streamfield, but it actually only uses the CSS of react-streamfield, adjusted to work with the old StreamField. Wagtail-react-streamfield is unfortunately still not yet in Wagtail due to long discussions and concerns regarding compatibility with a few third party blocks. For the record, we are arriving at a resolution for all these points, which will be documentation on how to migrate tricky third party block.
So I’m closing this issue for now, marking it as invalid, sorry :) Please open a Wagtail issue instead and reference this one. Thanks!

These names are invalid in vanilla Wagtail too, as per the docs:

‘name’ is used to identify the block type within templates and the internal JSON representation (and should follow standard Python conventions for variable names: lower-case and underscores, no spaces)

But it works with wagtail-react-streamfield because it only uses UUIDs to identify field instances :stuck_out_tongue:

@BertrandBordage ok sorry, I have been confused. I started to migrate a project from wagtail 2.4 + wagtail-react-streamfield to wagtail 2.7. I thought the latter has included wagtail-react-streamfield.
@gasman Ok, so i was misled by Block._check_name which was too lazy. Is it useful to propose a patch making it more restrictive?

But it works with wagtail-react-streamfield because it only uses UUIDs to identify field instances stuck_out_tongue

And installing wagtail-react-streamfield hide my problem. Thanks for the hint.

@gasman Ok, so i was misled by Block._check_name which was too lazy. Is it useful to propose a patch making it more restrictive?

Sure, sounds good. I think it makes sense for Block._check_name to reject anything which is not valid as a python variable name (so, for example, it should reject any names with invalid symbols, but it should still allow uppercase).

ok; I will propose a PR.


Animated mesh in the project page

It seems that Mixamo requires rigged mesh. Did you do rigging the mesh manually, or is there some automatic tool for it? (I'm not familiar with rigging thingy)

Mixamo has an autorigging feature. Just upload the obj, as long as it is a biped, it works pretty well.


kakoune: add support for plugins

Description
The kakoune editor has a plugin mechanism and several plugins are
already packaged under pkgs.kakounePlugins. However, adding these
packages to home.packages is not enough: the kakoune package
needs to be configured with the list of plugins to include, so
that they get sourced on start-up.
We add a programs.kakoune.plugins option, analogous to
programs.vim.plugins.
The change is backwards compatible since pkgs.kakoune is defined as
wrapKakoune kakoune-unwrapped { };

and wrapKakoune defaults the list of plugins to empty.
Checklist

[x] Change is backwards compatible.

[x] Code formatted with ./format.

[x] Code tested through nix-shell --pure tests -A run.all.

[ ] Test cases updated/added. See example.

[x] Commit messages are formatted like
{component}: {description}

{long description}

See CONTRIBUTING for more information and recent commit messages for examples.

If this PR adds a new module

[ ] Added myself as module maintainer. See example.

[ ] Added myself and the module files to .github/CODEOWNERS.

Amended the commit to add tests for this functionality

Thanks for the contribution! Rebased to master in 96e2f1bdf08add02065d7647d0d87a9d1662d0c1.


V0.3 logic date parsing

Works!
@mattheuslee sorry i couldn't wait so i touched a bit on UI Main window. mainly binded the 3 list panels to the correct API from logic. but i havent touched the individual event/deadline cards so the dates aren't showing yet.
A brief overview about date parsing

for now, date must come together with time
input format is as follows dd/MM/yy HH:mm
date separators support / , -
time separators support : , - , /
/by alone indicates deadline
/from /at to indicate start time when used with /to /by which indicate end time (must use both for events)
cannot add an end time that is earlier than start time
all integer fields allow single digits. e.g add task /by 11/1/17 9:30

Fixes #117
Fixes #113

@kevinLamKB I'm currently working on the cards and showing the dates

ok, great! in the meanwhile i'll go and fix my test cases, seems like travis is raging again

Part of #117


chore: add httpproxyconfig to the contract

What type of PR is this?
This is the first PR to start formalizing the bootstrap contract. Taking cue from AKS-RP protos structuring, the idea is to have different proto files for broader message types so as to increase readability and have proper segregation of fields.
HTTPProxyConfig is user input, and hence, it needs to be part of the bootstrap contract.
In the current cse_cmd.sh, there are 7 variables that reference/use HTTPProxyConfig:
The following 3 are conditionals that simply depend on the actual proxy values, and whether or not they are populated. These do not need to be in the contract, and can either be computed by the parser on the VHD, or be expanded directly in the bootstrap scripts.
SHOULD_CONFIGURE_HTTP_PROXY="{{ShouldConfigureHTTPProxy}}"
SHOULD_CONFIGURE_HTTP_PROXY_CA="{{ShouldConfigureHTTPProxyCA}}"
PROXY_VARS="{{GetProxyVariables}}"
The following 4 are actual values of the proxy fields and hence need to be in the contract.
HTTP_PROXY_TRUSTED_CA="{{GetHTTPProxyCA}}"
HTTP_PROXY_URLS="{{GetHTTPProxy}}"
HTTPS_PROXY_URLS="{{GetHTTPSProxy}}"
NO_PROXY_URLS="{{GetNoProxy}}"

What this PR does / why we need it:
Which issue(s) this PR fixes:

Fixes #
Requirements:

[ ] uses conventional commit messages

[ ] includes documentation
[ ] adds unit tests
[ ] tested upgrade from previous version

Special notes for your reviewer:
Release note:
none

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 79.036%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
2247

Relevant Lines:
2843

💛  - Coveralls

Please ignore the changes to config.proto, since its the one final file we are adding the contract to and it is changing state from its current form. The file to review is httpproxyconfig.proto and its corresponding import in config.proto


Roll engine to version c62248bdd3f46794b78d1bd141e92691d539e56f

This roll includes the following changes
c62248bdd Roll src/third_party/skia 82cf64a0d317..33d5394d08f6 (14 commits) (#6068)
b0fb3e660 Roll src/third_party/skia 96597c22c344..82cf64a0d317 (12 commits) (#6067)
ea8b949a7 Roll src/third_party/skia 4d727c560b58..96597c22c344 (27 commits) (#6066)
4fde39583 Roll Dart to version ccb16f72824374163562364bf19dd18e8a882fab (#6065)
140a5b757 Alllow access to Flutter engine, Dart & Skia versions in the Shell API. (#6060)

This caused a dramatic increase in debug_full_compile_millis (~20%), can we revert?

The regression may be a false alarm. We're going to keep an eye out and see what happens to the numbers.

Has somebody already reverted this change? In the benchmark page I see that the debug_full_compile_millis numbers are back to being green.

it seems it was a false alarm. there's something on the bots that is occasionally spiking all the host-sensitive times.


Failure with message Create submission failed, status code Conflict, reason phrase Conflict

I am attempting to test this action. The step in the workflow file is as follows:
    uses<EMAIL_ADDRESS>    with:
      tenant-id: ${{ secrets.AZURE_AD_TENANT_ID }}
      client-id: ${{ secrets.AZURE_AD_ClIENT_ID }}
      client-secret: ${{ secrets.AZURE_AD_CLIENT_SECRET }}
      app-id: ${{ secrets.STORE_APP_ID }}
      package-path: ${{ github.workspace }}\build\windows\runner\Release

When attempting to run it, this step fails with the error message in the title. I have tried changing some of the secret values to random incorrect values to see if the error message changes, and indeed, for each change I have tried, inputting the wrong value gives a different and more clear error message telling me what the problem was, but when all values are correct (as far as I am aware), I receive the title message, whose meaning I am unsure of.
What does this error mean, and what might be the root cause?

Hello @yaakovschectman.
It seems like you are publishing an MSIX, not an MSI, so you are using https://github.com/isaacrlevin/windows-store-action, and not this package.
Still, I believe I can help you.
This seems similar to this issue:
https://github.com/isaacrlevin/windows-store-action/issues/5
Which basically means that you have a pending submission. If you always submit using the APIs, you can simply go to Partner Center and delete that pending submission (pretty much deleting the draft). The problem is that the APIs do not allow us to delete a submission that was created in the portal. API calls can only delete submissions created by other API calls.
I hope that helps!

@azchohfi Thank you for your help.
Would you know anything about this issue? It does not appear that anyone has responded to it yet.

I'll reply there.


Implement Ctrl+C and toolbar copy on phrase

Users should be able to copy the translated (and untranslated, somehow) text by clicking on a phrase and then hitting Ctrl+C or a toolbar button.

right-click on a phraserect should have a context menu to copy the translated or raw text
ctrl-c could give you the text of the currently highlighted box, too

shit you're dead right, that's also a great place to start because we can dump things in there before they're ready to implement with more sophisticated UI.
I'm thinking multiple copy options should be available, like:
Copy Translated < default behavior of ctrl+c
Copy Original
Copy Both < produces output like the following:
[rawtext] translatedtext
Also, multi-select of phrase boxes should probably be enabled, and if you copy at that point you should get each box on a separate line with a full stop separating them, like:
[rawtext] translatedtext
[rawtext2] translatedtext2
[rawtext3] translatedtext3

This is implemented; skipped the toolbar options, don't think anyone would use them.


AzureKeyCredential

Type of issue
Typo
Description
[Enter feedback here]
Page URL
https://learn.microsoft.com/en-us/dotnet/api/azure.azurekeycredential?view=azure-dotnet
Content source URL
https://github.com/Azure/azure-docs-sdk-dotnet/blob/master/xml/Azure/AzureKeyCredential.xml
Document Version Independent Id
ae13eeb3-f819-cbfa-81fa-2baf730c9070
Article author
@azure-sdk
Metadata

ID: 47d6fab1-e3cd-0389-bb4a-2b0546c3bdf5
Service: azure

@vinay56318:  Thanks for reaching out and we regret that you're experiencing difficulties.   Would you please provide some further context and help us understand what typo you're seeing?

Because of a lack of obvious typo and no information available information, closing this out.   If you are still in need of assistance, please provide the requested information in a new issue.


change C# to C(sharp)

@jfmartinz please review and merge

@sanjay-kv kindly look into this one as well - updating docs should not be awarded points until there is a typo

@priyanshukumar397 becouse of api unable to fetch when the name in C# but it work when it rename to C(sharp)
thats whay i change , why are you targeting me...

Nobody is targeting you - as a contributor you should mention clearly what are you updating and why? I do not see any doc or summary from your side

@priyanshukumar397 Sir I am just doning my job as Contributor You filtered my 200+ points

Kindly add doc as well or a summary for a better understanding and do your job properly sir, I have mentioned it for everyone - regarding points I did not do that - that is for - @sanjay-kv

Kindly add doc as well or a summary for a better understanding and do your job properly sir, I have mentioned it for everyone - regarding points I did not do that - that is for - @sanjay-kv

@priyanshukumar397  ok got it

@pandeyji711 appologies for the wrong approach from my team side. I will have a look into it, we getting reported your name in discord . Maybe that's why the team commented here. I will do manual reviews if needed and confirm via official channels.

@pandeyji711 appologies for the wrong approach from my team side. I will have a look into it, we getting reported your name in discord . Maybe that's why the team commented here. I will do manual reviews if needed and confirm via official channels.

@sanjay-kv Thankyou sir for your confirmation


Box containers beark responsive elments sequnce

Currently boxes need to be included in containers such as

 to render properly. This prevents the rearrangement of box elements when one of them is removed as in the shot below. It would be better if either:

Make the boxes render properly without the need for containers by supporting col-*-* classes on the element level) or...
Give an option to the developer to let the remove function optionally removes the container instead of the element itself.

Option 2 would be tricky though.
Note: I'd expect the remove function to actually remove the DOM element instead of hiding it.

There are multiple ways to achieve this. Using the Bootstrap best practices guide prevents me from using  your first option. The second option won't work since the cols are placed within a .row. The best way to achieve this is to use a layout similar to that of either Dashboard examples.
For e.g,

I agree on the importance on following the best practices especially in a standard template. It seems that Bootstrap was not designed with the possibility of removing and adding components dynamically with auto rearrangement in mind at the first place. I am evaluating other approaches to this.

I'd suggest a plugin such as Masonry to have the effect you are looking for while preserving responsiveness.

Yes Masonry is one of the options. Thank you @almasaeed2010.

Hi any idea if there is any example on how masonry can be used for the box layout on this template? I not sure how can masonry be used with bootstrap as the column width needs to be define.


Constructing Target with if_else gives KeyError

Environment

Qiskit version: 1.0.2
Python version: 3.10.12
Operating system: Arch Linux

What is happening?
See title.
How can we reproduce the issue?
from qiskit.transpiler import Target

target = Target.from_configuration(basis_gates=["if_else"])

---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
Cell In[1], line 3
      1 from qiskit.transpiler import Target
----> 3 target = Target.from_configuration(basis_gates=["if_else"])

File ~/.local/share/virtualenvs/documentation--fuetTj0/lib/python3.10/site-packages/qiskit/transpiler/target.py:1322, in Target.from_configuration(cls, basis_gates, num_qubits, coupling_map, inst_map, backend_properties, instruction_durations, concurrent_measurements, dt, timing_constraints, custom_name_mapping)
   1320     for gate in basis_gates:
   1321         if gate not in name_mapping:
-> 1322             raise KeyError(
   1323                 f"The specified basis gate: {gate} is not present in the standard gate "
   1324                 "names or a provided custom_name_mapping"
   1325             )
   1326         target.add_instruction(name_mapping[gate], name=gate)
   1327 else:

KeyError: 'The specified basis gate: if_else is not present in the standard gate names or a provided custom_name_mapping'

What should happen?
It should work. if_else is a basis gate reported by some backends. Example:
from qiskit_ibm_runtime.fake_provider import FakeSherbrooke

backend = FakeSherbrooke()
basis_gates = list(backend.target.operation_names)

['delay', 'if_else', 'measure', 'x', 'ecr', 'sx', 'rz']

Any suggestions?
No response

Closing in favor of https://github.com/Qiskit/qiskit-ibm-runtime/issues/1516


Loaded Script tooltip shows path component twice

Testing https://github.com/Microsoft/vscode/issues/57249

https://github.com/Microsoft/vscode-chrome-debug/tree/master/testapp
Run gulp buildAndServe, debug in vscode
See test2.js in Loaded Scripts, the tooltip shows client with space twice in the script path

The DA sends the correct thing To client: {"seq":0,"type":"event","event":"loadedSource","body":{"reason":"new","source":{"name":"test2.js","path":"http://localhost:8080/out/client%20with%20space/test2.js","sourceReference":1002}}}
I don't see that with other scripts, maybe it's the space in the path?

@weinand I am adding the candidate label, please check with @egamma before pushing changes that we did not talk about

👍 on fixing for August


Port Docker builds from Travis

https://github.com/marketplace/actions/build-and-push-docker-images
If we run into rate limits, we may have to set up a Docker Hub account:
jobs:
  Docker:
    steps:
      # ...
      - name: Login to Docker Hub
        uses: docker/login-action@v2
        with:
          username: ${{ secrets.DOCKERHUB_USERNAME }}
          password: ${{ secrets.DOCKERHUB_TOKEN }}

Coverage remained the same at 99.323% when pulling 4b01652a108b51b7681897e12bca01aa3a3142dc on thetic:docker into c02ec75af97a536e34dd47fd7453abbcb095213a on cpputest:master.

I have tried to create an open source docker hub account in the past and had failed to do so. I couldn't find a good way to do that in the time that I had spend on it :(

Why not use Github Container Registry instead? It's already included, eg. for this project.


4.x: intermitent test failure grpc.webserver.GrpcServerTest.testServerStream

Saw this fail on the 4.x pipeline after upgrading gRPC (#5361). At first thought it was an issue with the gRPC upgrade, but a retry passed.
2022-11-09T20:45:23.7248180Z [ERROR] io.helidon.nima.tests.integration.grpc.webserver.GrpcServerTest.testServerStream  Time elapsed: 0.006 s  <<< ERROR!
2022-11-09T20:45:23.7248479Z java.util.concurrent.ExecutionException: io.grpc.StatusRuntimeException: INTERNAL: RST_STREAM closed stream. HTTP/2 error code: PROTOCOL_ERROR
2022-11-09T20:45:23.7248708Z 	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
2022-11-09T20:45:23.7249007Z 	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2096)
2022-11-09T20:45:23.7249323Z 	at io.helidon.nima.tests.integration.grpc.webserver.GrpcServerTest$StringsCollector.awaitResponse(GrpcServerTest.java:157)
2022-11-09T20:45:23.7249650Z 	at io.helidon.nima.tests.integration.grpc.webserver.GrpcServerTest.testServerStream(GrpcServerTest.java:134)
2022-11-09T20:45:23.7249917Z 	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)

This test repeats 100 times closing and creating a new channel each time.

The gRPC implementation currently in Nima is known to have some race conditions that impact a number of tests. PR #5361 disables this test. Issue #5323 tracks fixing the gRPC implementation and re-enabling tests.


Fix ActiveRecord version check

Minor change: the RAILS_GTE_5_1 version check in record_trail.rb looks wrong to me. It checks that ActiveRecord's major version is at least 5 and minor version is at least 1, but I think this check would exclude releases like 6.0 and 7.0.
I've changed the check to one that will match what I think was intended.
Thanks for your hard work on this gem; it's been working great for us so far!

.. I think this check would exclude releases like 6.0 and 7.0.

I think you're right, thanks.
How about ::ActiveRecord.gem_version >= ::Gem::Version.new("5.1.0.beta1")?

Ooh, I didn't realize that method existed! Yeah that's much nicer.

Yeah, I think it was added in some version of rails 4. Hopefully rails 4.0, because we still try to support 4.0 (at least for a few more months).

Please also add an entry to the changelog under unreleased -> fixed. Thanks.

Hmm. Actually it looks like it wasn't added until 4.2, in this giant commit. I'm basing this on the Github history for the gem_version.rb file.
Should we stick with the manual integer comparison method, then?

Hmm. Actually it looks like it wasn't added until 4.2, in this giant commit. I'm basing this on the Github history for the gem_version.rb file.
Should we stick with the manual integer comparison method, then?

Can we do something like:
::ActiveRecord.respond_to?(:gem_version) &&
  ::ActiveRecord.gem_version >= ::Gem::Version.new("5.1.0.beta1")

Merged, thanks.


The download script doesn't work.

I get a 404 error as shown below.
DNS server is using <IP_ADDRESS> and <IP_ADDRESS>.
Is there any other way to get that dataset?

Downloading the YCB-Video Dataset
Will not apply HSTS. The HSTS database must be a regular and non-world-writable file.
ERROR: could not open HSTS store at '/home/bgyoo/.wget-hsts'. HSTS will be disabled.
--2020-09-11 12:58:50--  https://docs.google.com/uc?export=download&confirm=&id=1if4VoEXNx9W3XCn0Y7Fp15B4GpcYbyYi
Resolving docs.google.com (docs.google.com)... <IP_ADDRESS>, 2404:6800:4004:81c::200e
Connecting to docs.google.com (docs.google.com)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘YCB_Video_Dataset.zip’
YCB_Video_Dataset.zip             [ <=>                                              ]   3.04K  --.-KB/s    in 0s
2020-09-11 12:58:50 (9.46 MB/s) - ‘YCB_Video_Dataset.zip’ saved [3110]
Archive:  YCB_Video_Dataset.zip
End-of-central-directory signature not found.  Either this file is not
a zipfile, or it constitutes one disk of a multi-part archive.  In the
latter case the central directory and zipfile comment will be found on
the last disk(s) of this archive.
unzip:  cannot find zipfile directory in one of YCB_Video_Dataset.zip or
YCB_Video_Dataset.zip.zip, and cannot find YCB_Video_Dataset.zip.ZIP, period.
Downloading the trained checkpoints...
Will not apply HSTS. The HSTS database must be a regular and non-world-writable file.
ERROR: could not open HSTS store at '/home/bgyoo/.wget-hsts'. HSTS will be disabled.
--2020-09-11 12:58:51--  https://docs.google.com/uc?export=download&confirm=&id=1bQ9H-fyZplQoNt1qRwdIUX5_3_1pj6US
Resolving docs.google.com (docs.google.com)... <IP_ADDRESS>, 2404:6800:4004:81c::200e
Connecting to docs.google.com (docs.google.com)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2020-09-11 12:58:51 ERROR 404: Not Found.
done

I encounter same problem. YCB_Video_Dataset and checkpoints are unavailable.

same problem

I guess it is the issue caused by the updated google drive viruses check mechanism. This link still work. An alternative to download in the terminal can be
curl -c /tmp/cookies "https://drive.google.com/uc?export=download&id=1YFUra533pxS_IHsb9tB87lLoxbcHYXt8" > /tmp/delete_me.html
curl -L -b /tmp/cookies "https://drive.google.com$(cat /tmp/delete_me.html | grep -Po 'uc-download-link" [^>]* href="\K[^"]*' | sed 's/\&/\&/g')" > Linemod_preprocessed.zip

This works on my machine.