Healthchecks duplicated when updating target

Summary
Kong version: 2.4.1
Whilst investigating #7406 I noticed that when deleting and adding targets to an upstream, the healthchecks associated with the upstream were duplicated.
Steps To Reproduce

Start Kong - create a single upstream with associated target and active healthchecks enabled
Delete the target
Add a new target
Observe the logs - notice that there are now 2  sets of healthchecks happening
Patch the upstream healthchecks - e.g change the path.
Observe the logs - notice that only the latest version of the healthcheck is updated so there are 2 different sets of healthchecks occurring

In the logs below, mock endpoint is using httpbin. Healthcheck path is initially set to / - which redirects (status 301) - and healthy interval at 30 (remains the same throughout). Firstly, the target is firstly deleted and readed to illutstrate the duplicate checks. The healthcheck path is subsequently patched to /status/500 and finally /status/200 to further illustrate the point and perhaps remove any potential suspicion regarding this being the same underlying healthcheck.
Additional Details & Logs

Kong debug-level startup logs ($ kong start --vv)
Kong error logs (<KONG_PREFIX>/logs/error.log)

kong_1            | Waiting for PostgreSQL on 'kong-database:5432'.  up!
kong_1            | Database already bootstrapped
kong_1            | Database is already up-to-date
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] globalpatches.lua:10: installing the globalpatches
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:455: init(): [dns-client] (re)configuring dns client
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:460: init(): [dns-client] staleTtl = 4
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:463: init(): [dns-client] validTtl = nil
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:467: init(): [dns-client] noSynchronisation = false
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:486: init(): [dns-client] query order = LAST, SRV, A, CNAME
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-mcastprefix = [ff00::0]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allnodes = [ff02::1]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allrouters = [ff02::2]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localhost = [::1]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-loopback = [::1]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:526: init(): [dns-client] adding A-record from 'hosts' file: vagranthost = <IP_ADDRESS>
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:526: init(): [dns-client] adding A-record from 'hosts' file: localhost = <IP_ADDRESS>
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: localhost = [::1]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:526: init(): [dns-client] adding A-record from 'hosts' file: a104f7f3b383 = <IP_ADDRESS>
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localnet = [fe00::0]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:585: init(): [dns-client] nameserver <IP_ADDRESS>
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:590: init(): [dns-client] attempts = 5
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:597: init(): [dns-client] no_random = true
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:606: init(): [dns-client] timeout = 2000 ms
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:610: init(): [dns-client] ndots = 1
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:612: init(): [dns-client] search =
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:618: init(): [dns-client] badTtl = 1 s
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:620: init(): [dns-client] emptyTtl = 30 s
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] globalpatches.lua:263: randomseed(): seeding PRNG from OpenSSL RAND_bytes()
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:455: init(): [dns-client] (re)configuring dns client
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:460: init(): [dns-client] staleTtl = 4
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:463: init(): [dns-client] validTtl = nil
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:467: init(): [dns-client] noSynchronisation = false
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:486: init(): [dns-client] query order = LAST, SRV, A, CNAME
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-mcastprefix = [ff00::0]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allnodes = [ff02::1]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-allrouters = [ff02::2]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localhost = [::1]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-loopback = [::1]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:526: init(): [dns-client] adding A-record from 'hosts' file: vagranthost = <IP_ADDRESS>
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:526: init(): [dns-client] adding A-record from 'hosts' file: localhost = <IP_ADDRESS>
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: localhost = [::1]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:526: init(): [dns-client] adding A-record from 'hosts' file: a104f7f3b383 = <IP_ADDRESS>
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:541: init(): [dns-client] adding AAAA-record from 'hosts' file: ip6-localnet = [fe00::0]
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:585: init(): [dns-client] nameserver <IP_ADDRESS>
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:590: init(): [dns-client] attempts = 5
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:597: init(): [dns-client] no_random = true
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:606: init(): [dns-client] timeout = 2000 ms
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:610: init(): [dns-client] ndots = 1
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:612: init(): [dns-client] search =
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:618: init(): [dns-client] badTtl = 1 s
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] client.lua:620: init(): [dns-client] emptyTtl = 30 s
kong_1            | 2021/05/31 17:48:07 [debug] 1#0: [lua] plugins.lua:245: load_plugin(): Loading plugin: request-transformer
kong_1            | 2021/05/31 17:48:07 [notice] 1#0: using the "epoll" event method
kong_1            | 2021/05/31 17:48:07 [notice] 1#0: openresty/<IP_ADDRESS>
kong_1            | 2021/05/31 17:48:07 [notice] 1#0: built by gcc 7.5.0 (Ubuntu 7.5.0-3ubuntu1~18.04)
kong_1            | 2021/05/31 17:48:07 [notice] 1#0: OS: Linux 4.15.0-143-generic
kong_1            | 2021/05/31 17:48:07 [notice] 1#0: getrlimit(RLIMIT_NOFILE): 1048576:1048576
kong_1            | 2021/05/31 17:48:07 [notice] 1#0: start worker processes
kong_1            | 2021/05/31 17:48:07 [notice] 1#0: start worker process 44
kong_1            | 2021/05/31 17:48:07 [debug] 44#0: *1 [lua] globalpatches.lua:263: randomseed(): seeding PRNG from OpenSSL RAND_bytes()
kong_1            | 2021/05/31 17:48:07 [debug] 44#0: *1 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=resty-worker-events, event=started, pid=44, data=nil
kong_1            | 2021/05/31 17:48:07 [notice] 44#0: *1 [lua] warmup.lua:92: single_dao(): Preloading 'services' into the core_cache..., context: init_worker_by_lua*
kong_1            | 2021/05/31 17:48:07 [notice] 44#0: *1 [lua] warmup.lua:129: single_dao(): finished preloading 'services' into the core_cache (in 78ms), context: init_worker_by_lua*
kong_1            | 2021/05/31 17:48:07 [notice] 44#0: *2 [lua] warmup.lua:34: warming up DNS entries ..., context: ngx.timer
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] base.lua:1503: new(): [upstream:mock 1] balancer_base created
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] round_robin.lua:165: new(): [upstream:mock 1] round_robin balancer created
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] base.lua:917: newHost(): [upstream:mock 1] created a new host for: mock
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] base.lua:655: queryDns(): [upstream:mock 1] querying dns for mock
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] base.lua:570: f(): [upstream:mock 1] dns record type changed for mock, nil -> 1
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] base.lua:370: newAddress(): [upstream:mock 1] new address for host 'mock' created: <IP_ADDRESS>:3000 (weight 100)
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] base.lua:634: f(): [upstream:mock 1] updating balancer based on dns changes for mock
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] base.lua:644: f(): [upstream:mock 1] querying dns and updating for mock completed
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Got initial target list (0 targets)
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) active check flagged as active
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) starting timer to check active checks
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Healthchecker started!
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=lua-resty-healthcheck [bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock], event=healthy, pid=44, data=table: 0x7ff08fbd0b20
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target added 'mock(<IP_ADDRESS>:3000)'
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'false' to 'true'
kong_1            | 2021/05/31 17:48:08 [debug] 44#0: *3 [lua] balancer.lua:847: create_balancers(): initialized 1 balancer(s), 0 error(s)
kong_1            | 2021/05/31 17:48:09 [debug] 44#0: *35 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) worker 0 (pid: 44) starting active check timer
kong_1            | 2021/05/31 17:48:09 [notice] 44#0: *2 [lua] warmup.lua:58: finished warming up DNS entries' into the cache (in 2097ms), context: ngx.timer
kong_1            | 2021/05/31 17:48:12 [debug] 44#0: *41 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:48:17 [debug] 44#0: *49 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:48:22 [debug] 44#0: *57 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:48:23 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:48:27 [debug] 44#0: *65 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:48:32 [debug] 44#0: *73 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:48:37 [debug] 44#0: *81 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:48:38 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:48:38 [debug] 44#0: *86 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:48:38 [debug] 44#0: *86 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:48:38 [debug] 44#0: *86 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:48:42 [debug] 44#0: *91 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:48:47 [debug] 44#0: *99 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:48:52 [debug] 44#0: *107 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:48:53 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:48:57 [debug] 44#0: *115 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:02 [debug] 44#0: *123 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:07 [debug] 44#0: *132 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:08 [debug] 44#0: *136 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:49:08 [debug] 44#0: *136 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:49:08 [debug] 44#0: *136 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:49:08 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:49:17 [debug] 44#0: *150 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:22 [debug] 44#0: *158 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:23 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:49:27 [debug] 44#0: *166 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:32 [debug] 44#0: *174 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:37 [debug] 44#0: *182 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:38 [debug] 44#0: *186 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:49:38 [debug] 44#0: *186 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:49:38 [debug] 44#0: *186 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:49:38 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:49:47 [debug] 44#0: *200 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:52 [debug] 44#0: *208 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:49:53 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:49:57 [debug] 44#0: *216 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:02 [debug] 44#0: *224 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:07 [debug] 44#0: *233 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:08 [debug] 44#0: *237 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:50:08 [debug] 44#0: *237 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:50:08 [debug] 44#0: *237 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:50:08 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:50:12 [debug] 44#0: *243 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:17 [debug] 44#0: *251 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:22 [debug] 44#0: *259 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:23 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:50:27 [debug] 44#0: *267 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:32 [debug] 44#0: *275 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:37 [debug] 44#0: *283 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:38 [debug] 44#0: *287 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:50:38 [debug] 44#0: *287 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:50:38 [debug] 44#0: *287 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:50:39 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:50:42 [debug] 44#0: *293 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:47 [debug] 44#0: *301 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:52 [debug] 44#0: *309 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:50:54 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:50:57 [debug] 44#0: *317 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:51:02 [debug] 44#0: *325 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:51:07 [debug] 44#0: *334 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:51:08 [debug] 44#0: *338 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:51:08 [debug] 44#0: *338 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:51:08 [debug] 44#0: *338 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:51:09 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:51:12 [debug] 44#0: *344 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:51:17 [debug] 44#0: *354 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *362 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] init.lua:27: Loading Admin API endpoints
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] init.lua:118: No API endpoints loaded for plugin: request-transformer
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] events.lua:211: do_event(): worker-events: handling event; source=dao:crud, event=delete, pid=nil, data=table: 0x7ff08a1b9438
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'targets:35ebb1a3-a464-4c9f-913a-025b7ea52ed1:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85'
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=targets:35ebb1a3-a464-4c9f-913a-025b7ea52ed1:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] init.lua:250: invalidate(): [DB cache] broadcasting (cluster) invalidation for key: 'targets:35ebb1a3-a464-4c9f-913a-025b7ea52ed1:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85'
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] events.lua:211: do_event(): worker-events: handling event; source=crud, event=targets, pid=nil, data=table: 0x7ff08a1b9438
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=balancer, event=targets, pid=44, data=table: 0x7ff08a1bc550
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] balancer.lua:649: on_target_event(): target delete for upstream 26c5e536-8e5f-4f5d-a291-702883dedbca
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'balancer:targets:26c5e536-8e5f-4f5d-a291-702883dedbca'
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] base.lua:1503: new(): [upstream:mock 2] balancer_base created
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] round_robin.lua:165: new(): [upstream:mock 2] round_robin balancer created
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Got initial target list (1 targets)
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Got initial status healthy mock <IP_ADDRESS>:3000
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) active check flagged as active
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Healthchecker started!
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=balancer:targets:26c5e536-8e5f-4f5d-a291-702883dedbca
kong_1            | 2021/05/31 17:51:22 [debug] 44#0: *363 [lua] events.lua:211: do_event(): worker-events: handling event; source=crud, event=targets:delete, pid=nil, data=table: 0x7ff08a1b9438
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:51:22 +0000] "DELETE /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca/targets/35ebb1a3-a464-4c9f-913a-025b7ea52ed1 HTTP/1.1" 204 0 "-" "-"
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:51:22 +0000] "GET /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca/targets?size=1000 HTTP/1.1" 200 23 "-" "-"
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:51:22 +0000] "GET /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca/health?size=1000 HTTP/1.1" 200 72 "-" "-"
kong_1            | 2021/05/31 17:51:24 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] events.lua:211: do_event(): worker-events: handling event; source=dao:crud, event=create, pid=nil, data=table: 0x7ff08a1778e0
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'targets:72092901-e8fd-4e4f-bd27-8277d9ca3590:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85'
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=targets:72092901-e8fd-4e4f-bd27-8277d9ca3590:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] init.lua:250: invalidate(): [DB cache] broadcasting (cluster) invalidation for key: 'targets:72092901-e8fd-4e4f-bd27-8277d9ca3590:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85'
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] events.lua:211: do_event(): worker-events: handling event; source=crud, event=targets, pid=nil, data=table: 0x7ff08a1778e0
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=balancer, event=targets, pid=44, data=table: 0x7ff08a1797a8
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] balancer.lua:649: on_target_event(): target create for upstream 26c5e536-8e5f-4f5d-a291-702883dedbca
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'balancer:targets:26c5e536-8e5f-4f5d-a291-702883dedbca'
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] base.lua:1503: new(): [upstream:mock 3] balancer_base created
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] round_robin.lua:165: new(): [upstream:mock 3] round_robin balancer created
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] base.lua:917: newHost(): [upstream:mock 3] created a new host for: mock
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] base.lua:655: queryDns(): [upstream:mock 3] querying dns for mock
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] base.lua:570: f(): [upstream:mock 3] dns record type changed for mock, nil -> 1
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] base.lua:370: newAddress(): [upstream:mock 3] new address for host 'mock' created: <IP_ADDRESS>:3000 (weight 100)
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] base.lua:634: f(): [upstream:mock 3] updating balancer based on dns changes for mock
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] base.lua:644: f(): [upstream:mock 3] querying dns and updating for mock completed
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Got initial target list (1 targets)
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Got initial status healthy mock <IP_ADDRESS>:3000
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) active check flagged as active
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Healthchecker started!
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) adding an existing target: mock <IP_ADDRESS>:3000 (ignoring)
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=balancer:targets:26c5e536-8e5f-4f5d-a291-702883dedbca
kong_1            | 2021/05/31 17:51:30 [debug] 44#0: *376 [lua] events.lua:211: do_event(): worker-events: handling event; source=crud, event=targets:create, pid=nil, data=table: 0x7ff08a1778e0
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:51:30 +0000] "POST /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca/targets HTTP/1.1" 201 176 "-" "-"
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:51:30 +0000] "GET /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca/targets?size=1000 HTTP/1.1" 200 199 "-" "-"
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:51:30 +0000] "GET /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca/health?size=1000 HTTP/1.1" 200 464 "-" "-"
kong_1            | 2021/05/31 17:51:32 [debug] 44#0: *386 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.368
kong_1            | 2021/05/31 17:51:37 [debug] 44#0: *394 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | 2021/05/31 17:51:37 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:51:38 [debug] 44#0: *396 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:51:38 [debug] 44#0: *396 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:51:38 [debug] 44#0: *396 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:51:39 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:51:42 [debug] 44#0: *404 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | 2021/05/31 17:51:45 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:51:47 [debug] 44#0: *412 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | 2021/05/31 17:51:52 [debug] 44#0: *420 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | 2021/05/31 17:51:52 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:51:52 [debug] 44#0: *421 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:51:52 [debug] 44#0: *421 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:51:52 [debug] 44#0: *421 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:51:54 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:51:57 [debug] 44#0: *430 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | 2021/05/31 17:52:00 [debug] 44#0: *433 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:52:00 [debug] 44#0: *433 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:52:00 [debug] 44#0: *433 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:52:00 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:02 [debug] 44#0: *440 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:52:03 +0000] "GET /upstreams?size=1000 HTTP/1.1" 200 974 "-" "-"
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:52:06 +0000] "GET /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca HTTP/1.1" 200 951 "-" "-"
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:52:06 +0000] "GET /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca/targets?size=1000 HTTP/1.1" 200 199 "-" "-"
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:52:06 +0000] "GET /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca/health?size=1000 HTTP/1.1" 200 464 "-" "-"
kong_1            | 2021/05/31 17:52:07 [debug] 44#0: *453 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | 2021/05/31 17:52:07 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:08 [debug] 44#0: *455 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:52:08 [debug] 44#0: *455 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:52:08 [debug] 44#0: *455 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:52:09 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:12 [debug] 44#0: *462 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | 2021/05/31 17:52:15 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:17 [debug] 44#0: *470 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event(): worker-events: handling event; source=dao:crud, event=update, pid=nil, data=table: 0x7ff08a0ff660
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] init.lua:250: invalidate(): [DB cache] broadcasting (cluster) invalidation for key: 'upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event(): worker-events: handling event; source=crud, event=upstreams, pid=nil, data=table: 0x7ff08a0ff660
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=balancer, event=upstreams, pid=44, data=table: 0x7ff08a102188
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'balancer:upstreams'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'balancer:upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'balancer:targets:26c5e536-8e5f-4f5d-a291-702883dedbca'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) healthchecker stopped
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] base.lua:1503: new(): [upstream:mock 4] balancer_base created
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] round_robin.lua:165: new(): [upstream:mock 4] round_robin balancer created
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] base.lua:917: newHost(): [upstream:mock 4] created a new host for: mock
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] base.lua:655: queryDns(): [upstream:mock 4] querying dns for mock
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] base.lua:570: f(): [upstream:mock 4] dns record type changed for mock, nil -> 1
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] base.lua:370: newAddress(): [upstream:mock 4] new address for host 'mock' created: <IP_ADDRESS>:3000 (weight 100)
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] base.lua:634: f(): [upstream:mock 4] updating balancer based on dns changes for mock
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] base.lua:644: f(): [upstream:mock 4] querying dns and updating for mock completed
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Got initial target list (0 targets)
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) active check flagged as active
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Healthchecker started!
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=balancer:upstreams
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=balancer:upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=balancer:targets:26c5e536-8e5f-4f5d-a291-702883dedbca
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=lua-resty-healthcheck [bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock], event=clear, pid=44, data=table: 0x7ff08a0c5158
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: local cache cleared
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: local cache cleared
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: local cache cleared
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=lua-resty-healthcheck [bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock], event=healthy, pid=44, data=table: 0x7ff08a0c5918
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target added 'mock(<IP_ADDRESS>:3000)'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'false' to 'true'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target added 'mock(<IP_ADDRESS>:3000)'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'false' to 'true'
kong_1            | 2021/05/31 17:52:22 [warn] 44#0: *476 [lua] balancer.lua:319: [healthchecks] failed setting peer status (upstream: bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock): no peer found by name 'mock' and address <IP_ADDRESS>:3000, client: <IP_ADDRESS>, server: kong_admin, request: "PATCH /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca HTTP/1.1", host: "kong:8444"
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target added 'mock(<IP_ADDRESS>:3000)'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'false' to 'true'
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *476 [lua] events.lua:211: do_event(): worker-events: handling event; source=crud, event=upstreams:update, pid=nil, data=table: 0x7ff08a0ff660
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:52:22 +0000] "PATCH /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca HTTP/1.1" 200 964 "-" "-"
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *481 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.591
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *483 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *483 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:52:22 [debug] 44#0: *483 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:52:24 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:27 [debug] 44#0: *491 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.687
kong_1            | 2021/05/31 17:52:32 [debug] 44#0: *499 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.687
kong_1            | 2021/05/31 17:52:37 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:37 [debug] 44#0: *507 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.687
kong_1            | 2021/05/31 17:52:37 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:39 [debug] 44#0: *510 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:52:39 [debug] 44#0: *510 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:52:39 [debug] 44#0: *510 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:52:39 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:42 [debug] 44#0: *517 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.687
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *531 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *531 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *531 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 500)
kong_1            | 2021/05/31 17:52:52 [warn] 44#0: *531 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) unhealthy HTTP increment (1/5) for 'mock(<IP_ADDRESS>:3000)', context: ngx.timer
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *531 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=lua-resty-healthcheck [bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock], event=mostly_healthy, pid=44, data=table: 0x7ff08a0d81f0
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *531 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'true' to 'true'
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *531 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'true' to 'true'
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *531 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'true' to 'true'
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *535 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.687
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *537 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *537 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently mostly_healthy)
kong_1            | 2021/05/31 17:52:52 [debug] 44#0: *537 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:52:52 [warn] 44#0: *537 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) healthy SUCCESS increment (1/2) for 'mock(<IP_ADDRESS>:3000)', context: ngx.timer
kong_1            | 2021/05/31 17:52:54 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:52:57 [debug] 44#0: *545 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.687
kong_1            | 2021/05/31 17:53:02 [debug] 44#0: *553 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.687
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event(): worker-events: handling event; source=dao:crud, event=update, pid=nil, data=table: 0x7ff08a081238
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] init.lua:250: invalidate(): [DB cache] broadcasting (cluster) invalidation for key: 'upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca:::::bdd6a8cd-50a2-4650-aba2-2e2cf172dc85'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event(): worker-events: handling event; source=crud, event=upstreams, pid=nil, data=table: 0x7ff08a081238
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=balancer, event=upstreams, pid=44, data=table: 0x7ff08a082f78
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'balancer:upstreams'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'balancer:upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] init.lua:229: invalidate_local(): [DB cache] invalidating (local): 'balancer:targets:26c5e536-8e5f-4f5d-a291-702883dedbca'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) healthchecker stopped
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] base.lua:1503: new(): [upstream:mock 5] balancer_base created
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] round_robin.lua:165: new(): [upstream:mock 5] round_robin balancer created
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] base.lua:917: newHost(): [upstream:mock 5] created a new host for: mock
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] base.lua:655: queryDns(): [upstream:mock 5] querying dns for mock
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] base.lua:570: f(): [upstream:mock 5] dns record type changed for mock, nil -> 1
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] base.lua:370: newAddress(): [upstream:mock 5] new address for host 'mock' created: <IP_ADDRESS>:3000 (weight 100)
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] base.lua:634: f(): [upstream:mock 5] updating balancer based on dns changes for mock
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] base.lua:644: f(): [upstream:mock 5] querying dns and updating for mock completed
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Got initial target list (0 targets)
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) active check flagged as active
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Healthchecker started!
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=balancer:upstreams
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=balancer:upstreams:26c5e536-8e5f-4f5d-a291-702883dedbca
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=mlcache, event=mlcache:invalidations:kong_core_db_cache, pid=44, data=balancer:targets:26c5e536-8e5f-4f5d-a291-702883dedbca
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=lua-resty-healthcheck [bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock], event=clear, pid=44, data=table: 0x7ff08a0985a8
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: local cache cleared
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: local cache cleared
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: local cache cleared
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event_json(): worker-events: handling event; source=lua-resty-healthcheck [bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock], event=healthy, pid=44, data=table: 0x7ff08a0989f0
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target added 'mock(<IP_ADDRESS>:3000)'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'false' to 'true'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target added 'mock(<IP_ADDRESS>:3000)'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'false' to 'true'
kong_1            | 2021/05/31 17:53:04 [warn] 44#0: *556 [lua] balancer.lua:319: [healthchecks] failed setting peer status (upstream: bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock): no peer found by name 'mock' and address <IP_ADDRESS>:3000, client: <IP_ADDRESS>, server: kong_admin, request: "PATCH /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca HTTP/1.1", host: "kong:8444"
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target added 'mock(<IP_ADDRESS>:3000)'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) event: target status 'mock(<IP_ADDRESS>:3000)' from 'false' to 'true'
kong_1            | 2021/05/31 17:53:04 [debug] 44#0: *556 [lua] events.lua:211: do_event(): worker-events: handling event; source=crud, event=upstreams:update, pid=nil, data=table: 0x7ff08a081238
kong_1            | <IP_ADDRESS> - - [31/May/2021:17:53:04 +0000] "PATCH /upstreams/26c5e536-8e5f-4f5d-a291-702883dedbca HTTP/1.1" 200 964 "-" "-"
kong_1            | 2021/05/31 17:53:07 [debug] 44#0: *565 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.687
kong_1            | 2021/05/31 17:53:08 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:53:09 [debug] 44#0: *568 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:53:09 [debug] 44#0: *568 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:53:09 [debug] 44#0: *568 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:53:09 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:53:12 [debug] 44#0: *575 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.779
kong_1            | 2021/05/31 17:53:17 [debug] 44#0: *583 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.779
kong_1            | 2021/05/31 17:53:19 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:53:22 [debug] 44#0: *591 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.779
kong_1            | 2021/05/31 17:53:23 [debug] 44#0: *593 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:53:23 [debug] 44#0: *593 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:53:23 [debug] 44#0: *593 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 301)
kong_1            | 2021/05/31 17:53:23 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:53:24 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:53:27 [debug] 44#0: *601 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.779
kong_1            | 2021/05/31 17:53:32 [debug] 44#0: *609 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.779
kong_1            | 2021/05/31 17:53:34 [debug] 44#0: *612 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking healthy targets: #1
kong_1            | 2021/05/31 17:53:34 [debug] 44#0: *612 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Checking mock <IP_ADDRESS>:3000 (currently healthy)
kong_1            | 2021/05/31 17:53:34 [debug] 44#0: *612 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) Reporting 'mock (<IP_ADDRESS>:3000)' (got HTTP 200)
kong_1            | 2021/05/31 17:53:34 [debug] 44#0: *38 [lua] healthcheck.lua:1127: log(): [healthcheck] (bdd6a8cd-50a2-4650-aba2-2e2cf172dc85:mock) checking unhealthy targets: nothing to do
kong_1            | 2021/05/31 17:53:37 [debug] 44#0: *619 [lua] init.lua:288: [cluster_events] polling events from:<PHONE_NUMBER>.779

Kong configuration (the output of a GET request to Kong's Admin port - see
https://docs.konghq.com/latest/admin-api/#retrieve-node-information)

{
  "node_id": "41ee5847-31d2-4678-a2f0-2bac937f89b2",
  "tagline": "Welcome to kong",
  "timers": {
    "running": 1,
    "pending": 5
  },
  "pids": {
    "workers": [
      45
    ],
    "master": 1
  },
  "configuration": {
    "pg_port": 5432,
    "pg_password": "******",
    "pg_ssl": false,
    "pg_ssl_verify": false,
    "pg_max_concurrent_queries": 0,
    "pg_semaphore_timeout": 60000,
    "lua_package_path": "./?.lua;./?/init.lua;",
    "pg_ro_ssl": false,
    "pg_ro_ssl_verify": false,
    "database": "postgres",
    "cassandra_contact_points": [
      "<IP_ADDRESS>"
    ],
    "cassandra_port": 9042,
    "status_ssl_enabled": false,
    "cassandra_ssl": false,
    "cassandra_ssl_verify": false,
    "cassandra_write_consistency": "ONE",
    "status_ssl_cert_default": "/usr/local/kong/ssl/status-kong-default.crt",
    "cluster_listeners": [
      {
        "port": 8005,
        "listener": "<IP_ADDRESS>:8005",
        "proxy_protocol": false,
        "deferred": false,
        "reuseport": false,
        "backlog=%d+": false,
        "bind": false,
        "ip": "<IP_ADDRESS>",
        "ssl": false,
        "http2": false
      }
    ],
    "lua_ssl_trusted_certificate_combined": "/usr/local/kong/.ca_combined",
    "status_ssl_cert_default_ecdsa": "/usr/local/kong/ssl/status-kong-default-ecdsa.crt",
    "status_ssl_cert_key_default_ecdsa": "/usr/local/kong/ssl/status-kong-default-ecdsa.key",
    "cluster_control_plane": "<IP_ADDRESS>:8005",
    "cassandra_lb_policy": "RequestRoundRobin",
    "cluster_mtls": "shared",
    "kic": false,
    "cassandra_repl_strategy": "SimpleStrategy",
    "proxy_listen": [
      "<IP_ADDRESS>:8443\nssl"
    ],
    "admin_listen": [
      "<IP_ADDRESS>:8444 ssl"
    ],
    "cassandra_repl_factor": 1,
    "stream_listen": [
      "off"
    ],
    "nginx_http_keepalive_timeout": "0",
    "admin_ssl_cert": [
      "/etc/kong/certs/kong-cert.pem"
    ],
    "admin_ssl_cert_key": [
      "/etc/kong/certs/kong-key.pem"
    ],
    "status_ssl_cert": {},
    "status_ssl_cert_key": {},
    "headers": [
      "server_tokens",
      "latency_tokens"
    ],
    "nginx_user": "kong\nkong",
    "nginx_main_user": "kong kong",
    "nginx_daemon": "off",
    "nginx_http_ssl_prefer_server_ciphers": "off",
    "nginx_stream_ssl_prefer_server_ciphers": "off",
    "ssl_dhparam": "ffdhe2048",
    "nginx_http_gzip_disable": "msie6",
    "role": "traditional",
    "trusted_ips": {},
    "db_update_frequency": 5,
    "nginx_proxy_real_ip_header": "X-Real-IP",
    "db_update_propagation": 0,
    "nginx_http_ssl_session_timeout": "1d",
    "client_max_body_size": "0",
    "proxy_access_log": "/dev/stdout",
    "proxy_error_log": "/dev/stderr",
    "proxy_stream_access_log": "logs/access.log\nbasic",
    "proxy_stream_error_log": "logs/error.log",
    "nginx_proxy_set": "$template_root /usr/local/share/templates",
    "admin_error_log": "/dev/stderr",
    "status_access_log": "off",
    "nginx_http_large_client_header_buffers": "4 16k",
    "log_level": "debug",
    "nginx_optimizations": true,
    "lua_ssl_trusted_certificate": [
      "/etc/ssl/certs/ca-certificates.crt"
    ],
    "lua_ssl_verify_depth": 1,
    "lua_ssl_protocols": "TLSv1.1\nTLSv1.2 TLSv1.3",
    "nginx_http_lua_ssl_protocols": "TLSv1.1 TLSv1.2 TLSv1.3",
    "nginx_stream_lua_ssl_protocols": "TLSv1.1 TLSv1.2 TLSv1.3",
    "lua_socket_pool_size": 30,
    "untrusted_lua": "sandbox",
    "untrusted_lua_sandbox_requires": {},
    "untrusted_lua_sandbox_environment": {},
    "proxy_ssl_enabled": true,
    "plugins": [
      "request-transformer"
    ],
    "loaded_plugins": {
      "request-transformer": true
    },
    "cluster_ocsp": "off",
    "prefix": "/usr/local/kong",
    "ssl_cipher_suite": "intermediate",
    "upstream_keepalive_pool_size": 60,
    "nginx_http_client_body_buffer_size": "8k",
    "client_body_buffer_size": "8k",
    "db_cache_ttl": 0,
    "nginx_stream_ssl_session_tickets": "on",
    "nginx_worker_processes": "1",
    "nginx_main_worker_rlimit_nofile": "auto",
    "stream_listeners": {},
    "pluginserver_names": {},
    "lua_package_cpath": "",
    "nginx_events_multi_accept": "on",
    "nginx_proxy_error_page": "401\n402 403 405 406 407 409 410 415 416 417 418 421 422 423 424 425 426 428 429 431 451 501 505 506 507 508 510 511 /kong_error_handler",
    "mem_cache_size": "128m",
    "nginx_proxy_real_ip_recursive": "off",
    "status_listeners": {},
    "ssl_prefer_server_ciphers": "on",
    "ssl_cert_default": "/usr/local/kong/ssl/kong-default.crt",
    "upstream_keepalive_idle_timeout": 60,
    "upstream_keepalive_max_requests": 100,
    "cassandra_refresh_frequency": 60,
    "go_plugins_dir": "off",
    "ssl_session_timeout": "1d",
    "ssl_cert_key_default_ecdsa": "/usr/local/kong/ssl/kong-default-ecdsa.key",
    "cassandra_schema_consensus_timeout": 10000,
    "cassandra_data_centers": [
      "dc1:2",
      "dc2:3"
    ],
    "go_pluginserver_exe": "/usr/local/bin/go-pluginserver",
    "nginx_http_types_hash_max_size": "2048",
    "port_maps": {},
    "nginx_admin_client_max_body_size": "10m",
    "cluster_data_plane_purge_delay": 1209600,
    "dns_order": [
      "LAST",
      "SRV",
      "A",
      "CNAME"
    ],
    "nginx_admin_client_body_buffer_size": "10m",
    "dns_stale_ttl": 4,
    "admin_ssl_cert_default_ecdsa": "/usr/local/kong/ssl/admin-kong-default-ecdsa.crt",
    "client_ssl": false,
    "db_resurrect_ttl": 30,
    "dns_hostsfile": "/etc/hosts",
    "ssl_cert_key": [
      "/etc/kong/certs/kong-key.pem"
    ],
    "error_default_type": "text/plain",
    "status_ssl_cert_key_default": "/usr/local/kong/ssl/status-kong-default.key",
    "host_ports": {},
    "anonymous_reports": false,
    "db_cache_warmup_entities": [
      "services"
    ],
    "cluster_listen": [
      "<IP_ADDRESS>:8005"
    ],
    "pg_host": "kong-database",
    "admin_listeners": [
      {
        "port": 8444,
        "listener": "<IP_ADDRESS>:8444\nssl",
        "proxy_protocol": false,
        "deferred": false,
        "reuseport": false,
        "backlog=%d+": false,
        "bind": false,
        "ip": "<IP_ADDRESS>",
        "ssl": true,
        "http2": false
      }
    ],
    "nginx_http_ssl_protocols": "TLSv1.2 TLSv1.3",
    "admin_ssl_cert_key_default_ecdsa": "/usr/local/kong/ssl/admin-kong-default-ecdsa.key",
    "pg_database": "kong",
    "pg_timeout": 5000,
    "admin_access_log": "/dev/stdout",
    "worker_state_update_frequency": 5,
    "admin_ssl_cert_default": "/usr/local/kong/ssl/admin-kong-default.crt",
    "ssl_cert": [
      "/etc/kong/certs/kong-cert.pem"
    ],
    "pg_user": "kong",
    "cassandra_keyspace": "kong",
    "nginx_http_sendfile": "on",
    "nginx_http_client_max_body_size": "0",
    "cassandra_read_consistency": "ONE",
    "ssl_ciphers": "ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384",
    "status_error_log": "logs/status_error.log",
    "cassandra_timeout": 5000,
    "nginx_events_worker_connections": "auto",
    "nginx_http_ssl_session_tickets": "on",
    "worker_consistency": "strict",
    "ssl_protocols": "TLSv1.1\nTLSv1.2 TLSv1.3",
    "nginx_stream_ssl_dhparam": "ffdhe2048",
    "nginx_http_ssl_dhparam": "ffdhe2048",
    "nginx_main_directives": [
      {
        "name": "daemon",
        "value": "off"
      },
      {
        "name": "user",
        "value": "kong kong"
      },
      {
        "name": "worker_processes",
        "value": "1"
      },
      {
        "name": "worker_rlimit_nofile",
        "value": "auto"
      }
    ],
    "nginx_http_gzip": "on",
    "nginx_main_daemon": "off",
    "nginx_events_directives": [
      {
        "name": "multi_accept",
        "value": "on"
      },
      {
        "name": "worker_connections",
        "value": "auto"
      }
    ],
    "ssl_session_tickets": "on",
    "nginx_http_directives": [
      {
        "name": "client_body_buffer_size",
        "value": "8k"
      },
      {
        "name": "client_max_body_size",
        "value": "0"
      },
      {
        "name": "default_type",
        "value": "application/octet-stream"
      },
      {
        "name": "gzip",
        "value": "on"
      },
      {
        "name": "gzip_disable",
        "value": "msie6"
      },
      {
        "name": "keepalive_timeout",
        "value": "0"
      },
      {
        "name": "large_client_header_buffers",
        "value": "4\n16k"
      },
      {
        "name": "lua_ssl_protocols",
        "value": "TLSv1.1 TLSv1.2 TLSv1.3"
      },
      {
        "name": "sendfile",
        "value": "on"
      },
      {
        "name": "ssl_dhparam",
        "value": "/usr/local/kong/ssl/ffdhe2048.pem"
      },
      {
        "name": "ssl_prefer_server_ciphers",
        "value": "off"
      },
      {
        "name": "ssl_protocols",
        "value": "TLSv1.2\nTLSv1.3"
      },
      {
        "name": "ssl_session_tickets",
        "value": "on"
      },
      {
        "name": "ssl_session_timeout",
        "value": "1d"
      },
      {
        "name": "tcp_nodelay",
        "value": "on"
      },
      {
        "name": "tcp_nopush",
        "value": "on"
      },
      {
        "name": "types_hash_max_size",
        "value": "2048"
      }
    ],
    "enabled_headers": {
      "X-Kong-Upstream-Status": false,
      "server_tokens": true,
      "X-Kong-Proxy-Latency": true,
      "Via": true,
      "X-Kong-Response-Latency": true,
      "X-Kong-Admin-Latency": true,
      "Server": true,
      "X-Kong-Upstream-Latency": true,
      "latency_tokens": true
    },
    "nginx_http_tcp_nodelay": "on",
    "nginx_main_worker_processes": "1",
    "real_ip_header": "X-Real-IP",
    "nginx_upstream_directives": {},
    "nginx_stream_ssl_session_timeout": "1d",
    "nginx_proxy_directives": [
      {
        "name": "error_page",
        "value": "401\n402 403 405 406 407 409 410 415 416 417 418 421 422 423 424 425 426 428 429 431 451 501 505 506 507 508 510 511 /kong_error_handler"
      },
      {
        "name": "real_ip_header",
        "value": "X-Real-IP"
      },
      {
        "name": "real_ip_recursive",
        "value": "off"
      },
      {
        "name": "set",
        "value": "$template_root\n/usr/local/share/templates"
      }
    ],
    "status_listen": [
      "off"
    ],
    "nginx_status_directives": {},
    "admin_ssl_cert_key_default": "/usr/local/kong/ssl/admin-kong-default.key",
    "nginx_admin_directives": [
      {
        "name": "client_body_buffer_size",
        "value": "10m"
      },
      {
        "name": "client_max_body_size",
        "value": "10m"
      }
    ],
    "cassandra_username": "kong",
    "nginx_stream_directives": [
      {
        "name": "lua_ssl_protocols",
        "value": "TLSv1.1\nTLSv1.2 TLSv1.3"
      },
      {
        "name": "ssl_dhparam",
        "value": "/usr/local/kong/ssl/ffdhe2048.pem"
      },
      {
        "name": "ssl_prefer_server_ciphers",
        "value": "off"
      },
      {
        "name": "ssl_protocols",
        "value": "TLSv1.2 TLSv1.3"
      },
      {
        "name": "ssl_session_tickets",
        "value": "on"
      },
      {
        "name": "ssl_session_timeout",
        "value": "1d"
      }
    ],
    "nginx_http_tcp_nopush": "on",
    "nginx_supstream_directives": {},
    "dns_resolver": {},
    "nginx_sproxy_directives": {},
    "nginx_stream_ssl_protocols": "TLSv1.2\nTLSv1.3",
    "dns_error_ttl": 1,
    "dns_not_found_ttl": 30,
    "nginx_http_upstream_directives": {},
    "nginx_http_status_directives": {},
    "dns_no_sync": false,
    "nginx_pid": "/usr/local/kong/pids/nginx.pid",
    "client_ssl_cert_key_default": "/usr/local/kong/ssl/kong-default.key",
    "client_ssl_cert_default": "/usr/local/kong/ssl/kong-default.crt",
    "nginx_err_logs": "/usr/local/kong/logs/error.log",
    "ssl_cert_default_ecdsa": "/usr/local/kong/ssl/kong-default-ecdsa.crt",
    "ssl_cert_key_default": "/usr/local/kong/ssl/kong-default.key",
    "nginx_acc_logs": "/usr/local/kong/logs/access.log",
    "real_ip_recursive": "off",
    "admin_acc_logs": "/usr/local/kong/logs/admin_access.log",
    "admin_ssl_enabled": true,
    "nginx_conf": "/usr/local/kong/nginx.conf",
    "stream_proxy_ssl_enabled": false,
    "nginx_kong_conf": "/usr/local/kong/nginx-kong.conf",
    "proxy_listeners": [
      {
        "port": 8443,
        "listener": "<IP_ADDRESS>:8443\nssl",
        "proxy_protocol": false,
        "deferred": false,
        "reuseport": false,
        "backlog=%d+": false,
        "bind": false,
        "ip": "<IP_ADDRESS>",
        "ssl": true,
        "http2": false
      }
    ],
    "nginx_kong_stream_conf": "/usr/local/kong/nginx-kong-stream.conf",
    "nginx_http_default_type": "application/octet-stream",
    "kong_env": "/usr/local/kong/.kong_env",
    "ssl_cert_csr_default": "/usr/local/kong/ssl/kong-default.csr"
  },
  "plugins": {
    "available_on_server": {
      "request-transformer": true
    },
    "enabled_in_cluster": [
      "request-transformer"
    ]
  },
  "version": "2.4.1",
  "hostname": "2605b5c63a4e",
  "lua_version": "LuaJIT\n2.1.0-beta3"
}

Operating system - Ubuntu Bionic

I had the same problem. #7045

is there are workaround for this issue? We are facing something similar and it causes several issues with some ratelimited internal services

is there are workaround for this issue? We are facing something similar and it causes several issues with some ratelimited internal services

@akira28 what version are you running? I believe this should be resolved in a newer version of Kong than 2.4.1 although I can't confirm for certain as I'm still running an older version with my monkey-patched version of the affected code. I see the backport of the fix I put through has made it into the release notes for 2.6.0:

Healthchecks are now stopped while the Balancer is being recreated #7549.

@onematchfox I'm trying release 2.6.0, but it seems that it still has the issue. I'll investigate further

Any news on this one ?  I am facing the issue on Kong 2.5.1. When i update the path in the upstream it continues to send healthchecks to the old and new paths

Dear contributor,
We're closing this issue as there hasn't been any update to it for a long time. If the issue is still relevant in the latest version, please feel free to reopen it. We're more than happy to revisit it again.
Please have a look at our pledge to the community for more information.
Sincerely,
Kong Gateway Team


[Feature Request] Multiple account per exchange

It'd be nice to have the possibility to add multiple accounts per exchange, for example when you trade on Polo with both BTC and USDT you could have a single TG bot that handles all of your accounts. It could be specified, for example, as follows:
...
{
	"Poloniex": {
		"accounts": [{
				"Name": "Polo-BTC",
				"Enabled": "true",
				"Key": "INSERT HERE",
				"Secret": "INSERT HERE",
				"SendHourlyUpdates": "false",
				"DailyNotifications": "17:00",
				"SellNotifications": "true",
				"DepositNotification": "true",
				"WithdrawalNotification": "true",
				"BuyNotifications": "true"
			},
			{
				"Name": "Polo-USDT",
				"Enabled": "true",
				"Key": "INSERT HERE",
				"Secret": "INSERT HERE",
				"SendHourlyUpdates": "false",
				"DailyNotifications": "17:00",
				"SellNotifications": "true",
				"DepositNotification": "true",
				"WithdrawalNotification": "true",
				"BuyNotifications": "true"
			}
		]
	}
}
...

Keep up the good work, this is a very nice project!

Thanks for the comment.
It is something I want to add in but there will be a fair bit of refactoring to do to get this working and I do not have a lot of time in the next few weeks.
But it is on the roadmap.


[Bug] Confusing integrated terminal order numbers

Does this issue occur when all extensions are disabled?: Yes

VS Code Version: v1.60.0-insider
OS Version: Windows 10

Steps to Reproduce:

Open two split terminals and two standalone terminals:

Use workbench.action.quickOpenTerm:

Expected behavior:
1.1: bash
1.2: bash
2: bash
3: bash

please include a gif showing your terminal layout

@meganrogge I've updated the issue description.

This is fixed:


VPS Linux Ram Problem

I started running my server to a Vps (linux)... but when i opened txAdmin
i saw that i got free only 9% of my ram (i got 8GB) but webuzo says when im running my server that i got 86% available ram...
https://prnt.sc/sqx31j

Well, if you had taken the time to look at the other open issues, you would have found #19

man i read it... but i didnt understand.. this is the problem...

so .. i shouldnt worry about that?? cuz i thought that My server was spending almost the 90% of my ram

No. But you should learn how Linux memory management works.

Dup of #19


Strange generic diagnostic with constexpr argument

Given this code:
void boo<let i : int>()
{
     printf("test");
}

[[shader("compute"), numthreads(1)]]
void foo()
{
    constexpr int i();
    boo<i>();
}

I get the error:
demo.slang(16): error 30019: expected an expression of type 'int', got '() -> int'
    boo<i>();
        ^
demo.slang(16): error 30019: expected an expression of type 'int', got '() -> int'
    boo<i>();
        ^

If I write instead constexpr int i = 0; then I get the error:
demo.slang(16): error 39999: expression does not evaluate to a compile-time constant
    boo<i>();
        ^

Which makes more sense, although I think that code should work in both cases (it certainly would in C++).

We currently do not support constexpr functions. They can only be expressions for now.

We currently do not support constexpr functions. They can only be expressions for now.

This is not a constexpr function. I wrote a constant expression, stored it in a variable, and then passed that to a non-constexpr generic function. Either way, the issue is regarding the error messages, which appear to both be inaccurate.


Undefined mediaResults when switching quickly between filters with license_type applied

Description

Error: Cannot read properties of undefined (reading 'reduce') in transformResults, on the main search results page.
While I was not able to reproduce this, it looks like the events are consistently happening when navigating from a search with license_type=commercial,modification filters applied, to the same search with a specific media-type filter. E.g.:
/search/?q=cat&license_type=commercial,modification -> /search/image/?q=cat&license_type=commercial,modification
In each case I checked, it appears that the search should have returned media results.
Sentry Link
https://openverse.sentry.io/share/issue/eb40f50b906643398ebfa974a59901ed/

The underlying API issue for this is #3058.
As a frontend hot-fix, similar to #3016, we can add an undefined/null check in the transform method. So, replace
https://github.com/WordPress/openverse/blob/9e63905a97868a1f1f40fa778588ff4d72ff687e/frontend/src/data/media-service.ts#L35C5-L35C43
const mediaResults = <T[]>data.results ?? []

Hello @obulat, I'd like to work on this issue. May I be assigned to it?
I have went through the quick-start guide for frontend. I'm able to pass all the test from running just frontend/run test:unitI'm trying to run just frontend/run test:playwright and it gives me this error: FATAL  EACCES: permission denied, mkdir '/frontend/node_modules/.cache/nuxt' What is the best way to run test for playwright and storybook? Thank you.

Hello @stacimc,
I'd like to work on this issue. May I be assigned to it? Please read the comment above. I couldn't run some of the test. Should I proceed and create a hot-fix from @obulat suggestion?

@ngken0995 you can work on this issue and submit the PR to let CI run the Playwright tests for you. I don't know what exactly could be be causing Playwright to not run locally so maybe deleting the .cache and trying could help?

@dhruvkb I couldn't find the .cache folder and decided to submit a PR and let CI run the Playwright test which passed.


[Bug]: test linting incubation branch linting errors

Is there an existing issue for this?

[X] I have searched the existing issues

Deploy type
OpenDataHub core version (eg. v1.10.0)
Version
incubation
Current Behavior
/Users/thomster/Documents/GitHub/odh-dashboard/frontend/src/utilities/imageUtils.ts
9:3  error  'PodContainer' is defined but never used  @typescript-eslint/no-unused-vars
https://github.com/shalberd/odh-dashboard/blob/incubation/frontend/src/utilities/imageUtils.ts#L9
Expected Behavior
no linting errors
Steps To Reproduce
npm run test:fix-frontend
Workaround (if any)
No response
What browsers are you seeing the problem on?
No response
Anything else
No response

rebase error on my end, never mind, all good. NotebookContainer has changed to PodContainer in imageUtils container-related function


How to test req.isAuthenticated() in express3 sample

Hello,
I'm wondering how to test  authentication with passport. I'm using mocha ( and supertest ) and I didn't find a way to test controllers that depend on req.isAuthenticated()?
It would be really useful to see the test on the example here,
https://github.com/jaredhanson/passport-local/tree/master/examples/express3
Bests regards,
olivier

+1


Can you provide a tutorial on generating Camera Trajectory?

I have some questions about generating Camera Trajectory data. Can you provide a tutorial on generating Camera Trajectory?

For using camera parameters in diffusion model, please refer to CameraCtrl. For extracting camera parameters from videos, please refer to DPVO and Driod-SLAM. Our code will be released later.

@zhenzhiwang thanks for quick response. I found that the test script argment --calib has different device, which device is used to generate?
python demo.py \
    --imagedir=<path to image directory or video> \
    --calib=<path to calibration file> \
    --viz # enable visualization
    --plot # save trajectory plot
    --save_ply # save point cloud as a .ply file
    --save_trajectory # save the predicted trajectory as .txt in TUM format
    --save_colmap # save point cloud + trajectory in the standard COLMAP text format

We use heuristic intrinsics as our own calib file: assuming the camera is a standard 36mm CMOS full-frame camera, we use 50mm focal length for horizontal videos and 75mm focal length for vertical videos. The numbers are from author's personal observation on pexels videos without any support from quantitative results. Yet it turns out that the heuristic values work well in our experiments.


[SuperEditor] Fix typing lag in large documents (Resolves #751)

[SuperEditor] Fix typing lag in large documents. Resolves #751
There is a lag when typing in a document with hundreds of nodes.
This PR is based on the investigation of @jmatth  and @Jei-sKappa.
Some analysis after testing with the Frankenstein document posted by @jmatth  (added as a gist here):

getNodeIndex takes some hundred microseconds to complete. It basically walks the entire list of nodes doing a deep comparison. Typing a single letter causes getNodeIndex to be called more than 3000 times. This function is called by  getNodeBefore , getNodeAfter and others.
getNodeById takes some microseconds, but far less than getNodeIndex.
ParagraphComponentViewModel.== is broken. Checking textStyleBuilder == other.textStyleBuilder always evaluates to false. Typing a single letter in a paragraph causes all the components to be considered changed.

This PR changes MutableDocument, adding a Map to quickly lookup a node index by its id. This Map is eagerly updated when the document is created and in each operation which affects the node indices. A Map to lookup a node by its id was also added. Because of this Map's, I had to change nodes to return as an unmodifiable List, to avoid the node list being out of sync with the node maps.
This PR also removes textStyleBuilder from the == operators of the view models. However, we still need to figure out how to handle the case in which textStyleBuilder do change.
After this, I experienced another issue: toggling an attribution wasn't causing the style to be updated immediately. This happens because toggling an attribution just changes AttributedText internally. When the viewmodel checks if the text changed, it is the same instance, so it's considered as not changed. This bug was hidden because comparing textStyleBuilder always causes the viewmodel to be considered as changed.
This PR changes the attribution commands to create new AttributedText's.
After these changes:
https://user-images.githubusercontent.com/7597082/198163767-1941f893-53e5-4da9-a4f5-5059e739e532.mp4
Dragging to select has still some lag:
https://user-images.githubusercontent.com/7597082/198163946-7567f6c3-052a-4564-ba2f-da854be108f0.mp4
Most of the time seems to be spent on getDocumentSelectionInRegion, more specifically in a call to localToGlobal at:
https://github.com/superlistapp/super_editor/blob/d5e7460956fc6d60abd65991d48ca2c073c1da38/super_editor/lib/src/default_editor/layout_single_column/_layout.dart#L418-L429
When testing with this document I found another bug that is present in the latest main. Typing 1.  to create a list item it throws this exception: type 'ListItemNode' is not a subtype of type 'ParagraphNode' of 'element'. This exception doesn't happen with the default example document.

I made an attempt to optimize mouse dragging:
https://user-images.githubusercontent.com/7597082/198168459-9867ddc2-9690-4add-901e-1023b37ebad7.mp4
But it doesn't help when selecting nodes at the end of the document.

@matthew-carroll Right now, the only thing I think is missing is a way to detect when textStyleBuilder actually changes.
BTW. I replaced List.unmodifiable with UnmodifiableListView because List.unmodifiable copies all elements. With this change, the performance improved a little bit.

@Jei-sKappa @jmatth @Mijawel - Can each of you give this PR a try and verify that it resolves your performance problems?

Looks good. No obvious lag at 500 nodes/50,000 words. At 1000 nodes/100,000 words there is a decent amount of lag but it is still usable.
Much better than before. Was getting lag at 50 to 100 nodes.

For me the performance is good, btw I also notice what @Mijawel said, but it's totally fine unless you type at 200+ wpm.
Unfortunately while testing the editor I noticed a bug when pasting text, I want to make clear that it could be totally unrelated but I wanted to point it out.
Steps to reproduce:

Run the example app
Add "some" empty nodes (see the video, it occurred not only with those lines)
Select all text (in my case with CMD+A)
Copy it
Paste it at the bottom

https://user-images.githubusercontent.com/46776108/198833074-3e34dee3-3bfa-49cc-8874-094434eaab72.mov
The error output is:
══╡ EXCEPTION CAUGHT BY WIDGETS LIBRARY ╞═══════════════════════════════════════════════════════════
The following StateError was thrown building TextComponent-[GlobalKey#2a2a8](dirty, state:
TextComponentState#86374):
Bad state: No element
The relevant error-causing widget was:
TextComponent-[GlobalKey#2a2a8]
TextComponent:file:///Users/jac/Downloads/super_editor-751_typing_lag/super_editor/lib/src/default_editor/paragraph.dar
t:91:12
When the exception was thrown, this was the stack:
#0      List.last (dart:core-patch/growable_array.dart:348:5)
#1      AttributedSpans.collapseSpans (package:attributed_text/src/attributed_spans.dart:913:24)
#2      ComputeTextSpan.computeTextSpan (package:super_editor/src/infrastructure/attributed_text_styles.dart:32:34)
#3      TextComponentState.build (package:super_editor/src/default_editor/text.dart:783:31)
#4      StatefulElement.build (package:flutter/src/widgets/framework.dart:4992:27)
#5      ComponentElement.performRebuild (package:flutter/src/widgets/framework.dart:4878:15)
#6      StatefulElement.performRebuild (package:flutter/src/widgets/framework.dart:5050:11)
#7      Element.rebuild (package:flutter/src/widgets/framework.dart:4604:5)
#8      ComponentElement._firstBuild (package:flutter/src/widgets/framework.dart:4859:5)
#9      StatefulElement._firstBuild (package:flutter/src/widgets/framework.dart:5041:11)
#10     ComponentElement.mount (package:flutter/src/widgets/framework.dart:4853:5)
...     Normal element mounting (24 frames)
#34     Element.inflateWidget (package:flutter/src/widgets/framework.dart:3863:16)
#35     MultiChildRenderObjectElement.inflateWidget (package:flutter/src/widgets/framework.dart:6435:36)
#36     Element.updateChild (package:flutter/src/widgets/framework.dart:3592:18)
#37     RenderObjectElement.updateChildren (package:flutter/src/widgets/framework.dart:5964:32)
#38     MultiChildRenderObjectElement.update (package:flutter/src/widgets/framework.dart:6460:17)
#39     Element.updateChild (package:flutter/src/widgets/framework.dart:3570:15)
#40     SingleChildRenderObjectElement.update (package:flutter/src/widgets/framework.dart:6307:14)
#41     Element.updateChild (package:flutter/src/widgets/framework.dart:3570:15)
#42     ComponentElement.performRebuild (package:flutter/src/widgets/framework.dart:4904:16)
#43     StatefulElement.performRebuild (package:flutter/src/widgets/framework.dart:5050:11)
#44     Element.rebuild (package:flutter/src/widgets/framework.dart:4604:5)
#45     BuildOwner.buildScope (package:flutter/src/widgets/framework.dart:2667:19)
#46     WidgetsBinding.drawFrame (package:flutter/src/widgets/binding.dart:882:21)
#47     RendererBinding._handlePersistentFrameCallback (package:flutter/src/rendering/binding.dart:378:5)
#48     SchedulerBinding._invokeFrameCallback (package:flutter/src/scheduler/binding.dart:1175:15)
#49     SchedulerBinding.handleDrawFrame (package:flutter/src/scheduler/binding.dart:1104:9)
#50     SchedulerBinding._handleDrawFrame (package:flutter/src/scheduler/binding.dart:1015:5)
#51     _invoke (dart:ui/hooks.dart:148:13)
#52     PlatformDispatcher._drawFrame (dart:ui/platform_dispatcher.dart:318:5)
#53     _drawFrame (dart:ui/hooks.dart:115:31)

@Jei-sKappa can you file a new issue for that copy bug?

BTW @Mijawel and @Jei-sKappa - would you two mind telling us a bit about how you're using Super Editor? If you'd like to send that info privately, you're welcome to come over to the Super Editor Slack channel. I'm curious, because the more we know about community use-cases, the better we can focus our roadmap.

@Jei-sKappa can you file a new issue for that copy bug?

Issue just created!

BTW @Mijawel and @Jei-sKappa - would you two mind telling us a bit about how you're using Super Editor? If you'd like to send that info privately, you're welcome to come over to the Super Editor Slack channel. I'm curious, because the more we know about community use-cases, the better we can focus our roadmap.

Of course, I’d be happy to share how I use the editor.
I'll reach you in Slack.

This resolves the performance issues for me.


How to activate an account if I cannot login and need the mail a second time

Settings:

Activation mode: User (The user activates their own account using mail.)
Sign in requires activation : true

Scenario:

User registers an account an the email does not arrive for unknown reasons
The user wants to resed the activation email, but he cant:
=> He cannot login since his account is not active, so this form does not help: {% partial __SELF__ ~ '::activation_check' %}
=> Within the onSendActivationEmail(), there's clearly the check:

            if (!$user = $this->user()) {
                throw new ApplicationException(Lang::get(/*You must be logged in first!*/'rainlab.user::lang.account.login_first'));
            }

Suggestion for Solution:
If the user wants to login and the account is not activated, instead of a message letting him know, he's redirected to a simple form with a button and an email field, where he can type in his adress and the mail is send again.

This is a valid logic trap. At the moment, the user needs to contact an administrator to manually activate the account.

Ok then I'll will make a note for those cases manually.
Do I guess right that this will most likely not be fixed since the Rainlab Users will be deprecated with the next October version?

This plugin is widely used so it won't be deprecated any time soon. There is a new user module for version 4 that canaddress this. Once solved there, we can backport it to this plugin.

We've decided to just upgrade this plugin instead: https://github.com/rainlab/user-plugin/pull/526
We'll make sure an adequate workflow is included for this.

This has been reviewed and addressed today in v3 (#526). There are so many different scenarios that it is simpler to address this inside Twig.
The layout can redirect an unverified user to a verification page that lets them verify a second time.
Notes added to the upgrade guide:

Require Activation is Removed
The Require Activation functionality has been removed for simplicity. The replacement approach below is more flexible, since custom pages or banners can be used based on the requirements.
A user can be checked if they are verified using Twig:
{% if not user.hasVerifiedEmail %}
    {% do redirect('account/login') %}
{% endif %}

It is possible to require administration approval by creating an "Approved User" user group, or by extending the users database table with a is_approved field. Then check in Twig:
{% if not user.is_approved %}
    {% do redirect('account/login') %}
{% endif %}


Thread-safe callbacks

I would like to implement an interface in Java that can be send to Rust in a thread safe way: I basically want to guarantee Send on the sent object Box<MyTraitInterface + Send>. Is this somehow possible?
Mind that it's late on my day and my brain is getting laggy. I have no idea whether it's somehow possible to do.

In the hypothetical case - if rust_swig would accept such syntax:
foreign_interface!(interface MyObserver {
    self_type OnEvent + Send;
    onStateChanged = OnEvent::something_change(&self, x: i32, s: &str);
});

all would be work fine.
All other parts are ready. In one of my projects I use java + Rust (tokio),
and my callbacks to java comes from thread created by Rust.
So generated code by rust_swig has all necessary code to inform JVM about new thread and so on things.
But I haven't yet use type checking for Rust+Java border,
so at now you have to use unsafe in this case to convert Box<Foo> to Box<Foo+Send>.


Standalone Hadoop-based Batch Ingestion can not push segments

My druid version is 0.12.3.
I write one sample batch ingestion file and it works well when I submit it through overlord interface.
But when I submit it through "standalone command line Hadoop indexer", which is described at http://druid.io/docs/latest/ingestion/command-line-hadoop-indexer.html.
The job fails when it tries to push segment into hdfs finally. The error msg looks like:
Pathname /user/bi_sz/realtime_druid_dev/segments/orderUV/2018-12-06T07:00:00.000Z_2018-12-06T08:00:00.000Z/2018-12-29T09:09:50.478Z/0/index.zip.0 from hdfs://ns3/user/bi_sz/realtime_druid_dev/segments/orderUV/2018-12-06T07:00:00.000Z_2018-12-06T08:00:00.000Z/2018-12-29T09:09:50.478Z/0/index.zip.0 is not a valid DFS filename.
I have noticed the reduce job is trying to use one io.druid.segment.loading.LocalDataSegmentPusher for pushing. It should be root reason but how can I avoid it?

I guess it should use one io.druid.storage.hdfs.HdfsDataSegmentPusher here


refactor geofeatures properties query

see https://vizzuality.atlassian.net/browse/MARXAN-490

@aagm except for a test which seems fickle (failed when I last pushed, then succeeded when I run tests again in CI manually), I think all is as we discussed this morning... geo indexes and other feedback from yourself to go into a separate PR