Invalid call on recovery phase _BoundariesReconnect

Is this a bug, feature request, or feedback?
Bug
What is the current behavior?
In a 4 workers cluster, after repeated crash & restart of workers 2 & 3, the following crash by the initializer worker halts the cluster:
1570577395.148307,|~~ -- Reconnect Phase 2: Wait for Reconnections -- ~~|
1570577395.148327,Sent control message to worker1
1570577395.148334,Sent control message to worker3
1570577395.148340,Sent control message to initializer
1570577395.148345,Invalid call on recovery phase _BoundariesReconnect
This should never happen: failure in /home/vagrant/wallaroo/lib/wallaroo/core/recovery/recovery_phase.pony at line 72

Full logs are available at http://wallaroolabs-dev.s3.amazonaws.com/logs/logs.20191008c.tar.gz
What is the expected behavior?
No crash
What OS and version of Wallaroo are you using?
Ubuntu Xenial/16.04 LTS + aloc-tee-source+scripts+autoscale-checkpoint+tcp-source-sink branch @ commit abb7b23f9
Steps to reproduce?
$ cd /top/of/wallaroo/repo
$ git checkout -f 7ab14750cd ; echo We need the passthrough app from another branch
$ mv examples/pony/passthrough
$ git checkout -f COMMIT-ABOVE
$ mv passthrough examples/pony
$ dd if=$HOME/wallaroo/testing/data/market_spread/nbbo/r3k-symbols_nbbo-fixish.msg bs=1000000 count=1 | od -x | sed 's/^/T/' | sed -n '1,/T3641060/p' | perl -ne 'print "\0\0\0"; print "1"; print' > /tmp/input-file.txt
$ cd testing/correctness/scripts/effectively-once
$ make -C ../../../..     PONYCFLAGS="--verbose=1 -d -Dresilience -Dtrace -Dcheckpoint_trace -Didentify_routing_ids"     build-examples-pony-passthrough build-testing-tools-external_sender     build-utils-cluster_shrinker build-utils-data_receiver     build-testing-tools-fixed_length_message_blaster

$ ./master-crasher.sh 4 crash2 crash3 crash-sink
,cS,rS,c3,r3,c3c2,r3r2,,cSc3r3,[...]rSr2,c3,,c2r3,,r2,,,CRASH LOOP 3: pause the world: exit 1 reason Failed to connect

cc: @jtfmumm

Also, a slightly different line number/method error:
1570578095.968166,|~~ -- Reconnect Phase 1: Wait for Boundary Counts -- ~~|
1570578095.968187,Sent control message to worker1
1570578095.968229,Sent control message to worker2
1570578095.968242,Sent control message to initializer
1570578095.968497,Received msg on Control Channel
1570578095.968506,Received InformOfBoundaryCountMsg on Control Channel
1570578095.980244,Rcvd msg at OutgoingBoundary
1570578095.980254,Received StartNormalDataSendingMsg at Boundary
1570578095.980359,Received msg on Control Channel
1570578095.980368,Received InformOfBoundaryCountMsg on Control Channel
1570578095.980446,Received msg on Control Channel
1570578095.980456,Received msg on Control Channel
1570578095.980461,Received InformOfBoundaryCountMsg on Control Channel
1570578095.980498,|~~ -- Reconnect Phase 2: Wait for Reconnections -- ~~|
1570578095.980510,Invalid call on recovery phase _BoundariesReconnect
This should never happen: failure in /home/vagrant/wallaroo/lib/wallaroo/core/recovery/recovery_phase.pony at line 67

And also:
1570582883.763048,|~~ INIT PHASE II: Application is initialized! ~~|
1570582883.763278,Sent control message to worker2
1570582883.763291,Sent control message to worker1
1570582883.763307,Sent control message to initializer
1570582883.763345,OutgoingBoundary: connected to worker2 at <IP_ADDRESS>:7125...

1570582883.763421,OutgoingBoundary: connected to worker1 at <IP_ADDRESS>:7115...

1570582883.763491,OutgoingBoundary: connected to initializer at <IP_ADDRESS>:7102...

1570582883.763557,OutgoingBoundary: connected to worker2 at <IP_ADDRESS>:7125...

1570582883.763761,OutgoingBoundary: connected to worker1 at <IP_ADDRESS>:7115...

1570582883.763950,OutgoingBoundary: connected to initializer at <IP_ADDRESS>:7102...

1570582883.764018,INFO,TCPSink,TCPSink initializing connection to <IP_ADDRESS>:7200

1570582883.764244,Input source is listening
1570582883.764252,Socket for Input now listening on <IP_ADDRESS>:7130
1570582883.764271,Rcvd msg at OutgoingBoundary
1570582883.764279,Received StartNormalDataSendingMsg at Boundary
1570582883.764372,Rcvd msg at OutgoingBoundary
1570582883.764380,Received StartNormalDataSendingMsg at Boundary
1570582883.764423,Rcvd msg at OutgoingBoundary
1570582883.764430,Received StartNormalDataSendingMsg at Boundary
1570582883.764481,INFO,TCPSink,TCPSink connected

1570582883.765757,Rcvd msg at OutgoingBoundary
1570582883.765767,Received StartNormalDataSendingMsg at Boundary
1570582883.765980,Received msg on Control Channel
1570582883.766019,Invalid call on recovery phase _AwaitRecovering
This should never happen: failure in /home/vagrant/wallaroo/lib/wallaroo/core/recovery/recovery_phase.pony at line 72

Also happens (rarely) with a 2 worker system via ./master-crasher.sh 2 crash1 crash-sink:
1570634095.676205,|~~ -- Reconnect Phase 1: Wait for Boundary Counts -- ~~|
1570634095.676222,Sent control message to initializer
1570634095.676950,Rcvd msg at OutgoingBoundary
1570634095.676962,Received StartNormalDataSendingMsg at Boundary
1570634095.677061,Received msg on Control Channel
1570634095.677075,Received msg on Control Channel
1570634095.677080,Received InformOfBoundaryCountMsg on Control Channel
1570634095.677094,Invalid call on recovery phase _BoundariesReconnect
This should never happen: failure in /home/vagrant/wallaroo/lib/wallaroo/core/recovery/recovery_phase.pony at line 72

The 2 worker system error (reported at https://github.com/WallarooLabs/wallaroo/issues/3030#issuecomment-540050740) also happens using the connector source & sink version, though with a different position in the restarting phases.  This is logged by worker1:
1570655069.477391,|~~ INIT PHASE II: Application is initialized! ~~|
1570655069.477534,Sent control message to initializer
1570655069.477575,OutgoingBoundary: connected to initializer at <IP_ADDRESS>:7102...

1570655069.477676,OutgoingBoundary: connected to initializer at <IP_ADDRESS>:7102...

1570655069.477782,Input source is listening
1570655069.477790,Socket for Input now listening on <IP_ADDRESS>:7110
1570655069.477800,INFO,ConnectorSink,Lifecycle: ConnectorSink.application_initialized at<PHONE_NUMBER>13268615897797082637482461717
1570655069.477806,INFO,ConnectorSink,ConnectorSink initializing connection to <IP_ADDRESS>:7200
1570655069.478591,DEBUG,ConnectorSink,ConnectorSink connecting
1570655069.478611,Rcvd msg at OutgoingBoundary
1570655069.478618,Received StartNormalDataSendingMsg at Boundary
1570655069.478690,Rcvd msg at OutgoingBoundary
1570655069.478698,Received StartNormalDataSendingMsg at Boundary
1570655069.478735,Rcvd msg at OutgoingBoundary
1570655069.478742,Received StartNormalDataSendingMsg at Boundary
1570655069.478785,INFO,ConnectorSink,ConnectorSink connected
1570655069.478792,INFO,ConnectorSink,ConnectorSink is experiencing back pressure, <BACKPRESSURE REMOVED> connected = true
1570655069.490300,DEBUG,ConnectorSink,Notify: stream_id 1 stream_name Passthrough-w-worker1-id-184702353713268615897797082637482461717 p-o-r/message_id 0
1570655069.490383,Received msg on Control Channel
1570655069.490403,Invalid call on recovery phase _AwaitRecovering
This should never happen: failure in /home/vagrant/wallaroo/lib/wallaroo/core/recovery/recovery_phase.pony at line 72

Line 72 is fun ref rollback_complete().

Theory: A EventLogAckRollbackMsg is sent by initializer during an 'old' control connection to worker 1. Worker 1 has already crashed, so initializer's control connection is closed.  However, the message is buffered (?) and sent when the control channel is reconnected?
Logged by initializer.  The only EventLogAckRollbackMsg message sent by initializer in this time period is the one sent at<PHONE_NUMBER>.886515 .
1570659081.885169,ControlSenderConnectNotifier: connection to worker1 at <IP_ADDRESS>:7114  closed
...
1570659081.886515,Sent control message to worker1: EventLogAckRollbackMsg
...
1570659083.734773,ControlSenderConnectNotifier: connected to worker1 at <IP_ADDRESS>:7114.
...
1570659083.745330,ControlSenderConnectNotifier: connection to worker1 at <IP_ADDRESS>:7114  closed
^^^ This closed message is due to worker1's Invariant() crash.

Theory seems to match the data.  I added data from Time.nanos() to the EventLogAckRollbackMsg  message in commit 6288e97ed. On initializer:
1570670426.762252,ControlSenderConnectNotifier: connection to worker1 at <IP_ADDRESS>:7114  closed
1570670426.768125,Sent control message to worker1: EventLogAckRollbackMsg.26259033910564
1570670426.806857,ControlSenderConnectNotifier: connected to worker1 at <IP_ADDRESS>:7114.

... and on worker1:
1570670426.805891,|~~ INIT PHASE II: Application is initialized! ~~|
...
1570670426.806486,Rcvd msg at OutgoingBoundary
1570670426.806517,Received StartNormalDataSendingMsg at Boundary
1570670426.806584,Rcvd msg at OutgoingBoundary
1570670426.806597,Received StartNormalDataSendingMsg at Boundary
1570670426.806635,Rcvd msg at OutgoingBoundary
1570670426.806641,Received StartNormalDataSendingMsg at Boundary
1570670426.806676,INFO,ConnectorSink,ConnectorSink connected
1570670426.806682,INFO,ConnectorSink,ConnectorSink is experiencing back pressure, <BACKPRESSURE REMOVED> connected = true
1570670426.806922,Received msg on Control Channel: EventLogAckRollbackMsg.26259033910564
1570670426.806936,Invalid call on recovery phase _AwaitRecovering
This should never happen: failure in /home/vagrant/wallaroo/lib/wallaroo/core/recovery/recovery_phase.pony at line 72

OK. I've tried adding a test hack in commit ca1c7f6d3 that will drop control messages sent to a worker when it has been closed(). Drops don't happen on the initial connection attempt to the worker (i.e., closed() hasn't happened yet).
However, I think that this is flawed?  It seems to be much better in that I'm not seeing this ticket's bug, maybe?  (This bug is rare enough that I'd want to run 5+ hours without it happening.)  However, the flaw is a hang that happens when:

initializer is working on checkpoint #21 and then determines that it needs to rollback.  Later,<PHONE_NUMBER>.714488,|~~ - Recovery Phase: Rollback - ~~|
initializer says:<PHONE_NUMBER>.730957,Sent control message to worker1: RemoteAbortBarrierMsg: [len=84:
worker1 is crashed, initializer says<PHONE_NUMBER>.281307,ControlSenderConnectNotifier: connection to worker1 at <IP_ADDRESS>:7114  closed
worker1's debugging timer delay hack says<PHONE_NUMBER>.417796,_DelayInitiateRollback: TIMER FIRED, and then immediately says<PHONE_NUMBER>.417994,Sent control message to worker1: EventLogInitiateRollbackMsg, but this message is dropped by test hack commit ca1c7f6d3
worker1 is restarted
initializer says<PHONE_NUMBER>.854832,Sent control message to worker1: InformOfBoundaryCountMsg: ... and then immediately<PHONE_NUMBER>.854872,Informed worker1 that I have 3 boundaries to it

This InformOfBoundaryCountMsg message is DROPPED at time<PHONE_NUMBER>.854998 by the test commit hack

The cluster hangs

Note: the test hack in commit ca1c7f6 does not avoid #3029.

Also, quite rare: This should never happen: failure in /home/vagrant/wallaroo/lib/wallaroo/core/recovery/recovery_phase.pony at line 38

See again today on today's master branch at commit 4323b713bc7d76152d0b3b01bcecdc3a5afc8c84 + connector-sink-fixes branch/PR #3042 using ./master-crasher.sh 2 crash0 crash1 crash-sink, full logs at http://wallaroolabs-dev.s3.amazonaws.com/logs/logs.1572991984.tar.gz
1572991509.990492,CheckpointInitiator: Aborting Checkpoint 7
1572991509.990576,Invalid call on recovery phase _BoundariesReconnect
This should never happen: failure in /home/vagrant/wallaroo/lib/wallaroo/core/recovery/recovery_phase.pony at line 38


Fix map_overlap in order to accept pandas arguments

[X] Closes #9567
[X] Tests added / passed
[X] Passes pre-commit run --all-files

lgtm

Someone to integrate this PR ?

Can you please resolve the conflicts?

Done !

Sorry for the long wait


To delete old backup file from Azure Blob Storage

Hello
I take the log backups to the Azure blob storage, but the cleanup time parameter in the databasebackup procedure does not work while using from the URL.
It is possible to delete backup files from Azure with another powershell script, I tested, it works fine. But within the SQL procedure (with T-Sql) - How can I delete old backup files at the time of the backup process? (like with cleanup time parameter)
Thanks in advance

Sorry, Azure currently does not support doing that from TSQL. Pieter van Hove describes how to do it with Powershell: http://pietervanhove.azurewebsites.net/?p=3648. Getting that to work with the Cleanup time parameter shouldn't be too hard (Powershell job step), but if you don't have Azure AD set up, or Ola's jobs aren't running under the right account, you'll need to put your Azure storage account secret into the code in plain text. Powershell won't read Shared Access Signature credentials...


Nested tables don't work in side array of tables

In [1]: import contoml
In [2]: toml = contoml.new()
In [3]: toml['test']=[{'address': 1234, 'tls': {'key':'test key', 'crt':'test crt'}}]
In [4]: print toml.dumps()
[[test]]
crt = "test crt"
key = "test key"
address = 1234

Fixed in 4166ccdd06b35ffda84b5aa9a47968da55b05abb


ImmaArray: Remove var_dump

Wow, embarassing that made it through static analysis and CI! Thanks Hans!


Transaction builder: no ETH field for payable functions

Title/Description
The payable function doesn't have an ETH field. At the same time, non-payable functions have ETH field on UI
Environment

Browser: chrome
Safe: 0x1230B3d59858296A31053C1b8562Ecf89A2f888b ( any safe)
Wallet: MM
App Version: 2.14.1
Environment:

staging (rinkeby)

Steps to reproduce

Go to the transaction builder
Use contract address 0xc778417e063141139fce010982780140aa0cd5ab
Select deposit
Current result: ETH field disappear and there is no payable amount (eth) field under the deposit function

4.Try to select non-payable function
Current result: There is ETH field
Expected result

Show "eth" field for the payable functions
Hide "eth" field for non-payable function

Screenshots

Please check if it makes sense to include this one as well: https://github.com/gnosis/safe-react-apps/issues/74

This is ready to be tested here @francovenica
https://ipfs.io/ipfs/QmRqREeEGJbiJ5w61gZK7Qk8ShRUc6xaNjTxqzKgT5hmza

Used the new tx builder link and try the steps given in the description of the ticket
When using the deposit method the ETH field shows properly

Looks good to me


BUG: flat map with "both" on top of one another

Using stc.plot(surface='flat', hemi='both') leads to a superposition of the two hemispheres:

(in addition, the conventional orientation of flat map is rotated 90* compared to what mne plots:

)

We should just not allow hemi='both' when using a flatmap and tell people to use hemi='split' (ValueError)
We should fix the orientation, it's a regression since https://mne.tools/dev/auto_tutorials/source-modeling/plot_visualize_stc.html is wrong but https://mne.tools/stable/auto_tutorials/source-modeling/plot_visualize_stc.html is correct (can you confirm @kingjr ?)

@kingjr if you want to take a stab at the ori fix at least, it should be that this line needs an appropriate roll= in degrees:
https://github.com/mne-tools/mne-python/blob/main/mne/viz/_brain/view.py#L41

... although I guess we could allow hemi='both' and add an appropriate offset so they show up in the correct locations relative to one another. This might actually be preferable to hemi='split' in some situations. So I think I changed my mind on (1) above.

I vote for an offset, it's easier to handle zoom in some cases.
hard to tell for an auditory response! I would only confirm for a visual one (alternatively, a quick check can be done by using the highlight by area option made by @GuillaumeFavelier)

it's hard for me to do PR on anything related to pyvista, because I only have it working on a headless, and I'm experiencing some painful lag

No worries, I can add that to my todo list and update https://github.com/mne-tools/mne-python/issues/7162

@GuillaumeFavelier can you take a look?

I'm on it :+1:


chore: typescript migration of components/settings/Honesty.test.js

Checklist:

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the main branch of freeCodeCamp.
[x] I have tested these changes either locally on my machine, or GitPod.

Is part of #43778

Hey folks, this is my first contribution, any feedback is appreciated :+1:

Hi @matheuspor thanks for taking this on. The tests are failing at the moment, so could you update the snapshot?  npm run test:source -- -u should do the trick.

Hi @ojeytonwilliams! Thanks for the reply, I think the snapshot is updated now.

Congrats on your first pull request (PR)! 🎉
Thank you for your contribution to the page! 👍
We are happy to accept these changes and look forward to future contributions. 📝


Out-Printer gives the "stack overflow" error for PDF printing

Steps to reproduce
I just tried to print my small PDF file with size of 138 KB by Get-Content piped with Out-Print cmdlet
The actual command looked this:
Get-Content C:\Users\danie\Documents\stuff\Документ.pdf | Out-Printer
Expected behavior
I expected my printer to receive this file and start to work with it
Actual behavior
But I got this error:

Environment data
This happens with every PDF file.
I tried this with files either contained Russian characters or only English but eventually the result is identical.
----                           -----
PSVersion                      7.0.0
PSEdition                      Core
GitCommitId                    7.0.0
OS                             Microsoft Windows 10.0.19041
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>
WSManStackVersion              3.0

I wonder why you send binary data to the cmdlet.
I guess you want print PDF file. See example https://gregcaporale.wordpress.com/2012/01/18/powershell-to-print-files-automatically/

I wonder why you send binary data to the cmdlet.
I guess you want print PDF file. See example https://gregcaporale.wordpress.com/2012/01/18/powershell-to-print-files-automatically/

 Greg's Blog**Using PowerShell to print pdf files automatically**My office has a series of nightly reports from SQL Server that export as Adobe documents.  The users want them printed and waiting for them each morning on a specific printer.  We had a little util…

This is not working at all

These all are workarounds. Is there any native possibility to send a file for printing?

You can run AcroRd32.exe with some parameters. Also there are some tools to print pdf files.

How do I request a feature?


v1.8.0

[x] collectionExistsAsync
[x] Key param for setPayloadAsync, overwritePayloadAsync.
[x] orderBy param for scrollAsync is supported since the method accepts the request object directly.
[x] Helpers to build DatetimeRange, StartFrom.
[x] Tests

Hi @russcam. I'll merge this for the time being. Please let me know if there should've been any changes.


Using speckle for version control

moving to backlog for the mo as it's not well enough defined. will pick back up when dim starts working on the grasshopper collaborative workflows doc as the two are quite related


Turn on amendable quarter dates in qa/dev

Adds feature flag to env vars list for GH actions. Have also added an env var to the dev environment of the repo within GH settings.

not quite sure I understand this

Have also added an env var to the dev environment of the repo within GH settings.
the code here hardcodes it, rather than using the version specified in the GH settings, will that cause duplication of the FF, if so should this be set to read it from the environment at build time?


labels associated in a wrong way, if not specified for each plot

Please provide a minimal working example (MWE) that shows what isn't working as
expected. Needed is

the Python code,

    import matplotlib.pyplot as plt
    from matplotlib2tikz import save as tikz_save
    x = y2 = range(-5,5)
    y1 = range(5,-5,-1)
    plt.plot(x,y1)
    plt.plot(x,y2,label='origin line')
    plt.legend()
    tikz_save('labelbug.tikz')

the output TeX (Pgfplots), and

% This file was created by matplotlib v0.1.0.
% Copyright (c) 2010--2014, Nico Schlömer<EMAIL_ADDRESS>% All rights reserved.
%
% The lastest updates can be retrieved from
%
% https://github.com/nschloe/matplotlib2tikz
%
% where you can also submit bug reports and leavecomments.
%
\begin{tikzpicture}

\definecolor{color1}{rgb}{1,0.498039215686275,0.0549019607843137}
\definecolor{color0}{rgb}{0.12156862745098,0.466666666666667,0.705882352941177}

\begin{axis}[
xmin=-5.45, xmax=4.45,
ymin=-5.5, ymax=5.5,
legend entries={{origin line}}
]
\addplot [semithick, color0]
coordinates {
(-5,5)
(-4,4)
(-3,3)
(-2,2)
(-1,1)
(0,0)
(1,-1)
(2,-2)
(3,-3)
(4,-4)

};
\addplot [semithick, color1]
coordinates {
(-5,-5)
(-4,-4)
(-3,-3)
(-2,-2)
(-1,-1)
(0,0)
(1,1)
(2,2)
(3,3)
(4,4)

};
\path [draw=black, fill opacity=0] (axis cs:0,13)--(axis cs:0,13);

\path [draw=black, fill opacity=0] (axis cs:1,13)--(axis cs:1,13);

\path [draw=black, fill opacity=0] (axis cs:13,0)--(axis cs:13,0);

\path [draw=black, fill opacity=0] (axis cs:13,1)--(axis cs:13,1);

\end{axis}

\end{tikzpicture}

the expected TeX (Pgfplots).

actual result:

Just realized that this is a duplicate of #167 .


Find in Selection option of Find showing pointer cursor while not active

VSCode Version: 1.1.0-alpha
OS Version: Windows 10

Steps to Reproduce:

Open a file
Ctrl+F to bring up Find menu
Hover over the Find in Selection option

Its a bit picky, but the Previous and Next match buttons keep the original cursor if they are not available. Previous and Next show the finger pointer icon if active, but the Find in Selection button always displays the finger pointer option when hovered.

Assigning to @vsccarl to verify the fix which should be available tomorrow


The last Docker Hub build of ocamlsf/learn-ocaml:dev failed

The logs of https://hub.docker.com/r/ocamlsf/learn-ocaml/ are not public but one can see in https://hub.docker.com/r/ocamlsf/learn-ocaml/tags that no successful build was pushed since the merge of #357
I investigated a bit more, reproducing the build in https://hub.docker.com/repository/docker/pfitaxel/learn-ocaml and I get:

Processing 3/4: [learn-ocaml: dune build]
+ /home/opam/.opam/4.05/bin/dune "build" "-p" "learn-ocaml" "-j" "71" (CWD=/home/opam/.opam/4.05/.opam-switch/build/learn-ocaml.0.12)
- js_of_ocaml src/toplevel/learnocaml_toplevel_worker_main.bc.js (got signal KILL)
- (cd _build/default/src/toplevel && /home/opam/.opam/4.05/bin/js_of_ocaml +dynlink.js +toplevel.js --toplevel --nocmis -o learnocaml_toplevel_worker_main.bc.js --no-runtime /home/opam/.opam/4.05/lib/js_of_ocaml-compiler/runtime.js learnocaml_toplevel_worker_main.bc)
- js_of_ocaml src/app/learnocaml_partition_view.bc.js (exit 1)
- (cd _build/default/src/app && /home/opam/.opam/4.05/bin/js_of_ocaml +cstruct/cstruct.js -o learnocaml_partition_view.bc.js --no-runtime /home/opam/.opam/4.05/lib/js_of_ocaml-compiler/runtime.js /home/opam/.opam/4.05/lib/cstruct/cstruct.js ../ace-lib/ace_bindings.js learnocaml_partition_view.bc)
- warning: overriding primitive "caml_blit_bigstring_to_bigstring"
- old: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:16
- new: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:16
- warning: overriding primitive "caml_compare_bigstring"
- old: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:26
- new: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:26
- warning: overriding primitive "caml_fill_bigstring"
- old: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:37
- new: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:37
- warning: overriding primitive "caml_check_alignment_bigstring"
- old: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:47
- new: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:47
- /home/opam/.opam/4.05/bin/js_of_ocaml: Error: Out of memory
- js_of_ocaml src/app/learnocaml_description_main.bc.js
- warning: overriding primitive "caml_blit_bigstring_to_bigstring"
- old: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:16
- new: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:16
- warning: overriding primitive "caml_compare_bigstring"
- old: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:26
- new: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:26
- warning: overriding primitive "caml_fill_bigstring"
- old: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:37
- new: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:37
- warning: overriding primitive "caml_check_alignment_bigstring"
- old: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:47
- new: /home/opam/.opam/4.05/lib/cstruct/cstruct.js:47
- There are some missing primitives
[…]

But I'm unsure how we could easily debug this (?) as locally, docker build -t learn-ocaml . is OK…
Cc @yurug @maiste FYI

Hi @erikmd,
sorry for my late reply! As you said, the problem comes from a memory limitation in the build system provided by Docker.  Before going on holidays, I was checking for a way to extend the memory space. Unfortunately, it seems that Dockerhub doesn't allow that to prevent RAM saturation on their servers.
I'm glad to know that moving to github CD/CI fixed this problem! Thanks so much!


FIX: address issue where PROJ core dumps on proj_create with +init= when global context does not have data directory set

[x] Closes #415
[x] Closes #368 (I hope)
[x] Fully documented, including history.rst for all changes and api/*.rst for new API

Before:
>>> from pyproj import CRS
>>> cc = CRS("+proj=utm +zone=33 +ellps=WGS84 +datum=WGS84 +units=m +no_defs")
>>> cc = CRS(init="epsg:4326")
Segmentation fault (core dumped)

After:
>>> from pyproj import CRS
>>> cc = CRS(init="epsg:3857")
>>> cc
<Projected CRS: EPSG:3857>
Name: WGS 84 / Pseudo-Mercator
Axis Info [cartesian]:
- E[east]: Easting (metre)
- N[north]: Northing (metre)
Area of Use:
- name: World - 85°S to 85°N
- bounds: (-180.0, -85.06, 180.0, 85.06)
Coordinate Operation:
- name: Popular Visualisation Pseudo-Mercator
- method: Popular Visualisation Pseudo Mercator
Datum: World Geodetic System 1984
- Ellipsoid: WGS 84
- Prime Meridian: Greenwich


If a for(each) loop modifies the loop counter, that modification needs to update the array being iterated

If a for(each) loop modifies the loop counter, that modification needs to update the array being iterated

Fixed in v1.023


groups information not asked

When you add authorization based on groups to be allowed to access e.g. notebook server. Upon accessing the server, proxy does not send the group scope to dataporten which means a user can not get access to the notebook server even though he/she is member of that group. Looking at the code , scope needs to be passed comma separated strings not as array as passed currently [scope1 scope2 scope3].
This needs to be fixed to all the charts which uses goidc-proxy

029facd499d7333afe451895fe692ab40cd7088d should fix this for all charts that use goidc-proxy

tested and its working.


Locally build your app with the Amplify build image before pushing

Is your feature request related to a problem? Please describe.
I'd like to be able to test my amplify.yml build prior to pushing it up.
Describe the solution you'd like
A script similar to AWS CodeBuild's codebuild_build
Additional context
Thank you for the build image though. That is helpful.

+1 for this, it's really frustrating when you have a build error in the amplify build and can't reproduce it locally.

Any word on this?

Agreed, i have a build error I can't reproduce. Seems to be missing a dependency when running npm build. Everything works fine locally.
Are there any suggestions/instructions on how to debug this? If I pull the build image what steps do I run inside the container? I don't even have an amplify.yml in my project dir? I'm sure I could reverse engineer from the logs but if anyone has helpful suggestions it would be appreciated (and I'm sure by anyone else coming across this thread).

@ahurlburt I had the same issue. It ended up being because of the NODE_ENV
If this is set to production before a yarn install, yarn will only install deps and not devdeps
This can be overridden by using --production=false

is there an update on this feature request?


⚠ Bofrost.es has degraded performance

In 91130d3, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1945 ms

Resolved: Bofrost.es performance has improved in df58ff4 after 16 minutes.


Add gRPC 1.36.3 to the interop matrix

The image generation was complicated by several Python dependencies.
v1.36.1 includes a patch to Core DirectPath https://github.com/grpc/grpc/pull/25569; v1.36.2 includes some infra fixes; v1.36.3 includes https://github.com/grpc/grpc/pull/25690 and infra fixes.

Interop matrix job run cf2dab55-e18d-4232-b086-7adc79abbe24 succeed. Merging.


vars to const

most people are writing for node.js 4 and up. It makes more sense to have examples written for the majority.

readme changed, will fix separately


pombe GO slim updates

remove iron sulfur cluster assembly  GO:0016226
( is now is_a cofactor metabolic process which is already in slim)

Add GO:1901135 - carbohydrate derivative metabolic process
(will capture some non slimmed GPs)

GO:0007346 - regulation of mitotic cell cycle
replace by
GO:1901990 regulation of mitotic cell cycle transition
(regulation of all other mitotic cell cycle processes are covered  by 'DNA replication, chromosome. segregation, cytokinesis etc).....less redundancy/overlap, smaller bins, no change in number of gene slimmed

Delete GO:0007059 chromosome segregation
replace by GO:0000070 mitotic chromosome segregation
(meiotic chromosome segregation is fully  covered by GO:0007126 meiotic nuclear division) ....less redundancy/overlap, smaller bins, no change in number of gene slimmed.

Delete GO:0007010	cytoskeleton organization
Add GO:0030036	actin cytoskeleton organization
Add GO:0000226	microtubule cytoskeleton organization
(Better biological grouping for PomBase users)

Thanks!
Val

Val,
Is this on the right tracker?
-D

I usually put it on this tracker and one of the editors does the changes (I don't know how to use obo edit!)

OK. My bad. I didn't realize you wanted me to modify the slims.
I can teach you how to use obo-edit and protege.

Edits done.

Thank you! I don't really want to lean to use obo edit.... but I know people at PomBase who can ;)

And very well I might add!

Hi David,
Sorry to be a pain.
Our current slim has
GO:0098974	postsynaptic actin cytoskeleton organization
instead of GO:0030036 actin cytoskeleton organization
could you switch it?
Thanks
Val

Hi Val, I just removed GO:0098974 postsynaptic actin cytoskeleton organization from the pombe slim (GO:0030036 was already in).

thanks!


Implement unlimited-depth directly-optimal recursion.

Implement a new directly-optimal recursion execution algorithm that can support unlimited-depth recursion, developed in collaboration with @bojanserafimov as part of the HYTRADBOI'22 Jam: https://www.hytradboi.com/jam
Traces show that the new implementation produces the first result in less than half as many steps on even the shallowest of recursion situations. The more steps previously involved in getting the first result from the recursion, the more significant the improvement will be.
After this merges, we'll still need to update the front-end to make the @recurse depth parameter nullable and plumb that change throughout Trustfall to enable unlimited-depth recursion.

Unlimited-depth recursion makes adapters even more likely to accidentally trigger the same re-entrancy bug as in #205.
The best way I can see is making a change to the Adapter trait to take &self instead of &mut self, and removing RefCell throughout. If users need mutability, they can use their own RefCell and will need to take care to avoid re-entrancy issues.


Fixes/cleanup to manifest and config

File paths in manifest.webapp were not inheriting the value from the path member in config. This is because, in helpers.js, _.map() creates a new array and does not mutate the passed in array (among other reasons).
The density member in manifest.json has been changed to a number. While technically having the value as a string should work, the specification alludes to it being a number type.
Added a <link> element for the coast icon.
#69 #89

+1 Google Chrome team also updated density member their manifest.json sample accordingly: https://github.com/GoogleChrome/samples/pull/98

Awesome, loving these commits mate :) Just gotta sort out a few questions then I'm good to merge

Also @phbernard You should cross reference this with your code :)


Can't specify "Default" site

Using the following code
    # parser arguments per sample code
    parser.add_argument('--site', '-si', required=False, default='Default', help='site to use')

    # Step 1: Sign in to server.
    tableau_auth = TSC.TableauAuth(args.username, password)
    tableau_auth.site = args.site
    server = TSC.Server(args.server)

and specifying "Default" as a site (which is the default value in many samples (e.g. python initialize_server.py -s http://localhost -u admin -si Default -wf . -df .) throws a login error.
Traceback (most recent call last):
  File "API_demo.py", line 502, in <module>
    main()
  File "API_demo.py", line 104, in main
    with server_upload.auth.sign_in(tableau_auth):
  File "/Library/Python/2.7/site-packages/tableauserverclient/server/endpoint/auth_endpoint.py", line 29, in sign_in
    Endpoint._check_status(server_response)
  File "/Library/Python/2.7/site-packages/tableauserverclient/server/endpoint/endpoint.py", line 54, in _check_status
    raise ServerResponseError.from_response(server_response.content)
tableauserverclient.server.endpoint.exceptions.ServerResponseError:

	401001: Signin Error
		Error signing in to Tableau Server

Passing the empty string '' DOES work to login to the Default site.  (e.g. python initialize_server.py -s http://localhost -u admin -si '' -wf . -df .)

That's because you need to pass the "content_url" or "site_id", not the site 'name'.
This is the same behavior as tabcmd, though we acknowledge that it's difficult to discern that from the docs. Do you have any recommendations on how to make it better?

The content URL for the Default site is "" (an empty string).  However, the default is "Default" in the samples.
Ideally, the contentUrl of Default would translate to the Default site (and hence, be the same as the name).  But short of that changing the default in the samples to match the contentUrl of the default site should help.
The fact that the contentUrl or ID is not displayed with the Default site (in the UI) doesn't help, but understand it is out of scope for this conversation.
Default site:

Any other site:

Yup, that's a bug in the sample then.

@benlower fix your sample :)

@t8y8 I'll also add that outside of the sample, the code and documentation makes it seem like the site id is what is required and not the content url.
An example would be
import tableauserverclient as TSC
tableau_auth = TSC.TableauAuth('username', 'password', site_id='site')
server = TSC.Server('http://servername')

with server.auth.sign_in(tableau_auth):
  all_workbook_items, pagination_item = server.workbooks.get()
  print([workbook.name for workbook in all_workbooks])

which is at https://tableau.github.io/server-client-python/docs/api-ref#workbooks

The UI refers to the content_url as the 'site_id'.
Tabcmd also calls that the site id (the -t parameter).
We should unify all references to be the same so that it's clear across the Tableau ecosystem but that's beyond the scope of the api library, more of an internal work item.

It would be helpful if the sample code included passing the site_id parameter in the tableau_auth string.   I just spent more time than I'm willing to admit trying to figure out why I could not utilize the sample code properly, because the debug and error messages are not particularly informative.

Reviewing older issues, I believe we have addressed this one by rewriting the sign in / sign out topic to be more clear: https://tableau.github.io/server-client-python/docs/sign-in-out


Get-DbaSqlBuildReference - added SMO pipe support

it conflicts partially with what was originally discussed with klaas, but it works.  BTW: current development seems to have a small issue now, but that's not a fault for this commit
Unable to find type [sqlcollective.dbatools.dbaSystem.MessageLevel]

Hi @niphlod ,
can't reproduce the issue and the tests seem fine. Can you reproduce the issue?
Cheers,
Fred

will do in approximately 2 hours. Stay tuned.

The problem originated from reimporting the new development in the powershell process
in a fresh one, no issues. Sorry for the wrong report.

How's that @niphlod ?

Perfect.
Styleguide police is coming .... one target less ^_^


[U4] Install transformers from main

Waiting on #23445 before we can merge this!

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

Good to be merged 👍


imports synchronization without a log

💚 Acceptance. Tried importing a sync without log both in master and in this branch, failing in the first case :)


Recommendation for when to use a client connection pool

Is there a rough limit (or guideline) for when it's recommended we maintain a pool of ClickHouseClients instead of generating a new client per request? (Whether it's a limit of total open clients at any given time, or frequency of writes, or volume of writes, etc)?
I'm developing an application with frequent writes of high volume on multiple threads and it seems like it wouldn't be performant to generate new clients per request
Originally posted by @AntonOyung in https://github.com/ClickHouse/clickhouse-java/issues/786#issuecomment-1908937224

I'm uncertain about the pooling strategy, but if you're utilizing an HTTP client, configuring the SOCKET_KEEPALIVE and SOCKET_REUSEADDR options can help reduce the total number of open connections. This approach has proven effective for us at scale.

Thanks for the response! So it sounds like we should be reusing clients instead of generating new ones per request/write.
If I have for example have 30 JVMs each with 30 threads running against my cluster, is it recommended we maintain 1 ClickHouseClient per thread? From a cursory look of the code it seems like each client maintains its own pool of connections, so that would be 30 * 30 * (X # of connections established by the client) total connections.
It looks like the default max connections is 1024, is there any performance implication as we get closer to that limit?


Possible memory leak when putting a value with the same key

When putting a value into the db with an existing key (and the same value) I see that the size of the db folder just grows. Expected behaviour is that it will remain the same size if I re-insert an entry as the old value is to be overwritten.
I use
store.put(key, value, { valueEncoding: "view" })

I get the same results using the batch put method.
I get the same results using sync: true
Deleteing the entry seems to clear up all the data that has accumulated for all insertions on the same key.
I am using version "1.3.0"

I realized that this is intended behaviour for performance reasons. Disc size never seems to exceed 10mb as pruning will start to kick in eventually.


utop fails to run

Issue description
When running utop on unstable NixOS I get the following error:
$ utop
/nix/store/hjbj55zxa0vj6f7kxgckj67qb4v84kik-utop-1.19.3/bin/utop not found or is not a bytecode executable file

Technical details

System: 17.09pre104652.08c87ee (Hummingbird)
Nix version: nix-env (Nix) 1.11.8
Nixpkgs version: "17.09pre104652.08c87ee"

Weird, it is working for me in unstable-small.

I forget to say that it happens with ocamlPackages_latest.utop.

Thanks for the report. Please check #24524.

It fixes utop for me.

The wrapProgram helper by default runs exec -a $0 .../.utop-wrapped. I can avoid this issue by running exec .../.utop-wrapped, i.e. just removing the -a $0 part.
This can be accomplished be invoking wrapProgram --argv0 "" ....

I guess this is fixed now.


Relicense to dual MIT/Apache

Looks like the people other than me who still have code committed are:

[ ] @kmcallister
[ ] @tailhook

Could both of you reply to this PR and say that you are/are not okay relicensing your work under the user's choice of MIT or Apache 2.0?
Thanks!

I'm fine with that.

I'm fine with that too.

Awesome, thanks!


PWAs: Identify group of people who want to participate in docs project

Among the various potentially interested parties, determine who is interested in actively engaging in the documentation project, at any of the following levels:

Planning and determining what documentation and sample code is needed
Writing documentation and/or sample code
Reviewing the produced content

Acceptance criteria

A list of people who will engage in this project on a regular basis has been collected

A group has been found that is interested in participating but I have no commitments yet as to what they can and will do.

Got as many as I could. Calling it closed.


tfa.seq2seq decoder implementation problem

System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10
TensorFlow version and how it was installed (source or binary): tf 2.1.0
TensorFlow-Addons version and how it was installed (source or binary): tf_addons 0.7.1
Python version: 3.6
Is GPU used? (yes/no): no

Describe the bug
I do not understand how the decoder function is working as in what should be the input to the sequence_length. I did what I could decipher from the code. Here, embedding and embedding1 are embedding of two different languages in NMT and fr_vocab_size, en_vocab_size are the lengths of respective tokenizers.
Code to reproduce the issue
@tf.function
def train_step(source_seq, target_seq_in, target_seq_out):
    with tf.GradientTape() as tape:
        encoder_outputs, state_h, state_c = encoder(embedding(source_seq))
        encoder_state = [state_h, state_c]
        sampler = tfa.seq2seq.sampler.TrainingSampler()
        projection_layer = tf.keras.layers.Dense(fr_vocab_size)
        decoder = tfa.seq2seq.BasicDecoder(
            decoder_cell, sampler, output_layer=projection_layer)

        outputs,_,_= decoder(
            embedding1(target_seq_in),
            initial_state=encoder_state,
            sequence_length=[fr_vocab_size])
        logits = outputs.rnn_output
        loss = loss_func(target_seq_out, logits)

    variables = encoder.trainable_variables + decoder.trainable_variables
    gradients = tape.gradient(loss, variables)
    optimizer.apply_gradients(zip(gradients, variables))

    return loss

Other info / logs
ValueError: in converted code:
<ipython-input-32-11e809516a8d>:12 train_step  *
    outputs,_,_= decoder(
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/keras/engine/base_layer.py:778 __call__
    outputs = call_fn(cast_inputs, *args, **kwargs)
/usr/local/lib/python3.6/dist-packages/tensorflow_addons/seq2seq/decoder.py:162 call  *
    return dynamic_decode(
/usr/local/lib/python3.6/dist-packages/tensorflow_addons/seq2seq/decoder.py:393 body  *
    (next_outputs, decoder_state, next_inputs,
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/control_flow_ops.py:2478 while_loop_v2
    return_same_structure=True)
/usr/local/lib/python3.6/dist-packages/tensorflow_addons/seq2seq/basic_decoder.py:126 step  *
    cell_outputs = self.output_layer(cell_outputs)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/keras/engine/base_layer.py:748 __call__
    self._maybe_build(inputs)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/keras/engine/base_layer.py:2116 _maybe_build
    self.build(input_shapes)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/keras/layers/core.py:1113 build
    trainable=True)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/keras/engine/base_layer.py:446 add_weight
    caching_device=caching_device)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/training/tracking/base.py:744 _add_variable_with_custom_getter
    **kwargs_for_getter)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/keras/engine/base_layer_utils.py:142 make_variable
    shape=variable_shape if variable_shape else None)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/variables.py:258 __call__
    return cls._variable_v1_call(*args, **kwargs)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/variables.py:219 _variable_v1_call
    shape=shape)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/ops/variables.py:65 getter
    return captured_getter(captured_previous, **kwargs)
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/eager/def_function.py:502 invalid_creator_scope
    "tf.function-decorated function tried to create "

ValueError: tf.function-decorated function tried to create variables on non-first call.

Ohhhkkkk .. I got my mistake .. Thanks!


controlplane bootstrap fails/stuck after first controlplane node

/kind bug
What steps did you take and what happened:
i tried to deploy a k8s cluster by using the Hetzner capi provider but the control plane is not able to get healthy.
the deployment stuck after the first control plane.
my steps:
clusterctl generate provider --infrastructure hetzner:v1.0.0-alpha.20 > hetzner-capi.yml
kubectl apply -f hetzner-capi.yml

export HCLOUD_TOKEN=xxxxxxxxxxxx
export HCLOUD_SSH_KEY="mykey"
export CLUSTER_NAME="mycluster"
export HCLOUD_REGION="fsn1"
export CONTROL_PLANE_MACHINE_COUNT=3
export WORKER_MACHINE_COUNT=3
export KUBERNETES_VERSION=1.24.1
export HCLOUD_CONTROL_PLANE_MACHINE_TYPE=cpx31
export HCLOUD_WORKER_MACHINE_TYPE=cpx31

kubectl create secret generic hetzner --from-literal=hcloud=${HCLOUD_TOKEN}
kubectl patch secret hetzner-p '{"metadata":{"labels":{"clusterctl.cluster.x-k8s.io/move":""}}}'
clusterctl generate cluster --infrastructure hetzner:v1.0.0-alpha.20 ${CLUSTER_NAME} > ${CLUSTER_NAME}.yaml
kubectl apply -f ${CLUSTER_NAME}.yaml

cluster is created but the controlplane is not able to get healthy:
$ clusterctl describe cluster ${CLUSTER_NAME}
NAME                                                                       READY  SEVERITY  REASON                       SINCE  MESSAGE
Cluster/mycluster                                                          False  Warning   ScalingUp                    71m    Scaling up control plane to 3 replicas (actual 1)
├─ClusterInfrastructure - HetznerCluster/mycluster
├─ControlPlane - KubeadmControlPlane/mycluster-control-plane               False  Warning   ScalingUp                    71m    Scaling up control plane to 3 replicas (actual 1)
│ └─Machine/mycluster-control-plane-x5jb5                                  False  Warning   NodeStartupTimeout           49m    Node failed to report startup in &Duration{Duration:20m0s,}
│   └─MachineInfrastructure - HCloudMachine/mycluster-control-plane-prxwq
└─Workers
  └─MachineDeployment/mycluster-md-0                                       False  Warning   WaitingForAvailableMachines  72m    Minimum availability requires 3 replicas, current 0 available
    └─3 Machines...                                                        True                                          7m53s  See mycluster-md-0-59f5696b48-khjkp, mycluster-md-0-59f5696b48-v57kg, ...

$ kubectl get KubeadmControlPlane
NAME                          CLUSTER         INITIALIZED   API SERVER AVAILABLE   REPLICAS   READY   UPDATED   UNAVAILABLE   AGE   VERSION
mycluster-control-plane       mycluster       true                                 1                  1         1             73m   v1.24.1

$ kubectl describe KubeadmControlPlane mycluster-control-plane
.....
Events:
  Type     Reason                 Age                    From                              Message
  ----     ------                 ----                   ----                              -------
  Warning  ControlPlaneUnhealthy  3m28s (x285 over 73m)  kubeadm-control-plane-controller  Waiting for control plane to pass preflight checks to continue reconciliation: [machine mycluster-control-plane-x5jb5 does not have APIServerPodHealthy condition, machine mycluster-control-plane-x5jb5 does not have ControllerManagerPodHealthy condition, machine mycluster-control-plane-x5jb5 does not have SchedulerPodHealthy condition, machine mycluster-control-plane-x5jb5 does not have EtcdPodHealthy condition, machine mycluster-control-plane-x5jb5 does not have EtcdMemberHealthy condition]

$ kubectl get MachineHealthCheck
NAME                                       CLUSTER         EXPECTEDMACHINES   MAXUNHEALTHY   CURRENTHEALTHY   AGE
mycluster-control-plane-unhealthy-5m       mycluster       1                  100%                            74m
mycluster-md-0-unhealthy-5m                mycluster       3                  100%                            74m

$ kubectl describe MachineHealthCheck mycluster-control-plane-unhealthy-5m
Events:
  Type     Reason          Age                 From                           Message
  ----     ------          ----                ----                           -------
  Warning  ReconcileError  75m (x13 over 75m)  machinehealthcheck-controller  error creating client and cache for remote cluster: error fetching REST client config for remote cluster "default/mycluster": failed to retrieve kubeconfig secret for Cluster default/mycluster: secrets "mycluster-kubeconfig" not found
  Warning  ReconcileError  74m                 machinehealthcheck-controller  error creating client and cache for remote cluster: error creating dynamic rest mapper for remote cluster "default/mycluster": Get "https://<IP_ADDRESS>:443/api?timeout=10s": dial tcp <IP_ADDRESS>:443: i/o timeout
  Warning  ReconcileError  73m (x4 over 74m)   machinehealthcheck-controller  error creating client and cache for remote cluster: error creating dynamic rest mapper for remote cluster "default/mycluster": context deadline exceeded

$ kubectl get secrets
NAME                                TYPE                                  DATA   AGE
default-token-vcccj                 kubernetes.io/service-account-token   3      5h35m
hetzner                             Opaque                                1      78m
mycluster-ca                        cluster.x-k8s.io/secret               2      76m
mycluster-control-plane-xkvnf       cluster.x-k8s.io/secret               2      76m
mycluster-etcd                      cluster.x-k8s.io/secret               2      76m
mycluster-kubeconfig                cluster.x-k8s.io/secret               1      76m
mycluster-md-0-48wdl                cluster.x-k8s.io/secret               2      12m
mycluster-md-0-rlccb                cluster.x-k8s.io/secret               2      13m
mycluster-md-0-x2q8s                cluster.x-k8s.io/secret               2      12m
mycluster-proxy                     cluster.x-k8s.io/secret               2      76m
mycluster-sa                        cluster.x-k8s.io/secret               2      76m

# Get the node status of the deployed cluster
$ kubectl get no --kubeconfig mycluster
NAME                            STATUS   ROLES              AGE    VERSION
mycluster-control-plane-x5jb5   NotReady    control-plane   74m    v1.24.1
mycluster-md-0-khjkp            NotReady    <none>          72m    v1.24.1
mycluster-md-0-v57kg            NotReady    <none>          72m    v1.24.1
mycluster-md-0-x5d32            NotReady    <none>          72m    v1.24.1

# Try to fetch API - possible
$ curl https://<IP_ADDRESS>:443/api?timeout=10s -k
{
  "kind": "Status",
  "apiVersion": "v1",
  "metadata": {},
  "status": "Failure",
  "message": "forbidden: User \"system:anonymous\" cannot get path \"/api\"",
  "reason": "Forbidden",
  "details": {},
  "code": 403
}

If tested hetzner:v1.0.0-alpha.19 and hetzner:v1.0.0-alpha.20 but i get the same result.
Environment:

cluster-api-provider-hetzner version: v1.0.0-alpha.19 and v1.0.0-alpha.20
Kubernetes version:

Client Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.4", GitCommit:"b695d79d4f967c403a96986f1750a35eb75e75f1", GitTreeState:"clean", BuildDate:"2021-11-17T15:48:33Z", GoVersion:"go1.16.10", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.6", GitCommit:"42a9a90338d705a1650fb68b7891f84b62adb0b0", GitTreeState:"clean", BuildDate:"2022-06-15T04:25:21Z", GoVersion:"go1.16.12", Compiler:"gc", Platform:"linux/amd64"}

OS:

Server image: ubuntu 20.04
client: OSX

@kisahm this looks like the bootstrap provider (e.g. kubeadm) didn't created the kubeconfig secret... See: secrets "mycluster-kubeconfig" not found. Is the error persistent after you recreated the cluster?

could you ssh to the node and do crictl ps?
And did you installed the ccm and a cni? I see that the node status is NotReady

i've dropped the cluster but i'll recreate a new and send you the output.
does the capi provider needs the cni and ccm to complete the deployment after the first control plane is up?

@kisahm every kubernetes cluster needs a ccn and a cni to work properly. In simple terms, the cluster api takes over the lifecycle management of the cluster. It also checks whether the nodes are ready, apiserver, etcd are functioning as intended. So if the initialization of the node is missing it will not create any further control-planes.

@batistein thx for your support. i missunterstood the docs.
i've deployed cni and ccm after the first controller is up and after this the other control plane nodes are created

I'm glad to help! Do you have a suggestion on how we can improve the documentation at this point?
And if you like the project please give it a :star:

Re docs improvements: can you mention in https://github.com/syself/cluster-api-provider-hetzner/blob/main/docs/topics/quickstart.md#apply-the-workload-cluster that following two steps (CNI and CCM deployment) are needed to finalize the bootstrap before the timeout for node deployment expires?

so basically I cant have 3 control-plane in my initial setup and can only add extra control-plane, once I move it to the new cluster ?

so basically I cant have 3 control-plane in my initial setup and can only add extra control-plane, once I move it to the new cluster ?

Hey @ashish1099, Can you give me more details around the following questions?
Which version of CAPH you're using?
Ideally, you can scale your controlplanes even if you've 3 controlplanes in the starting. For example if you started your cluster with 3 controlplanes and 1 worker nodes and want to have 4 controlplanes and 4 worker nodes, you can scale your kubeadmcontrolplane and machinedeployment objects respectively.

once I move it to the new cluster ?

Do you mean moving from bootstrap to management cluster.

I'm using v1.6.3 for cluster-api and hcloud-ccm 1.19.0 and CAPI v1.0.0-beta.33
This is a simple control-plane nodes starting with 3 (1 nodes get setup fine) and I can do kubectl get pods and install cilium as well.
but the other two nodes never get picked up. all I see is this error
 Warning  ControlPlaneUnhealthy  11m (x980 over 4h32m)  kubeadm-control-plane-controller  Waiting for control plane to pass preflight checks to continue reconciliation: Machine k8s-control-plane-mlrvl does not have a corresponding Node yet (Machine.status.nodeRef not set)

Do you also install the CCM, additionally to the CNI?

@ashish1099 Thank you for the input.
Can you share me the logs of hetzner-ccm? Also, it'll be great if you can share how to reproduce the problem you're facing? What does you HcloudMachine object look like(the ones those are not coming up, can you share those with status please)?

This is my HetznerBareMetalHost
---
# Source: capi-hetzner/templates/HetznerBareMetalHost.yaml
apiVersion: infrastructure.cluster.x-k8s.io/v1beta1
kind: HetznerBareMetalHost
metadata:
  name: htzhel1-ax41d.enableit.dk
  labels:
    role: kcm-control-plane
spec:
  serverID: 1866472
  maintenanceMode: false
  rootDeviceHints:
    raid:
      wwn:
        - "0x50000397cb700acd"
        - "0x500003981be00179"
  description: "Cluster kcm control plane node htzhel1-ax41d.enableit.dk"
---
# Source: capi-hetzner/templates/HetznerBareMetalHost.yaml
apiVersion: infrastructure.cluster.x-k8s.io/v1beta1
kind: HetznerBareMetalHost
metadata:
  name: htzhel1-ax41e.enableit.dk
  labels:
    role: kcm-control-plane
spec:
  serverID: 1866482
  maintenanceMode: false
  rootDeviceHints:
    raid:
      wwn:
        - "0x5000cca25ed86494"
        - "0x5000cca25ecf496b"
  description: "Cluster kcm control plane node htzhel1-ax41e.enableit.dk"
---
# Source: capi-hetzner/templates/HetznerBareMetalHost.yaml
apiVersion: infrastructure.cluster.x-k8s.io/v1beta1
kind: HetznerBareMetalHost
metadata:
  name: htzhel1-ax41f.enableit.dk
  labels:
    role: kcm-control-plane
spec:
  serverID: 1866484
  maintenanceMode: false
  rootDeviceHints:
    raid:
      wwn:
        - "0x50014ee2097c6ca4"
        - "0x50014ee2097c9304"
  description: "Cluster kcm control plane node htzhel1-ax41f.enableit.dk"

I have tried deleting the cluster multiples time, and it picks up any node between 3 and it get installed as well

Do you also install the CCM, additionally to the CNI?

yes, CCM is installed 1.19.0 version here and CNI is on 1.14.4

you get a 403 error there. Are you sure that there is one node that is up successfully?
And you use the hetzner ccm. Can you try our fork? I have never tried the one of Hetzner until now. Not sure whether it works. Maybe the 403 is related to that

you get a 403 error there. Are you sure that there is one node that is up successfully?
And you use the hetzner ccm. Can you try our fork? I have never tried the one of Hetzner until now. Not sure whether it works. Maybe the 403 is related to that

let me the fork one, I didnt tried that so far :)

With the hcloud-cloud-controller-manager you need to make sure that the correct secret is configured to access the Hetzner Cloud API. In the default configuration the secret created by cluster-api-provider-hetzner in the workload cluster is called hetzner. hcloud-ccm expects a secret called hcloud by default, but can be configured to use whatever secret you want.
I have my cluster running with CAPH & hcloud-ccm and can confirm that it works well for Hetzner-Cloud only scenarios. The logs indicate invalid credentials & issues while talking to the Hetzner Robot API. During the timeframe indicated by the Logs, there was a scheduled maintenance of the Robot API, which would explain the issues: https://status.hetzner.com/incident/e162e98c-61b8-4a5d-8ea8-1ea3a84a6ee1

the fork CCM worked for me.
One thing I noticed is that the first node got provisioned and the second node didn't got provisioned, until I installed the CCM on the new cluster + CNI (cilium 1.14.4) and the second node got provisioned and soon after this the 3rd node got provisioned too.
so not sure if it was just a coincidence or is it a requirement, maybe a doc improvement ?

yes it is a requirement (see above in this issue). @kranurag7 did you include the cni and ccm already as requirement in your docs PR?

did you include the cni and ccm already as requirement in your docs PR?

I didn't as part of my PR but it's there in quickstart guide.
Ref:

https://github.com/syself/cluster-api-provider-hetzner/blob/fc635050ccf4ad636f6168f7400c5a56c06ce026/docs/topics/quickstart.md#deploy-a-cni-solution
https://github.com/syself/cluster-api-provider-hetzner/blob/fc635050ccf4ad636f6168f7400c5a56c06ce026/docs/topics/quickstart.md#deploy-the-ccm

then add a sentence that both CNI and CCM are required after the first control plane is ready, otherwise the cluster won't be usable


Vehicle Trim Levels

Describe the feature
For more realism, admin's can define trim levels for vehicles in the Manage Vehicles menu. When registering a vehicle, citizens and officers can select the trim level of their vehicle.
This can especially helpful for officers because they could label their vehicle as unmarked, marked, or ghost.
Additional Context
No response

This is already supported. You can use Vehicle Flags.

Trim Levels and Flags are different. Trim Levels describe the equipment and performance of a vehicle while flags are more for pointing things out.
Example of Trim Levels: The Model 3 has 3 trim levels, Standard, Long Range, and Performance.
I could not list all vehicle trim levels in flags because all vehicles would have access to trim levels of other vehicles. A Ford Explorer doesn't have a trim level of "Performance" because it's trim level is "ST".

This is editable by the citizen then?

Sorry for not responding.
Trim Levels shouldn't be in their own menu but added to the Manage Vehicles menu because not all cars have the same trims. It should be added to each car individually, or at least, not let all cars have access to them.


Ignore words which are intentionally different casing

Having a test like

will show an error about casing being wrong. However it is done on purpose here.
A solution could be to ignore words if they are wrapped in quotes.
e.g Can be used with "camelCase"

Thanks! This will be fixed in v1.6.0 which is building right now 👍


equalTo doesn't set ng-invalid

First of all; lovely package. Brillant!
Im having a small issue when using this code (simplified)

    Password
    <input class="input" [(ngModel)]="signUpUser.password" id="signUpPassword" type="password" required #password/>
    Confirm password
    <input class="input" [(ngModel)]="signUpUser.passwordConfirm" #passwordConfirm/>

equalTo error

password: {{password.className}}

passwordConfirm: {{passwordConfirm.className}}

And the user inputs something that doesnt match, you get the 'equalTo error' but not the ng-invalid class on passwordConfirm/password
Screencapture includes some elements not displayed in example code

Is this expected? It this a bug?

I also have that issue. It's not really necessary because we can set some custom error class but it would be great to have ng-invalid class out of the box

@brunsten @IlyaSurmay please check the new version.


Portal ignores direction

PJP: 5.2.0-13.7
SpongeForge: 1.10.2-2281-5.2.0-BETA-2363
Minecraft Forge: <IP_ADDRESS>7
When creating a portal, the direction specified with the -d flag is ignored and the direction is always East.

https://github.com/NucleusPowered/Nucleus/issues/870
This might be a sponge or forge issue.

è vero

This still seems to be an issue as of:
Java version: 1.8.0_151-b12
minecraft server.1.12.2
forge 1.12.2 <IP_ADDRESS>4 universal
spongeforge 1.12.2 2529 7.0.0 BETA 2746
project core 7.0.0 0.2.1 b31
project portals 7.0.0 0.14.0 b29


Support tunnel_count when attach spoke to transit

https://registry.terraform.io/providers/AviatrixSystems/aviatrix/latest/docs/resources/aviatrix_spoke_transit_attachment
tunnel_count - (Optional) Number of public tunnels. Required with both Spoke and Transit to be insane mode enabled and max performance enabled. Type: Integer. Valid Range: 1-49. Available as of provider version R3.1.3+.

This is already in the master branch, just not yet released. Will be part of next release. Feel free to test directly against master and report any issues.


Tab options like ripple, stretch, colors/theming, icons

Feature request:
Obviously the first pass at tabs was MVP, but it would be lovely to get some options back from v1:

Colors & Theming: I'd expect something like the toolbar <md-tab-group color="primary">
Ripple when clicking an md-tab-label
Stretch tabs (though a simple flex-grow:1 on tab labels can achieve this now)
Icons: md-icons current don't render in tabs

More work on tabs is forthcoming, alpha.5 was indeed just the initial version. Going to close this since it's not really focused enough to be an actionable issue. The <md-icon> thing sounds like a bug, though.

Hi
 flex-grow:1 did work fr you ?
<md-tab-group *ngIf="box">
  <md-tab >
    <template md-tab-label style="flex-grow:1" >One</template>
    <template md-tab-content>

One

...

    </template>
  </md-tab>
    <md-tab>
    <template md-tab-label style="flex-grow:1"> Two </template>
    <template md-tab-content>

Two

...

    </template>
  </md-tab>
</md-tab-group>


Performance improvements

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

https://people.sap.com/kai.niklas.1

Thanks a lot for your contribution. The solution looks great and I'll close this PR now!
You should receive your badge soon.


Add a .odc.explore() method for automatically plotting raster data on an interactive map

Geopandas recently added an extremely useful .explore() method that allows users to quickly plot and inspect data on an interactive map: https://geopandas.org/en/stable/docs/reference/api/geopandas.GeoDataFrame.explore.html
Being able to quickly plot and inspect raster data on an interactive map would be incredibly useful, and would avoid a common workflow of having to export to GeoTIFF and load data into a GIS just to inspect it closely.
Luckily with odc-geo we can already do something like this:
import folium
import rioxarray
import odc.geo.xr

ds = rioxarray.open_rasterio(
    "https://dea-public-data-dev.s3-ap-southeast-2.amazonaws.com/derivative/dea_intertidal/sample_data/160/2019-2021/DEV_160_2019_2021_elevation.tif",
    masked=True,
).squeeze("band")

# Create folium Map
m = folium.Map()

# Reproject to 3857
ds_reproj = ds.odc.reproject("epsg:3857")

# Add to map
ds_reproj.odc.add_to(m)

# Zoom map to bounds
m.fit_bounds(ds.odc.map_bounds())
display(m)

But this adds a lot of boilerplate code that makes this harder than it needs to be.
Proposal
Instead, we could add a new .odc.explore() method to odc-geo that mimics the .explore() functionality of Geopandas. In my mind, calling ds.odc.explore() would automatically:

Create a Folium or Ipyleaflet map
Reproject data to "epsg:3857"
Add the reprojected data to the map
Fit the map bounds to the data
Display the map

I'd be keen to have a go at adding something like this, but I'd love to know if there's any obvious issues with this proposal. One thing I can think of is that neither folium or ipyleaflet are currently included as a requirement for odc-geo (I imagine to keep it as small and manageable as possible), so this may be a blocker to adding a feature that depends on those packages?

Something like this is certainly needed, but I want to be able to combine several odc-geo elements together, ideally with some kind of config option available.
I was experimenting with syntax like this:
aa = odc.stac.load(...)
bb = aa.odc.reproject(3857)

aa.odc.geobox >> bb.odc.geobox%{'color': 'red'} >> bb.odc.preview | folium.Map()


update 2FA language

stress the need for enabling 2FA and clarify that it does not impact other accounts linked to the MSA

Docs Build status updates of commit be80f1c:
:clock10: Pending: waiting for processors (10 builds ahead of you)
:warning: Docs Build is busy, currently there are 10 builds ahead of this one, for more information you can view the Build queue graph on the Docs Portal.

Docs Build status updates of commit be80f1c:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/nuget-org/individual-accounts.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

@shishirx34 - I have updated the aka.ms to point to the relevant section - https://aka.ms/nuget-enable-2fa

Docs Build status updates of commit c7857f6:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/nuget-org/individual-accounts.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Store Firestore rules in repo; fixes #306

cc @oferb @webdevelopland
You can deploy rules only by executing firebase deploy --only firestore:rules

Great!
Let's have Vadim approve it's working for him.

@oferb I managed to deploy new rules, see changelog here. Guess it works 🙂

Works for me too.


DO NOT MERGE INCOMPLETE First stab at adding leagues/league sign up.

I merged this even though it's not complete because it works and it's not exposed in the menu or anything.


[FLINK-14232][runtime] Support global failure handling in NG scheduling

What is the purpose of the change
Global failure handling(full restarts) is widely used in ExecutionGraph components and even other components(CheckpointCoordinator) to recover the job from an inconsistent state.
This PR is to support it for DefaultScheduler to not break such usages.
Brief change log

Add getGlobalFailureHandlingResult(Throwable) in ExecutionFailureHandler
Add an interface handleGlobalFailure(Throwable) in SchedulerNG and implement it in DefaultScheduler
Add an interface notifyGlobalFailure(Throwable) in InternalTaskFailuresListener and rework the implementations to use SchedulerNG#handleGlobalFailure
Rework ExecutionGraph#failGlobal to invoke InternalTaskFailuresListener#notifyGlobalFailure for NG scheduling

Verifying this change
This change added tests and can be verified as follows:

Added unit tests for ExecutionFailureHandler#getGlobalFailureHandlingResult
Added unit tests for DefaultScheduler#handleGlobalFailure
The overall changes can be verified by successfully running ZooKeeperHighAvailabilityITCase. This requires some additional changes though, including tests fix and state restore supporting. It is verified with private patches.

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

Generally speaking good. There are some minor comments.

@flinkbot run travis


kubelogin(interactive pop) issue with AKSArc connected to Winfield

@julienstroheker
For Winfield, we need to disable instance discovery in the auth flow, or we will hit below error. Maybe the previous flow work as the instance discovery was not enabled at that time
PS C:\Users\cloudtest> $env:AZURE_ENVIRONMENT_FILEPATH = "C:\AksArc\env.json"
PS C:\Users\cloudtest> kubectl --kubeconfig C:\Aksarc\config-aksarc-test1-user get ns
Error: failed to get token: failed to create PoP token using interactive login: failed to create PoP token with interactive flow: http call(https://login.microsoftonline.com/common/discovery/instance?api-version=1.1&authorization_endpoint=https%3A%2F%2Flogin.autonomous.cloud.private%2F98b8267d-e97f-426e-8b3f-7956511fd63f%2Foauth2%2Fv2.0%2Fauthorize)(GET) error: reply status code was 400:
{"error":"invalid_instance","error_description":"AADSTS50049: Unknown or invalid instance. Trace ID: 8475d55f-87de-42e3-a4fb-8bc1e1401100 Correlation ID: 7e9eef1b-bbc1-4d55-b2b6-9c3b1ae15fb7 Timestamp: 2024-11-20 03:14:35Z","error_codes":[50049],"timestamp":"2024-11-20 03:14:35Z","trace_id":"8475d55f-87de-42e3-a4fb-8bc1e1401100","correlation_id":"7e9eef1b-bbc1-4d55-b2b6-9c3b1ae15fb7","error_uri":"https://login.microsoftonline.com/error?code=50049"}
E1120 03:14:35.121603    2420 memcache.go:265] couldn't get current server API group list: Get "https://<IP_ADDRESS>:6443/api?timeout=32s": getting credentials: exec: executable kubelogin failed with exit code 1
Error: failed to get token: failed to create PoP token using interactive login: failed to create PoP token with interactive flow: http call(https://login.microsoftonline.com/common/discovery/instance?api-version=1.1&authorization_endpoint=https%3A%2F%2Flogin.autonomous.cloud.private%2F98b8267d-e97f-426e-8b3f-7956511fd63f%2Foauth2%2Fv2.0%2Fauthorize)(GET) error: reply status code was 400:
env.json:
{
"name":  "AzureEdgeCloud",
"managementPortalURL":  "https://portal.autonomous.cloud.private/",
"resourceManagerEndpoint":  "https://resourcemanagerweb.azs:40007/",
"activeDirectoryEndpoint":  "https://login.autonomous.cloud.private/",
"graphEndpoint":  "https://graph.autonomous.cloud.private/",
"microsoftGraphEndpoint":  "https://graph.autonomous.cloud.private/",
"storageEndpointSuffix":  "autonomous.cloud.private",
"cosmosDBDNSSuffix":  "docdb.autonomous.cloud.private:13443",
"tokenAudience":  "https://resourcemanagerweb.azs:40007/",
"resourceIdentifiers":  {
"graph":  "https://graph.autonomous.cloud.private/",
"storage":  "https://resourcemanagerweb.azs:40007/",
"cosmosDB":  "https://docdb.autonomous.cloud.private:13443/"
}
}
kubelogin info:
users:

name: aad-user
user:
exec:
apiVersion: client.authentication.k8s.io/v1beta1
args:
- get-token
- --login
- interactive
- --server-id
- 6256c85f-0aad-4d50-b960-e6e9b21efe35
- --client-id
- 3f4439ff-e698-4d6d-84fe-09c9d574f06b
- --tenant-id
- 98b8267d-e97f-426e-8b3f-7956511fd63f
- --environment
- AzureStackCloud
- --pop-enabled
- --pop-claims
- u=/subscriptions/8673b929-0d2f-a5d9-3003-7b9184a881c4/resourceGroups/onebox-test/providers/Microsoft.Kubernetes/connectedClusters/aksarc-test1
command: kubelogin
env: null

@Aijing2333 Make sense, let's open a PR to see how it looks like.
This should be easy by leveraging https://github.com/AzureAD/microsoft-authentication-library-for-go/blob/4a4dafcbcbd7d57a69ed3bc59760381232c2be9c/apps/public/public.go#L110 or something around these line.


How does the pool get the height of the block created by the farmer instead of the height of the packaged coinbase transaction?

I use node_rpc_client.get_coin_records_by_puzzle_hashes,and  it return a list of coinRecord ,but I can't get the coinRecords for which height's coinbase tx

https://github.com/Chia-Network/pool-reference/blob/main/pool/singleton.py#L125


Game broken

When attempting to access this at https://githubschool.github.io/github-games-yevhen-maslov-rft/, I am getting a 404. This could be caused by a couple things:

GitHub pages needs to be enabled on main. You can fix this in the repository settings.
the index.html file is incorrectly named inde.html. We will fix this together in class.

Can you please fix the first bullet @yevhen-maslov-rft?

@githubteacher already fixed both points

@githubteacher already fixed both points


Failing on Chrome Canary builds

On Chrome build 51.0.2689.0 (actually, for versions stretching back for the preceding week or so), attempts to click on a logged Immutable.js object now result in:
VM562:9 Custom Formatter Failed: ReferenceError: bindRemoteObject is not defined
I suspect that there's some kind of permanent change to the Custom Formatter API. A few Google searches have revealed precious little information, sadly.

Version 51.0.2687.0 dev (64-bit)
I'm seeing the same issue on the dev build of stable Chrome.

Just FYI. We have the same problem here:
https://github.com/binaryage/cljs-devtools/issues/14

Hi @darwin. Do you think we should delegate this to Chromium? I'm sure that bindRemoteObject is not used in this project.

The problem seems to be this call:
https://github.com/binaryage/dirac/blob/devtools/front_end/components/CustomPreviewSection.js#L213
It has been there for a long time and that function is not defined anywhere in DevTools code, so I assume it was provided as part of WebKit environment. So I assume someone removed that function or broke it in some way in recent builds. I don't really have time and expertise to go through WebKit/Chromium sources to find what changed at this point.
I believe this will be solved soon when they notice this function is missing. It was probably just renamed or moved elsewhere.

It's working for me with the current Chrome Canary.

@mattzeunert Please paste here your Chrome version / OS.
It is still broken in Mac Chrome 51.0.2691.0 canary (64-bit). The bug is reproducible when you try to expand a console log generated via custom formatters (by clicking on it's disclosure triangle).

@darwin Ah, got it.

This is the issue in the Chromium bug tracker: https://bugs.chromium.org/p/chromium/issues/detail?id=595206

I have just raised the issue upstream:
https://bugs.chromium.org/p/chromium/issues/detail?id=599884

Thanks @darwin, I starred the issue.

Fixed in 51.0.2702.0 canary (64-bit)

Great! :-)


Help / Open logs folder not working on Windows

When I select "Help/Open logs folder" from menu, nothing happens.

Hi, @sajmons
Does path to log folder contains non-latin letters?

No, here is the path: C:\Users\Simon\AppData\Roaming.astra_lite\logs

Fixed in v0.0.80


Case when cannot work on nested sql

My SQL is as follows, I use case..when in outer sql, but  cannot get "value"
SELECT
t,
sum(CASE host WHEN 'druid-host1' then value ELSE 0 END) as "tps_host1",
sum(CASE host WHEN 'druid-host2' then value ELSE 0 END) as "tps_host2"
FROM(
SELECT
    TIME_FLOOR(__time, 'PT1M') as t,
    host,
    sum(sum_value) as v
FROM druid_metric_default
WHERE "__time" >= '2018-11-21 16:30:00+0800'
AND metric='ingest/events/processed'
GROUP BY TIME_FLOOR(__time, 'PT1M'),host
)
GROUP by t

Hey @zhaojiandong,
What result do you get when you run this query? And what do you get if you add "EXPLAIN PLAN FOR" to the front of it?

Hey @zhaojiandong,
What result do you get when you run this query? And what do you get if you add "EXPLAIN PLAN FOR" to the front of it?

For example, the inner SQL
SELECT
    TIME_FLOOR(__time, 'PT1M') as t,
    host,
    sum(sum_value) as v
FROM druid_metric_default

We got:
t                           host          v
2018-11-22T10:00:00.000Z    druid-host1   100
2018-11-22T10:00:00.000Z    druid-host2   10
2018-11-22T10:01:00.000Z    druid-host1   150
2018-11-22T10:01:00.000Z    druid-host2   12

We expect to  get when run the whole sql
t                                                tps_host1    tps_host2
2018-11-22T10:00:00.000Z    100            10
2018-11-22T10:01:00.000Z    150             12

Actually We get:
t                                                tps_host1    tps_host2
2018-11-22T10:00:00.000Z    0                 0
2018-11-22T10:01:00.000Z     0                 0

@gianm

Hi @zhaojiandong,
I tried a similar query on master and got a correct result. It is possible something has been fixed here since the version you're using. Could you tell if this query works in master (or even in the latest 0.13.0 RC, available at https://dist.apache.org/repos/dist/dev/incubator/druid/0.13.0-incubating-rc3/)?
If you still find issues in master, could you please write a unit test that shows the problem, in CalciteQueryTest?
Thanks!

Hi @zhaojiandong,
I'm going to close this since it seems to be working in master.

Hi @zhaojiandong,
I tried a similar query on master and got a correct result. It is possible something has been fixed here since the version you're using. Could you tell if this query works in master (or even in the latest 0.13.0 RC, available at https://dist.apache.org/repos/dist/dev/incubator/druid/0.13.0-incubating-rc3/)?
If you still find issues in master, could you please write a unit test that shows the problem, in CalciteQueryTest?
Thanks!

Thanks Gianm
It works in 0.13.0, we use 0.12.0


[bug] Installing repo dependencies using yarn install or npm install always fails

Is there an existing issue for this?

[X] I have searched the existing issues

RainbowKit Version
0.6.0
wagmi Version
n/a
Current Behavior
Attempting to install the dependencies on the repository always fails.
yarn install fails.
Expected Behavior
yarn install succeeds.
Steps To Reproduce
Fresh checkout of the repo.
$ yarn install
...
error rainbowkit/node_modules/@lavamoat/preinstall-always-fail: Command failed.
Exit code: 1
Command: echo "Don't run npm lifecycle scripts by default, whitelist them with @lavamoat/allow-scripts" && exit 1
Arguments:

Link to Minimal Reproducible Example (CodeSandbox, StackBlitz, etc.)
No response
Anything else?
This fails due to the inclusion of the @lavamoat/preinstall-always-fail, which in itself fails to install itself during the install step.

This repo uses pnpm rather than yarn or the official npm client.
The @lavamoat/preinstall-always-fail package deliberately breaks the install step if its preinstall script is allowed to run. This serves as a test case to ensure we've disabled package install scripts correctly.
The install step works in pnpm because we've configured pnpm's onlyBuiltDependencies option to only allow install scripts for esbuild, which you can see in our package.json: https://github.com/rainbow-me/rainbowkit/blob/7b3ed26b4892539d58bd7d6a6bc5011304da97d9/package.json#L81-L850

@markdalgleish what if pnpm install still fails?
After cloning the repo fresh, installing pnpm (npm i -g pnpm), and running pnpm install, it fails with
ERR_PNPM_PREPARE_PKG_FAILURE  Command failed with exit code 1: npm install

Tried on a WSL environment and repro'd as well
If I configure lavamoat as you would with just npm:
npm i -D @lavamoat/allow-scripts
npx --no-install allow-scripts setup

and add
  "lavamoat": {
    "allowScripts": {
      "esbuild": true
    }
  }

to package.json
then npm install succeeds, but pnpm install still fails with the same error
ERR_PNPM_PREPARE_PKG_FAILURE  Command failed with exit code 1: npm install

any ideas? no special global setup you all have done?
I would love to start contributing but I can't get this code to build 🙃


Convert all python to python3.7

to: @ryandeivert
cc: @airbnb/streamalert-maintainers
resolves: #850
Background
Python2.7 is reaching end of life and support on aws for python2.7 will cease in the near future; an upgrade to python3 is required.
Changes

Broadly, all python updated to support python3.7
Requirements updated, testing scripts updated, CI configuration updated
Vagrant configuration added for ease of environment generation
Documentation that references python2.7 now references python3.7

Testing

The unit tests, linter pass, and bandit pass all succeed when running with python3.7
The integration tests, invoked via python manage.py test {rules,classifier,live} all pass
All steps of the Getting Started guide complete successfully

Hi @GarretReece, thanks a bunch for opening this up!
I'll be helping perform testing of this over the next few days.
Can you rebase this onto release-3-0-0? We plan on releasing the Python 3 changes in the next StreamAlert major release.

@Ryxias no problem at all, should be rebased now. Thanks for the prompt attention!

hey @GarretReece  can you set the base branch for this to release-3-0-0?

done

@GarretReece - we just merged some release 2.3.0 changes into master. can you address the conflicts that arose from this?
also, can you rebase your branch from current master (or this release-3-0-0 branch [they're the same]) and ensure that none of the new code is non-py3 compliant? The changes should largely be covered in this PR: https://github.com/airbnb/streamalert/pull/976

Coverage decreased (-0.2%) to 96.614% when pulling 922fb1b96b4d9058472904de0894b0e599e44b4c on trailofbits:py2to3 into 7032a7e7721e7392a0dcd7200a28dfc8c05b1c43 on airbnb:release-3-0-0.

@GarretReece
These are my test plan results on 922fb1b:
Bug when running manage.py with no arguments:
Reproduction:
$ ./manage.py

Symptom:
(venv) ~/extrepos/streamalert-3.7 (py2to3)$ ./manage.py
[INFO 2019-08-22 15:00:42,274 (stream_alert_cli.runner:58)]: Issues? Report here: https://github.com/airbnb/streamalert/issues
Traceback (most recent call last):
  File "./manage.py", line 1510, in <module>
    main()
  File "./manage.py", line 1506, in main
    sys.exit(not cli_runner(options))
  File "/Users/derek_wang/extrepos/streamalert-3.7/stream_alert_cli/runner.py", line 84, in cli_runner
    result = cmds[args.command](args)
AttributeError: 'Namespace' object has no attribute 'command'

Expectation:
usage: ./manage.py [-h] [-v] [-d]
                   {app,athena,build,clean,configure,create-alarm,create-cluster-alarm,custom-metrics,deploy,destroy,generate,init,kinesis,list-targets,output,rollback,rule-staging,status,test,threat-intel,threat-intel-downloader}
                   ...
./manage.py: error: too few arguments

Syntax Error on Alert Processor
I was able to fully deploy StreamAlert and while testing I encountered another bug:
[ERROR] Runtime.UserCodeSyntaxError: Syntax error in module 'stream_alert.alert_processor.main': invalid syntax (_base.py, line 381) Traceback (most recent call last): File "/var/task/concurrent/futures/_base.py" Line 381 raise exception_type, self._exception, self._traceback

[ERROR] Runtime.UserCodeSyntaxError: Syntax error in module 'stream_alert.alert_processor.main': invalid syntax (_base.py, line 381) Traceback (most recent call last): File "/var/task/concurrent/futures/_base.py" Line 381 raise exception_type, self._exception, self._traceback

This one looks like it's dealing with a concurrency manager of some kind?

Bug when running manage.py with no arguments:
Reproduction:
$ ./manage.py

Symptom:
(venv) ~/extrepos/streamalert-3.7 (py2to3)$ ./manage.py
[INFO 2019-08-22 15:00:42,274 (stream_alert_cli.runner:58)]: Issues? Report here: https://github.com/airbnb/streamalert/issues
Traceback (most recent call last):
  File "./manage.py", line 1510, in <module>
    main()
  File "./manage.py", line 1506, in main
    sys.exit(not cli_runner(options))
  File "/Users/derek_wang/extrepos/streamalert-3.7/stream_alert_cli/runner.py", line 84, in cli_runner
    result = cmds[args.command](args)
AttributeError: 'Namespace' object has no attribute 'command'

Expectation:
usage: ./manage.py [-h] [-v] [-d]
                   {app,athena,build,clean,configure,create-alarm,create-cluster-alarm,custom-metrics,deploy,destroy,generate,init,kinesis,list-targets,output,rollback,rule-staging,status,test,threat-intel,threat-intel-downloader}
                   ...
./manage.py: error: too few arguments

ugh, that's a change to the interface in argparse that's causing issues elsewhere too (https://github.com/python/cpython/pull/3027). I can't quite get to the exact same behavior as before, but a near fix will produce the help message and a similar-ish error message to what's expected.

Syntax Error on Alert Processor
I was able to fully deploy StreamAlert and while testing I encountered another bug:
[ERROR] Runtime.UserCodeSyntaxError: Syntax error in module 'stream_alert.alert_processor.main': invalid syntax (_base.py, line 381) Traceback (most recent call last): File "/var/task/concurrent/futures/_base.py" Line 381 raise exception_type, self._exception, self._traceback

[ERROR] Runtime.UserCodeSyntaxError: Syntax error in module 'stream_alert.alert_processor.main': invalid syntax (_base.py, line 381) Traceback (most recent call last): File "/var/task/concurrent/futures/_base.py" Line 381 raise exception_type, self._exception, self._traceback

This one looks like it's dealing with a concurrency manager of some kind?

Oh neat, that doesn't reproduce at all on my system. It looks like it's an issue with the futures backport getting installed when not needed and not getting properly scoped to only python2.X versions (see https://github.com/pypa/pipenv/issues/1589 for a similar issue). The fix is probably to remove the futures package from requirements.txt, which I've done with the most recent commit. Let me know if that resolves the issue.


Minor linting fixes

Curious question: which tool are you using for finding these issues? Rustdoc does not seem to catch them

@Tpt If you really want to go to town on your doctests, at PyO3 we use a bit of Python to extract their code and run Rustfmt on it. But you could certainly also run Clippy on them.

@adamreichold Very nice! Thank you!


Add support for pushing podspecs to SVN specs repos

This adds a push command that functions similar to pod repo push. It does not do any validation, however, so it is up to the user to validate before pushing. This is because the validator assumes sources are git repos
Let me know what you think!

Thanks for the contributions @amorde! :cake:
I'm working on some unit tests for the plugin tonight and hopefully will do a release before I sleep :)

@clarkda Awesome man! Glad my contributions are helping. I would recommend maybe bumping the version number since the plugin API will require a certain version of cocoapods (whatever their next release is)

absolutely! i think these changes are enough to justify a bump to 2.x :smile:


Azure AD Connect Health URLs list

For automatic upgrade to work, make sure you have opened the URLs in your proxy server for Azure AD Connect Health as documented in Office 365 URLs and IP address ranges https://support.office.com/article/Office-365-URLs-and-IP-address-ranges-8548a211-3fe7-47cb-abb1-355ea5aa88a2
Is the link correct? It doesn't include section for "Azure AD Connect Health"

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e192eab2-771f-4572-cd55-a166eac1e0e7
Version Independent ID: 528dec55-c74d-3769-3a34-5e29e4a9852f
Content: Azure AD Connect: Automatic upgrade
Content Source: articles/active-directory/hybrid/how-to-connect-install-automatic-upgrade.md
Service: active-directory
GitHub Login: @billmath
Microsoft Alias: billmath

Hello @tariqjaber Thanks for reaching out, will review your question and get back to you as soon as possible

@tariqjaber Thanks for the feedback !  I have assigned this issue to content author to investigate and update the document as appropriate.


Is WHERE EXISTS supported?

This is question, not a bug or feature request.
Sorry if this is not good place to ask...
Is it possible to generate WHERE EXISTS with bun framework like here in this example:
SELECT first_name,
       last_name
FROM customer c
WHERE EXISTS
    (SELECT 1
     FROM payment p
     WHERE p.customer_id = c.customer_id
       AND amount > 9 )
ORDER BY first_name,
         last_name;

Tried to find in documentation but only this example:
https://bun.uptrace.dev/guide/query-select.html#exists
Discard this question if this is not proper place to ask...

Converted to IN like here:
SELECT first_name,
       last_name
FROM customer c
WHERE c.customer_id IN
    (SELECT p.customer_id
     FROM payment p
       WHERE amount > 9 )
ORDER BY first_name,
         last_name;

using:
```Where(" p.customer_id IN (?)", subQuery).`
function...


Added Night Owl Theme

These pull ads a new theme named Night Owl based on the Visual Studio Code theme by Sarah Drasner.
Note: The image for the theme is missing from the commit because I would need the address to the Theme Testing server, or someone who can make an image based on this Night Owl theme.

Hello @CrHasher,
Thanks for your pull request! A Core Committer will review your pull request soon. For code contributions, you can learn more about the review process here.
Per the Mattermost Contribution Guide, we need to add you to the list of approved contributors for the Mattermost project.
Please help complete the Mattermost contribution license agreement?
Once you have signed the CLA, please comment with /check-cla and confirm that the CLA check is green.
This is a standard procedure for many open source projects.
Please let us know if you have any questions.
We are very happy to have you join our growing community! If you're not yet a member, please consider joining our Contributors community channel to meet other contributors and discuss new opportunities with the core team.

/check-cla

Just updated the mentions background the rest of the theme is based on the other themes in the themes color page ex. OneDark, Discord and so on. All those themes have duplicate mentionBg fields in the json. Hope that is ok, the theme was tested and works on https://community.mattermost.com/

Also note that the #FF2C83 color you see in some places indicates unread and active channels. See this link for details on colors used: https://github.com/VonHeikemen/night-owl-sublime-scheme


The fix clicks the error hyperlink that 'here' appears

The fix clicks the error hyperlink that 'here' appears

/approve cancel

/assign @bobsky

/assign @zacharysarah

@zacharysarah  OK，Thanks

@xichengliudui 👋 I missed that this was an updated link to k/k, not k/website. Sorry! 🙇
It looks like the link you're updating has changed significantly, with its contents moved to a different repo. I've modified the entire link path here.

/lgtm
/approve


Expand ellipses options

Initial checklist

[x] I read the support docs
[x] I read the contributing guide
[x] I agree to follow the code of conduct
[x] I searched issues and couldn’t find anything (or linked relevant results below)
[x] If applicable, I’ve added docs and tests

Description of changes
Re: #9 discussion, this PR adds 'unspaced' and 'spaced' options to ellipses config:

when true, turns triple dots into ellipses (with or without spaces between);
when 'unspaced', turns triple dots into ellipses (only for those without spaces);
when 'spaced', turns triple dots into ellipses (only for those with spaces).

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (bc33ba5) 100.00% compared to head (cefe004) 100.00%.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff            @@
##              main       #11   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            2         2
  Lines          354       377   +23
=========================================
+ Hits           354       377   +23

Files
Coverage Δ

lib/index.js
100.00% <100.00%> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

thanks, released! https://github.com/retextjs/retext-smartypants/releases/tag/6.1.0