[UPDATE] 0.50.1

Updating the lbry client to 0.50.1
I've also tweaked the README so the correct Electron package is given (this is the one in the .json manifest used for building)

@kcseb I can't tag you as a reviewer but would you be able to?

Looks good! Merging. Please drop an LBC address if you would like, can get some LBC your way.

@kcseb thanks, no need to tip LBC though :wink:


Add test-output-dir to Espresso tests

Describe the solution you'd like
We have a set of espresso tests running in AppCenter right now, we would like to be able to display the test results in Azure DevOps. We've heared that this can be achieved by using the test-output-dir arguments, however, this argument is currently not supported for Espresso tests.
Describe alternatives you've considered
I havn't found an alternative yet apart from reading the test results from AppCenter directly.
Additional context
Add any other context or screenshots about the feature request here.

Thanks for your feedback, if this ticket gets more reaction from other users we can start working on it.

I would also like this.


/xss/reflect/onmouseover_fp is exploitable

Should be a False Positive but currently exploitable.
PoE: http://<IP_ADDRESS>:8080/xss/reflect/onmouseover_fp?in=ch01xabcD%22%20onmouseover=alert%28123%29+x=%22

Fixed by #23


QMCGenerators v1.2.0 Release

@JuliaRegistrator register()

Registration pull request created: JuliaRegistries/General/88234
After the above pull request is merged, it is recommended that a tag is created on this repository for the registered package version.
This will be done automatically if the Julia TagBot GitHub Action is installed, or can be done manually through the github interface, or via:
git tag -a v1.2.0 -m "<description of version>" cda58aa41374c8bebeb9d9d35935d12c49eb1a32
git push origin v1.2.0


speed.measurementlab.net has a bug when latencies are very very low

From the javascript console
Missed cache for undefined
mlabService.js:35 Received M-Lab answer ndt-iupui-mlab2-lga06.measurement-lab.org for undefined
ndt-browser-client.js:236 Uncaught DOMException: Failed to execute 'send' on 'WebSocket': Still in CONNECTING state.
    at keepSendingData (https://speed.measurementlab.net/assets/js/ndt-browser-client.js:236:22)
    at https://speed.measurementlab.net/assets/js/ndt-browser-client.js:274:7
    at WebSocket.ndtSocket.onmessage (https://speed.measurementlab.net/assets/js/ndt-browser-client.js:483:11)
```

The speed.measurementlab.net site is here:

https://github.com/m-lab/mlab-speedtest

@pboothe Thanks for reporting this. I replicated this issue in the mlab-speedtest repo. Closing here.


Use 'p' with mkdir

Ref: https://github.com/dojoteef/neomake-autolint/issues/6#issuecomment-265334603

@blueyed I actually specifically decided not to use 'p' so as not to have the plugin create an unexpected directory for users. If they have something misconfigured it seems like a bad idea to make a directory structure for the user. In the issue you reference it does not seem that using 'p' was the issue. Rather the expansion of '~' to mean $HOME was not working. Possibly need to include a call to expand() to fix that issue.

Ok, we do not want literal ~ directories.. :)

68e4bf7 should address the directory issue from #6.


Selective "cf push" with manifest

Hi!
We have manifest.yml with few apps. But sometimes we want to push only one app.
I know that we can split manifest.yml into few small manifests, but it's not so handful to run "cf push" on each in case if we want to push all.
Would be cool if in case of manifest push there will be switch --only=foo,bar to deploy only "foo" and "bar" apps from this manifest.
Thanks!

@bsideup That is a cool idea but goes against the core set of rules we currently have for app manifests.  Right now, you'd have to settle for having multiple manifests that specify a given app of subsets of the whole set of apps.


Look for nvm relative to slave home directory instead of master

As of 1.3.0, my builds starting failing like this:
$ bash -c "source /var/lib/jenkins/.nvm/nvm.sh && NVM_NODEJS_ORG_MIRROR=https://nodejs.org/dist nvm install v7.8.0 && nvm use v7.8.0 && export > nvm.env"
bash: /var/lib/jenkins/.nvm/nvm.sh: No such file or directory

My master home directory is /var/lib/jenkins, but my slave home directory is /home/jenkins.

With this commit, the new behavior is to conditionally source the first nvm.sh found on the target node:
$ bash -c "{ [ -f ~/.nvm/nvm.sh ] && source ~/.nvm/nvm.sh; } || { [ -f /usr/local/nvm/nvm.sh ] && source /usr/local/nvm/nvm.sh; } && NVM_NODEJS_ORG_MIRROR=https://nodejs.org/dist nvm install v7.8.0 && nvm use v7.8.0 && export > nvm.env"
v7.8.0 is already installed.
Now using node v7.8.0 (npm v4.2.0)

Nice.  This will solve https://issues.jenkins-ci.org/browse/JENKINS-45784


Consecutive presses of back button on  screen cause a transition to  blank screen

Describe the bug
When I consective presses back button repeatedly on the following screen, transition to blank screen.

Screenshots

SearchScreen
TimetableItemDetailScreen
StaffScreen
SponsorsScreen

Related issue
https://github.com/DroidKaigi/conference-app-2023/issues/468
This issue has been corrected as follows
https://github.com/DroidKaigi/conference-app-2023/blob/99a14d95be8c98e7190862115e39935491928c1f/feature/sessions/src/main/java/io/github/droidkaigi/confsched2023/sessions/component/BookmarkTopArea.kt#L128-L134

Thanks for this issue! Maybe we have to create a utility method for it.

I wanna try ! :raised_hand_with_fingers_splayed:

Thanks as always!


update for more images in webp

fixed blog images ($sArticle.media.thumbnails to $sArticle.preview.thumbnails)
added ajax_add_article.tpl
added checkout/ajax_add_article.tpl
added compare/col.tpl
added frontend/detail/config_variant.tpl
added frontend/listing/product-box/box-big-image.tpl
added frontend/listing/product-box/box-eomtion.tpl

hey shyim, i fixed the indention.

Thanks :blue_heart:


Question about log output.

Running Blackbird in demo mode, I have this log output:

[ 06/01/2016 08:44:24 ]
Bitfinex: 	531.04 / 531.10
OKCoin: 	534.82 / 535.45
Bitstamp: 	530.94 / 531.26
Gemini: 	531.12 / 532.02
Kraken: 	529.43 / 530.00
ItBit: 	532.27 / 532.31
BTC-e: 	519.07 / 517.32
796.com: 	546.17 / 550.60
Poloniex: 	524.00 / 527.39

Bitfinex/Poloniex:	-1.34% [target  0.10%, min -1.46%, max  0.45%]
OKCoin/Bitfinex:	-0.82% [target  0.10%, min -0.85%, max  0.75%]
OKCoin/Poloniex:	-2.14% [target  0.10%, min -2.16%, max  0.88%]
Bitstamp/Bitfinex:	-0.04% [target  0.10%, min -0.68%, max  0.76%]
Bitstamp/Poloniex:	-1.37% [target  0.10%, min -1.50%, max  0.29%]
Gemini/Bitfinex:	-0.18% [target  0.10%, min -0.71%, max  0.55%]
Gemini/Poloniex:	-1.51% [target  0.10%, min -1.58%, max  0.42%]
Kraken/Bitfinex:	 0.20% [target  0.10%, min -0.86%, max  1.20%]   trailing  0.10%  0/2
Kraken/Poloniex:	-1.13% [target  0.10%, min -1.58%, max  0.87%]
ItBit/Bitfinex:	-0.24% [target  0.10%, min -0.82%, max  0.74%]
ItBit/Poloniex:	-1.56% [target  0.10%, min -1.79%, max  0.45%]
BTC-e/Bitfinex:	 2.65% [target  0.10%, min  0.00%, max  3.82%]
BTC-e/Poloniex:	 1.29% [target  0.10%, min  0.00%, max  2.51%]
796.com/Bitfinex:	-3.55% [target  0.10%, min -4.73%, max -2.84%]
796.com/Poloniex:	-4.83% [target  0.10%, min -5.49%, max -2.93%]
Poloniex/Bitfinex:	 0.69% [target  0.10%, min -0.86%, max  1.02%]
WARNING: 8 second(s) too late at 06/01/2016 08:44:27`
How would I know if there was a possible successful trade?
Would the csv output file actually be written to with demo data of trades that could have occurred?
What does the warning mean??
Bonus question: Which section of the code do I need to edit in order to only use certain exchanges?
I can't find anything to configure in the .conf?

How would I know if there was a possible successful trade?

If a potential trade opportunity comes up, you will see the following line in the log file:
INFO: Opportunity found but no trade will be generated (Demo mode)

Would the csv output file actually be written to with demo data of trades that could have occurred?

No, in Demo mode nothing is written in the csv file.

What does the warning mean ("WARNING: 8 second(s) too late at 06/01/2016 08:44:27")?

It means that your system took too long to complete the iteration (the analysis loop) in the time lapse defined by the parameter GapSec. You can increase that parameters (e.g. GapSec=15.0) to make the warnings disappear. The only drawback is that you might miss arbitrage opportunities because the analysis will occur every 15 seconds instead of every 3 seconds.

Which section of the code do I need to edit in order to only use certain exchanges?

In Demo mode, all the exchanges for which we have the bid/ask information are displayed. In real trading, only the exchanges for which you put credentials in the config file will be automatically used.

Thank you for your response.
With regards to the GapSec, why might my system be taking so long, how can I improve the analysis loop speed?

Usually it's due to the network latency when the quotes are downloaded


Doesn't work

Whenever i try to put my discord token in, it says the syntax is wrong

Hello @jangodev,
Which software are you referring to? :D


glib: 2.58.1 -> 2.58.2

Semi-automatic update generated by https://github.com/ryantm/nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/glib/versions.
meta.description for glib is: '"C library of programming buildings blocks"'.

Checks done (click to expand)

built on NixOS
Warning: no invocation of /nix/store/18xqarg1cc542485y6k7l7hci4bjimcm-glib-2.58.2-bin/bin/gio-launch-desktop had a zero exit code or showed the expected version
/nix/store/18xqarg1cc542485y6k7l7hci4bjimcm-glib-2.58.2-bin/bin/gapplication passed the binary check.
/nix/store/18xqarg1cc542485y6k7l7hci4bjimcm-glib-2.58.2-bin/bin/gdbus passed the binary check.
/nix/store/18xqarg1cc542485y6k7l7hci4bjimcm-glib-2.58.2-bin/bin/gio passed the binary check.
/nix/store/18xqarg1cc542485y6k7l7hci4bjimcm-glib-2.58.2-bin/bin/gsettings passed the binary check.
4 of 5 passed binary check by having a zero exit code.
3 of 5 passed binary check by having the new version present in output.
found 2.58.2 with grep in /nix/store/18xqarg1cc542485y6k7l7hci4bjimcm-glib-2.58.2-bin
directory tree listing: https://gist.github.com/70c3bc1559860ad3d72d33df166f45c9
du listing: https://gist.github.com/fe711ece4df75e8ff6507925c84ddb93

Rebuild report (if merged into master) (click to expand)

21389 total rebuild path(s)
7538 package rebuild(s)
7524 x86_64-linux rebuild(s)
6478 i686-linux rebuild(s)
1343 x86_64-darwin rebuild(s)
6044 aarch64-linux rebuild(s)
First fifty rebuilds by attrpath
AgdaSheaves
AgdaStdlib
DisnixWebService
EmptyEpsilon
MMA
R
SDL
SDL2
SDL2_gfx
SDL2_image
SDL2_mixer
SDL2_net
SDL2_ttf
SDL_gfx
SDL_image
SDL_mixer
SDL_net
SDL_sound
SDL_stretch
SDL_ttf
TotalParserCombinators
_20kly
_90secondportraits
a2jmidid
aacskeys
abcde
abcl
abcm2ps
abiword
abootimg
accountsservice
acgtk
acoustidFingerprinter
acsccid
adapta-gtk-theme
adobe-reader
adom
adoptopenjdk-bin
adoptopenjdk-hotspot-bin-11
adoptopenjdk-jre-bin
adoptopenjdk-jre-hotspot-bin-11
adoptopenjdk-jre-openj9-bin-11
adoptopenjdk-openj9-bin-11
adwaita-qt
aegisub
aeolus
aesop
afew
afl
afterstep

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/18xqarg1cc542485y6k7l7hci4bjimcm-glib-2.58.2-bin \
  --option binary-caches 'https://cache.nixos.org/ https://r-ryantm.cachix.org/' \
  --option trusted-public-keys '
  r-ryantm.cachix.org-1:gkUbLkouDAyvBdpBX0JOdIiD2/DP1ldF3Z3Y6Gqcc4c=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(r-ryantm's Cachix cache is only trusted for this store-path realization.)
Or, build yourself:
nix-build -A glib https://github.com/r-ryantm/nixpkgs/archive/e8a470867ae66debbdb557c2b37f9d88acd4c495.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/18xqarg1cc542485y6k7l7hci4bjimcm-glib-2.58.2-bin
ls -la /nix/store/18xqarg1cc542485y6k7l7hci4bjimcm-glib-2.58.2-bin/bin

cc @lovek323 @7c6f434c for testing.

Duplicate of #52539


Extend manufactured solution to del2 and del4

This PR adds manufactured solution tests for del2 and del4 and renames the existing case to default. Both del2 and del4 tests depend on the corresponding source terms being added to the model. These terms are added to MPAS-Ocean here https://github.com/E3SM-Ocean-Discussion/E3SM/pull/110. All tests depend on https://github.com/E3SM-Ocean-Discussion/E3SM/pull/55 to achieve expected convergence.
Checklist

[X] User's Guide has been updated
[X] Documentation has been built locally and changes look as expected
[X] Testing comment in the PR documents testing used to verify the changes
[X] New tests have been added to a test suite

Testing
MPAS-Ocean tests have been run.
Default convergence:

Del2 convergence:

Omega tests have been set-up and namelist file examined to ensure it has the appropriate settings.

I'm not working much tomorrow but I can try to test this out.  I agree that it would be good to get it in first without worrying about Omega, and then rework it for Omega support.

Just a note that this needs https://github.com/E3SM-Project/E3SM/pull/6862 and and update to the E3SM-Project submodule.


Refactor inspec and yaml files

refactor(inspec): use os:family simplification for config_spec
refactor(yaml): sort default and config alphabetically
refactor(yaml): move shared values to defaults.yaml

@n-rodriguez Follows on from #4 as discussed in the last comment there.
My main concern is about the alphabetical sort that's been applied.  Perhaps some of the previous ordering needs to be maintained, such as for the paths?  Please let me know if there are any issues.

@n-rodriguez Thanks for the review.  Fixed the quotes, so the only thing left is if there are any issues with the changes to alphabetic ordering.

if there are any issues with the changes to alphabetic ordering.

I don't know if it's really an issue... rkhunter is basically a shell script that do some checks with the help of Perl. The /etc/rkhunter.conf file is loaded at runtime.

@n-rodriguez Thanks for the approval.  Do you mind merging this?

:tada: This PR is included in version 0.1.3 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Is Indy strictly required?

I was reworking some integration tests for the resolver plugins today and ran into the following error when the indy extra of ACA-Py was not installed and python3-indy wasn't already installed in the environment:
Traceback (most recent call last):
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/__main__.py", line 74, in <module>
    main(sys.argv)
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/__main__.py", line 71, in main
    run(args)
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/__main__.py", line 64, in run
    run_command(command, args)
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/commands/__init__.py", line 36, in run_command
    module = load_command(command) or load_command("help")
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/commands/__init__.py", line 31, in load_command
    return import_module(module_path)
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/commands/start.py", line 16, in <module>
    from ..core.conductor import Conductor
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/core/conductor.py", line 17, in <module>
    from ..config.default_context import ContextBuilder
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/config/default_context.py", line 16, in <module>
    from ..ledger.indy import IndySdkLedgerPool, IndySdkLedgerPoolProvider
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/aries_cloudagent/ledger/indy.py", line 14, in <module>
    import indy.ledger
ModuleNotFoundError: No module named 'indy'

To reproduce, you can use the following Dockerfile:
FROM bcgovimages/von-image:py36-1.15-1

RUN pip install aries-cloudagent
RUN yes | pip uninstall python3-indy

ENTRYPOINT ["/bin/bash", "-c", "aca-py \"$@\"", "--"]

I then built and ran the container with:
$ docker build -t acapy-test .
$ docker run --rm -it acapy-test start -it http <IP_ADDRESS> 3000 -ot http -e http://localhost:3000 --no-ledger

We don't intend Indy to be strictly required, do we?

@TimoGlastra it looks like the offending line might have been introduced with multi-tenancy changes in December

"indy" is an "extra". I think you need to install something like pip install aries-cloudagent[indy, bbs]

Yep, I'm aware, and am taking that approach in my integration tests as a workaround. My question is: is something really an "extra" if it doesn't work without installing the extra? Or in other words, shouldn't this work without installing the indy and bbs extras?


Boomerang zombie processes getting created on userspace reboot

After each reboot userspace, using Cocoatop reveals an additional Boomerang process, which seems to result in extra memory usage

that shouldn't happen, can you show a screenshot?

Can confirm this is also happening on iPhone 14, iOS 16.1

Also can confirm this issue. Just rebooted userspace twice and sure enough

that shouldn't happen, can you show a screenshot?

iphone7 plus 15.8.1
Dopamine2.0.5

Just tested, and each time the user space is restarted, an additional one is added.

Same, 15.1.1 12 Pro

I think I fixed it, test latest nightly build:
https://nightly.link/opa334/Dopamine/actions/runs/7978865650/Dopamine.zip
(rejailbreak with it and then do a few userspace reboots)

Can confirm Its fixed

I think I fixed it, test latest nightly build:
https://nightly.link/opa334/Dopamine/actions/runs/7978865650/Dopamine.zip
(rejailbreak with it and then do a few userspace reboots)

Fixed


Use Apple Script + Bash

In the current version, WebCatalog uses a bash script as its main executable. It works well but it doesn't integrate well with the system (such as Choosy.app). With this PR, apps installed from WebCatalog can now open URLs so you can use it together with Choosy and similar apps.

#44


DBZ-7018 Allow SQL statements greater than 40kb

https://issues.redhat.com/browse/DBZ-7018
Description
In some corner cases, users may have unusually large SQL statements that need to be buffered due to the number of columns paired with the data in those columns. Previously we capped this to 4000*10 or 40kb primarily to address situations with LOB operations that could lead to OOM scenarios. The new code rather logs a warning when exceeding 100kb and hard faults ony when the connector sees Integer.MAX_VALUE number of SQL lines for a single SQL buffer.

/packit test --labels oracle

/packit test --labels oracle

/packit test --labels oracle

@Naros we found the issue, it was a bit funny, but we hope the issue is resolved

nice and green :green_heart:

Thanks for the help @thrix

Applied to main (=2.5) and backported to branches 2.4 and 2.3.


Windows 2019 Sysprep forever

Trying to build a 2019 image from win19/20200524.1, Modified for bug #940
Build goes to it;s last step, runs Sysprep than continues to log

IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE

every ten seconds.  For the last 11 hours.
We also tried to go back to the previous release ( not tagged as pre-release) win19/20200517.1.  This release also does not build due to bug #898 .
Virtual environments affected

[ ] macOS 10.15
[ ] Ubuntu 16.04 LTS
[ ] Ubuntu 18.04 LTS
[ ] Windows Server 2016 R2
[x ] Windows Server 2019

Expected behavior
Packer build to complete with a viable VM image
Actual behavior
The Windows2019 packer template was adjusted to remove the Install-IEWebDriver and Validate-SeleniumWebDrivers steps, then run.  This is executed from cloud-init on a temporary build box.
log from serial console
[17042.562839] cloud-init[2079]: ==> vhd: Provisioning with Powershell...
[17042.570186] cloud-init[2079]: ==> vhd: Provisioning with powershell script: /tmp/powershell-provisioner037029381
[17042.570784] cloud-init[2079]:     vhd: IMAGE_STATE_COMPLETE
[17042.573014] cloud-init[2079]:     vhd: IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE
[17044.073317] cloud-init[2079]:     vhd: IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE
.
.
.
[56831.770690] cloud-init[2079]:     vhd: IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE
[56841.785452] cloud-init[2079]:     vhd: IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE
I have validated that the sysprep command contains the /generalize switch, that block hasn't been touched by any processing.

Hello @davemedvitz,
I found several similar issues:
https://github.com/hashicorp/packer/issues/8428
https://github.com/hashicorp/packer/issues/8929
We are able to build the image without any issue, it looks like temporary issue with Azure Services. Which version of the packer did you for the build? Could you please try to build the image with packer version 1.5.6?
We are looking forward to your reply.

I am on 1.5.5  Will update, rerun, and report
Thank you
Dave

Reran using packer 1.5.6 with the same results.
Having read the packer issues you mentioned, I've added boot diagnostics to the packer config and am running again, with the intent of determining if sysprep is hung, or if , as one of the suggestions indicated, if a reboot was pending, or something else.
Dave

@davemedvitz we have a similar issue with some tips that can be useful for you as well
https://github.com/actions/virtual-environments/issues/507

@Darleev I am on 1.5.5, I am experiencing the same intermittent issue reported by @davemedvitz.
Let's say 20% to 30% of my Windows Server 2019 builds are wasted because of the dreaded
IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE issue.
I have mitigated it through a couple of restart before the sysprep.
It is a pity, because otherwise the specific build wouldn't be flacky at all.

 Closing the tickets too early is not really going to make disappear the issues ..

@davemedvitz your ticket prompted me to look at my huge collection of build logs related to this issue, and I may have spotted something. I have put a "choco list -li" before the last restart before the sysprep, and when I get the dreaded issue, it is reporting 1 application more:
Microsoft Monitoring Agent|10.20.18038.0
I think those subscriptions are actually configured to push that to VMs via a VM extension. I wonder if I should put 2 reboots before the generalisation, or perhaps trying to find a way to exclude the resource group where packer is generating the VM from being pushed those extensions (there may be other ones ..).

@davemedvitz  2 extensions got pushed during a build I started after reading your ticket, I can see both in the resource group, and in the activity log blade (look for "'deployIfNotExists' Policy action" items). Now, this time these extension were pushed pretty early (there are still a couple of reboot to go before reaching sysprep), finger crossed .. this is what I see in the extension blade of the VM packer is building:
AzurePolicyforWindows Microsoft.GuestConfiguration.ConfigurationforWindows 1.* Provisioning succeeded MicrosoftMonitoringAgent Microsoft.EnterpriseCloud.Monitoring.MicrosoftMonitoringAgent 1.* Provisioning succeeded

Failed .. looking at C:\windows\System32\Sysprep\Panther\setuperr.log, I can read:
2020-05-30 23:52:38, Error      [0x0f0082] SYSPRP LaunchDll:Failure occurred while executing 'DscCore.dll,SysPrep_Cleanup', returned error code 0x2 2020-05-30 23:52:38, Error      [0x0f0070] SYSPRP RunExternalDlls:An error occurred while running registry sysprep DLLs, halting sysprep execution. dwRet = 0x2[gle=0x00000006] 2020-05-30 23:52:38, Error      [0x0f00ae] SYSPRP WinMain:Hit failure while processing sysprep cleanup external providers; hr = 0x80070002[gle=0x00000006]

@davemedvitz my last provisioner is currently looking like this (I haven't yet looked into the removal of the Defender Windows feature ..):
{
	"type": "powershell",
	"inline": [
		"if (((Get-Item -LiteralPath 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration' -ErrorAction SilentlyContinue).PSObject.Properties -ne $null) -and ((Get-ItemProperty 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration').PSObject.Properties.Name -contains 'AgentId')) {Set-ItemProperty -path 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration' -Name 'AgentId' -value ''}",
		"if((Get-Service | ? Name -eq RdAgent).count -gt 0) {while ((Get-Service RdAgent).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if((Get-Service | ? Name -eq WindowsAzureTelemetryService).count -gt 0) {while ((Get-Service WindowsAzureTelemetryService).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if((Get-Service | ? Name -eq WindowsAzureGuestAgent).count -gt 0) {while ((Get-Service WindowsAzureGuestAgent).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if( Test-Path $Env:SystemRoot\\System32\\Sysprep\\unattend.xml ){ rm $Env:SystemRoot\\System32\\Sysprep\\unattend.xml -Force}",
		"& $env:SystemRoot\\System32\\Sysprep\\Sysprep.exe /oobe /generalize /quiet /quit /mode:vm",
		"$attempts=0; while($true) { if ($attempts -gt 10) {break}; $imageState = Get-ItemProperty HKLM:\\SOFTWARE\\Microsoft\\Windows\\CurrentVersion\\Setup\\State | Select ImageState; if($imageState.ImageState -ne 'IMAGE_STATE_GENERALIZE_RESEAL_TO_OOBE') { Write-Output $imageState.ImageState; if($imageState.ImageState -eq 'IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE'){$attempts++}; Start-Sleep -s 10  } else { Write-Output $imageState.ImageState; break } }"            ]
}

caveat: this is a work in progress!
E.g. note that if the last while breaks because $attempts is greater than 10, the resulting image is not generalised. I am wondering if failing the build, or attempt to rearm after a reboot.
For the Hashibot masters: my view is that the above deserves its own Packer provisioner. It's nonsense that thousands of Packer user must figure out among themselves how to do that again and again. Microsoft is your partner, sit down or have a call with them, and get us a provisioner to generalize our images.

@davemedvitz I will try to re-arm after uninstalling Defender, without a reboot, something like this (perhaps better to target $env:ProgramData for the rearm.do file):
{
	"type": "powershell",
	"inline": [
		"if (((Get-Item -LiteralPath 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration' -ErrorAction SilentlyContinue).PSObject.Properties -ne $null) -and ((Get-ItemProperty 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration').PSObject.Properties.Name -contains 'AgentId')) {Set-ItemProperty -path 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration' -Name 'AgentId' -value ''}",
		"if((Get-Service | ? Name -eq RdAgent).count -gt 0) {while ((Get-Service RdAgent).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if((Get-Service | ? Name -eq WindowsAzureTelemetryService).count -gt 0) {while ((Get-Service WindowsAzureTelemetryService).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if((Get-Service | ? Name -eq WindowsAzureGuestAgent).count -gt 0) {while ((Get-Service WindowsAzureGuestAgent).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if( Test-Path $Env:SystemRoot\\System32\\Sysprep\\unattend.xml ){ rm $Env:SystemRoot\\System32\\Sysprep\\unattend.xml -Force}",
		"& $env:SystemRoot\\System32\\Sysprep\\Sysprep.exe /oobe /generalize /quiet /quit /mode:vm",
		"$attempts=0; while($true) { if ($attempts -gt 10) {Uninstall-WindowsFeature Windows-Defender-Features;New-Item -Path 'C:\\Install' -Name rearm.do -ItemType File -Force; break}; $imageState = Get-ItemProperty HKLM:\\SOFTWARE\\Microsoft\\Windows\\CurrentVersion\\Setup\\State | Select ImageState; if($imageState.ImageState -ne 'IMAGE_STATE_GENERALIZE_RESEAL_TO_OOBE') { Write-Output $imageState.ImageState; if($imageState.ImageState -eq 'IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE'){$attempts++}; Start-Sleep -s 10  } else { Write-Output $imageState.ImageState; break } }",
		"if(Test-Path 'C:\\Install\rearm.do' -PathType Leaf){& $env:SystemRoot\\System32\\Sysprep\\Sysprep.exe /oobe /generalize /quiet /quit /mode:vm}",
		"if(Test-Path 'C:\\Install\rearm.do' -PathType Leaf){$attempts=0; while($true) { if ($attempts -gt 10) {break}; $imageState = Get-ItemProperty HKLM:\\SOFTWARE\\Microsoft\\Windows\\CurrentVersion\\Setup\\State | Select ImageState; if($imageState.ImageState -ne 'IMAGE_STATE_GENERALIZE_RESEAL_TO_OOBE') { Write-Output $imageState.ImageState; if($imageState.ImageState -eq 'IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE'){$attempts++}; Start-Sleep -s 10  } else { Write-Output $imageState.ImageState; break }}}"
	],
	"pause_before": "1m"
}

Failing the above, I will try to figure out how to move the second re-arm after a shutdown (I used a file as flag for that), but I have to make the reboot and the provisioner conditional (e.g. if the first generalisation worked fine).
Please note that AFAIK an image can be rearmed only thrice (and I think Microsoft may have fired already the first shot, as I am using one of the marketplace image as baseline).

@davemedvitz I have configured packer to perform its builds on a specific resource group (I gave it contributor rights only to 2 resources groups, the one for the builds and the one for the images).
I have also updated the policy, excluding the resource group for the builds. The policy name is something like "Enable Monitoring in Azure Security Center".

@davemedvitz at the end, it seems that excluding the resource group from the policy assignment did the deed.
To recap: I have 2 resource groups in a subscription where Packer is authorised at contributor level, let's call them Build and Image.
Packer builds in the Build resource group, and then store the images in the Image resource group (from there, I then add them to a shared images gallery, but it is not significant for the issue at hand).
I have excluded the Build resource group from the following policies:
"Deploy prerequisites to enable Guest Configuration Policy on Windows VMs."
"$SubscriptionName: Enable Monitoring in Azure Security Center."
This seem to have solved the issue in my scenario (so it was likely some sort of interaction between Windows Defender and the Monitoring Agent).
I stand by my previous statement to the Hashibot masters, that my generalising script, albeit improvable, is better than the one they show on their documentation (let alone Microsoft documentation, stating the the rearming may end in a infinite loop, apparently how to write while($true) exit conditions is a lost art those days).
Here is a version with an hardcoded C:\ProgramData for the flag file (this can be done in a million better ways ..):
{
	"type": "powershell",
	"inline": [
		"if (((Get-Item -LiteralPath 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration' -ErrorAction SilentlyContinue).PSObject.Properties -ne $null) -and ((Get-ItemProperty 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration').PSObject.Properties.Name -contains 'AgentId')) {Set-ItemProperty -path 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration' -Name 'AgentId' -value ''}",
		"if((Get-Service | ? Name -eq RdAgent).count -gt 0) {while ((Get-Service RdAgent).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if((Get-Service | ? Name -eq WindowsAzureTelemetryService).count -gt 0) {while ((Get-Service WindowsAzureTelemetryService).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if((Get-Service | ? Name -eq WindowsAzureGuestAgent).count -gt 0) {while ((Get-Service WindowsAzureGuestAgent).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if( Test-Path $Env:SystemRoot\\System32\\Sysprep\\unattend.xml ){ rm $Env:SystemRoot\\System32\\Sysprep\\unattend.xml -Force}",
		"& $env:SystemRoot\\System32\\Sysprep\\Sysprep.exe /oobe /generalize /quiet /quit /mode:vm",
		"$attempts=0; while($true) { if ($attempts -gt 10) {Uninstall-WindowsFeature -Name Windows-Defender;New-Item -Path 'C:\\ProgramData' -Name rearm.do -ItemType File -Force; break}; $imageState = Get-ItemProperty HKLM:\\SOFTWARE\\Microsoft\\Windows\\CurrentVersion\\Setup\\State | Select ImageState; if($imageState.ImageState -ne 'IMAGE_STATE_GENERALIZE_RESEAL_TO_OOBE') { Write-Output $imageState.ImageState; if($imageState.ImageState -eq 'IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE'){$attempts++}; Start-Sleep -s 10  } else { Write-Output $imageState.ImageState; break } }",
		"if(Test-Path 'C:\\ProgramData\\rearm.do' -PathType Leaf){& $env:SystemRoot\\System32\\Sysprep\\Sysprep.exe /oobe /generalize /quiet /quit /mode:vm}",
		"if(Test-Path 'C:\\ProgramData\\rearm.do' -PathType Leaf){$attempts=0; while($true) { if ($attempts -gt 10) {break}; $imageState = Get-ItemProperty HKLM:\\SOFTWARE\\Microsoft\\Windows\\CurrentVersion\\Setup\\State | Select ImageState; if($imageState.ImageState -ne 'IMAGE_STATE_GENERALIZE_RESEAL_TO_OOBE') { Write-Output $imageState.ImageState; if($imageState.ImageState -eq 'IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE'){$attempts++}; Start-Sleep -s 10  } else { Write-Output $imageState.ImageState; break }}}"
	],
	"pause_before": "1m"
}

And this an untested (not for long) version for Windows 10:
{
	"type": "powershell",
	"inline": [
		"if (((Get-Item -LiteralPath 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration' -ErrorAction SilentlyContinue).PSObject.Properties -ne $null) -and ((Get-ItemProperty 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration').PSObject.Properties.Name -contains 'AgentId')) {Set-ItemProperty -path 'HKLM:\\SOFTWARE\\Microsoft\\DesiredStateConfiguration' -Name 'AgentId' -value ''}",
		"if((Get-Service | ? Name -eq RdAgent).count -gt 0) {while ((Get-Service RdAgent).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if((Get-Service | ? Name -eq WindowsAzureTelemetryService).count -gt 0) {while ((Get-Service WindowsAzureTelemetryService).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if((Get-Service | ? Name -eq WindowsAzureGuestAgent).count -gt 0) {while ((Get-Service WindowsAzureGuestAgent).Status -ne 'Running') { Start-Sleep -s 5 }}",
		"if( Test-Path $Env:SystemRoot\\System32\\Sysprep\\unattend.xml ){ rm $Env:SystemRoot\\System32\\Sysprep\\unattend.xml -Force}",
		"& $env:SystemRoot\\System32\\Sysprep\\Sysprep.exe /oobe /generalize /quiet /quit /mode:vm",
		"$attempts=0; while($true) { if ($attempts -gt 10) {Disable-WindowsOptionalFeature -Online -NoRestart -FeatureName Windows-Defender-ApplicationGuard;Disable-WindowsOptionalFeature -Online -NoRestart -FeatureName Windows-Defender-Default-Definitions;New-Item -Path 'C:\\Install' -Name rearm.do -ItemType File -Force; break}; $imageState = Get-ItemProperty HKLM:\\SOFTWARE\\Microsoft\\Windows\\CurrentVersion\\Setup\\State | Select ImageState; if($imageState.ImageState -ne 'IMAGE_STATE_GENERALIZE_RESEAL_TO_OOBE') { Write-Output $imageState.ImageState; if($imageState.ImageState -eq 'IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE'){$attempts++}; Start-Sleep -s 10  } else { Write-Output $imageState.ImageState; break } }",
		"if(Test-Path 'C:\\Install\\rearm.do' -PathType Leaf){& $env:SystemRoot\\System32\\Sysprep\\Sysprep.exe /oobe /generalize /quiet /quit /mode:vm}",
		"if(Test-Path 'C:\\Install\\rearm.do' -PathType Leaf){$attempts=0; while($true) { if ($attempts -gt 10) {break}; $imageState = Get-ItemProperty HKLM:\\SOFTWARE\\Microsoft\\Windows\\CurrentVersion\\Setup\\State | Select ImageState; if($imageState.ImageState -ne 'IMAGE_STATE_GENERALIZE_RESEAL_TO_OOBE') { Write-Output $imageState.ImageState; if($imageState.ImageState -eq 'IMAGE_STATE_SPECIALIZE_RESEAL_TO_OOBE'){$attempts++}; Start-Sleep -s 10  } else { Write-Output $imageState.ImageState; break }}}"
	],
	"pause_before": "1m"
}

Last but not least, the above provisioners should really be in script, not inline (and ideally, tested). And again, even better, we should have a specialised provisioner provided by HashiCorp & Microsoft for the generalisation of Windows and Linux.

@aledeniz @davemedvitz thank you for the meaningful reply and the investigation details. Unfortunately, we are not able to reproduce the issue on our side. Everything works fine in our internal scripts. We use the following script to generate the image on Azure side. Below an example of how to start the script:
GenerateResourcesAndImage -SubscriptionId ******* -ResourceGroupName "ResourceGroupTest -ImageGenerationRepositoryRoot "C:\RepositoryRoot" -ImageType Windows2019 -AzureLocation "East US" -GithubFeedToken *****************
Please note that you should have owner or contributor role on subscription to perform the script without any issues.
Could you please try to use it, for image generation purposes?
Also, We don't manage packer provisioners and use them as users so unfortunately, we can't help to diagnose this issue deeper

@aledeniz @davemedvitz I'm going to close the issue until further clarifications from your side. In case of any questions, feel free to contact us.

Recognizing this was closed, and I apologize for not providing this update earlier, as I had a priority task come up.
We did, partially, identify this issue.  We had begun applying security policies via Azure Policy.  In particular, the ASC Default, and the NIST 800-53 R4 initiatives.  These were applying to the windows machine during the build.  Once we excluded this initiatives from the Resource Group where the build was being performed, we no longer had this issue.
I appreciate the time that was spent on this issue, and hope this info can be of use to others.
-Dave

@davemedvitz Hello,
Thank you for the provided solution and investigation details. In case of any questions, feel free to contact us, we will be glad to assist you.

I stumbled upon this issue as well. Removing the: "Deploy prerequisites to enable Guest Configuration Policy on Windows VMs."
"$SubscriptionName: Enable Monitoring in Azure Security Center." policies (or configuring an exclusion for these policies) as mentioned by @aledeniz seems to resolve the issue.


Initial layout is not honoured when coupling_map is present

Informations

Qiskit Terra version: 0.8.0
Python version: 3.6.6
Operating system: OSX

What is the current behavior?
When coupling_map is present in transpile it overwrites initial_layout.
Steps to reproduce the problem
Transpile a circuit with both a coupling_map and initial_layout
What is the expected behavior?
initial_layout should be honoured if coupling_map is present.
Suggested solutions
https://github.com/Qiskit/qiskit-terra/blob/1a9229d51c98253e4875b54a522d80c52aa404ce/qiskit/transpiler/_transpiler.py#L104-L119
Should be modified to
if coupling_map and initial_layout is None:

I won't be able to work on this until next Monday. If someone wants to pick it up between now and then that'd be great.


Allow bools in scan init

hmm, looks like I am a bit undecided. since there were tests that check that some operations are not allowed on bools and since using these is most likely a user mistake, I implemented no change in behavior, but introduced a new category is_number.


[Issue] Error on azd pipeline config : no git remotes found

[ x] Make sure you've installed the latest version using instructions in the wiki

Output from azd version
Run azd version and copy and paste the output here:
Output from az version
Run az version and copy and paste the output here (minimum required version is 2.38.0):
azd version 0.1.0-beta.5 (commit 7bd25dd6f1b1899abf63b5f6f36d268a465183e4)
Describe the bug
Cannot set up GHA via azd pipeline config

To Reproduce

Run azd up --template Azure-Samples/todo-python-mongo-swa-func
Run azd pipeline config

Environment
Information on your environment:
WSL2 + Ubuntu 20.04

u.u
Using the just-created repository seems to be broken now :(
As a workaround, you can run azd pipeline config again and choose Select an existing GitHub project:

You will see the GitHub repo that was created before and you can choose it. (this is just a workaround)
This is fixed in: https://github.com/Azure/azure-dev/pull/561

It was actually fixed by: https://github.com/Azure/azure-dev/pull/560
There was a variable shadowing here: https://github.com/Azure/azure-dev/pull/560/files#diff-def994bbb17a2ca16c183eddc615854764c1a21e0e090970249780637dca1e3bR338

Thanks for investigating! Do we have any tests that cover azd pipeline config? Could we set something up to catch a regression like this?

Thanks for investigating! Do we have any tests that cover azd pipeline config? Could we set something up to catch a regression like this?

We have a few unit tests. We need to think and design some strategy for doing functional test for it

Makes sense - do we have an issue tracking this investigation?

We do now: https://github.com/Azure/azure-dev/issues/624


Bitcoin Donation

I have Bitcoins and want to donate, let me.

https://github.com/SublimeLinter/SublimeLinter3/commit/6f0f8216a4eb2c34f443b6408bca087f689c85a6
Thanks you!


Turbine is not aggregating cluster environment url's  with HTTPS protocol in Hystrix Dash board

Hi ,
Turbine aggregated out is not coming up in Hystrix dash board for cluster URL's starts with HTTPS protocol. Cluster URL's start with HTTP port are  good though.
we are using turbine core 1.0 jar in our turbine application .
any help would be appreciated.Thanks in advance.

This doesn't work with Turbine 2 either. I've actually tried to implement support for but I cannot get it to work. I can get SSL to work but not when it's combined with SSE (server sent events) that Turbine is using. I've tried upgrading Netty, my JDK, and also the SSE implementation (since it's Turbine 2 is currently using deprecated classes) but none if it has helped so far. This is a real limitation and it prevents us from using Turbine in production.
@benjchristensen I'd really appreciate any tips or hints on my code so far even though it doesn't work. Perhaps someone more well-rounded with Netty knows what's going on.. Should I submit a non-working pull request or are there any better options?

Turned out that my code was correct but there was also a bug in RxNetty (which I've fixed). I've created a pull request.


Getting "bash: [: too many arguments" under Bash on WSL

Hi,
Trying to use your script on bash under Windows Subsystem for Linux and getting the following error  "bash: [: too many arguments" when executing bash commands.
Thought I messed up the installation, but full clean reinstall did not help.
Any ideas what might be the cause?

im not sure whether this fix would do the trick. honestly i'm not that familiar with windows. Just  try and use the fix and reinstall. see if it works

@yedhink seems to have fixed it. Thanks for the nice prompt!


Use OkHttp instead of the native Java client

Hello!
This pull request aims to improve this client's connection and speed by using OkHttp, an open source HTTP & HTTP/2 client. I have personally been using it for a long time and can vouch for it's speed in comparison to the native java client
The changes made have only been tested to see if they work so bugs/abnormalities may persist. Feel free to make any changes you see necessary :)

I'll be merging this in later today, thank you for contributing.


Tips for improving encoding time for large vecs/hashmaps?

Hi!
I'm writing a library for Elixir which deserialises Apache Arrow, specifically the IPC streaming files using arrow2 , then returning them back to Elixir as rows. Using Rustler for this has been an amazing experience, and has taught me a lot about Rust (as a Rust beginner).
This is for a Snowflake adapter for Elixir, they return both JSON/Arrow and from my initial benchmarks when Snowflake sends Arrow it returns 2-3x faster compared to JSON.
I seem to have hit a problem when returning a large amount of strings back to Elixir, as it needs to encode each one? Maybe there is a more efficient way to return data?
Here is an example repo I have: https://github.com/joshuataylor/serde_rustler
git clone https://github.com/joshuataylor/serde_rustler
cd serde_rustler
mix deps.get
# You'll need rust, for this
MIX_ENV=bench mix run lib/benchmarks

My results across three different systems:
1/ My desktop, a 32 core threadripper 2990wx, designed for multicore not as much single threaded :)
Operating System: Linux
CPU Information: AMD Ryzen Threadripper 2990WX 32-Core Processor
Number of Available Cores: 64
Available memory: 125.75 GB
Elixir 1.13.4
Erlang 25.0

Benchmark suite executing with the following configuration:
warmup: 2 s
time: 5 s
memory time: 0 ns
reduction time: 0 ns
parallel: 1
inputs: none specified
Estimated total run time: 1.40 min

Benchmarking hashmap of size 100 with 30,000 integer items ...
Benchmarking hashmap of size 100 with 30,000 str items ...
Benchmarking hashmap of size 100 with 30,000 string items ...
Benchmarking hashmap of size 4 vec with 30,000 integer items ...
Benchmarking hashmap of size 4 vec with 30,000 string items ...
Benchmarking hashmap of size 4 with 30,000 str items ...
Benchmarking vec with 100 integer items ...
Benchmarking vec with 100 str items ...
Benchmarking vec with 100 string items ...
Benchmarking vec with 30,000 integer items ...
Benchmarking vec with 30,000 str items ...
Benchmarking vec with 30,000 string items ...

Name                                                      ips        average  deviation         median         99th %
vec with 100 integer items                          224596.04     0.00445 ms   ±272.73%     0.00437 ms     0.00526 ms
vec with 100 str items                               28490.19      0.0351 ms   ±116.05%      0.0214 ms        0.22 ms
vec with 100 string items                            22930.98      0.0436 ms    ±88.19%      0.0304 ms        0.22 ms
vec with 30,000 integer items                         3420.43        0.29 ms    ±32.16%        0.23 ms        0.44 ms
hashmap of size 4 vec with 30,000 integer items        799.12        1.25 ms    ±20.59%        1.07 ms        1.80 ms
vec with 30,000 str items                              124.86        8.01 ms    ±36.03%        7.18 ms       11.35 ms
vec with 30,000 string items                           104.46        9.57 ms    ±27.90%        8.28 ms       12.72 ms
hashmap of size 4 with 30,000 str items                 28.71       34.83 ms    ±37.95%       34.50 ms       50.27 ms
hashmap of size 4 vec with 30,000 string items          23.77       42.07 ms    ±31.14%       41.78 ms       59.60 ms
hashmap of size 100 with 30,000 integer items           16.39       61.03 ms    ±30.10%       48.28 ms       95.36 ms
hashmap of size 100 with 30,000 str items                0.79     1261.12 ms    ±35.46%     1235.97 ms     1832.85 ms
hashmap of size 100 with 30,000 string items             0.68     1480.41 ms    ±30.67%     1462.82 ms     2053.02 ms

Comparison:
vec with 100 integer items                          224596.04
vec with 100 str items                               28490.19 - 7.88x slower +0.0306 ms
vec with 100 string items                            22930.98 - 9.79x slower +0.0392 ms
vec with 30,000 integer items                         3420.43 - 65.66x slower +0.29 ms
hashmap of size 4 vec with 30,000 integer items        799.12 - 281.06x slower +1.25 ms
vec with 30,000 str items                              124.86 - 1798.79x slower +8.00 ms
vec with 30,000 string items                           104.46 - 2150.13x slower +9.57 ms
hashmap of size 4 with 30,000 str items                 28.71 - 7823.25x slower +34.83 ms
hashmap of size 4 vec with 30,000 string items          23.77 - 9448.26x slower +42.06 ms
hashmap of size 100 with 30,000 integer items           16.39 - 13706.17x slower +61.02 ms
hashmap of size 100 with 30,000 str items                0.79 - 283241.75x slower +1261.11 ms
hashmap of size 100 with 30,000 string items             0.68 - 332494.03x slower +1480.40 ms

A desktop 6 core 5600x, pretty decent single core performance.
Operating System: Linux
CPU Information: AMD Ryzen 5 5600X 6-Core Processor
Number of Available Cores: 12
Available memory: 31.26 GB
Elixir 1.13.4
Erlang 25.0

Benchmark suite executing with the following configuration:
warmup: 2 s
time: 5 s
memory time: 0 ns
reduction time: 0 ns
parallel: 1
inputs: none specified
Estimated total run time: 1.40 min

Benchmarking hashmap of size 100 with 30,000 integer items ...
Benchmarking hashmap of size 100 with 30,000 str items ...
Benchmarking hashmap of size 100 with 30,000 string items ...
Benchmarking hashmap of size 4 vec with 30,000 integer items ...
Benchmarking hashmap of size 4 vec with 30,000 string items ...
Benchmarking hashmap of size 4 with 30,000 str items ...
Benchmarking vec with 100 integer items ...
Benchmarking vec with 100 str items ...
Benchmarking vec with 100 string items ...
Benchmarking vec with 30,000 integer items ...
Benchmarking vec with 30,000 str items ...
Benchmarking vec with 30,000 string items ...

Name                                                      ips        average  deviation         median         99th %
vec with 100 integer items                          440026.49     0.00227 ms   ±527.90%     0.00152 ms     0.00333 ms
vec with 100 str items                               98311.55      0.0102 ms   ±326.28%     0.00618 ms      0.0761 ms
vec with 100 string items                            75990.35      0.0132 ms   ±234.79%     0.00901 ms      0.0677 ms
vec with 30,000 integer items                         3363.90        0.30 ms    ±30.24%        0.23 ms        0.43 ms
hashmap of size 4 vec with 30,000 integer items        943.68        1.06 ms    ±17.88%        0.93 ms        1.33 ms
vec with 30,000 str items                              205.69        4.86 ms    ±34.67%        3.99 ms        6.83 ms
vec with 30,000 string items                           158.76        6.30 ms    ±26.89%        5.57 ms        8.13 ms
hashmap of size 4 with 30,000 str items                 44.00       22.73 ms    ±40.48%       21.72 ms       32.81 ms
hashmap of size 4 vec with 30,000 string items          32.72       30.56 ms    ±29.89%       30.20 ms       40.48 ms
hashmap of size 100 with 30,000 integer items           21.64       46.21 ms    ±26.00%       37.65 ms       69.52 ms
hashmap of size 100 with 30,000 str items                1.01      990.53 ms    ±29.35%      944.34 ms     1421.41 ms
hashmap of size 100 with 30,000 string items             0.89     1128.15 ms    ±26.64%     1111.75 ms     1577.29 ms

Comparison:
vec with 100 integer items                          440026.49
vec with 100 str items                               98311.55 - 4.48x slower +0.00790 ms
vec with 100 string items                            75990.35 - 5.79x slower +0.0109 ms
vec with 30,000 integer items                         3363.90 - 130.81x slower +0.30 ms
hashmap of size 4 vec with 30,000 integer items        943.68 - 466.29x slower +1.06 ms
vec with 30,000 str items                              205.69 - 2139.25x slower +4.86 ms
vec with 30,000 string items                           158.76 - 2771.61x slower +6.30 ms
hashmap of size 4 with 30,000 str items                 44.00 - 10000.30x slower +22.72 ms
hashmap of size 4 vec with 30,000 string items          32.72 - 13446.55x slower +30.56 ms
hashmap of size 100 with 30,000 integer items           21.64 - 20335.74x slower +46.21 ms
hashmap of size 100 with 30,000 str items                1.01 - 435860.19x slower +990.53 ms
hashmap of size 100 with 30,000 string items             0.89 - 496416.95x slower +1128.15 ms

My laptop, a 2020 m1 Macbook Air:
Operating System: macOS
CPU Information: Apple M1
Number of Available Cores: 8
Available memory: 16 GB
Elixir 1.13.4
Erlang 25.0

Benchmark suite executing with the following configuration:
warmup: 2 s
time: 5 s
memory time: 0 ns
reduction time: 0 ns
parallel: 1
inputs: none specified
Estimated total run time: 1.40 min

Benchmarking hashmap of size 100 with 30,000 integer items ...
Benchmarking hashmap of size 100 with 30,000 str items ...
Benchmarking hashmap of size 100 with 30,000 string items ...
Benchmarking hashmap of size 4 vec with 30,000 integer items ...
Benchmarking hashmap of size 4 vec with 30,000 string items ...
Benchmarking hashmap of size 4 with 30,000 str items ...
Benchmarking vec with 100 integer items ...
Benchmarking vec with 100 str items ...
Benchmarking vec with 100 string items ...
Benchmarking vec with 30,000 integer items ...
Benchmarking vec with 30,000 str items ...
Benchmarking vec with 30,000 string items ...

Name                                                      ips        average  deviation         median         99th %
vec with 100 integer items                          186525.60     0.00536 ms   ±133.82%     0.00404 ms      0.0362 ms
vec with 100 str items                               51739.64      0.0193 ms   ±101.05%      0.0117 ms       0.104 ms
vec with 100 string items                            38760.47      0.0258 ms   ±136.20%      0.0144 ms       0.107 ms
vec with 30,000 integer items                         3760.79        0.27 ms    ±39.94%       0.200 ms        0.44 ms
hashmap of size 4 vec with 30,000 integer items        848.99        1.18 ms    ±26.98%        1.24 ms        1.93 ms
vec with 30,000 str items                              224.81        4.45 ms    ±37.61%        4.50 ms        7.41 ms
vec with 30,000 string items                           169.46        5.90 ms    ±27.64%        6.40 ms        8.86 ms
hashmap of size 4 with 30,000 str items                 51.07       19.58 ms    ±38.90%       19.07 ms       29.39 ms
hashmap of size 4 vec with 30,000 string items          39.17       25.53 ms    ±29.49%       25.12 ms       35.08 ms
hashmap of size 100 with 30,000 integer items           29.37       34.05 ms    ±51.80%       21.56 ms       65.53 ms
hashmap of size 100 with 30,000 str items                1.19      842.51 ms    ±49.59%      787.23 ms     1632.54 ms
hashmap of size 100 with 30,000 string items             0.93     1071.76 ms    ±44.40%      908.49 ms     1896.11 ms

Comparison:
vec with 100 integer items                          186525.60
vec with 100 str items                               51739.64 - 3.61x slower +0.0140 ms
vec with 100 string items                            38760.47 - 4.81x slower +0.0204 ms
vec with 30,000 integer items                         3760.79 - 49.60x slower +0.26 ms
hashmap of size 4 vec with 30,000 integer items        848.99 - 219.70x slower +1.17 ms
vec with 30,000 str items                              224.81 - 829.70x slower +4.44 ms
vec with 30,000 string items                           169.46 - 1100.73x slower +5.90 ms
hashmap of size 4 with 30,000 str items                 51.07 - 3652.00x slower +19.57 ms
hashmap of size 4 vec with 30,000 string items          39.17 - 4761.35x slower +25.52 ms
hashmap of size 100 with 30,000 integer items           29.37 - 6351.49x slower +34.05 ms
hashmap of size 100 with 30,000 str items                1.19 - 157150.24x slower +842.51 ms
hashmap of size 100 with 30,000 string items             0.93 - 199910.08x slower +1071.75 ms

If you have a single buffer that contains all strings, you can return that one and the positions to the extract the substrings using binary:part/2. Since this will only create a bunch of views into the one buffer, I'd guess that this would be faster.

Unfortunately it will be a mix of strings, integers, strructs, etc.
You can see an example here: https://github.com/joshuataylor/serde_examples/blob/main/native/serde_examples/src/lib.rs#L57


Upgrade to node 20

DEVOPS PULL REQUEST
Related Issue

Resolves #6844

Changes Proposed

Upgrade current version of node to 20 since it was starting to block a lot of our dependency updates

Additional Information

Previous upgrade for reference #4634

Testing

Bug bash scheduled for 04/16/2024 to smoke test app post upgrade
Bug bash findings here
Available on dev3 with SendGrid enabled

No new issues discovered during the bug bash!


Updates Steemconnect API Connection Address

Changed the SteemConnect V2 API Connection Parameters.

Sorry for answering so late...
It seems it has changed again, closing this in favor of https://github.com/guix77/wordpress-social-login/pull/2


Bring input setters on par with type getters

The goal of this PR is to bring setters on Input Annotated Objects on par with getters.
Since the introduction of Input Types in #269 setters were very simple and did not bring any Field Middleware functionality that getters have (Autowire, Security, Right, Assert etc..).
With this Update setters have their own InputFieldMiddleware system that is pretty much 1:1 to the FieldMiddleware system allowing Autowire, Security and Right annotations to work.
Assertation would need to be added separately into the respective repositories for Symfony and Laravel.
While this seems like a relatively small addition, this allows for a very potent pattern with Doctrine Entities.
I will explain this pattern in depth as a example but this PR brings many more possibilities not outlined here.
Entities can now not only have computed fields on getters but also on setters leveraging the power of Autowire to set up references for example:
#[ORM\Entity]
#[GQL\Type(default: true)]
#[GQL\Input(name: "UpdateAccountInput", update: true, default: true)]
class Account {
//...
    #[ORM\ManyToOne]
    #[ORM\JoinColumn(name: "lang_id", referencedColumnName: "lang_id", nullable: false)]
    private Language $lang;
//...
    #[GQL\Field]
    public function setLang(LanguageEnum $lang, #[GQL\Autowire] EntityManagerInterface $entityManager): void
    {
        $this->lang = $entityManager->getReference(Language::class, $lang->getValue());
    }

    #[GQL\Field]
    public function getLang(): LanguageEnum
    {
        return LanguageEnum::from($this->lang->getLangId());
    }
}

This allows for a very clean separation of ORM responsibility around the private properties and the public API using the setter and getter functions without the need to map between DTOs and Entities, there is even potential for nested graph traversing in mutations but this would need to be figured out.
Additionally using Doctrines Embeddables one can fully abstract the public data structure while still working with Doctrine Entities that can be persisted without any mapping.
Unrelated to this lib we even have a merge service that allows to persist partially hydrated Entities like this:
    #[GQL\Mutation]
    public function updateAccount(
        ID $id,
        #[GQL\UseInputType(inputType: "UpdateAccountInput!")]
        Account $account
    ): Account
    {
        $account->setID($id);
        $merged = $this->mergeService->merge($account);
        $this->entityManager->flush();
        return $merge;
    }

The as for Validation directly on setters, i will make a PR on the Symfony Validator Bridge Repo asap.
There is still documentation to be made around this feature and maybe some edge cases to be discussed.
@oojacoboo there are some commits left over from your input improvements since we initially based our branch on your.
Let me know if this needs cleanup or can be ignored.
Overall working on this PR gave us a lot of insights into how this lib is working and i already have a few more ideas on how to improve it :)
Looking forward to your feedback!

@Lappihuan I'll try to have a deeper look at this in the next few days.
I'm not a huge fan of reusing the Doctrine entities as input types, personally.  I know other people are doing this as well and I don't see why we shouldn't allow more support around this.    Adding a service as a param to your domain model setters is really not ideal.  It works, but ideally your domain would be more pure and you'd use services outside of the domain models.  Autowiring is really a nasty hack overall, even outside the domain IMO.  That said, it's already implemented and I'm not sure the cat gets put in the bag around it.  Further, my more pure preferences may not be shared by many others.
I also still think support for setters is beneficial for DTO style Input types, allowing for modifications of input data before being "set" onto DTO properties.  Of course, these modifications could be done in operation controllers before being persisted or passed to domain models.  Regardless, there are situations where it's ideal to modify via a setter in the DTO.  We've been using constructors for this purpose since the Input type resolver instantiates the DTO, passing the requisite constructor arguments, prior to hydrating the DTO properties.  It'd be cleaner to handle some of this in setters and offers a location for some custom validation as well - that's the big win.

Also, any thoughts on the Field annotation being used for input and output types? I'm a little concerned about the overall understanding on how these annotations work together with each other and the lack of clarity with their naming. In your example, you're going to get an input and output type with fields being mapped accordingly. However, to a noob, it's not inherently clear how this will happen.

This is exactly on of the edge cases. We are making the assumption that methods that start with set can only be InputFields and are filtered out for QueryFields.
While this works fine and seems to have no side effects it feels a tad bit hacky.
On the other hand i think PropertyAccessors like the one from Symfony have to make similar assumptions.
The one used in this lib does so too for example for getters:
https://github.com/thecodingmachine/graphqlite/blob/b69ba7e9d48fc91ef29504d93986bdb94d49d50a/src/Utils/PropertyAccessor.php#L27
I will check if i can reuse this.

@Lappihuan I'm wondering if we could enforce the use of the for option on the Field attribute if the definition is ambiguous.

@oojacoboo forcing for is not backwards compatible. but keep in mind, the field is not named setLang its named lang for input and output, its how getters worked since the beginning in this lib.
My concern was more with the technical implementation of it reather than the implicit separation, which should be natural to anyone familiar with graphqlite.
For a beginner, its a mather of having good docs explaining this very thing in a straight forward way.

Codecov Report

Merging #466 (1a21b83) into master (063b9b5) will decrease coverage by 1.62%.
The diff coverage is 78.74%.

@@             Coverage Diff              @@
##             master     #466      +/-   ##
============================================
- Coverage     96.36%   94.74%   -1.63%
- Complexity     1631     1772     +141
============================================
  Files           146      154       +8
  Lines          4100     4472     +372
============================================
+ Hits           3951     4237     +286
- Misses          149      235      +86

Impacted Files
Coverage Δ

src/Mappers/RecursiveTypeMapper.php
96.44% <ø> (+1.52%)
:arrow_up:

src/Middlewares/MissingMagicGetException.php
50.00% <0.00%> (-50.00%)
:arrow_down:

src/ResolveUtils.php
55.55% <0.00%> (-44.45%)
:arrow_down:

src/TypeRegistry.php
100.00% <ø> (ø)

src/Types/MutableInputObjectType.php
100.00% <ø> (ø)

src/Middlewares/MagicInputPropertyResolver.php
11.11% <11.11%> (ø)

src/Middlewares/SourceInputPropertyResolver.php
47.05% <47.05%> (ø)

src/NamingStrategy.php
97.36% <75.00%> (-2.64%)
:arrow_down:

src/InputFieldDescriptor.php
81.52% <81.52%> (ø)

src/InputField.php
83.87% <83.87%> (ø)

... and 11 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 063b9b5...1a21b83. Read the comment docs.

Could you please outline the changes and improvements here overall? It'd be nice to have a list of functionality changes.
Setters should now support everything getters do:

parameter middlewares:

Autowire
InjectUser
Any user defined parameter middlewares

field middlewares:

Security
Right
Logged
Support for Validation/Assertation is given but needs to be added to those packages
user defined field middlewares are not supported out of the box, but can easily be added by implementing the InputFieldMiddlewareInterface

inputType property is now able to overwrite the update property as described in #371
potential fix for crash with circular reference in input types #449, currently building a testcase to confirm.

@Lappihuan I've added a failing test, @group PR-466.  I came across the error while testing this PR on a rather large app.

@oojacoboo i fixed a minor issue where the inputFields property was was not initialized as empty array.
Was this the bug you are having?

@Lappihuan Yea, I guess the field annotations should be moved to the setters.  The issue is what’s being passed to the constructor isn’t correct.

@oojacoboo the field annotation is fine on properties, as long as there exists a public setter method.
I removed the exceptions from the setters and the test is not failing now.
not sure whats you see wrong with the constructor

Copied that over from another test, I wasn't able to test that it was properly failing.  Looks like it'll have to be adjusted.  We're getting the following error on our unit tests
TypeError: Foo\GraphQL\Operation\Employment\InputType\Employment::__construct(): Argument #1 ($startDate) must be of type ?Foo\Date, string given

Foo\Date is resolved with a custom root type mapper.

@oojacoboo constructor hydration proves to be challenging in the way it does not integrate with the whole middleware pattern.
The middlewares can go and wrap a field with other logic like for example Security, or any other user defined middleware. Now in those middlewares need to have access to the resolver and from those resolvers you are always supposed to get the DTO you are working with. In the case of the Security middleware you can use it to access properties on the DTO in the expression via this so if you have a secret Field on the DTO you can check it in the expression via this.secret == "Foo".
This works well in the case of setting properties directly or via setters since the DTO is already instantiated. But with Fields that are supposed be hydrated via constructor this whole system does not make sense. 🐔🥚
I feel like constructor hydration has to be a second class citizen and not support any middlewares.
I will try and come up with a implementation that determines if a field is hydrated via constructor and if so it will skip all the fancy FieldDescriptor and middleware stuff and just be used to instantiate the DTO before its passed to hydration via setters and properties.
Any toughs?

@Lappihuan I agree with skipping all the fancy business with the constructor.  Let's just get it instantiating and then we can do all the other middleware on the other fields being hydrated.  I'd be nice to check for fields being hydrated via the constructor to see if they're implementing any middleware logic, and if so, throw an exception.
There is one other option - fully constructing and hydrating the object and then post-processing all the middleware.  I suspect that this isn't worth it and would require recursively resolving all the fields in 2 passes - performance hit.

There is one other option - fully constructing and hydrating the object and then post-processing all the middleware. I suspect that this isn't worth it and would require recursively resolving all the fields in 2 passes - performance hit.

Since i already do a second pass for setters and properties this wouldn't be a big deal.
But it assumes there is a way to do so. If the constructor is the only way to hydrate it would not work as expected.
I think is should be able to throw if middleware annotations are detected for constructor hydrated fields. :+1:
Working on it right now.

@Lappihuan if you're already having to do 2 passes, using reflection, you can check which fields are being hydrated and simply re-hydrate them...  I don't love it, but it would retain functionality and I don't see any real issues with it.

@oojacoboo now i only do one pass for all constructor fields and one for setters/property fields. I detect early if the property is hydrated via constructor and if so check if middleware annotations are used if so i throw a exception explaining its not supported, else i just skip all the middleware stuff and resolve the properties for instantiation, after instantiation the new stuff kicks in. fields that are used in the constructor are pretty close to how they are handled in the lib right now.

@Lappihuan I'll give it a test again ASAP.

@oojacoboo let me know if there is something to change on the unresolved points

@Lappihuan thanks, added some more comments.  In general, if we're leaving commented out code, we should at least have a comment saying why it's there so it doesn't cause any confusion.

@Lappihuan I've merged in this PR.  Documentation wasn't completed and I'm doing that now, in addition to versioning the docs for a 6.0 release.


Basic cursor fixes

Changed Awake to Start function. Fixes Layer reacast mask to use bitwise op for calculation.

Hi @HodgsonSDAS, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by Microsoft and real humans are currently evaluating your PR.
TTYL, MSBOT;


Add unmarshal_unsafe feature

This PR adds an unmarshal_unsafe feature. When enabled, it generates a func (p *YourProto) UnmarshalVTUnsafe(data []byte) that behaves like UnmarshalVT, except it unsafely casts slices of data to bytes and string fields instead of copying them to newly allocated arrays, so that it performs less allocations. Data received from the wire has to be left untouched for the lifetime of the message, otherwise the message's bytes and string fields can be corrupted.
The PR tackles part of https://github.com/planetscale/vtprotobuf/issues/97. We may want to implement a marshal_unsafe feature as well before closing that issue, though.
Credits to @jbarnette for starting to work on this feature. Some of the code in this PR is based on https://github.com/planetscale/vtprotobuf/pull/79.
The test for this feature relies on a non-moving garbage collector. If vtprotobuf is upgraded to Go >= 1.21, then we can consider using https://pkg.go.dev/runtime#Pinner in that test.

cc @vmg, thank you for expressing interest for that feature! Please let me know what you think of this PR. 😄


feat: hyperparameter optimization

Closes #264
Adjusted classical ML-Models to support taking a Choice Parameter
New Features for Classifiers and Regressors:

combined Linear,Lasso,Ridge and ElasticNetRegressor into ElasticNetRegressor

changed property methods and parameter types

added fit_by_exhaustive_search(), to fit a model with all combinations of given Choices

added Errors for using the wrong fit method (fit with or fit_by_exhaustive_search without Choice Parameter)

added Enums ClassifierMetric and RegressorMetric, which are passed to fit_by_exhaustive_search to determine the optimization metric

added cross validation in fit_by_exhaustive_search

added multiprocessing in fit_by_exhaustive_search

added tests for all methods and classes

Related Bug Fixes:
https://github.com/PrefectHQ/prefect/issues/10794

:tada: This PR is included in version 0.28.0 :tada:
The release is available on:

v0.28.0
GitHub release

Your semantic-release bot :package::rocket:


Suggestion: Add some automated testing like Travis CI, Circle CI, Appveyor

They are all free for Open Source projects like this one.
https://github.com/marketplace/category/continuous-integration

Ha, I have no plan of marketing for another build system :)
Meanwhile, automated testing may occur, but the time for that is not now.  Probably when I get a chance to weld the REST API back in, there could be some functional tests.
People will be able to run them easily from makefiles, as they can already do now with some targets like pyflakes.
But ultimately a distributed system that has a lot of side effects is going to get a lot of mock testing which has rapidly diminishing returns.
I expect contribution to be pretty active, but not nearly as active as ansible (so many modules all changing at once) so I'm not really worried about it.
Appreciate your for stopping by with the suggestion but I hope you understand the reasoning for it.
(Finally, as shared in issue_template.md, we're not using the issue queue for RFE tickets to keep this queue organized - which was a HUGE problem with past projects - check out talk.vespene.io if you haven't already)
Thanks!


 tags on frontpage

Should we fill the opengraph protocol tags also on header?
meta keywords could be filled with all articles in website tags
meta description to be the 'about' text for website
authors to be filled with all website authors?

:tada: This issue has been resolved in version 5.2.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


[microNPU][ETHOSU] Fix compiler attributes types

The bool type is replaced with tvm::Bool to pass these parameters to tvmc via the command line.
cc @neildhickey, @lhutton1, @ekalda, @leandron

Thanks @Aleksei-grovety!


pdal: 2.5.5 -> 2.5.6

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/project/pdal/versions.
meta.description for pdal is: PDAL is Point Data Abstraction Library. GDAL for point cloud data
meta.homepage for pdal is: https://pdal.io
Updates performed

Version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 2.5.6 with grep in /nix/store/d87lhniwijwqzqiqsxh421g9yym6vd6g-pdal-2.5.6
found 2.5.6 in filename of file in /nix/store/d87lhniwijwqzqiqsxh421g9yym6vd6g-pdal-2.5.6

Rebuild report (if merged into master) (click to expand)

6 total rebuild path(s)

6 package rebuild(s)

First fifty rebuilds by attrpath
cloudcompare
entwine
grass
pdal
qgis
qgis-ltr

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/d87lhniwijwqzqiqsxh421g9yym6vd6g-pdal-2.5.6 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A pdal https://github.com/r-ryantm/nixpkgs/archive/51f927cbf2d9a28f6f21d33290c17c3e74f51aa3.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/d87lhniwijwqzqiqsxh421g9yym6vd6g-pdal-2.5.6
ls -la /nix/store/d87lhniwijwqzqiqsxh421g9yym6vd6g-pdal-2.5.6/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
nixpkgs-review took longer than 45m and timed out

Maintainer pings
cc @imincik @sikmir @nh2 @willcohen for testing.

Result of nixpkgs-review pr 250897 run on x86_64-linux 1

6 packages built:

cloudcompare
entwine
grass
pdal
qgis
qgis-ltr

I assume we can merge this.


MQTT support?

Considering MQTT is very popular for home automation, it would be valuable to have MQTT support.
There's a php library for mqtt: https://github.com/php-mqtt/client

Will look into this


bugs-tab feature seems not working most of the time

Still cannot see the Bugs tab most of the time.

I know I can visit the Bugs tab through: https://github.com/sindresorhus/refined-github/issues?q=is%3Aissue+is%3Aopen+sort%3Aupdated-desc+label%3Abug, but the counter of Bugs tab seems failed:

Or these bugs are being fixed?🤦♂

Did you enter a personal access token in the extension’s settings page?

Did you enter a personal access token in the extension’s settings page?

My bad🤦♂. I didn’t enter a personal access token.
Just ignore this issue.


Cannot upgrade from Istio 1.9 to Istio 1.10

cc @Monkeyanator
$ ./istio-1.9.0/bin/istioctl install -y
✔ Istio core installed
✔ Istiod installed
✔ Ingress gateways installed
✔ Installation complete
$ ./istio-1.10.0-alpha.1/bin/istioctl install -y
! Istio control planes installed: 1.9.0.
! An older installed version of Istio has been detected. Running this command will overwrite it.
✔ Istio core installed
- Processing resources for Istiod.                                                                                2021-04-20T18:14:30.320441Z     error   installer       failed to update resource with server-side apply for obj MutatingWebhookConfiguration//istio-sidecar-injector: MutatingWebhookConfiguration.admissionregistration.k8s.io "istio-sidecar-injector" is invalid: [webhooks[0].clientConfig.service.port: Invalid value: 0: port is not valid: must be between 1 and 65535, inclusive, webhooks[1].clientConfig.service.port: Invalid value: 0: port is not valid: must be between 1 and 65535, inclusive, webhooks[2].clientConfig.service.port: Invalid value: 0: port is not valid: must be between 1 and 65535, inclusive, webhooks[3].clientConfig.service.port: Invalid value: 0: port is not valid: must be between 1 and 65535, inclusive]
✘ Istiod encountered an error: failed to update resource with server-side apply for obj MutatingWebhookConfiguration//istio-sidecar-injector: MutatingWebhookConfiguration.admissionregistration.k8s.io "istio-sidecar-injector" is invalid: [webhooks[0].clientConfig.service.port: Invalid value: 0: port is not valid: must be between 1 and 65535, inclusive, webhooks[1].clientConfig.service.port: Invalid value: 0: port is not valid: must be between 1 and 65535, inclusive, webhooks[2].clientConfig.service.port: Invalid value: 0: port is not valid: must be between 1 and 65535, inclusive, webhooks[3].clientConfig.service.port: Invalid value: 0: port is not valid: must be between 1 and 65535, inclusive]
✔ Ingress gateways installed
- Pruning removed resources                                                                                Error: failed to install manifests: errors occurred during operation
- ```

Looks related to https://github.com/istio/istio/issues/31028... maybe we changed the MutatingWebhook between 1.9 and 1.10 such that a merge can't succeed (we're probably doing this merge for all resources with the same name but the results are fine in most cases).
@richardwxn has anything changed in 1.10 with how the operator does SSA? Any ideas in general how to avoid this merge behavior? I don't think we want it by default.


Keyboard enhancements

Great work so far on this library. While using it, I found a couple issues concerning the keyboard which I have fixed in this pull request.
Enhancements

Passes through properties from the internal text field's UITextInputTraits so that behavior of the keyboard can be customized better.

Bugs

Fixes a bug where autocorrect suggestions were being offered by the keyboard when a tag was highlighted.

@danielrhodes Thanks a lot!


[webapi] Reword README for notification test suite

@chunywang, @kangxu  maybe we can leverage this test suite to thoroughly test the feature at
https://crosswalk-project.org/jira/browse/XWALK-286
Please help make an inst.deb.py and build a .deb package.

@Honry I also updated your email address here. Please have a look.

Thanks, LGTM :smile:


Ad hoc panel

Relates to #610
I have only changed the overview dashboard to see if that is what we want.

@glommer if you think it's the right approach please approve and I'll continue.

It's a very good direction, but I'd like to see it in all dashboards if possible (or at least in the per-server one)
Actually now that I think of it, maybe just in the per server would be enough. The biggest power of this is being able to correlate things, and most of the detailed metrics are in the per-server dashboard.

@glommer that's what I wanted to know, so let's have it on the overview and the per-server dashboards


Route filter security issue or feature?

Hi,
IMHO laravels route filters has a security issue. This can be feature but should be documented.
Basic Example:
Route::group(['before'=>'auth'], function()
{
 Route::get('protect', function() {});
});

if i'm not logged in and hit /protect in the browser i should get redirected to /login because i've defined a before filter, right?
Now the Security Issue. If you use Route::when() like this: (in filters.php)
Route::when('protect*', 'check');

the before filter on the Route::group() is completely ignored.
But php artisan routes list my route with the Before Filters auth, check.
Instead you have to put a "/" at the beginning so the auth filter is executed:
Route::when('/protect*', 'check');

What do you think? Feature or Security Issue? :)

Can you send a pull request please.


Big problem with PEX

Hello i have a BIG problem with Pex, i am 1 month trying to resolve this and nothing :/ i pay 50€ for the man that resolve this. I have a similar problem to this: https://github.com/PEXPlugins/PermissionsEx/issues/2125
I have all minigame synced with mysql, and all good, but when i go to give admin to a users, he recive the rank in the lobby2 that we are, but if he go to lobby4, he haven´t got the rank, and is posible that if he reconnect to lobby4 he have the rank, or if he go to the lobby1, he have the rank at the first time. Is very rare, i tried all, changing the mysql server and all... please HELP. 50€ for repair this.

Note: Xavikrac1 is not interested in using NetEvents which is a likely solution to his problem.


Replaced StorageCredentials by StorageCredentialsInner

This PR:

Removes StorageCredentials struct
Renames StorageCredentialsInner to StorageCredentials

Thereby removing one level of indirection in the storage credentials.
Background
The struct StorageCredentials was a wrapper to pub Arc<Mutex<StorageCredentialsInner>>. However, this is not really needed:

#1470 removed the Mutex, thereby making StorageCredentials(pub Arc<StorageCredentialsInner>)
The Arc in this context is not required, as StorageCredentialsInner is not a large enum (and if any of the members is large, we should optimize them instead, e.g. using Arc<[String]> instead of Vec<String>).

This PR
As such, we can make life easier for our users by providing an easier API: remove the indirection provided by StorageCredentials by replacing it altogether with the current StorageCredentialsInner. This PR does this.

An example has been provided for why the types are separate. And performance improved by using a RwLock instead of Mutex.

#1474
#1477


Start-with-Six-Simple-Steps.aspx contains a long webpart

PROVISIONING NOTE: If you are having issues with the SharePoint look book while trying to provision M365 learning pathways please do not post that issue to this repo as we cannot help you here. Please post all questions and issues for the SharePoint look book to SharePoint/sp-provisioning-service GitHub Issues List.

WEB PART NOT LOADING: If you are getting the error: "Microsoft 365 learning pathways has a configuration issue. Ask your administrator for assistance". Please review the Diagnosing Pre-Check guidance before submitting your bug.

Describe the bug
When using the template , the page Start-with-Six-Simple-Steps.aspx created is not well defined since it have a long webpart that seems empty for the majority of the occupied space.
To Reproduce
Create a page using the template
Expected behavior
The webpart is rendered based on the content.
Screenshots

If applicable, add screenshots to help explain your problem.

Learning Pathways version number
<IP_ADDRESS>
Additional context

Add any other context about the problem here.

@AndreaBelcastro , Thank you for reaching out to us. We will check this issue and get back to you ASAP


refactor: fix logging and linting on generated code

@JefeDavis need to get you to fix the import issues as described in the failed integration test:
https://github.com/vmware-tanzu-labs/operator-builder/runs/4180747244?check_suite_focus=true#step:6:169


Use Install-Binary instead of Install-MSI

Description
Bug fixing
Catch up with the most recent master changes: Install-MSI replaced with Install-Binary
Related issue:
https://github.com/actions/virtual-environments-internal/issues/418
Check list

[ ] Related issue / work item is attached
[ ] Tests are written (if applicable)
[ ] Documentation is updated (if applicable)
[ ] Changes are tested and related VM images are successfully generated

/azp run windows2016, windows2019


Add function to return root of a proof that can later be verified via a signing scheme.

Using verify query on light clients would require them to be supplied with the expected root hash, in addition to the proof, keys and signature. Since the proof already contains the root_hash, and any other root hash wouldn't match for the signature, it would be optimal not to send it.
The change requested decomposes verify_query into a new function query_proof_root that returns the root hash as well as the result of querying the keys.

Codecov Report

Merging #51 (806d873) into develop (2b31f6f) will increase coverage by 0.04%.
The diff coverage is 100.00%.

@@             Coverage Diff             @@
##           develop      #51      +/-   ##
===========================================
+ Coverage    89.90%   89.94%   +0.04%
===========================================
  Files           23       23
  Lines         2555     2557       +2
===========================================
+ Hits          2297     2300       +3
+ Misses         258      257       -1

Impacted Files
Coverage Δ

src/proofs/verify.rs
94.97% <100.00%> (+0.50%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2b31f6f...806d873. Read the comment docs.

Closing this, and will make a new PR potentially eventually with the same idea.

@QuantumExplorer cool, might make sense to do it by adding a root_hash method to Map


Check build_lock before releasing

@smunilla
@tbielawa @sosiouxme PTAL
If the wait_for_build is called, then build_lock is actually already released. Not really sure how this doesn't always fail other than threading is weird we've gotten lucky except when we don't and get failures like here -> https://buildvm.openshift.eng.bos.redhat.com:8443/job/aos-cd-builds/job/build%252Focp4/196/consoleFull
Traceback (most recent call last):
  File "/bin/doozer", line 1831, in <module>
    main()
  File "/bin/doozer", line 1812, in main
    cli(obj={})
  File "/usr/lib64/python2.7/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/usr/lib64/python2.7/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/usr/lib64/python2.7/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib64/python2.7/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/lib64/python2.7/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/usr/lib64/python2.7/site-packages/click/decorators.py", line 64, in new_func
    return ctx.invoke(f, obj, *args, **kwargs)
  File "/usr/lib64/python2.7/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/bin/doozer", line 842, in images_build_image
    results = results.get()
  File "/usr/lib64/python2.7/multiprocessing/pool.py", line 554, in get
    raise self._value
doozerlib.runtime.WrapException:
Original traceback:
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/doozerlib/runtime.py", line 78, in wrapper
    return func(*args, **kwargs)
  File "/bin/doozer", line 840, in <lambda>
    terminate_event=terminate_event, scratch=scratch, realtime=(threads == 1)),
  File "/usr/lib/python2.7/site-packages/doozerlib/distgit.py", line 783, in build_container
    self.build_lock.release()
ValueError: semaphore or lock released too many times

/lgtm


Error on converting from import.

I can import, but doesn't convert the song.

This issue should be fixed in v1.5.1, please update SLAM and open a new issue if it persists.


ADD HACKTOBERFEST AND GSSOC BANNER ON THE README

Describe the bug
The README file is missing the Hacktoberfest and GSSoC banners. The issue is to add these banners at the appropriate location to showcase the project's involvement in these events.
To Reproduce
Steps to reproduce the behavior:

Go to the GitHub repository.
Navigate to the README.md file.
Scroll down to check for banners related to Hacktoberfest and GSSoC.
See that the banners are missing.

Expected behavior
The Hacktoberfest and GSSoC banners should appear on the README file, ideally at the top, to indicate that the project is part of these events.
Screenshots
N/A
Additional context
The banners can be sourced from the official Hacktoberfest and GSSoC websites. They should align with the current styling of the README file, and possibly, they could be centered for better visibility.
ADD LABELS HACKTOBERFEST AND GSSOC EXT 24
ASSIGN ME THE WORK
THANK YOU @Harshdev098 !

ADD LABELS HACKTOBERFEST AND GSSOC EXT 24
ASSIGN ME THE WORK
THANK YOU @Harshdev098 !

ADD LABELS HACKTOBERFEST AND GSSOC EXT 24 ASSIGN ME THE WORK THANK YOU @Harshdev098 !

@Harshdev098


To Reproduce
Before
CREATE TABLE test (
  id bigserial PRIMARY KEY
);

After
CREATE TABLE test (
  id bigint PRIMARY KEY GENERATED ALWAYS AS IDENTITY
);

Run pg-schema-diff apply after saving each time.
Context
pg-schema-diff version: 5fe8259b82bd784644224a861cce575339a45a59
pg-schema-diff usage: CLI
Postgres version: 14

Should be fixed with #183


Fix declaration for noImplicitAny

Omitting the return type of fn causes compile errors in consuming projects that import fuse-box with noImplicitAny compiler option.

Thanks!


fix(plugins/plugin-kubectl): Fixing guidebook layouts and validation code

Description of what you did:
With the introduction of :imports, install-knative-quickstart.md needed an updated layout. The Clean Up section has been commented out for now because this guidebook is being used as an import in other files and the Clean Up content is not necessary when file is imported. Also, some validation scripts were not running due to a typo in the validation flag. This has also been fixed.

My PR is a:

[ ] 💥 Breaking change
[x] 🐛 Bug fix
[ ] 💅 Enhancement
[ ] 🚀 New feature

Please confirm that your PR fulfills these requirements

[x] Multiple commits are squashed into one commit.
[x] The commit message follows Conventional Commits, which allows us to autogenerate release notes; e.g. fix(plugins/plugin-k8s): fixed annoying bugs
[x] All npm dependencies are pinned.

/lgtm
/approve


Required role

What's the required role to create a firewall rule?
I granted SQL DB Contributor, SQL Security Manager and SQL Server Contributor roles to a user, but he's still not able to add the rule by himself.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6b404ba7-af5a-bb77-4cd4-c0123490e0ed
Version Independent ID: d0430276-271c-4e57-ffdc-6b8a923b1dad
Content: Create a server-level firewall rule - Azure SQL Database
Content Source: articles/sql-database/sql-database-server-level-firewall-rule.md
Service: sql-database
Sub-service: security
GitHub Login: @sachinpMSFT
Microsoft Alias: sachinp

@fleed We are checking this and we will get back to you.

@fleed Please check the link https://docs.microsoft.com/en-us/azure/sql-database/sql-database-firewall-configure#troubleshoot-the-database-firewall which also explains the access issue for creating these rules.
Please go through the document mentioned in the TS document for managing logins for various tasks- https://docs.microsoft.com/en-us/azure/sql-database/sql-database-manage-logins

@fleed Were you able to check these documents and have any questions.

Hi @NavtejSaini-MSFT
Thank you. I found interesting information, but still no description for the roles that I can assign from the Access control (IAM) tab.

@fleed The SQL Security Manager is the role you would need to assign to anyone who wants to set Server level Firewall permission. You already did that but it didnt work. Can you please
granting this role on the Resource Group containing the SQL Server

@fleed Please convey if you were able to check this.

Thank you @NavtejSaini-MSFT , it works


Fix typo in filename

Summary
Remove the extra . before devcontainer.json in the tutorial. Only the folder is hidden, not the file itself.
Task list

[ ] For workflow changes, I have verified the Actions workflows function as expected.
[x] For content changes, I have reviewed the style guide.

@heiskr Can I get an lgtm please 🙏


Compression settings struct for forward compatibility

The current "Compress" functions take all settings as a single flags DWORD and individual parameters, i.e.:
    HRESULT __cdecl Compress(         _In_ const Image& srcImage, _In_ DXGI_FORMAT format, _In_ DWORD compress, _In_ float threshold,         _Out_ ScratchImage& cImage);
Using a compression settings struct aggregating all of the options instead would allow better forward compatibility, since non-flag options (or more than 32 flags) could be added without requiring new function signatures.

What new options where you thinking of adding here?
Generally I can't break existing API signature compatibility, but I could certainly add new functions:
struct CompressOptions
{
    float threshold;
    ???
};

HRESULT __cdecl CompressEx( _In_ const Image& srcImage, _In_ DXGI_FORMAT format,
     _In_ DWORD compress, const CompressOptions& opts, _Out_ ScratchImage& cImage);

Configurable per-channel weights is probably the most important.
I'm not sure if ASTC support is planned, but if it is, then configurability will become more important because ASTC block configs are highly modular, so exhaustive searching the entire config space is much less practical and heuristics will be more important.  The reference encoder has about 20 scalar options.
Some of those options would be useful in current-generation formats anyway, like the deblocking parameter (boosts edge pixel importance).

Right now we have two 'channel-weight' options:
The default (as was in D3DX for it's entire history):
// Perceptual weightings for the importance of each channel.
const HDRColorA g_Luminance(0.2125f / 0.7154f, 1.0f, 0.0721f / 0.7154f, 1.0f);
const HDRColorA g_LuminanceInv(0.7154f / 0.2125f, 1.0f, 0.7154f / 0.0721f, 1.0f);

I added an option via TEX_COMPRESS_UNIFORM to just use (1,1,1,1) weights (it was added to some Xbox 360 era tooling).
Are you thinking per-image custom weights are a thing worth tweaking, or is there some other common weighting scheme that you think would be useful?


Project construction issues

Why the project cannot build correct，when  code signing   changed～！
The most critical issue is the problem of handling two group IDs related to core

Do you have a suggested fix for this?  If so, please re-open and comment.  Thanks for your feedback.


Optionally Encrypt Access Request Data [#46][#83]

Purpose
Fidesops must support the ability to supply a custom encryption key on request creation, that will be used throughout the PrivacyRequest flow. This encryption key should be used to encrypt the access data we return to the user at the end of a request before it is uploaded in either JSON or CSV format.
Changes

Use optional encryption_key field supplied with the Privacy Request body to trigger encrypting data (for local and s3 uploads only)

Temporarily store the encryption_key in the Redis cache

Encrypt the contents of the results upload (for JSON and CSV files) using AES GCM encryption where applicable - concatenates the internally generated nonce with the encrypted data as "nonce" + encrypted_data.

If CSV data is specified, each csv in the zipfile will be encrypted using a different nonce

Use secrets.token_bytes() to generate the nonce

Do this same thing for our encryption endpoints

Add additional fixes to encryption endpoints

Ticket
Resolves https://github.com/ethyca/fidesops/issues/46
Resolves #83

thank you @stevenbenjamin !


Document running the Data Science Sandbox as Docker container while using ITDE and EXASLCT

The current ticket requests to document how users can run the DSS as Docker Container while using ITDE and EXASLCT.
This includes Mapping the port of the docker socket from host to inside the Docker Container.

PR #30 added creation of a Docker Image for DSS and was inspired by test_install_dependencies.py
On of the findings during review of the PR's  was that the docker socket was not mapped.

Documentation has been created and updated in the scope of #78.
SLCT is currently out of scope.
Closing the current ticket.


[Meta] Using github releases

Hey
It will be nice if the maintainers update the releases every time a new version is released perhaps with a changelog. Makes it easier for users using this crate. If needed, would love to contribute that on every release
Keep up the good work 👍  😃

Thanks @Dylan-DPC! I've created a tag for the latest 1.0.1 release and I think we should keep on top of them going forward so I think we can close this one now.


parse bundle-id from URL params & attempt to store in redis

DON'T MERGE. PR just for code comparison & concept exploration.

NOT FINISHED. PR just for code comparison & conceptual exploration.

I feel that using the term bundle-id is misleading. "bundle" and "bundle-id" is already used and refers specifically to Flashbots Relay bundles and the id of them. I suggest we change the term to cacheId, and the query arg to cid, like rpc.flashbots.net?cid=foo

I've pushed a PR with updates to this PR: https://github.com/zeroXbrock/rpc-endpoint/pull/1

"Whitehat-ID" could be an alternative

"Whitehat-ID" could be an alternative

The issue is that mistypings will fail silently, and the longer the query arg is the easier to mistype. Users will think they are all set and wonder why it's not working. Perhaps best would simply be a 1-letter arg, like ?x=foo?

Created the branch whitehat-txcache with this PR merged in, and others opened to it. Let's work against that branch until we merge.
Summary PR in #48