Better and more ASCII !! (╯°□°）╯︵ ┻━┻

Some of our ascii logos look a bit out of shape...
plz help ಥ_ಥ
Don't hesitate to add more languages, if you feel inspired.
Bye.
ฅ^•ﻌ•^ฅ

Would it be okay to add Coffeescript?

I don't see why not...you might also want to add JavaScript as it's closely related.

@o2sh, how did you draw these? Maybe with a formal procedure we could synthesize the logos straight from a PNG. There are, afaik, libraries that do this for you :D

Hi @felix91gr,
Except for typescript, R, lua and maybe clojure, I used an [online tool] (https://www.text-image.com/convert/ascii.html) that converts PNG into ascii which is OK but not great.
If you know better alternatives, plz share. :)


Move "Add Sub-Page" button up to the toolbar

I understand that it's nice to tidy up the toolbar and shove everything editing-related under the "edit" button, but I think it's counter-intuitive to end-users if the "Add Sub-Page" button is under the "Edit" button, instead of its own button in the admin toolbar (like it has been up to 5.4.x). Having it under the "Edit" button is a developer-centric way of looking at the functionality, in my opinion, and doesn't really match the normal end-user's mental model of how the system works.
BTW, I think it's great that the button was renamed to "Add Sub-Page" (as opposed to the old "Add Page") -- this is much clearer.

I agree, but I think it should stay Add Sub-Page


question of boundary

When there are two boundary in the question, I want to know how to define the boundary  attribute of the  joint vertex of the two boundary in mesh v1.0 format ?   Different boundary attribute of the joint vertex will give different solution. How to deal with this problem?

Hello, @fengerhan ,
There is currently no way, in MFEM, to assign boundary conditions to individual vertices.  However, there may be ways to work around this limitation if necessary.  What type of equation are you solving and what is the boundary condition?
Best wishes,
Mark

Hello Mark,
Thank you for your answer. I just want to solve a possion equation on 2D domain. On the boundary of the domain, I want to set the solution function u = 0 on part of the boundary, and u = 1 on the rest of boundary. I find my solution  on   the joint vertex of the two boundary will get wrong result. Especially when I do mesh  adaptation. I find the boundary attribute of the joint vertex of the two boundary have been change. Can you give me a way to deal with this limitation?
Best wishes,
Han

Hi, @fengerhan ,
I forget the details but I don't think an exact solution exists when the boundary condition is discontinuous like this.  I see two ways to proceed which each introduce a small transition region across the discontinuity.
The first is to write a function that is 0 on part of the boundary, 1 on the other part of the boundary, and apply this as your Dirichlet BC function.  The function could be discontinuous, using something like if (x[0] <= 1.0) {return 0.0;} else {return 1.0;}, or it could have a transition region with a suitable thickness.  When such a function is projected onto a continuous finite element basis you'll get an artificial transition region comparable in width to the mesh spacing.
The second option is to choose a fixed width for the transition region and build this into the mesh by creating a small portion of the boundary between the portions that should equal 0 and 1.  You then set no boundary condition on this small transition region.  The natural boundary condition on this new portion will be that the normal component of the gradient will be zero.  If this natural boundary condition creates an odd kink in the solution you can specify a desired gradient to smooth things.
Best wishes,
Mark


Unable to install Pytorch

I am using Python 3.11.7 and at the moment I am not being able to install pytorch using the recommended command:
uv pip install torch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 --index-url https://download.pytorch.org/whl/cu118

The result is:
× No solution found when resolving dependencies:
  ╰─▶ Because there is no version of torch==2.1.2 and you require torch==2.1.2, we can conclude that the requirements are unsatisfiable.

I know this is related to some other issues already mention here, but I think none of them state this problem in a simple way like this one here.
In this other comment @charliermarsh gives an example of how you would be able to apply some workaround, but I have not being able to apply them. Could you give an example of how to apply them for this specific case?
Thanks in advance! :)

Did you try using --extra-index-url instead of --index-url?

what platform did you run that on? https://download.pytorch.org/whl/torch/ doesn't have anything for (py311, torch2.1.2, macos)
on my machine (macos + arm) py311 seems to be able to install those packages okay:
$ uv pip install torch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2
Resolved 18 packages in 277ms
Downloaded 7 packages in 2.78s
Installed 18 packages in 178ms
 + certifi==2024.2.2
 + charset-normalizer==3.3.2
 + filelock==3.13.3
 + fsspec==2024.3.1
 + idna==3.6
 + jinja2==3.1.3
 + markupsafe==2.1.5
 + mpmath==1.3.0
 + networkx==3.2.1
 + numpy==1.26.4
 + pillow==10.3.0
 + requests==2.31.0
 + sympy==1.12
 + torch==2.1.2
 + torchaudio==2.1.2
 + torchvision==0.16.2
 + typing-extensions==4.10.0
 + urllib3==2.2.1
chankang@chans-Air ~/test/311 -
$ .venv/bin/python -V
Python 3.11.8
$ ls .venv/lib/python3.11/site-packages/
Jinja2-3.1.3.dist-info             functorch                          requests-2.31.0.dist-info
MarkupSafe-2.1.5.dist-info         idna                               sympy
PIL                                idna-3.6.dist-info                 sympy-1.12.dist-info
__pycache__                        isympy.py                          torch
_virtualenv.pth                    jinja2                             torch-2.1.2.dist-info
_virtualenv.py                     markupsafe                         torchaudio
certifi                            mpmath                             torchaudio-2.1.2.dist-info
certifi-2024.2.2.dist-info         mpmath-1.3.0.dist-info             torchgen
charset_normalizer                 networkx                           torchvision
charset_normalizer-3.3.2.dist-info networkx-3.2.1.dist-info           torchvision-0.16.2.dist-info
filelock                           numpy                              typing_extensions-4.10.0.dist-info
filelock-3.13.3.dist-info          numpy-1.26.4.dist-info             typing_extensions.py
fsspec                             pillow-10.3.0.dist-info            urllib3
fsspec-2024.3.1.dist-info          requests                           urllib3-2.2.1.dist-info

Did you try using --extra-index-url instead of --index-url?

No, but I just did and I got the same result.
I was trying to replicate an issue that happens in a linux machine but now that you mention it I am running this in a macos machine where cuda is not compatible. I will reopen another issue when I run this in a cuda compatible machine. Thanks!


ALC 7.0 produces apps that do not run correctly on BC14.10

Describe the bug
I know this may be early, but still: when using ALC7.0 (from master) to compile an app, the package that is produced is not working correctly on BC14 (tested on CU10 and CU12). I have tested this only by compiling the app through VSCode, but it most probably also applies to ALC.exe running via CLI. The issue is basically:

Create App "Lib" which contains a Codeunit which contains function with a parameter of type Record.
Create App "UI" which has a dependency on App "Lib" and executes the aforementioned function
An error is raised: "The function ID [SomeID] was called. The object of type [CodeunitID] does not have a member with this ID."

This error disappears if I compile the app with ALC3.0 or ALC6.1.
To Reproduce
Steps and to reproduce the behavior:

Create app "Lib", create a Codeunit, create a function with 1 parameter of type "Cust: Record Customer"
Create app "UI" that has a dependency on app "Lib"
Create a page extension that adds an action to the customer list and call the function in the Codeunit from app "Lib".

AL Code to reproduce the issue
I have placed the code to reproduce this issue on a dropbox folder (see below). My "Lib" app is "ALProject4" and "UI" is "ALProject5". I have also included the compiled version of those apps. working_v3 was compiled with ALC3.x, failing_v7 was compild with ALC7.0.
https://www.dropbox.com/sh/3jti86kgc3bftwu/AAA905Ma5242ppS9r6EFa_pha?dl=0
Expected behavior
I expect apps compiled with ALC7.0 to fully backward compatible.
Screenshots

5. Versions:
ALC v7: 7.0.xxxxx (taken from master)
ALC v3: 3.0.193882

Thanks for raising this! This is a must-fix.

The fix for this issue has been checked in to the master branch. It will be available in the bcinsider.azurecr.io/bcsandbox-master Docker image starting from platform build number 21804 and VS Code Extension Version 7.0.411812.
If you don’t have access to these images you need to become part of the Ready2Go program: aka.ms/readytogo
For more details on code branches and docker images please read:
https://blogs.msdn.microsoft.com/nav/2018/05/03/al-developer-previews-multiple-releases-and-github/
https://freddysblog.com/2020/06/25/working-with-artifacts/


CASMNET-1588:  Add link to instructions for running gateway tests externally

Summary and Scope
Adds instructions for running the gateway tests externally to the CSM validation.
Issues and Related PRs

Resolves CASMNET-1588

Testing
Test description:

docs only

Pull Request Checklist

[ ] Version number(s) incremented, if applicable
[ ] Copyrights updated
[ ] License file intact
[ ] Target branch correct
[ ] CHANGELOG.md updated
[ ] Testing is appropriate and complete, if applicable
[ ] HPC Product Announcement prepared, if applicable

/backport release/1.2 release/1.2.6

Working on the lint issues right now.


Bug: DefWindowProcW can not be used in WNDCLASSEXW directly

Which crate is this about?
windows
Crate version
0.48
Summary
let window_classx = WNDCLASSEXW {
  lpfnWndProc: Some(DefWindowProcW),
  ..Default::default()
};

fails to compile due to incompatibility between WNDPROC used for lpfnWndProc and DefWindowProcW
Toolchain version/configuration
Default host: x86_64-pc-windows-msvc
rustup home:  C:\Users\REDACTED\.rustup
installed toolchains
stable-x86_64-pc-windows-msvc (default)
nightly-x86_64-pc-windows-msvc
active toolchain
nightly-x86_64-pc-windows-msvc (directory override for 'C:\Users\REDACTED\Projects\retour-rs')
rustc 1.72.0-nightly (36fb58e43 2023-06-26)
Reproducible example
use windows::Win32::UI::WindowsAndMessaging::*;

let window_classx = WNDCLASSEXW {
  lpfnWndProc: Some(DefWindowProcW),
  ..Default::default()
};

Expected behavior
The above should compile
Actual behavior
|         lpfnWndProc: Some(DefWindowProcW),
|                           ^^^^^^^^^^^^^^ expected "system" fn, found "Rust" fn
|
= note: expected fn pointer `unsafe extern "system" fn(HWND, _, WPARAM, LPARAM) -> LRESULT`
                  found fn item `unsafe fn(_, _, _, _) -> LRESULT {DefWindowProcW::<'_, _, _, _>}`

That's not a complete repro but I think I see what you're trying to ask. 😉
The system-provided DefWindowProcW function is not a callback, so it can't be passed in the place of a callback (as you would in C or C++) using the windows crate since it is not a function pointer. If you need that to compile, I suggest you do one of:

use the windows-sys crate where this will work as is since functions aren't wrapped
declare DefWindowProcW yourself using the windows-targets crate
call DefWindowProcW from your own window procedure using the windows crate

The last option is probably simplest if you're already using the windows crate.

We also have a sample that covers CreateWindow basics https://github.com/microsoft/windows-rs/blob/master/crates/samples/windows/create_window/src/main.rs


fix typo in "transaction email"

I removed parentheses that shouldn't have been there.

Great catch!


34 Button Refresh in Preview

This adds a refresh button to the Preview page (right side, over the scroll area)

Thanks @egolus,
the placement of the button seems a bit awkward (problem related somehow to #49). This could be a good place to try a toolbar implementation, no? Do you want to take a go at it?

OK, I'll put a toolbar in Preview, so under the tabbar. If we like it, we can do the same for Editing

Travis failing to merge seems no problem - it seems git got confused over a trivial thing.
However - the implementation does not seem to work for me (Win 8.1). The toolbar is fixed to the three options Up, New N, New F, and whatever I switch tab to, stay there. I get repeatedly this error:
Traceback (most recent call last):
  File "noteorganiser/NoteOrganiser.py", line 271, in showActiveToolBar
    self.library.toolbar.setVisible(False)
AttributeError: 'Library' object has no attribute 'toolbar'

Surprisingly enough, the tests pass.

Aah, you're right, I forgot to change this to ´library.shelves.toolbar´
The tests don't need the toolbar to be visible to 'click' on it, it seems
Am 25. Juni 2015 09:29:12 MESZ, schrieb Benjamin Audren<EMAIL_ADDRESS>
Travis failing to merge seems no problem - it seems git got confused
over a trivial thing.
However - the implementation does not seem to work for me (Win 8.1).
The toolbar is fixed to the three options Up, New N, New F, and
whatever I switch tab to, stay there. I get repeatedly this error:
Traceback (most recent call last):
 File "noteorganiser/NoteOrganiser.py", line 271, in showActiveToolBar
   self.library.toolbar.setVisible(False)
AttributeError: 'Library' object has no attribute 'toolbar'

Surprisingly enough, the tests pass.

Reply to this email directly or view it on GitHub:
https://github.com/baudren/NoteOrganiser/pull/50#issuecomment-115142511

Aah, you're right, I forgot to change this to library.shelves.toolbar The tests don't need the toolbar to be visible to 'click' on it, it seems

This should fix the toolbar

It's looking good!
I will test tonight on linux to see how it looks there, then will merge it. Thank you!

I think that the separator behaves strangely on my machine. There is a physical separation between the save and the one on the left, but no visual indication of it. Is there anything on your side? Do you find it visually clear enough?

there's a thin line, but I have to admit, it's very thin

we could use 3 separators to make it a bit stronger..
the other question is if it is strong enough when we use icons instead of text

Well, one or three, either is invisible on my linux setup. On win8.1, no problem. I will try to see if it is a known bug.
In terms of layout, I would put the Save and Reload to the left, rather than to the right.
I was also thinking that a more ribbon like appearance could work better, no? Having maybe a tab for each panel (Library, Editing, Preview), and the related options in these tabs?

Since the functionnality is added, and working, I could merge this, right?


[UBS Order Form][Step 0.1.] Clicking outside of the pop-up doesn't close it

Environment: Windows 11 Home, Google Chrome 109.0.5414.122.
Reproducible: always.
Description
According to the acceptance criteria of the user story #3033, clicking outside of the pop-up should close it and redirect the user to the previous page:

By clicking on the button “Назад”, on “X” (close), or outside of the pop-up, the pop-up should close, and the user shall be redirected to the page, from which the popup was entered. The button “Назад” is always active.

Preconditions

Go to https://www.testgreencity.ga/#/ubs
Click 'Sign in'.
Enter the valid email in the Email field.
Enter the valid password in the Password field.
Click 'Sign in'.

Steps to reproduce

Click on the 'Замовити Кур’єра' button.
Click outside of the pop-up on the background page.
Check if the pop-up is closed.
Check if the user is redirected to the page from Step 1.

Actual result

The pop-up is not closed.
The user is not redirected to https://www.testgreencity.ga/#/ubs.

Expected result

The pop-up is closed.
The user is redirected to https://www.testgreencity.ga/#/ubs.

User story and test case links
User-story #3033
Test case WR50QC-571 in Jira

Bug is fixed
https://github.com/ita-social-projects/GreenCity/assets/101433204/93f7efef-1d79-4066-aec7-e428e3aadfa3

@katia9261  The bug is not fixed when the pop-up is opened on UBS main page.
The bug is fixed when the pop-up is opened on the UBS Order page.
https://github.com/ita-social-projects/GreenCity/assets/106426661/de1b047c-e169-4a74-be1f-f32483e13abd

To reproduce this bug User needs to have no orders in 'User cabinet', then pop-up window 'first choose the location' could appear on UBS main page after clicking on 'order' button


fix(observer): Disable reactive non-numerical property of array (fix #8535)

What kind of change does this PR introduce? (check at least one)

[x] Bugfix
[ ] Feature
[ ] Code style update
[ ] Refactor
[ ] Build-related changes
[ ] Other, please describe:

Does this PR introduce a breaking change? (check one)

[ ] Yes
[x] No

If yes, please describe the impact and migration path for existing applications:
The PR fulfills these requirements:

[x] It's submitted to the dev branch for v2.x (or to a previous version branch), not the master branch
[x] When resolving a specific issue, it's referenced in the PR's title (e.g. fix #xxx[,#xxx], where "xxx" is the issue number)
[ ] All tests are passing: https://github.com/vuejs/vue/blob/dev/.github/CONTRIBUTING.md#development-setup
[x] New/updated tests are included

If adding a new feature, the PR's description includes:

[ ] A convincing reason for adding this feature (to avoid wasting your time, it's best to open a suggestion issue first and wait for approval before working on it)

Other information:
Pre-defined non-numerical properties are never reactive, new non-numerical properties' behaviors
should be consistent with them.
/test/e2e/specs/modal.js failed, but the previous commit also failed.

https://github.com/vuejs/vue/issues/8535#issuecomment-432397071


fix prompt message for debug command

Debug environment variable was changed. The command in prompt message need to be updated.

Thank you!


Book 2, version 2022-07-21, sections 5.2-5.3 - confusing

I think your presentation may confuse readers on the concepts of cross entropy $\mathbb{H}(p, q)$ and joint entropy $\mathbb{H}(X, Y)$. You may wish to consider providing an explicit definition of joint entropy for any number of variables, and point out how you are using similar notation for two different concepts.
page 215, formula (5.106): $\mathbb{H}(XYZ)$ -> $\mathbb{H}(X, Y, Z)$

fixed


Update 'Changelog' link on rubygems.org/gems/rubocop-rspec

The CHANGELOG.md file hasn't been updated for a couple of releases. Is it better to now point the rubygem Changelog link to the github releases page?

CHANGELOG.md file hasn't been updated for a couple of releases

There will be all updates once we release 3.0.0
Now, it’s a burden for us to sync 2.0-stable and master (3.0.0-pre).
https://github.com/rubocop/rubocop-rspec/blob/2-x-stable/CHANGELOG.md


rename master branch to stable [ch3290]

Will close once stable is the default branch.
https://app.clubhouse.io/ghostinspector/story/3290/rename-master-branch-to-stable

Done


No longer working on Firefox

Stopped working this week. Same key, same site working on Chrome, Safari, Brave all for macOS.
Firefox 130.0.1
Upon inserting and touching the key, I get ‘No credentials were found for “{my site}” on this security key. Try again with a different security key’.
I have two keys registered, and neither work here. They do work on the above-mentioned browsers.
I’ve tried turning U2F on and off in the Two-Factor Auth plugin – no difference. Cannot turn off WebAuthn in that spot. Both keys are registered in both U2F and WebAuthn.

I'm experiencing the same issue.

@jimmiedave @zaneselvans does 2.4.1 work for you?
I suspect that #874 could break things :-(

Also, what are the steps to reproduce?
This is what I have tried:

Logged in from Chrome, created a new key
Logged out
I logged in from Firefox, and it worked for me.

I guess I am missing something?

2.4.1 works (just reinstalled it manually) saying "Touch your security key to continue with {my site}" - using the Firefox dialog, not the OS passkey dialog.
Steps to repro with 2.5.0:
Wordpress (always latest) installed on my own VPS (not shared hosting, no WP hacks from Bluehost or anybody).
Go to login page (mine, not  a "log into WordPress.com" page)
Enter username (an admin, though I've got 2FA on admin account and on user account - haven't tested user account)
Enter password
OS Passkey dialog appears: "Choose how you'd like to sign in to {my site}"
See options: •iPhone, iPad or Android device, •Security Key
Choose "Security Key"
Click "Continue"
Dialog changes to "Use Security Key":"To continue with {my site}, insert and activate one of your security keys"
Touch Yubikey activation area. Nothing happens (yes, tested this repeatedly)
Touch Yubikey activation area again.
Get error: 'No credentials for "{my site}" were found on this security key. Try again with a different security key'.
I'm on Sonoma 14.5. I should note that I have never activated iCloud keychain, but this hasn't affected any other apps, including the OS passkey dialog on other browsers.

Not sure if it's easy to re-install a non-current version, but the Yubikey login was working great until recently.
It would also be nice if there was some way to avoid having to select the Yubikey and not the passkey with every single login.

Noting that this is an OS dialog, I just updated Sonoma to the latest 14.7, with no noted change to behavior.
I'll also state that I didn't create a new key from Chrome first - I used my current Yubikey (one of 2 registered, tried both with no difference), and touched a key that stays plugged into a hub all the time (i.e. not plugged in when dialog pops up. Tried both already-plugged, and plug-in-when-prompted with no difference in bug).

Also the "Having Problems?" "Use your security key" link from the "Retry" page changes the dialog to (I guess) the plugin  dialog: "Now insert (and tap) your Security Key." and when I tap the key, nothing happens.

If I "revoke" a key, can I re-add it? Wondering if your "added a new key in Chrome" has some effect.

@jimmiedave

If I "revoke" a key, can I re-add it?

Yes

:/ I'm pretty sure I tested Firefox on macos with a physical yubikey, but I can test it again tomorrow.
As explored in https://github.com/dd32/wp-two-factor-provider-webauthn/pull/1 the "proper" solution is to store the transports at registration time and prompt with those at login time. (The upstream library doesn't really do that, since it's not a level 2 implementation)
Unfortunately Firefox appears to differ from the other browsers in their implementation of challenges without the transport field, which is why we're here I guess.

Just noted that my Yubikey works fine in Firefox with a brokerage. Uses OS dialog. So it can be accomplished.

I've also found that it works as expected on Vanguard (and never asks me if I want to use a Passkey!)

I'm unable to duplicate with Firefox 131.0 (aarch64) on macOs Sequoia 15.0 (24A335). I've tried registering a yubikey with a previous version of the plugin and then updating, all that.
The behaviour has changed, as it no longer prompts instantly to use a security key and uses the macos system prompts

Before
Now
with a Passkey registered

Using a Kensington VeriMark Guard I do end up with a different login flow.
Previously it would act like the Before video above, but now it acts like the following, prompting for which credential on the key to use. Selecting either one works. Revoking and add the key doesn't change it.
https://github.com/user-attachments/assets/e5e42705-893d-4551-9048-67fd542865c8
Something I'm not seeing mentioned here is what keys are being used, brand etc.. Yubikey also has a long changelog of changes they've made to their firmwares, so no two keys are identical in behavour.. I've been testing with version 5.4.3 of the firmware

Upon inserting and touching the key, I get ‘No credentials were found for “{my site}” on this security key. Try again with a different security key’.

I'm not sure how this would actually happen in practice, I'm guessing that maybe this is an algorithm issue; Perhaps the key is registered with a alg that firefox supports but isn't supported via the macos interface?  I can't imagine it's actually because of the transports being specified, rather just the different codepath that's triggering..
I'm not sure how to determine if this is the case.. but if so, revoking and re-registering the key would work..
I wonder if it's possible to have the plugin return the array with two of the same keys in the payload? see if that changes it for the affected keys ie.
[
{"type":"public-key","id":"1K1U.....AAAA","transports":["usb","nfc","ble","internal","hybrid"]},
{"type":"public-key","id":"1K1U.....AAAA","transports":[]}
]

In trying that, I triggered the kensington key above to offer 4 credentials; as it matched against both key options.. and the yubikey just worked
Index: wp-content/plugins/two-factor-provider-webauthn/vendor/madwizard/webauthn/src/Server/WebAuthnServer.php
===================================================================
             foreach ($credentialIds as $credentialId) {
                 $descriptor = new PublicKeyCredentialDescriptor($credentialId->toBuffer());
+                $requestOptions->addAllowedCredential( clone $descriptor );
                 foreach (AuthenticatorTransport::allKnownTransports() as $transport) {

Using that diff, I've successfully triggered the Yubikey to get rejected as No credentials on device, despite the Kensington key being happy with it (and just offering 4x credentials now, instead of 2x)
That suggests it's not at all the algorithm, but rather the transports that is causing the issue here.. but I'm not sure how.
By setting all transports as done in v2.5.0 I think it's against this line of the spec: (emphasis mine)
https://www.w3.org/TR/webauthn-2/#sctn-getAssertion:~:text=It is RECOMMENDED to also,find a suitable authenticator.

It is RECOMMENDED to also:

Associate the credentialId with the transport hints returned by calling credential.response.getTransports(). This value SHOULD NOT be modified before or after storing it. It is RECOMMENDED to use this value to populate the transports of the allowCredentials option in future get() calls to help the client know how to find a suitable authenticator.

By setting it to all known methods we're modifying the value, which causes a spec violation, but I'm not actually sure how that's used by keys. I thought it was purely used by the client to determine the location to find the key, which seems to be how other browsers interpret it, and I'm not seeing anything else in the spec to suggest that the key should verify it's being accessed over an approved manner..

It would also be nice if there was some way to avoid having to select the Yubikey and not the passkey with every single login.

I agree. I think there's a chance that the 'proper' route mentioned in https://github.com/sjinks/wp-two-factor-provider-webauthn/issues/892#issuecomment-2388027219 would lead to that being a potential option. If the only registered keys are only ever available over USB then it might just prompt for USB straight away.
Finally... Just noting you can use https://wordpress.org/plugins/wp-rollback/ to install an older version of a plugin for testing.

Testing here with a couple Yubikey 5 NFCs, Firmware 5.4.3.
Don't have a PIN on mine.

OK, so I "Deleted" a Yubikey's U2F config and "Revoked" its WebAuthn config. I was able to add back a WebAuthn config, but the U2F config just runs a spinner and never completes. I realize I probably only need one 2FA method to work, but the never-completing spinner vs. a dialog that says "you can't" or "don't bother" is an unexpected result.

The surprise to me is that after re-adding the WebAuthn config, which this time used the macOS dialog, I was able to log in with the Yubikey.
Just to reiterate: I didn't have to do any of this to get Safari, Brave, Chrome to work.

Same key working on Firefox with OS dialog for log in to GitHub (just tested a minute ago). Is GitHub's login code open source?

I don't believe it is, however looking at the prompt in the past it stores the transports and prompts with it in the future.
The plugin is kinda stuck, as the library we're using doesn't store the transports and was never really designed to do it.

Testing here with a couple Yubikey 5 NFCs, Firmware 5.4.3.

Hmm.. that the exact same key as I have then.

I was able to add back a WebAuthn config, but the U2F config just runs a spinner and never completes.

The U2F stuff is from the two-factor plugin, and is not operational (for at least a year), that's why this plugin exists. You can ignore the U2F section.

The surprise to me is that after re-adding the WebAuthn config, which this time used the macOS dialog, I was able to log in with the Yubikey.

Great! I think that is making me think this is a algorithm issue; unfortunately I don't really know how to debug this though.. without being able to reproduce it.. I'm thinking maybe I need to try setting up the key with a much older version of Firefox and the plugin.. Do you have any idea as to the approximate time you would've added the key?

I'm thinking maybe I need to try setting up the key with a much older version of Firefox and the plugin.. Do you have any idea as to the approximate time you would've added the key?

Oh! You had it in the U2F section too? That means you setup the key prior to the webauthn plugin being installed, which yeah I'm 99% certain now that this is a algorithm issue.  To duplicate this I'd need to setup a key with a much older browser that still supported U2F.
We might be able to do something like "If this key was added via U2F don't present transports; If it was setup with webauthn offer them"

I'm also using a YubiKey 5NFC with firmware 5.4.3 that I set up before WebAuthn was available.

Don't know that it matters here, but I've never enabled iCloud keychain - (I have no plans to do so. Apple are internet dilletantes, and I want no part. Disagree? Contact me on AppleLink. No, wait, eWorld. Sorry, no, iMessage. Oops, I mean my .mac account. Or is that mobile.me?)

Do you have any idea as to the approximate time you would've added the key?

Probably added around 11:12 AM EDT (UTC-4:00) today (local Oct 8, 24)


IIS8.5 - Deployments fails with VS 2017 build tools(v15) installed but worked with VS2015 (v14)

For deployment issues, please provide us with the following information:

Error:
The target "pipelinePreDeployCopyAllFilesToOneFolder" does not exist in the project.
Server is Windows 2012 R2 with IIS 8.5 installed
Initially had VS 2017 installed with MSBuild 15
Websites built using ASP.net 4.6.2
Kudu was working fine until the build process.  I was able to manually build using my own bat files from the repository folder to www folder.
I tried with different websites and still getting the same error when building.
Uninstalled VS 2017
Installed VS 2015 with MSBuild 14.
Websites not building fine after pushing to remote branch.

@vijayrkn, is pipelinePreDeployCopyAllFilesToOneFolder not supported on msbuild 15?
/cc @watashiSHUN

These targets are part of WAP targets that ships along with VS (it should get installed when build components are selected during VS install). These are not shipped inside msbuild.
It is supported with msbuild 15 but the targets needs to be available in the msbuild 15 folder similar to msbuild14 (either needs to be copied over or installed).

Ah, right. This is in fact the way it always was.
If you copy %ProgramFiles(x86)%\Microsoft Visual Studio\2017\Enterprise\MSBuild\Microsoft\VisualStudio\v15.0 from your VS machine to your server, that should fix it.
Note that this is not a Kudu issue. It's about getting msbuild working in general on that server.


Memory leak when using docx.Document() with io.Bytes

Line #    Mem usage    Increment  Occurrences   Line Contents
=============================================================
    37     65.7 MiB     65.7 MiB           1   @profile
    38                                         def process_docx(docx_stream: IO[bytes]) -> list[str]:
    39                                             """
    40                                             Process a DOCX document and extract text and images.
    41
    42                                             Args:
    43                                                 docx_stream (IO[bytes]): The input DOCX file stream.
    44
    45                                             Returns:
    46                                                 list[str]: A list of extracted text and images from the document.
    47                                             """
    48     65.8 MiB      0.0 MiB           1       zip_file = zipfile.ZipFile(docx_stream)
    49     71.3 MiB      5.6 MiB           1       document = docx.Document(docx_stream)
    50                                             #docx_stream.close()
    51
    52     71.3 MiB      0.0 MiB           1       image_rels = {}
    53     71.3 MiB      0.0 MiB          28       for rel in document.part.rels.values():
    54     71.3 MiB      0.0 MiB          27           if isinstance(rel._target, docx.parts.image.ImagePart):
    55     71.3 MiB      0.0 MiB           1               image_rels[rel.rId] = rel._target.partname
    56
    57     71.3 MiB      0.0 MiB           1       image_paragraphs = []
    58     71.3 MiB      0.0 MiB           1       text_pages = []
    59     71.3 MiB      0.0 MiB           1       current_page_text = ''
    60     75.2 MiB      0.1 MiB         129       for element in document.iter_inner_content():
    61     75.2 MiB      0.0 MiB         128           if isinstance(element, docx.text.paragraph.Paragraph):
    62     75.2 MiB      0.0 MiB         125               current_page_text += element.text + '\n'
    63     75.2 MiB      0.1 MiB         125               if 'graphicData' in element._p.xml or 'Graphic' in element._p.xml:

There is an increment in size there, but the memory is never released even when the function ends its execution, any solutions?
PS: I tested and with file path it has the same issue

Not sure how to interpret your figure, can you point out more specifically what you're seeing there and what you expect it to be?

The same problem, and using gc.collect() solves it.

Sorry, It was not releasing memory, but once I added gc.collector after calling the function it cleaned it.

I tried the same thing, and enabled the gc.collect() manually, but the memory leak are still existing. can you show me what is solution from your side, thanks

Sorry, It was not releasing memory, but once I added gc.collector after calling the function it cleaned it.

I tried the same thing, and enabled the gc.collect() manually, but the memory leak are still existing. can you show me what is solution from your side, thanks

Same problem but gc.collect() doesn't work.
def extract(self, url: str, limit: int) -> ExtractResult:
    data = self.get_url(url)
    document = Document(io.BytesIO(data))
    content = parse_docx(document, limit)
    del document
    del data
    gc.collect()
    return ExtractResult(content=content, title="")

Sorry, It was not releasing memory, but once I added gc.collector after calling the function it cleaned it.

I tried the same thing, and enabled the gc.collect() manually, but the memory leak are still existing. can you show me what is solution from your side, thanks

Same problem but gc.collect() doesn't work.
def extract(self, url: str, limit: int) -> ExtractResult:
    data = self.get_url(url)
    document = Document(io.BytesIO(data))
    content = parse_docx(document, limit)
    del document
    del data
    gc.collect()
    return ExtractResult(content=content, title="")

Memory leak happens on some large document. like this:
Uploading 新建 DOCX 文档.docx…


proxies

proxies are a feature i have been wanting to do for a long time, but never really focused on it.

i just noticed that you can literally pass proxies as cli args already


HADOOP-17999: Do not initialize all target FileSystems for setWriteChecksum and setVerifyChecksum

JIRA: https://issues.apache.org/jira/browse/HADOOP-17999

Description of PR
All the target filesystems corresponding to mount points are initialized in setWriteChecksum and setVerifyChecksum methods. This PR initializes the filesystems lazily
How was this patch tested?
Added unit tests. Also for large number of mount points, hadoop cli commands such as get, put or copyFromLocal were throwing OOM. With the fix, the commands were successful.
For code changes:

[ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 43s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 1 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
35m 57s

trunk passed

+1 :green_heart:
compile
21m 51s

trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04

+1 :green_heart:
compile
19m  5s

trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

+1 :green_heart:
checkstyle
1m  9s

trunk passed

+1 :green_heart:
mvnsite
1m 36s

trunk passed

+1 :green_heart:
javadoc
1m 10s

trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04

+1 :green_heart:
javadoc
1m 44s

trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

+1 :green_heart:
spotbugs
2m 24s

trunk passed

+1 :green_heart:
shadedclient
21m 44s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 55s

the patch passed

+1 :green_heart:
compile
20m 56s

the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04

+1 :green_heart:
javac
20m 56s

the patch passed

+1 :green_heart:
compile
18m 52s

the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

+1 :green_heart:
javac
18m 52s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
1m  6s

the patch passed

+1 :green_heart:
mvnsite
1m 34s

the patch passed

+1 :green_heart:
javadoc
1m  6s

the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04

+1 :green_heart:
javadoc
1m 39s

the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

+1 :green_heart:
spotbugs
2m 33s

the patch passed

+1 :green_heart:
shadedclient
21m 40s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
17m 16s

hadoop-common in the patch passed.

+1 :green_heart:
asflicense
0m 58s

The patch does not generate ASF License warnings.

196m 46s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3639/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/3639

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell

uname
Linux 986aa11af17d 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / eb54f19a2b65c3e6aa85b9882039cd7019b57e4b

Default Java
Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3639/1/testReport/

Max. process+thread count
1258 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3639/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 51s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

-1 :x:
mvninstall
0m 23s
/branch-mvninstall-root.txt
root in trunk failed.

-1 :x:
compile
0m 23s
/branch-compile-root-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt
root in trunk failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.

-1 :x:
compile
0m 23s
/branch-compile-root-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt
root in trunk failed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.

-0 :warning:
checkstyle
0m 20s
/buildtool-branch-checkstyle-hadoop-common-project_hadoop-common.txt
The patch fails to run checkstyle in hadoop-common

-1 :x:
mvnsite
0m 23s
/branch-mvnsite-hadoop-common-project_hadoop-common.txt
hadoop-common in trunk failed.

-1 :x:
javadoc
0m 23s
/branch-javadoc-hadoop-common-project_hadoop-common-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt
hadoop-common in trunk failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.

-1 :x:
javadoc
0m 22s
/branch-javadoc-hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt
hadoop-common in trunk failed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.

-1 :x:
spotbugs
0m 23s
/branch-spotbugs-hadoop-common-project_hadoop-common.txt
hadoop-common in trunk failed.

+1 :green_heart:
shadedclient
2m 38s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

-1 :x:
mvninstall
0m 23s
/patch-mvninstall-hadoop-common-project_hadoop-common.txt
hadoop-common in the patch failed.

-1 :x:
compile
0m 23s
/patch-compile-root-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt
root in the patch failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.

-1 :x:
javac
0m 23s
/patch-compile-root-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt
root in the patch failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.

-1 :x:
compile
0m 23s
/patch-compile-root-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt
root in the patch failed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.

-1 :x:
javac
0m 23s
/patch-compile-root-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt
root in the patch failed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

-0 :warning:
checkstyle
0m 21s
/buildtool-patch-checkstyle-hadoop-common-project_hadoop-common.txt
The patch fails to run checkstyle in hadoop-common

-1 :x:
mvnsite
0m 22s
/patch-mvnsite-hadoop-common-project_hadoop-common.txt
hadoop-common in the patch failed.

-1 :x:
javadoc
0m 23s
/patch-javadoc-hadoop-common-project_hadoop-common-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt
hadoop-common in the patch failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.

-1 :x:
javadoc
0m 24s
/patch-javadoc-hadoop-common-project_hadoop-common-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt
hadoop-common in the patch failed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.

-1 :x:
spotbugs
0m 22s
/patch-spotbugs-hadoop-common-project_hadoop-common.txt
hadoop-common in the patch failed.

+1 :green_heart:
shadedclient
4m 21s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
0m 23s
/patch-unit-hadoop-common-project_hadoop-common.txt
hadoop-common in the patch failed.

+0 :ok:
asflicense
0m 23s

ASF License check generated no output?

12m 49s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3639/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/3639

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell

uname
Linux 784f5a89cd40 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / e6621db13de437453dffc921413f679613bd8a7e

Default Java
Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3639/2/testReport/

Max. process+thread count
42 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3639/2/console

versions
git=2.25.1 maven=3.6.3

Powered by
Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 58s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 2 new or modified test files.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
35m 20s

trunk passed

+1 :green_heart:
compile
23m 45s

trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04

+1 :green_heart:
compile
20m 14s

trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

+1 :green_heart:
checkstyle
1m  2s

trunk passed

+1 :green_heart:
mvnsite
1m 36s

trunk passed

+1 :green_heart:
javadoc
1m  7s

trunk passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04

+1 :green_heart:
javadoc
1m 40s

trunk passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

+1 :green_heart:
spotbugs
2m 28s

trunk passed

+1 :green_heart:
shadedclient
25m  3s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
1m  0s

the patch passed

+1 :green_heart:
compile
23m 10s

the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04

+1 :green_heart:
javac
23m 10s

the patch passed

+1 :green_heart:
compile
20m 15s

the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

+1 :green_heart:
javac
20m 15s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 59s

the patch passed

+1 :green_heart:
mvnsite
1m 32s

the patch passed

+1 :green_heart:
javadoc
1m  3s

the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04

+1 :green_heart:
javadoc
1m 44s

the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

+1 :green_heart:
spotbugs
2m 39s

the patch passed

+1 :green_heart:
shadedclient
25m 47s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
17m  8s

hadoop-common in the patch passed.

+1 :green_heart:
asflicense
0m 50s

The patch does not generate ASF License warnings.

209m 11s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3639/4/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/3639

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell

uname
Linux 0e3a6e9c5342 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / e6621db13de437453dffc921413f679613bd8a7e

Default Java
Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3639/4/testReport/

Max. process+thread count
1252 (vs. ulimit of 5500)

modules
C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3639/4/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

+1 for the past patch.
Looks like yetus also approves.
Will commit this shortly.


Simplification and Normalization of Standard Apps Deployment

Deployment of applications on Kubernetes is facilitated by Helm and requires some amount of maintenance to keep running smoothly, it would be useful to have this organized to help facilitate this.

[x] Add a feature to help in private deployments
[x] Merge previous work into current develop and master branches
[x] Maintain-suggest a version numbering
[ ] Collect current work and set numbers.
[x] Convert heal deployments
[ ] Convert BDC deployments
[x] Add metrics tracking data processing efficiency

== Updates
=== Items Update
Added a metrics item, this is a monthly ongoing item
=== HEAL deployments
Monthy update to heal deployments is in progress
=== BDC deployments
BDC dev has been updated to deploy like the others
Maintenance of other deployments is in progress
BDC production conversion remains blocked
=== Versioning
Monthly version  maintenance is in progress


How can I disable searchable when Elasticsearch node not available?

I use only 1 server to host Elasticsearch, when the instance down, I will fallback to use normal query search.
But the problem is, when user try to save the model, it throws
Elasticsearch\Common\Exceptions\NoNodesAvailableException: No alive nodes found in your cluster

Is it possible to disable this, and let user save it? I understand that it may have data inconsistency. But it's fine for my use case.

I've found a workaround
In the model class
<?php
namespace App\Models;
...
class MyModel extends BaseModel
{
    use SoftDeletes, \ScoutElastic\Searchable;
    ...

    /**
     * Determine if the model should be searchable.
     *
     * @return bool
     */
    public function shouldBeSearchable()
    {
        $host = config('scout_elastic.client.hosts.0');
        $ch = curl_init();
        curl_setopt($ch, CURLOPT_URL, $host);
        curl_exec($ch);
        if (curl_error($ch)) {
            config(['scout.driver' => null]);
            return false;
        }
        curl_close($ch);
        return true;
    }
}

Override the scout trait, set the driver to null if the instance down


Include defensive stats for NCAAF teams

Is your feature request related to a problem? Please describe.
I am writing an app that currently leverages the offensive team stats pulled from sportsreference - I would like to pull the defensive stats as well.
Describe the solution you'd like
As many defensive team stats (for a given year) as makes sense/are available should be returned alongside the offensive team stats.
Additional context
https://www.sports-reference.com/cfb/years/2019-team-defense.html

Thanks again for the work here @ajhodges! Your PR looks great and I'm excited to include this work!

Happy to help! Love the package and glad I can contribute.


pip & pip-tools incompatibility

Is there an existing issue for this?

[X] I have searched the existing issues

Package ecosystem
Python
Package manager version
No response
Language version
Python 3.9
Manifest location and content before the Dependabot update
No response
dependabot.yml content
No response
Updated dependency
No response
What you expected to see, versus what you actually saw
We're seeing failures to update any of our Python dependencies for the past several weeks. We use pip-tools to manage our lock files and it seems that dependabot is getting tripped up on a recently introduced incompatibility between pip-tools and pip itself.
We're seeing the following traceback for each dependency in the dependabot log:
updater | 2023/05/03 13:56:45 ERROR <job_656628458> Error processing importlib-metadata (Dependabot::SharedHelpers::HelperSubprocessFailed)
updater | 2023/05/03 13:56:45 ERROR <job_656628458> Using indexes:
updater |   https://<redacted>/python/simple/
updater |   https://pypi.python.org/simple
updater | Traceback (most recent call last):
updater |   File "/usr/local/.pyenv/versions/3.9.16/bin/pip-compile", line 8, in <module>
updater |     sys.exit(cli())
updater |   File "/usr/local/.pyenv/versions/3.9.16/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
updater |     return self.main(*args, **kwargs)
updater |   File "/usr/local/.pyenv/versions/3.9.16/lib/python3.9/site-packages/click/core.py", line 1055, in main
updater |     rv = self.invoke(ctx)
updater |   File "/usr/local/.pyenv/versions/3.9.16/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
updater |     return ctx.invoke(self.callback, **ctx.params)
updater |   File "/usr/local/.pyenv/versions/3.9.16/lib/python3.9/site-packages/click/core.py", line 760, in invoke
updater |     return __callback(*args, **kwargs)
updater |   File "/usr/local/.pyenv/versions/3.9.16/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
updater |     return f(get_current_context(), *args, **kwargs)
updater |   File "/usr/local/.pyenv/versions/3.9.16/lib/python3.9/site-packages/piptools/scripts/compile.py", line 589, in cli
updater |     results = resolver.resolve(max_rounds=max_rounds)
updater |   File "/usr/local/.pyenv/versions/3.9.16/lib/python3.9/site-packages/piptools/resolver.py", line 545, in resolve
updater |     wheel_cache = WheelCache(
updater | TypeError: __init__() takes 2 positional arguments but 3 were given

This appears to be the same issue as described here: https://github.com/jazzband/pip-tools/issues/1854
We had been seeing this locally too and upgrading pip-tools to 6.13.0 fixed it for us in our local environments.
From a quick look it seems that dependabot pins the versions of these tools here: https://github.com/dependabot/dependabot-core/blob/main/python/helpers/requirements.txt and that pip was updated just last week here: https://github.com/dependabot/dependabot-core/pull/7097/files
Is it possible the pip update triggered the incompatibility? AFAIK upgrading pip-tools to 6.13.0 should resolve the issue.
Native package manager behavior
No response
Images of the diff or a link to the PR, issue, or logs
No response
Smallest manifest that reproduces the issue
No response

I missed this issue in my initial search, but there's an open PR that i think would fix the issue (and another report) over at https://github.com/dependabot/dependabot-core/pull/7034

#7034 is merged and deployed. Looks like it fixed similar issues for other folks so I'll close this, but let us know if you're still having issues.


hotfix: essd PerformanceLevel sync

这个 PR 实现什么功能/修复什么问题:
阿里云支持ESSD规格信息
是否需要 backport 到之前的 release 分支:

release/2.10.0

/area region
/cc @swordqiu @yousong

Codecov Report

Merging #2135 into master will increase coverage by 0.01%.
The diff coverage is 0%.

@@            Coverage Diff            @@
##           master   #2135      +/-   ##
=========================================
+ Coverage    7.13%   7.15%   +0.01%
=========================================
  Files         451     451
  Lines       70323   70331       +8
=========================================
+ Hits         5019    5030      +11
+ Misses      64891   64889       -2
+ Partials      413     412       -1

Flag
Coverage Δ

#aFlag
7.15% <0%> (+0.01%)
:arrow_up:

Impacted Files
Coverage Δ

pkg/compute/guestdrivers/aliyun.go
5.2% <0%> (-0.48%)
:arrow_down:

pkg/util/rbacutils/rbac.go
74.3% <0%> (+3.4%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 727e537...fd6ef3e. Read the comment docs.

/approve
/lgtm


Use AppEngineFlexHandler on prod

lgtm

Coverage decreased (-0.06%) to 98.278% when pulling 008765e9dccb4afbc4b469c02758328609bb8af4 on flex-handler into 134b3357fa1eecd8fad46f912b32883a201ad412 on master.

Thanks @JustinBeckwith
I'm also running the full test suite (including deployment e2e tests) on our jenkins server. I will merge this once it passes.

Coverage decreased (-0.05%) to 98.291% when pulling 32ffae30941ca20ee7ff91b3509b5a3d4a97dedb on flex-handler into 134b3357fa1eecd8fad46f912b32883a201ad412 on master.

this looks great!

Thanks guys. Merging.


Rollback

Hi,
I know this is not an issue, but couldn't find better place to ask.
From docs, if deployment is not successful, for any reason, e.g. syntax error in config file or permissions on remote server, any error...  it will auto preserve previous deployment version, there is no need to execute "rollback" command?
Thanks

Hello.
Yes, the new version is not deployed in case of error.  Except for errors in the post_deploy hock

Hi,
Thank you for the clarification.


chore: bdd-spring-1584879761 to 0.0.1

chore: Promote bdd-spring-1584879761 to version 0.0.1

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approvers:
If they are not already assigned, you can assign the PR to them by writing /assign  in a comment when ready.
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


Remove git add in lint-stage

WHAT THE PROBLEM
We get a warning from git when we run git commit, this I because we do git add twice in lint-staged
SUGGESTION
We should remove the git add from the lint-stage config in the package.json, here and here

@MichalPorag I would like to take this 😸


Tabnine doesn't work

please complete the following information:

OS version: Kubuntu 20.04
Editor version: VS Code March 2021 (version 1.55)
Programming language: [e.g. js, ts, c++]
TabNine extension version:

Tabnine doesn't work, no open Tabnine Hub. I try to reinstall, doesn't work. No complete.

Thank you


Using multiple font faces

When trying to set up multiple '@font-face' it seems to always load the font that is declared last and ignore the first.
Take this example
'@font-face': {
  Roboto: {
    fontStyle: 'normal',
    fontWeight: 'normal',
    srcPaths: ['fonts/Roboto.woff2', 'fonts/Roboto.ttf'],
  },
  Roboto2: {
    fontStyle: 'normal',
    fontWeight: 'normal',
    srcPaths: ['fonts/Roboto2.woff2', 'fonts/Roboto2.ttf'],
  },
}

In the network Tab I would get Roboto2 downloading and being used around the site but not Roboto.
Tried Lots of different implementations after seeing this jss issue
Unsure if its implementation or a limitation at this point?

So you're using JSS yeah?
Could you screenshot/paste me what the compiled CSS looks like by chance? And what the font-family on the element looks like?

The code for implementation is.

The compiled css in the DOM is

Stripped the Font stack on Html back to just the imported for testing.

Awesome thanks, will look into.
That data-meta also looks suspect.

Bug has been fixed in 2.3.2, thanks for the report!


Arc-2599 part 2 connection panel main pending and duplicate

What's in this PR?
Add content for DUPLICATION/PENDING states in the connection panel.

Added feature flags
RENOVATED_JENKINS_FOR_JIRA_CONFIG_FLOW
Affected issues
Arc-2599
How has this been tested?
dev & staging
What's Next?
Going to add content for the set up guide.


[SEP] Send tasks

Support for send tasks.
IMPORTANT NOTE: this should maybe not be merged, since we did not include this in the final iteration @JortvD please correct me if I am wrong. But I left it here so the work can be viewed.

Hello, @JuanvdHeijden are you sure you want to merge this branch? Because this was more of an undeveloped idea that we did not use in the final version.


[Feature] API Show New User Profile Fields

Fixes bug #4203
Purpose
In the API, users that have not filled out the any social fields in their profile will not show social media fieldnames. There is just a blank dictionary labeled social_accounts.

To provide consistent user experience and to encourage users to fill out their profiles, we will now show all social fields even if they do not exist on the database.
Changes
User fields are shown on new users and ones without any social media information filled out.
Side Effects
All User social fields are stored at the top level of the JSON object, not one level down in the social_accounts dictionary.
Before:

Now:

First pass done. :penguin: Looks good, but make it a bit more generic and a little more DRY, but the general approach is great and should do just what we want.

In the current API implementation, when updating a field in the social dictionary, it is the only field written.  So, for example, when you patch a new user's github field, it will only add 'github':'newGitHub" to the social dictionary, but not add 'personal': '' or any other social key.  This is different then the OSF, which writes all of the keys to the social dictionary when any field is updated.
The blank fields are created by the serializer in the API (the reason for this PR), but only the modified keys and values are written to the DB.
So, a PATCH or PUT has different behavior then currently exists on the osf.  No tests fail, all fields write correctly, and my functional testing has turned up no errors on the osf or the api.  We could add the missing blank fields when we do any write (like the OSF), but that seems not 100% inline with the DRF specifications.  @sloria, @brianjgeiger, thoughts?
Make sense?

I think keep it as you have it. I don't see the need to replicate OSF functionality in the API.

Looks good to me. :tada: :penguin: :tada: Looks ready for @sloria.

#OSF-4257

WIth the current approach, you would have to make a subclass for every field that you want to allow a missing attribute. This is not ideal.
How about using composition instead?
twitter = AllowMissing(CharField(source='social.twitter', ...))

Pass finished.

There seems to be some django rest inheritance issues with using a composition.  Since this is a specific use case, I think overriding the two DRF classes to test for blanks is the best solution.

What, specifically, are the problems?

The error I am getting is
My composed class is running the Field class' to_representation function, when it should be running the specific field's (CharField) to_representation.
Here is the specific error message.
AllowMissing.to_representation() must be implemented.
If you are upgrading from REST framework version 2 you might want `ReadOnlyField`.

and my implementation
class AllowMissing(ser.Field):

    def __init__(self, *args, **kwargs):
        super(AllowMissing, self).__init__(*args, **kwargs)

    def get_attribute(self, instance):
        """
        Overwrite the error message to return a blank value is if there is no existing value.
        This allows the display of keys that do not exist in the DB (gitHub on a new OSF account for example.)
        """
        try:
            Field.get_attribute(self, instance)
        except SkipField:
            return ''

You should probably follow the advice in that error message. =) It's telling you that fields subclasses must implement to_representation.

Just a few last minor changes.

Replaced by #4357


Added separator and empty footer to improvement UI

This is a really great theme overall, and after using it I found several possible UI improvements.
1. Added separators between navbar items to provide better visual.
Before
 .
After

And this won't affect mobile experience as these separators are set to display:none on the small screen as shown here:
.
2. Added an empty footer for pages/posts without tags to avoid narrow bottom part.
As shown on the demo's search page:

The bottom border of the last result would be too close to the outer layer's bottom border, which is not perfect.

A simple fix is to add an empty footer element to each page/post, resulting in:
.
Also, without this change, posts with feature-image but without tags would have inconsistent looking.
Before:

After:

Hi!
Thanks for the pull request. I will review it asap :wink:

Yup, I like the improvement.
The footer improvement it is great!
On my side I like that there are no bars but I like the space in between. Since you can change the opacity settings, I am good with it ;)
I have come to realize thought that the menu is getting bigger and bigger. I should look into refactoring that into a loop. Do you think you can help on that (to avoid the copy and paste of html)? Let me know.

I Just read docs about Liquid template language. I'm afraid that there is no simply solution to use a loop instead of hard coding each nav item.
( loop involves array, but you can't initialize array in this template language...)

I don't like repeating codes too. Maybe we could write some JavaScript to I sent this separator afterwards, or simply fake it with some css, or simply set margin-left for these elements.

Ok, thanks, then I will look into it later.


StackEdit - Login to Resume Document Management?

I'm a new user of StackEdit. I was working on a few documents, created a folder to store those documents, and exited my browser session. Is there any way to get back to manage the documents I was working on? There doesn't appear to be a login of any type.
Any advice on how I can resume my work at a later time would be most appreciated.
Thank you,
Tony

Please try the new login feature in the v5 (https://stackedit.io/app).

Could you provide some explanation about what this login feature provides. I did a "reset application", then signed back in and all my files were back. Does that mean I don't really need to sync them to Drive/Gist etc, if I don't have collaborators? Or can the files still be gone if I clear browser cache/cookies/whatnot? Where do those files reside? Inside the profile? (Using Firefox Quantum here.)
Say I can sync every file to Gist, so they are not lost. What about the folder structure in the Explorer pane, what action can cause me to lose that?
Thanks.


Rollback Lato to v1

v2 drops letters on certain systems. This seems to have been a common problem if you google for "Lato font missing letters" and we have received some reports of it from some users. Apparently this is the reason why Google dropped Lato v2 - it just doesn't work.

Done b610aac567d1ef660db9aa6f458f02c0719cd823


Exception in HubConnectionBuilder.Build using .net5 preview 8

I have a working Blazor WASM project, which connects to a server hub with SignalR. I was excited to finally try it out with all the .net 5 improvements now that preview 8 is out - I couldn't use preview 7 because it would throw an exception trying to decompress gzip, which I use to compress the JSON that I send to and from the hub.
With preview 8, I get this stack when trying to call HubConnectionBuilder.Build:
      Unhandled exception rendering component: Exception has been thrown by the target of an invocation.
System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation.
 ---> System.PlatformNotSupportedException: System.Security.Cryptography is not supported on this platform.
   at System.Security.Cryptography.X509Certificates.X509CertificateCollection..ctor()
   at Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions..ctor()
   at System.Reflection.RuntimeConstructorInfo.InternalInvoke(Object obj, Object[] parameters, Boolean wrapExceptions)
   --- End of inner exception stack trace ---
   at System.Reflection.RuntimeConstructorInfo.InternalInvoke(Object obj, Object[] parameters, Boolean wrapExceptions)
   at System.RuntimeType.CreateInstanceMono(Boolean nonPublic, Boolean wrapExceptions)
   at System.RuntimeType.CreateInstanceSlow(Boolean publicOnly, Boolean wrapExceptions, Boolean skipCheckThis, Boolean fillCache)
   at System.RuntimeType.CreateInstanceDefaultCtor(Boolean publicOnly, Boolean skipCheckThis, Boolean fillCache, Boolean wrapExceptions)
   at System.Activator.CreateInstance[HttpConnectionOptions]()
   at Microsoft.Extensions.Options.OptionsFactory`1[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].CreateInstance(String name)
   at Microsoft.Extensions.Options.OptionsFactory`1[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].Create(String name)
   at Microsoft.Extensions.Options.OptionsManager`1.<>c__DisplayClass5_0[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].<Get>b__0()
   at System.Lazy`1[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].ViaFactory(LazyThreadSafetyMode mode)
   at System.Lazy`1[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor)
   at System.Lazy`1[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].CreateValue()
   at System.Lazy`1[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].get_Value()
   at Microsoft.Extensions.Options.OptionsCache`1[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].GetOrAdd(String name, Func`1 createOptions)
   at Microsoft.Extensions.Options.OptionsManager`1[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].Get(String name)
   at Microsoft.Extensions.Options.OptionsManager`1[[Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionOptions, Microsoft.AspNetCore.Http.Connections.Client, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60]].get_Value()
   at Microsoft.AspNetCore.Http.Connections.Client.HttpConnectionFactory..ctor(IOptions`1 options, ILoggerFactory loggerFactory)
   at System.Reflection.RuntimeConstructorInfo.InternalInvoke(Object obj, Object[] parameters, Boolean wrapExceptions)
   at System.Reflection.RuntimeConstructorInfo.DoInvoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at System.Reflection.RuntimeConstructorInfo.Invoke(BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.Object, System.Private.CoreLib, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(ServiceCallSite callSite, RuntimeResolverContext argument)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitCache(ServiceCallSite callSite, RuntimeResolverContext context, ServiceProviderEngineScope serviceProviderEngine, RuntimeResolverLock lockType)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite singletonCallSite, RuntimeResolverContext context)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.Object, System.Private.CoreLib, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(ServiceCallSite callSite, RuntimeResolverContext argument)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeServiceProviderEngine.<>c__DisplayClass1_0.<RealizeService>b__1(ServiceProviderEngineScope p)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeServiceProviderEngine.<>c__DisplayClass1_0.<RealizeService>b__0(ServiceProviderEngineScope scope)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngine.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngine.GetService(Type serviceType)
   at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType)
   at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetService[IConnectionFactory](IServiceProvider provider)
   at Microsoft.AspNetCore.SignalR.Client.HubConnectionBuilder.Build()
   at test.Client.Pages.Index.OnInitializedAsync()
   at Microsoft.AspNetCore.Components.ComponentBase.RunInitAndSetParametersAsync()

I then tried making a new project based on the instructions on this page, and I see the same behavior there.
Is there something that needs to be updated about the HubConnectionBuilder or some dependency? Or is this just broken in preview 8?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 08de9daf-79aa-ee76-431e-f2432f8d691e
Version Independent ID: 1a1ee728-1741-c82a-75e1-06159709935b
Content: Use ASP.NET Core SignalR with Blazor WebAssembly
Content Source: aspnetcore/tutorials/signalr-blazor-webassembly.md
Product: aspnet-core
Technology: aspnetcore-tutorials
GitHub Login: @guardrex
Microsoft Alias: riande

Hello @comet56us ... Open that for engineering at ...
https://github.com/dotnet/aspnetcore/issues

btw --- Please add a cc: @guardrex to your issue over there so that I can follow the discussion. I'll re-open this issue if we need to do work on the topic. Thx! :beers:


Message Tracker - External Authenticated Service

Problem statement
As an external authenticated user sender or receiver, I would like the ability to search for one or multiple msgIDs to understand what happened to it and why it did not make it to the expected state
The purpose of this is to help users to self-serve with troubleshooting errors with message delivery via ReportStream.
What you need to know
Mural with initiative break-down https://app.mural.co/t/primedatainput6410/m/primedatainput6410/1660849046968/e257020850ab71f57b31120e27ec06203ae9c22b?sender=u3fea607b46e84058d3224917
Wireframe for the ongoing work on this feature
https://www.figma.com/file/fKl2M96ylkxYezwjVVUSIX/Internal-Admin-%26-Tools?node-id=411%3A1069
Acceptance criteria
External authenticated user is able to search for multiple  test results to get information about

success in being delivered or the reason why it was not delivered
all associated dates, facility, organization, report ID and other related data

To do

Research if this feature should be built and with what scope.
Design Wireframes, flow and IA
Scope out requirements from O&O for display and export of data

cc @HeatherRienks

With ongoing STLT feature improvements, we should reassess how this functionality can fit into the wonderful features in design right now, such as the Facility features for STLTs! @chris-kuryak @CnoteNava @HeatherRienks

Per conversation with O+O engineers (James and Ott and Tom G), making the message tracker feature available to Senders and Receivers (not just RS admins) is not needed at this time and should be rescoped in the future if/when it is needed.
cc: @HeatherRienks @stephenkao


Uml 817 abstract out code verification

Purpose
Abstracts our actor one time use code usage and verification out into a strategy interface so that we can replace it with the new microservice that deals with those things
Fixes UML-817
Approach
Creation of a new CodeValidationStrategyInterface and associated DynamoCodeValidationStrategy to migrate our existing strategy to the new interface.
Checklist

[x] I have performed a self-review of my own code
[x] I have added relevant logging with appropriate levels to my code
[ ] I have updated documentation (Confluence/GitHub wiki/tech debt doc) where relevant
[x] I have added tests to prove my work
[ ] The product team have tested these changes

Coverage decreased (-1.5%) to 79.147% when pulling ed096088f04f6f7964b578aea3035883d49e6241 on UML-817-abstract-out-code-verification into a30f70ed666faca8305c334c65cf0824b2541119 on master.


Optimise FastAggregation#and by cloning the lowest cardinality bitmap

Is your feature request related to a problem? Please describe.
I noticed that FastAggregation#and was consuming a lot of time in RoaringArray#clone. It turned out that I was anding bitmaps with greatly different cardinalities; e.g. on bitmap with 100k+ and another with < 100 bits set with an intersection of ~ 10 bits.
Describe the solution you'd like
It would be ideal if FastAggregation optimises this issue away. In a particular benchmark I'm running, selecting the bitmap with the lowest cardinality yields a ~4x performance improvement.
Selecting the smallest bitmap isn't straightforward with the current interface of FastAggregation#and for the form with an Iterator as argument. But the array version could easily use this heuristic and adding a version with a List<RoaringBitmap> or Collection could also work. I'd be happy to contribute this if desired.
The big question of course is what the cost of such optimisation is for cases with more homogeneous cardinalities. Any thoughts and feedback on this are welcome.

That's 100% reasonable and it does not look like a PR would be difficult to produce.
PR invited.

I've been working this a bit; some observations.
Given a benchmark setup:
@Param({"0.1", "0.5"})
double density;

@Param({"0.001", "0.01", "0.1", "0.5", "1.0"})
double overlap;

@Setup(Level.Trial)
public void setup() {
    int limit = 0x100000;
    int cardinality1 = (int) (limit * density);
    int cardinality2 = (int) (cardinality1 * overlap);

    SplittableRandom random = new SplittableRandom(42);

    bitmap1 = new RoaringBitmap();
    while (bitmap1.getCardinality() < cardinality1) {
        bitmap1.add(random.nextInt(limit));
    }

    bitmap2 = selectRandom(cardinality2, random);
    bitmap3 = selectRandom(cardinality2, random);
    bitmap4 = selectRandom(cardinality2, random);

    bitmaps = List.of(bitmap1, bitmap2, bitmap3, bitmap4);
}

private RoaringBitmap selectRandom(int cardinality, SplittableRandom random) {
    int[] ints = bitmap1.toArray();

    for (int i = 0; i < cardinality; i++) {
        int tmp = ints[i];
        int j = random.nextInt(bitmap1.getCardinality());
        ints[i] = ints[j];
        ints[j] = tmp;
    }

    ints = Arrays.copyOf(ints, cardinality);
    partialRadixSort(ints);

    return RoaringBitmap.bitmapOf(ints);
}

and benchmarks like:
return FastAggregation.and(bitmaps.iterator());

return FastAggregation.and(bitmaps.toArray(RoaringBitmap[]::new));

RoaringBitmap[] array = bitmaps.toArray(RoaringBitmap[]::new);
Arrays.sort(array, Comparator.comparing(RoaringBitmap::getLongSizeInBytes));
return FastAggregation.and(array);

List<RoaringBitmap> list = new ArrayList<>(bitmaps);
list.sort(Comparator.comparingLong(RoaringBitmap::getLongSizeInBytes));
return FastAggregation.and(list.iterator());

I get the impression that for 'overlap densities' of 0.1 and less, sorting the input by its cardinality, size or something similar improves performance.
When comparing the array version of FastAggregation.and with the iteration version over a size-sorted list:

Performance increase is worthwhile when the first bitmap has a density of 50% and the subsequent bitmaps have a density overlap of 10% at a ~67% speed improvement.
At a density of 10% and overlap density of 10% the speed improvement is over 6x.
At a density of 10% and an overlap density of 0.1% the speed improvement is a whopping 39x!

So it seems the performance improvement is caused by sorting by size and using the naive_and implementation. There seems to be no performance increase when sorting the input by size in combination with the array version of FastAggregation.and.
Note that for density 10% with overlap density 0.1%, the iterator version of FastAggregation.and without sorting is over 2x faster than the array version!
However, at higher densities of the first bitmap (10% and 50%) and higher overlap densities (50% and 100%), the array version of FastAggregation.and has a clear overhand being 3 to 4x faster than the iterator version over bitmaps sorted by size.
I would appreciate feedback on this. @lemire / richardstartin?

Such problems are always data-dependent and so it is important to take a broad view and include many tests. We also include more than one approach in our API because not one approach can be best, it is all about tradeoffs.
Could you add FastAggregationRLEStressTest to your benchmarks?

    public void createBitmaps() {
      random = new SplittableRandom(seed);
      RoaringBitmapWriter<RoaringBitmap> bitmapWriter = constructionStrategy.create();
      bitmaps = new RoaringBitmap[count];
      bufferBitmaps = new ImmutableRoaringBitmap[count];
      double p = Math.pow(probability, 1D/count);
      for (int i = 0; i < count; ++i) {
        for (int j = (int)(Math.log(random.nextDouble())/Math.log(1-p));
             j < size;
             j += (int)(Math.log(random.nextDouble())/Math.log(1-p)) + 1) {
            bitmapWriter.add(j);
        }
        bitmaps[i] = bitmapWriter.get();
        bufferBitmaps[i] = bitmaps[i].toMutableRoaringBitmap();
        bitmapWriter.reset();
      }
    }

sorting the input by its cardinality, size or something similar improves performance.

You probably do not even need to sort. If you have a tiny bitmap, putting it first should help. I will add a remark to our documentation.

Putting the bitmap with the smallest number of containers first would be beneficial. This came up in Pinot, which sorts by ascending cardinality now, but having access to the containers allows for better worst case implications.

@richardstartin Added an issue: https://github.com/RoaringBitmap/RoaringBitmap/issues/611

closed through https://github.com/RoaringBitmap/RoaringBitmap/pull/612


Add detail and links to error message guidance in components

Resolves #32

 Error pattern needs to direct user to components for message details


Suspend Surface.sizeProvider

I'm going to call WebGPU from multiple threads, which it was designed for.
However, GLFW's glfwGetWindowSize can only be called from its own thread; therefore, I need to be able switch to that thread.
Currently, I'm using runBlocking; but this is a bad solution.
I would've wrapped Surface and hack in some form of cache, but Surface isn't an interface for no reason whatsoever, so I just can't.

Surface will be converted to an interface, as the implementation should be specific to the window API used. A GlfwSurface will be created within the toolkit, while other users will be able to create their own implementations.

Additionally: I believe sizeProvider should be deleted entirely. I don't see a reason for its existence besides initializing the surface? This could be done as a parameter, without a property/interface function, as it limits suspendability.


seatunnels&postgresql

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
我需要的使用场景是：将多源数据导入到postgresql数据库中
我在apache-seatunnel-2.3.3/plugins/jdbc/lib下放了postgresql-42.6.0.jar和postgis-jdbc-2021.1.0.jar两个jar包，都是从maven仓库里下载的，但当我执行测试脚本的时候，我遇到了报错，希望能帮我看看这个问题
SeaTunnel Version
2.3.3
SeaTunnel Config
env {
  execution.parallelism = 1
  job.mode = "BATCH"
}

source {
  jdbc {
    url = "jdbc:postgresql://<IP_ADDRESS>:5433/test"
    driver = "org.postgresql.Driver"
    user = "postgres"
    password = "testdb"
    query = "select * from testdb_0808"
  }
}

transform {
}

sink {
  Console {}
}

Running Command
/data/seaTunnel/apache-seatunnel-2.3.3/bin/seatunnel.sh --config /data/seaTunnel/apache-seatunnel-2.3.3/config/seatunnel.postgresql.conf.template -e local

Error Exception
2023-12-18 18:37:39,655 ERROR org.apache.seatunnel.core.starter.SeaTunnel -

===============================================================================

2023-12-18 18:37:39,655 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Fatal Error,

2023-12-18 18:37:39,655 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Please submit bug report in https://github.com/apache/seatunnel/issues

2023-12-18 18:37:39,655 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Reason:SeaTunnel job executed failed

2023-12-18 18:37:39,656 ERROR org.apache.seatunnel.core.starter.SeaTunnel - Exception StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
	at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:191)
	at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
	at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry
	at java.lang.Class.getDeclaredConstructors0(Native Method)
	at java.lang.Class.privateGetDeclaredConstructors(Class.java:2671)
	at java.lang.Class.getConstructor0(Class.java:3075)
	at java.lang.Class.getDeclaredConstructor(Class.java:2178)
	at org.postgresql.jdbc.PgConnection.getObject(PgConnection.java:739)
	at org.postgresql.jdbc.PgResultSet.getObject(PgResultSet.java:3020)
	at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.dialect.psql.PostgresJdbcRowConverter.toInternal(PostgresJdbcRowConverter.java:59)
	at org.apache.seatunnel.connectors.seatunnel.jdbc.internal.JdbcInputFormat.nextRecord(JdbcInputFormat.java:220)
	at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceReader.pollNext(JdbcSourceReader.java:63)
	at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:150)
	at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:95)
	at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168)
	at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:100)
	at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.ClassNotFoundException: net.postgis.jdbc.geometry.Geometry
	at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
	at org.apache.seatunnel.engine.common.loader.SeaTunnelBaseClassLoader.loadClassWithoutExceptionHandling(SeaTunnelBaseClassLoader.java:56)
	at org.apache.seatunnel.engine.common.loader.SeaTunnelChildFirstClassLoader.loadClassWithoutExceptionHandling(SeaTunnelChildFirstClassLoader.java:95)
	at org.apache.seatunnel.engine.common.loader.SeaTunnelBaseClassLoader.loadClass(SeaTunnelBaseClassLoader.java:47)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
	... 19 more

	at org.apache.seatunnel.engine.client.job.ClientJobProxy.waitForJobComplete(ClientJobProxy.java:122)
	at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:184)
	... 2 more

Zeta or Flink or Spark Version
No response
Java or Scala Version
No response
Screenshots
No response
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

这里报错说找不到这个class文件java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry，我去看了postgis-jdbc.jar的包结构，只能找到net/postgis/jdbc这一级目录，往后的找不到了。我不确定是代码找的目录写错了，或者是我用的包版本不对，又或者是我其他地方配置有问题，请帮我看看这个问题，十分感谢

看不了一点，我的报错是Caused by: java.lang.ClassNotFoundException: org.apache.seatunnel.api.source.SeaTunnelSource
at java.net.URLClassLoader.findClass(URLClassLoader.java:407)

这里报错说找不到这个class文件java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry，我去看了postgis-jdbc.jar的包结构，只能找到net/postgis/jdbc这一级目录，往后的找不到了。我不确定是代码找的目录写错了，或者是我用的包版本不对，又或者是我其他地方配置有问题，请帮我看看这个问题，十分感谢

Can you provide ddl and pgsql versions of the source table?

DDL：CREATE TABLE "public"."geom_test1206" (
"AREA_CODE" varchar(20) COLLATE "pg_catalog"."default",
"NAME" varchar(160) COLLATE "pg_catalog"."default",
"geom" geometry(GEOMETRY),
"gid" varchar(50) COLLATE "pg_catalog"."default",
"cxflm" varchar(255) COLLATE "pg_catalog"."default",
"center_geom" geometry(GEOMETRY),
"geom_3857" geometry(GEOMETRY),
"xian_name" varchar(255) COLLATE "pg_catalog"."default",
"old_code" varchar(255) COLLATE "pg_catalog"."default",
"test_geom" geometry(GEOMETRY),
"is_frozen" int4 DEFAULT 0
)
;
ALTER TABLE "public"."geom_test1206"
OWNER TO "postgres";
pgsql version is 11.6
I'm really sorry that I switched my mailbox before and I didn't receive your reply.
Could this issue be related to the version of the pg database? I know my version is probably old.
在 2023-12-24 16:22:50，"Carl-Zhou-CN" @.***> 写道：
这里报错说找不到这个class文件java.lang.NoClassDefFoundError: net/postgis/jdbc/geometry/Geometry，我去看了postgis-jdbc.jar的包结构，只能找到net/postgis/jdbc这一级目录，往后的找不到了。我不确定是代码找的目录写错了，或者是我用的包版本不对，又或者是我其他地方配置有问题，请帮我看看这个问题，十分感谢
Can you provide ddl and pgsql versions of the source table?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: @.***>

@MZSY hi,It seems that you also need to add and change the jar package, you can select the corresponding jar package version to try https://repo1.maven.org/maven2/net/postgis/postgis-geometry/2.5.1/postgis-geometry-2.5.1.jar

Shall I raise this issue again or consult it here?

You can create a new issue and associate it

@Carl-Zhou-CN In fact, I later tried to remove the postgis jar package and keep only the postgresql jar package, and there was no such problem. If I just want to copy spatial data from one pg database to another pg database, is it necessary to use postgis jar packages? PS.In fact, I also encountered another problem when importing data, I found that if there is a field like 3857_geom (number beginning) or AREA_NAME (all caps) in the source table, the transmission process will also report an error problem

Can you help refine the documentation for this？

@Carl-Zhou-CN In fact, I later tried to remove the postgis jar package and keep only the postgresql jar package, and there was no such problem. If I just want to copy spatial data from one pg database to another pg database, is it necessary to use postgis jar packages? PS.In fact, I also encountered another problem when importing data, I found that if there is a field like 3857_geom (number beginning) or AREA_NAME (all caps) in the source table, the transmission process will also report an error problem

Can you help refine the documentation for this？

I'm sorry, I don't understand what you mean about refining documentation, do you mean that I should take this commission issue or something else?

I think you found a way to add jar packages differently due to PostgreSQL versions. I was hoping you could help me add a reminder to the documentation, re you interested？
https://github.com/apache/seatunnel/blob/dev/docs/en/connector-v2/source/PostgreSQL.md

I'd love to help refine the markdown documentation, but I don't think I've tested a strong correlation between the PostgreSQL version and the jdbc jar package version. The PG version I was using was 11.6, but the jdbc jar package I was using was the latest 42.6.x version and I had no other problems executing it

I'd love to help refine the markdown documentation, but I don't think I've tested a strong correlation between the PostgreSQL version and the jdbc jar package version. The PG version I was using was 11.6, but the jdbc jar package I was using was the latest 42.6.x version and I had no other problems executing it

Thank you very much, PostgreSQL to PostgreSQL I will find time to build 11.6 to try, it is essentially jdbc, if jdbc is compatible, it is compatible

I'd love to help refine the markdown documentation, but I don't think I've tested a strong correlation between the PostgreSQL version and the jdbc jar package version. The PG version I was using was 11.6, but the jdbc jar package I was using was the latest 42.6.x version and I had no other problems executing it

Thank you very much, PostgreSQL to PostgreSQL I will find time to build 11.6 to try, it is essentially jdbc, if jdbc is compatible, it is compatible

You're welcome. I wasn't very helpful

@frozer798 hi，I tried to use postgis/postgis:11-3.3 docker image to build the environment. Do as you say only need to add the https://repo1.maven.org/maven2/org/postgresql/postgresql/42.3.3/postgresql-42.3.3.jar
PostgreSQL to PostgreSQL is also running properly and data is synchronized properly

Sorry, there seems to be other problems, I will update after checking

@frozer798 hi，I tried to use postgis/postgis:11-3.3 docker image to build the environment. Do as you say only need to add the https://repo1.maven.org/maven2/org/postgresql/postgresql/42.3.3/postgresql-42.3.3.jar PostgreSQL to PostgreSQL is also running properly and data is synchronized properly

@frozer798 Sorry,current version seatunnel cannot transfer PostgreSQL to PostgreSQL geometry at this time because geometry is currently recognized as a String，It will be added in the next version

link #5872

@frozer798 Sorry,current version seatunnel cannot transfer PostgreSQL to PostgreSQL geometry at this time because geometry is currently recognized as a String，It will be added in the next version

Did you mean that transferring geometry data from PostgreSQL database to PostgreSQL database is not currently supported?

@frozer798 Sorry,current version seatunnel cannot transfer PostgreSQL to PostgreSQL geometry at this time because geometry is currently recognized as a String，It will be added in the next version

Did you mean that transferring geometry data from PostgreSQL database to PostgreSQL database is not currently supported?
Yes, but you can refer to it
https://github.com/apache/seatunnel/blob/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-3/src/test/java/org/apache/seatunnel/connectors/seatunnel/jdbc/JdbcPostgresIT.java
t provides a roundabout way of thinking