Questionable ZED accuracy?

I've noticed some depth issues with my ZEDs, which had abysmal depth errors with the factory calibration, i.e. sensing 12 m when the real depth was 25 m.
To test the depth, we used a planar and highly textured surface and moved it away from the camera 50 times (1m to 25m), saving the measurements via SVOs (720p mode). On the ZED, we mounted a small laser rangefinder which looked in the same direction. Then, I ran through every SVO file and chose the same pixel, whose ray hit the target every frame (close to the red laser dot). The measurement is the mean of all disparities during the SVO sequence, which would help the accuracy greatly. Then I used a manual calibration file to improve the results, which are plotted in the image below. I also ran ELAS on the rectified images using the rectified intrinsics to test whether your algorithm is just wrong. It does not seem that way:

Using ULTRA mode, no self calib.
Is there any way to improve the depth accuracy? I mean the depth error as e_z = z^2/(B*f)*e_m with z being the distance, B the baseline, f the hor. focal length and e_m the disparity (matching) error of your algorithm would yield 25.0m^2/(0.12m*670px)*0.5px = 3.89m, which is on point for ELAS. But I would assume that the ZED would fluctuate around the laser ground truth and not be systematically off, i.e. biased.
What is the absolute best way to calibrate the camera?
Also, why was the factory calibration so bad?

Your charts show a quadratic decrease in Z-accuracy and a bias increase with the range, which is consistent with the stereo uncertainty model.
The systematic bias you mention is due to subpixel interpolation which is affected by pixel-locking and foreshortening phenomena. These phenomena are discussed in many papers. We are working on bias reduction techniques but it is still a work in progress.
Regarding calibration, your camera may have suffered a mechanical shock or there was an issue during its calibration process. Either way, please send to our Support team your order and serial numbers so we have a look into the issue.
For the recalibration, your charts seem to indicate that you are close to the stereo accuracy model. You can still try Kalibr which is currently the state of the art tool for calibration and could improve your triangulation results.

Hey! I got a simillar behaviour. What I did to solve this is to calibrate the camera using external ROS calibrator... but each lens separately and then using both calibrations within the opencv stereocalibration. It works much better than the calibration tool.

@wbapablo That sounds great! Do you have a link to the external ROS calibrator? I assumed that the SDK just used the stereo calibration of OpenCV, though.
Do you have some data to show the improvement, too?

This paper shows an approximation of the RMS error of the ZED camera as a function of distance.
https://ddd.uab.cat/pub/elcvia/elcvia_a2018v17n1/elcvia_a2018v17n1p1.pdf

@LuisOrtizF The link doesn't work for me, could you share the title and author name please?

@RSKothari Sorry, test this link: https://elcvia.cvc.uab.es/article/view/v17-n1-ortiz/1084-pdf-en

I am curious what the best depth accuracy you can achieve using ZED camera at 1m - 2m distance range. 1cm?

I am curious what the best depth accuracy you can achieve using ZED camera at 1m - 2m distance range. 1cm?

This depends on the calibration (fx and B) and the quality of the stereo matching. Assuming B=0.12, fx=1400 px (2K mode) and a Gaussian disparity error with e_d = 0.5 px (1sigma). Plugging it in e_z = Bf/d - (B*f)/(d + e_d) we can get
e_z = 3mm @ 1m
e_z = 12mm @ 2m
With worse stereo matching, e_d = 1.0 px
e_z = 6mm @ 1m
e_z = 23.5mm @ 2m
Keep in mind that e_z is one approximate standard deviation of a Gaussian and that it is only adequate for near points. So @1m with good stereo matching and perfect calibration, most measurements will be below 1 cm. But keep in mind that the stereo matching may be biased in some way.

I am curious what the best depth accuracy you can achieve using ZED camera at 1m - 2m distance range. 1cm?

This depends on the calibration (fx and B) and the quality of the stereo matching. Assuming B=0.12, fx=1400 px (2K mode) and a Gaussian disparity error withe_d = 0.5 px (1 x sigma). Plugging it in
e_z = B*f/d - (B*f)/(d + e_d) we can get (using d = B*f/z)
e_z = 3mm @ z = 1m
e_z = 12mm @ z = 2m
With worse stereo matching, e_d = 1.0 px
e_z = 6mm @ z = 1m
e_z = 23.5mm @ z = 2m
Keep in mind that e_z is one approximate standard deviation of a Gaussian and that it is only adequate for near points. So @1m with good stereo matching and perfect calibration, most measurements will be below 1 cm. But keep in mind that the stereo matching may be biased in some way.

This is very helpful. Thanks a lot!

@wbapablo That sounds great! Do you have a link to the external ROS calibrator? I assumed that the SDK just used the stereo calibration of OpenCV, though.
Do you have some data to show the improvement, too?

@WASCHMASCHINE Did ROS calibrator work for you? Did you eliminate the estimation error with manual calibration ?

@WASCHMASCHINE you might find this useful :
https://github.com/stereolabs/zed-opencv-native/blob/f7e17b6368ecbc432c0ca0d64be4586e88db8799/src/calibration.cpp#L74-L175
This function takes the ZED calibration parameters and converts them to OpenCV format (the reverse of what you want).

@adujardin Thank you! Can't you push the reverse too? :sweat_smile:

@WASCHMASCHINE @adujardin Thank you.

@WASCHMASCHINE did you figure out a better way to calibrate the camera?

Keep in mind that e_z is one approximate standard deviation of a Gaussian and that it is only adequate for near points. So @1m with good stereo matching and perfect calibration, most measurements will be below 1 cm. But keep in mind that the stereo matching may be biased in some way.

You mention good stereo matching - is this something we can control, or is this already implemented when we get the depth image from /depth/depth_registered?

@WASCHMASCHINE did you figure out a better way to calibrate the camera?

No, I haven't spend time with the ZED.

You mention good stereo matching - is this something we can control, or is this already implemented when we get the depth image from /depth/depth_registered?

This is dependent on the stereo matching algorithm, which is closed source. So you are limited by their implementation for the creation of the disparity map. This is too bad because there are newer algorithms  that could outperform the current ZED SDK in not all, but certain scenery.

If we use a structured light projector in addition to the ZED system, by how much can we reduce the disparity error?


Outdated screenshot: OS values in the capture are not representing the actual current values

On the Screenshot that shows the blade listing the devices, under the column 'OS', several values are listed as 'Windows Server [...]'.
This does not reflect the reality anymore, as the AD Connect Default sync rule no. 143 ('In from AD - Computer Join'), now has a transformation rule that reads: "IIF(InStr([operatingSystem],"Windows") > 0,"Windows",[operatingSystem])"
What this means is that unless the customer is running a very old version of the ADConnect (previous to <IP_ADDRESS>, released 11/08/2019) the customer will only see 'Windows' under the OS field, not 'Windows Server [...]'.
This way, to avoid confusion, I'd suggest replacing the screenshot of the console with a most recent one that does not show the OS column values with the details, in order to avoid confusion.
In the updated screenshot, the values under the 'OS' column should only show 'Windows'.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a8119688-e88d-2916-3dcf-bf777a5fc80c
Version Independent ID: e767d695-1c9f-64e4-e6c4-fef07b0f3d2e
Content: Manage devices in Azure AD using the Azure portal
Content Source: articles/active-directory/devices/device-management-azure-portal.md
Service: active-directory
Sub-service: devices
GitHub Login: @MicrosoftGuyJFlo
Microsoft Alias: joflore

@vbrennydossa
Thanks for your feedback! I've assigned this issue to the author who will investigate and update as appropriate.


Throw exception when request rate limiter denys request

When the current limiting mechanism is triggered, the gateway responds to the status code 429 to the client, but I want the client to always accept only the 200 status code. Any error message is prompted by the response data. How can I capture this situation?
I tried to write a class that inherits DefaultErrorAttributes to implement, but found that this exception was not caught at all.

If you would like us to look at this issue, please provide the requested information. If the information is not provided within the next 7 days this issue will be closed.

@spencergibb This problem is universal and it seems to be improved as a feature in the next version. I look forward to your best solution, thank you!

+1 I will have to create my own filter until this is possible.


implement custom headers

This is related to #35 - it adds the ability to specify a custom header component (and to pass arbitrary properties).
There is one thing that is not general, however -- in order to function, it ascends the DOM tree from the header looking for a <th> tag, which it assumes is the encapsulating Griddle header tag. This will fail in the event that your custom header component includes its own <th> tag.

I shifted a few things around to take out ascendParentsUntil(...), but everything else is awesome.
Thanks a ton for putting this together! :+1:


alarm mysql, table name error: change date_val to date_time

Hi,I have tried the alarm system, and found this error from logs.  I had a look at the AgentStaticsMapper.xml and then made this change.

Hi zcmjcd1.
Could you retry it using latest version?
This issue was fixed by #2279.
thanks.

OK,thanks


Design System - Icon Left and Icon Right Buttons not currently listed in DS

The Icon Left and Icon Right buttons are not currently listed in the design system.
Thx,
Ismael

@jdrf-digitaldesigner
These are currently displayed in the icons section:
http://jdrf.github.io/design-system/dist/content.html#icons

@RachelRVasquez can we move them into the buttons section?
cc @jdrf-digitaldesigner

@pmmck @jdrf-digitaldesigner Should we move "Icon Only Buttons" to the Buttons section as well?

Yes, please move "Icon-only Buttons" to the Buttons section as well. Thx

@fuhton Submitted two PRs:
https://github.com/JDRF/design-system/pull/159
https://github.com/JDRF/design-system/pull/160

Merged.

@jdrf-digitaldesigner This is ready for you to review and close.

Can you please update the button sizes to: 48px, 40px, and 32px (height)? Thx

@jdrf-digitaldesigner I've adjusted the icon sizes in each button so it matches the Zeplin specs (24px, 20px, 16px), however adding the icon inside the button increases the height of the button just slightly that it's no longer 48px, 40px, 32px but instead 60px, 48px, 36px. We can reduce the size of the icons so it's more inline with 48px, 40px, 32px but I wanted to get your thoughts before I proceed.

@briansaycocie how about a .has-icon class that when applied to a button reduces the vertical padding?  That way we can keep the buttons sizes consistent and use bigger icons that are easier to read.  Thoughts?
cc @RachelRVasquez @jdrf-digitaldesigner

Seems like too many classes to be added.

Adding 3 new button heights is not an option because they will change the balance of the layout.  And decreasing the icon size is not an option because of minimum legibility sizes — and they just look better.
The two solutions I can think of are:

Adding a modifier like .has-icon to existing buttons.
Creating new buttons.

The downside of the modifier approach is that you have to add an additional class to the HTML.
The downside of the new button approach is that we would double the amount of button css we need to maintain.  If we changed the the core button style we would need to also make that update in the icon button variation.
Seems to me like option 1 is the way to go.
Is there a third option I'm not thinking of?
@fuhton @RachelRVasquez @briansaycocie @jdrf-digitaldesigner

@pmmck I originally removed any height restrictions on the icon buttons so we can let the icons determine the height. Forcing a height on the left/right icon buttons as well as the icon button toolbar won't guarantee vertical alignment due to the unknown icons that will be swapped out. Since we can't predict what icons will be used, it makes sense to keep them as maintainable as possible by letting the padding decide the buttons height - only for buttons with icons. This can be adjusted on a per project basis with overwrites in that project.
I agree with Nick on avoiding the addition of more classes than necessary. Changing the icons size as Patrick mentioned, can interfere with legibility - not to mention one icon may work well at one size whereas another won't. Take the facebook/twitter icons for example - due to the FB logo being so thin, it's usually enlarged a bit compared to the wider, more legible twitter icon. I know FB/Twitter aren't part of the material design icons, but wanted to reference them for an example of the dilemma we're facing in this ticket.
For maintainability in DS, less classes and less css, we can keep the buttons as is with the icons determining the height. Thoughts?
cc: @briansaycocie @fuhton @jdrf-digitaldesigner

@RachelRVasquez I have to put my foot down here.  We cannot have variations on our button heights.
cc @briansaycocie @fuhton @jdrf-digitaldesigner

@RachelRVasquez
Material icons are a set size. Let's add another class for icons called .ds-btn-has-icon that sets a static height (or reduced padding).
Let's update the docs in the buttons section and the icon section.

@fuhton I changed the name of the modifier classes so it wouldn't look too similar tp .ds-btn-icon. PRs submitted:
https://github.com/JDRF/design-system/pull/242
https://github.com/JDRF/design-system/pull/243

@pmmck Merged. Please confirm.

.ds-btn-icon seems to describe the icon.   Isn't the point of this class to describe a situation happening with the button?
$btn-icon-height: 40px;

That to me reads as "The icon inside of a button is 40px".
Whereas .has-* is a reusable pattern.   .nav-has-search, .btn-has-icon, etc.

@pmmck Good point. Sorry I missed this convention.

@fuhton PRs:
https://github.com/JDRF/design-system/pull/248
https://github.com/JDRF/design-system/pull/249

Merged. @pmmck Please confirm.

LGTM thanks!

@fuhton I realize now that I was only reviewing the code but the buttons are not the correct height in the docs.  Re-opening this issue.

@pmmck I'll need more context regarding this issue?

@fuhton The large button with icon is 58px - it should be 48px.  The primary button is 50px - it should be 40px.  The small button is 42px - it should be 32px.
I'm not sure the current implementation is the best approach.
ds-btn ds-btn-primary ds-btn-lg ds-btn-icon ds-btn-has-icon-lg

Do we really need both the .btn-icon applied to the button?  And then also the .btn-has-icon-[size]?
Also, it seems that in the button scss file there is both heights using padding and heights set in pixels.  Do we need to set the heights in pixels if the padding is correct?

@pmmck If you re-review this ticket, the set heights and additional class(es) are something we agreed upon and decided was the best way forward.
I'll re-review but I believe we can remove the .btn-has-icon-[size] class.

@fuhton having set heights as the outcome is absolutely something we want.  There should only be 3 heights for buttons: 32, 40, 48.
I was talking about what seems to be a mixed approach of declaring a pixel height and using padding.  I would prefer if the padding + line-height + etc = 32, 40, 48.   But perhaps that's just my own personal preference and if it's not the best approach here, I defer to 10up.

@pmmck @jdrf-digitaldesigner
To confirm what Patrick's saying, ideally you don't want to declare a fixed height on buttons as in height: 40px but to change the padding/line-height so that buttons are those heights naturally? And if so, if it means going against the Zeplin design specs for padding/line-height to get the desired heights - is that ok?
Just want to clarify the task again before jumping back in. Thanks!
cc: @fuhton

@RachelRVasquez
Where do you see a discrepancy in Zeplin?  This is an example of what I'm seeing where the total heights are equal to 32, 40, 48.

cc @fuhton @jdrf-digitaldesigner

@pmmck Right now the buttons do match the Zeplin specs without the .btn-has-icon-size class, but we had to go against them due to heights. For the large button for example we have:

14px/14px for the font in Gotham Medium
Padding in the button is 16px Top/Bottom and 24px Left/Right.

And with the height: auto - the natural height that the browser interprets is larger than 48 by 10px.

Forcing the 48px height pictured below, cuts off the button.

So we had to change the padding using the .btn-has-icon-size classes if we wanted the browser to reduce the padding and naturally stick to those heights without cutting the button off unevenly. So although Zeplin has those specs for the font size and padding, the height Zeplin has versus what the browser makes it don't match up, so we had to make adjustments to imitate it.
cc: @jdrf-digitaldesigner @fuhton

@RachelRVasquez
Thanks, that makes sense.   Please ignore the padding in Zeplin and adjust accordingly so that the total heights equal 32, 40, 48px.  Many thanks!
@fuhton @jdrf-digitaldesigner

@fuhton PRs submitted with updates. Removed the .btn-has-icon-size classes/variables/styles and adjusted padding for buttons with icons/text to naturally be these heights.
https://github.com/JDRF/design-system/pull/263
https://github.com/JDRF/design-system/pull/264

@pmmck @jdrf-digitaldesigner This is ready for your review.


Include options in README.

Hello @facundobatista.
Did you read the documentation at readthedocs? It has that exact thing, you've inserted into README.rst, except it is generated automatically from the source code.

Hi thesharp!
It happened to me and to a friend that we looked at the info in PyPI, and then at the README in github, and docs were not good.
We didn't thought about going into readthedocs.
Maybe you could incorporate a link to readthedocs into the README?

There is one at the top, near the build status.

On 7 нояб. 2015 г., at 7:12, Facundo Batista<EMAIL_ADDRESS>wrote:
Hi thesharp!
It happened to me and to a friend that we looked at the info in PyPI, and then at the README in github, and docs were not good.
We didn't thought about going into readthedocs.
Maybe you could incorporate a link to readthedocs into the README?
—
Reply to this email directly or view it on GitHub.

Ah, that fancy button! Thanks!


Cannot run "pyb" command in Anaconda environment

I'm trying to use Pybuilder in an Anaconda env. Pybuilder is correctly installed but when I try to run "pyb" command I get an error that says that the command does not exist. What is wrong?

What OS? What PyB version? How did you install PyB in Anaconda?

I'm using Windows, therefore I had to use "pyb_", now it is working, thanks.

@roarrrr thanks for reporting back!


Setup all crates according to #6 and make backend "functional"

The goal here is to populate every proposed crate we got with * something * with the rough direction we want to go in.
bundles #20 with some slight improvements as well as it fits the bill.
If you ask: "Why drop this huge PR?", well I consumed a critical amount of caffeine and became very motivated..
before merge:

[x] Basic documentation to hint at the function each crate has
[x] Fix some obvious problems we don't want to merge
[x] Split up into smaller commits
[x] ?

closes: #6

Will merge as is, no point in continuing this without a goal


'lncli queryroutes' almost always hangs for most pubkeys

I just set up a testnet lnd node and received funds from a faucet using the following tutorial: http://lightning.community/lnd/faucet/2017/01/19/lightning-network-faucet/ .
Everything was successful until I tried to queryroutes. Querying the route to the faucet succeeds (it is still my active peer):
lncli queryroutes --dest=02c39955c1579afe4824dc0ef4493fdf7f3660b158cf6d367d8570b9f19683afb5 --amt=1000
But querying the route to my other active peer hangs (including if amt=1000000):
lncli queryroutes --dest=02f6d66509f7ef98d9470ab5dc3998f8785112c545f86e50b9811772a9166f99dc --amt=1000
Also, querying a random pubkey found in the 'lnd describegraph' output hangs.
lncli queryroutes --dest=038e1c0dee8a07504e9870e16e22162a8c3c51698ba051e5d1ca14b0f3cc2afee8 --amt=1000000
Notably the third case succeeded once, taking only a few seconds, but I haven't been able to reproduce that success.
The pubkey listed in the tutorial also hangs:
lncli queryroutes --dest=03c3cbc887448ff950c32a3561441249f1983322519fcea18cbb7769cbd2f4b995 --amt=1000000
Purchasing on Starblocks has been a success each time I've tried, so this appears to be a problem with queryroutes in particular rather than the LN testnet or my machine.
'lncli --version' returns "lncli version 0.3"
Is there any other information I can provide or testing that I can do to help debug this issue?

Fixed by these series of commits: 33ba60ce661da053dac03a6b28a24433f5648929, 8a29c01354e8867fc8548eaffd25c0b6d250f3f6, ad0f5b31f6129de8edfa4fbeb000bc7460c9ddcf.


relax terra requirement with ~=

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 88.836%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
2427

Relevant Lines:
2732

💛  - Coveralls


How do i test formly form in unit test ?

How do i test form used by formly in unit test ?

Hi @abbish. Excellent question, I'm planning on making an example as soon as I am able. This is being tracked here (I recommend you subscribe to that issue).

<canned-message>
Thanks for your interest in angular-formly. The issues are for bug reports/feature requests, so I'm going to go ahead and close this issue. If you have a question or need help, please watch this screencast for an explination of the most effective/proper way to get help using angular-formly.
Summarized:

Learn angular-formly basics
Check the examples
Reproduce the issue
Ask on Stack Overflow
Ask on the mailing list
Ask on Chat

P.S. sorry for the canned message, this just happens a lot :smile:
</canned message>

Thank u

Example has been created: http://angular-formly.com/#/example/other/testing

The blank testing page was amusing at least.


disable flaky tests

Changes proposed in this PR

disable flaky backend-proto tests

Why are we making these changes?
too many PRs blocked by these right now

Can you confirm that all of these are flaking? I thought only the https one is flaking internally.


Operational Transaction signed extension.

built on top of #3115 and should be updated with it. Should only be marge after #3115 is merged.

Renames the #[weight] to a more generalized #[meta]  tag which can carry static information about both weight, priority and basic functions on top of them. (pub type CallDescriptor = (Weight, TransactionPriority);-- okay name?)
Consequently refactors some occurrences of weight in the code to the more general structure.

Gist of the change being:
fn validate(
	&self,
	_who: &Self::AccountId,
	info: CallDescriptor,
) -> Result<ValidTransaction, DispatchError> {
	let (weight, priority) = info;
	Self::internal_check_weight(weight)?;
	Ok(ValidTransaction { priority, ..Default::default() })
}

where setting #[meta = WeightedTransaction::Operational()] simply boosts to your priority to infinity and drops your weight to Zero etc.
TODO:

[ ] allow CallMetadata  to define will_cause_full_block() to guarantee operational txs will go through.

I will mark this as in-progress now since reviewing it is moot with the additional commits of #3115.
Also closes #3106

and drops your weight to Zero etc.

why would it do this? wouldn't that make the transaction free? what stops a dos/sybil attack?

This needs to be started over again.


Async ParquetExec

I've not thoroughly tested this yet, it may represent a performance regression, and will likely need more memory
Which issue does this PR close?
Closes #TBD.
Rationale for this change
Avoids needing to use a blocking threadpool for reading Parquet data, and opens the door for fetching data from object storage.
What changes are included in this PR?
Updates ParquetExec to use the POC async ParquetRecordBatchStream in https://github.com/apache/arrow-rs/pull/1154
Are there any user-facing changes?
Yes, I had to alter the ObjectReader trait

This can probably be refreshed after  https://github.com/apache/arrow-datafusion/pull/1775 is merged

I'm going to wait until after #1738 is merged and do some comparative investigation. Async is certainly not free as the block structure of parquet is not particularly amenable to streaming. Prior to merge I'd like a better handle on what the trade-offs here are, I'd expect memory usage to be higher, but performance may be better, not sure :smile:

https://github.com/apache/arrow-datafusion/pull/1738 is merged 🎉

Running the benchmarks against a backported https://github.com/apache/arrow-rs/pull/1418 show the performance of this to be significantly worse than the current Sync reader (~2x). It is possible this is just a simple oversight with a simple fix, but I'm unlikely to have time to look into it this week. Async is far from free and so I'd expected the performance to be somewhat worse, but not that much worse...
Hopefully I will have some time next week, otherwise I'll keep this pootling along on the backburner until it is ready for prime-time :smile:

Marking PR as stale - will close in a while to clean up the PR list. Feel free to reopen if more work is planned


integrate tavily

related: https://github.com/ai16z/eliza/issues/363

ai16z is full of scammers do not work or contribute code to these people.
They have been pumping and dumping crypto coins for the past week on retail investors: $eliza, $matr, $vs and more.
https://dexscreener.com/solana/2pofqcvn4wysazpsqppxq4cspbtkqlsehf9q5x77avm7
https://dexscreener.com/solana/hzqcylo7gjl5xvvglc2zfgfuwzkunhrzvge2hn9sysbr
scammers:
https://x.com/mattyryze
https://x.com/shawmakesmagic/status/1857903111073067315
https://x.com/pindarosothecat
Bunch of people calling out the ai16z team:
https://x.com/spacepixel/status/1860511246241661274
https://x.com/JW100x/status/1860501669907189772
https://x.com/0xApeRich/status/1860492861357060381
https://x.com/BullTrx1/status/1860492092767695108
DYO. Don't help work for free for these people. Fork the repo and contribute somewhere else.

ai16z is full of scammers do not work or contribute code to these people.
They have been pumping and dumping crypto coins for the past week on retail investors: $eliza, $matr, $vs and more.
https://dexscreener.com/solana/2pofqcvn4wysazpsqppxq4cspbtkqlsehf9q5x77avm7
https://dexscreener.com/solana/hzqcylo7gjl5xvvglc2zfgfuwzkunhrzvge2hn9sysbr
scammers:
https://x.com/mattyryze
https://x.com/shawmakesmagic/status/1857903111073067315
https://x.com/pindarosothecat
Bunch of people calling out the ai16z team:
https://x.com/spacepixel/status/1860511246241661274
https://x.com/JW100x/status/1860501669907189772
https://x.com/0xApeRich/status/1860492861357060381
https://x.com/BullTrx1/status/1860492092767695108
DYO. Don't help work for free for these people. Fork the repo and contribute somewhere else.


Update view_container_logs.md

Proposed changes

Unreleased project version (optional)

Related issues (optional)

Thanks, @scjane :)


Compilation Error with GCC 8

Gem compiles fine with GCC 7 but fails with GCC 8 with this error. It is reproducible on Ruby 2.4 as well as 2.3:
make  2>&1
make  all-am
make[1]: Entering directory '$HOME/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/zookeeper-1.4.11/ext/zkc-3.4.5/c'
/bin/sh ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I. -I.  -I./include -I./tests -I./generated  -Wall -Werror  -g -O2 -D_GNU_SOURCE -c -o zookeeper.lo `test -f 'src/zookeeper.c' || echo './'`src/zookeeper.c
mkdir .libs
 gcc -DHAVE_CONFIG_H -I. -I. -I. -I./include -I./tests -I./generated -Wall -Werror -g -O2 -D_GNU_SOURCE -c src/zookeeper.c  -fPIC -DPIC -o .libs/zookeeper.o
src/zookeeper.c: In function 'format_endpoint_info':
src/zookeeper.c:3440:21: error: '%d' directive writing between 1 and 5 bytes into a region of size between 0 and 127 [-Werror=format-overflow=]
     sprintf(buf,"%s:%d",addrstr,ntohs(port));
                     ^~
src/zookeeper.c:3440:17: note: directive argument in the range [0, 65535]
     sprintf(buf,"%s:%d",addrstr,ntohs(port));
                 ^~~~~~~
src/zookeeper.c:3440:5: note: 'sprintf' output between 3 and 134 bytes into a destination of size 128
     sprintf(buf,"%s:%d",addrstr,ntohs(port));
     ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
cc1: all warnings being treated as errors
make[1]: *** [Makefile:754: zookeeper.lo] Error 1
make[1]: Leaving directory '$HOME/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/zookeeper-1.4.11/ext/zkc-3.4.5/c'
make: *** [Makefile:468: all] Error 2
*** extconf.rb failed ***

I'm having the same issue on ruby 2.5.3p105

On a Debian Buster system this can be sorted out by doing
$ sudo apt install gcc-7
$ CC=/usr/bin/gcc-7 bundle install zookeeper --version 1.4.11

gcc-6 will also work.

To suppress the gcc error:
$ CFLAGS=-Wno-error=format-overflow gem install zookeeper --version 1.4.11

Same using:
gcc version 9.1.0 (GCC)
5.1.14-arch1-1-ARCH
ruby 2.3.3p222 (2016-11-21 revision 56859) [x86_64-linux]
supressing the gcc error worked for me :+1:

Worked also for kafkat:
CFLAGS=-Wno-error=format-overflow  gem install kafkat

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=897892
and patch
https://salsa.debian.org/java-team/zookeeper/commit/8f12c964bbc1fc1c025d5fc5e7011a5a67d75181

The CFLAGS=-Wno-error=... trick does not work for 1.4.1 and 1.4.3 but works for 1.4.11.
Did not bother to check the versions in between, if any.
Thanks, @drrzmr!

I was trying to modify the buffer size.
static const char* format_endpoint_info(const struct sockaddr_storage* ep)
{
    static char buf[256];  // new one
    //static char buf[128]; // orignal
    char addrstr[128];
    void *inaddr;

CFLAGS=-Wno-error=format-overflow gem install zookeeper --version 1.4.11

You should switch to root user, and then do this command.

@land-pack, please do not misinform: the gem tool is perfectly able to install packages for regular users, so there is absolutely no need to switch to root unless the user very well understands what they are after.

Bumping this issue so that interested parties (and the package maintainers) can take a look at my fix for this issue: https://github.com/zk-ruby/zookeeper/pull/90

We've merged and released @nickmarden 's fix in version 1.5.0


⚠ ClamAV has degraded performance

In a8a3f8f, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 67 ms

Resolved: ClamAV performance has improved in 6930616.


FAILURE: Build failed with an exception. Running Gradle task 'assembleDebug'

Description:
Hi I'm new to Flutter and Dart. I installed the environment as described in the documetation and resolved a a few errors related to;
1) FirebaseStorage unresolved reference:
I've updated the dependencies as follows;
Firebase dependencies
firebase_core: ^0.4.0+9
firebase_analytics: ^5.0.2
cloud_firestore: ^0.12.9+5
firebase_auth: ^0.14.0+5
google_sign_in: ^4.0.1
firebase_storage: ^3.0.5
firebase_messaging: ^5.1.3
firebase_crashlytics: ^0.1.0+2
2) Execution failed for task ':app:compileDebugKotlin'
Updated the kotlin_version by upgrading to 1.3.50. Resolved some errors, others in the logs remains.
Any assistance or pointing in the right direction would be greatly appreciated.
Thanks!
To Reproduce
Steps to reproduce the behavior:

In Android Studion. Go to 'Run,
Click on Run main,dart
Select console window.
See error

Expected behavior
Application should launch on Android emulator
Device Information:

Device: Emulator Pixel 3 API 20
OS: Android 10.0

Flutter Information

flutter doctor output
Doctor summary (to see all details, run flutter doctor -v):
[ΓêÜ] Flutter (Channel unknown, v1.10.5, on Microsoft Windows [Version 6.1.7601]
,
locale en-US)
[ΓêÜ] Android toolchain - develop for Android devices (Android SDK version 29.0.

[ΓêÜ] Android Studio (version 3.5)
[ΓêÜ] VS Code, 64-bit edition (version 1.40.1)
[ΓêÜ] Connected device (1 available)
ΓÇó No issues found!
Logs
C:\flutter\packages\circles_app>flutter run
Using hardware rendering with device Android SDK built for x86. If you get
graphics artifacts, consider enabling software rendering with
"--enable-software-rendering".
Launching lib\main.dart on Android SDK built for x86 in debug mode...
Initializing gradle...                                              1.2s
Resolving dependencies...                                          30.5s
Running Gradle task 'assembleDebug'...
e: C:\flutter\packages\circles_app\android\app\src\main\kotlin\com\example\circl
es_app\UploadPlatform.kt: (15, 36): Unresolved reference: FirebaseStorage

e: C:\flutter\packages\circles_app\android\app\src\main\kotlin\com\example\circl
es_app\UploadPlatform.kt: (16, 36): Unresolved reference: StorageReference

e: C:\flutter\packages\circles_app\android\app\src\main\kotlin\com\example\circl
es_app\UploadPlatform.kt: (298, 19): Unresolved reference: FirebaseStorage

e: C:\flutter\packages\circles_app\android\app\src\main\kotlin\com\example\circl
es_app\UploadPlatform.kt: (333, 13): Unresolved reference: StorageReference

e: C:\flutter\packages\circles_app\android\app\src\main\kotlin\com\example\circl
es_app\UploadPlatform.kt: (334, 28): Cannot infer a type for this parameter. Ple
ase specify it explicitly.

e: C:\flutter\packages\circles_app\android\app\src\main\kotlin\com\example\circl
es_app\UploadPlatform.kt: (342, 57): Cannot infer a type for this parameter. Ple
ase specify it explicitly.

FAILURE: Build failed with an exception.

* What went wrong:

Execution failed for task ':app:compileDebugKotlin'.

> Compilation error. See log for more details

* Try:

Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 27s
Running Gradle task 'assembleDebug'...                             88.4s
Gradle task assembleDebug failed with exit code 1

C:\flutter\packages\circles_app>

Additional context
Add any other context about the problem here.

Hi,
Make sure you are using
classpath 'com.google.gms:google-services:4.2.0'
in your project level gradle. if not try with these versions of the dependencies.
firebase_core: ^0.4.0
firebase_analytics: ^5.0.0
cloud_firestore: ^0.12.9
firebase_auth: ^0.14.0
google_sign_in: ^4.0.1
firebase_storage: ^3.0.5
 firebase_messaging: ^5.1.3
 firebase_crashlytics: ^0.1.0+2

Hi,
Make sure you are using
classpath 'com.google.gms:google-services:4.2.0'
in your project level gradle. if not try with these versions of the dependencies.
firebase_core: ^0.4.0
firebase_analytics: ^5.0.0
cloud_firestore: ^0.12.9
firebase_auth: ^0.14.0
google_sign_in: ^4.0.1
firebase_storage: ^3.0.5
 firebase_messaging: ^5.1.3
 firebase_crashlytics: ^0.1.0+2

Hi ThuAbLKA,
I added....
implementation 'com.google.firebase:firebase-storage:19.1.0'
in the dependencies under the app\src\build.gradle and it worked for the android app, got everything deployed ok as per the documentation. I'll play with your advised settings to get it done the correct way.
As I tested out the application, all seems to to be working except the user profile button/screen which gave "Bad state: No element" all the way down the screen (red background). Do you know if that should work normally?
Thanks

Hi mike1573,
Yes the user profile screen should work. The only crucial feature that is missing is the "no-data" screen. Other than that everything else should work as expected.

Thanks ThuAbLKA. I'll dig around on this and come back with a new ticket if I need some help (which should be soon).
Regards


added funding.yml

Thank you I hadn't looked into this before.

Thank you I hadn't looked into this before.


What would be the best way to force .data() to always return string values?

The .data() method will return boolean values in case of data-arg="true" and data-arg="false"
Live demo: https://jsfiddle.net/5e8uqh3b/1/
Do you have any advice on how to force .data() to always return string value?

@limonte use attr instead. If you don't call data without arguments you might want to do something like this:
$.fn.data = function ( name, value ) {
  return this.attr ( `data-${name}`, value );
};

Thank you @fabiospampinato for your advice!
I ended up with
$.fn.data = function (name, value) {
  return typeof value === 'undefined' ? this.attr('data-' + name) : this.attr('data-' + name, value)
}

@limonte also keep in mind that there are a few differences between attr and data, namely you can't pass to attr JSON-stringifiable objects.
That check for undefined could probably be removed once #277 is fixed.

That check for undefined could probably be removed once #277 is fixed.

I don't think so. cashElement.attr('data-word', undefined) and cashElement.attr('data-word') are different things: https://jsfiddle.net/Lr9kvt4w/

I don't think so. cashElement.attr('data-word', undefined) and cashElement.attr('data-word') are different things: https://jsfiddle.net/Lr9kvt4w/

Right, jQuery's (and now Cash's as well) behavior when undefined gets passed is pretty weird.


⬆ Upgrade to the Rust 2018 edition

Brief change to update to Rust 2018 and do a little clean up.

Nice changes, thanks! :hugs:


Not able to get render-fidelity-tools run on Ubuntu

Description
We tried to get the render-fidelity-tools running on Ubuntu and WSL.
The model-viewer works as intended, but when we try to run npm run test in render-fidelity-tools the following error appears:
(node:3749) ExperimentalWarning: The ESM module loader is experimental.
.../model-viewer/packages/render-fidelity-tools/lib/workflows/test-fidelity.js:15
import HTTPServer from 'http-server';
       ^^^^^^^^^^
SyntaxError: Unexpected identifier
    at Module._compile (internal/modules/cjs/loader.js:723:23)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:789:10)
    at Module.load (internal/modules/cjs/loader.js:653:32)
    at tryModuleLoad (internal/modules/cjs/loader.js:593:12)
    at Function.Module._load (internal/modules/cjs/loader.js:585:3)
    at createDynamicModule (internal/modules/esm/translators.js:73:15)
    at Object.meta.done (internal/modules/esm/create_dynamic_module.js:40:9)
    at file:///.../model-viewer/packages/render-fidelity-tools/lib/workflows/test-fidelity.js:9:13
    at ModuleJob.run (internal/modules/esm/module_job.js:95:12)
    at process._tickCallback (internal/process/next_tick.js:68:7)
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! @Google<EMAIL_ADDRESS>test: `node --experimental-modules ./lib/workflows/test-fidelity.js ./test/config.json`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the @Google<EMAIL_ADDRESS>test script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR! A complete log of this run can be found in:
npm ERR!     .../.npm/_logs/2020-11-12T14_45_12_966Z-debug.log

If we run npm run update-screenshots the following error appears:
.../model-viewer/packages/render-fidelity-tools/lib/workflows/update-screenshots.js:15
import { spawn } from 'child_process';
       ^
SyntaxError: Unexpected token {
    at Module._compile (internal/modules/cjs/loader.js:723:23)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:789:10)
    at Module.load (internal/modules/cjs/loader.js:653:32)
    at tryModuleLoad (internal/modules/cjs/loader.js:593:12)
    at Function.Module._load (internal/modules/cjs/loader.js:585:3)
    at createDynamicModule (internal/modules/esm/translators.js:73:15)
    at Object.meta.done (internal/modules/esm/create_dynamic_module.js:40:9)
    at file:///.../model-viewer/packages/render-fidelity-tools/lib/workflows/update-screenshots.js:9:13
    at ModuleJob.run (internal/modules/esm/module_job.js:95:12)
    at process._tickCallback (internal/process/next_tick.js:68:7)
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>update-screenshots: `node --experimental-modules ./lib/workflows/update-screenshots.js ./test/config.json`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>update-screenshots script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR! A complete log of this run can be found in:
npm ERR!     .../.npm/_logs/2020-11-12T14_47_47_450Z-debug.log

Are there any dependencies despite imagemagick?
Do we need to use a particular node.js or npm version?
It seems like some dependencies are not resolved correctly, but npm install and npm run bootstrap seem to work.
OS

[ ] Android
[ ] iOS
[x] Linux
[ ] MacOS
[ ] Windows

When you say Ubuntu on WSL, you mean you're actually on a Windows machine? I can confirm this all works as intended on actual Ubuntu, but we've had scattered reports of difficulties on Windows (including WSL). Unfortunately I have no access to a Windows machine to debug. I would really like to get our repro running more easily on Windows for contributors like yourself.
I'll do my best to provide support, but I'm unfamiliar with WSL. I know @bsdorra had some success getting things running under WSL. I'm on npm version 6.14.8 (the latest). If you find how to get this working properly, please push a PR to update our README accordingly.

We tried it on 2 machines with normal Ubuntu 20 running and on one Windows machine with WSL.
We also tried it on Windows, but as you described, there are some issues currently.

Ugh. Well I haven't tried it on Ubuntu 20 specifically. What version of npm does it have? You followed all the steps on our README? It looks like it's having trouble with ES6 module imports. We build legacy versions with rollup that target ES5 for old browsers like IE11, but I can't imagine why you'd be having trouble there. If you're successfully running the model-viewer tests, those are already using ES6 imports so it's strange that only these other modules would have trouble.

Apparently,  sudo apt-get install nodejs installs version 10 by default. After updating node.js to version 15 (as described here) it works.


Gitlab integration stopped to work

It doesn't work since 9.0 release.
PRONTO_GITLAB_API_PRIVATE_TOKEN="..." PRONTO_GITLAB_API_ENDPOINT="https://.../api/v3" bundle exec pronto run -f gitlab -c origin/develop
/home/saulius/.rvm/gems/ruby-2.4.2/gems/gitlab-4.2.0/lib/gitlab/request.rb:80:in `validate': Server responded with code 404, message: 404 Project Not Found. Request URI: https://.../api/v3/projects/company%252Fproject/repository/commits/22327dc6a9cba45b81c49e0da2baa832ac9184c0/comments (Gitlab::Error::NotFound)
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/gitlab-4.2.0/lib/gitlab/request.rb:43:in `get'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/gitlab-4.2.0/lib/gitlab/client/commits.rb:61:in `commit_comments'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto/gitlab.rb:5:in `commit_comments'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto/formatter/commit_formatter.rb:6:in `block in existing_comments'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto/formatter/commit_formatter.rb:6:in `each'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto/formatter/commit_formatter.rb:6:in `flat_map'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto/formatter/commit_formatter.rb:6:in `existing_comments'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto/formatter/git_formatter.rb:6:in `format'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto.rb:67:in `block in run'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto.rb:66:in `each'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto.rb:66:in `run'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto/cli.rb:61:in `block in run'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto/cli.rb:60:in `chdir'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/lib/pronto/cli.rb:60:in `run'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/thor-0.19.4/lib/thor/command.rb:27:in `run'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/thor-0.19.4/lib/thor/invocation.rb:126:in `invoke_command'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/thor-0.19.4/lib/thor.rb:369:in `dispatch'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/thor-0.19.4/lib/thor/base.rb:444:in `start'
  from /home/saulius/.rvm/gems/ruby-2.4.2/gems/pronto-0.9.5/bin/pronto:6:in `<top (required)>'
  from /home/saulius/.rvm/gems/ruby-2.4.2/bin/pronto:23:in `load'
  from /home/saulius/.rvm/gems/ruby-2.4.2/bin/pronto:23:in `<main>'
  from /home/saulius/.rvm/gems/ruby-2.4.2/bin/ruby_executable_hooks:15:in `eval'
  from /home/saulius/.rvm/gems/ruby-2.4.2/bin/ruby_executable_hooks:15:in `<main>'

The solution is to replace %2F with / in Gitlab slug.


[WebToolsE2E][Aspire] Add some code to Aspire project and publish again, it will shows "Didn't find new changes."

REGRESSION INFO: Also reproduce on Aspire P5
INSTALL STEPS

Clean machine: Win11 x64 23h2 ENU
Install VS 17.10.0 Preview 5 [rel.d17.10-34818.151] includes Aspire 8.0 P6 [8.0.0-preview.6.24214.1]
Apply dotnet-tools Feed
Install latest daily azd [1.9.0-beta.1-daily.3712265]
Install git [2.44.0.windows.1]

REPRO STEPS

Create a new Aspire Starter App project using VS or CLI
Open Command Prompt and navigate to the solution path of this project
Run 'azd init', select 'Use code in the current directory' > Confirm and continue initializing my app, type a new environment named bennett, press enter
Run 'azd up', and select Subscription to WTE and select Location to East US, press enter
Open the program.cs of the AppHost project add follow code:
var apiService = builder.AddProject<Projects.AspireApp6_ApiService>("apiservice").WithExternalHttpEndpoints();

Publish again

ACTUAL
It will shows Didn't find new changes.

AZD issue. Can you move this to https://github.com/Azure/azure-dev/issues

Close this issue because the repo is wrong.


The linter ruleset should be versionable

At some point we will introduce the ability to treat warnings as errors. At that point, if we add a new linting rule it could be a breaking change, so we should have the ability to pin the linter rule set to a specific version in bicepconfig.json. Something like:
{
  "analyzers": {
    "core": {
      "ruleSetVersion": "x.y.z"
      ...
    }
  }
}

cc @marcusfelling @StephenWeatherford

Related to https://github.com/Azure/bicep/issues/2811

Whatever mechanism is used, ideally Intellisense for rule names (at least core ones) will work based on the rules available only in the specified ruleset version.

https://github.com/Azure/bicep/issues/8013


Create .Net SDK

I'll put my hand up for this.

Initial progress here https://github.com/dcrowe/sdk-dotnet/tree/initial-sdk
Outstanding tasks:

[ ] CI
[ ] config from file
[ ] config from environment
[ ] readme

@dcrowe awesome!
you are invited into sdk-dotnet team with all access to repos:
https://github.com/Visual-Regression-Tracker/sdk-dotnet
https://github.com/Visual-Regression-Tracker/examples-dotnet

Can you please create a nuget.org account, so I ca make you a package owner?

@pashidlos Do you mind setting up codacy for me?

Looks like I need to wait a day before net5.0 becomes supported by github: https://github.com/actions/virtual-environments/issues/1891

@pashidlos Do you mind setting up codacy for me?

done

https://github.com/Visual-Regression-Tracker/sdk-dotnet/pull/4
https://github.com/Visual-Regression-Tracker/examples-dotnet/pull/2

@dcrowe it's gonna make huge impact on project!
thank you for support!


running karma with angular-moment-picker installed causes job to fail

hi there I've encountered an error with the bower install of angular-moment-picker when I try to run a karma job with the library install it fails on line 156  in angular-moment-picker.js
module.moment = moment
i found when I removed it it caused it to successfully bulids
is this able to be removed from the code. as it's not used anywhere else that I've seen.

We are having a similar issue. Can this be fixed?


Non-resolvable import POM: Could not find artifact com.alibaba.cloud:spring-cloud-alibaba-dependencies:pom:2.2.3-SNAPSHOT

Which Component
spring-cloud-alibaba
Describe what problem you have encountered
I can't execute ./mvnw.cmd clean, the error below:
PS C:\Users\rc452\Documents\workspace\src\spring-cloud-alibaba> .\mvnw.cmd clean
[INFO] Scanning for projects...
Downloading from nexus-aliyun: http://maven.aliyun.com/nexus/content/groups/public/com/alibaba/cloud/spring-cloud-alibaba-dependencies/2.2.3-SNAPSHOT/maven-metadata.xml
Downloading from nexus-aliyun: http://maven.aliyun.com/nexus/content/groups/public/com/alibaba/cloud/spring-cloud-alibaba-dependencies/2.2.3-SNAPSHOT/spring-cloud-alibaba-dependencies-2.2.3-SNAPSHOT.pom
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[ERROR] Non-resolvable import POM: Could not find artifact com.alibaba.cloud:spring-cloud-alibaba-dependencies:pom:2.2.3-SNAPSHOT in nexus-aliyun (http://maven.aliyun.com/nexus/content/groups/public) @ com.alibaba.cloud:spring-cloud-alibaba:${revision}, C:\Users\rc452\Documents\workspace\src\spring-cloud-alibaba\pom.xml, line 135, column 25
 @
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]
[ERROR]   The project com.alibaba.cloud:spring-cloud-alibaba:2.2.3-SNAPSHOT (C:\Users\rc452\Documents\workspace\src\spring-cloud-alibaba\pom.xml) has 1 error
[ERROR]     Non-resolvable import POM: Could not find artifact com.alibaba.cloud:spring-cloud-alibaba-dependencies:pom:2.2.3-SNAPSHOT in nexus-aliyun (http://maven.aliyun.com/nexus/content/groups/public) @ com.alibaba.cloud:spring-cloud-alibaba:${revision}, C:\Users\rc452\Documents\workspace\src\spring-cloud-alibaba\pom.xml, line 135, column 25 -> [Help 2]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException

Describe what information you have read
I have read the README.md and Issues,but no solution suit me. Maybe the mirroring  Repository  caused the error? I'll try it later.

the master branch root pom.xml revision is 2.2.3-SNAPSHOT,but spring-cloud-alibaba-dependencies is 2.2.3-RELEASE.


Timestamps are wrong?

If there is a small drift in the timestamps, like 25 ms => 24.988662719726562, will that cause evaluation errors for longer audio files?

[
    [
        "embeddings/hearbaseline/dcase2016_task2-hear2021-small/train/dev-1-ebr-6-nec-3-poly-0.wav",
        0.0
    ],
    [
        "embeddings/hearbaseline/dcase2016_task2-hear2021-small/train/dev-1-ebr-6-nec-3-poly-0.wav",
        24.988662719726562
    ],
    [
        "embeddings/hearbaseline/dcase2016_task2-hear2021-small/train/dev-1-ebr-6-nec-3-poly-0.wav",
        49.977325439453125
    ],
    [
        "embeddings/hearbaseline/dcase2016_task2-hear2021-small/train/dev-1-ebr-6-nec-3-poly-0.wav",
        74.96598815917969
    ],
    [
        "embeddings/hearbaseline/dcase2016_task2-hear2021-small/train/dev-1-ebr-6-nec-3-poly-0.wav",
        99.95465087890625
    ],
    [
        "embeddings/hearbaseline/dcase2016_task2-hear2021-small/train/dev-1-ebr-6-nec-3-poly-0.wav",
<PHONE_NUMBER>9863281
    ],
    [
        "embeddings/hearbaseline/dcase2016_task2-hear2021-small/train/dev-1-ebr-6-nec-3-poly-0.wav",
<PHONE_NUMBER>1835938
    ],
    [
        "embeddings/hearbaseline/dcase2016_task2-hear2021-small/train/dev-1-ebr-6-nec-3-poly-0.wav",
<PHONE_NUMBER>3808594
    ],
    [
        "embeddings/hearbaseline/dcase2016_task2-hear2021-small/train/dev-1-ebr-6-nec-3-poly-0.wav",
<PHONE_NUMBER>578125
    ],
:


Plombardi/doc/proxy proto fix

Small doc mistakes and fix the changelog as well.

I cherry-picked the changes, since I needed to split the doc commit from the CHANGELOG commit. Closing this PR since I took the changes out of band.


use go 1.16.7 in Appveyor

Update Appveyor config to use Go 1.16.7.
Describe how to test your changes
CI only, so no QA.
Checklist

[x] A release note has been added or the changelog/no-changelog label has been applied.
[x] The appropriate team/.. label has been applied, if known.
[x] If known, an appropriate milestone has been selected; otherwise the Triage milestone is set.

Appveyor jobs are green; the gitlab failures are, I think, the usual intermittents.


Path slashes are removed on Windows

We noticed since tojos have been moved in separate project, that back slashes vanished from file paths on Windows.

@yegor256 please, assign me this task.

@baudoliver7 go ahead

@yegor256/z everybody who has role DEV is banned at #545; I won't be able to assign anyone automatically; consider assigning someone manually (as in §19), or invite more people (as in §51), or remove the job from the scope (as in §14)

@yegor256/z everybody who has role DEV is banned at #545; I won't be able to assign anyone automatically; consider assigning someone manually (as in §19), or invite more people (as in §51), or remove the job from the scope (as in §14)


[Management] Releases

Existing Functionality
A channel of communication with Sergio would be amazing. Since this didn't yet happen there needs to be some kind of backbone for releasing updates on this crate.
Option A:
Somehow get sergio on board and let him take part in releases.
-> https://github.com/SergioBenitez/Rocket/discussions/2011#discussioncomment-1983130
Option B:
Release via github tags.
-> - Doesn't interfier with crates.io
-> - Doesn't work that well with dependabot and renovate
-> + Git is built into the cargo toolchain
Option C:
Release a new crate on crates.io
-> - This should be considered as a last option
-> - Confusion for developers
-> - If Sergio gets back on has to be marked as deprecated, crates on crates.io can't be deleted
-> + works fine with renovate and dependabot

If we do any work regarding releases within the next weeks I would opt for B.
Posted today in the matrix chat that we had a fork which will probably be moving and within seconds he responded 😊 He said he will be back from March on. Sadly (and historically) august turned into end-of-year, in october "will anounce soon" never arrived and getting that quick of a response seems like he's taking it personally (which intern means hes not doing that great from a psychological point of view)

I've been building a number of changes into a repo.  Many of them I'll be submitting ASAP after launch.

Me not, I have been trying to reach out to the owner of this org but no answer so far. Sergio actually has been back for some weeks and has somewhat active.
If I might add some personal things: I’m actually changing from rocket to axum


Intrinsic Alignment

A first pass at adding an IA model would be to reimplement the simple NLA-based prescription @dlanzieri is using in her project. We can consider more complex models afterwards.
Please add here any suggestions for other models.
@dlanzieri could you describe here your strategy? maybe also with links to useful bits and pieces of code?

Formulate a likelihood or likelihood-free inference? For the former see https://arxiv.org/abs/2112.04484. @EiffL any suggestion for the latter?

Formulate a likelihood or likelihood-free inference? For the former see https://arxiv.org/abs/2112.04484. @EiffL any suggestion for the latter?
Do we want to consider the NLA + environment-dependence model? Kindly provided by @dlanzieri :) https://ui.adsabs.harvard.edu/abs/2022MNRAS.509.3868H/abstract

Formulate a likelihood or likelihood-free inference? For the former see https://arxiv.org/abs/2112.04484. @EiffL any suggestion for the latter?
Do we want to consider the NLA + environment-dependence model? Kindly provided by @dlanzieri :) https://ui.adsabs.harvard.edu/abs/2022MNRAS.509.3868H/abstract
Joint inference of WL and IA: I have a block sampling MCMC framework to jointly sample the NLA IA amplitude and random noise given a tidal field on a galaxy-by-galaxy basis, but Denise's code seems more suitable since we are not operating at the individual-object basis.

Here is some very very simple prototype code of how we could implement IA.
  # Definining IA ampliture
  Aia = numpyro.sample('Aia', dist.Uniform(0.0, 10.0))

  def resampling_func(entry, coord):
    r = entry['r']; a = entry['a']; p = entry['plane']
    dx = entry['dx']; dz = entry['dz']

    norm_factor = -Aia * jc.constants.C_1 * cosmo.Omega_m * jc.constants.rhocrit / jc.background.D1(
      cosmo, a)

    # Normalize density planes
    constant_factor = 3 / 2 * cosmo.Omega_m * (constants.H0 / constants.c)**2
    density_normalization = dz * r / a
    p = (p - p.mean()) * constant_factor * density_normalization

    # Interpolate at the density plane coordinates
    im = map_coordinates(p,
                         coords * r / dx - 0.5,
                         order=1, mode="wrap")
    return im * norm_factor

  ia_maps = [ resampling_func(plane) for plane in density_planes]

  # To be refined
  ia_maps = [simps(lambda z: nz(z).reshape([-1,1,1]) *
                              ia_maps(z), 0., 2.5, N=64)
                      for nz in nzs_s_sys]

  # Generate convergence maps by integrating over nz and source planes
  convergence_maps = [simps(lambda z: nz(z).reshape([-1,1,1]) *
                              convergence_Born(cosmo, density_planes, coords, z), 0., 2.5, N=64)
                      for nz in nzs_s_sys]

  # Apply noise to the maps (this defines the likelihood)
  observed_maps = [numpyro.sample('kappa_%d'%i,
                                  dist.Normal(k+k_ia, sigma_e/jnp.sqrt(10**2*galaxy_density))) # assumes pixel size of 10 arcmin
                   for i,(k,k_ia) in enumerate(zip(convergence_maps, ia_maps))]

  return observed_maps

A good illustration of what the simulation volume looks like:
https://arxiv.org/pdf/2010.09731.pdf

I would be pleased to participate to a LFI/SBI code. I have nicely test the sbi library (written in (Py)Torch) with a JAX-based simulator running on GPU.

Hey @nataliaporqueres this is the very simple prototype  we saw last time. There are still a few things I have to solve, like figuring out what it’s happening for the auto power-spectrum II in the bin 3, but this is the general idea!

Just for safe keeping, here is a demo notebook https://colab.research.google.com/drive/1upWB7r2MBnRirEQNJT8UN8KXb06gce_H?usp=sharing


[rapidjson] Improve usage

Improve usage, add extra 2 codes:
target_link_libraries(main PRIVATE rapidjson)

and
target_include_directories(main PRIVATE ${RapidJSON_INCLUDE_DIRS})

Fixes #18292.

@upsj  Is that what you need?

Now, the usage is printed automatically:
The package rapidjson:x86-windows provides CMake targets:

    find_package(RapidJSON CONFIG REQUIRED)
    target_link_libraries(main PRIVATE rapidjson)

great, thanks :)


🆙 Update Application to Use New MoJ Crest

👀 Purpose

To use the new MoJ Crest for our applications and services

✅ Definition of Done

[x] All Auth0 Applications use the new crest
[x] All Third-Party Tooling uses the new crest

📓 Notes

Images provided in this Slack message

🆙 Update

Updated Logo in GitHub Organisations
Updated Logo in https://github.com/ministryofjustice/ministryofjustice.github.io - which is where all our Auth0 Apps pull the logo from
Checked other Third Party Tooling, nothing else is using the old logo

👀 Remaining Work

None, all done 🥳


Load passwords from 1Password quickly

Related to #1906
Turns out loading passwords from 1Password is really slow, so having a mutex around it makes deployments take 10-20 seconds each.
A couple of ideas for solutions:

Change the 1Password provider to store all secrets in a JSON blob in a single password entry.
Block on the first password fetch to avoid spamming the authentication prompt, then parallel load the remainder.

Fixed in this epic https://github.com/TBD54566975/ftl/issues/1951


Incorrect JSON sort order

Does this issue occur when all extensions are disabled?: Yes

VS Code Version: 1.93.1 38c31bc77e0dd6ae88a4e9cc93428cc27a56ba40 x64
OS Version: Windows 10.0.27695.1000

Steps to Reproduce:

Create this JSON file.

{
    "a0": "a0",
    "[a0]": "[a0]",
    "A1": "A1",
    "[A1]": "[A1]",
    "B0": "B0",
    "[B0]": "[B0]",
    "b1": "b1",
    "[b1]": "[b1]"
}

Sort it.

Expected result:
{
    "[a0]": "[a0]",
    "[A1]": "[A1]",
    "[B0]": "[B0]",
    "[b1]": "[b1]",
    "a0": "a0",
    "A1": "A1",
    "B0": "B0",
    "b1": "b1"
}

Actual result:
{
    "A1": "A1",
    "B0": "B0",
    "[A1]": "[A1]",
    "[B0]": "[B0]",
    "[a0]": "[a0]",
    "[b1]": "[b1]",
    "a0": "a0",
    "b1": "b1"
}

Reverting VS Code to 1.92.2 fee1edb8d6d72a0ddff41e5f71a671c23ed924b9 could resolve this issue.

I'm having this issue as well. The behaviour changed since last updated vscode. It was working as the mentioned "expected result" and now it isn't. Any option to rollback or introduce setting to change behaviours?

Problem is here https://github.com/microsoft/vscode-json-languageservice/pull/238 . It was added wrongly an ascii sorting

This issue will be fixed by using the localeCompare method instead


[🐞] qwik-auth - AuthJS is not calling https on prod

Which component is affected?
Qwik Runtime
Describe the bug
I'm using AuthJS for a Google, Github, and custom credentials provider on my qwik app, locally everything works as expected, however, on prod/staging the application is calling my SignIn providers as a simple HTTP call instead of HTTPS (even Custom Credentials as well) on an HTTPS server.
I tried many possible configurations on the form submission and links with no success, at this point, I believe is something related to the serverAuth$ from the<EMAIL_ADDRESS>implementation.
Any light that you could throw me would much appreciate it.
This is the login screen on staging

This is my package.json
{
  "name": "my-qwik-basic-starter",
  "description": "Website",
  "engines": {
    "node": ">=15.0.0"
  },
  "private": true,
  "scripts": {
    "build": "qwik build",
    "build.client": "vite build",
    "build.preview": "vite build --ssr src/entry.preview.tsx",
    "build.server": "vite build -c adapters/express/vite.config.ts",
    "build.types": "tsc --incremental --noEmit",
    "dev": "vite --mode ssr",
    "dev.debug": "node --inspect-brk ./node_modules/vite/bin/vite.js --mode ssr --force",
    "fmt": "prettier --write .",
    "fmt.check": "prettier --check .",
    "lint": "eslint \"src/**/*.ts*\"",
    "postinstall": "prisma generate",
    "preview": "qwik build preview && vite preview --open",
    "prisma": "prisma",
    "prisma:pull": "prisma db pull && prisma generate",
    "prisma:generate": "prisma generate",
    "prisma:migrate": "prisma migrate dev",
    "prisma:migrate:prod": "prisma migrate deploy",
    "serve": "node server/entry.express",
    "start": "vite --open --mode ssr",
    "qwik": "qwik"
  },
  "devDependencies": {
    "@auth/core": "^0.9.0",
<EMAIL_ADDRESS>"^1.2.4",
<EMAIL_ADDRESS>"~0.1.0",
<EMAIL_ADDRESS>"^1.2.4",
    "@prisma/client": "4.16.2",
    "@types/bcryptjs": "^2.4.2",
    "@types/compression": "^1.7.2",
    "@types/eslint": "8.40.2",
    "@types/express": "4.17.17",
    "@types/masonry-layout": "^4.2.5",
    "@types/node": "^20.3.3",
    "@types/toastify-js": "^1.11.1",
    "@typescript-eslint/eslint-plugin": "5.61.0",
    "@typescript-eslint/parser": "5.61.0",
    "compression": "^1.7.4",
    "eslint": "8.44.0",
    "eslint-plugin-qwik": "^1.2.4",
    "express": "^4.18.2",
    "prettier": "2.8.8",
    "prisma": "^4.16.2",
    "typescript": "5.1.6",
    "undici": "5.22.1",
    "vite": "4.3.9",
    "vite-tsconfig-paths": "4.2.0"
  },
  "dependencies": {
    "bcryptjs": "^2.4.3",
    "masonry-layout": "^4.2.2",
    "toastify-js": "^1.12.0"
  }
}

Thank you
Reproduction
https://sea-turtle-app-36scw.ondigitalocean.app/auth/login/
Steps to reproduce
No response
System Info
System:
    OS: macOS 13.4
    CPU: (24) arm64 Apple M2 Ultra
    Memory: 94.50 GB / 128.00 GB
    Shell: 5.9 - /bin/zsh
  Binaries:
    Node: 18.16.0 - /usr/local/bin/node
    npm: 9.5.1 - /usr/local/bin/npm
  Browsers:
    Chrome: 114.0.5735.198
    Safari: 16.5
  npmPackages:
    @builder.io/qwik: ^1.2.4 => 1.2.4
    @builder.io/qwik-auth: ~0.1.0 => 0.1.0
    @builder.io/qwik-city: ^1.2.4 => 1.2.4
    undici: 5.22.1 => 5.22.1
    vite: 4.3.9 => 4.3.9

Additional Information
The callback URLs are set as HTTPS on GitHub and Google, but because the app is calling an HTTP call, that causes a mismatch between them and causes this issue. (Try different servers, Digital Ocean and Railwaiy with the exact same results)

Where are u deploying? are u using a reverse proxy to add https?

I think, the root of the problem is that the express server (the node process) does not know it's being server under HTTP.
Could it be related to this?
https://github.com/BuilderIO/qwik/issues/4685#issuecomment-1616638734
Again the root of the problem is that the express server (node) does not know the ORIGIN
it can also be set manually by setting the ORIGIN environment variable:
ORIGIN=https://sea-turtle-app-36scw.ondigitalocean.app

Planning to add docs about this, this week! specially for manual deployments with node, this is not a problem for vercel, netlify, cloudflare pages, since we know the ORIGIN (it's provided by them)

Thanks @manucorporat
That did part of the trick, and I was able to continue on stating and testing the route protection as well.
However, not sure why in the local environment and the stating/prod the callbacks are different, I mean, I have something like this on the<EMAIL_ADDRESS>file
callbacks: {
      async signIn({ user, account, credentials, email, profile }) {

On local, I was using the user to get the user's information, (email, name, and avatar), however, on prod/staging, that piece is null/undefined, I had to use the profile object and adapt the code according to the provider.
Thank you once again @manucorporat, you can close the issue!


Add support for the SSO credential provider

This adds support for resolving temporary AWS Credentials from a profile configured to use an SSO profile.

Codecov Report

Merging #2070 into develop will increase coverage by 0.02%.
The diff coverage is 98.94%.

@@             Coverage Diff             @@
##           develop    #2070      +/-   ##
===========================================
+ Coverage    93.09%   93.11%   +0.02%
===========================================
  Files           60       60
  Lines        11003    11096      +93
===========================================
+ Hits         10243    10332      +89
- Misses         760      764       +4

Impacted Files
Coverage Δ

botocore/utils.py
98.29% <93.75%> (-0.10%)
:arrow_down:

botocore/credentials.py
98.64% <100.00%> (-0.23%)
:arrow_down:

botocore/exceptions.py
99.45% <100.00%> (+0.01%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 72c7e55...50e6840. Read the comment docs.


refactor: Implement Deserialize of wrapper types with a macro

Backported commit from the derive_seed branch which removes a bit of boiler plate (which helps when porting this module to the seeded variants)

Didn't realize this broke 1.13. I changed the macro to not have an empty where clause and reverted the impl for Cell since I accidentally removed the Copy bound. Travis is still broken though but that does not seem to be due to this change.


Newsboat -v does'nt give current version information

Newsboat version (copy the output of newsboat -v or the first line of git show):
$ newsboat -v

newsboat  - https://newsboat.org/
Copyright (C) 2006-2015 Andreas Krennmair
Copyright (C) 2015-2019 Alexander Batischev
Copyright (C) 2006-2017 Newsbeuter contributors
Copyright (C) 2017-2019 Newsboat contributors

Newsboat is free software licensed under the MIT License. (Type `newsboat -vv' to see the full text.)
It bundles JSON for Modern C++ library, licensed under the MIT License: https://github.com/nlohmann/json
It bundles an alphanum algorithm implementation licensed under the MIT license: http://www.davekoelle.com/alphanum.html

newsboat
System: Linux 4.15.0-54-generic (x86_64)
Compiler: g++ 7.4.0
ncurses: ncurses 6.1.20180127 (compiled with 6.1)
libcurl: libcurl/7.58.0 GnuTLS/3.5.18 zlib/1.2.11 libidn2/2.0.4 libpsl/0.19.1 (+libidn2/2.0.4) nghttp2/1.30.0 librtmp/2.3 (compiled with 7.58.0)
SQLite: 3.22.0 (compiled with 3.22.0)
libxml2: compiled with 2.9.4

Steps to reproduce the issue:
version=2.16.1
if newsboat --version | grep -F "newsboat $version"
then
    echo "newsboat $version already installed"
    return 0
fi
url="https://newsboat.org/releases/$version/newsboat-$version.tar.xz"
curl -sSL "$url">"newsboat.tar.xz"
atool -x newsboat.tar.xz
cd "newsboat-$version"
make
sudo make install

After running this bash script, newsboat --version and newsboat -v show the following first line : newsboat  - https://newsboat.org/, but 2.16.1 is nowhere to be found in the output.
I think this was not the case on previous releases.

I can't reproduce this by checking out the r2.16.1 tag.

Couldn't reproduce from the tag either, but did reproduce from a tarball as @edi9999 described. Fascinating, because there's basically nothing that could be broken here—and yet it's broken :) I'm investigating.

The problem was caused by us running git describe and using its output without checking if it exited successfully. In 2.16.1 we didn't even check if the command started; this has been fixed in master, but the other half remained—we need to check if the command finished all right. I just submitted a PR that adds a check.
This is the second bug in that 16-line build script. I'm starting to doubt my abilities as a programmer ._.

Can you also add treatment if the command fails ?
I usually like to think I will always handle errors (first), then only the main case, so that all potential errors are catched and not ignored. Also it has the advantage that the main case (without error) has no indentation.
Something like :
if !hash_output.status.success() {
   fail('miserably') // dont no any rust ...
}
println!("cargo:rustc-env=GIT_HASH={}", hash);	            let hash = String::from_utf8_lossy(&hash_output.stdout);
// Re-build this crate when Git HEAD changes. Idea lifted from vergen crate.
println!("cargo:rustc-env=GIT_HASH={}", hash);
println!("cargo:rebuild-if-changed=.git/HEAD");	            // Re-build this crate when Git HEAD changes. Idea lifted from vergen crate.
println!("cargo:rebuild-if-changed=.git/HEAD");

Oh, it is handled, just not in build.rs. utils::program_version() checks the value of GIT_HASH (at compile time) and uses it if it's non-empty. Otherwise the program version is determined by the version of the "libnewsboat" crate; this cannot fail.
But now that I written the above paragraph, it occurs to me that I could make this clearer by moving all the logic into build.rs, which will set PROGRAM_VERSION or something, which is then used by utils::program_version(). I'll go update my PR; thanks for the inspiration :)


Add support for Solidity 0.8.17

Official announcement: https://blog.soliditylang.org/2022/09/08/solidity-0.8.17-release-announcement/.

cc @roynalnaruto


Use ClickHouse image for init

The init job oars_init_schemas_tables_users.sh uses the oars default image but forcibly installs the clickhouse client, which takes a long time. We already have a clickhouse image in the system, so we should use that! I have no memory of what broke when I tried that last time, but it's worth fixing.

It's already fixed https://github.com/openedx/tutor-contrib-oars/blob/main/tutoroars/plugin.py#L84


Overhaul URL Parsing

The current setup to aggressively ships urls to google instead of trying to resolve.

Fixed in upcoming 1.0.7 release.


⚠ Bofrost.at has degraded performance

In ff01cc7, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2082 ms

Resolved: Bofrost.at performance has improved in c753362 after 20 minutes.


Style blink issue of SSR

VUE Version: 2.x
Server Side Rendering(SSR) is a great feature of VUE 2. However, I found a issue. SSR does not output styles in .vue file to the first screen page. Though we can extract styles in .vue files to one external large size .css file, for a large SPA, it does not suitable to do this way. Because large size css file will block the other assets  in the page from downloading.
Is there any solution for this issue?

You should be using extraction any way, because if you don't, the styles are inlined as strings in your JavaScript. The payload/blocking factor is the same. BTW - I don't think large CSS blocks downloading other assets, it only blocks rendering.
This concern can be solved with code splitting + fallback loader for the extract text plugin (additional style chunks would be inserted dynamically when async chunks are loaded), but at the moment best practices for SSR + code splitting is something that still needs to be worked on. We will be updating the vue-hackernews-2.0 demo in the future once we settle on a good solution.

@yyx990803 Thanks for you reply! Actually, My project is a large SPA based on VUE 2.x, code splitting is neccesary and is the best practice. Every page is a .vue file that downloaded on demand using code splitting. It works very well on browser, stylesheets and other parts in each .vue file are compiled into a js file. But for ssr, it doesn't. The first screen render will blink for no styles for it. Currently, I only have to extract all styles in all pages into one large css file and include it in the html file to solve this problem..

I'm facing the same issue, does it have better solution now?@JiayangShen

我面临同样的问题，现在有更好的解决方案吗？@JiayangShen


How to add a custom line on the timeline of the network as shown below:

Hi Thank you for contributing a good lib. I encountered a problem. How do I add a specified line to the timeline at the network as shown below:

how do i need to do it,  thanks.

HI @LIUPING789 right now this package does not support this functionality.
I'm closing this and marking this as potential-enhancement as we might take this once we've fixed all major issues and enhancements.


[DISCUSSION] Make DataFusion the fastest engine for querying parquet data in ClickBench

Is your feature request related to a problem or challenge?
I am mostly writing this up to record what I think is an ongoing work with @jayzhan211 @Rachelint @korowa and myself
TLDR, we are working on (and getting pretty close) to having DataFusion be the fastest single node engine for querying parquet files in ClickBench
Background:
https://benchmark.clickhouse.com/ shows the results of ClickBench
ClickBench the benchmark and is described here https://github.com/ClickHouse/ClickBench. I am not personally interested in proprietary file formats that require special loading
Here is the current leaderboard for partitioned parquet reflecting DataFusion 40.0.0:

Describe the solution you'd like
I would like DataFusion to be the fastest
Describe alternatives you've considered
No response
Additional context
This is also inspired by @ozankabak 's call to action on #11442
The scripts to run with datafusion are here: https://github.com/ClickHouse/ClickBench/tree/main/datafusion
Last update is here: https://github.com/ClickHouse/ClickBench/pull/210

Changes I think will make these queries significantly faster:

[x] https://github.com/apache/datafusion/pull/11627 - @korowa
[x] https://github.com/apache/datafusion/pull/12269 - @jayzhan211
[ ] https://github.com/apache/datafusion/issues/11682 - team effort (we are close)
@Rachelint  also has another potential ~10% faster with https://github.com/apache/datafusion/pull/11943

Reuse hash for repartition #12526 and avoid copy in coalesce #7957 could probably also provide some improvement

Nice!
I created https://github.com/apache/datafusion/issues/12826 which might be relatively low hanging fruit.
I think one bigger future interesting direction would be further vectorization of core hash aggregate algorithm (i.e. treating matches as candidates and doing e.g. equality checks in a vectorized way to allow for more specialization / more efficient code).

🤔  As reviewing #12697 , seems we can still continue to improve partial skipping?
Now we can modify threshold to get performance improvement, but it may be a bit tricky?

And I think maybe we can make clearer about when partial can help, and when partial will even get slower?

In my mind the challenge with tweaking the "switch to partial mode" threshold setting is that some queries will likely get faster and some will likely get slower. If we can justify changing the default setting to some different constant I think it will be fine. However, if we are going to add more complex logic to decide when to switch modes in my opinion it needs to be significantly better than a static threshold (where significantly means "always better" or close to it)

And I think maybe we can make clearer about when partial can help, and when partial will even get slower?

In my mind the challenge with tweaking the "switch to partial mode" threshold setting is that some queries will likely get faster and some will likely get slower. If we can justify changing the default setting to some different constant I think it will be fine. However, if we are going to add more complex logic to decide when to switch modes in my opinion it needs to be significantly better than a static threshold (where significantly means "always better" or close to it)

Got it, @jayzhan211 have tried some other values of skip_partial_aggregation_probe_ratio_threshold and skip_partial_aggregation_probe_rows_threshold, some queries seems improve obviously.
And I have some thoughs like removing the is_locked field?
Now, we take skip_partial_aggregation_probe_rows_threshold as a sample to define if we need to skip, when exceed we will not check this again).
But I found some partial operator can get improvement from skipping, but have no chance to switch to due to is_locked.

https://github.com/apache/datafusion/pull/12697#discussion_r1789659808  Only Q1 slows down, but given it has nothing to do with grouping, I think we can ignore it.
This number is run on another branch that only change the configuration value, so I think another approach is to remove skip_partial_aggregation_probe_rows_threshold  and related logic entirely.

I think one bigger future interesting direction would be further vectorization of core hash aggregate algorithm

Can we use nightly rust that enable std::simd for vectorization? Although in arrow-rs, the simd code is rewritten with auto-vectorization, but when I check the generated asm, I didn't see vector instruction for all the function (some exists, some doesn't). I think it would be nice to have explicitly simd to ensure the code is always vectorized and not disappear because of the code change or the llvm change.

@jayzhan211 Yeah, this sounds like a good idea. We could start stepping into a direction to make the execution engine as performant as Velox. Especially having arrow be the format should allow us to maximize our use of vectorized execution.
Should I open an issue for this?

Can we use nightly rust that enable std::simd for vectorization? Although in arrow-rs, the simd code is rewritten with auto-vectorization, but when I check the generated asm, I didn't see vector instruction for all the function (some exists, some doesn't). I think it would be nice to have explicitly simd to ensure the code is always vectorized and not disappear because of the code change or the llvm change.

I think @tustvold  found that using manually written simd kernels is quite hard to get faster than the auto vectorized code (aka using the vector instructions) made by LLVM and also harder to maintain
If possible I would suggest we instead focus on improving the code so that LLVM has a greater likelihood of being able to auto vectorize code. This is some combination of looking at the resulting assembly code, and then making the inner loops simpler (e.g. via #[inline] and removing bounds checks get_unchecked, special cases for not checking Option, etc)

I found that LLVM is relatively good at vectorizing vertical operations provided:

There are no conditionals within the loop body
You've been careful to avoid inlining too much, as the vectorizer gives up if the code is too complex
You aren't doing bitwise horizontal reductions or masking (although FWIW std::simd struggles with this as well)
You've enabled SIMD instructions in the target ISA

This last point is likely why you aren't seeing anything, the default x86 ISA is over a decade old at this point and doesn't support pretty much any SIMD instructions. See the Performance Tips section at the end of - https://crates.io/crates/arrow
My 2 cents is to get as far as you can without reaching for std::simd, there is a massive maintainance overhead and with care LLVM can produce code that performs better than naively written manual SIMD. We used to have a fair bit of manual SIMD in arrow-rs, and over time we've removed it as the auto-vectorized code was faster.
I'd recommend getting familiar with tools like https://rust.godbolt.org/ (again being sure to set RUSTFLAGS) and only once you've exhausted that avenue think of reaching for SIMD. Generally the hard part is getting the algorithm structured in such a way that it can be vectorised, regardless of what goes and generates those instructions.

Thank you @tustvold  -- that content is so good I made a PR to propose putting it in the readme of arrow-rs: https://github.com/apache/arrow-rs/pull/6554

After a few more PRs for StringView I think we are pretty close: https://github.com/apache/datafusion/pull/12092#issuecomment-2410952786
I'll try and run the numbers at some point to compare to duckdb, but DataFusion is certainly quite a bit faster than 40.0.0 once we complete the StringView work

I made a poc https://github.com/apache/datafusion/pull/12996#issuecomment-2440105534 about what @Dandandan mentioned in https://github.com/apache/datafusion/issues/12821#issuecomment-2401542201
It seems a promising idea !

StringView by default is finally merged into DataFusion: https://github.com/apache/datafusion/pull/13101

@Rachelint  has another non trivial group by performance improvement that is very close: https://github.com/apache/datafusion/pull/12996

Update here: the results from @pmcgleenon  are looking really nice: https://github.com/apache/datafusion/issues/13099#issuecomment-2478314793

Also, BTW, 43.0.0 doesn't include the work from @Rachelint that will likely improve things a few more percent overall (substantially for some queries):

@Rachelint has another non trivial group by performance improvement that is very close: #12996

Love this 🚀 🚀 🚀

Here is a fun challenge:

https://github.com/apache/datafusion/issues/13448

While there is definitely more we can do to improve performance, for now I am going to claim we are done here.
The blog is live: https://datafusion.apache.org/blog/2024/11/18/datafusion-fastest-single-node-parquet-clickbench
🚀


build: update info to build with Java 11

Fixes #296
Test Plan

How do we know the code works?

Flank compiles with the JDK 11.
Checklist

[x] Documented

is this migration one way? i.e. JDK 8 is not supported after this?

is this migration one way? i.e. JDK 8 is not supported after this?

still supported no code changes :D

@Mergifyio rebase


Adding integration tests for Digest authentication

(continuation of https://github.com/guzzle/guzzle/pull/918, that was marked unmodifiable by GitHub)
This intends to prepare Digest implementation, to prevent regressing from the current (cURL) implementation.

As far as I can see this was opened against the 5.x series. Can you please resubmit it against the latest master?

@outtersg Is this still a thing? I can see some digest auth tests in the 6.x release branch.

Uh, I would say that it can be abandonned. The tests were done to prevent regressions in case a pure-PHP Digest authentication would be implemented in Guzzle *; but neither I did take time to work on it, nor exist any plans in Guzzle to implement it AFAIK.
So unless I'm wrong on my last assertion, rejecting this pull request would make sense.

One big advantage on cURL would have been to allow Digest persistence. curl_init() has no way to be told that "latest request was Digest with this given nonce, retry with the same one in case the server did not change". With the right combination of server options (I noticed it on Baikal CalDAV, which has a sabre/dav server layer), implementing this persistence on client's side would cut the retries by half:
A 3-requests sequence without persistence would be (C: client request; S: server response):
C Basic/S 401, C Digest/S 200; C Basic/S 401, C Digest/S 200; C Basic/S 401, C Digest/S 200
With persistence client would retry with the same nonce, giving us:
C Basic/S 401, C Digest/S 200; C Digest/S 200; C Digest/S 200

Thanks for your work.


Copilot plugin does not work from JetBrains IDEs (like PyCharm)

Copilot plugin does not work from PyCharm IDE. It attempts to log into github and fails.
Here is how the proxy is setup.

Here is the error message in the plugin.

Codegate logs show CopilotProvider getting initialized many times, which is not the case when using copilot+VSCode.

I think we have 2 ways to approach this - we don't want to expose a third port in addition to the HTTP proxy with just the different chat endpoints that we use for Continue now and the HTTPS proxy that we use for copilot now.
We could add an option to the container to start the copilot provider proxy with http without the s. That would work but still be a bit of a hack.
I think it would be better to just expose one port, which would mean integrate with FastAPI but I'm not sure how easy would it be to just take over the connections.


Move compression to worker threads if available

This is experimental work ⚠
The idea is to move the compression and decompression work to worker threads. This change could potentially improve performance as the operations would not block the event loop. This is still pending a proper benchmark, which will happen during the course of this draft.

Note 1: worker threads require Node.js >= 12.11
Note 2: If this is successful we could potentially move the encoding and decoding bits to worker threads.

Closing this since we didn't see any improvement and we're not planning on merging this.


zstream-trigger only finds new stable versions on initial load.

On 24 hour sleep next check is always already processed. Though there is a new accepted version and it is not in the already processed file. Its like the page is cached and not being updated.
If I delete the pod and the process restarts it will then find the new version and process.

@rnetser This still is not working... Only get parsing message on initial load. Looks like after fist execution the function is not even entered... I think it has to do with @functools.cache. May need to remove from both parse_openshift_release_url() and get_accepted_cluster_versions():


missing metric value with annotation

Short summary about the issue/question:
Brief what process you are following:
I try to use """@nni.report_intermediate_result(loss)""" and """@nni.report_final_result(loss)""" annotation to report the metric. However , at the side of web-UI, I can not get any value of the metric.  The status shows the program is successfully executed.
I tried to locate this bug source:
(1) First , I checked the file at :cat ~/nni/experiments/ANF1NHa8/trials/WxIJU/.nni/metrics and the file exist there but nothing is in it.  Therefore, I suspect the metric written process has some problems.
(2)Then, I checked the function for metric writting.(report_final/intermediate_result at the file: ~/.local/lib/python3.5/site-packages/nni/trial.py). I made some experiments and found this function is not executed in the whole process.
(3)Then, I checked the command in the run.sh file,
vim ~/nni/experiments/ANF1NHa8/trials/WxIJU/run.sh

cd /tmp/qsong/nni/annotation/tmpw4iu7xwj
export NNI_PLATFORM=local
export NNI_SYS_DIR=/home/qsong/nni/experiments/ANF1NHa8/trials/WxIJU
export NNI_TRIAL_JOB_ID=WxIJU
export NNI_OUTPUT_DIR=/home/qsong/nni/experiments/ANF1NHa8/trials/WxIJU
export NNI_TRIAL_SEQ_ID=0
export MULTI_PHASE=false
export CUDA_VISIBLE_DEVICES=0
eval python /work/qsong/myusim/src/squtils/nni/tfmain_nni.py 2>/home/qsong/nni/experiments/ANF1NHa8/trials/WxIJU/stderr
echo $? `date +%s000` >/home/qsong/nni/experiments/ANF1NHa8/trials/WxIJU/.nni/state

It shows that, the origin file is executed. In that file, the """@nni.report_intermediate_result(loss)""" is still the string. In my mind, the produced file at /tmp/qsong/nni/annotation/ should be executed. In that file, the report function is changed to command from string.
It looks like a bug ?

How to reproduce it:

nni Environment:

nni version: 0.5.1
nni mode(local|pai|remote): local
OS:Linux
python version: python3.5
is conda or virtualenv used?:  NO
is running in docker?:NO

Anything else we need to know:

The problem is solved. I should not write the path information at comand line in the yml file.  After it's removed, everything is ok.

@songqiqqq I met the same problem. Could you please explain more on how you solved the problem?

I found out the problem is due to I use mmdetection(mmclassificatoin, detectron2,etc. should have similar phenomenon) for training. I post the solution here if anyone else met the same problem. Although the code is copied to trial dir, it actually uses the original code path where nni.report_intermediate_result is still commented. Change python tools/train.py ... to python setup.py develop && python tools/train.py ... would solve the problem.


CP-SAT: not all threads are used, why?

What version of OR-tools and what language are you using?
Version: v.8.1.8487
Language: Python 3.7.5
Which solver are you using (e.g. CP-SAT, Routing Solver, GLOP, BOP, Gurobi)
CP-SAT
What operating system (Linux, Windows, ...) and version?
Ubuntu
What did you do?
I run a CP-SAT solver in AWS on machine with 32 threads and I expected that, after it found first feasible solution, it will exploit all possible threads, but it does not work like that. It is using between half and two thirds of all threads.
What is a reason of such behaviour? Is there any way to use all threads?
I set num_search_workers in the following way:
solver.parameters.num_search_workers = multiprocessing.cpu_count()
What did you expect to see
I expect solver to use all avaliable threads.
What did you see instead?
Solver is not using all avaliable threads.

check cpu_count. Most likely it is 1 or 2.
Laurent Perron | Operations Research |<EMAIL_ADDRESS>| (33) 1 42 68 53
00
Le jeu. 18 févr. 2021 à 14:46, rybickibartek<EMAIL_ADDRESS>a
écrit :

What version of OR-tools and what language are you using?
Version: v.8.1.8487
Language: Python 3.7.5
Which solver are you using (e.g. CP-SAT, Routing Solver, GLOP, BOP,
Gurobi)
CP-SAT
What operating system (Linux, Windows, ...) and version?
Ubuntu
What did you do?
I run a CP-SAT solver in AWS on machine with 32 threads and I expected
that, after it found first feasible solution, it will exploit all possible
threads, but it does not work like that. It is using between half and two
thirds of all threads.
What is a reason of such behaviour? Is there any way to use all threads?
I set num_search_workers in the following way:
solver.parameters.num_search_workers = multiprocessing.cpu_count()
What did you expect to see
I expect solver to use all avaliable threads.
What did you see instead?
Solver is not using all avaliable threads.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/google/or-tools/issues/2399, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACUPL3ILLBPBR63ZYLXVZALS7UK3XANCNFSM4X2KQQRQ
.

I execute the following snippet of code and I get 32.
`In [1]: import multiprocessing
In [2]: multiprocessing.cpu_count()
Out[2]: 32`

I seems to work on my machine.
Anyway, I routinely use 32 to 72 threads, and it works flawlessly.
Laurent Perron | Operations Research |<EMAIL_ADDRESS>| (33) 1 42 68 53
00
Le jeu. 18 févr. 2021 à 15:17, Laurent Perron<EMAIL_ADDRESS>a écrit :

check cpu_count. Most likely it is 1 or 2.
Laurent Perron | Operations Research |<EMAIL_ADDRESS>| (33) 1 42 68
53 00
Le jeu. 18 févr. 2021 à 14:46, rybickibartek<EMAIL_ADDRESS>a
écrit :

What version of OR-tools and what language are you using?
Version: v.8.1.8487
Language: Python 3.7.5
Which solver are you using (e.g. CP-SAT, Routing Solver, GLOP, BOP,
Gurobi)
CP-SAT
What operating system (Linux, Windows, ...) and version?
Ubuntu
What did you do?
I run a CP-SAT solver in AWS on machine with 32 threads and I expected
that, after it found first feasible solution, it will exploit all possible
threads, but it does not work like that. It is using between half and two
thirds of all threads.
What is a reason of such behaviour? Is there any way to use all threads?
I set num_search_workers in the following way:
solver.parameters.num_search_workers = multiprocessing.cpu_count()
What did you expect to see
I expect solver to use all avaliable threads.
What did you see instead?
Solver is not using all avaliable threads.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/google/or-tools/issues/2399, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACUPL3ILLBPBR63ZYLXVZALS7UK3XANCNFSM4X2KQQRQ
.

I would expect to have 32 running instead of 23.

So, an intel 32 core CPU will be 16 core + 16 hyperthread.
Hyperthreads have an efficiency around 1/3. So 16 / 3 is between 5 and 6.
So 21-22 full cores.
I may mis-understand how CPU works, but getting around 22 full CPU is what
I would expect from an hyperthreading environment.
When I run a large CP-SAT model on my linux workstation with 64 threads, I
get
PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+

COMMAND
377019 lperron   20   0 2242780 862584   9964 S  6387   0.4  77:26.26 fz
So it is clearly using 64 cores fully.
My point is: I know CP-SAT works well with multiple threads, and fully
utilizes them.
The problem may be in the reporting, or in the low level scheduling on the
OS.
Good luck.
Laurent Perron | Operations Research |<EMAIL_ADDRESS>| (33) 1 42 68 53
00
Le jeu. 18 févr. 2021 à 15:23, rybickibartek<EMAIL_ADDRESS>a
écrit :

[image: Screenshot 2021-02-18 at 15 22 12]
https://user-images.githubusercontent.com/29629799/108370651-2d8fde80-71fd-11eb-8b9e-bc89ea113228.png
I would expect to have 32 running instead of 23.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/google/or-tools/issues/2399#issuecomment-781378632,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACUPL3MFYK6YTEA4D7WBLX3S7UPHXANCNFSM4X2KQQRQ
.

Thanks for help!

Sorry for reopening, but I have similar issue with c5.24xlarge (AWS) which has 48 cores (96 vCPU), and only 28 threads are running. So less than 30% of CPU power is used. Are you sure that there is no any issue on or-tools side?

No. I run it a lot with very high number of threads.
I suppose it is an AWS issue.
Laurent Perron | Operations Research |<EMAIL_ADDRESS>| (33) 1 42 68 53
00
Le mar. 23 févr. 2021 à 12:53, Mizux<EMAIL_ADDRESS>a écrit :

Assigned #2399 https://github.com/google/or-tools/issues/2399 to
@lperron https://github.com/lperron.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/google/or-tools/issues/2399#event-4364750147, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ACUPL3IWDRYM4MQ4SQGCSOTTAOJNJANCNFSM4X2KQQRQ
.

Ok it seems that it is a problem with reporting on AWS side.
It seems that you are right, or-tools fully utilizes CPUs.
Thanks for help!


[Feat]: Adding favicon.cc website to free-hit

What feature?
Favicon.cc is a website that allows users to create and customize favicon icons for their websites. It provides a simple and intuitive interface to design and generate favicon images in various formats.
Add screenshots
Add screenshots

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Please assign this issue to me so that I can contribute to your amazing project 😇

@Prajwal0225 are you working under gssoc23

Can you please assign me this issue under GSSOC'23?

Yes I am working under GSSOC


HTTP status: 401

From time to time, I have 401 errors (Azure OpenAI).
I've completed the previous steps.

and I would have 401 from time to time, but after running cell a couple of times, I would get a response

(I changed the prompt in this specific example to give me JSON so it's different)

in #6-Memory-and-embedding step, I keep getting 401 all the time

@cherchyk this seems like a throttling issue, a couple followup questions:

Have you checked your Azure OpenAI quota limits?
Has notebook 6 ever run successfully for you?

@cherchyk  I was not able to reproduce this on my side.
Make sure you provide proper credentials in your settings.json by running steps 0 and 00.
Also, try with the latest version as some changes have been put in.
Let us know whether you are still experiencing the issue.