QR requests screen

Description:
The QR will have the Hexa logo in the center and two words like ‘F&F Request’ for all types of QR.
Display heading/ subheading as follows:
a. Above QR. Heading: "Scan QR" Subheading: "With your contacts Hexa app"
b. Above Link: "Share link" Subheading: "With the contact"
Need to add an option at the bottom: "Secure with 2FA". If tapped, an option opens up where the user can choose OTP or Confirm Phone Number or Confirm email. (Phone number and email may not be present) When the user selects any one, the QR or link on the screen changes and the selected option is shown at the bottom

Do the QR image

https://xd.adobe.com/view/182db13e-dc6a-40ec-a319-5bf018182399-4d7e/screen/c08dd9e9-baa9-4376-b115-c3e3a94dc843/

@Parsh - note here that when the 2FA is chosen, even the QR changes. Not just the link

Depending on what data the user has, this screen will show options. E.g. if the contact does not have an email ID, it will not show that option.
OTP is always shown.
Below each option (instead of Lorem Ipsum) the actual phone number or email address is shown. As example Contact name’s phone number:<PHONE_NUMBER>. OTP is also shown
Depending on what the user selects, the data is encrypted with that option

Verified this issue on dev app v1.9.5(330)


Not working on Android 10+ (permission issue?)

I know this project is not active, so this probably won't be fixed.  But it's worth pointing out that this plugin is not working for me anymore when compiled for Android SDK 29.  There are no runtime errors in console, and no BLE devices are discovered.
A quick search brings up new permission requirements for Android 10+:
android.permission.ACCESS_FINE_LOCATION,
android.permission.ACCESS_COARSE_LOCATION,
android.permission.ACCESS_BACKGROUND_LOCATION.
https://stackoverflow.com/questions/58428763/android-10-not-working-with-ble-bluetooth-scanning
I tried adding those to the AndroidManifest.xml with no luck.
It's interesting that older versions of my App which were compiled previously with older SDK continues to work and discover BLE devices on Android 10+.  And seems google won't let me submit a newly build app to the app store unless SDK >= 29.
WTF does google require FINE and BACKGROUND location just to use BLE?  I'm not trying to spy on users of my app and I don't use location at all.  IMO by requiring these in every BLE app, they are desensitizing people to the requirement of location permission.  So when a spyware app asks for LOCATION permission it just seems normal.  Anyway... Rant over.
Has anyone got this working on Android 10+?

Yes, @phatpaul it does work on Android 10+. Had the same issue months ago.
It seems it's fine for new installers of the app but is an issue is for users updating (which I assume you are too). The only solution we have found is for users to turn off their location permissions and then turn them straight back on again which seems to make Android set the correct settings internally. Changing the android.permissions made no difference, seems it is a bug between Android SDK versions.

Yes, @phatpaul it does work on Android 10+. Had the same issue months ago.
It seems it's fine for new installers of the app but is an issue is for users updating (which I assume you are too). The only solution we have found is for users to turn off their location permissions and then turn them straight back on again which seems to make Android set the correct settings internally. Changing the android.permissions made no difference, seems it is a bug between Android SDK versions.


Unexport parameters stuff

The most of the content is in the second commit. Please see the commit message there.
@erikbern can you review as you wrote much of this?
For later when I actually refactor the code, I know have a rough idea of how many test cases that needs to be changed with that refactoring.

Also, by hiding the stuff now, it's unblocking a potential 2.0.0 release and the actual refactoring can happen under the hood not requiring yet another major version bump.

LGTM

@Tarrasch - this PR removed some public apis from Parameter class, e.g. value, has_value, reset_global, etc. For people who access them in workflows, upgrading from 1.3 to 2.0.0 will break things.
I guess it's ok, since it's a major upgrade, but it would have been nicer if these methods were deprecated in one of 1.* releases (just something to maybe keep in mind for the future).

@jkukul - Then the cost for the maintainers is higher. I agree it would be nicer with deprecations in-between, but then we wouldn't have time to do other nice things. Also, all of those methods were inherently buggy. Their behaviour was undefined really.
I'm sorry if things broke for you. :-/

Also this PR is related to #1182

@Tarrasch no problem! I completely understand that the development speed is on the other side of the trade-off and that finding the right balance is hard.


feat(tail) Iterant.dump

PR for #434
This is pretty straightforward, I've used map for printing because there is no foreach. On second thought I should probably write
case NextCursor(cursor, rest, stop) =>
          cursor.map { el =>
              out.println(s"$pos: $prefix --> $el")
              pos += 1
          }
          NextCursor[F, A](cursor, rest.map(loop), stop)

instead of
case NextCursor(cursor, rest, stop) =>
          val dumped = cursor.map { el =>
              out.println(s"$pos: $prefix --> $el")
              pos += 1
              el
          }
          NextCursor[F, A](dumped, rest.map(loop), stop)

but I will wait for your opinion and fix with any other comments

@Avasil thanks for sending another PR 😀
On your question, it doesn't work, because a Cursor can have either strict or lazy behavior in map, depending on the underlying implementation ... so you can have cursors over arrays, which are strict, but you can have cursors over Iterator, which are lazy.

@alexandru
You're right about var, actually this was my first approach but I've had some weird behaviour for batches/cursor but it turns out I was printing wrong index... facepalm
I still have some vars, but completely local, so it should be referentially transparent now but i can also write it like this, I'm not sure what's better:
val newPos = cursor.foldLeft(pos) { (cursorPos, el) =>
    out.println(s"$cursorPos: $prefix --> $el")
    cursorPos + 1
}

And I'm happy to contribute, if there are more newbie-friendly functions (but progressively harder!) you'd like to delegate to someone I'd love to help

@alexandru Well, after some thought I came to the conclusion that I can't use foldLeft for incrementing updated position for batch/cursor because foldLeft is side-effecting (consumes cursor) and dump shouldn't do any side-effects apart from IO


Hang completing code when outside of func, type, etc.

example
import (
"log"
)
type FileNode struct {
giv.FileNode
}
TRY COMPLETING HERE - you get proper list (const, type, etc) but hitting return will result in endless spinning. But all good it seems if only one completion option is available.

likely the dash issue..


[SLM] Remove C++ mlc_chat_cli in favor of the new SLM Python CLI

This PR removes the old C++ based mlc_chat_cli in favor of the new Python CLI built on top of the SLM pipeline.

All files related to C++ based CLI is removed
Docs are updated to point to the new CLI

The mlc_chat_cli is also used for android targets (cross compiled) too.
Python CLI is not a good idea for deploy over RPC.
Any thoughts here ?

Perhaps I'm missing something, but was something hurting by the cpp CLI interface existing? It'd be nice to have it to experiment with.

The mlc_chat_cli is very good for experiments with debug/optimization, and easily to be verified on Windows, Linux as well as Android.
We really want this cli tool back.


Use nodeset_networks ansible var

There is no concept of role, use nodeset_networks instead.
As a pull request owner and reviewers, I checked that:

[x] Appropriate testing is done and actually running

This is apparently linked to https://github.com/openstack-k8s-operators/dataplane-operator/pull/793 ?

This is apparently linked to openstack-k8s-operators/dataplane-operator#793 ?

Seems maybe this one: https://github.com/openstack-k8s-operators/dataplane-operator/pull/790

/approve
(need to get some more patches in before we can actually merge it)

recheck

recheck RETRY_LIMIT

recheck tempest crash

Someone can add lgtm to merge this I guess.

/lgtm
let's see how it goes now.


GRCRestarter force closing client despite being on latest version

This is the 3rd time I've experienced this with the latest client version, the grcrestarter believes that there is a more recent version of the client available (despite being on the latest version) and attempts to upgrade (windows UAC prompt - yes/no options both close the client).
I realize that the grcrestarter may make it easier for mandatory upgrades to go through, but i'd prefer to opt out of forced upgrades, especially when it shuts my staking client down.
Has anyone else experienced this?

hrm i think someone else mentioned this. anything useful in the grcrestarter.log?

Just had it happen again, posting all logs.
So I logged onto my windows machine, the grcrestarter is asking for UAC permission, I click 'No' and it closes my client fully.
Debug 2:
Jun 14 2017 00:20, Client outdated; needs upgraded[2].
Jun 14 2017 00:20, Found key AutoUpgrade 12/06/2017 06:12:54
Jun 14 2017 00:20, Ready for upgrade
Jun 14 2017 00:20, Restarting wallet with params upgrade

Debug (First instance of issue):
[DoTallyRA_START]  [DoTallyRA_END]
06/12/17 00:39:20 {SBC} SetBestChain: new best=f9cfb8a715e05cf28847  height=924311  trust=3275838333972824660711873320762369734724920483558585417587755121813965410246  blocktrust=17683569863  date=06/12/17 00:38:56
06/12/17 00:39:20 {ACC}{PB}: ACC;
06/12/17 00:39:20  {SVC} {Checking for Upgrade} socket sending timeout: 1201s
06/12/17 00:58:25 socket sending timeout: 1201s
			[repeating lines]
06/12/17 05:08:17 socket sending timeout: 1201s
06/12/17 05:09:08 Needs upgraded 1.000000
06/12/17 05:09:08 Executing upgradesocket sending timeout: 1201s
06/12/17 05:28:05 socket sending timeout: 1201s
			[repeating lines]
06/13/17 16:02:59 socket sending timeout: 1201s
06/13/17 16:13:26 Calling start shutdown...
06/13/17 16:13:26 {Done checking for upgrade}
bitcoin.cpp:main calling Shutdown...
06/13/17 16:13:27 gridcoinresearch exiting...
06/13/17 16:13:27 Flush(false)
06/13/17 16:13:27 DBFlush(false) ended               0ms
06/13/17 16:13:27 StopNode()
06/13/17 16:13:27 ThreadSocketHandler exited
06/13/17 16:13:27 ThreadOpenConnections exited
06/13/17 16:13:27 ipcThread exited

Debug (Second occurrence):
[DoTallyRA_START]  [DoTallyRA_END]
06/13/17 19:50:23 {SBC} SetBestChain: new best=7d351350280a95d3a5d2  height=926706  trust=3275838333972824660711873320762369734724920483558585417587755185816927163624  blocktrust=13450265960  date=06/13/17 19:50:40
06/13/17 19:50:23 {ACC}{PB}: ACC;
06/13/17 19:50:23  {SVC} {Checking for Upgrade} socket sending timeout: 1201s
06/13/17 20:10:01 socket sending timeout: 1201s
			[repeating lines]
06/13/17 22:55:19 socket sending timeout: 1201s
06/13/17 23:16:06 Needs upgraded 1.000000
06/13/17 23:16:06 Executing upgradesocket sending timeout: 1201s
06/13/17 23:19:55 socket sending timeout: 1201s
			[repeating lines]
06/13/17 23:37:56 socket sending timeout: 1201s
            [five days go by in a broken state... wow i should have noticed waaay earlier]
06/18/17 21:57:39 socket sending timeout: 1201s
06/18/17 22:07:07 Calling start shutdown...
06/18/17 22:07:07 {Done checking for upgrade} socket sending timeout: 1201s
06/18/17 22:07:07
Bootup
06/18/17 22:07:07
bitcoin.cpp:main calling Shutdown...
06/18/17 22:07:07 gridcoinresearch exiting...
06/18/17 22:07:07 Flush(false)
06/18/17 22:07:07 DBFlush(false) ended               0ms
06/18/17 22:07:07 StopNode()
06/18/17 22:07:07 ipcThread exited
06/18/17 22:07:07 ThreadSocketHandler exited
06/18/17 22:07:07 ThreadMessageHandler exited
06/18/17 22:07:08 ResearchMiner:ShuttingDown..ThreadStakeMiner exiting, 0 threads remaining
06/18/17 22:07:09 ThreadMapPort exited
06/18/17 22:07:11 ThreadOpenAddedConnections still running
06/18/17 22:07:11 ThreadOpenConnections exited
06/18/17 22:07:11 Flush(true)
06/18/17 22:07:11 DBFlush(true) ended               0ms
06/18/17 22:07:12 Gridcoin exited
06/18/17 22:07:12 ThreadOpenAddedConnections exited

The second occurrence, the client was stuck outputting the following for 5 days (not staking)

06/12/17 00:58:25 socket sending timeout: 1201s

hrm the socket timeout likely the node or wallet connections. thats in net not a vb file least search says that. i still think the hashes are not matching for some reason so it keeps thinking it needs an upgrade.

Tried adding 'suppressautoupgrade=true' to my config file, grcrestarter again kicked my client offline. Is this the wrong entry for the config file? grcrestarter shouldn't be so aggressive.

Auto upgrade is such a Microsoft thing to do. Why?

suppressupgrade=true

Why?

For blockchain safety. It is important that security holes are plugged on supermajority of nodes fast.

Does Bitcoin have force upgrade?

This just happened to me.

Should we disable grcrestarter for now and have people download the new version manually? When time comes we can add a more standard way of checking for updates.

I'd prefer that we scraped the github repo release page to compare versions, then providing a notification with the MSI download links or optionally upgrade the files via grcrestarter. Automatically throwing you to the UAC and killing the client can lead to long periods of client downtime.

Just a thought: not all client updates are super important, right? Some updates are urgent because of security holes, others just implement new features.
There could be some sort of "update priority level indicator" that has like three levels: low prio, medium prio, high prio. Every update that is available for download will be flagged with one of these three, e.g. a security upgrade would receive the high prio flag.
The updater then can suggest the user in what time frame the update should be downloaded, e.g. "High Prio update! It is advised to update your client within the next 24 hours" or "Low Prio update! Please update your client within the next 7 days."
Then there could be several options how to proceed, e.g. "update now" / "update in x hours" / "update in x days" - preferably letting the user manually pick the number of hours/days  - and/or have an additional "update behaviour" setting that gives the user to set up X for different update priorities.
Something that should be ensured is that client auto-restart after update is applied correctly (if necessary).

Killing the running client is a bit cut throat.
I would feel better about the auto-upgrade if it happened like ClickOnce where it applied the update the next time the client started. However, I would still like the option to say yes/no to applying the update even if it's something that has to be added to the conf to enable the confirmation dialog.
With the way it is now I've set suppressupgrade=true in the .conf which has solved the bug (I mean feature) permanently.

We can fix the false positive signal where it thinks it should upgrade for one.  Since the majority of nodes are windows, while we are still in beta, it is definitely valuable to have the feature.
  There is a thread that flushes the wallet, look in the stopnode area, that detects when the client is being killed.  GRCRestarter sends the signal to kill the wallet in 10 seconds.  Then the wallet exits gracefully.  GRCRestarter has a busy wait loop waiting for the process to exit before it upgrades.  So its the same as clicking exit, waiting, then upgrading the files.

I get that it's a valuable feature but the way it is now is just not expected behavior from any piece of software I've ever seen (other than the Windows OS which is controversial).
What if someone is in the middle of sending a transaction or building a transaction that took a lot of time to put together (lots of inputs and send addresses). It will annoy people when it shuts down.
Having a message displayed in the client that there's a new update, and have it auto-install on next start would be a lot more user friendly. You could even have a button next to the message that restarts it now.

I understand the concern- my only answer is : We dont have frequent updates, and it checks that flag on startup so its more likely that you havent started doing that yet- and yes, I agree if there is a better long term way we should do it.  For now the benefits outweigh the risks -
There are a LOT of situations like this in Gridcoin, like the necessity to port the Neural network to c++, cosmetic features, ease of use for boinc integration- all competing for resources.
If you want an idea that works, the gitian builder system from bitcoin works, and does include a signed installer.  The pro is the user can reinstall all of GRC with one click.  The con is we will no longer have auto updates.
So for now while we are in beta, its still valuable to have the legion of windows at least upgrade the version to a supermajority.

Ok, you've sort of convinced me, but bare in mind there have been a few people in IRC complain about it.
Maybe making the updates happen on startup is something to think about in the future when it comes out of beta and updates are not as critical.
The Gitian Builder system looks interesting and a good way to prove that the final build is trustworthy.


Add Rust template

Add copier rust template with options:

open_source
lib/bin
python bindings

Adding @tiyash-basu-frequenz as a reviewer too as he said he had some ideas for this template too.


Prefer len(os.sched_getaffinity(0)) over os.cpu_count()

Description

Closes #30
By Submitting this PR I confirm:

I am familiar with the Contributing Guidelines.
When the PR is ready for review, new or existing tests cover these changes.
When the PR is ready for review, the documentation is up to date with these changes.

/merge


Revise tests to avoid using Eumerable.Range

Starting with .NET 8, Eumerable.Range returns an instance of a private RangeIterator that implements IList<T> (see also dotnet/runtime#88249). A lot of the unit tests potentially went with the assumption that Eumerable.Range returns a pure sequence. There are some operators in MoreLINQ that are optimised for sources that are collections and/or lists so tests using Eumerable.Range may be testing those optimised paths rather than the actual intended path iterating the source as an IEnumerable<>. Those tests need to be revised to avoid Enumerable.Range altogether.
Potential candidates that need revision:

[ ] AggregateRightTest
[ ] AggregateTest
[ ] AppendTest
[ ] AssertCountTest
[ ] AtLeastTest
[ ] AtMostTest
[ ] BacksertTest
[ ] ChooseTest
[ ] CompareCountTest
[ ] ConsumeTest
[ ] CountBetweenTest
[ ] CountByTest
[ ] CountDownTest
[ ] ExactlyTest
[ ] FlattenTest
[ ] FoldTest
[ ] GroupAdjacentTest
[ ] InsertTest
[ ] MemoizeTest
[ ] MoveTest
[ ] PadStartTest
[ ] PairwiseTest
[ ] PartitionTest
[ ] PermutationsTest
[ ] PrependTest
[ ] PreScanTest
[ ] RandomSubsetTest
[ ] RepeatTest
[ ] ScanRightTest
[ ] ScanTest
[ ] SequenceTest
[ ] ShuffleTest
[ ] SkipLastTest
[ ] SkipUntilTest
[ ] SubsetTest
[ ] TakeUntilTest
[ ] TestingSequenceTest
[ ] ToDataTableTest
[ ] TraverseTest
[ ] TrySingleTest
[ ] WindowLeftTest
[ ] WindowRightTest

I'll create the branch, that way we can each work on it. Honestly, they should all be TestingSequence regardless, and then it doesn't matter.

@viceroypenguin Awesome.

they should all be TestingSequence regardless

PR #475 is addressing that.

Ah, I remember this one. I used it as a foundation for some of the changes I did in SuperLinq to handle this consistency. I'll pull in the commits here and offer some additional improvements for you to decide on. I'll push something shortly.

Created the first draft in e3c5554. After review, I didn't see that much in #475 that was usable here, though there may be some overlap you see that I don't.
For the first commit, I did the following:

Add .ToTestData() extension method

This simplifies the creation of different testing sequences
Actually uses TestingSequence for SourceKind.Sequence instead of a simple sequence

Update all AggregateRight tests to use TestingSequence, either directly or via .ToTestData().

One open problem that you can probably solve quicker than me: The various tests that use TestCaseSource are not folding up into child properties of their method test. The existing test case methods don't exhibit the same behavior, so I'm not sure if the difference is because they're void methods, or if there is another factor. I don't use nUnit myself, having switched to the much simpler xUnit, so I don't have the background to know this without further research.


mWeb - Compose Box - The magnifying glass moves up when words are highlighted

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 1.3.93-0
**Reproducible in staging?:**Y
**Reproducible in production?:**N
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Expensify/Expensify Issue URL:
Issue reported by: Applause - Internal Team
Slack conversation:
Issue found when executing PR https://github.com/Expensify/App/pull/29434
Action Performed:

Open https://staging.new.expensify.com/
Log in with an expensifail account
Open any chat and paste an RTL text in the compose box, for example " مثال "
Write any word in English, for example, "Hello."
Highlight the word "Hello" and move the selection cursor all the way to the left to fully highlight the word "مثال" at the same time

Expected Result:
When English and Arabic words are highlighted at the same time, the magnifying glass should magnify the highlighted text and not move across the screen beyond the text
Actual Result:
When English and Arabic words are highlighted at the same time, the magnifying glass moves upward
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Native
[x] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[ ] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos

Android: Native

Android: mWeb Chrome

https://github.com/Expensify/App/assets/78819774/4fba87af-90c2-4f8b-b24b-82b1d4ddef99

iOS: Native

iOS: mWeb Safari

MacOS: Chrome / Safari

MacOS: Desktop

View all open jobs on GitHub

:wave: Friendly reminder that deploy blockers are time-sensitive ⏱ issues! Check out the open StagingDeployCash deploy checklist to see the list of PRs included in this release, then work quickly to do one of the following:

Identify the pull request that introduced this issue and revert it.
Find someone who can quickly fix the issue.
Fix the issue yourself.

This is a weird one. I don't think we should block the deploy for it since most users don't type in RTL characters.

Hey @stephanieelliott! Going to un-assign myself for now and let this go the regular bug route since I believe it can be solved externally if it is reproducible and worth fixing.

Adjusting labels to be fixed externally

Reapplying the Bug label to get another BZ member on this while I am OOO til Nov 13. Thanks @NicMendonca,  I'll grab this back from you when I return!

Hey! I'm Bartek from Callstack and I would work on this issue.

I can't reproduce that. For me composer behaves other way:

When I paste RTL text - the content is aligned to the right
When I start typing after RTL text - the content is still aligned to the right which looks a proper way
When I start typing previous RTL text - content is aligned to the left, looks a proper way

Is it connected to a particular device or Android version?
I've tested it on LG Velvet (LM-G900EM), android 13
cc: @NicMendonca @lanitochka17
https://github.com/Expensify/App/assets/7682108/61eca274-b1a7-486b-98dd-660f3e1f9bf0

Here is a mWeb recording
https://github.com/Expensify/App/assets/7682108/05466b91-d920-4e5e-bbc0-673b6796101e

I am not able to reproduce this issue on Samsung Galaxy A50/Android11
https://github.com/Expensify/App/assets/78819774/7e9a67bb-25f0-4557-a19f-9c931a415f9b

@aimane-chnaif which device did You use to test it?

Grabbing this issue back, thanks @NicMendonca!

Thanks @aimane-chnaif!
I suspected that maybe this issue happened only to Samsung devices. However, I've checked that on Samsung s10 lite and still can't reproduce it. I tried pasting RTL text with and without space at beginning - always the same, proper result.
Any thoughts on how to reproduce that, every time? Maybe I've missed some details.

still can't reproduce it. I wondering what is the detail that makes this issue happen.
https://github.com/Expensify/App/assets/7682108/e9640040-6ac7-4b39-a547-0bfc45a5cd21

I can't reproduce this either, it seems like it is happening only in very specific scenarios. Given how edge case it is (must type arabic and english characters, then highlight them), I think we should close this. If you disagree, feel free to reopen and start a discussion.


LXD Containers

Anyone have a solution for running this inside a LXD container?
Host: Ubuntu 17.04
Container: Ubuntu 17.04
I am forwarding port 1194 from the host to the container using iptables.
Sadly I still can not connect.

sudo systemctl status openvpn@server shows:
Failed to start OpenVPN connection to server.
Commenting out the LimitNPROC line in<EMAIL_ADDRESS>allows the service to run but I still can not connect.

If the service is running, maybe haven't forwarded the port correctly.
Or maybe you did set up the NAT wrongly, check this.
Difficult to troubleshoot more with the information given, but this does seem like a connectivity issue.


[17.5] Update Razor addin version to 17.5

17.5 backport of https://github.com/dotnet/razor/pull/8164

/cc @davidwengier @mrward


Added in end model to synthetic tutorial

[DRAFT PR] Adds in the basic EndModel from metal to the synthetic tutorial
@henryre @bhancock8 @paroma My goal is to have a basic, single-task end model working.  Is it worth merging this in, or should I use the MTL code, or...?  (Note: I know could also import external lib, but while we still support some end model capability, want to have it here)
Let's discuss the above and then can finish & clean this up, discard, or modify.

Waiting to comment until MTL vs. not MTL is resolved.
 Lets strip those out

In the interest of going from working to working, I say go ahead with porting the EndModel for now. Can merge in a follow-up PR if we have time.   I'll leave this open till that route is confirmed though.


gauss noie can be negative

What is usecase? Don't it break clipping?

I would say, it is just the definition of the Gaussian Noise. Should have zero mean.
We clip on both sides [0, 255] => Everything should work.


Integration with Leaflet

It would be great to layer React Flow on top of a map to open this to location-based visualizations. Would this even be possible?
Here is an example without the map I put together.
https://codesandbox.io/s/networked-map-markers-bfcp4
Just imagine how it might look with a map underneath.

wow! that is a crazy use case for react-flow. I am not sure if it is possible to abstract that functionality and build it into the core of the library. could you provide some pseudo code how you would expect react-flow to work in that case?

I think this is not something that we can support from this library. Maybe a way of doing this would be to sync the positions of the elements with the map (map.containerPointToLatLng). There are also some network visualization plugins for leaflet already existing (for example https://github.com/danwild/leaflet-network).


java-openliberty: Add kafka template

Checklist:

[x] Read the Code of Conduct and Contributing Guidelines.

[x] Followed the commit message guidelines.

[x] Stack adheres to Appsody stack structure.

Modifying an existing stack:

[x] Updated the stack version in stack.yaml

Add a new kafka template for apps using mpReactiveMessaging to work with Kafka.
README changes to be added shortly.
Tested:

appsody run, appsody test
appsody deploy to k8s on Docker Desktop
appsody deploy to OpenShift

Related Issues:
Fixes: 477

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: ianpartridge:x: matthewpwilsonYou have signed the CLA already but the status is still pending? Let us recheck it.

Requested a review from stack maintainers. cc @scottkurz @awisniew90 :)


Exception: API Key and the authentication credential are from different projects

If you have multiple sets of valid credentials configured in your Java environment, the Cloud library will not resolve between the two.
Repro steps

Configure client library for API key: export GOOGLE_API_KEY=SOME_VALID_DEVELOPER_KEY
Configure client library for valid credentials from separate project: export GOOGLE_APPLICATION_CREDENTIALS=./creds.json
Run java sample, e.g. from github.com/GoogleCloudPlatform/java-docs-samples/translate...

mvn clean compile assembly:single
JAR_FILE=target/translate-1.0-jar-with-dependencies.jar
INPUT="A quick brown fox jumped over a lazy dog."
SOURCE_LANG="en"
TARGET_LANG="fr"
java -jar $JAR_FILE translate "$INPUT" $SOURCE_LANG $TARGET_LANG

Expected outcome
Client library warns developer but uses an access token from the service account.
Actual outcome
Client library fails, throwing exception and crashing app.
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
  "code" : 400,
  "errors" : [ {
    "domain" : "global",
    "message" : "The API Key and the authentication credential are from different projects.",
    "reason" : "badRequest"
  } ],
  "message" : "The API Key and the authentication credential are from different projects.",
  "status" : "INVALID_ARGUMENT"
}

We are seeing this in the AppVeyor integration test - looks like an important issue to address.

GOOGLE_APPLICATION_CREDENTIALS should override gcloud auth application-default login

@lesv This is happening when you are using the GOOGLE_API_KEY environment variable alongside the GOOGLE_APPLICATION_CREDENTIALS variable. I am not sure whether the default application credentials are affecting the conflict.

It doesn't sound like this will block GA for Storage, Logging, PubSub, Datastore, or BigQuery

I think this should block GA for Translate.

@gguuss It shouldn't be hard to ignore GOOGLE_API_KEY when GOOGLE_APPLICATION_CREDENTIALS is specified, but I'm wondering about the case where an explicit API key is passed to a call --- in this case, would you expect the service account credentials to be ignored?

(This may also be relevant to proper resolution of #1594.)

Initial modification at https://github.com/GoogleCloudPlatform/google-cloud-java/pull/2151 is expected to resolve the specific error seen here, but I'd like to add some additional tests once we have consensus on proper behavior where an explicit API key is provided.

Marking as release blocking until @tcoffee-google 's change #2151 is submitted.

@tcoffee-google I'm in favor of ignoring API key when Google application credentials is specified and somewhere documenting precedence for credentials. Regarding API key, it would be helpful to have a scenario that shows what you mean when referring to explicitly including an API key with an API call.  Is there a way to call the client library and include the API key in the call?

@gguuss Sorry, I shouldn't have said "call" (this is done in the Apiary client library, which supports the API key query parameter with each request) --- I meant where the API key is explicitly specified in the service options, i.e., through TranslateOptions.Builder.setApiKey.
It seems to me a user would be very surprised if they explicitly set an API key in their service options but it was overridden by the GOOGLE_APPLICATION_CREDENTIALS environment variable. Thus I would say the order of precedence should be:

explicitly set service account credentials (through ServiceOptions.Builder.setCredentials
explicitly set API key (through TranslateOptions.Builder.setApiKey)
default service account credentials (through GOOGLE_APPLICATION_CREDENTIALS)
default API key (through GOOGLE_API_KEY).

What do you think?

Thus I would say the order of precedence should be:

explicitly set service account credentials (through ServiceOptions.Builder.setCredentials
explicitly set API key (through TranslateOptions.Builder.setApiKey)
default service account credentials (through GOOGLE_APPLICATION_CREDENTIALS)
default API key (through GOOGLE_API_KEY).

@tcoffee-google I agree, environment configuration should not override explicit configuration (e.g. through a builder); your ordering makes sense to me.

Fixed by #2151.


[ECS] Fix loop code sniffer inconsistency

https://github.com/squizlabs/PHP_CodeSniffer/blob/62cd52272e9351f6c9d258e2653ee29e6426456e/src/Fixer.php#L151

Add loop for specific sniffs here
https://github.com/Symplify/Symplify/blob/master/packages/EasyCodingStandard/packages/SniffRunner/src/Application/SniffFileProcessor.php#L221


lncli listchaintxns shows not owned txs

I don't know if its an issue, or its on purpose, just wanted to know what is happening
Background
i have been trying loop in testnet, for this loop in HTLC 2MuuE7evoExqtVmFX2K1WsJA6jpzY2aosac
which have 2 tx
this b7a46dceffca8b738344011fc74ad88cd5eb0c158ceee50b84d5ece3699672ae which i think is the on-chain payment funding the HTLC
and this 4dc4c183d937747db543a2f08753e16aa06ba688670ae9a1d24937f7544d4619 which i think its the loop server sweeping the payment, after the off-chain invoice was paid, and secret revealed..
but if i prompt my node with lncli listchaintxns i can see both txs tracked by my node wallet
the second with "total_fees": "0",
we can explore that tx and see that in fact it has fees, (wont be mined if not)
why is my node tracking that tx? isn't that tx supposed to be from the server side?
is loopd using LND to watch for the final resolution of the swap and maybe LND's transaction subscriptions just do weird accounting when it's not your TX?
also in LND logs is see
[INF] LNWL: Inserting unconfirmed transaction 4dc4c183d937747db543a2f08753e16aa06ba688670ae9a1d24937f7544d4619
that tx is not supposed to be inserted by my node wallet, or am i wrong?e.
Your environment

lnd 0.8.0-beta
Linux 4.4.0-166-generic
Bitcoin Core version v<IP_ADDRESS>-g2472733a24a9364e4c6233ccd04166a26a68cc65 (64-bit)

Steps to reproduce
Loop in and inspect logs
Expected behaviour
LND wallet module not to track that zero fee on-chain tx
Actual behaviour
LND wallet module tracking that that zero fee on-chain tx

This is intended, we show all transactions sent by the wallet. loopd uses lnd to create its transactions.

The fees being 0 is another bug, see https://github.com/lightningnetwork/lnd/issues/2936.
Closing per https://github.com/lightningnetwork/lnd/issues/3746#issuecomment-556388330.

@Roasbeef , question...
the 2nd tx: 4dc4c183d937747db543a2f08753e16aa06ba688670ae9a1d24937f7544d4619
i think its the loop server sweeping the payment, after the off-chain invoice was paid, and secret revealed.. or i am wrong?
if its the loop server, why is my wallet tracking that? is that because its destination is the HTLC address that i broadcasted? so its attached to an address of my ownership?

This seems like a bug actually, that transaction shouldn't show up for you.

Anything actionable here?

@Roasbeef from what I remember, we may be calling NotifyReceived on outputs that aren't ours, causing its spend to show up as relevant.

Fixed by the recent update to btcwallet master.


refactor weight to percent logic

resolves #12

[x] test examples
[x] run e2e tests
[x] add docs

To test:
$ OPERATOR_IMAGE=<username>/smi-adapter-istio make bootstrap build
$ docker push <username>/smi-adapter-istio:<tag>
# edit deploy/operator-and-rbac.yaml and replace image with one that was just built
# run e2e with following line
operator-sdk test local ./test/e2e --namespaced-manifest deploy/operator-and-rbac.yaml --namespace istio-system


[Bug]: Update the Jaeger Operator image will automatically update options es

What happened?
update jaeger-operator:1.21.2 -> jaeger-operator:1.25.0, then the /spec/storage/options config is automatically updated
before
spec:
    options:
      es:
          password: elastic
          server-urls: http://<IP_ADDRESS>:30029
          username: elastic

after
spec:
    options:
      es.password: elastic
      es.server-urls: http://<IP_ADDRESS>:30029
      es.username: elastic

Steps to reproduce
1: apply jaeger-operator:1.21.2
2: apply the Jaeger resource that contains the es config
3: update jaeger-operator:1.21.2 -> jaeger-operator:1.25.0
4: watching jaeger-prod-elasticsearch
apiVersion: jaegertracing.io/v1
kind: Jaeger
metadata:
  name: jaeger-prod-elasticsearch
  namespace: kube-system
spec:
  agent:
    image: jaeger-agent:1.21.0
  collector:
    image: jaeger-collector:1.21.0
  query:
    image: jaeger-query:1.21.0
  storage:
    dependencies:
      enabled: false
    esIndexCleaner:
      enabled: false
    options:
      es:
          password: elastic
          server-urls: http://<IP_ADDRESS>:30029
          username: elastic
    type: elasticsearch
  strategy: production

Expected behavior
The options config will be updated
Relevant log output
No response
Screenshot
No response
Additional context
No response
Jaeger backend version
No response
SDK
No response
Pipeline
No response
Stogage backend
No response
Operating system
centos
Deployment model
k8s
Deployment configs
No response

Is this affecting the functionality of your system or something?

Why does the update happen?

The result is the same. It isn't?

It seems this it not causing any problems in the functionality. Closing the issue


DragOverlay Wrapper does not resize to its content size.

The DragOverlay Wrapper seems to have  the same size as the component that was used to start the drag and not the size of its content which messes up collison.

For example: I want to drop it in the right dropzone but because of the overlay shape it has collision with the left dropzone.

The DragOverlay wrapper is intentionally sized the same as the draggable source, and will remain that way even if its children are sized differently.
However, if you decide to resize the first child of DragOverlay, we will now use the collision rect of the child rather than the DragOverlay as of this commit: https://github.com/clauderic/dnd-kit/pull/337
This will be released in the next major version, however you can start using it right away by upgrading to the versions of @dnd-kit tagged with @next on npm


Images Optimizations

Hi, I need some info on optimizing images on the application side (not the server side, for e.g. responding with different sizes for the image).
Are there any Down Sampling or Image Resizing available in the flutter?
https://developer.android.com/topic/performance/graphics/load-bitmap

Please check https://pub.dartlang.org/packages?q=image
Please consider asking support questions in one of the other channels listed at http://flutter.io/support .

This is more of a core feature request.
I've used most of the community libraries, most are buggy and not
maintained anymore or are maintained by an unprofessional programmer.
Customers complain about the performance of the apps we make using flutter.
I've made all of the optimizations one can think of, but the app still
doesn't feel completely native.
On Tue, Sep 11, 2018 at 14:10 Günter Zöchbauer<EMAIL_ADDRESS>wrote:

Closed #21649 https://github.com/flutter/flutter/issues/21649.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/flutter/flutter/issues/21649#event-1838064110, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABM_FIELBN5c-1Z-jLs3PQDf-XsyvSu0ks5uZ4T2gaJpZM4Wh1s_
.

I doubt the Flutter team will engage in image manipulation libraries.
You can always use a plugin to make native implementations available to Flutter https://flutter.io/developing-packages/
@Hixie any thoughts?

I don't really understand the feature request here.

@p30arena
If you just need compress image file, you can use flutter_image_compress
But I think an efficient down-sample algorithm is necessary, and flutter's Image is not as efficient as Glide at loading large images.
It load about 3 to 5 seconds to load 30 5M + local image into a RecyclerView using Glide in Android, and 15 seconds or more to use GridView +  Image. file in Flutter.
Flutter official provides a more efficient way to load large pictures is actually a more important thing.After all, the app itself is more often based on pictures and text
@zanderso  @Hixie

@p30arena
If you just need compress image file, you can use flutter_image_compress
But I think an efficient down-sample algorithm is necessary, and flutter's Image is not as efficient as Glide at loading large images.
It load about 3 to 5 seconds to load 30 5M + local image into a RecyclerView using Glide in Android, and 15 seconds or more to use GridView + Image. file in Flutter.
Flutter official provides a more efficient way to load large pictures is actually a more important thing.After all, the app itself is more often based on pictures and text
@zanderso @Hixie

That's my point, I wasn't able to elaborate, thanks.

@zoechi @Hixie
I think this issue should be opened again.
Thanks to @CaiJingLong

Flutter official provides a more efficient way to load large pictures is actually a more important thing.After all, the app itself is more often based on pictures and text

We should also consider animated gifs, they take too much memory,
https://github.com/flutter/flutter/issues/22299#issuecomment-424836254

I leave it to @Hixie to decide if this issue should be kept open or if this is left to community effort (plugin, ...)

Gif takes too much memory
https://github.com/flutter/flutter/issues/20521

Since it's unclear to me what specifically is being requested here, I'm closing this in favour of #32156 which I've opened as a tracking issue for a collection of memory-related Flutter issues.


docs(borealis): initial borealis CLI docs

https://deploy-preview-918--armory-docs.netlify.app/borealis


BaseVarDumper::exportInternal() may seem to have a problem

I think there is something wrong in this method.
In short: I suspect that for case 'object' var_export(serialize($var), true) causes an error when the serialized object contains callbacks.
I've got problems with logging and the debug toolbar caused by validation errors. In my log file I've got no logging at all for the request and the debug toolbar is replaced by warning:
( ! ) Warning: array_map(): An error occurred while invoking the map callback in /var/www/html/misc/c3integration/vendor/yiisoft/yii2/log/FileTarget.php on line 106
Call Stack
#	Time	Memory	Function	Location
1	0.0778	4585328	yii\base\ErrorHandler->handleException( )	../ErrorHandler.php:0
2	0.1114	4975160	yii\log\Logger->flush( )	../Logger.php:0
3	0.1114	4975472	yii\log\Dispatcher->dispatch( )	../Logger.php:170
4	0.1114	4975920	yii\log\Target->collect( )	../Dispatcher.php:183
5	0.1122	4986752	yii\log\FileTarget->export( )	../Target.php:111
6	0.1122	4987288	array_map ( )	../FileTarget.php:106

Is it possible that whenever a validation rule of a model contains a callback the serialization fails?
If Model::$_errors contains something (because of validation errors, of course) this leads to logging which in turn call the exportInternal() method with that model object. And the model object has $_validators which holds in its arrays somewhere a callback function, for example for the 'when' Validator property.

It's expected since callbacks could not be serialized in PHP.

Hm.... IMHO it's a bug. Debug extension and logging doesn't work with such validation rules, which are quite common.
The not serializable callbacks might be expected, but that parts oft Yii don't work anymore is unexpected.
Shouldn't I use callbacks in rules?

Couldn't you just remove the serialization in that place? It's 'just' the VarDumper...

http://php.net/manual/en/class.serializable.php

Yes, it's not serializable but indeed debugger and logger should try to avoid crashing even for the case.

may be add serializable for yii\base\Component and check properties on callable?

How would that help?

@samdark on serialize will be return array without callable properties

check only public

Resolved by commit f2f211f


The link in README.md should be corrected.

The link to LICENSE.md in the License section of README.md should be changed to LICENSE.txt.

Up


Security issue with set-value

Github signals a security issue with set-value. It says to upgrade to version 2.0.1 or later

Updated.


Cannot read property 'length' of undefined when clicking links

I'm just getting started with smoothstate.js. I'm getting this error when clicking links inside the page. Does anyone know what could be the issue?

Edit: I'm using Zend Framework btw.

Hey there,
I'm getting the same error! =(

I was having this issue with some invalid HTML code. which cause jQuery to reload.
For example :

Some content

But if you do

Some content

Hope this will help you. I faced the same issue for around 3h...

@Anwardo, did @HugoHeneault's suggestion help you?

I've realized it would best to move personal support requests over to Stack Overflow. There's a special smoothstate.js label for us there. This will help us keep the Github issue tracker clean for bugs, pull requests, and enhancements. If you're not having any luck on Stack Overflow, feel free to join the Gitter room and ping me there. I'll try to help as much as I can.
That said, I'll be closing out this issue.


added support for Ops Mgr 1.11

Change was made to New Relic tile to support PCF / Ops Mgr 1.11.x.
Documents have been updated.

@shahramk Thanks!


Improve tooltips positioning

Problem
In multiple cases, our tooltips positioning is not working great. We are mainly facing three issues:

Tooltip is positioned out of screen - see first screencast
Tooltip is not reacting to windows events (scroll, resize...etc) - see second screencast
Tooltip is not initializing correctly - see #2736

We have mainly two components that we need to fix: StyledTooltip and EditPublicMessagePopupContainer. The second provides its own code for positioning, while the first one relies on react-tooltip (that obviously is not doing its job properly).

Proposal
PopperJS is a small library (6kb) whose role is solely to position poppers. popper.js is not a tooltip library, it's a positioning engine to be used to build features such as (but not restricted to) tooltips. It's popular (13k+ stars) and maintained.
We should ideally use it though its React implementation, https://github.com/popperjs/react-popper.

[x] Remove the custom positionning logic in EditPublicMessagePopup by using react- popper
[ ] Get rid of react-tooltip in StyledTooltip, use react-popper for positioning (maybe take the code from https://github.com/opencollective/opencollective-frontend/blob/f7c8da49023345248976ca7265c155f7a66be9ae/components/EditPublicMessagePopup.js#L36 to render the arrow?)
[ ] Two components are still using react-tooltip directly, migrate them to StyledTooltip and uninstall react-tooltip from frontend

Popper 2 is approaching its stable release. If you'd like to contribute, it's on, d'uh, OpenCollective 😄
Here's the alpha 2 changelog:
https://opencollective.com/popperjs/updates/popper-2-alpha-2-is-out

Hello @FezVrasta! Thanks for the info, I missed the fact that a new major was about to be released - thanks for jumping in :slightly_smiling_face: Also glad to see that you joined Open Collective, feel free to join us on Slack if you need help with anything.
The company gives us a budget to contribute to the project that we use, I'll be happy to contribute to Popper as soon as we start using it :wink:

react-popper has been introduced in the codebase in https://github.com/opencollective/opencollective-frontend/pull/3857 and should now be the default to build new tooltips (side note: it's delightful to work with!).
A work has been started to migrate EditPublicMessagePopup: https://github.com/opencollective/opencollective-frontend/pull/3859. After that we'll still need to migrate StyledTooltip.

:gift: :money_with_wings: A $150 bounty was attached to this issue. Anyone submitting a Pull Request will be rewarded with $150 when the Pull Request is reviewed, accepted and merged.
:arrow_right: More info

Here we have to migrate StyledTooltip?
I think so rest you have done ??

@jeffin143 As per the issue description, only the first item (Remove the custom positionning logic in EditPublicMessagePopup by using react- popper) has been done. We need to:

Migrate StyledTooltip
Update StyledUpdate that still uses react-tooltip

Hi @Betree, can I work on this issue?

@nonsodaniel I have almost completed , there is a pr

:trophy: This issue has been completed by @jeffin143
To claim the $150 bounty, you can either:

Submit an invoice to https://opencollective.com/engineering/expenses/new (please mention the issue number)
Or ask for an Open Collective gift card of the same value (to donate to other collectives)


Allow disabling histogram interactions

Just a parameter to be able to disable the histogram interactions from the Threshold effect completely

How do you use the effect if interactions are disabled?

I have a fiducial placement widget outside the segment editor and I use those points to execute the "apply" method from localThresholdEffect with those as seeds


FAQ: how to check when VM was last scanned using Agentless scanning?

[Enter feedback here]
Customers are asking frequently "how to check when VM was last scanned using Agentless scanning?"
At this moment there is no way for customer check when was VM scanned via Agentless scanning.
Can you please add it to our doc to add more clarity to our customers?

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: ede81000-9e59-b0dc-6bd5-9a94b1999e4f
Version Independent ID: 93f831a1-61dc-c8ec-40bf-bcbe13c38bdc
Content: Learn about agentless scanning for VMs - Microsoft Defender for Cloud
Content Source: articles/defender-for-cloud/concept-agentless-data-collection.md
Service: defender-for-cloud
GitHub Login: @dcurwin
Microsoft Alias: dacurwin

@ankkp
Thanks for your feedback! We will investigate and update as appropriate.

#reassign:dcurwin

#label:"backlog-item-created"

#reassign:alizabernstein

@moraviv
Could you please review it.

#please-close


About accuracy of determined coordinates

Hello.
I have a question about accuracy of determined coordinates by reciever, if it recieves a signal from gps-sdr-sim. By accuracy, I mean the deviation from coordinates which determined during the generation of the signal. I can't check it myself with a real reciever and transmitter now, but i have my matlab model of a gnss reciever. I approved the model by recordings of a real signal almost a year ago and there was not a big error (not bigger than 5-10 meters). But now when I generate a signal and send it to my model, an error of about 30-40 meters appears. I can not once again approve my model right now, but I need to find out why, because it is very important for my undergraduate work. What is the coordinate error you have when using real receivers?

gps-sdr-sim + hackrf + NEO-M8T

Accuracy-GNSS
quadrifilar backfire helix antenna + NEO-M8T

Thanks for the answer. I saw that you used the 2.619 MHz sample rate in the experiment, right?
I am trying to use a GNSS-SDR receiver with a sampling frequency of 12.276 MHz and only now the error is ~ 0.1-1 m, but the height error is almost 10 meters. In the anti-drone window, I saw that the height of the receiver is 4643.5, and in the signal 4657.8, right?

I used 2.619 MHz in the old version,
latest version has several fixes :

residual error from

to

sample rate UP  to 12 MHz

e.t.s.

height  4643.5 --> 4657.8 it is
https://d3i71xaburhd42.cloudfront.net/334560ae5bfd9a538b65cfc8bfcc2a8e45518003/6-Figure5-1.png


Addressing the sudo bash issue in the custom installation of chromedriver

Using a different web crawler instead, https://crawlee.dev/.


Revert "Add new Javy JSON builtins"

Reverts Shopify/shopify-function-javascript#11

Was this the reason why all JS functions on prod got the ["The function returned invalid JSON"] error at the same time yesterday?


Improper memory ordering when reading wakeup flag with SQPOLL

This is a followup to #219.
In that discussion it was decided that a relaxed load is sufficient even though the documentation states that an acquire load is needed but it's actually the opposite. Between updating the sq tail and reading the flags a full memory barrier (smp_mb) is required. This is even documented in the kernel source code:
 * When using the SQ poll thread (IORING_SETUP_SQPOLL), the application
 * needs to check the SQ flags for IORING_SQ_NEED_WAKEUP *after*
 * updating the SQ tail; a full memory barrier smp_mb() is needed
 * between.

This is a case of a read-after-write which neither acquire nor release semantics deal with. Even on x86 which has a strong memory model a read-after-write is the only situation where memory operations can be reordered due to the store buffer.
This same bug is also present in the kernel code. The kernel sets the NEED_WAKEUP flag and then checks if there are SQEs one last time before going to sleep. This is again a read-after-write which means a full memory barrier is required but it's missing in the kernel code.
With the current implementation the following sequence of events is possible:
Kernel sleep timer expires
Kernel sets NEED_WAKEUP flag
                                                         Application submits new work to the SQ (updates the SQ tail)
Kernel checks SQ for new entries and doesn't see the
update to the SQ tail because it's in the store buffer
                                                         Application checks NEED_WAKEUP flag and doesn't see it because
                                                         the store to the flag is in the store buffer
Kernel thread goes to sleep
                                                         Application moves on without invoking io_uring_enter

The result is there is now an IO operation sitting in the sq and not being processed while the application thinks the operation was submitted. I used x86 specific terminology and referenced the store buffer just to simplify the explanation but this applies to all architectures. In the C11 memory model a WriteRead can be reordered if there is no full barrier between the two operations.

Care to send a patch for this?

@almogkh Thanks for the explanation about the fix. I wonder if there is another situation that could cause missed wakeup.
Kernel sleep timer expires
Kernel sets NEED_WAKEUP flag
Kernel checks SQ for new entries and it's empty
                                                         Application submits new work to the SQ (updates the SQ tail)
                                                         Application checks NEED_WAKEUP flag and see it
                                                         Application invokes io_uring_enter
Kernel thread goes to sleep without handling the last SQ work

In the above situation, suppose we don't have any reordering, the Application submits a SQ work and wakes up kernel between Kernel checks tail and Kernel calls schedule(). Is this a potential issue, or am I missing something? Thanks!

There is no issue in the situation you describe. The first thing the SQPOLL thread does when it's about to go to sleep, even before it sets the NEED_WAKEUP flag, is call prepare_to_wait. From the moment that call happens, the application can wakeup the SQPOLL thread using io_uring_enter (which calls wake_up inside the kernel). All of this wait/wakeup code is part of the scheduler and not related to io_uring so I'm fairly certain there are no races there.
If the SQPOLL thread already checked the SQ and it was empty, then it will call schedule, but that's fine because after wake_up is called due to io_uring_enter, the SQPOLL thread will not be in a sleeping state and the scheduler will be able to schedule the thread to run again eventually.

Got it, my thought was wrong. Thanks again!


Error during dupRadar

Description of the bug
Hi,
I was trying to run the pipeline of all my samples, however one sample keeped fail during dupRadar. I also attach the log file below. Any suggestion?
Thanks.
Command used and terminal output
ERROR ~ Error executing process > 'NFCORE_RNASEQ:RNASEQ:DUPRADAR (Adh18-S_REP3)'

Caused by:
  Process `NFCORE_RNASEQ:RNASEQ:DUPRADAR (Adh18-S_REP3)` terminated with an error exit status (1)

Command executed:

  dupradar.r \
      Adh18-S_REP3.markdup.sorted.bam \
      Adh18-S_REP3 \
      annot.gtf \
      2 \
      paired \
      1

  cat <<-END_VERSIONS > versions.yml
  "NFCORE_RNASEQ:RNASEQ:DUPRADAR":
      r-base: $(echo $(R --version 2>&1) | sed 's/^.*R version //; s/ .*$//')
      bioconductor-dupradar: $(Rscript -e "library(dupRadar); cat(as.character(packageVersion('dupRadar')))")
  END_VERSIONS

Command exit status:
  1

Command output:
  (empty)

Command error:
  Input bam      (Arg 1): Adh18-S_REP3.markdup.sorted.bam
  Input gtf      (Arg 2): annot.gtf
  Strandness     (Arg 3): reverse
  paired/single  (Arg 4): paired
  Nb threads     (Arg 5): 1
  R package loc. (Arg 6): paired
  Output basename       : Adh18-S_REP3
  Loading required package: dupRadar
  Loading required package: parallel
  Error in if (trim > 0 && n) { : missing value where TRUE/FALSE needed
  Calls: duprateExpDensPlot -> mean -> mean.default
  Execution halted

Relevant files
nextflow.log
System information
No response

I have the same issue


AzeriCard switching to TLSv1.2

AzeriCard switching to TLSv1.2 completely, from 1st of June, 2015.
At now, both of TLSv1 and TLSv1.2 are working on production:
Hostname was found in DNS cache
Hostname in DNS cache was stale, zapped
  Trying <IP_ADDRESS>...
Connected to mpi.3dsecure.az (<IP_ADDRESS>) port 443 (#15)
successfully set certificate verify locations:
  CAfile: none
  CApath: /etc/ssl/certs
SSLv3, TLS handshake, Client hello (1):
SSLv3, TLS handshake, Server hello (2):
SSLv3, TLS handshake, CERT (11):
SSLv3, TLS handshake, Server finished (14):
SSLv3, TLS handshake, Client key exchange (16):
SSLv3, TLS change cipher, Client hello (1):
SSLv3, TLS handshake, Finished (20):
SSLv3, TLS change cipher, Client hello (1):
SSLv3, TLS handshake, Finished (20):
SSL connection using TLSv1.2 / RC4-SHA
Server certificate:
	 subject: CN=mpi.3dsecure.az; O=AzeriCard Ltd; L=Baku; ST=Baku; C=AZ
	 start date: 2015-05-01 04:31:03 GMT
	 expire date: 2017-02-27 10:31:03 GMT
	 subjectAltName: mpi.3dsecure.az matched
	 issuer: C=US; ST=Illinois; L=Chicago; O=Trustwave Holdings, Inc.; CN=Trustwave Organization Validation SHA256 CA, Level 1<EMAIL_ADDRESS>	 SSL certificate verify ok.
upload completely sent off: 206 out of 206 bytes
Server Apache is not blacklisted
Connection #15 to host mpi.3dsecure.az left intact

Thanks. Version 1.0.3 was released.


chore: Upgrade RTS Dependencies

Upgrading Motoko RTS dependencies:

LLVM 18.1.8
Rust 1.82.0

Special aspects:

Support new dylink.0 instead of dylink.
Support GOT.mem for RTS in the Motoko linker.
Adjusting the RTS code in line with the latest Rust features/rules.
No longer needing emscripten: Use custom Rust targets .
Get rid of emscripten by using custom Rust targets for generating PIC-relocatable Wasm.
Get rid of musl by using Rust builtins instead.
Float formatting changes due to removal of musl: The output format of NaN and infinity has changed. Moreover, one particular output format (hexadecimal float) is no longer supported. Updating the documentation and base library is needed.
Optimization: Use bulk-memory operations because memcpy of Rust is slower than musl.
Optimization: Applying wasm-opt to reduce the RTS binary size as the new Rust core library produces larger RTS binaries.

Note:

If your nix-shell crashes with a segmentation fault with this PR, you need to upgrade nix. For this, you need to manually uninstall and re-install nix.

TODO:

Merge https://github.com/dfinity/motoko-base/pull/589: Then we can change the motoko-base dependency back to next-moc.

Comparing from 247aa05 to a6d1305: In terms of gas, 4 tests regressed, 1 tests improved and the mean change is -0.0%. In terms of size, 5 tests regressed and the mean change is +29.3%.

Now optimized the both size and performance. Would be nice if we could rerun this benchmark.

Size compression is no longer needed for the specific Rust target backends.
Instead, we can again optimize for speed:
This is the latest perf diff on CI (locally repeated):
Comparing from b7fa63936cf708952deae0dd0b0429faa1baa119 to a10ab53a1ec3e5e48dbce36d6c7dd8547503c85c:
In terms of gas, 3 tests regressed, 2 tests improved and the mean change is -0.0%.
In terms of size, 5 tests improved and the mean change is -1.6%.

According to the GC benchmark, it seems that this upgrade/cleanup even improves performance:

Mode
Before
Now
Improvement

Classical (copying GC)
2.33e10
2.29e10
1.7%

Classical (incremental GC)
2.39e10
2.35e10
1.7%

EOP
2.54e0
2.50e10
1.6%

Thank you for reviewing, Claudio and Gabor!


HAR import: Correctly parse the date when the millisecond field conta…

…ins more than three digits

Oh right. I guess this code comes from early days when we were supporting JDK6 and java.time didn't exist. Thanks!

Cherry-picked as fbbbde2131bc7740b9c1390614935823a6c5a7a0


Fix #3463 - Prepare Custom Metric definition

Describe your changes :

This PR fixes https://github.com/open-metadata/OpenMetadata/issues/3463
We have added the backend implementation for custom metrics following the same approach as with the column tests.
Thanks,

Type of change :

[ ] Bug fix
[ ] Improvement
[x] New feature
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation

Frontend Preview (Screenshots) :
For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.
[ ] I have performed a self-review of my own.
[ ] I have tagged my reviewers below.
[ ] I have commented on my code, particularly in hard-to-understand areas.
[ ] My changes generate no new warnings.
[ ] I have added tests that prove my fix is effective or that my feature works.
[x] All new and existing tests passed.

Reviewers

I'll review the failures of merging main after working on other P0 issues. Thanks!


ExecutorService - how to specify workers

hi, I wonder what does the workers mean when I register a worker:
 WorkerOptions options = WorkerOptions.defaults()
    // Defines workers amount used to execute tasks.
    // Default is 1.
    .workers(2)

Do I have to specify all the workers that might be registered into this cluster? The problem is that the auto-scaling strategy makes it hard to specify the number of all workers, because the number varies in runtime.

it means units used to execute tasks and executed on shared executorService (threads amount defined in threads settings).

what's its scope? jvm or the whole cluster?

jvm


Documentation covering buildpack deployment

A tidied up version of https://til.simonwillison.net/til/til/digitalocean_datasette-on-digitalocean-app-platform.md - but mention that you can deploy to Heroku using the same mechanism.

Note #633 - you need to set WEB_CONCURRENCY=1 on Heroku for this to work.

I asked about other hosts for these on Twitter https://twitter.com/simonw/status/1314042631949676544

https://buildpacks.io/
https://doc.scalingo.com/languages/python/start
https://cloud.google.com/run/docs/continuous-deployment-with-cloud-build

Docs are now live here: https://docs.datasette.io/en/latest/deploying.html#deploying-using-buildpacks


Please merge revision f145f89ccb4b807641914a0631e9c77995a29b20 into dev channel

@ricowind @whesse @kasperl
This fixes nondeterministic crashes when attempting to analyze a file that calls loadLibrary on a deferred import.  See #24627.
Revision to be merged: f145f89ccb4b807641914a0631e9c77995a29b20
There is a trivial merge conflict, owing to the fact that f145f89ccb4b807641914a0631e9c77995a29b20 contains a change to pkg/analyzer/tool/task_dependency_graph/tasks.dot, which doesn't exist in the dev branch.  This change may safely be ignored.  I've uploaded a CL with the correct merge here: https://codereview.chromium.org/1403373005

Merged into 1.13.0-dev.7.3


[Enhancement] Inefficient use of keyset iterator instead of entrySet iterator [AsyncHTTPPushRequest]

Search before asking

[X] I had searched in the issues and found no similar issues.

Enhancement Request

located at:
org/apache/eventmesh/runtime/core/protocol/http/push/AsyncHTTPPushRequest.java line 145
analysis and explanation:
This method accesses the value of a Map entry, using a key that was retrieved from a keySet iterator. It is more efficient to use an iterator on the entrySet of the map, to avoid the Map.get(key) lookup.
Describe the solution you'd like
reference:

Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

I would like to work on this issue. @xwm1992 Can you please assign this task to me?


Graphback Config should ask for different databases

When doing config we should utilize our datasources intergration:
See
https://github.com/aerogear/graphback/pull/746

We need to ask for

MongoDB (and provide default docker-compose
Postgres (Nothing changes here)

We not going to support other databases.
Install different runtime package based on the choice (currently installs only @graphback/runtime - if should @graphback/runtime-mongo or @graphback/runtime-knex
DataSources documentation should be also updated

@craicoverflow This is blocker for relase. If not done by commmunity we will need to do it ourselves.

Can I work on this issue?

@NVS16 Perfect. Copy some files from our example app:
https://github.com/aerogear/datasync-starter/blob/master/server/docker-compose.yml

Ok. Working on it.

Install different runtime package based on the choice (currently installs only @graphback/runtime - if should @graphback/runtime-mongo or @graphback/runtime-knex

@wtrocki We need to have changes in the templates too since they have this as default
import { createKnexPGCRUDRuntimeServices } from "@graphback/runtime-knex"

Yes. There is issue to document that but I'm currently occupied by finishing code changes

See: https://github.com/aerogear/graphback/issues/756
Swapping datasource involves changes in the template which is tricky to do.
What we can do is to have some file in template that initializes proper datasource. Like datasources.ts and replace it with the cli based on choice.
This will make it hard to build new templates but we are not woried about it

I had some doubts regarding writing the documentation and wanted your help.
I guess we need to at least add some info here:
https://graphback.dev/docs/intro/existingproject
and here:
https://graphback.dev/docs/db/datasources

in datasources - We add that we now support mongodb (and remove sqlite3 and mysql)
in the first link -
We have to add what a user needs to manually do to change his code so as to comply with postgres or mongo, whatever he chooses.
As far as I can see the user will have to modify these two files in the template -

db.ts
graphql.ts
(Are there anymore files to change?)
I believe I can use the files here -
https://github.com/aerogear/datasync-starter/blob/master/server/src/db.ts
https://github.com/aerogear/datasync-starter/blob/master/server/src/graphql.ts
which you had provided me earlier.

Now, maybe we can approach in this way -

Make a new folder in the /src folder, let's say, /src/dbsetup/  (or something like that)
here in this folder we have two subfolders /src/dbsetup/mongodb and /src/dbsetup/postgresql
and each of the folders will have the respective db.ts and graphql.ts files.
by default the original db.ts and graphql.ts will have the code for postgresql (let's say)
then if the user has chosen mongodb he will just replace it with the files of mongodb present in /src/dbsetup/mongodb

Am I going in the right direction?

As mentioned before. config is being run on project that has no dB files. it is just some project that wants graphback to be added.
I think @ankitjena created new issue and we need to have software fix for this rather than docs.

@NVS16 thank you for your contribution


User agent caching and static option.

Caching the userAgent http header and give the ability to use custom userAgent http headers as an additional option. Background: The method getWebbviewUserAgentAsync can cause the error The WKWWebView was invalidated on iOS. This happened in our app <2k times. Caching the result of getWebbviewUserAgentAsync is fine because it is constant. (expo-constants)

Related to: https://forums.expo.io/t/unhandled-promise-rejection-error-the-wkwebview-was-invalidated/25044/3

@musemind thanks for this!  Does this change workin Expo SDK versions < 33?

@ryanvanderpol not more than the existing "Breaking Changes in Expo SDK 33".


Let providers search by candidate reference number

Context
Providers have requested the ability to search by 'candidate reference' (ie. support reference)

Changes proposed in this pull request

Updates provider application filter to search by candidate name or support reference depending on input
Adds ability to configure the filter component so that the search field can be treated as 'primary' and sit above results. (See screenshot)
Adds support reference to application card caption

Guidance to review

There are effectively 2 filtering forms now which have to maintain filtering params from one another, so combining filtering and searching should give expected results.
The support UI uses the same filtering mechanism, worth checking no support UI was harmed in the making of this PR.
Link to Trello card
https://trello.com/c/XSZRMDg2/3138-implement-letting-providers-search-by-candidate-reference-number

Things to check

[x] This code does not rely on migrations in the same Pull Request
[x] If this code includes a migration adding or changing columns, it also backfills existing records for consistency
[x] API release notes have been updated if necessary
[x] New environment variables have been added to the Azure config

@steventux there’s a small change with the empty states.
If no applications are found, we show a message depending on the search and filter terms:

Just the search was used: There are no results for ‘search term’.
The search and a single filter was used: There are no results for ‘search term’ and the selected filter.
The search and multiple filters/filter options were used: There are no results for ‘search term’ and the selected filters.

@steventux there’s a small change with the empty states.
If no applications are found, we show a message depending on the search and filter terms:

Just the search was used: There are no results for ‘search term’.
The search and a single filter was used: There are no results for ‘search term’ and the selected filter.
The search and multiple filters/filter options were used: There are no results for ‘search term’ and the selected filters.

@simonwhatley I've added contextual 'no results' messages here https://github.com/DFE-Digital/apply-for-teacher-training/pull/3784/commits/53a0c37492088ee9247c8c92f7b0d2dd31f5a783

@simonwhatley I've added contextual 'no results' messages here https://github.com/DFE-Digital/apply-for-teacher-training/pull/3784/commits/53a0c37492088ee9247c8c92f7b0d2dd31f5a783


[FEATURE] Add authorization documentation

Description
The SOCI snapshotter's authorization setup is not immediately obvious. It doesn't share authorization with the containerd client that normally performs a pull and instead relies on either docker credentials or kubernetes credentials. Both require additional setup when using SOCI with private images.
The only documentation we have is to do sudo docker login in our getting started doc which is not realistic in a production environment. Additionally, since SOCI tries hard not to fail an image pull, if it doesn't have credentials it will fall back to pulling with the client which will likely succeed. This leads to confusion about SOCI's performance being on-par or worse than without because it's doing work and then doing a normal image pull anyway.
Describe the solution you'd like
[ ] A doc outlining the authorization options and their configuration
[ ] Update to debug.md to include looking for authorization errors when the SOCI performs worse than ahead-of-time pulls
Describe any alternative solutions/features you've considered
N/A
Any additional context or information about the feature request
https://github.com/awslabs/soci-snapshotter/discussions/642#discussioncomment-6511008

This is done via #1237


Fix karma tests memory issues

Task Description
Karma tests often have memory issues and halt execution - even before actually starting running the tests.
This seems inconsistent but increasingly common, as tests grow more and more complex and comprehensive.
Possible fixes include:

Increasing memory limit
Fixing underlying memory leak (if any)

See this thread for discussion.

I think I can confirm that it happens in the source map preprocessing. Here's the full debug log for the failure:
>> WebPack
✔ Stories Editor
  Compiled successfully in 133.37ms

30 06 2020 09:10:48.198:DEBUG [web-server]: Instantiating middleware
ℹ ｢wdm｣: Compiled successfully.
ℹ ｢wdm｣: Compiling...

✔ Stories Editor
  Compiled successfully in 58.80s

ℹ ｢wdm｣: Compiled with warnings.

>>> Fails between these two logs

30 06 2020 09:12:03.278:DEBUG [preprocessor.sourcemap]: base64-encoded source map for /Users/dvoytenko/DNI/web-stories-wp/assets/src/edit-story/components/canvas/karma/backgroundCopyPaste.karma.js

This most likely comes from this Karma configuration:
preprocessors: {
  'assets/src/edit-story/**/karma/**/*.js': ['webpack', 'sourcemap'],
},

Not clear what are all issues related to sourcemap here.

Here's something similar and suggested solution is here. This promises to speed up our test compilation time on WebPack quite a bit.

The above configuration generates a webpack bundle for each test.

That sounds horrible! Yes, let's go for this alternative approach and pack them all in single bundle for CI.

PTAL: https://github.com/google/web-stories-wp/pull/2887


Field of type radio-group does not apply 'checked' attribute when using v2 Forms

I was using 'radio_group' type field with Forms v1 and there was the  correct behaviour :
  <.form_field type="radio_group" form={@form} layout={:row} field={:rating} label="Rating"
          options={[
            {"1", "1"},
            {"2", "2"},
            {"3", "3"},
            {"4", "4"},
            {"5", "5"}
          ]}
        />

After updating to Forms v2 and converting the above code to :
        <.field type="radio-group" group_layout="row" field={@form[:rating]} label="Rating"
          options={[
            {"1", "1"},
            {"2", "2"},
            {"3", "3"},
            {"4", "4"},
            {"5", "5"}
          ]}
        />

The result is that when a form is populated with existing data the respective radio control is not 'checked' when the option is set.
Maybe related to #197

Thanks! Should be fixed in v1.2.6

Hey! This is still not working as expected.
If an option is set when the form is loading with data, the radio control does not reflect that. (i.e. it does not set the 'checked' attribute)
I have checked on Firefox, Safari and Chrome.

 For me the Phoenix.HTML.FormField has a value of "2", and that is showing for me
<% IO.inspect(@form[:radio_group]) %>

    <.field
      type="radio-group"
      field={@form[:radio_group]}
      group_layout="row"
      options={[{"Option 1", "1"}, {"Option 2", "2"}, {"Option 3", "3"}]}
    />

%Phoenix.HTML.FormField{
  ...
  value: "2"
}

I set a gh repo that you could check : https://github.com/gtaranti/p172
There you could visit http://localhost:4000/test
Sample data have 'rating' field populated, but it's not showing in the form.

Thanks - seems when the value is an integer it didn't work. Works in v1.2.7


Use a deeper copy for frame vars

Since we added the recursive option for the EventScrubber in #2755, vars nested inside could be replaced with AnnotatedValue and potentially break userland code.
We really shouldn't be holding references to frame.f_locals throughout our SDK, this has all sorts of breakage potential.
To make this work, I had to add a port of python's copy.deepcopy (license included) that falls back to safe_repr instead of the pickling step. This ensures that we have a deepcopy of all data structure like objects - dicts/lists/tuples and so on while we make a repr early for other random objects.

this is getting out of hand so i'm trying another solution


[MPG] Imporved K-means training data collecting

Summery
i founded inefficient logic when i'm reviewing color clustering process.
so i improved it by replacing it with builit-in function of opencv.
what i work

improevd collecting K-means training data
found and fix some errors in process.py

results

Improved painting process time by 2 seconds
i did test 10 times using Time module to figure out how many time improved. the result is shown below.

before improvement

NO
started_time
ended_time
proceeded time

1
1685715414.55033
1685715416.43859
1.88826

2
1685715418.21411
1685715420.10045
1.88634

3
1685715422.07031
1685715423.97360
1.90329

4
1685715425.99577
1685715427.88517
1.88940

5
1685715429.86232
1685715431.74993
1.88760

6
1685715466.01876
1685715467.89783
1.87907

7
1685715469.91850
1685715471.79747
1.87896

8
1685715473.75721
1685715475.66917
1.91196

9
1685715477.61598
1685715479.51461
1.89863

10
1685715481.48454
1685715483.36009
1.87554

after improvement

NO
started_time
ended_time
proceeded time

1
1685716198.13303
1685716198.14200
0.00898

2
1685716200.02325
1685716200.03123
0.00798

3
1685716201.94506
1685716201.95504
0.00997

4
1685716203.90207
1685716203.91005
0.00798

5
1685716205.92959
1685716205.93856
0.00898

6
1685716207.83959
1685716207.84956
0.00997

7
1685716209.81431
1685716209.82330
0.00898

8
1685716216.12213
1685716216.13010
0.00798

9
1685716218.12036
1685716218.12933
0.00898

10
1685716219.97299
1685716219.98197
0.00898

n this result, we can see that the average process time has decreased by about 2 seconds.

1
Change class name to "ImageColorSimplifier" is nice try,
how about "ReduceImageColors" ?
2
Try to change parameters name of run method, but when a user uses this function, wouldn't it be inconvenient to use if the name is long?
3
on blurring process, It is good to make simple operations a function
4
If later you want PR, please to "dev" branch
Thank you for your support!!


feat(breadcrumb): webcomponent

NEEDS UPDATED Z-INDEX
Describe pull-request
Web component version of the breadcrumb.
Solving issue
Fixes: AB#2854
How to test

Go to storybook link below
Check in Components -> Breadcrumb -> WebComponent

Screenshots
Additional context

Yeay! Making web components 😍
Some thoughts:
Maybe the breadcrumb could be a nav-element instead of host and have the slots in an ol for WCAG reasons:
https://www.w3.org/WAI/ARIA/apg/example-index/breadcrumb/index.html
I don't know if we want to get a head start on a bit of a11y for new components, but there is also an aria state called aria-current.

Yeay! Making web components 😍 Some thoughts: Maybe the breadcrumb could be a nav-element instead of host and have the slots in an ol for WCAG reasons: https://www.w3.org/WAI/ARIA/apg/example-index/breadcrumb/index.html I don't know if we want to get a head start on a bit of a11y for new components, but there is also an aria state called aria-current.

Great idea! I'll update the PR 😄

@EmelieLitwin updated the PR now. Please have a look :)

@EmelieLitwin updated the PR now. Please have a look :)

Nice! :) I was thinking that the disabled breadcrumb in the storybook story might not be needed. It looks a little off and hopefully not a common use case.
I also saw in figma that hovered breadcrumb is supposed to be underlined.
Otherwise, looks good 🥳

Please rename the "Default" story to "Native" just as that is how we named it in other components that exist in both HTML&CSS and WebComponent versions.
Other than that tiny things, it looks good!

Nice catch!

@theJohnnyMe please have a look again. Removed the link-text prop and used a slot instead, I think it looks a bit neater 😄

@theJohnnyMe please have a look again. Removed the link-text prop and used a slot instead, I think it looks a bit neater 😄

That was a good call really, then component reminds more of the native anchor tag + it enables uses to pass HTML in too, in case they want to have an SVG icon text to text too or something similar.


Rubygems API

Hi,
any plans to support the Rubygems API that Bundler 1.1 will take advantage of?
Thanks!

Sent a pull request with the implementation for the Rubygems dependencies API.


errors when run "python3 setup.py"

Hello,
when I run "python3 setup.py", it returns an error as follows:

I have followed your instructions correctly, could you please give me some help?
Thanks

Your SEAL's version is not right. You should use the SEAL3.3 in this res

Your SEAL's version is not right. You should use the SEAL3.3 in this res

Thank you


ChromeOS 129.0.6668.112's Linux Development running Python3.11, which unable to install PyCoral API

Description
When following the guideline on https://coral.ai/software/#pycoral-api
sudo apt-get install python3-pycoral, failed to complete.
Click to expand!
Issue Type
Build/Install
Operating System
Linux
Coral Device
USB Accelerator
Other Devices
No response
Programming Language
Other
Relevant Log Output
Python 3.11.2, ChromeBook 129's Linux

calvinwhk@penguin:~$ python3
Python 3.11.2 (main, Aug 26 2024, 07:20:54) [GCC 12.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>>

calvinwhk@penguin:~$ uname --all
Linux penguin 6.6.46-04024-g9e7e147b4900 #1 SMP PREEMPT Thu, 3 Oct 2024 12:57:30 +0000 aarch64 GNU/Linux
calvinwhk@penguin:~$ sudo apt-get install python3-pycoral
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 ****python3-pycoral : Depends: python3-tflite-runtime (= 2.5.0.post1) but it is not going to be installed
                   Depends: python3 (< 3.10) but 3.11.2-1+b1 is to be installed
E: Unable to correct problems, you have held broken packages.****
calvinwhk@penguin:~$

It only supports python versions upto 3.9. There's some workarounds mentioned in the following issue


openstack: workers don't join the cluster due to python scripts

Openstack / oVirt are using a python script to find IPs: https://github.com/openshift/machine-config-operator/blob/fcos/templates/worker/00-worker/openstack/files/openstack-non-virtual-ip.yaml#L6
FCOS doesn't provide python (and most likely never will), so it needs to be rewritten

cc @iamemilio

Probably best to track this as an MCO bug?
I think the fix is similar to https://github.com/openshift/okd/issues/38 - move the scripts into Go code executed in the machine-config-daemon binary.


DRILL-3767: SchemaPath.getCompoundPath(String...strings) reverses it'…

…s input array
@amansinha100 can you please review ?

Updated PR looks good to me.  +1


Swift client status

Hello, we are using deepstream for our iOS app. However, we are unable to upgrade to the latest deepstream server version because the iOS client hasn't been updated since 2017. What is the status of iOS support for deepstream?
Thanks

iOS support is currently non existent. If I was to work on it I would personally create a single SDK in C++ and wrap it to support other libraries but it's way more time consuming to setup.
If a group of people are willing to sponsor the work (for the minimum specs required) I'm definitely open to working on it. Also open to giving feedback to any opensource ones as well.

Thanks for your response.
I am trying to use the latest version with the old js client (v3). However the server crashed with this stack trace:
2020-04-09T22:42:40.65303922Z AUTH_SUCCESSFUL | open
2020-04-09T22:42:40.794259265Z UNKNOWN_TOPIC | AUTH
2020-04-09T22:42:40.796097288Z { topic: 1, action: 1, originalTopic: 3 } false
2020-04-09T22:42:40.833895847Z TypeError: Cannot read property '1' of undefined
2020-04-09T22:42:40.83392511Z     at Object.exports.getMessage (/src/connection-endpoint/websocket/text/text-protocol/message-builder.ts:218:42)
2020-04-09T22:42:40.833929566Z     at TextWSSocketWrapper.getMessage (/src/connection-endpoint/websocket/text/socket-wrapper-factory.ts:12:31)
2020-04-09T22:42:40.833933123Z     at TextWSSocketWrapper.sendMessage (/src/connection-endpoint/base/socket-wrapper.ts:59:32)
2020-04-09T22:42:40.833936477Z     at MessageDistributor.distribute (/src/utils/message-distributor.ts:21:21)
2020-04-09T22:42:40.833939877Z     at MessageProcessor.onPermissionResponse (/src/utils/message-processor.ts:103:12)
2020-04-09T22:42:40.833942852Z     at ConfigPermission.canPerformAction (/src/services/permission/valve/config-permission.ts:92:7)
2020-04-09T22:42:40.833946533Z     at MessageProcessor.process (/src/utils/message-processor.ts:67:32)
2020-04-09T22:42:40.833949563Z     at TextWSSocketWrapper.unauthenticatedSocketWrapper.onMessage (/src/connection-endpoint/base/connection-endpoint.ts:287:12)
2020-04-09T22:42:40.833952576Z     at WebSocket.websocket.on (/src/services/http/node/node-http.ts:144:25)
2020-04-09T22:42:40.833955589Z     at WebSocket.emit (events.js:198:13)

I am using server version 5.0.12 and JS client version 2.3.0

What features are you using the iOS client?

I am mainly using records.

The best bet we have now is either:

someone writes a functioning client for iOS
we manage to get time to setup a C or Kotlin SDK that can be used by iOS

I'll close this issue for now, hopefully open open a new swift one when I feel we have the opportunity to expland


Distributed memory umap

I'm looking to implement umap on an array with n = 500k and feature dimension of 80mil. This obviously implies that I would need to implement a distributed memory version of this.
Is the memory bottleneck the nearest neighbor search?

The nearest neighbor search is certainly the most pressing difficulty in making a distributed memory version -- I'm not sure others wouldn't rear their head once that was taken care of mind you. Is there any chance you can represent it as a sparse matrix? Are the number of non-zeros low enough that it might fit in memory?

There's a lot of zeros, but there's still about 400 billion nonzero entries =[

That's certainly too large; sorry. I don't think I have any good solutions in that situation -- a distributed version of UMAP is still a fairly non-trivial series of steps away, and I don't see it in the near to medium term. Eventually such a thing is theoretically on the roadmap, but it is a long way off.

I think I can implement a distributed memory nearest neighbor search. Like you say though, other issues will probably rear their head.

If you believe you can do that ... then ideally you can pass the knn_indices and knn_dists arrays into some of the internal functions, and on reflection I don't actually see why that wouldn't work -- in that it no longer needs to be distributed; you only need the 500k x n_neighbors sized pieces to fit in memory, which is likely doable (on a large memory box). If you can get the nearest neighbor search to work I can help step you through the rest of it.

Ya I have done this type of thing for media search engines. I agree it seems doable.
I just need to do a bit of data infrastructure and to move a giant matrix. I think next week I can start implementing this.

Excellent. Let me know when you reach a stage where you want help getting those results into UMAP and we can go from there.

Actually, I don’t think I can do this.
The method I typically use for doing nearest neighbor on a very large media (like photos) datasets won’t work for such high dimensional features. I am not sure if there’s a known method for horizontally scaling nearest neighbor search with extremely high dimensional features. Hopefully I’m wrong. The ANN method you use mentions a mapreduce version in the paper. Do you know if this method would scale to d=80mil? Cutting planes just don’t work in such high dimensions

It scales in data sample, bot their dimensionality, so I suspect you would have a similar issue. Sorry.

Hello,
Firstly, I want to acknowledge to Leland McInnes the great contribution UMAP gives to the field of dimensionality reduction and feature extraction.
I just read about this discussion and wanted to highlight the following papers:
https://doi.org/10.1016/j.cageo.2019.02.009: They discuss different parallelization strategies for Knn with geospatial weights.
https://doi.org/10.1016/j.jpdc.2019.04.008: They propose a GPU parallel implementation of tSNE, maybe some ideas can be used
https://arxiv.org/abs/1907.03736: Another work on parallelization of queries on spatial data.
I apologize in advance if the papers are out of the scope, @ghost if you provide more details about how is your problem different from those in the papers, I can try to narrow my future researches for a solution

This is probably not very helpful; depending on why you want to use umap in your dataset. If your purpose is dimensionality reduction, I don't believe any KNN method will scale well to those sizes (distributed or not).
Since you have two orders of magnitude more features than datapoints, I think it's clear you have too many of them anyway, so I would start by attempting to reduce the number of those using simpler methods, such as some linear decompositions, or at least something that can work on batches of a few datapoints at a time. I think an auto-encoder network should be able to handle those sizes.
Barring that, you might have to resort to sampling subsets of the features, with 500K datapoints is not reasonable to try and find embeddings in millions of dimensions, so you might as well pick some subsets of (say) 10k or 20K features at a time and finding embedding for those.


[ALGO] Bellman-Ford Shortest Path

Bellman-Ford Shortest Path
The Bellman-Ford algorithm computes the shortest path between a source vertex and all other vertices in the graph. Compared to Dijkstra, it can handle negative edge weights. See the wikipedia entry for more details.
Syntax
The algorithm should have the following syntax:
template <typename V, typename E, graph_type T>
[[nodiscard]] return_type your_algorithm_name(const graph<V, E, T>& graph);

/**
 * Find the shortest paths from a source vertex to all other vertices using
 * the Bellman-Ford algorithm.
 *
 * @tparam V The vertex type of the graph.
 * @tparam E The edge type of the graph.
 * @tparam T The graph specialization (directed or undirected).
 * @tparam WEIGHT_T The type of weight associated with the edges.
 * @param graph The graph in which to find the shortest paths.
 * @param start_vertex The source vertex for the shortest paths.
 * @return A map of target vertex IDs to shortest path structures. Each
 *         value contains a graph_path object representing the
 *         shortest path from the source vertex to the respective vertex.
 *         If a vertex is unreachable from the source, its entry will be
 *         absent from the map.
 */
template <typename V, typename E, graph_spec T, typename WEIGHT_T = decltype(get_weight(std::declval<E>()))>
std::unordered_map<vertex_id_t, graph_path<WEIGHT_T>>
bellman_ford_shortest_paths(const graph<V, E, T>& graph, vertex_id_t start_vertex);

This should live in the graaf::algorithm namespace under include/graaflib/algorithm/shortest_path.h.
Definition of Done
This issue is done when:

[ ] The algorithm is implemented
[ ] The new function has a javadoc-style comment explaining the interface
[ ] Appropriate tests are added under test/graaflib/algorithm/shortest_path_test.cpp
[ ] A test coverage of at least 95% is reached
[ ] A documentation entry is added under docs/docs/algorithms under the appropriate category

Just adding a short description and the algorithm syntax here is fine
See the wiki on how to build the documentation locally

[ ] The algorithm is added to the list of algorithms in README.md

Hi, I'd like to work on this issue.

Awesome, I will assign the issue to you then!
Feel free to take a look at the wiki or join our discord in case of any questions.

Should the Bellman-Ford implementation also report negative-weight cycles? In that case, there is no shortest path. The Bellman-Ford algorithm can detect it.
Otherwise, I should mention it as a limitation in the docs.
I've implemented it now without that capability. Maybe it can be done later.

Should the Bellman-Ford implementation also report negative-weight cycles? Wikipedia states that in the case of a negative-weight cycle that is reachable from the source, there is no shortest path.
The Bellman-Ford algorithm given on Wikipedia can detect a negative-weight cycle. If this check isn't implemented, I should mention it as a limitation in the docs.
I've implemented it now without that capability. Maybe it can be done later.

Good point! I think it would indeed make sense to detect this. Then we can omit that path from the result map.
I would be fine with doing this in a follow-up. If you want you can create an issue for it :)


regexp/syntax: 10000x slower in Regexp.String()

Go version
1.23 darwin/arm64
What did you do?
I received a report at https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6911 and ran a benchmark for Regexp.String().
What did you see happen?
The negate [^] causes calcFlags to run over a large character space to find a fold case.
goos: darwin
goarch: arm64
pkg: regexp/syntax
cpu: Apple M1
BenchmarkString/^(.*);$|^;(.*)-8                 4594401               253.2 ns/op            56 B/op          3 allocs/op
BenchmarkString/(foo|bar$)x*-8                   5006730               236.1 ns/op            56 B/op          3 allocs/op
BenchmarkString/[^=,]-8<PHONE_NUMBER> ns/op               8 B/op          1 allocs/op
BenchmarkString/([^=,]+)=([^=,]+)-8<PHONE_NUMBER> ns/op              56 B/op          3 allocs/op
BenchmarkString/([^=,]+)=([^=,]+),.*-8<PHONE_NUMBER> ns/op              56 B/op          3 allocs/op
PASS
ok      regexp/syntax   9.011s

Related Issues and Documentation

regexp/syntax: fix >10000x slower Regexp.String() #69304
regexp: MatchString run time could be independent of the string length #39480 (closed)
Dramatically speed down regexp while grow difficulty it #14167 (closed)

(Emoji vote if this was helpful or unhelpful; more detailed feedback welcome in this discussion.)


CCM-12641-managed service provider documentation

Added a new markdown file for MSP-CCM.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app


Implement the new CSS settings, includeModules and update jimpex

What does this PR do?
Fixes the regular expressions for including and excluding svg files.
The fonts loader was recognizing every svg file that matched with /fonts/ as a font. The intention was to only pick svg files inside a fonts directory, but if the path of the project included the word fonts anywhere, it would match the expression and the file would be handled as a font.
Now the expression was changed to this:
new RegExp(`${target.paths.source}/(?:.*?/)?fonts/.*?`, 'i')

Which means: Inside the target source directory, and on directory called fonts.
I also included the same expression as exclude on the images loader, because even if the svg was being handled as a font, the image loader was also copying it as an image.
Implement the new settings.
The full description of the settings is on homer0/projext#15, so I recommend you to read the PR to fully understand how they work.
The changes on the settings include the replacement of browser targets CSSModules flag for css.modules, so that's why this PR is breaking.
Update jimpex to 2.1.0
Because I released a couple of days ago :P.
How should it be tested manually?
yarn test
# or
npm test

Pull Request Test Coverage Report for Build 51

10 of 10 (100.0%) changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 47:
0.0%

Covered Lines:
421

Relevant Lines:
421

💛  - Coveralls