where is the hyperplane equation(w' and b)

I am new to SVM, but as I know, SVM tries to find a best hyperplane whose equation is w'x + b = 0 to separate two classes samples. And I want to know where are the w and b after I train the hear_scale.model.

see the following libsvm faq:
Q: How could I generate the primal variable w of linear SVM?
Let's start from the binary class and assume you have two labels -1 and +1.
After obtaining the model from calling svmtrain, do the following to have w
and b:
w = model.SVs' * model.sv_coef;
b = -model.rho;
if model.Label(1) == -1
w = -w;
b = -b;
end
If you do regression or one-class SVM, then the if statement is not needed.
For multi-class SVM, we illustrate the setting in the following example of
running the iris data, which have 3 classes

[y, x] = libsvmread('../../htdocs/libsvmtools/datasets/multiclass/iris.scale');
m = svmtrain(y, x, '-t 0')

m =
Parameters: [5x1 double]
  nr_class: 3
   totalSV: 42
       rho: [3x1 double]
     Label: [3x1 double]
     ProbA: []
     ProbB: []
       nSV: [3x1 double]
   sv_coef: [42x2 double]
       SVs: [42x4 double]

sv_coef is like:
+-+-+--------------------+
|1|1|                    |
|v|v|  SVs from class 1  |
|2|3|                    |
+-+-+--------------------+
|1|2|                    |
|v|v|  SVs from class 2  |
|2|3|                    |
+-+-+--------------------+
|1|2|                    |
|v|v|  SVs from class 3  |
|3|3|                    |
+-+-+--------------------+
so we need to see nSV of each classes.

m.nSV

ans =
 3
21
18

Suppose the goal is to find the vector w of classes 1 vs 3. Then y_i alpha_i
of training 1 vs 3 are

coef = [m.sv_coef(1:3,2); m.sv_coef(25:42,1)];

and SVs are:

SVs = [m.SVs(1:3,:); m.SVs(25:42,:)];

Hence, w is

w = SVs'*coef;

For rho,

m.rho

ans =
1.1465
0.3682

-1.9969

b = -m.rho(2);

because rho is arranged by 1vs2 1vs3 2vs3.
EvergreenHZ writes:

I am new to SVM, but as I know, SVM tries to find a best
hyperplane whose equation is w'x + b = 0 to separate two
classes samples. And I want to know where are the w and b after
I train the hear_scale.model.
—
You are receiving this because you are subscribed to this
thread.
Reply to this email directly, view it on GitHub, or mute the
thread.*


Move the find in selection button into a filters dropdown

Current:

Proposed:

When a filter is non-default:

Find in selection behaves a little strangely currently as it's enabled when there is no selection, we could disable the dropdown entry in this case.
We can also expand this filter to include find in commands/strings/brackets in the future so it's not just a single entry. @hediet is there a feature request for this you could link?

No known feature request for this.

I believe we had previously discussed this in https://github.com/microsoft/vscode/issues/14836#issuecomment-926959562

duplicate of https://github.com/microsoft/vscode/issues/144851


add missing iomanip header file in Date.cpp

required for std::put_time function

Codecov Report
All modified lines are covered by tests :white_check_mark:
:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
see 1 file with indirect coverage changes
:loudspeaker: Thoughts on this report? Let us know!.


Introduce stylelint

Why did we have stylelint disabled for these 2 files?

Ah, yes. Those files had so many dozens of lint complaints that I didn't have time to start untangling them!

Why did we have stylelint disabled for these 2 files?

Ah, yes. Those files had so many dozens of lint complaints that I didn't have time to start untangling them!

I see! Seems okay to leave them as is considering they're not Boxel components.


Make all the link styles 2px wide

There are currently more content on the site that are "links" and need the link styles since the last time I focused on link styles. The link styles on the site are all too thin now and barely visible – the original link styles won't work either since they are too thick.
Please make them 2px wide instead of what they are now. (It would be visually between the current and the original versions). Here is what it would look like.
Level of importance: Important because it's barely visible that a content is a "link" right now.

@gissoo what browser were you on when you noticed this? Asking because I primarily use Chrome and the underlines are much thinner, I think since @thatbudakguy switched to use the text-underline style that skips descenders (I think he noted at the time that the underline thickness can't be styled on chrome). It does seem like a concern that the underlines are so thin.

@rlskoeser Interesting – I've been on Firefox.

just to make sure we're all on the same page - i just checked chrome, safari, and firefox and saw a uniform underline thickness of 2px, which is what's set in the css.
@gissoo can you take some screenshots to show the difference? I suspect that we might instead be talking about the distance the underline is from the text (which unfortunately chrome does not support controlling, though safari and firefox do).

@thatbudakguy I think you may have fixed this in your active filters changes.

@thatbudakguy @rlskoeser I noticed this got fixed for a day or two, and then it has come back again :D
No, as far as I can tell visually I'm talking about the thickness of the line, unless it is affected by something that has to do with the distance of the line with the text implementation-wise.
Right now, it's again thin in chrome and firefox, and it looks correct on Safari. Here they are in the following order: (Chrome, Firefox, Safari)

@gissoo as per our conversation when discussing the map, would you mind checking if your browser versions are all up-to-date and then trying again?

@thatbudakguy Thanks for writing. After we talked last week I updated all my browsers :D
I'll test this again today. At the moment I'm having issues with accessing the test site (on my side, trying to fix in a few minutes)

@thatbudakguy I tried this again now. Thank you!!! They all look perfect on mobile. The only one that still shows very thin lines is Chrome on my desktop (I tried two machines and updated not only the browsers but also one of the machines :D – I really don't know what's wrong with the chome on desktop, it's okay on mobile). But I think it's not a big deal and it's fine.

fantastic - thank you for trying them all out!! go ahead and close the issue if you think it's done.


Interoperability testing

Problem
There are lots of ways we can make changes to groups that will break existing clients.
Not an exhaustive list at all
Breaking the ability to add some members to a group

Adding a new required capability to groups. Adding a user whose key package doesn't advertise this capability to one of these groups will throw an error. The only fix is for everyone to upgrade their clients and upload new key packages.
Changes to the credential format or IdentityUpdate format will mean that key packages cannot be validated by clients
Changes to the Welcome message format or "sealed sender" encryption
Changes to IdentityUpdate validation
Changes to OpenMLS that affect key packages

Commit validation errors
If we make a change to commit validation, that change needs to be available to every single group member or we can end up in a "split brain" situation where commits are seen by part of the group as valid and part of the group as invalid.

Changes to the commit validation process
Changes to the permissions system, or the shape of the permissions structs saved in the metadata
Changes to the credential format or IdentityUpdate format
Changes to Identity Update validation
Changes to OpenMLS that affect commit validation
Introducing new proposal types that older clients cannot read or handle properly

Solution
There's a few ways we could catch these kinds of issues before they get rolled out

Have some really good fixtures of key packages, groups, and messages that we can use in integration tests
Have an interop test suite that runs both an old client version (the 1.0 release of groups + any other major releases), and the current version and has all of them create groups and add the installations from all the client versions to those groups.

I think the second one is going to be more effective and maybe even easier. But having some version of this is going to prevent a lot of pain down the road.

There's a separate but related issue of "backward compatiblity testing", which we could do if we had a legacy client in our test suite.
We would join a bunch of groups on an old client version, then try and start a client with the newer code using the same DB. The DB needs to be able to upgrade itself and continue joining groups and sending messages.


[#noissue] Refactor HttpClient3

Codecov Report

Merging #3023 into master will decrease coverage by 0.04%.
The diff coverage is 0%.

@@            Coverage Diff             @@
##           master    #3023      +/-   ##
==========================================
- Coverage   38.25%   38.21%   -0.05%
==========================================
  Files        1921     1923       +2
  Lines       64771    64823      +52
  Branches     9043     9056      +13
==========================================
- Hits        24779    24770       -9
- Misses      37460    37518      +58
- Partials     2532     2535       +3

Impacted Files
Coverage Δ

...in/httpclient3/interceptor/ExecuteInterceptor.java
0% <0%> (ø)
:arrow_up:

...MethodBaseRequestAndResponseMethodInterceptor.java
0% <0%> (ø)
:arrow_up:

...orp/pinpoint/plugin/httpclient3/EndPointUtils.java
0% <0%> (ø)

...terceptor/HttpConnectionOpenMethodInterceptor.java
0% <0%> (ø)
:arrow_up:

...ttpclient3/interceptor/RetryMethodInterceptor.java
0% <0%> (ø)
:arrow_up:

...ceptor/HttpMethodBaseExecuteMethodInterceptor.java
0% <0%> (ø)
:arrow_up:

...nt/plugin/httpclient3/CommandContextFormatter.java
0% <0%> (ø)

...ofiler/sender/StandbySpanStreamDataSendWorker.java
80.59% <0%> (-2.99%)
:arrow_down:

...orp/pinpoint/rpc/server/DefaultPinpointServer.java
73.48% <0%> (-2.66%)
:arrow_down:

...navercorp/pinpoint/rpc/common/SocketStateCode.java
81.25% <0%> (-2.5%)
:arrow_down:

... and 6 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c75917e...a0c0309. Read the comment docs.


Update readme.md

Grammar: then to than

Coverage remained the same at 93.366% when pulling 67cd98995cb99324c3e674dadb7cd8c706adbbfa on TomFaulkner:patch-1 into d0ac0e68a73f40788de7a1080609f98f8d257ca1 on mweststrate:master.


Universal Segmentation for MLOPs

This Pull requests adds a new node for universal segmentation models (MaskFormer, Mask2Former and OneFormer) to MLOPs. The node accepts a colored points network (or an image file path) and exports 3 outputs, a colored mask point network of the detected objects in the image, a corresponding primitive network, and the original image. All three outputs contain id, label and score attributes for the detected objects.
A complimentary node "MLOPs image segment" can extract detected objects by ID from either point output of the Universal segmentation node. It has two outputs, one translated, the other at the 0,0,0 position
The example HIP included shows how to use both nodes, including how to chain results from one model into another in order to refine the extraction

I moved this back to draft status. Refactoring segmentation to use the transformers pipeline model


Add Game Hunter (Target) effect

When you succeed at a Strike against your hunted prey while it's Off-Guard, it must attempt a Fortitude save against your class DC. On a failure, the prey's Speeds are each reduced by 10 feet for 1 round; on a critical failure, the duration of this effect is 1 minute. The prey is then temporarily immune to this effect for 10 minutes.

We might also be able to expand the roll predicates with:
"or": [
	"target:trait:animal",
	"target:trait:beast",
	"target:trait:dragon"
]

Not sure that additional predicate is correct for this part
Because predicate relates to apply hunt prey, but you could have hunt prey from other sources


collect history of the Q&A question

What I did?

Add POST history in QuestionPost
merge migration

I want to add QA to bookmark too. It not relate to this branch but it small change

YES YES YES


Fancyzone default layout reset once in a while

Microsoft PowerToys version
0.45
Running as admin

[X] Yes

Area(s) with issue?
FancyZones, FancyZones Editor
Steps to reproduce
Fancyzone default layout reset once in a while; I use a custom layout, and sometimes the default automatically changes to the last template layout (priority grid).
✔ Expected Behavior
Default stays as my custom layout 1
❌ Actual Behavior
default automatically changes to the last template layout (priority grid).
Other Software
No response

Duplicate of #13069

Thanks for reporting this. This issue is a duplicate. We'll track this in #13069 to centralize the discussion thread.


Please add support for Seeed Studio XIAO RP2040

What kind of issue is this?

[ X] Feature Request.

Additional info
https://wiki.seeedstudio.com/XIAO-RP2040/

Meaning, complete the PRs and integrations necessary to integrate the PR #36 cited in this forum thread
https://community.platformio.org/t/support-for-seeed-xiao-rp2040/28989/5


Allows searching users by join date in Users module

Fixes #4012
Bugfix/dnn 28950 1
Summary

Updated Stored Procedure Personabar_GetUsersBySearchTerm to include CreatedOnDate(Joining date) values in  search criteria
Skipped modifying the search text when value is in date format (SearchTextFilter.CleanWildcards modifies the date value to only year)

After fix

Please do not use reference numbers that mean nothing here in the titles, titles are used to produce the release notes and we need something understandable. I moved your original title into the description and put an understandable title.

After review, closing per the commentary added on the linked issue.


fix: removing LUA dependency from mv_webout to enable Viya 4 compatibility

:tada: This PR is included in version 4.18.8 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Updated my profile

👷 Deploy Preview for gladia processing.

Name
Link

🔨 Latest commit
31a07b9167ae00576207596e86bcbb974033ea07

🔍 Latest deploy log
https://app.netlify.com/sites/gladia/deploys/64a2dc9a93200b00088b268d


Add version output to LVM storage driver

Simply sets s.sTypeVersion to all three lines of "lvm version" output, since they all seem potentially useful.
Here's an example:
ubuntu@canonical-lxd:~$ sudo lvm version
  LVM version:     2.02.111(2) (2014-09-01)
  Library version: 1.02.90 (2014-09-01)
  Driver version:  4.29.0

Signed-off-by: Michael McCracken<EMAIL_ADDRESS>

I wonder whether we should attempt a bit more parsing and expose them as LVM / library / driver, so in your case:
2.02.111(2) / 1.02.90 / 4.29.0
This would be less likely to mess up with anything printing the server status (multi-line is kinda bad for that) and would offer some consistency in the event that the version subcommand of LVM changes for some reason.

@stgraber good idea, I've added your suggestion.


Added option hostname to docker service create. This option will allo…

This pull request is related to issue docker/docker#24877
- What I did
Added option hostname in docker service create command.
- How I did it
I changed the docker client, updated the ContainerSpec structures in docker/swarm repo, so that this option is serialized to the swarm agents from the clients.
- How to verify it
docker service create --name test --hostname vasko <image_id>
docker exec test.1.<task_id> hostname
- Description for the changelog
This pull request will allow to specify hostname option to the docker service create command.
The same hostname will be set on all containers.
Signed-off-by: Vasil Yordanov<EMAIL_ADDRESS>

This pull request is failing on build because it depends on the following pull requests: https://github.com/docker/engine-api/pull/352
https://github.com/docker/swarmkit/pull/1318

I could fix the failing-ci if I change hack/vendor.sh to download the swarmkik and engine-api dependencies from my forked versions of these repos. How to proceed? Should I wait for the for the engine-api and swarmkit pull requests to be accepted, or to change the vendor.sh?

@vasil-yordanov only the vendor check should fail because of vendoring (which is ok). The other ones fails because of gofmt :
16:24:08 ---> Making bundle: validate-gofmt (in bundles/1.13.0-dev/validate-gofmt)
16:24:08 These files are not properly gofmt'd:
16:24:08  - api/client/service/opts.go
16:24:08  - daemon/cluster/convert/container.go
16:24:08
16:24:08 Please reformat the above files using "gofmt -s -w" and commit the result.

@vdemeester I have fixed the formatting, but some check fails. I saw in the logs "Variable with name 'BUILD_DISPLAY_NAME' already exists, current value: '#25437', new value: '#25437'". Is this some issue from build system side or there is something from my side that I have to do?

@vasil-yordanov looks like the error is;
11:45:53 # github.com/docker/docker/api/client/service
11:45:53 api/client/service/opts.go:445: unknown swarm.ContainerSpec field 'Hostname' in struct literal

@thaJeztah this error is because the code depends on github.com/docker/engine-api/types/swarm, which is in another github repo, where I have waiting pull request.
https://github.com/docker/engine-api/pull/352
Actually this pull request depend on pull requests on two other repos: docker/engine-api and docker/swamkit, I'm not sure if this is the same team that is responsible for accepting the pull request on these three repos or it is separated teams with good synchronization.
@vdemeester told me earlier that "only the vendor check should fail because of vendoring (which is ok).", so I believe that now this error is due to vendoring only.

@vasil-yordanov what we usually do, is to temporarily include the changes in the vendored code in this PR (you can do separate commits for that); that way the code works, and CI can run. The vendor-CI will complain that you made changes to vendored code that don't match the commit/tag specified in hack/vendor.sh, but that's ok; once this PR is in code review, and the related PRs are merged, you can update the hack/vendor.sh and vendored code, so that the vendor CI goes green.

Thank you @theJeztah for explaining me the process. I will commit vendor. Actually now I noticed that there is such folder in this repo. I was expecting that it is created by hach/vendor.sh during build time, and the dependencies are not kept here, but fetched when needed from the corresponding repo.

Please sign your commits following these rules:
https://github.com/docker/docker/blob/master/CONTRIBUTING.md#sign-your-work
The easiest way to do this is to amend the last commit:
$ git clone -b "master" git@github.com:vasil-yordanov/docker.git somewhere
$ cd somewhere
$ git rebase -i HEAD~5
editor opens
change each 'pick' to 'edit'
save the file and quit
$ git commit --amend -s --no-edit
$ git rebase --continue # and repeat the amend for each commit
$ git push -f

Ammending updates the existing PR. You DO NOT need to open a new one.

@GordonTheTurtle I have checked that I have signed all my commits with git -s except the merges to the master of docker/docker repo which generates automatic commit message.
I also checked that "git rebase -i HEAD~5" does not show commits that I haven't signed, It do not show the merge commits.
These are my commits from "git reabase -i" command
pick 2a659dd Added option hostname to docker service create. This option will allow setting the same hostname on all containers spawned for given service
pick 3c4358d Reformated files with gofmt
pick 0009a68 Add vendor changes, to build the code and make CI to pass
In the git-rebase-todo I can not see merge commits.
All my commits have been signed when I did the commits, so it seems I do not need to amend the commits.

@vasil-yordanov you should not have merge commits of master in your PR. You should remove the merge commit and rebase, and that will fix the signing issue.

Does anyone has idea why this CI fails?
docker_cli_build_test.go is not related to my change for docker service create --hostname option.

win2lin is currently having issues (there's a PR to fix that), not sure about windowsRS1, but we can restart. During design review, it's not a problem anyway

@thaJeztah I have implemented the --hostname option to be a template, like --hostname=srv-*, in this case if we create a service with replicas>1 then the hostname will be srv-1, srv-2, ...
Only single replacement of * will happen. If there is not * at all then no replacement will be done and the hostname will be set the same on all containers for the given service.
Do you think this design is acceptable for you?
In my case I will not use * at all, I have implemented this because some people wanted it in docker/docker#24877

I have removed my last commit after some discussion with stevvooe. "We need to be careful about creating a "template" system without thinking about consistent user experience."

Not really sure why hostname would really matter in services (or even normal containers)... but I guess people find reasons.
In the linked issue it looks like there was still some discussion going on.
@mavenugo Are you ok with this?

@stevvooe I start working on the adding hostname option in the docker repo, but do not know well the vendoring process.
I changed the hack/vendor.sh to use my repo: clone git github.com/vasil-yordanov/swarmkit.git
Then I tried to build with make, but it fails due to missing field in swarm.ContainerSpec structure, because the vendoring didn't happen.
Building: bundles/1.13.0-dev/binary-client/docker-1.13.0-dev
# github.com/docker/docker/api/client/service
api/client/service/opts.go:447: unknown swarm.ContainerSpec field 'Hostname' in struct literal
Makefile:80: recipe for target 'binary' failed
make: *** [binary] Error 1

I tried to execute hack/vendor.sh manually before to build, but then error is:
api/client/service/update.go:19:2: cannot find package "github.com/flynn-archive/go-shlex" in any of:
	/go/src/github.com/docker/docker/vendor/github.com/flynn-archive/go-shlex (vendor tree)
	/usr/local/go/src/github.com/flynn-archive/go-shlex (from $GOROOT)
	/go/src/github.com/flynn-archive/go-shlex (from $GOPATH)
	/go/src/github.com/docker/docker/vendor/src/github.com/flynn-archive/go-shlex
cli/cobra.go:6:2: cannot find package "github.com/spf13/cobra" in any of:
	/go/src/github.com/docker/docker/vendor/github.com/spf13/cobra (vendor tree)
	/usr/local/go/src/github.com/spf13/cobra (from $GOROOT)
	/go/src/github.com/spf13/cobra (from $GOPATH)
	/go/src/github.com/docker/docker/vendor/src/github.com/spf13/cobra
cli/flags/common.go:12:2: cannot find package "github.com/spf13/pflag" in any of:
	/go/src/github.com/docker/docker/vendor/github.com/spf13/pflag (vendor tree)
	/usr/local/go/src/github.com/spf13/pflag (from $GOROOT)
	/go/src/github.com/spf13/pflag (from $GOPATH)
	/go/src/github.com/docker/docker/vendor/src/github.com/spf13/pflag
Makefile:80: recipe for target 'binary' failed
make: *** [binary] Error 1

I could make the same changes I did before in docker/swarmkit repo by hand, based on the clone git github.com/docker/swarmkit 8a761950fb4d9251c335dc6149a8a02756cb3b10, but this seems a little bit strange to me, because it is error prone and double work.
Could you help me to understand the vendoring process?
How should I incorporate my changes in docker/swarm repo into the docker/docker repo?
Why you keep the vendor directory under VCS, after you have defined in vendor.sh the exact hashes and vendor repos from which the docker/docker code depends on?

How should I incorporate my changes in docker/swarm repo into the docker/docker repo?

Just include the revision of swarmkit that has the Hostname changes. When you run the hack/vendor.sh script, it will update the dependencies locally. Confirm these are correct then add these changes to your PR.

Why you keep the vendor directory under VCS, after you have defined in vendor.sh the exact hashes and vendor repos from which the docker/docker code depends on?

Downloading dependencies is error prone and time consuming. By including them directly in the project, you ensure that the project can be built, even if the upstream dependencies are unavailable or the version you were using is broken. In Go, this is a defacto standard approach. We retain the hashes to ensure we have provenance of which versions led to which updates.

@stevvooe Thank you for clarifying me the docker vendoring process.
I already tried to execute the ./hack/vendor.sh, but then the 'make' fails with the error I wrote you before:
---> Making bundle: binary (in bundles/1.13.0-dev/binary)
Building: bundles/1.13.0-dev/binary-client/docker-1.13.0-dev
api/client/service/update.go:19:2: cannot find package "github.com/flynn-archive/go-shlex" in any of:
	/go/src/github.com/docker/docker/vendor/github.com/flynn-archive/go-shlex (vendor tree)
	/usr/local/go/src/github.com/flynn-archive/go-shlex (from $GOROOT)
	/go/src/github.com/flynn-archive/go-shlex (from $GOPATH)
	/go/src/github.com/docker/docker/vendor/src/github.com/flynn-archive/go-shlex
cli/cobra.go:6:2: cannot find package "github.com/spf13/cobra" in any of:
	/go/src/github.com/docker/docker/vendor/github.com/spf13/cobra (vendor tree)
	/usr/local/go/src/github.com/spf13/cobra (from $GOROOT)
	/go/src/github.com/spf13/cobra (from $GOPATH)
	/go/src/github.com/docker/docker/vendor/src/github.com/spf13/cobra
cli/flags/common.go:12:2: cannot find package "github.com/spf13/pflag" in any of:
	/go/src/github.com/docker/docker/vendor/github.com/spf13/pflag (vendor tree)
	/usr/local/go/src/github.com/spf13/pflag (from $GOROOT)
	/go/src/github.com/spf13/pflag (from $GOPATH)
	/go/src/github.com/docker/docker/vendor/src/github.com/spf13/pflag
Makefile:80: recipe for target 'binary' failed
make: *** [binary] Error 1

The same error occurs when I do:
git clone https://github.com/docker/docker.git
./hack/vendor.sh
make

In the same time when I do git diff after execution of ./hack/vendor.sh, it shows me a lot of untracked files and files not staged for commit in 'vendor'  folder.

What is the value of GOPATH when you run the command?

In the same time when I do git diff after execution of ./hack/vendor.sh, it shows me a lot of untracked files and files not staged for commit in 'vendor' folder.

This is normal. You'll have to check these. I'd recommend doing this in a separate commit.

@stevoo Sorry for the inconvenience. I just noticed that ./hack/vendor.sh was not executed successful, due to missing 'hg'. I've missed this message.
bitbucket.org/ww/goautoneg @ 75cd24fc2f2c2a2088577d12123ddee5f54e0675: clone, hack/.vendor-helpers.sh: line 44: hg: command not found
After installing the mercurial now everything is working.
I pushed my re-vendored fork, but will test if this hostname option is still working and will let you know tomorrow.

@cpuguy83

Not really sure why hostname would really matter in services (or even normal containers)... but I guess people find reasons.

On the one hand, it's easier to know where you are running commands when the prompt shows the task.slot as hostname. Definitely root@2d425a02daf1 doesn't help.
On the other hand, if --hostname is somehow linked to DNS name of the running container, containers could find each other by name, instead of IP, being easier to handle IP changes.
I'll love each instance to be named as . like @thaJeztah said at https://github.com/docker/docker/pull/24973#issuecomment-234904529
Regards

@stevvooe I have re-vendored this PR and also tested manually the new feature with hostanme, and it is working. Could you make me code review and let me know how to proceed?

@vasil-yordanov Thanks for getting this into a workable state!
@mrjana @aluzzardi @crosbymichael @mavenugo Could you comment on the problems with allowing setting the hostname of all instances of a service and possible future implications? Are there areas that need to be limited to allow for future hostname oriented features?

@stevvooe i cannot think of any on the system side of things.  Its fine to reuse the hostname and does not cause any conflicts.

@crosbymichael @stevvooe IMHO If all containers share the same hostname, there could be some scenarios where problems could arise. Let me give you a (pretended) example:
Redis clusters use a 1-16383 slot array, in which keys are stored based on hash(key), hence each node is responsible for a few slots. Now consider node-1 handles slot 1 and node-2 handles slot 2.
Redis client can request node-1 to put data on slot 1 and that's ok, but if also request to put data on slot 2, node-1 will response "MOVED to node-2". (To be honest: MOVED to IP:PORT, but using hostnames ilustrates the problem)
It's also recommended to have smart Redis client, which remember the node-slot topology, avoiding MOVED responses and improving performance. In the case of sharing hostnames, that could also be a problem:
 slot 1: mynode # instead of node-1
 slot 2: mynode # instead of node-2

More information about Redis clusters
To sum up: IMHO each hostname should be the same as the service short name(without hash).
ie: node-1, node-2, even NOT USING DOTS "." for task.slot naming, but task-slot.
I suggest reading
Hope it helps.

@mostolog I think you're confusing the hostname seen within the container process with the hostname exported to the network. As it is planned, this hostname parameter would affect the hostname as seen by container process. Much of what you're discussing is proposed in https://github.com/docker/swarmkit/issues/1242.
The main issue is whether or not bind these two concepts. While what you are demonstrating is important, it is largely orthogonal to this discussion. In fact, showing that these are easily confused is an argument on the side of considering this parameter in the context of a DNS mapping scheme.
We still need to hear from @mavenugo @mrjana on this topic!

@stevvooe
I think you're confusing the hostname seen within the container process with the hostname exported to the network.

Indeed, I though they should be the same!

The main issue is whether or not bind these two concepts. While what you are demonstrating is important, it is largely orthogonal to this discussion. In fact, showing that these are easily confused is an argument on the side of considering this parameter in the context of a DNS mapping scheme.

Totally agree.
Going docker/swarmkit#1242

Indeed, I though they should be the same!

@mostolog If only life were so simple!!!
Thanks for the feedback! Let's keep bouncing this around so we can get this right.

@thaJeztah We merged the functionality in swarmkit. This PR will likely need to be carried for integration into docker.

@stevvooe so since https://github.com/docker/swarmkit/pull/1688 was merges I assume we have to also do our job and merge that one in vendor. Or since actually @vasil-yordanov has referenced his repo in vendor.sh we don't need to do stuff here and that one can also be closed?

@niau That is the process. Let us know if you need help!

uha @stevvooe  I assume that I had really lagged  the dogs here.
This is basically the result of updating vendor.sh, executing it, and committing the various changes to vendor folders. It was a strange that the new run of vendor.sh caused also a lot of changes not only to swarmkit but also to other vendor folders. Is this how it is and should I commit also those? If not the changes  are in separate commits to facilitate easy reverting.

@niau You can do something like ./hack/vendor.sh github.com/docker/swarmkit to only update that dependency. Let's keep the updates scoped to swarmkit.

Please sign your commits following these rules:
https://github.com/docker/docker/blob/master/CONTRIBUTING.md#sign-your-work
The easiest way to do this is to amend the last commit:
$ git clone -b "master" git@github.com:vasil-yordanov/docker.git somewhere
$ cd somewhere
$ git rebase -i HEAD~8
editor opens
change each 'pick' to 'edit'
save the file and quit
$ git commit --amend -s --no-edit
$ git rebase --continue # and repeat the amend for each commit
$ git push -f

Amending updates the existing PR. You DO NOT need to open a new one.

Ok, this PR wasn't actually merged, but possibly @vasil-yordanov rebased/updated his master, and GitHub shows the exact same tree as https://github.com/docker/docker/commit/80d6d2e129805e8ee9257641b922e47a01f16736, so automatically marks it as "merged", even though nothing was actually merged;

@thaJeztah  very true I simply rebased it.

@niau looks like something went wrong during the rebase, because the change set in this PR is not empty https://github.com/docker/docker/pull/25437/files

Thanks @theJeztah I assume so. We are missing one commit. I have recommited it in vasil's repo, but it does not appear here. It looks like the only option is a new PR.

@niau yep, and it would be best to open the PR using a branch (that way, if you change/rebase master, it shouldn't happen again 👼)

@vdemeester @thaJeztah sorry for all the noise I hope that the latest PL is exactly as it should be. It is from a branch, it is rebased and hopefully all tests pass :)


Upgrade to Go 1.12

Hello, we should upgrade Go to 1.12
This is required for https://github.com/containous/traefik/issues/4275

You can assign this to me


Pairing fail

When switching from test -> live, the pairing first time fails, second time works

Note sure if you already figured this out/tested it, but there is bitpay.com and there is test.bitpay.com. They use different tokens.


Glasses/Rectangles creation

Is your feature related to something you want to see in this project? Please describe.
A calming culmination of multiple rectangles in vertical and horizontal layers
Describe the solution you'd like
Randomness + Vertical and Horizontal angled drops of constant values
Additional context

Completed and can be found here.


Add docs for upgradeable contracts

Resolves https://github.com/stellar/soroban-docs/issues/388

Preview is available here:http://soroban-docs-pr450.previews.kube001.services.stellar-ops.com/

Preview is available here:http://soroban-docs-pr450.previews.kube001.services.stellar-ops.com/


youtube.com "ERROR: Content Warning"

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.05.09. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2018.05.09

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'--username', u'PRIVATE', u'--password', u'PRIVATE', u'https://www.youtube.com/watch?v=wSFvZUK4xWU']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.05.09
[debug] Python version 2.7.9 (CPython) - Linux-4.14.9-041409-generic-x86_64-with-Ubuntu-15.04-vivid
[debug] exe versions: ffmpeg 2.5.10-0ubuntu<IP_ADDRESS>, ffprobe 2.5.10-0ubuntu<IP_ADDRESS>, phantomjs 1.9.0
[debug] Proxy map: {}
[youtube] Downloading login page
[youtube] Looking up account info
[youtube] Logging in
[youtube] Checking cookie
[youtube] wSFvZUK4xWU: Downloading webpage
[youtube] wSFvZUK4xWU: Downloading embed webpage
[youtube] wSFvZUK4xWU: Refetching age-gated info webpage
[youtube] wSFvZUK4xWU: Extracting video information
ERROR: Content Warning
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 792, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 503, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/youtube.py", line 1974, in _real_extract
    raise ExtractorError(unavailable_message, expected=True)
ExtractorError: Content Warning

<end of log>

Description of your issue, suggested solution and other information
While downloading age-gated content, one of the videos (see output) fails with "ERROR: Content Warning".
Tested it while passing the login credentials and cookies. Any other age-gated content works, except this one.

You did not pass credentials to youtube-dl.

Changed the output to "logged in" since I didn't know if it would keep any info about the password and username. Still same error.

@dstftw there you go
youtube-dl.exe -i --no-playlist -R 100 --fragment-retries 100  -c -w -F https://youtu.be/5wHbTXgy0M4

youtube-dl -F -v  https://www.youtube.com/watch?v=zAa6CS6ALhM

Checklist

[x] I'm reporting a broken site support issue
[x] I've verified that I'm running youtube-dl version 2019.07.14
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read bugs section in FAQ

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-F', '-v', 'https://www.youtube.com/watch?v=zAa6CS6ALhM']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.07.14
[debug] Python version 3.6.8 (CPython) - Linux-4.15.0-20-generic-x86_64-with-LinuxMint-19.1-tessa
[debug] exe versions: ffmpeg 3.4.6, ffprobe 3.4.6
[debug] Proxy map: {}
[youtube] zAa6CS6ALhM: Downloading webpage
[youtube] zAa6CS6ALhM: Downloading embed webpage
[youtube] zAa6CS6ALhM: Refetching age-gated info webpage
ERROR: Content Warning
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/youtube_dl/YoutubeDL.py", line 796, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/lib/python3.6/dist-packages/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/lib/python3.6/dist-packages/youtube_dl/extractor/youtube.py", line 2109, in _real_extract
    raise ExtractorError(error_message, expected=True)
youtube_dl.utils.ExtractorError: Content Warning

Description

Same question, other age-gated content works, except this one.

This is a case of reporting a misleading status message. The error message it shows in this case is actually a warning, and not a fatal error, but it's from beyond the age-gate page. And it turns out that there's a more pressing failure, so the inability to download is real.
The true error, which youtube-dl should probably report instead. is likely:

Watch this video on YouTube. Playback on other websites has been disabled by the video owner.

The problem is that the age_gate code path doesn't check for such error messages. Instead the operation fails later upon discovering that there is no actual video url (or dash manifest) to download. In other words, the error message you're getting is actually just the warning that would apply if you did "watch this video on YouTube."
To fix the error message, insert the following three lines into extractor/youtube.py:
https://github.com/ytdl-org/youtube-dl/blob/c2d125d99f81aa33429b2158acd9a90524575378/youtube_dl/extractor/youtube.py#L1728-L1735
    +     player_status = player_response.get('playabilityStatus')
    +     if 'reason' in player_status:
    +         raise ExtractorError(clean_html(player_status['reason']), expected=True)

https://github.com/ytdl-org/youtube-dl/blob/c2d125d99f81aa33429b2158acd9a90524575378/youtube_dl/extractor/youtube.py#L1736-L1737
cc: @dstftw

Actually, it turns out that those three lines are applicable to the non-age-gated code path as well. So it would be even better to insert them here, instead:
   +     player_status = player_response.get('playabilityStatus')
   +     if 'reason' in player_status:
   +         raise ExtractorError(clean_html(player_status['reason']), expected=True)

https://github.com/ytdl-org/youtube-dl/blob/c2d125d99f81aa33429b2158acd9a90524575378/youtube_dl/extractor/youtube.py#L1813-L1817

ping @dstftw -- this is an easy 3-line fix if you want to adopt it...
Besides giving a more correct error message for age-gate failures, this change also makes youtube-abandon those cases earlier on, which avoids further wasted effort extracting metadata.

Watch this video on YouTube. Playback on other websites has been disabled by the video owner.

is as useless and incorrect as the current one.
The real error in my case is

Sign in to confirm your age
This video may be inappropriate for some users. Confirm and download?

Thanks. That's why you're the expert.

Before I post what may be a duplicate, is it expected behavior now that certain age-gated videos cannot be downloaded without logging in? I thought previously youtube-dl had ways of bypassing such checks.

@diamondsw Youtube-dl bypasses it by doing (this is my assumption) /embed/
This means that if the video does not allow playback on other websites, it won't be downloaded and you HAVE to sign in

Despite the commit on Aug 5, this issue still persists.
I'm calling Youtube-DL via an import into a script of my own. I'm setting login data and passing it to youtube-dl. This appears to work fine for most videos, but age-gated videos with embeds disabled refuse to work.
Tests by calling youtube-dl directly from the command line are also unsuccessful.


Assignment two

What changes are you trying to make? (e.g. Adding or removing code, refactoring existing code, adding reports)
I've made 2 logical models and wrote SQL queries
What did you learn from the changes you have made?
That I need to practice SQL more and more :)
Was there another approach you were thinking about making? If so, what approach(es) were you thinking of?
Yeah, I have thought about multiple approaches
Were there any challenges? If so, what issue(s) did you face? How did you overcome it?
When some of my queries didn't work, I tried them differently multiple times. Took help from internet and from the LSs as well
How were these changes tested?
The changes were tested against their desired outputs
A reference to a related issue in your repository (if applicable)
Checklist

[ ] I can confirm that my changes are working as intended

Hi Niyaz,
Thanks for your help and feedback.
Regards,
Saleha.
Sent from Outlook for Androidhttps://aka.ms/AAb9ysg

From: Niyaz Nazari @.>
Sent: Wednesday, December 25, 2024 2:50:36 PM
To: saleha-12/sql @.>
Cc: saleha-12 @.>; Author @.>
Subject: Re: [saleha-12/sql] Assignment two (PR #2)
@niyazmnazari approved this pull request.
Thank you for submitting assignment 2. Everything looks correct.
Point: 70/70
—
Reply to this email directly, view it on GitHubhttps://github.com/saleha-12/sql/pull/2#pullrequestreview-2522654883, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BM5KNIDIREJE74BTEYSZZZL2HMEAZAVCNFSM6AAAAABUCATIV2VHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDKMRSGY2TIOBYGM.
You are receiving this because you authored the thread.Message ID: @.***>


add detection for npm-run-all and wildcards

https://github.com/byteclubfr/npm-scripts-tree/commit/1e89b76c4e79cc9ac5a1d071e1168c7650c057e0


Remove the broker-cli folder at the root

Addresses part of #75. This library is not used by anyone and it is obsolete.

@martinmaly Could you take a look?


feat: add indexOf method for useFilter

Add indexOf method for useFilter.
I have met a situation where it is necessary to filter options by the index of a substring, so it would be better if an indexOf method could be provided directly.
✅ Pull Request Checklist:

[ ] Included link to corresponding React Spectrum GitHub Issue.
[ ] Added/updated unit tests and storybook for this change (for new code or code which already has tests).
[ ] Filled out test instructions.
[ ] Updated documentation (if it already exists for this component).
[ ] Looked at the Accessibility Practices for this feature - Aria Practices

📝 Test Instructions:

🧢 Your Project:
Currently I am using the following as a workaround:
const collator = useCollator({ usage: 'search', sensitivity: 'base' });
const indexOf = useCallback((string: string, substring: string) => {
  if (substring.length === 0) {
    return 0;
  }

  string = string.normalize('NFC');
  substring = substring.normalize('NFC');

  const sliceLen = substring.length;
  const strLen = string.length;
  for (let scan = 0; scan + sliceLen <= strLen; scan++) {
    const slice = string.slice(scan, scan + sliceLen);
    if (collator.compare(substring, slice) === 0) {
      return scan;
    }
  }

  return -1;
}, [collator]);

Thanks for the PR, you'll need to sign the CLA https://react-spectrum.adobe.com/contribute.html#contributor-license-agreement then you may need to close and reopen the PR to get it to take

Discussed with the team and the one concern we have is that it doesn't match the existing pattern of the filter functions which is to return a boolean. Do you mind sharing the use case you ended up needing this for? We may need something like this in the future, so it may help us figure out where it could fit in.

@reidbarber Perhaps this is a useSorting scenario.
In my case, there are some date and time options that need to be sorted by the first match position while being searched. The options that match earlier should be placed in front.

Hello, now I have another request regarding the filter. I need to highlight an option if it fully matches the input value.
Could I also add a equals method to this useFilter hook in this PR or I should create a new PR?


The return type 'String' isn't a 'String', as required by the closure's context

In the code below, the first assignment of method results in The return type 'String' isn't a 'String', as required by the closure's context. The next two work as expected. I would expect all three assignments to be valid.
void main() {
  String Function<T>(T data) method;

  method = <String>(String data) {
    return data; // Results in: The return type 'String' isn't a 'String', as required by the closure's context
  };

  method = <String>(String data) {
    return 'data'; // this works
  };

  method = <String>(String data) {
    return data.toString(); // this works
  };
}

You got kinda fooled here since you thought <String>, in your example, was the type String and not a generic called String. I was rather confused for a second since this program ended up being valid:
void main() {
  String Function<T>(T data) method;

  method = <String>(String data) {
    return 'value: $data runtimeType: ${data.runtimeType}';
  };

  print(method(2)); // value: 2 runtimeType: int
}

But then, after closer inspection, you can replace it with method = <X>(X data) { and it starts to make more sense what is going on.
Don't know if there should be some kind of lint warning if you are using a named generic with the same name as a type since it can make it hard to understand what is going on.

What @julemand101 says.
You have two types named String, one from dart:core, one a type variable from your own function. None of them are assignable to the other.


First real rough draft of outbound dialing

Allows a station to outbound dial, and also allows stations to
join a call if there is one in progress.  Kicks out additional
outside channels if one attempts to call the extension when a
call is in progress.  Checks device states to see if entry is
allowed.

Looks like the old commits from before you rebased off of master are back in. Not sure how that happened but this branch should be cleaned up so it does not contain them anymore.


cleaner url's /about/ vs /about.html

Is there a way to do this currently?
If this is too superficial a request in the project's current form, I apologize in advance...
Was just wondering, thank you!
Ryan

I'm using middleman 2.0.14.
I tried @tsaleh solution (Rack::Rewrite), but it didn't work. I think the problem is that Middleman.start_server doesn't pass :config => 'config.ru' to Rack::Server.new.
I ended up using @TrevorBurnham's solution since I didn't want to monkey-patch middleman. I'm not sure if this was corrected in middleman 3.0 (codebase changed a lot and I couldn't dig it out).
Tks for the tips guys!

To anyone coming across this in 2020.
If you just need to use clean urls with dev server, nowadays there's a directory_indexes option, which can be enabled selectively for development, and effectively solves the pretty url issue.
configure :development do
    activate :directory_indexes
end


Adding the option of ely.by login

it should be simple to add it as an option to authenticate with the ely.by servers

Sorry, this is not something I am interested in supporting.


clang errors in mac

I am getting lot of clang errors in mac. I have all the supporting libraries that you mentioned. Does this project run in mac?
clang: error: unknown argument: '-sha'
clang: error: unknown argument: '-target-feature'
clang: error: unknown argument: '-target-feature'
clang: error: unknown argument: '-target-feature'
clang: error: no such file or directory: '+cx16'
clang: error: no such file or directory: '+xsave'
clang: error: no such file or directory: '+bmi2'
clang: error: language not recognized: 'savec'
clang: error: no such file or directory: '+fsgsbase'
clang: error: no such file or directory: '+avx'
clang: error: no such file or directory: '+popcnt'
clang: error: no such file or directory: '+fma'
clang: error: no such file or directory: '+bmi'
clang: error: no such file or directory: '+aes'
clang: error: no such file or directory: '+rdrnd'
clang: error: language not recognized: 'saves'
clang: error: no such file or directory: '+sse4.1'
clang: error: no such file or directory: '+sse4.2'
clang: error: no such file or directory: '+avx2'
clang: error: no such file or directory: '+sse'
clang: error: no such file or directory: '+lzcnt'

There was some mismatch between Mac's Xcode and Theano. After updating Xcode these errors got resolved


[AIRFLOW-3287] Moving DB clean-up code into the CoreTest.tearDown()

Jira

[x] My PR addresses the following Airflow Jira

Description
While running a single unit test of some Dataproc operator, I've spotted that database clean-up code in tests.core module is triggered, which should not take place since I run unit test in a completely different place.
Tests
Fixing existing tests. Like test_task_fail_duration, it was failing if ran second time without proper DB cleanup.
Commits

[x] My commits all reference Jira issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":

Subject is separated from body by a blank line
Subject is limited to 50 characters (not including Jira issue reference)
Subject does not end with a period
Subject uses the imperative mood ("add", not "adding")
Body wraps at 72 characters
Body explains "what" and "why", not "how"

Documentation
No changes neede
Code Quality

[x] Passes flake8

Codecov Report

Merging #4122 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #4122   +/-   ##
=======================================
  Coverage   76.66%   76.66%
=======================================
  Files         199      199
  Lines       16209    16209
=======================================
  Hits        12427    12427
  Misses       3782     3782

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bc3108e...23a7957. Read the comment docs.


docs(readme): Update installation docs with typescript support

Added readme changes discussed here to make note of typescript support.

Codecov Report

Merging #599 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##           master   #599   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           1      1
  Lines         950    950
=====================================
  Hits          950    950

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e4b81f4...710f5f5. Read the comment docs.

Thanks!


apple_framework copies .swiftmodule files into app bundle when used with dynamic vendored_xcframeworks

Hi,
apple_framework copies .swiftmodule files into app bundle when used with dynamic vendored_xcframeworks.
This seems to be unnecessary.
This can be validate by running the following commands on latest master
$ bazelisk build //tests/ios/xcframeworks/Basic:XCFrameworksApp --apple_platform_type=ios
...
INFO: Build completed successfully, 1 total action
$ cp bazel-bin/tests/ios/xcframeworks/Basic/XCFrameworksApp.ipa XCFrameworksApp.zip
$ unzip -qq XCFrameworksApp.zip
find Payload/XCFrameworksApp.app -name '*.swiftmodule'
Payload/XCFrameworksApp.app/Frameworks/BasicXCFrameworkDynamic.framework/Modules/BasicXCFrameworkDynamic.swiftmodule

Furthermore when building with xcodebuild, .swiftmodule are never copied into app bundle.
This can be validate by building the following example project.

Just for reference, I was hoping that maybe apple_dynamic_xcframework_import doesn't have this issue, but it's the same:
https://github.com/bazelbuild/rules_apple/issues/2510


Replace submodule RxSwift with symlink of carthage checkout

This will help:

Project intergrating RxDataSources with carthage do not need to clone RxSwift submodule eveny time carthage bootstrap executed, which will speed up CI builds.
Unify RxSwift version of RxDataSources.xcodeproj and Examples.

Solved by #281. Thanks for your assistance on that one!


x64 Support?

I was wondering how I could build this library for 64bit. I need this, as my project is 64bit only.

Nevermind, I found it out:
mkdir build64
cd build64
cmake -G "Visual Studio 12 2013 Win64" ..

Nice to hear, I would have answer the same, but a few hours later.
Cheers!


Save a changed value in a replaced screen

In this example:

We use the original data to replace the screen and paint the chart. If we add an input in the replaced screen to change some value, is it possible to save that changed? (To see that changed value reflected in the VX project, as if we had replaced that value directly in some table of VX)

Did you read the API documentation: https://github.com/sibvisions/reactUI#api
Here's an example:
https://github.com/sibvisions/reactUI.example/tree/main/src/readme-files/example-screen

Ok, so in that example a screen-wrapper is being used. I understand that I can also do that in a replaced screen by using the useRowSelect hook.
Thanks.


Request for Documentation: Hi Team, in Allow untrusted internal connections is the whitelist based on DNS resolution?

Mattermost user george from https://community-daily.mattermost.com has requested the following be documented:
It depends on the elements in the list. First we match IP addresses and hostnames without even resolving. If that fails we resolve using the local resolver (it means we read the `/etc/hosts` file first) and check for matching CIDR rules. So to answer your question, only CIDR rules will require DNS resolution.

See the original post here.
This issue was generated from Mattermost using the Doc Up plugin.

Documentation updated via: https://github.com/mattermost/docs/pull/4327


Feature request: migrate from gym to gymnasium

Hi, this repository is currently listed in the gymnasium third party environments but we are cleaning the list up to only include maintained gymnasium-compatible repositories.
Would it be possible for it to be upgraded from gym to gymnasium? Gymnasium is the maintained version of openai gym and is compatible with current RL training libraries (rllib and tianshou have already migrated, and stable-baselines3 will soon).
For information about upgrading and compatibility, see migration guide and gym compatibility. The main difference is the API has switched to returning truncated and terminated, rather than done, in order to give more information and mitigate edge case issues.

Hi!
Thanks for the reminder. We will upgrade the version soon (possibly by the end of this week).

Hi, we have completed the migration to gymnasium. I will close this now, I further questions arise feel free to reopen.


Running the px4 app without usb

Hi
I am working on Snapdragon
Can i run the px4 app on snapdragon board using wifi (without USB)
Actually i am running this using usb on FC ./px4 mainapp.config but as soon as i remove my usb the app stop running and communication was lost between QGC and FC.(Fc is also connected with WIFI and can able to ping the device)
Thanks

You should be able to run it by going into the device via SSH. Have you tried that?

@anujkumargupta You can either try to use the autostart as described in the Devguide. Or alternatively, just open a screen session and start it there. It should then survive when you disconnect USB and you can re-attach it later if you need to.

Thanks @julianoes and @ndepal , Your both solutions works perfectly but i tried to going into the device using ssh but for that i need the root id and password but i did not find it any where.

IIRC "root" and "linaro" (password).


Meshlet continuous LOD

Adds a basic level of detail system to meshlets. An extremely brief summary is as follows:

In from_mesh.rs, once we've built the first level of clusters, we group clusters, simplify the new mega-clusters, and then split the simplified groups back into regular sized clusters. Repeat several times (ideally until you can't anymore). This forms a directed acyclic graph (DAG), where the children are the meshlets from the previous level, and the parents are the more simplified versions of their children. The leaf nodes are meshlets formed from the original mesh.
In cull_meshlets.wgsl, each cluster selects whether to render or not based on the LOD bounding sphere (different than the culling bounding sphere) of the current meshlet, the LOD bounding sphere of its parent (the meshlet group from simplification), and the simplification error relative to its children of both the current meshlet and its parent meshlet. This kind of breaks two pass occlusion culling, which will be fixed in a future PR by using an HZB from the previous frame to get the initial list of occluders.

Many, many improvements to be done in the future https://github.com/bevyengine/bevy/issues/11518, not least of which is code quality and speed. I don't even expect this to work on many types of input meshes. This is just a basic implementation/draft for collaboration.
Arguable how much we want to do in this PR, I'll leave that up to maintainers. I've erred on the side of "as basic as possible".
References:

Slides 27-77 (video available on youtube) https://advances.realtimerendering.com/s2021/Karis_Nanite_SIGGRAPH_Advances_2021_final.pdf
https://blog.traverseresearch.nl/creating-a-directed-acyclic-graph-from-a-mesh-1329e57286e5
https://jglrxavpok.github.io/2024/01/19/recreating-nanite-lod-generation.html,  https://jglrxavpok.github.io/2024/03/12/recreating-nanite-faster-lod-generation.html, https://jglrxavpok.github.io/2024/04/02/recreating-nanite-runtime-lod-selection.html, and https://github.com/jglrxavpok/Carrot
https://github.com/gents83/INOX/tree/master/crates/plugins/binarizer/src
https://cs418.cs.illinois.edu/website/text/nanite.html

Looks good, I'd probably rename self_lod and self_culling to just lod and culling

I'd personally like to keep it extra explicit, because it's really easy to get confused :sweat_smile:.

Thank you to everyone involved with the authoring or reviewing of this PR! This work is relatively important and needs release notes! Head over to https://github.com/bevyengine/bevy-website/issues/1303 if you'd like to help out.


feat(object): add lru cache to object get/put

Quick add of an lru-cache to js-ipfs-api for orbit. To make this effort complete we need:

[x] Make the data and links calls use the same cache and fallback to object get (this way we can take the RT to the node to fetch the entire node, instead of just fetching parts of it)

This is ready

LGTM

@haadcode now js-ipfs-api does the caching automatically :)


Page stats goes to zero after updating page settings

v.2.0.6 w7 64 bits
Go to Settings > Page, change any setting (like description) and save. Go back to your page and all your stats will be zero.

This is still present in 2.0.8, even after #676
But now Following doesn't goes to zero, only Store and Followers do.

Where we at with this one @jjeffryes?

This is still a live bug.

I'm seeing broken but different behaviour here too.
I've created one listing and when I refresh the URI at the top for one stat the other stats go to zero.
After clicking on 'Store 1':

After clicking on 'Following 0':

After refreshing the page (enter on URI ob://QmZuTqFBi2cWFAREajSTxKf8YLZJ1fKzSG2q5xD9NdhaLe/following):


[Feature] logstash写入

Search before asking

[X] I had searched in the issues and found no similar issues.

Description
logstash写入希望可以再优化一下，目前看只能根据日志内容的message通过设定的标识符分割写入
Use case
No response
Related issues
No response
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

另外也发现用doris编译处理的logstash的插件竟然能写入到starRocks的库表里面


Add shutdown.

A shutdown() API is added to perform orderly shutdown. This came about due to how bedrock-test was exiting. In the flow it uses, calling bedrock.exit() or process.exit() after successful testing results in a more abrupt shutdown. There isn't a way to exit and emit orderly events on the way. In some testing cases you may want bedrock.exit or similar events to trigger to do cleanup.
This patch attempts to keep the same semantics for current code and only adds the shutdown() call (and does some refactoring).  Retaining all prior behavior in all cases isn't well tested.  Help wanted.
shutdown() could be named something else or be hacked into exit() as options, but this seemed like a simple approach. At the time this was written, it wasn't named stop(), but now I can't recall the reasoning and that might be a better choice as it aligns with start/stop semantics and event naming. Comments welcome.

This does not appear to impact how Bedrock behaves when it receives a SIGTERM, is that correct?

This does not appear to impact how Bedrock behaves when it receives a SIGTERM, is that correct?

The signal handler calls _exit() so it will emit bedrock.stopped now.  That could cause behavior change if you implement that event handler, but if it doesn't exist, that wouldn't matter.  Looks like a finally block also will call cluster.worker.kill() for workers.  It's been a while so I can't recall the exact reasoning there.  I think that was needed to stop everything when the program started orderly shutdown, where before it would simply exit abruptly and not need that call?  Testing for all these specific cases would be useful but I imagine may be a bit tricky in practice.
Also there's still the open naming question in the PR description if anyone has thoughts.

@mattcollier, I'd like to merge this (and do a minor release). Can you take a look at @davidlehn's comments and figure out if we need to make any changes to enable this to happen or if it's good to go?

@mattcollier @davidlehn This PR keeps not landing -- we should try to push it forward so it doesn't hang out here any longer.

@davidlehn can you do a quick audit to look for bedrock.stopped event handlers?  I don't think that is used, certainly not commonly.

@davidlehn can you do a quick audit to look for bedrock.stopped event handlers? I don't think that is used, certainly not commonly.

bedrock.stopped is new in this PR, and I don't think was ever used elsewhere.


CellViT Implementation

[ ]  finish cellvit_patch function
[ ]  clean cellvit files (remove unecessary functions, methods, correct typing for python 3.10)
[ ]  handle nuclei types

@quentinblampey ,  @stergioc
Issue #19

Closing for now (CellViT is too heavy and with too many new dependencies)


build a lib with specified version

I try to build a lib with specified version, and find a suggestion as following in #11768 :

Use command .\vcpkg x-history qt5
Get the commit id of the version you need.
Use command git reset
Rebuild qt5.

Originally posted by @timautry in https://github.com/microsoft/vcpkg/issues/11768#issuecomment-639874654
I do a test with the zlib(The latest version of zlib in vcpkg is 1.2.11-6),
Vcpkg still build the latest version of module when I following the suggestion of @timautry timautry.

git reset 18b029a
.\vcpkg x-history zlib
version date vcpkg commit
1.2.11-5 2019-06-15 18b029a
1.2.11-3 2018-08-30 ab54bfa
1.2.11-2 2017-09-23 67e876c
1.2.11-1 2017-09-09 26516fe
1.2.11 2017-01-17 0d50c67
1.2.10 2017-01-04 6a220ed
1.2.8 2016-11-08 1808d46
[note: It seems the current version should be 1.2.11-5 now.]
.\vcpkg install zlib
Computing installation plan...
The following packages will be built and installed:
zlib[core]:x64-windows
Downloading powershell-core...
Extracting powershell-core...
Starting package 1/1: zlib:x64-windows
Building package zlib[core]:x64-windows...
-- Downloading http://www.zlib.net/zlib-1.2.11.tar.gz...
-- Extracting source E:/vcpkg/downloads/zlib1211.tar.gz
-- Applying patch cmake_dont_build_more_than_needed.patch
-- Using source at E:/vcpkg/buildtrees/zlib/src/1.2.11-deec42f53b.clean
-- Configuring x64-windows
-- Building x64-windows-rel
-- Installing: E:/vcpkg/packages/zlib_x64-windows/share/zlib/copyright
-- Performing post-build validation
-- Performing post-build validation done
Installing package zlib[core]:x64-windows...
Installing package zlib[core]:x64-windows... done
.\vcpkg list
zlib:x64-windows 1.2.11-6 A compression library

The installed version is still 1.2.11-6, is there any thing wrong?

Confirmed, but I think this is just a display issue.

Just a

Confirmed, but I think this is just a display issue.

Hi, it seem not that.
if you test the boost module, you will find that the vcpkg download the tar.gz file with latest  version from github.

Misuse(close the issue)

git reset 18b029a probably requires --hard  to reset the working tree instead of leaving it untouched ;)

git reset 18b029a probably requires --hard  to reset the working tree instead of leaving it untouched ;)

Oh, do you mean the buildtree?
I test it with a new vcpkg, no lib has been installed before, so there don't have any of the following folder: buildtrees,downloads,installed,packages
And I try reset it with --hard option,
After that, the vcpkg told me to run 'bootstrap-vcpkg.bat',
Then I got many many errors.

@ras0219 @ras0219-msft Could you take a look?
Thanks.

@alimai the correct command to run is probably:
$ git checkout <copied commit> -- ports/<port-name>

This will check out only the specified port from the tree. You can also do something like:
$ mkdir pinned-ports
$ git checkout <copied commit> -- ports/<port-name>
$ mv ports/<port-name> pinned-ports
$ git checkout HEAD -- ports

and then proceed to use vcpkg with the additional flag --overlay-ports=./pinned-ports :)

@alimai the correct command to run is probably:
$ git checkout <copied commit> -- ports/<port-name>

This will check out only the specified port from the tree. You can also do something like:
$ mkdir pinned-ports
$ git checkout <copied commit> -- ports/<port-name>
$ mv ports/<port-name> pinned-ports
$ git checkout HEAD -- ports

and then proceed to use vcpkg with the additional flag --overlay-ports=./pinned-ports :)

Thanks. It works now.

I need this to be automated. it is here for you just in case
from pathlib import Path
import subprocess as p
import shutil

MISSING_PKG_NAME = 'boost-signals'
MISSING_PKG_VERSION = '1.68.0'

REPO_ROOT = Path(__file__).parent.parent.parent.parent # CHANGE TO FIT UR NEED
PORTS_OVERLAY_PATH = REPO_ROOT / 'pinned_ports'   # CHANGE TO FIT UR NEED

# VCPKG --assumed to be a submodule in repo root
VCPKG_PATH = REPO_ROOT / 'vcpkg'
VCPKG_EXE = VCPKG_PATH / 'vcpkg.exe'
VERSIONS_PATH = VCPKG_PATH / 'versions'
if not VCPKG_PATH.exists():
    raise FileNotFoundError(f"dir does not exist: {VCPKG_PATH}")

if not VERSIONS_PATH.exists():
    raise FileNotFoundError(f"dir does not exist: {VERSIONS_PATH}")

def get_git_hash_for_pkg_latest_version_patch():
    process = p.run([str(VCPKG_EXE), 'x-history', MISSING_PKG_NAME],
                    capture_output=True, encoding='utf-8', check=True)
    out = process.stdout
    print(out)
    out_lines = out.splitlines()
    out_lines_match_missing_pkg_version = list(
        filter(lambda line: MISSING_PKG_VERSION in line,  out_lines))
    version_and_hash_dict = {}
    versions_list = []
    for line in out_lines_match_missing_pkg_version:
        line_splitted = line.strip().split(' ')
        # no need to clean the mid spaces we only interseted in the first and last element
        version = line_splitted[0]
        version_git_hash = line_splitted[-1]

        version_and_hash_dict[version] = version_git_hash
        versions_list.append(version)

    latest_path_version = sorted(versions_list)[-1]

    git_hash = version_and_hash_dict[latest_path_version]
    print(f'selected {latest_path_version} : {git_hash}')
    return git_hash

def reset_vcpkg_ports_to_this_git_hash(git_hash):
    done = p.run(['git', 'checkout', git_hash, '--', f'ports/{MISSING_PKG_NAME}'],
                 # capture_output=False,
                 # encoding='utf-8',
                 check=True,
                 cwd=VCPKG_PATH)
    print(
        f'switched {VCPKG_PATH}/ports/{MISSING_PKG_NAME} to {git_hash} where it exists')
    # print(done.stdout)
    # print(done.stderr)

def copy_pkg_port_to_pinned_ports_dir():
    shutil.copytree(VCPKG_PATH / 'ports' / MISSING_PKG_NAME,
                    PORTS_OVERLAY_PATH / MISSING_PKG_NAME,
                    dirs_exist_ok=True)
    print(
        f'copied {VCPKG_PATH}/ports/{MISSING_PKG_NAME} to {PORTS_OVERLAY_PATH}')

def restore_vcpkg_ports_to_HEAD():
    p.run(['git', 'checkout', 'HEAD', '--', 'ports'],
          capture_output=True, encoding='utf-8', check=True, cwd=VCPKG_PATH)
    print(
        f'restored {VCPKG_PATH}/ports back to HEAD')

missing_pkg_version_git_hash = get_git_hash_for_pkg_latest_version_patch()
reset_vcpkg_ports_to_this_git_hash(missing_pkg_version_git_hash)
copy_pkg_port_to_pinned_ports_dir()
restore_vcpkg_ports_to_HEAD()


test pr 2

Codecov Report

Merging #202 into master will decrease coverage by 1.98%.
The diff coverage is 45.83%.

@@             Coverage Diff              @@
##             master     #202      +/-   ##
============================================
- Coverage     65.46%   63.48%   -1.99%
- Complexity     1258     1297      +39
============================================
  Files           141      141
  Lines          3918     3954      +36
  Branches        516      541      +25
============================================
- Hits           2565     2510      -55
- Misses         1212     1314     +102
+ Partials        141      130      -11

Impacted Files
Coverage Δ
Complexity Δ

.../chopchop/logic/edit/IngredientEditDescriptor.java
36.84% <0.00%> (-8.62%)
8.00 <0.00> (+2.00)
:arrow_down:

...n/java/chopchop/logic/edit/StepEditDescriptor.java
36.84% <0.00%> (+0.47%)
8.00 <0.00> (+4.00)

...in/java/chopchop/logic/edit/TagEditDescriptor.java
28.57% <0.00%> (-14.29%)
4.00 <0.00> (+1.00)
:arrow_down:

...pchop/logic/parser/commands/ListCommandParser.java
75.00% <0.00%> (+8.33%)
6.00 <0.00> (+1.00)

...java/chopchop/logic/edit/RecipeEditDescriptor.java
63.15% <22.22%> (+3.15%)
7.00 <2.00> (+6.00)

...main/java/chopchop/logic/commands/MakeCommand.java
17.02% <50.00%> (ø)
4.00 <2.00> (?)

...ava/chopchop/logic/commands/EditRecipeCommand.java
87.03% <72.72%> (+78.03%)
46.00 <0.00> (+42.00)

...in/java/chopchop/logic/commands/CommandResult.java
100.00% <100.00%> (+37.50%)
26.00 <4.00> (+14.00)

...pchop/logic/parser/commands/MakeCommandParser.java
100.00% <100.00%> (ø)
4.00 <0.00> (ø)

src/main/java/chopchop/ui/CommandBox.java
0.00% <0.00%> (-86.80%)
0.00% <0.00%> (-12.00%)

... and 39 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0a54309...2d87142. Read the comment docs.


Add a command to remove a model, sort them by size, usage, etc

done with -mm, no usage statistics yet but its much better now


Add SVG support to NFT Gallery

Fixes YOMO-489
React native does not seem to support SVGs by default, which means I've opted out to use react-native-svg to display remote SVGs.
react-native-svg however does not support blurRadius making it impossible to blur out the SVG when its moderation status is consent. In order to fix the blur issue, I've tried to use @react-native-community/blur but this library crashes when the blur view is rendered multiple times, as mentioned here https://github.com/Kureev/react-native-blur/issues/396.
The 2nd library with a blur API is @shopify/react-native-skia but requires RN >=0.66 and we're on 0.64.4.
Possible solutions

update RN to 0.66 and check if @shopify/react-native-skia works
use some service to convert SVG to png
use image placeholder if it's SVG and needs to be blurred

have you looked into expo blurview?

@wolverineks I've looked into their documentation, and they support iOS only, so I've ruled that one out. Unless we want to blur the SVG on iOS and show a placeholder on Android?

yeah, use a placeholder and let @stackchain know.

Isn't an update in the Podfile lock file?

@MichalSzorad I deployed the new version of blockies, yet, I think it's missing to add the same logic to the asset list to handle the svgs, can you check it?


Syntatic sugar for callable namespaces (functions as namespace)

I have a suggestion: I love to write callable namespaces but I don't want to write its name twice (one for function, one for namespace), so I propose a syntax sugar for this:
export namespace myFunc {
  (x: number) => square(2 * x)
  export const square = (x: number) => x * x
}

This should be equivalent to:
export function myFunc (x: number) {
  return myFunc.square(2 * x)
}

export namespace myFunc {
  export const square = (x: number) => x * x
}

Search Terms:
callable namespace syntax sugar

Related, but not sure if duplicate:
https://github.com/Microsoft/TypeScript/issues/21572
https://github.com/Microsoft/TypeScript/issues/15868

I would consider this a dupe of https://github.com/Microsoft/TypeScript/issues/15868.
https://github.com/Microsoft/TypeScript/issues/15868 is JS syntax, and no need to create new constructs if one already exists.

@mhegazy where is that syntax for function + namespace ?
can u post a link?

https://www.typescriptlang.org/docs/handbook/declaration-merging.html scroll down to about 2/3.
function buildLabel(name: string): string {
    return buildLabel.prefix + name + buildLabel.suffix;
}

namespace buildLabel {
    export let suffix = "";
    export let prefix = "Hello, ";
}


Add support for System.Text.Json

Why?

Performance
System.Net.Json is a built in

See docs
https://docs.microsoft.com/en-us/dotnet/standard/serialization/system-text-json-migrate-from-newtonsoft-how-to

I've pushed a branch up that starts work on this. Feel free to collaborate on it with me.
branch: https://github.com/Astn/JSON-RPC.NET/tree/SwitchToSystem.Text.Json

I've pushed a branch up that starts work on this. Feel free to collaborate on it with me.
branch: https://github.com/Astn/JSON-RPC.NET/tree/SwitchToSystem.Text.Json

Initial tests show this branch is almost 2x as fast the current approach.
Starting benchmark
processed 50 rpc in      0ms for         ∞ rpc/sec
processed 100 rpc in     0ms for         ∞ rpc/sec
processed 300 rpc in     0ms for         ∞ rpc/sec
processed 1,200 rpc in   3ms for         400,000.00 rpc/sec
processed 6,000 rpc in   11ms for        545,454.55 rpc/sec
processed 36,000 rpc in          83ms for        433,734.94 rpc/sec
processed 252,000 rpc in         686ms for       367,346.94 rpc/sec
Finished benchmark...


[SS-71] Create Contact Request Form

Contact request on submission create an object
{
"missionName":"M864",
"satelliteId":"1",
"orbit":"2",
"uplink":false,
"telemetry":true,
"science":true,
"aosTime":"2024-11-24T15:00:00",
"rfOnTime":"2024-11-24T15:00:00",
"rfOffTime":"2024-11-24T17:30:00",
"losTime":"2024-11-24T18:00:00",
"location":"Gatineau Quebec",
"satellite_id":"1"
}

Tasks Completed

[x] SS-70
[x] SS-71
[x] SS-72

Features Added

Connects to backend on form submission
On success/failure a toast is triggered and displayed for error handling
Satellite is a dropdown menu to choose
Error handling built into form, ex. When RF Time ON is after RF Time OFF an error is triggered via Zod.

Merged into [SS-65]


Everything with uv will be just right?

@zanieb: uv works just fine, and is fast. Thanks for helping us to resolve the issues re. dependency pinning.


Change 'npm install crosis4furrets' to 'npm i<EMAIL_ADDRESS>on the #README.md file

Hey @rayhanadev!
I've been checking crosis4furrets and it's so cool! I've been checking the #README.md file and the npm command to install crosis4furrest is npm install crosis4furrets. But on npm the command is  npm i<EMAIL_ADDRESS>Should the README.md be changed for this one?

Hi Hugo! Well the latest version of crosis4furrets that you should be using is<EMAIL_ADDRESS>not<EMAIL_ADDRESS>the latter is before I took crosis4furrets public :).
By using npm install crosis4furrets you automatically get the latest version 1.2.2 and this package follows SemVer so the latest version will always have the highest number :).
I think you might've followed an old link, the link to the newest version of the package (and Usage which might help) is always here.
Hopefully that answers your question, best of luck! :)

Thanks!


groupby performance degrades rapidly as column cardinality increases

Dask can perform groupby operations relatively well for columns with low cardinality, but performance seems to degrade significantly for columns with more distinct values.
Let's look at the h2o groupby benchmarks for some examples on the 1e9 dataset (contains one billion rows and is 50 GB on disk when stored as an uncompressed CSV file).
Let's query this dataset with a 16 node i3.large cluster (244 GB of cluster RAM total).  Here's a query that returns 10,000 distinct row groups (i.e. the result has 10,000 rows) and takes 37 seconds to execute.  Here's the notebook with complete details on how to build the software environment, the cluster info, all the code, etc.
ddf = dd.read_parquet(
    "s3://coiled-datasets/h2o-benchmark/N_1e9_K_1e2_parquet",
    storage_options={"anon": True, "use_ssl": True},
    columns=["id1", "id2", "v1"],
    engine="pyarrow",
)

ddf.groupby(["id1", "id2"], dropna=False, observed=True).agg({"v1": "sum"}).compute()

Here's a different groupby query on the same dataset that returns a million row groups.  I ran this query for a half hour or so and then it errored out with a KilledWorker exception.  Here's the notebook.
ddf = dd.read_parquet(
    "s3://coiled-datasets/h2o-benchmark/N_1e9_K_1e2_parquet",
    storage_options={"anon": True, "use_ssl": True},
    columns=["id3", "v1", "v3"],
    engine="pyarrow",
)

ddf.groupby("id3", dropna=False, observed=True).agg(
    {"v1": "sum", "v3": "mean"}
).compute()

Let's try to get this running by using the pyarrow[string] data type and by repartitioning first.  The pyarrow[string] dtype massively shrinks the memory footprint of the DataFrame from 224GB to 37GB.  This query still errors out with a KilledWorker exception.
ddf["id3"] = ddf["id3"].astype("string[pyarrow]")

ddf.repartition(200).groupby("id3", dropna=False, observed=True).agg(
    {"v1": "sum", "v3": "mean"}
).compute()

It's the same dataset and the same cluster, so it seems like the issue is caused by the cardinality of the groupby column.  I'm interested in hearing what other folks think is the root cause.  Let me know if there is any additional info I can provide to give you with more context.  I'm happy to take pictures of dashboards, look at logs, etc.

Thanks for raising this @MrPowers - I will certainly try to help with this effort.  Minor Note: You should specify index=False in your dd.read_parquet commands to avoid reading the unnecessary int64 "null" index into memory (you can also specify write_index=False when you write the dataset to avoid writing the "null" index).

Update: I downloaded the billion-record csv file to my local system and played with this a bit on a LocalCluster with a memory allowance similar to the h2o instance. I found it a bit challenging to get the default groupby(..).agg operation to succeed with the existing ACA-based groupby algorithm. It should work with smaller split_every settings and/or larger split_out settings.  However, the operation was significantly more stable when I redirected the aggregate method to use the groupby_agg function I added to dask_cudf a couple years back.  For example, the following code ran in ~3.5-4mins:
import time
import dask.dataframe as dd

from dask.distributed import LocalCluster, Client, wait

cluster = LocalCluster(
    local_directory="/.../dask-worker-space",
    n_workers=10,
    memory_limit="24GB",
)
client = Client(cluster)

ddf = dd.read_csv(
    "/.../h2o/N_1e9_K_1e2_single.csv",
    blocksize="250MB",
)
columns = ["id3", "v1", "v3"]
ddf = ddf[columns]
ddf["id3"] = ddf["id3"].astype("string[pyarrow]")
agg = ddf.groupby("id3", dropna=False).agg(
    {"v1": "sum", "v3": "mean"},
    split_every=4,
    split_out=1,
)

t0 = time.time()
result = agg.persist()
wait(result)
total_time = time.time() - t0

print(total_time, len(result))

Note that groupby_agg lives in dask_cudf, but it only uses cudf if the input data is a cudf.DataFrame.  The logic is backend agnostic, because I had originally intended to upstream the code to dask.dataframe. The only reason I didn't follow through with this plan was because light preliminary benchmarking suggested that the "optimized" code path offered little-to-no benefit for  Pandas-backed Dask-DataFrame. This particular example clearly suggest that my preliminary benchmarking was probably too light, and that the real benefit comes at scale.

FYI I had an incredibly great experience with pre-shuffle compression for high column cardinality problems, see https://github.com/dask/dask/pull/6259 I never had the time to finish this but the code is straight forward enough if somebody wants to pick it up and give it a try
This implementation was developed for of ETL pipelines that heavily relied on shuffling for parquet dataset repartitioning, see https://github.com/data-engineering-collective/plateau/blob/main/plateau/io/dask/_shuffle.py


[Trivial] Update EURe logo

As requested by Martin.
The image already exists in our folder structure, I'm surprised we are still referencing the old URLs in the json (isn't this risky if the assets disappear over there?). I can update the list if this is something that was just not yet done.

The image already exists in our folder structure, I'm surprised we are still referencing the old URLs in the json (isn't this risky if the assets disappear over there?). I can update the list if this is something that was just not yet done.

There is still a lot to improve in the list indeed, but we used up all the allocated time for working on this in the first quarter.

Oh, I completely missed this.
We have a develop branch and this PR should have been pointed there.
I'll update develop to keep both in sync

What is the purpose of the develop branch? Wouldn't it make more sense to simply merge everything into main and deploy on release?

and once ready merge to main/create the release.

Why would something be merged into develop but not ready to be released? And if, why can it not stay in main (what's the point of having main always be the most recent release tag)?
I know the frontend has this three tiered release process (and I was convinced it makes sense in that case because of some "last manual checks"), but I think for a lot of projects having a feature and a main branch is more sensible.

Hmm true.
I guess my reason for sticking to it is mainly because I'm used to develop->main cycle.
Thinking more about it, I can't find another argument in favor of keeping develop for this project.
@cowprotocol/frontend Anyone has a different opinion?
Otherwise let's remove develop and stick to main only for this repo.


Move KLDLoss into the spade network

The KLD loss is currently only used in one place in the codebase, by the SPADE network. It is also not the general KLD loss but just covers a special case: the loss between a univariate Gaussian and another univariate Gaussian with zero mean and unit std.
In anticipation of the port to MONAI Core, and given this loss does not seem to be more broadly useful in its current form, I propose moving it into the SPADE network file.
Does this sound sensible @ericspod ?

Sounds good to me!