state explicitly that const-items are copied bitwise

This certainly describes the current reality.
Cc @ecstatic-morse

As I noted on Zulip, I think we should leave this deliberately unspecified until we have a strategy for heap allocation in constants. I don't think we gain much by specifying this today? Although I guess this repo is non-normative, so explaining this as the current behavior would be fine.
Basically, the issue is around code like:
const ONE: Box<i32> = Box::new(1);

let a = ONE;
let b = ONE;

My intuitive understanding of const is that it behaves as though you copy-pasted the initializer everywhere the const was used, in which case this should compile. However, if bitwise-copies are used everywhere, obviously this code obviously must be rejected.

I don't think we gain much by specifying this today

I think we gain a lot in clarity.^^ The only reason this sentence isn't there already is that when writing this document, I considered it so obvious that it wasn't worth stating...

My intuitive understanding of const is that it behaves as though you copy-pasted the initializer everywhere the const was used

It behavs as-if but without actually doing that, that's the entire point. const would be rather useless if it was actual copy-paste... or at least the name would be quite the misnomer. There is nothing constant about them any more!

My understanding is that specifying that a const always uses bitwise copies means that, under all possible proposals for heap allocation in constants, the above example must fail to compile. Is this correct?
If so, then I think this should at least be discussed in rust-rfcs/const-eval#20 before a decision is made here. I'm not convinced that the previous example must be accepted, but I don't think it's outside the realm of possibility.

I expected that to be a constraint anyway, but I'll add a clause clarifying that this is current behavior.
And in any case, nothing in this repo is normative -- these are just docs.

@ecstatic-morse e.g., everything we say here is also just describing current behavior and could be changed if we wanted to.

True. In any case, we should try to reach consensus about this when @oli-obk is back from vacation.
I would r+ the new changes if I had the permissions btw.

I would r+ the new changes if I had the permissions btw.

That sounds good enough for such a small change. ;)


Scoped CSS with :global

I've been having trouble getting certain CSS to output correctly. It works really great when setting styles for classes within the template, but to set styles that will affect  child content, it's not so easy/impossible.
I am using the scoped functionality (which is awesome).
In webpack's css loader there is an option for scoped styles where you can put :global before the selector to make it global. It also allows doing something like .something :global( .else ) and it would output something similar to .something[data-v-234] .else {}.
More info here: https://github.com/webpack-contrib/css-loader#css-scope
Currently I am putting all of these rules into a new stylesheet file and just doing a raw require() call to it from within my component file. It'd be great to be able to include all of the styles for the component in one stylesheet, though.
I think the easiest would maybe be to allow just putting :global at the beginning of the line.
.name {
  color: red;
}
:global .title {
  font-weight: bold;
}

Would generate:
.name[data-v-5] {
  color: #f00;
}
.title {
  font-weight: bold;
}

It'd be really great to have support for doing the sort of "scoped" global selector where you can wrap a piece of the selector with :global(), but that may just be totally out of scope.
What are your thoughts on something like this?

Looks nice. But I'm not so much familiar with CSS transformation (using postcss), so it would not be implemented soon. If you would like to implement it, PR is welcome.

How is this handled when using vue-loader inside .vue files ?

Just realized that there is an issue in the vue-loader for this exact thing. I guess we'll wait to see what they do: https://github.com/vuejs/vue-loader/issues/661

Implemented via #32. I'll release it after writing docs.

I just realized there is a standard combinator >>> in Shadow DOM for the purpose of this use case. I've replaced :global with >>> and released it.
Here is the docs

Whoa, this is great! Thanks a bunch for implementing it. I had actually tried my hand at it for a few hours one day and didn't get very far. =P


Make ResourceRef in PipelineResourceBinding consistent with TaskRun

Changes
In TaskRun, TaskRef can be nil, which was not the case for
PipelineResourceBinding (and ResourceRef). This fixes that by making
the two consistent.
Very similar to #1495
Signed-off-by: Vincent Demeester<EMAIL_ADDRESS>Submitter Checklist
These are the criteria that every PR should meet, please check them off as you
review them:

[x] Includes tests (if functionality changed/added)
[ ] Includes docs (if user facing)
[x] Commit messages follow commit message best practices

See the contribution guide for more details.
Double check this list of stuff that's easy to miss:

If you are adding a new binary/image to the cmd dir, please update
the release Task to build and release this image.

Reviewer Notes
If API changes are included, additive changes must be approved by at least two OWNERS and backwards incompatible changes must be approved by more than 50% of the OWNERS, and they must first be added in a backwards compatible way.

/test pull-tekton-pipeline-integration-tests

/lgtm

/hold cancel

/test pull-tekton-pipeline-integration-tests


Allow multiple commands for table selection

Fixed compilation failure

@nmirasch this is actually duplicating another PR, see: https://github.com/droolsjbpm/jbpm-console-ng/pull/455
If you can +1 that one I can merge it.

Sorry, I meant https://github.com/droolsjbpm/jbpm-console-ng/pull/452

@cristianonicolai  sorry!


Do not create a volume when a parent directory is bind mounted from the host already.

I'll need to think about the implications of the change.

yeah, I'm not sure about it either. It sounds reasonable to not create two volumes when one is the child of the other, but I dunno.

After a quick chat with @crosbymichael, we've decided that the current code is working as expected. I'm closing this PR, and the issue soon.


updating so that we continue to use ikm.dev module naming and wrap caching-api are used

note that mostly this is moving the module names back, adding the caching-api (and undoing the exclude).  While I was in there, I blew away the Jenkins files (unneeded) and refactored the gitignore files.  Please take a look and you can see what we want to do to use this.  I'll continue updating/testing, but wanted to get this to you quickly so you could see the desired state.

Please @jlgrock , can you update:

pom.xml of commons-text
https://github.com/Sandec/jpms-deps/blob/19c58ba36571446b3a5294fa96060220c9651465/commons-text/pom.xml

Line:29
<apache-commons.version>3.17.0-r1</apache-commons.version>

pom.xml of hapi-fhir-r4
https://github.com/Sandec/jpms-deps/blob/19c58ba36571446b3a5294fa96060220c9651465/hapi-fhir-r4/pom.xml

Line:30
<hapi-fhir-utilities.version>6.3.3-r8</hapi-fhir-utilities.version>
Line:163
requires dev.ikm.jpms.commons.lang3;

pom.xml of hapi-fhir-structures-r4
https://github.com/Sandec/jpms-deps/blob/19c58ba36571446b3a5294fa96060220c9651465/hapi-fhir-structures-r4/pom.xml

Lines: 29-30
<hapi-fhir-utilities.version>6.3.3-r8</hapi-fhir-utilities.version>
<hapi-fhir-r4.version>6.3.3-r9</hapi-fhir-r4.version>
Line: 179
requires dev.ikm.jpms.org.hl7.fhir.r4;

Sorry about the slow turnaround.  I corrected, though the last one (179) was a different mistake, because the org was still in there.  I have adjusted in the h4 pom

In recent commits, the module names dev.ikm.jpms.org.hl7.fhir.r4 and dev.ikm.jpms.org.hl7.fhir.utilities have been aligned with those used intinkar-core.
Here is an example of a module-info.java class from tinkar-core:

It appears that the same naming structure of the original artifacts has been maintained:

All tests have passed, and the changes are ready to be merged.

I have just tested everything on my system too and I confirm all works now. We can proceed to merge at this point 🙂.
Thank you Justin.


Non row-scope pure sync nodes should always be allowed by jelopezf

Helping Jesus to port his change.
https://github.com/microsoft/Power-Fx/pull/1445

✅ No public API change.


Fix path issues

Mostly on Windows, but also on other platforms, when BUILDCACHE_DIR env variable is used.

This branch is based on no-impersonate (it's hard to use separate branches when the dist directory is part of the repo :/)

I'm going to close the original PR on impersonation as I don't think it's reasonable to untangle them, and it can ride in on this PR. If I'm mistaken in some way, can always reopen it

Some linting issues at minimum, react-native run still going

2 minutes, I'll fix the prettier issues.

These are actually more serious - I'm not sure exactly how to fail the react-native compile test based on this type of failure (I did not spend much time investigating though, TBH - I just visually inspect), but there's a problem here
https://github.com/mikehardy/buildcache-action/pull/34/checks?check_run_id=3125987994#step:27:20

Warning: buildcache: unable to upload buildlog: Error: File ../custom_buildcache.log does not exist
Warning: buildcache: unable to delete buildcache.log Error: ENOENT: no such file or directory, unlink '../custom_buildcache.log'
buildcache: saving cache with key "buildcache-react-native-compile-2021-07-21T16:28:25.384Z".
Warning: buildcache: caching not working: AssertionError [ERR_ASSERTION]: Invalid pattern '../custom_buildcache_dir'. Relative pathing '.' and '..' is not allowed.

Dang. The error I noted has been happening quite some time, it is unrelated and not a regression on this PR.

I suppose the intent was to use a directory relative to github workspace. This can be done by detecting that the path is relative, and the using path.resolve with the workspace as base.

If this build passes (with the error that is not a regression) I'll merge as is, it's solid incremental progress regardless I think.
If you want to fix that too I would obviously be thrilled but is not gating this

I'll try. :)

This is merged now so it's a clean base on main branch again at least

Thank you.


Support VK_EXT_custom_border_color

The upcoming Vulkan backend for the Citra emulator uses VK_EXT_custom_border_color to implement border colors on the guest system GPU. Without the extension some games experience noticable visual glitches, so it would be ideal if this could be implemented in MoltenVK.
Metal seems to have a property for this: https://developer.apple.com/documentation/metal/mtlsamplerdescriptor/2092299-bordercolor

Metal seems to have a property for this: https://developer.apple.com/documentation/metal/mtlsamplerdescriptor/2092299-bordercolor

That's for the fixed "Model T-style" border color that is already supported in base Vulkan 1.0. Custom border colors need an undocumented SPI.

Ah, I misunderstood the docs on that as examples and didn't realize there were only 3 possible fixed values. That's unfortunate.

We managed to implement an emulated version of what we need in shaders. Will leave this open though as it could be a useful extension for others.


Remove Node 12 support

Dropping a Node.js release line should be considered a semver major change.

BTW, we have a stray #if for node version > 8 in heap.cc; we could get rid of that as well.


[1.4.0] Fragment line height set to 0 by obsolete class

https://github.com/jothepro/doxygen-awesome-css/blob/main/doxygen-awesome.css#L882
The line height is then overruled by setting the individual lines' height with the new variable a few lines further down. Is there a special reason the line height is first set to 0 for the fragment and then the lines are set to something else?

div.fragment {
    line-height: 0;
}

(L883) sets the line height of the fragment container for fragments that define a span for each line, while
div.fragment .line, pre.fragment {
    line-height: var(--fragment-lineheight);
}

(L893) sets the line height for the separate lines & pre fragments, which are fragments without separate spans for each line. So I don't see anything being overriden here. Am I missing sth?

I hope this image helps to understand whats going on:

L883 sets the green line height to 0, so there is no spacing between the diffs.
L893 sets the blue line height, which is the real spacing between text lines.

As I am looking at my own drawing I am starting to realize that my idea of a line height may be a bit wrong, as it is not equivalent with the space between lines. The key problem was that the line heights of the .line divs and the fragment added up somehow, which lead to the huge space between lines that you also observed in #9 .

I removed the obsolete line-height: 0 override. This will be included in the next release.


correct way to handle "SQ ring full" state

Hi,
suppose io_uring_get_sqe() returned NULL .  My ring is running without IORING_SETUP_SQPOLL flag.
What are my options?

Does io_uring_enter call with min_complete=1  ensure that SQ is offloaded?
Can SQ get full just because I have not called io_uring_enter() quickly enough, thus did not allow kernel to offload SQ ring?

You can either wait for something to complete, or you can explicitly wait for SQ ring space with IORING_ENTER_SQ_WAIT
Right, the sq thread will only poll it's running. If it's gone to sleep it'll need a syscall to wake it up, and if that is the case, then it's quite possible to fill the SQ ring and get NULL returned on grabbing a new sqe. That's also possible in case the thread is running, as filling in new entries is faster than getting them submitted (more work is involved there, vs just writing out 64 bytes to memory).

Hope that helps!

Thanks. based on https://man.archlinux.org/man/io_uring_enter.2.en it seems that IORING_ENTER_SQ_WAIT is applicable only for IORING_SETUP_SQPOLL rings.

Heh, I totally read your initial message as "with SQPOLL". What I wrote applies to SQPOLL being enabled. If you're not using SQPOLL and you get a NULL return when trying to get an sqe, then you already filled in all your entries. The only sane course of action there is to either increase the size of the sqring when you set it up, or just submit whatever you already have pending and then retry the sqe get. It'll succeed once you have the kernel consume entries from it.

Thanks!

Extra clarification,
Getting single sqe is simple enough you can do it something like:
https://github.com/YoSTEALTH/Liburing/blob/master/liburing/helper.py#L156
Multiple sqes can be tricky, this is how I went about it:
https://github.com/YoSTEALTH/Liburing/blob/master/liburing/helper.py#L118

Thanks @YoSTEALTH  lets see if it's possible to improve the API so that it we won't need to do busy waits.
@axboe  I would like to get to bottom of this. Here is a specific scenario that I am failing to understand:

I run io_uring without SQ_POLL of size 256.
the flow just unloaded bunch of completions (64 of them) and called io_uring_cq_advance(&ring_, cqe_count);
The sq ring is full, i.e. io_uring_sq_ready(&ring_) returns 256.
I call sys_io_uring_enter(ring_fd, 256, 0, 0, NULL); but it returns -1 (EBUSY).

Questions:

Why after I advance kernel cq->khead and I context switch into kernel, it does not unload sq ring? I suspect that it's because unloading CQ does not immediately mean that the submit buffers become available. Just want to confirm it.
I appreciate the asynchronous nature of io_uring API, however, it seems that there are corner cases when blocking behavior can be helpful. For example, here I try to model periodic timer event. When it's fired, its callback function recharges it back using IORING_OP_TIMEOUT opcode. If I am not able to allocate an sqe from the callback function I can not continue with my flow. My basic axiom is: it is possible to allocate a single sqe from the completion callback because if completion callback runs it means I removed a single item from CQ buffer. So as long as I do not allocate more than a single entry it should work.  Maybe it make sense to use  IORING_ENTER_SQ_WAIT for non SQPOLL rings as well?
If not, how you would manage back pressure here?

@romange, it looks you get EBUSY, because there is a backlog, i.e. overflowed completions.
https://elixir.bootlin.com/linux/v5.12.19/source/fs/io_uring.c#L6667
So, you previously submitted so many requests that after they had completed, io_uring didn't find place in CQ to fit them, and so they got stashed internally. In this case it expects you to reap CQEs (including io_uring_cq_advance) and do sys_io_uring_enter again, so those overflowed completions got placed into CQ, and you can process them.

iow, you can do:
ring = create_ring(sq_size=8, cq_size=8);
submit(8);
submit(8);
submit(8);

And submit might not return any errors, requests will be inflight. Then, they will complete, 8 would be placed in CQ, and 16 CQEs stashed internally, so you would need to enter the kernel to get them.
And that check leading to -EBUSY was deleted in 5.13, so since 5.13 it won't return EBUSY in this scenario.

Oh, that's good to know! Thanks, Pavel. I could rearrange my code and fix periodic timer implementation so it would be recharged after I unload all completions including stashed ones. However, in general, that check prevents CQE callbacks from submitting new requests, which is problematic, imho.

Why after I advance kernel cq->khead and I context switch into kernel, it does not unload sq ring? I suspect that it's because unloading CQ does not immediately mean that the submit buffers become available. Just want to confirm it.

Because, there are overflowed CQEs and the kernel expects you to reap them (via entering the kernel with waiting first), a kind of backpressure. You won't get the error for kernels 5.13+, because it sounded inconvenient indeed. But that change depends on some other features in 5.13, so I'm not sure can be backported to older kernels.

I appreciate the asynchronous nature of io_uring API, however, it seems that there are corner cases when blocking behavior can be helpful. For example, here I try to model periodic timer event. When it's fired, its callback function recharges it back using IORING_OP_TIMEOUT opcode. If I am not able to allocate an sqe from the callback function I can not continue with my flow. My basic axiom is: it is possible to allocate a single sqe from the completion callback because if completion callback runs it means I removed a single item from CQ buffer. So as long as I do not allocate more than a single entry it should work.  Maybe it make sense to use  IORING_ENTER_SQ_WAIT for non SQPOLL rings as well?

If we forget about EBUSY for now, sys_io_uring_enter(submit=N) tries hardest to submit those requests, so you wouldn't need to SQ_WAIT but just to submit requests. Thus I'd say it's not needed and the responsibility is on the userspace, especially considering that it already should be accessing SQ in a synchronised way (or single-threaded).
I'd say there is no so direct link between number of CQEs and SQEs queued, but the remedy is again to submit if SQ is full.

Oh, that's good to know! Thanks, Pavel. I could rearrange my code and fix periodic timer implementation so it would be recharged after I unload all completions including stashed ones.

Great

However, in general, that check prevents CQE callbacks from submitting new requests, which is problematic, imho.

Pretty much agree, it's much better to be able to freely submit (if there is place in SQ), and that's the behaviour since 5.13.

Was thinking whether we can backport it, but apart from simply taking
https://lore.kernel.org/io-uring/20210416232837.EpkCt1h-_Fk1PTRiQA92ifC9l5pNLc2vk84GqYJcJJc@z/
would need the one below to be taken, and doing so looks too error-prone for stable (considering differences in code bases).
<EMAIL_ADDRESS>

It's fine really. We focus here on the edge case where ring buffers are not enough to handle the expected traffic. The workaround for older kernels exists  - to increase the ring size. I will still try to fix my lib to be more robust with < 5.13 kernels but if the layer above my lib will allocate SQEs in its completion callbacks it might crash the process when EBUSY is returned.

Yes, thank you!


Invitations don't work in production

Look at the logs and see what's happening. My guess is that email isn't setup.

actually, email just sucks so i'm not going to fix it


Default column sorting for the Table component

Prerequisites

[X] I have searched for duplicate or closed feature requests
[X] I have read the Modus style guidelines

Proposal
Expose a property to set a default column to be used to sort the data
Motivation and context
No response
What is the issue regarding ?
@trimble-oss/modus-web-components
Priority
Low
What product/project are you using Modus Components for ?
Trimble Inspections
What is your team/division name ?
Camaleão/Transportation
Are you willing to contribute ?
Yes
Are you using Modus Web Components in production ?
No response

Pr Merged. Closing


[Bug] No cuda.so for the 70b llama-2

There isn't a Llama-2-70b...-cuda.so among prebuilt binaries which seems required to run the 70b model.

Please see #584

Closing due to inactivity. Feel free to open a new issue!


Added ComputePipelineDescriptor

Objective
Fix ComputePipelineDescriptor missing from WGPU exports
Solution
Added it to the pub use wgpu::{ ... }

Also added ComputePassDescriptor, as that was missing too

bors r+

bors retry


[FLINK-9234] [table] Fix missing dependencies for external catalogs

What is the purpose of the change
This PR adds the required dependencies commons-logging (via slf4j) and commons-collections to flink-table. They are required for the deprecated external catalog discovery.
Brief change log
Modified pom.xml.
Verifying this change
Manually verified.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): yes
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: no
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? no
If yes, how is the feature documented? not applicable

@zentol @EronWright would be great if you could verify my changes

The Flink code doesn't need the jcl dependency but if commons libraries want to log something we should make this possible, right? Good point @zentol. I will verify the logs again.

Can we actually get rid of commons-configuration in the table API?
All the commons packages with their weird long tail of not properly declared dependencies have become a bit of an anti-pattern to me over time...

encountered same issue.

encountered the same issue, any progress on this?

any progress on this?

Forwarding some comment from @fhueske from JIRA:

I tried to reproduce this issue for 1.5 but it seems to work.
Flink 1.5 should be out soon (release candidate 2 was published two days ago). We can merge a fix for 1.4, but would need to wait for 1.4.3 to be released before it is publicly available (unless you build from the latest 1.4 branch).
commons-configuration is used for the external catalog support that was recently reworked for the unified table source generation. The code that needs the dependency was deprecated. I think we can drop the code and dependency for the 1.6 release.

That means we should merge this into release-1.4 and release-1.5. In master, we could merge this, but should probably simply drop the pre-unified-source code.

From my side, +1 to merge this to release-1.4 and release-1.5.

Thanks, @StephanEwen.
I will later merge this for release-1.4 and release-1.5. Should we merge it for master as well and create a JIRA to drop the deprecated code? That would ensure we have the fix in 1.6 as well in case we don't drop the code for whatever reason.

Agreed, let's add it to master as well...


Put Codecov into informational mode

Fixes #2528

Codecov Report

Merging #2542 (cfe425c) into develop (fd1913a) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           develop    #2542   +/-   ##
========================================
  Coverage    39.90%   39.90%
========================================
  Files           21       21
  Lines         1629     1629
========================================
  Hits           650      650
  Misses         979      979

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fd1913a...cfe425c. Read the comment docs.

Great! Thank you so much!


System.ComponentModel.Win32Exception (5): An error occurred trying to start process

Using the suggested name for the project with a . is causing the following error when trying to run the project later:
dotnet new console -o App -n NetCore.Docker
dotnet run
System.ComponentModel.Win32Exception (5): An error occurred trying to start process '<root>\App\bin\Debug\net6.0\NetCore.Docker.exe' with working directory '<root>\App'. Access is denied.
   at System.Diagnostics.Process.StartWithCreateProcess(ProcessStartInfo startInfo)
   at System.Diagnostics.Process.Start()
   at Microsoft.DotNet.Cli.Utils.Command.Execute(Action`1 processStarted)
   at Microsoft.DotNet.Cli.Utils.Command.Execute()
   at Microsoft.DotNet.Tools.Run.RunCommand.Execute()
   at Microsoft.DotNet.Tools.Run.RunCommand.Run(String[] args)
   at Microsoft.DotNet.Cli.Program.ProcessArgs(String[] args, TimeSpan startupTime, ITelemetry telemetryClient)
   at Microsoft.DotNet.Cli.Program.Main(String[] args)

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4c7470d2-9a57-7654-e13a-4f912898f7aa
Version Independent ID: 58d57b81-4ca6-6536-8788-f212402b41a7
Content: Containerize an app with Docker tutorial - .NET
Content Source: docs/core/docker/build-container.md
Product: dotnet-fundamentals
Technology: dotnet-docker
GitHub Login: @IEvangelist
Microsoft Alias: dapine

Hi @iRejish, you're getting an access denied error. I do not believe it has anything to do with the . in the file name. In fact, that error itself shows that the file name correctly.
System.ComponentModel.Win32Exception (5): An error occurred trying to start process '<root>\App\bin\Debug\net6.0\NetCore.Docker.exe' with working directory '<root>\App'. Access is denied.
   at System.Diagnostics.Process.StartWithCreateProcess(ProcessStartInfo startInfo)
   at System.Diagnostics.Process.Start()
   at Microsoft.DotNet.Cli.Utils.Command.Execute(Action`1 processStarted)
   at Microsoft.DotNet.Cli.Utils.Command.Execute()
   at Microsoft.DotNet.Tools.Run.RunCommand.Execute()
   at Microsoft.DotNet.Tools.Run.RunCommand.Run(String[] args)
   at Microsoft.DotNet.Cli.Program.ProcessArgs(String[] args, TimeSpan startupTime, ITelemetry telemetryClient)
   at Microsoft.DotNet.Cli.Program.Main(String[] args)


Action based message extension with SSO

Steps to reproduce
Copied from: https://github.com/OfficeDev/teams-toolkit-samples/issues/1284
Details:
I'm implementing an action-based message extension (three dots on the message in a chat).
How can I add SSO in order to get the user token in the TeamsActivityHandler methods?
The example for search-based message extension shows how to do it (handleTeamsMessagingExtensionQuery and handleMessageExtensionQueryWithSSO), but there are no examples on how to do it with action based methods (handleTeamsMessagingExtensionSubmitAction).
Thanks!
Expected behavior
NA
Actual behavior
NA
Error details
No response

@jamzi - Could you please let us know if this comment resolved your issue? https://github.com/OfficeDev/teams-toolkit-samples/issues/1284#issuecomment-2298031280


Update date.md

@szarnyasg  follow up on https://github.com/duckdb/duckdb-web/pull/4206 can be merged too now

Thanks!


Remove default impl from transaction version

There is no logical default for the transaction version number, there is only pre-bip68 (v1) and post-bip68 (v2). Uses should specify the version they want not rely on us making the choice.
(I originally added this impl to support testing, this was in hindsight the wrong thing to do, props to Sanket for noticing.)
Discussed in comments here: https://github.com/rust-bitcoin/rust-bitcoin/pull/2006#issuecomment-1732385464

@clarkmoody where have you been all my life, review 40 minutes after creating the PR, I love it!

There is no logical default for the transaction version number

FWIW I think "the latest" is a reasonable default, it's just that it changes every decade or so and we're worried that this decade's change is fairly soon :).
Will ACK in a sec.

There is no logical default for the transaction version number

FWIW I think "the latest" is a reasonable default, it's just that it changes every decade or so and we're worried that this decade's change is fairly soon :).

Oh ok, but we still don't want to reimplement it after v3 comes out, right? Otherwise we have the same problem waiting to happen 10 years later the we will almost certainly forget about?

Eh, I think it'd be fine to add a v3 default, then remove it for a version or two in ten years (to alert everybody that they may need to update their code), then putting it back for v4.
I also don't actually think there'll be a v4, in ten years or ever ;).


Fix contentEditable definition

It has always been a string and not a boolean, and is being extended with new values in a W3C proposal, which now fail the check.
isContentEditable, on the other hand, is a boolean but was defined without a type.

Imported for internal testing. Created internal issue b/124236940.

@tjgq Is this looking good now? I'm not sure what's going on on the CI...

I don't think the Travis failure is related to this PR. Let's ignore it for now.
This version is looking a lot better in internal testing. There are still a couple of internal projects that need fixing, but I expect to be able to submit it before the end of the week.

Sounds good, thanks. Out of curiosity - what are the cases still failing looking like?
For the initial version I expected just smth.contentEditable = true and similar to be popular enough to be a problem, but for the new one it seems trickier to trigger...

The problem is with isContentEditable, not contentEditable. It has to do with the fact that ? (the unknown type) is contagious, and can be legally used in place of another type.
So if you have a return statement like return str && element.isContentEditable, and the function where it appears is @return {boolean}, the code type-checks before your changes (the type of the entire expression is ?, since isContentEditable was ? by omission), but not after (the type of the expression becomes string|boolean).
Fortunately, it's pretty easy to fix by rewriting the code as return !!str && element.isContentEditable.

Ah ok, that makes sense, thanks for explanation.


Adds a tutorial for single/two qubit heatmaps

Adds a tutorial for single / two qubit heatmaps

Automerge cancelled: A status check is failing.


Use message routing to input data

Is there a way to use the standard message routing between modules to store the data? Ultimately I would like Edge Streaming Analytics to output directly to the IoT Edge Storage Module (no coding necessary). Can we define an input on this module?
Another question I have is if it is possible to configure the module with a default container so one doesn't have to do so manually (or does it have the smarts to create missing containers if it doesn't exist).
I would like the deployment of this module to be code free in this case so the Edge Streaming Analytics can output data directly to a container in the local storage module (which in turn will synchronize with the configured container in the cloud)

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 07a44a28-a19c-f68e-167c-5e8ad91605e0
Version Independent ID: 33eacdff-4f0a-c543-d8f9-e7b208bab015
Content: Store block blobs on devices - Azure IoT Edge
Content Source: articles/iot-edge/how-to-store-data-blob.md
Service: iot-edge
GitHub Login: @arduppal
Microsoft Alias: arduppal

This module does not support message routing.
Please provide us feedback how would you like to see the messages store in blob?
do you want separate blob for each message? or do you want any extension associated with these messages when they are stored as blobs?
No, today one has to specify at-least the source container name for deviceToCloudUpload feature to work

Thank you so much for the clarification :)
I think it would be great if messages were individually stored as blobs. In the configuration of the module (twin), to be able to define an initial container with a specified name - it would behave with the CreateIfNotExists behind the scenes.  Then for message routing be something like this:
"telemetryToStorage": "FROM /messages/modules/{streamanalyticsmodule}/outputs/* INTO BrokeredEndpoint("/modules/{storagemodulename}/inputs/")
Thank you for your reply :)

@codingbandit- Thank you for the feedback.

I appreciate you listening - thank you :) Cheers to the future of Storage on Edge :D


Port and run runtime tests

Port and run the test in the runtime directory:

As part of this investigation we might discover missing functionality or expose functional issues in the current implementation. Separate work items may be added to track compiler work required to complete this task.

Let's not close this yet. I have post merge review comments to PR #227. Want to ensure we have issues to track failing tests cases skipped by that PR.


CSP security issue due to it being ineffective

As it currently stands, the CSP is ineffective at preventing XSS issues due to having unsafe-inline and unsafe-eval in the script-src directive. The way to fix this would be to have all

It would just need translating over to php code etc


MAINT: Documentation update based on feedback

Using tuples in our example as per feedback.
Further clarified information on what inputs are supported.
Issues

https://github.com/MetOffice/improver_suite/issues/2214

@mo-robert-purvis - this hopefully addresses some of the troubles you had.

@mo-robert-purvis - this hopefully addresses some of the troubles you had.

Looks good. Thanks.


postgres db is up  but pgadmin can't connect with error Connection Refused

Hi
i just used docker compose up -d
when i want to add server i get below error
**
can anybody help me ? thanks

Use postgres as hostname.  #https://github.com/khezen/compose-postgres/issues/6
Use internal Ipv4 of the pgAdmin container #https://stackoverflow.com/questions/53610385/docker-postgres-and-pgadmin-4-connection-refused

@MyroslavBoiko  Thanks


Notification of Twitch stream go-live

When a Twitch user goes on stream, notify a target channel with a link to stream
Support for configuration of multiple users

This issue should be configured per-server, so it will be done after #44.
I was going to delay detailed-helptext for this, but I suppose I could go kick off an integration branch, on the off chance that @JunhaoSLi and @magix430 actually intend to finish their tasks on that front someday... I'd rather not release a new prod build with half of detailed-helptext and live-reconfig both in place though.


Find occurances of problematic language in this repository

Acceptance criteria: issues created to remove/update source codes and documentation to avoid problematic language

Nothing like this has been detected in this repository -> closing this issue.


Optimize docker dev setup

streamline the gem install process to the docker image build and re-use these via named volumes, https://docs.docker.com/storage/volumes/#populate-a-volume-using-a-container
This allows all gems to be cached between image building / manual install in the container for reuse and avoids the cost of installing gems on boot.
Review checklist

[ ] First, the most important one: is this PR small enough that you can actually review it? Feel free to just reject a branch if the changes are hard to review due to the length of the diff.
[ ] If there are any migrations, will they the previous version of the app work correctly after they've been run (e.g. the don't remove columns still known about by ActiveRecord).
[ ] If anything changed with regards to the public API, are those changes also documented in the apiary.apib file?
[ ] Are all the changes covered by tests? Think about any possible edge cases that might be left untested.

So I guess this means that right now, scaling pods does a full bundle install for each container started. And since updating the Gemfile would mean a merge, it would rebuild the container and the volume's cache, as well. Nice. Just a quick question about the docker-compose.yml contents.

Not quiet - it only runs bundle install if it's in dev mode not production / staging. So this is amied at improving the development with docker / compose lifecycles like installing new gems, etc.
https://github.com/zooniverse/Panoptes/pull/3243/files#diff-649fa42c6639e33e18d4d15d8ab1a053R15


Fix broken link in README and minor edits.

Description

The link to the docs for building the package are broken due to case sensitivity.

lgtm. The commit message looks good.


Mapping Color Config Semantics

I wanted to create a simple script that maps the colorspace and pixel format values from MediaInfo to several video encoders that use slightly different syntax. Please see the subsection 6.4.2, 6.7.3, and 6.7.4 of the AV1 Bitstream & Decoding Process Specification. Is there any documentation clarifying this? FFmpeg for example provides a list of values for supported pixel formats, color_primaries, color_trc, colorspace, and color_range: https://ffmpeg.org/ffmpeg-codecs.html#Codec-Options

For the moment it is only in https://github.com/MediaArea/MediaInfoLib/blob/master/Source/MediaInfo/Video/File_Mpegv.cpp#L33-L99

Thank you! This was exactly what I was looking for!


Update settings.xml

Prepare WebGUI in Plugin to accept E-Mail-Adresses for Whitelisted E-Mails.

What about templating?

What about templating?

If I am right this is already there in #3611 .
https://github.com/opnsense/plugins/pull/3611

No, in #3611 you define a local file which is not templated, I thought it's already there.
Now you create a form where you can add adresses without a model and without a file where those settings gets written for rspamd.
Maybe you want to open a feature request with alle the things you need and we work on a complete PR together?

Yeah, you are right. I need more "practice" in this. I will create a feature request for rspamd-Plugin....


Add Pricing and Support page in Zerodha

Is your feature request related to a problem? Please describe.
Pricing and Support page are missing in Zerodha Clone
Describe the solution you'd like.
I want to pricing and Support page
Describe alternatives you've considered.

Add any other context or screenshots about the feature request here.
No response

/assign


Log in functionality

The task is to provide simple log-in functionality for authentication purposes.

 Add log-in panel


Firefox reports loading fonts multiple times

I'm seeing an issue in Firefox 43.0.4 where the network tab shows 3 requests for each font loaded from Google. Chrome & Safari latest don't have this problem. I've tried using webfontloader version 1.5.18 & 1.6.20; the issue occurs in both.
I'm not sure if this is an issue with Firefox's Dev Tools, Google Fonts or webfontloader. I have a hunch it's Firefox, but I just want to make sure.
My webfontconfig:
WebFontConfig = {"google":{"families":["Open Sans:normal,bold,italic,bolditalic"]},"typekit":{"id":"kxz1dcg"}};

Firefox:

Chrome:

I'm having the same issue.  Both Firebug, and FF's built-in inspector show up to 16 times more font loads than Chrome.
Is this really loading the fonts more, or is it a false indicator in the inspector window?

I can't reproduce this in the latest Firefox version, so I'm guessing it was a temporary bug.

Hmmm.. I'll keep an eye out, but it's still occurring for me in Firefox 43.0.4.

Still happening for me in Firefix Developer 46.0a2. FF makes 12 requests while Chrome make just 3 requests for http://fonts.googleapis.com/css?family=Lato:300,400,700

Also we just noticed this while debugging today. On changing font css properties, Firefox makes new request.

Found on Chrome (Version 51.0.2704.103 (64-bit)) that each time WebFont.load() is called the number of request would increase by 1.
Calling the first load only fires 1 request, 2 for the 2nd, etc.
However when I tried with Safari it seems fine. Only 1 request no matter what.

I see this in 2024, in Firefox 127. This site, which seems to have nothing to do with typekit:
https://www.meredithfrederickart.com/


It will crash if you change the mod settings.

Minecraft version
1.20.1
Describe the bug
I changed the settings of the midnightcontrols mod and it crashed when I started the game again.
Steps to reproduce
1.The first step is to install midnightcontrols and start the game
2.Go to Key Binds and there will be a game joystick icon next to it. Click on it and change a setting called Virtual Mouse.
3.Then restart the game and it will crash
...
Logs
No response
Additional context
No response

I use google translate and if something looks weird that's why

Closing as stale / cannot reproduce.
If you can provide the necessary logs and information to reproduce the problem or identify the faulty mod, please open a new issue with all necessary details.


Correct internal cross-references when splitting the markdown file

It would be great if mdsplit could also fix markdown cross-references like  [text](#target) (where target is a link to an internal heading) if link and target are no longer in the same file.
Same goes for relative image links in the input markdown that are no longer valid in the split output markdown.

That's a good suggestion, but as I have no time to work on mdsplit I can not implement it myself.
If somebody wants to implement it: I guess a 2-pass approach would make sense since now the splitting process streams the file (and can thereby handle extremely large files without problems since only a few lines are kept in memory at a single time). So resolving the links would definitely require either a change to the streaming approach or a post-processing step.


functions don't work on results of sub-subqueries

Bug report
System info: 1.2.0
Steps to reproduce:
I have this query:
select count(v) from (select sum as v from (select sum(value) from "some.metric" where person='michael' and time > 0 group by time(1d)) where sum<5000)
I would expect it to show me the number of rows in some.metric where the person tag was michael and the value of the 1-day sum was < 5000.  It always returns nothing.  There are no errors logged.
If, however, I remove the count on the outermost query, I get back N rows of data, as expected.  Ditto for sum or mean on that outermost query.

This is an issue with the condition so, since the condition isn't getting applied correctly, I think it's likely filtering out all of the rows because everything wrongly evaluates to false.

Any progress on this issue? Currently using version 1.2.2 and have a similar use case for this functionality, with the "count()" aggregator, still experiencing the same results described above.
Thanks!

Can you try this on master? I think the fix is in there and it should be part of 1.3.

I've just tried it on 1.3 and can confirm that it indeed works.

I'm going to close this. If you continue to have issues, please report them as a new issue.


timestamp without timezone panic when selecting from kafka source with _rw_kafka_timestamp

create source test2 (v int) with (
  connector = 'kafka',
  topic = 'test',
  properties.bootstrap.server = '<IP_ADDRESS>:29092',
  scan.start_up.mode = 'earliest',
) FORMAT PLAIN ENCODE JSON

dev=> select * from test2 where _rw_kafka_timestamp >= '2023-09-25 10:34:33.000000+00:00';
 v
---
 1
 2
(2 rows)

This is OK
But:
dev=> select * from test2 where _rw_kafka_timestamp >= '2023-09-25 10:34:33.000000';
ERROR:  Panicked when processing: called `Result::unwrap()` on an `Err` value: Expr error: Unsupported function: cast(varchar) -> timestamptz
   0: std::backtrace_rs::backtrace::libunwind::trace
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
   1: std::backtrace_rs::backtrace::trace_unsynchronized
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2: std::backtrace::Backtrace::create
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/std/src/backtrace.rs:331:13
   3: <risingwave_common::error::RwError as core::convert::From<risingwave_common::error::ErrorCode>>::from
             at ./src/common/src/error.rs:174:33
   4: <T as core::convert::Into<U>>::into
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/core/src/convert/mod.rs:716:9
   5: risingwave_expr::error::<impl core::convert::From<risingwave_expr::error::ExprError> for risingwave_common::error::RwError>::from
             at ./src/expr/src/error.rs:91:9
   6: <core::result::Result<T,F> as core::ops::try_trait::FromResidual<core::result::Result<core::convert::Infallible,E>>>::from_residual
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/core/src/result.rs:1962:27
   7: risingwave_frontend::expr::ExprImpl::eval_row::{{closure}}
             at ./src/frontend/src/expr/mod.rs:312:28
   8: futures_util::future::future::FutureExt::now_or_never
             at /Users/martin/.cargo/registry/src/index.crates.io-6f17d22bba15001f/futures-util-0.3.28/src/future/future/mod.rs:605:15
   9: risingwave_frontend::expr::ExprImpl::try_fold_const
             at ./src/frontend/src/expr/mod.rs:324:13
  10: risingwave_frontend::optimizer::plan_node::logical_source::expr_to_kafka_timestamp_range::{{closure}}
             at ./src/frontend/src/optimizer/plan_node/logical_source.rs:342:46
  11: risingwave_frontend::optimizer::plan_node::logical_source::expr_to_kafka_timestamp_range
             at ./src/frontend/src/optimizer/plan_node/logical_source.rs:372:58

or
dev=> select * from test2 where _rw_kafka_timestamp >= TO_TIMESTAMP('2023-09-25 10:34:33.000000', 'YYYY-MM-DD HH24:MI:SS.US');
ERROR:  Panicked when processing: called `Result::unwrap()` on an `Err` value: Expr error: Unsupported function: to_timestamp should have been rewritten to include timezone
   0: std::backtrace_rs::backtrace::libunwind::trace
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5
   1: std::backtrace_rs::backtrace::trace_unsynchronized
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2: std::backtrace::Backtrace::create
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/std/src/backtrace.rs:331:13
   3: <risingwave_common::error::RwError as core::convert::From<risingwave_common::error::ErrorCode>>::from
             at ./src/common/src/error.rs:174:33
   4: <T as core::convert::Into<U>>::into
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/core/src/convert/mod.rs:716:9
   5: risingwave_expr::error::<impl core::convert::From<risingwave_expr::error::ExprError> for risingwave_common::error::RwError>::from
             at ./src/expr/src/error.rs:91:9
   6: <core::result::Result<T,F> as core::ops::try_trait::FromResidual<core::result::Result<core::convert::Infallible,E>>>::from_residual
             at /rustc/62ebe3a2b177d50ec664798d731b8a8d1a9120d1/library/core/src/result.rs:1962:27
   7: risingwave_frontend::expr::ExprImpl::eval_row::{{closure}}
             at ./src/frontend/src/expr/mod.rs:312:28
   8: futures_util::future::future::FutureExt::now_or_never

We remark that the last query is generated by the users' Superset automatically, so the first query, as the workaround, cannot work.

I guess it has something to do with _rw_kafka_timestamp column as
dev=> create table t(t1 timestamp);
CREATE_TABLE
dev=> select * from t where t1 >= '2023-09-25 10:34:33.000000';
 t1
----
(0 rows)

dev=> select * from t where t1 >= '2023-09-25 10:34:33.000000';
dev=> create table t2(t1 timestamptz);
CREATE_TABLE
dev=> select * from t2 where t1 >= '2023-09-25 10:34:33.000000';
NOTICE:  Your session timezone is UTC. It was used in the interpretation of timestamps and dates in your query. If this is unintended, change your timezone to match that of your data's with `set timezone = [timezone]` or rewrite your query with an explicit timezone conversion, e.g. with `AT TIME ZONE`.

 t1
----
(0 rows)

dev=> select * from t2 where t1 >= '2023-09-25 10:34:33.000000+00:00';
 t1
----
(0 rows)

dev=> select * from t2 where t1 >= to_timestamp('2023-09-25 10:34:33.000000+00:00');
ERROR:  QueryError: Expr error: Parse error: invalid float literal
dev=> select * from t2 where t1 >= to_timestamp('2023-09-25 10:34:33.000000', 'YYYY-MM-DD HH24:MI:SS.US');
NOTICE:  Your session timezone is UTC. It was used in the interpretation of timestamps and dates in your query. If this is unintended, change your timezone to match that of your data's with `set timezone = [timezone]` or rewrite your query with an explicit timezone conversion, e.g. with `AT TIME ZONE`.

 t1
----
(0 rows)

dev=> select * from t where t1 >= to_timestamp('2023-09-25 10:34:33.000000', 'YYYY-MM-DD HH24:MI:SS.US');
NOTICE:  Your session timezone is UTC. It was used in the interpretation of timestamps and dates in your query. If this is unintended, change your timezone to match that of your data's with `set timezone = [timezone]` or rewrite your query with an explicit timezone conversion, e.g. with `AT TIME ZONE`.

 t1
----
(0 rows)

all work

This is an optimizer issue. A timezone-dependent expression cannot be evaluated in a earlier phase (logical_source predicate_pushdown) until a later phase (inline session timezone) is done.
https://github.com/risingwavelabs/risingwave/issues/7175#issuecomment-1381314486


poco: 1.7.8 -> 1.8.1

Semi-automatic update. These checks were performed:

built on NixOS
ran /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/bin/cpspc -h got 0 exit code
ran /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/bin/cpspc --help got 0 exit code
ran /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/bin/cpspc help got 0 exit code
ran /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/bin/f2cpsp -h got 0 exit code
ran /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/bin/f2cpsp --help got 0 exit code
ran /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/bin/f2cpsp help got 0 exit code
found 1.8.1 with grep in /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1

cc "@orivej"

Failure on x86_64-darwin (full log)
Partial log (click to expand)
Package ‘poco-1.8.1’ in /Users/graham/nix-borg/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/pkgs/development/libraries/poco/default.nix:25 is not supported on ‘x86_64-darwin’, refusing to evaluate.

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

Success on x86_64-linux (full log)
Partial log (click to expand)
shrinking /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/lib/libPocoUtil.so.51
shrinking /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/lib/libPocoNetSSL.so.51
shrinking /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/lib/libPocoMongoDB.so.51
shrinking /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/lib/libPocoDataODBC.so.51
shrinking /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/lib/libPocoFoundation.so.51
shrinking /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/lib/libPocoRedis.so.51
strip is /nix/store/b0zlxla7dmy1iwc3g459rjznx59797xy-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/lib  /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1/bin
patching script interpreter paths in /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1
checking for references to /tmp/nix-build-poco-1.8.1.drv-0 in /nix/store/i0mvrxm8vlgilmmkqrlp33g122iw5zlm-poco-1.8.1...

@GrahamcOfBorg build clickhouse

Failure on x86_64-darwin (full log)
Partial log (click to expand)
Package ‘clickhouse-1.1.54310’ in /Users/graham/nix-borg/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/pkgs/servers/clickhouse/default.nix:34 is not supported on ‘x86_64-darwin’, refusing to evaluate.

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

Success on x86_64-linux (full log)
Partial log (click to expand)
shrinking /nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310/bin/clickhouse-zookeeper-cli
shrinking /nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310/bin/config-processor
shrinking /nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310/bin/clickhouse
shrinking /nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310/bin/clickhouse-compressor
shrinking /nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310/lib/libclickhouse.so.1.1.54310
strip is /nix/store/b0zlxla7dmy1iwc3g459rjznx59797xy-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310/lib  /nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310/bin
patching script interpreter paths in /nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310
checking for references to /tmp/nix-build-clickhouse-1.1.54310.drv-0 in /nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310...
/nix/store/hv639xfnd10nka87n5kvqrgqkxnhybv5-clickhouse-1.1.54310

Thanks!

Success on aarch64-linux (full log)
Partial log (click to expand)
shrinking /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1/lib/libPocoMongoDB.so.51
shrinking /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1/lib/libPocoNet.so.51
shrinking /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1/lib/libPocoUtil.so.51
shrinking /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1/lib/libPocoJSON.so.51
shrinking /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1/lib/libPocoXML.so.51
shrinking /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1/lib/libPocoFoundation.so.51
strip is /nix/store/viv0il4zpdqj4p7yamwbmn2k9pb8dcnv-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1/lib  /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1/bin
patching script interpreter paths in /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1
checking for references to /build in /nix/store/s64y4qglzs6lkkrrrmwxxcz3774ccmfl-poco-1.8.1...

Failure on aarch64-linux (full log)
Partial log (click to expand)
Package ‘oraclejre-8u161’ in /var/lib/gc-of-borg/nix-test-rs-3/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-aarch64-community-3/pkgs/development/compilers/oraclejdk/jdk-linux-base.nix:71 has an unfree license (‘unfree’), refusing to evaluate.

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowUnfree = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowUnfree = true; }
to ~/.config/nixpkgs/config.nix.


Remove Fatal Warnings in Shellfish

This PR removes the different warnings that made the compiler crash under the flag tlFatalWarnings.
What was done:

Before most of the Paths were defined in terms of Java NIO Paths, which caused many Fs2 methods to show a warning as the usage with paths other than Fs2's owns is outdated. As a result, the majority of the API was migrated using the Files[F] typeclass (except for one method that still uses JFiles and I couldn't find a replacement to that method just yet).

Replaced old utf8Encode and utf8Decode to its new variants, utf8.encode and utf8.decode respectively.

Removed unused imports

Removed the flag tlFatalWarnings in build.sbt

The changes are done!


Add web exporter link to exporters page.

Signed-off-by: Huseyin Yilmaz<EMAIL_ADDRESS>Hello,
I wrote a new exporter that can count elements on a page with css queries. It also exposes request duration and response size as metrics. I have been using it on production for around couple weeks and I want to share it with community.

Thanks for sharing. Knowing the number of DOM elements before any JS is applied seemed a bit niche, and general HTTP monitoring is already covered by the blackbox and webdriver exporters. We try to avoid duplication in this list, so the community tends to work towards improving existing exporters rather than continuously reinventing the wheel.

Hey @brian-brazil, you are right that this one is close to blackbox exporter and webdriver exporter. Problem I was having before implementing this was checking the actual content of the page. For instance, I want to know if page has a header, footer and certain components on the page. This is specially helpful if some of the components depends on a database table that can be changed from an interface.
As far as I am aware there is only single way of achieving this right now. Blackbox exporter provides a configuration like this:
     fail_if_body_not_matches_regexp:
        - '"class":"page-header"'
        - '"class":"page-footer"'

There are 2 problems with this. First one is, I am just running a regex match on page as text. It does not let me look for a specific element in specific location. It might even match with something else on the page by mistake. Second thing is it creates a metric on failure. I do not necessarily want to create an alert from this even though this is the main usecase. I also graph those for elements that is variable in numbers.
I guess my point is we already have exporters that check network health better than web_exporter. I am actually using blackbox exporter for most of health checks myself. But point of web_exporter is actually check the content of the page more than the network. I throw in network health info as an extra because I already had the data in hand and they create pretty sweet graphs :)
@brian-brazil let me know if you still think web exporter does not cover different enough need from webdriver exporter and blackbox exporter. If you still think it is too similar, I will close the pr.

I think this is much too niche to list, the blackbox exporter already sufficiently covers this use case between regex matching and response size. In general I'd treat blackbox monitoring as a smoketest, not try to use it to indirectly do SQL queries.

Got it. Closing the pr.


parameter question

Hi, and thanks for making this awesome Module.
I have a question as to how to define the parameter object for the cmd'let New-Isijobs.
Specifically, I need to use this for permissionrepair, and the -prepair_params, I do not know what notation to type the parameters.
the example I would love to see how you convert is this:
isi job jobs start --type=permissionrepair --mode=inherit --template=/ifs/data/path1 --paths=/ifs/data/path2
It would look like this:
New-isiJobs -type permissionrepair -paths /ifs/data/path2 -prepair_params ??
I have tried looking around, but nobody seems to have posted anything on this, and checking the module or help, doesn't really help me ;)
Thanks in advance.
Oh and mark this a questions please.

Ok i found the solution myself, sorry for my ignorance, examples would have helped ;)
I did: $ged=@{mode="inherit";template="/path"}
and then New-isiJobs -type permissionrepair -paths /ifs/data/path -prepair_params $ged
And all is well ;)

great! :) I'll add you example to the Readme.
Thank you!


MySQL Cattle DB needs improved cleanup process

Rancher Version:
1.1.1
Docker Version:
1.11.2
OS and where are the hosts located? (cloud, bare metal, etc):
bare / ubuntu 14.04 LTS
Setup Details: (single node rancher vs. HA rancher, internal DB vs. external DB)
single node
Environment Type: (Cattle/Kubernetes/Swarm/Mesos)
Cattle
Steps to Reproduce:
Use for a few months
Results:
audit_log = 2.6GB
instance = 1GB
process_execution = 600MB
container_event = 500MB
Expected:
There is a lot of data hanging around needlessly in many of the cattle's tables. It's really slows down the UI and creates a poor user experience.

+1 - i've had to clear down old cruft in my rancher db recently it was not a quick or trivial exercise or without risk :( There should really be an official script/process for this, if not an actual maintenance thread that runs in the background.

We have ways to decrease the cleanup of certain tables today, but need to add cleanup for aduti_log.
http://docs.rancher.com/rancher/latest/en/faqs/server/#rancher-server-database-is-growing-too-quickly

One of the messiest areas is hosts. Deleting a host record should cascade removing all it's child records. Instead restricts are used everywhere.

@bacheson The only tables we clean up today are process_instance, process_execution, service_event, container_event, and audit_logs.  The interval we clean those up after is based on a setting (/v1/settings/)
process_instance, process_execution - process_instance.purge.after.seconds default 86400
service_event, container_event - events.purge.after.seconds default 1209600
audit_logs - audit_log.purge.after.seconds default 7776000
Those are the tables that grow quickly, all other tables, such as instance we never delete.  We should at some point but the tables don't grow all that quickly.  The size of the DB typically doesn't impact performance that much.  It is usually something else that is slowing things down.  We welcome any audit you'd like to do.  Just know that any changes you suggest need to be done in a backwards compatible way.  For example renaming tables, column is typically not feasible because it breaks zero down time upgrades and doesn't allow rollback.  Unfortunately we've just had to live with poorly named things.

I totally understand. Anything I can do to help even if it's something that get thrown out on the cutting room floor.
The big one for me is hosts. There are 10 tables I have to manually run a delete on to remove cruft. The foreign keys using "no action" don't allow me to simply delete the host record and take advantage of cascading.
eg:
delete from healthcheck_instance_host_map WHERE host_id = 54;
delete from container_event WHERE host_id = 54;
delete from host_ip_address_map WHERE host_id = 54;
delete from host_label_map WHERE host_id = 54;
delete from host_vnet_map WHERE host_id = 54;
delete from instance_host_map WHERE host_id = 54;
delete from service_event WHERE host_id = 54;
delete from storage_pool_host_map WHERE host_id = 54;
delete from host WHERE id = 54;

@bacheson we use liquibase to manage the schema which I'll admit is probably not the easiest thing to figure out.  If you can recommend cleanup of the "on delete" actions by just sharing a mysqldump which has the DDL changes we can handle getting it into the right format.

Closing in favor of https://github.com/rancher/rancher/issues/5129


Access denied/ Failed to Load Chart while opening/ Creating charts

Hello All,
I am facing issues when i am editing charts. When clicking on three vertical dots i am getting error like failed to load charts. When clicking on datasets  and viewing any datasets(physical or virtual), i am getting error like Access is denied. I have all the admin privileges for creating charts. I have compared all the roles with my local superset installed.
This issues is coming from 18th July 2022. Before this there were no such issues.
Kindly provide your input on this.
Thank You!
Regards,
Aditya Shankar

+1 here.
I runned superset init , but it don't fix that problem.

@Always-prog did you ever find a solution to this?

Closing this as stale since it's been silent for so long, and we're trying to steer toward a more actionable Issues backlog. If people are still encountering this in current versions (currently 3.x) please re-open this issue, open a new Issue with updated context, or raise a PR to address the problem. Thanks!


Setup a "plan" presubmit

This needs two separate PRS.

We should create a NEW identity in iac/bootstrap that's a project viewer and can be federated by pull requests presubmit (e.g. ref:refs/heads/main -> :pull_request). -- I may need to apply this once it lands, or add folks to ACLs.

We should add a presubmit like mono that posts the plan to the PR body.

cc @cpanato

This failed


Update to 6.4.1

@conda-forge-admin please rerender

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

Do we have any idea why the bot does not pick up version updates automatically?

because of the branch maybe ?

Yeah this only happens for main


mp4track failing for unknown reason

I record timelapse of Lego builds in iStopMotion, which results in giant files because they are uncompressed full frame video. Once completed, I run them through transcode-video and normally don't have an issue. But this time round I'm getting an error.
transcode-video --quick --mp4 -vvv --no-audio bucketwheelbuild6.mov -o ~/Desktop/Bricks/
transcode-video 0.10.0
Copyright (c) 2013-2016 Don Melton
HandBrake 0.10.5 found...
HandBrake 0.10.5 found...
Processing: bucketwheelbuild6.mov...
Scanning media title 1 with HandBrakeCLI...
[21:51:55] hb_init: starting libhb thread
HandBrake 0.10.5<PHONE_NUMBER>) - Darwin x86_64 - https://handbrake.fr
8 CPUs detected
Opening bucketwheelbuild6.mov...
[21:51:55] CPU: Intel(R) Core(TM) i7-4870HQ CPU @ 2.50GHz
[21:51:55]  - Intel microarchitecture Haswell
[21:51:55]  - logical processor count: 8
[21:51:55] OpenCL device #1: Intel Iris Pro
[21:51:55]  - OpenCL version: 1.2
[21:51:55]  - driver version: 1.2(Jun 30 2016 20:43:33)
[21:51:55]  - device type:    GPU
[21:51:55]  - supported:      YES
[21:51:55] OpenCL device #2: AMD AMD Radeon R9 M370X Compute Engine
[21:51:55]  - OpenCL version: 1.2
[21:51:55]  - driver version: 1.2 (Jun 30 2016 20:50:27)
[21:51:55]  - device type:    GPU
[21:51:55]  - supported:      YES
[21:51:55] hb_scan: path=bucketwheelbuild6.mov, title_index=1
libbluray/bdnav/index_parse.c:162: indx_parse(): error opening bucketwheelbuild6.mov/BDMV/index.bdmv
libbluray/bdnav/index_parse.c:162: indx_parse(): error opening bucketwheelbuild6.mov/BDMV/BACKUP/index.bdmv
libbluray/bluray.c:2182: nav_get_title_list(bucketwheelbuild6.mov) failed
[21:51:55] bd: not a bd - trying as a stream/file instead
libdvdnav: Using dvdnav version 5.0.1
libdvdread: Encrypted DVD support unavailable.
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.IFO failed
libdvdread:DVDOpenFileUDF:UDFFindFile /VIDEO_TS/VIDEO_TS.BUP failed
libdvdread: Can't open file VIDEO_TS.IFO.
libdvdnav: vm: failed to read VIDEO_TS.IFO
[21:51:55] dvd: not a dvd - trying as a stream/file instead
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'bucketwheelbuild6.mov':
  Metadata:
    major_brand     : qt
    minor_version   : 537199360
    compatible_brands: qt
    creation_time   : 2016-08-03 18:11:15
    encoder         : x iStopMotion
    encoder-zkn     : x iStopMotion
  Duration: 00:02:48.73, start: 0.000000, bitrate: 995343 kb/s
    Stream #0.0(eng): Video: rawvideo, argb, 1920x1080, 995328 kb/s, 1500 tbn (default)
    Metadata:
      creation_time   : 2016-08-03 18:11:15
    Stream #0.1(eng): Data: tmcd / 0x64636D74
    Metadata:
      creation_time   : 2016-08-05 19:04:25
[21:51:55] scan: decoding previews for title 1
[21:51:56] scan: 2 previews, 1920x1080, 15.000 fps, autocrop = 0/0/0/0, aspect 16:9, PAR 1:1
[21:51:56] libhb: scan thread found 1 valid title(s)
+ title 1:
  + stream: bucketwheelbuild6.mov
  + duration: 00:02:48
  + size: 1920x1080, pixel aspect: 1/1, display aspect: 1.78, 15.000 fps
  + autocrop: 0/0/0/0
  + support opencl: yes
  + support hwd: not built-in
  + chapters:
    + 1: cells 0->0, 0 blocks, duration 00:02:48
  + audio tracks:
  + subtitle tracks:
HandBrake has exited.

Scanning with mp4track...
mp4track - MP4v2 2.0.0 found...
ERROR: unable to open for read: bucketwheelbuild6.mov
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
Warning (charLength > fixedLength) in src/mp4file_io.cpp at line 400
ReadProperties: atom 'raw ' is too small; overrun at property: compressorName (src/mp4atom.cpp,386)
/usr/local/bin/transcode-video: scanning failed

My guess is that since there's no audio, mp4track is failing. But since I'm specifying no-audio, why is mp4track being run?

@richard5mith Sorry I took so long to look at this in depth.
OK, specifying --no-audio only affects the output file. It has nothing really to do with the input.
The mp4track tool is used to scan MP4 media files and identify tracks and their attributes. It should work fine if there's no audio track. I suspect that issue is a red herring. So, there's must be something else wrong with this file.
Can you post the file somewhere online so I can examine it myself? Thanks.

@richard5mith I've just confirmed that mp4track and transcode-video work fine with .mov files with no audio tracks. So that's definitely not the issue here.

Well I guess my guess was the wrong guess. :)
I'll see if I have any files left with the problem. I've been re-exporting them out of iStopMotion again using it's export option, and that then gives me a file that works, so I've then be deleting the originals. But I might have one left.

@richard5mith It was still a good guess. :)

@richard5mith Looking at your diagnostic output again, perhaps the problem is due to the rawvideo format of the video stream? I don't have sample files in that format so I can't be sure.

I don't have any files left which give me the same error, because I haven't done any Lego videos this week. I tried to create a test file and it gives me an error when trying to convert, but it's a different error!
https://www.dropbox.com/s/isl3e9mij49jxon/test.mov?dl=0

@richard5mith Thanks for the file!
OK, the reason why both transcode-video and convert-video fail on that file is that HandBrakeCLI doesn't think it contains a title, i.e. a video track. You can simple try:
HandBrakeCLI --scan --input test.mov

... and watch HandBrakeCLI barf on it.
I think the reason is that the file contains RGB raw video. The good news is that FFmpeg seems to handle it. So I would suggest using that tool instead of a workflow with HandBrake.

@richard5mith As near as I can tell, there's not a "bug" in transcode-video, mp4track or HandBrakeCLI here. Perhaps a "limitation" in the underlying implementation of the latter two, but that's not something I can fix.
So, I'm closing this for now but if you still need help or suspect there really is a larger problem then comment here and I'll reopen the issue.
Thanks for reporting this!


save custom training loop with keras API (train_step)

Hi, based on the #38103 issue, I'd like to reopen the discussion:
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Google Colab (Windows/Linux as well)
TensorFlow installed from (source or binary): binary
TensorFlow version (use command below): last one, 2.4.0
Python version: 3.8

Describe the current behavior
I'm using the feature: custom training logic with model.fit by overriding model.train_step (and model.test_step). It's working well, except for saving/loading cases, I have the following issue:
When I save my model (model.save) with the custom training logic and then I want to load it, the custom training loop is not saved and when I apply a model.fit for my loaded model, it comes back to the default one.
Describe the expected behavior
I'd expect to save as well the model.train_step (and also test_step). Especially with the new 2.4 feature model.save(save_traces=True). Is it possible (and if yes, how) ? If no, is a such feature planned or should I write a feature request ?
Standalone code to reproduce the issue
Gist
Thank you in advance,

Was able to reproduce the issue with TF v2.4 and TF-nightly.
Whereas running the code with TF v2.3 throws an error stating TypeError: save() got an unexpected keyword argument 'save_traces'. Please check the linked gist for reference. Thanks!

Was able to reproduce the issue with TF v2.4 and TF-nightly.
Whereas running the code with TF v2.3 throws an error stating TypeError: save() got an unexpected keyword argument 'save_traces'. Please check the linked gist for reference. Thanks!

@quetil There are some differences while saving and loading of Sequential/Functional models when compared to Subclass models. The approach you followed is correct for Sequential/Functional models but need slight modification as shown in the following gist.
In simple you need to implement get_config and from_config methods. There is an extensive guide.
Please verify once and close the issue if this was resolved for you. Thanks!


[iOS] Run CI on macOS 11 Big Sur host runner

Issue

close #642

Overview (Required)

Switch GitHub Actions host runner to Big Sur for iOS App
Run each workflows with Xcode 12.5.1
Unfortunately, trying to run with Xcode 13 has failed on Gradle task.

It seems that KMM is not supporting Xcode 13 (or Swift 5.5) yet.

There are multiple sudo xcode-select -s ~ steps in ios-test workflow, so I made it easier to change Xcode path.
fix argument on generate-license-list (--package-path -> --swift-package-path)

Links

mono0926/LicensePlist#156

Screenshot

Before
After

@ry-itto

Please apply to ios-commit-snapshots workflow as well 🙏🏼

I did it! 💪


Add support for HackerEarth

What needs to be done
Create a hackerEarth function in the scraping.js file which returns an array of contest details from HackerEarth. You can use Axios to get the contest data as JSON from here. The contest data should be returned in the following format:
{
    name: 'name_of_contest',
    url: 'link_to_the_contest',
    start: start_time_in_epoch_format,
    duration: duration_in_seconds
}

I  would like to contribute to this. assign to me. @roshan1337d

@saimaheshtaduri Assigned this to you. Submit after the 1st of October if you want it to count towards the HacktoberFest 🚀

PR submitted and approved


[RuntimeError: Connection reset by peer] When scaling up training jobs

I am facing a similar problem as the one posted by @g-karthik in https://github.com/microsoft/DeepSpeed/issues/570#issuecomment-750744107.
When I use 40 nodes with 10 gpus on each node (400 jobs), the training works well. But when I scale up the training to 40 or more nodes, deepspeed.initialize() fails with:
Traceback (most recent call last):  File "/home/hanwentao/work/enc-dec-pretrain/Megatron-LM/pretrain_enc_dec.py", line 947, in <module>
    main()
File "/home/hanwentao/work/enc-dec-pretrain/Megatron-LM/pretrain_enc_dec.py", line 769, in main
    initialize_distributed(args)
File "/home/hanwentao/work/enc-dec-pretrain/Megatron-LM/pretrain_enc_dec.py", line 703, in initialize_distributed
    deepspeed.init_distributed(distributed_port=29501)
File "/home/hanwentao/.local/lib/python3.8/site-packages/deepspeed-0.3.11+4f1d827-py3.8.egg/deepspeed/utils/distributed.py", line 49, in init_distributed
    torch.distributed.init_process_group(backend=dist_backend,
File "/home/hanwentao/.local/lib/python3.8/site-packages/torch/distributed/distributed_c10d.py", line 455, in init_process_group
    barrier()
File "/home/hanwentao/.local/lib/python3.8/site-packages/torch/distributed/distributed_c10d.py", line 1960, in barrier
    work = _default_pg.barrier()
RuntimeError: Connection reset by peer

I used the deepspeed version at the master branch. I ran my script with mpirun, just as described in https://www.deepspeed.ai/getting-started/#mpi-and-azureml-compatibility.
Any ideas on what's going on?

So if I understand correctly, things work fine with <=400 gpus? Can you try a run where you configure 1 gpu per node but more than 40 nodes?

Thanks for your advice! I tried a run using more nodes and I found that when I use less than 66 nodes with 1 GPU per node, the training works well. But when I added more node, another bug appeared:
Traceback (most recent call last):
  File "/home/hanwentao/work/enc-dec-pretrain/Megatron-LM/pretrain_enc_dec.py", line 959, in <module>
    main()
  File "/home/hanwentao/work/enc-dec-pretrain/Megatron-LM/pretrain_enc_dec.py", line 781, in main
    initialize_distributed(args)
  File "/home/hanwentao/work/enc-dec-pretrain/Megatron-LM/pretrain_enc_dec.py", line 715, in initialize_distributed
    deepspeed.init_distributed()
  File "/home/hanwentao/.local/lib/python3.8/site-packages/deepspeed-0.3.11+4f1d827-py3.8.egg/deepspeed/utils/distributed.py", line 49, in init_distributed
    torch.distributed.init_process_group(backend=dist_backend,
  File "/home/hanwentao/.local/lib/python3.8/site-packages/torch/distributed/distributed_c10d.py", line 455, in init_process_group
    barrier()
  File "/home/hanwentao/.local/lib/python3.8/site-packages/torch/distributed/distributed_c10d.py", line 1960, in barrier
    work = _default_pg.barrier()
RuntimeError: NCCL error in: ../torch/lib/c10d/ProcessGroupNCCL.cpp:784, unhandled system error, NCCL version 2.7.8

I have also tried different combinations of the nodes. It seems that the error is only related to the number of nodes.

I couldn't really resolve this issue myself, either @tjruwase and @t1101675.
My workaround solution was literally to keep killing and restarting the job until the connection did not get reset by any process.

@t1101675 Thanks for sharing the update.
@g-karthik Thanks for sharing your experience. Are you seeing the issue with the same number of nodes and does your workaround work reliably?
@t1101675 , I am not sure how to repro this issue as I can't get a similar number of nodes. But I am curious about what enabling NCCL logs could reveal? Have you tried doing  that?

@tjruwase I saw it with 30 nodes, 8 GPUs each.
So far, the workaround has indeed worked reliably after N iterations of killing+restarting (where N is very large, to my dissatisfaction).

@g-karthik Thanks for sharing that. Just a crazy thought, now I am wondering if there is a power of 2 dependency in DeepSpeed/NCCL? It would be great to share NCCL logs if possible.

@tjruwase I don't think that's the issue, I tried it with 32 nodes also, I still see it happen.

@g-karthik and @t1101675 what torch version are you using here? We have seen similar issues like this with torch 1.7 and 1.8 with NCCL 2.7.8 and have fixed them by forcing torch to use NCCL 2.8.3. Since torch is compiled with its own NCCL version we have to wait for torch to upgrade their NCCL version for a real fix here. We have a PR to pytorch here: https://github.com/pytorch/pytorch/pull/50235 and related here: https://github.com/pytorch/pytorch/pull/50240. Really hoping this will be merged soon to make the 1.9 release target.
The way we've tested this is by hacking in NCCL 2.8.3 via LD_PRELOAD, you should be able to try this out via steps similar to these:

Install NCCL 2.8.3, this works for us on a cuda 11 system: apt-get install -y libnccl2=2.8.3-1+cuda11.0 libnccl-dev=2.8.3-1+cuda11.0
Set LD_PRELOAD to the the library path, on our system we do it like this: LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libnccl.so.2.8.3

To confirm LD_PRELOAD is working you can see the version it uses in the NCCL logs if you have NCCL_DEBUG=INFO, it should say: NCCL version 2.8.3+cuda11.0

@jeffra I'm using torch 1.4, with NCCL 2.4.8.
Does separately installing NCCL 2.8.3 and hacking it in via LD_PRELOAD work with torch 1.4?

Hi @g-karthik, it should probably work? But I have not tried it myself with torch 1.4. Sorry for a less than confident answer there haha :)

Hey @jeffra! It looks like FB published a new Docker image for the latest PyTorch, with NCCL 2.9.6:
https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel_21-04.html#rel_21-04
Seems like the LD_PRELOAD hack won't be needed any more? I see your PyTorch PRs haven't been merged but I am assuming they're not needed.
Does DeepSpeed support this base image?

@g-karthik, thanks for this pointer! I will give it a try on our side. At a quick glance I don't see why DeepSpeed would have any issues with this image though. We've recently tested a version of NCCL 2.9.6 + torch 1.7 via a custom build and that was all fine.

The degradation mentioned above is a deepspeed issue, not an NCCL issue. Just pasting my findings here for completeness: https://github.com/microsoft/DeepSpeed/issues/1057#issuecomment-840259981

We're observing the same issue as the OP when running on more than ~3k GPUs using Pytorch 1.7, NCCL 2.7.8, CUDA 10.2, and DeepSpeed 0.3.15. Unfortunately, the issue persists after upgrading to PyTorch 1.9 and NCCL 2.8.3. I know this is a tough (and expensive!) scale to test at,  but I wanted to see if anyone else was still running into this. Thanks!


Updates to the Python Service Management Doc

Updating the Python Service Management API doc

Hugues should probably review these changes since he is the listed author.

Sent pull request to Hugues and Varun for review/reconciliation if needed


Gradle bintrayUpload does not work

Describe the bug
Uploading flank using gradle plugin (bintrayUpload command) stop working with no reason, only for flank-snapshots( after each merge to master)
> Task :bintrayUpload FAILED
> Task :bintrayPublish
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':bintrayUpload'.
> Could not upload to 'https://api.bintray.com/content/flank/maven/flank/flank_snapshot/com/github/flank/flank/flank_snapshot/flank-flank_snapshot.pom': HTTP/1.1 405 Not Allowed 405 Not Allowed405 Not Allowednginx

Version of snapshot is uploaded correctly, however when we upload .pom file there is an issue which breaks our CI
To Reproduce

Steps to reproduce the behavior:

Push something to master and observer RELEASE CI job
See error

Expected behavior

A clear and concise description of what you expected to happen.

bintrayUpload command should work properly for each file and should not fail the job.
Details (please complete the following information):

Have you tested on the latest Flank snapshot?
Post the output of  flank --version.

Additional context

Add any other context about the problem here.

If there will be problem fixing this try:

jfrog cli tool
ask @bootstraponline  to create support ticket
moving to GitHub packages

There are many different reports of this exact issue occurring across the internet after a small investigation:
https://github.com/KrailOrg/krail-i18n/issues/4
https://devhub.vr.rwth-aachen.de/VR-Group/conan/conduit/-/jobs/26934
https://stackoom.com/question/262qP/Bintray-不允许Nginx
All of the resolutions were simply to wait as Bintray was having issues and they resolved themselves after some time.
I think that we should give it a day or two and come back and see if it resolves itself. Especially since the code has not been changed recently as confirmed by @piotradamczyk5 and it "suddenly" stopped working.
Else we could open a ticket for bintray as @bootstraponline suggested or simply upload elsewhere.
WDYGT?

I tried to upload the pom file using curl:
curl -T <path to pom> -u<jfroguser>:<apikey> https://api.bintray.com/content/flank/maven/flank/flank_snapshot/com/github/flank/flank/flank_snapshot/flank-flank_snapshot.pom

and got

<title>405 Not Allowed</title>

405 Not Allowed

nginx

Thanks for the detailed investigation!
I'd like to try uploading to GitHub packages and see if that's a more stable option.

Issue fixed by manual upload by web interface and sync with maven central


Theme Request: Bat

bat is cat with wings - things like syntax highlighting to cat.
https://github.com/sharkdp/bat

That's not necessary to make any Sublime theme; thus already works out of the box for Bat. 😅


type '_Map<Object?, Object?>' is not a subtype of type 'Map<String, dynamic>?' in type cast

Future<CallKitParams?> getCurrentCall() async {
  final calls = await FlutterCallkitIncoming.activeCalls();
  if (calls is List) {
    if (calls.isNotEmpty) {
      final callParam = CallKitParams.fromJson(calls as Map<String, dynamic>);

      return callParam;
    }
  }

  return null;
  }

You can simply cast the extra params,
Map<String, dynamic> temp = event.body['extra'].cast<String, dynamic>();


Dimensional Transceiver stops powering Farming Station

I don't know if this issue is related to #2094.
The bug is tricky to reproduce but it happened to me many times. When I put a dimensional transceiver (DT) on top of a farming station (FS), it fills the FS' internal power buffer correctly but then, for no obvious reason, it stops powering it. Generally when it happens, removing the DT and placing it on the side or bottom of the FS solves the problem. Replacing it on top usually fails.
I haven't noticed this behaviour with any other machine yet. The farming station was farming trees with shears on. I'll let you know if I can find a way to reliably reproduce this bug.

I have tried for an hour to reproduce this bug using your latest commit and it never came back. The farming station gets powered properly by the DT. I have no clue why it happened before.
I'll keep on eye on it on my main world just in case.


New lifecycle event for request failures in RequestWrapper

Note to self: I need to add in a new lifecycle event to handle network request failures and feed into the offline queueing library work that @prateekbh is working on.

@prateekbh, this is actually implemented already. I just misremembered when we were sync'ing up.
You take advantage of it by passing in a class with a fetchDidFail method to the behaviors property when constructing RequestWrapper:
E.g.
const requestWrapper = new RequestWrapper({
  behaviors: [
    new BackgroundSyncQueueBehavior(/* config options */)
  ]
});

BackgroundSyncQueueBehavior#fetchDidFail({request}) will be called anytime there's a fetch() made using the wrapper which fails.


Bump @vercel/ncc from 0.31.1 to 0.33.4

Related:

#103
#143

Suffers from the same CodeQL analysis failure as #103, so closing this one out since it's targeting a more outdated dependency version. 🤷🏻♂


Where can i find install？

Hi, you can find that information now available in the README. Let me know if you have any issues with the installation.


Deletion policies and the need to enable an archive mailbox

Please see my suggestion to the Note on the page to add "or deletion".  Because I only wanted to implement a deletion policy without any archive polices, it was not clear if I needed to enable an archive mailbox, so I opened a ticket (21713052) with Premier support on it.  They said that enabling archive mailboxes was required even for deletion policies.
Note
You can enable archive mailboxes any time during this process, just as long as they're enabled at some point before you complete the process. If an archive mailbox isn't enabled, no action is taken on any items that have an archive or deletion policy assigned to it.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 81e9c1f9-d22d-8c83-25bb-637f3121ef33
Version Independent ID: b6c1f57d-978f-c959-ef0a-00ef1b9d9cab
Content: Set up an archive and deletion policy for mailboxes in your organization - Microsoft 365 Compliance
Content Source: microsoft-365/compliance/set-up-an-archive-and-deletion-policy-for-mailboxes.md
Service: o365-seccomp
GitHub Login: @markjjo
Microsoft Alias: markjjo

@eric92315 Thanks for following up about this. I will incorporate your suggested fix. Update should be published by tomorrow or so.


(maint) Update tests requiring a yaml end of document in output

The behavior of dropping the yaml end of document changed between
Ruby 2.4.4p296 and 2.4.5p334. The tests regarding lookup are really
not about yaml output compatibility and this commit drops
the optional end of document at the end of the output if it is present
so that the individual tests can compare against the rest of the
produced yaml output.

CLA signed by all contributors.

I filed https://tickets.puppetlabs.com/browse/PUP-9313 to understand the change in behavior. It looks to be an issue with libyaml, and it's just that ruby on windows (from rubyinstaller2) used in appveyor includes the new yaml library whereas ruby on other platforms doesn't (not yet at least).


macOS: update_translations.py not working

Describe the bug
(openpilot-py3.11) blah@Someoness-MacBook-Pro openpilot % ./selfdrive/ui/update_translations.py
sh: lupdate: command not found
Traceback (most recent call last):
  File "/Users/blah/github/openpilot/./selfdrive/ui/update_translations.py", line 53, in <module>
    update_translations(args.vanish, args.plural_only)
  File "/Users/blah/github/openpilot/./selfdrive/ui/update_translations.py", line 42, in update_translations
    assert ret == 0
           ^^^^^^^^
AssertionError

trying to use third_party/qt5/larch64/bin/lupdate results in..
(openpilot-py3.11) blah@Someoness-MacBook-Pro openpilot % ./selfdrive/ui/update_translations.py
sh: /Users/blah/github/openpilot/third_party/qt5/larch64/bin/lupdate: cannot execute binary file
Traceback (most recent call last):
  File "/Users/blah/github/openpilot/./selfdrive/ui/update_translations.py", line 54, in <module>
    update_translations(args.vanish, args.plural_only)
  File "/Users/blah/github/openpilot/./selfdrive/ui/update_translations.py", line 43, in update_translations
    assert ret == 0
           ^^^^^^^^
AssertionError

OS Version
Ventura 13.4.1
openpilot version or commit
master
Additional info
No response

Is there a dev version of qt5 you can install? Does Linguist exist on your machine?

one way you can try is install it via qt maintenance tool

@sshane is it ok to attach the bin files here?

We have binaries for Darwin in third_party, so should be safe to add them if they work

@fredyshox can you see about getting those binaries in openpilot?

qt@5 tools should be already installed on your system if you used mac_setup.sh.  you can check if they're present at$(brew --cellar)/qt@5/*/bin
It's possible that brew didn't link them. Try running brew link qt@5 to regenerate links.

----   OPENPILOT SETUP DONE   ----
Open a new shell or configure your active shell env by running:
source /Users/blah/.zshrc

blah@Someoness-MacBook-Pro openpilot % source /Users/blah/.zshrc

blah@Someoness-MacBook-Pro openpilot % $(brew --cellar)/qt@5/*/bin
zsh: permission denied<EMAIL_ADDRESS>
blah@Someoness-MacBook-Pro openpilot % sudo !!
sudo $(brew --cellar)/qt@5/*/bin
Password:
sudo<EMAIL_ADDRESS>command not found

blah@Someoness-MacBook-Pro openpilot % brew list
==> Formulae
abseil		git-lfs		librist		m4		readline
aom		glfw		libsamplerate	mbedtls		rubberband
aribb24		glib		libsndfile	mpdecimal	sdl2
autoconf	gmp		libsodium	mpfr		six
brotli		gnutls		libsoxr		mpg123		snappy
bzip2		graphite2	libtasn1	nettle		speex
ca-certificates	harfbuzz	libtiff		opencore-amr	sqlite
cairo		highway		libtool		openexr		srt
capnp		icu4c		libunibreak	openjpeg	svt-av1
catch2		imath		libunistring	openssl@3	swig
cjson		isl		libusb<EMAIL_ADDRESS>tesseract
cmake		jpeg-turbo	libvidstab	opus		theora
coreutils	jpeg-xl		libvmaf		p11-kit		tinyxml2
cppcheck	lame		libvorbis	pango		unbound
dav1d		leptonica	libvpx		pcre		webp
eigen		libarchive	libx11		pcre2		x264
ffmpeg		libass		libxau		pixman		x265
flac		libb2		libxcb		pkg-config	xorgproto
fontconfig	libbluray	libxdmcp	portaudio	xvid
freetype	libevent	libxext		protobuf	xz
frei0r		libidn2		libxrender	protobuf-c	z3
fribidi		libmpc		little-cms2	pyenv		zeromq
gcc@12		libnghttp2	llvm<EMAIL_ADDRESS>zimg
gettext		libogg		lz4		qt@5		zlib
giflib		libpng		lzo		rav1e		zstd

==> Casks
appcleaner		gcc-arm-embedded

blah@Someoness-MacBook-Pro openpilot % brew link qt@5
Linking<EMAIL_ADDRESS>506 symlinks created.

If you need to have this software first in your PATH instead consider running:
  echo 'export PATH="/opt/homebrew/opt/qt@5/bin:$PATH"' >> ~/.zshrc

blah@Someoness-MacBook-Pro openpilot % sudo $(brew --cellar)/qt@5/*/bin
sudo<EMAIL_ADDRESS>command not found

blah@Someoness-MacBook-Pro openpilot % echo 'export PATH="/opt/homebrew/opt/qt@5/bin:$PATH"' >> ~/.zshrc

blah@Someoness-MacBook-Pro openpilot % sudo $(brew --cellar)/qt@5/*/bin
sudo<EMAIL_ADDRESS>command not found

Running /opt/homebrew/opt/qt@5/bin/lupdate does work
blah@Someoness-MacBook-Pro ~ % /opt/homebrew/opt/qt@5/bin/lupdate
Usage:
    lupdate [options] [project-file]...
    lupdate [options]<EMAIL_ADDRESS>-ts ts-files|@lst-file

lupdate is part of Qt's Linguist tool chain. It extracts translatable
messages from Qt UI files, C++, Java and JavaScript/QtScript source code.
...

Running brew link qt@5 or echo 'export PATH="/opt/homebrew/opt/qt@5/bin:$PATH"' >> ~/.zshrc does the trick! I assume it just needs to be added to openpilot_env.sh

Thats good. Gonna add it here: https://github.com/commaai/openpilot/pull/29456


templates of css and js not showing

Description
1.templates of css and js not showing
2.all templates of cool front are also not showing
Screenshots
No response

@Jayanth-MKV

Yes assign it to me @arpit456jain

@Jayanth-MKV do this asap

@Jayanth-MKV i just noticed that u have hard coded the templates
instead of that either use a json file or directly fetch it from the respective repo

u have to use this somehow otherwise its very difficult for handling for us
https://github.com/arpit456jain/Cool-Front-End-Templates/blob/master/style_links.json
or
https://raw.githubusercontent.com/arpit456jain/Cool-Front-End-Templates/master/style_links.json

if its not possible to use directly just download this json file and use it

okay sure i would in that way only


do not shutdown executor in OutputS3

The executorService doesn't belong to the OutputS3 so it isn't allowed to shut
it down.


Possible to export a stylesheet?

I acknowledge this does not fit issue guidelines

Is it possible to export the CSS that glamorous generates as a static file?

Hi @kirkstrobeck! :wave:
Allow me to redirect you to #86

Thx! Looks like I was able to achieve what I had expected with https://github.com/threepointone/glamor/blob/5e7d988211330b8e2fca5bb8da78e35051444efd/docs/server.md

Ah yes, server-rendering is great too :+1:


update document on how to run tests using saucelab

The current protractor used for testing doesn't support the latest chrome version.
While we are waiting for protractor to be fixed, we should fix the chrome version or run the tests using saucelab.

Added documentation here https://github.com/informatics-isi-edu/chaise/wiki/E2E-tests-guide#running-tests-using-sauce-labs-locally


Accordion needs a unique key prop

Bug Report
Current Behavior
Each child in a list should have a unique "key" prop. Accordion does not follow this rule.
Input Code
https://github.com/SnapITSolutions/snapit-hacktoberfest/blob/b146819c8376530aef5308bbc70df18ba196c035/src/components/AccordionList.jsx#L13-L14
Possible Solution
Add a unique "key" prop to accordion.
Additional context/Screenshots
https://reactjs.org/docs/lists-and-keys.html#keys

Hey @aaronshivers the PR is up against #101 please review the PR. Thankyou


How to set SK lang

Hi, I would like to have SK lang in GoPay form, and as I see GoPay support SK language https://doc.gopay.com/en/?php#lang
But in the Markete are allowed only CZ/EN.
There is a method:
public function setLang($lang)
    {
        if (!in_array($lang, $this->allowedLang)) {
            throw new InvalidArgumentException('Not supported language "' . $lang . '".');
        }
        $this->lang = $lang;

        return $this;
    }

which does not allow any other language. If I change the code ($allowedLang property), to support SK lang it works. In my opinion condition in setLang method is useless. Everybody can ensure the valid lang code and in other way it throws an exception (as it works also for now). Is it really necessary to check allowed langs which are hardly coded in AbstractService->allowedLang?
Thanks.
EDIT: Not valid lang code falls to default EN, what is expectable and desirable, so that condition looks really useless.

Hi. Thank you for your time.
What about stay strict and append only missing languages?

Language code	Language
CS	Czech
EN	English
SK	Slovak
DE	German
RU	Russian

It si your dicision. But what about ES, PL, HU, ................................
I think it is not necessary to be strict here. Fallback to default is common pattern and I thing Gopay will support it also in future. So setLang can be so simple as possible.

Hmm. Good point. But I still thing that strictness should be on library side. It's no difference for programmers, if they'll type properly values, otherwise it'll throw an exception.
I think this way is more clean. Also it's more predictable, because you know what you send to server. Fallbacks are not straightforward solutions, especially not for the beginners.
Do you agree? Would you mind prepare a PR for it?

I don know how to make PR from GH fork. It is not so simple if I remember. But I am still against the strict mode here. Exception as exception. It is the same. If Gopay will throw an exception in future I believe it will be clean also for beginners. And every new language will need new release of this library. Strict mode is mainly about safety. This is not user friendly.
THX.

So I did PR. Now it is on you.

And what about change the exception to EN fallback in this method?

@camohub Sorry, I would like to maintain it as closed (strict) as possible. So no, no fallback. But thank you for your time.

Closed via #57