WFLY-12460 Upgrade jboss-transaction-api_1.2_spec to jboss-transactio…

…n-api_1.3_spec 2.0.0CR1
Thanks for submitting your Pull Request!
Please make sure your PR meets the following requirements:

[x] Pull Request title is properly formatted: [WFLY-XYZ] Subject or WFLY-XYZ Subject
[x] Pull Request contains link to the JIRA issue(s)
https://issues.jboss.org/browse/WFLY-12460
[x] Pull Request contains description of the issue(s)
Rev the artifact ID of the transactions API
[x] Pull Request does not include fixes for issues other than the main ticket
[x] Attached commits represent units of work and are properly formatted

For bigger changes, major and minor component upgrades make sure your PR also meets following requirements:

[ ] Pull Request requires a change to the documentation
[ ] Documentation have been updated accordingly
[ ] Tests were added to cover changes

For new features ensure as well:

[ ] Analysis was done
[ ] Test Plan has been done
[ ] Tests were verified in advance

If you are not an active contributor of the WildFly project you can request sponsorship by one of the members to help guide you through the process.

retest this please

retest this please

retest this please

Dependency Tree Analyzer Output:
New Dependencies:

org.jboss.spec.javax.transaction:jboss-transaction-api_1.3_spec:jar:2.0.0.CR1:compile

Removed Dependencies:

org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:jar:2.0.0.CR1:compile

CC @wildfly/prod

FYI, I'm building this locally, with a few other spec changes and see build error:

Dependency convergence error for org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:2.0.0.CR1 paths to dependency are:
+-org.wildfly:wildfly-ejb3:18.0.0.Beta1-SNAPSHOT
+-org.jboss.spec.javax.ejb:jboss-ejb-api_3.2_spec:2.0.0.CR2
+-org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:2.0.0.CR1
and
+-org.wildfly:wildfly-ejb3:18.0.0.Beta1-SNAPSHOT
+-org.wildfly.transaction:wildfly-transaction-client:1.1.6.Final
+-org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.0.1.Final

I think this might have been due to me also fetching the ejb change (version.org.jboss.spec.javax.ejb.jboss-ejb-api_3.2_spec updated to 2.0.0.CR2).

@tomjenkinson it still fails with the same error

I pushed a commit that resolves it locally

retest this please


Update resource-limits-vcore-single-databases.md

Add info about multi az public preview

@emlisa : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off

@emlisa: I'm sorry - only the author of this article, @stevestein, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.

Hi @emlisa - This pull request was opened in the public repo. PMs should work in the private repo, per the Microsoft Docs contributor guide. Would you make this content update in the private repo instead? Thank you! We'll close this PR.


Provide binding to jump to next/previous error

Oni Version: 0.3.6
Neovim Version (Linux only): n/a
Operating System: MacOS 10.12
Issue:
When editing a file that is supported by a configured language server, I would like to be able to jump to the next/previous highlighted error. There doesn't appear to be any way to do this currently, unless I'm missing something.
Looking into the code, I see 3 ways of implementing this:

add all diagnostic errors to the Quickfix List, so they can be navigated with [q and ]q
add all diagnostic errors to the Location List, so they can be navigated with [l and ]l
add a new entry to browser/src/Services/GlobalCommand, so that custom bindings can be added by the user

The Quickfix and Location List approaches have the downside of potentially overwriting anything already in those lists. I know that workspace searches and find-all-references searches populate the Quickfix list, so that's probably not ideal for many users.
I'm also curious if there's a default binding we should set for this. JetBrains IDEs like WebStorm and IntelliJ use F2/Shift-F2 for these bindings, while VSCode and VisualStudio use F8/Shift-F8.
Expected behavior:
Press a key combo (e.g. ), and the cursor would jump to the next highlighted error.
Actual behavior:
No such binding is available or documented
Steps to reproduce:

Open a Typescript file
type in some gibberish
verify the nonsensical line is highlighted
jump to a different spot in the file
how to quickly jump back to error?

Thanks for the feedback @badosu. I'm also leaning toward the 3rd implementation I listed. I have a prototype locally just for jumping between errors. It should be possible to later add a GUI element for listing errors across the entire project.
I'll probably implement this without a default binding, since most IDEs seem to have different shortcuts for this.

I'll probably implement this without a default binding, since most IDEs seem to have different shortcuts for this.

Kudos for that :+1:, although default FX keybindings (also C-PgUp, C-PgDwn and similar) are usually not an issue for experienced vimmers (which tend to concentrate keybindings in the middle of the keyboard).

@psxpaul @badosu I agree re. avoiding the quickfix and loclists for this as I think that could open a can of worms but might be interesting to revisit once they are externalised I think the third option sound great 👍, there should be a list in the/a redux store of all the errors and the associated lines its currently being used to render markers on the buffer scroll bar but could be also be used for this


Regarding understanding different fMRI dataset

HI @akcarsten,
Thanks for explaining everything so easily, I tried the code you have provided to understand the nature of different fMRI dataset., mentioned below.

(http://www.cs.cmu.edu/afs/cs.cmu.edu/project/theo-81/www/)
(https://openfmri.org/dataset/ds000204/)

A. How do I analyze a mat format data like the one mentioned in 1 to understand which brain part is active?
B. Also, the '2' dataset is in .nii format which I could utilize like the hdr dataset you explained. But got correlation as negative for this and a similar dataset which is of a normal human.
Mainly I am trying to utilize the methods explained to understand the active
parts of the brain.
Thanks for the help, your guidance would be really helpful to me.
Regards
Nidhi

Hi @NidhiSultan,

the .mat indicates that the data is saved as a Matlab file. You can try importing it to Python with SciPy.
Its hard to tell you anything without knowing what kind of analysis you have done. If you upload the code somewhere I can have a look and give you some feedback.

Best,
Carsten

Hi @akcarsten,

I was able to use the SciPy for loading and using .mat format. Though, my concern is that the data in it is not a similar format as mentioned in the data link provided by you.
I had used the same code as provided by you, to analyze the fMRI. It gave me a negative correlation and hence no region with any activity.
Thanks for the prompt reply.
If you think for the different datasets we need to use different strategies to do the analysis, please explain that as well. I am keen on understanding fMRI more, any link for the same would be helpful as well.

Regards
Nidhi

Hi @NidhiSultan,
As I said it is hard to give you concrete advice without having seen your code.
The data in the .mat file is from a different experiment, so you will have to adapt the design matrix to match the experimental conditions. This means adapting the timings etc. Also in the linked data two stimuli were shown with the second one being of variable length ("...on the screen for four seconds, or until the subject pressed the mouse button,  ..."). This has to be taken into account as well for the analysis.
As a general remark: The notebooks in this repository are meant to outline the general process of fMRI data analysis. There are many things that are not covered in the notebooks but have to be taken into account if you want to perform a serious analysis. However there are toolboxes available for Python as well as for Matlab that have lots of useful features already implemented. I would advice you to switch to one of those libraries.
Finally on the page that provides the Matlab dataset, code and documentation is linked which should be a good starting point. Further it provides references to peer-reviewed papers that implemented various ways of analyzing the dataset.

Hi @akcarsten,
Thanks for the support. I'll research a bit on this and if required will come back with further doubts.
Regards
Nidhi


Unit tests for malicious borrower

Added some unit tests poking around with borrower1

Other places for money flowing out is the exitPool() and withdrawRevenue() in SaplingPoolContext.sol. Both methods update the balance first before making the outbound transfer, and the calls to them require a sufficient balance to be present preventing reentry style attacks to these methods.

Appreciate the test cases, thanks!


ImageService.Instance.LoadUrl() missing in Maui

Description
In Xamarin.Forms there was a function to load image from cache into a native image (Android/iOS): ImageService.Instance.LoadUrl();
I cannot find this function in Maui. Is there an alternative?

Updated version has the function again.


TrashBags#create success should redirect to Dashboards#show

Make sure that the flash message still shows (I think it will)

Done


⚠ Bofrost.fr has degraded performance

In 94dc97d, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1197 ms

Resolved: Bofrost.fr performance has improved in f0f242c after 22 minutes.


Layout issue and onItemInvoked func of NavigationView

Hi, your control library really helped me a lot, but I still have two questions, could you please help to check? Thank you so much!
1. Layout issue
I want 'Hello Word!' to display in the right panel of NavigationView, but it just displays below the last NavigationViewItem. Please check the attached screenshot for detail info, and I have put my code of NavigationView at the end.

2. onItemInvoked func
Could you please guide how to reach the goal that right panel of NavigationView shows different pages when I select different NavigationViewItem?
ItemInvoked func in Windows.UI.Xaml.Controls:
public event TypedEventHandler<NavigationView,NavigationViewItemInvokedEventArgs> ItemInvoked;
onItemInvoked fun in react-native-xaml:
onItemInvoked?: (event: NativeSyntheticEvent) => void;
As NavigationViewItemInvokedEventArgs in ItemInvoked pass the item I select, but onItemInvoked does not have such parameter, so how could I know which Item is selected?
Here is my code of NavigationView:

For the first issue, that's a bug; going to fix it in #165.
For the second part of your question, you can use this:
        <WinUI.NavigationView width={700} height={700} onItemInvoked={(e) => {
          const v = JSON.stringify(e.nativeEvent.args.invokedItem);
          alert(v); // this prints the selected navigation view item content, e.g. "Item 1".
        }}>
          <WinUI.NavigationViewItem content='Item 1' onTapped={() => setText('text #1')} priority={NavigationViewPriority.MenuItem}>
            <FontIcon glyph="" />
          </WinUI.NavigationViewItem>
          <WinUI.NavigationViewItem content='Item 2' onTapped={() => setText('text #2')} priority={NavigationViewPriority.FooterMenuItem}/>
          <TextBlock text={text} priority={NavigationViewPriority.Content}/>
        </WinUI.NavigationView>


Possibility to have optional phone field with validation

I am trying to set up a form with optional phone number, but yet with validation and preselected country code. Right now these options are conflicting with each other.
Would be nice to have some attribute controlling this :)

Not sure to understand what you mean by saying "options are conflicting"

When using react-hook-form, the defaultCountry triggers onChange, which makes it difficult to implement the validation properly, since the phone field will be prefilled with a country code then and not be empty anymore.
I solved it with this code:
  const { countryCode } = useCountryCode();
  const {
    field: { ref: fieldRef, value, ...fieldProps },
    fieldState: { error, isTouched }
  } = useController({
    name: 'phoneNumber',
    rules: {
      validate: value => {
        if (!isTouched) return true; // <--- note this!
        return matchIsValidTel(value);
      }
    }
  });
  return (
    <MuiTelInput
      {...fieldProps}
      value={value ?? ''}
      inputRef={fieldRef}
      defaultCountry={countryCode}


Edited in order to overcome error : incorrect padding

https://cdn.discordapp.com/attachments/723799666256511086/1003013971395231774/unknown.png

Thanks! This fixed the issue for me, had the same issue! The merge seems to be good :) I hope a maintainer will merge this soon.


Refreshed content for Manage Availability and Planned Maintenance

Refreshed content and changed date.

Creating a new one.


Discover SUSE subscription details

Ready to be reviewed. In draft because I didn't implement the UT and becaues it will conflict with https://github.com/trento-project/trento/pull/240
Implement the SUSE subscription details discovery mechanism.
It simpley runs SUSEConnect -s and stores the output in the KV storage under the hosts entry.
I have omitted the storage of the registration code, as it look private (easy to change in any case).
To show the data, I have implemented a basic table in the hosts view. We can definitely improve this or use the data in any other place:

I have added a new subscriptions service in this last commit; https://github.com/trento-project/trento/pull/260/commits/ceaafefae4de46a741a31fd5dd0b7f4f756e64e8
I think it makes sense to have a more service oriented code, which we can use in the web handlers. This way, if we decide to change consul at some point, it should be easier.
What do you think guys?

I have added a new subscriptions service in this last commit; ceaafef
I think it makes sense to have a more service oriented code, which we can use in the web handlers. This way, if we decide to change consul at some point, it should be easier.
What do you think guys?

LGTM! not sure we will need a dedicated service for host subscriptions when we will drop the KV store in favor of the relational model since it could be part of the host repo, but looks cleaner as for now.

@fabriziosestito This PR will conflict with https://github.com/trento-project/trento/pull/240 , so let's see if we can close that one first to adapt the current code to the unique consul health check system

@arbulu89 can you undraft this and add tests?
I think it will be easier to rebase #240 against this one, instead of the other way around.
Also this is kinda more important and urgent, since it introduces net-new value.

@stefanotorresi @fabriziosestito
UT added and PR moved to Ready to review. I have not done any change with this last commit (besides the UT), so you can just have a superficial check.


feat: send email on proposal creation/closing

fix #45
Todo

[x] Create template for new proposal email
[x] Create template for closed proposal email
[ ] Closed proposal email should include the user choice (if participated)
[x] Add webhook to receive events from webhook service
[x] Add internal CLI scripts to trigger new email type sending
[ ] Remove class="xxx" in output HTML

We have a first draft of the new proposal email:

Closed email

@aurelianoB @less, any comments about the new email types ?

Email subject particularly

I think it would make sense to have the subjects for the two types of emails follow a more similar format. For example:

open proposal:
[space_name] New proposal: proposal_title
closed proposal:
[space_name] Closed proposal: proposal_title

For the closed proposal maybe we can skip the result to keep the subject more concise. User can see the results on the body of the email.

Some UI update and improvement, to avoid HTML tag not supported by email clients

Could we move
https://github.com/snapshot-labs/envelop/blob/main/src/helpers/snapshot.ts#L5
to .env variables?

There will be no need to change it, envelop will always poll the same production hub, even on test environment.

This PR has 37 file changes :D wow. how are you managing to review this 😄
@wa0x6e PRs should be as small as possible and individual as possible

This PR has 37 file changes :D wow. how are you managing to review this 😄
@wa0x6e PRs should be as small as possible and individual as possible

🙈

During testing, I found another critical problem. During proposal closing, we remove the entity from DB. And when we try to get the instance of a removed proposal we will get nothing. That's why we never send emails on proposal removal

During testing, I found another critical problem. During proposal closing, we remove the entity from DB. And when we try to get the instance of a removed proposal we will get nothing. That's why we never send emails on proposal removal

Proposal closing are proposal for which the voting period has closed. It's not for proposal deletion.


Bug in scripts/chroot.sh

Hello,
since commit 91f43f7cb2c28e175f51a1e4338082835650293d I can't build the images anymore, because of the following errors:
platform-bbb/image-builder/scripts/chroot.sh: 235: [: xarmhf: unexpected operator
platform-bbb/image-builder/scripts/chroot.sh: 235: [: xarmhf: unexpected operator
platform-bbb/image-builder/scripts/chroot.sh: 238: [: xarmhf: unexpected operator

The problem seems to be that the comparisons on that line are done with == as comparison operator instead of =.

Sorry about that, a bashism crept in. ;)


TBCCustomEditor.DoOnProcessCommand hint

[DCC Hint] BCEditor.Editor.pas(16): H2269 Overriding virtual method 'TBCCustomEditor.DoOnProcessCommand' has lower visibility (protected) than base class 'TBCBaseEditor' (public)

I don't get this. DoOnProcessCommand is in the protected section of both (TBCCustomEditor and  TBCBaseEditor) classes.

Not getting it anymore either, not sure what happened :/


Question about editing using P2P DDIM Unconditional

I am confused by this term as "unconditional" here seems to mean not conditional to texts as I understand, but P2P (prompt-to-prompt) requires two sets of text prompts as conditions.  Aren't these two self-conflicting then?

Hello! There we're using "unconditional" to refer to the inversion technique to get the latents. During generation (latents to new image) the original caption is used to generate the attention maps as in prompt to prompt. The expectation is that the inverse and generative process aren't fully aligned, but it combines the stability of UC inversion with the control of prompt2prompt. Does that make sense?

Marking as closed but feel free to re-open for further discussions

Thanks for the quick response.  A quick follow up for further clarifications:

As the LDM model itself is conditional to text inputs, for UC inversion, the empty text input (just like the one used in classifier-free guidance) is used, right?
Then for DDIM UC Rec. (Table 1), it's UC for both inversion and reconstruction; but for P2P DDIM UC, it's UC for inversion but Conditional (and with classifier-free guidance) for generation/editing, right?


[Bug]: Direct Runner doesn't use coder registered in registry?

What happened?
I'm trying to write a coder for an unpicklable object, but when I register it with the coder registry, the direct runner seems to want to try to pickle it anyways. I've created an example in beam playground
Not sure if I'm just missing something trivial here
Issue Priority
Priority: 3 (minor)
Issue Components

[X] Component: Python SDK
[ ] Component: Java SDK
[ ] Component: Go SDK
[ ] Component: Typescript SDK
[ ] Component: IO connector
[ ] Component: Beam YAML
[ ] Component: Beam examples
[ ] Component: Beam playground
[ ] Component: Beam katas
[ ] Component: Website
[ ] Component: Spark Runner
[ ] Component: Flink Runner
[ ] Component: Samza Runner
[ ] Component: Twister2 Runner
[ ] Component: Hazelcast Jet Runner
[ ] Component: Google Cloud Dataflow Runner

Might this be related to #18490

#18490 was a red herring. The issue isn't exactly with the python direct runner either. I think the issue is that apache_beam.transforms.util.ReshufflePerKey uses type hints Any and Any data use the picklecoder rather than any specially specified coder in the coder registry.

have you tried setting with_input_types / with_output_types explicitly after create or on reshuffle ?

Yes, that indeed works. I think the issue is more that when this happens, it's difficult to identify why, especially if you think that the registry coder will get respected all the time.
I have a limited fix that I haven't gotten around to posting yet that narrows the type definitions in ReshufflePerKey for global windows. This fixes some part of the issue


Base image update for the latest RELENG image

Automated Pull request to update the base image and reduce CVEs

Duplicates #14489.


cupy.cuda.runtime.CUDARuntimeError: cudaErrorMemoryAllocation: out of memory ?

ubuntu14.04
In .bashrc,
export PATH=/usr/local/cuda/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH
export LIBRARY_PATH=/usr/local/cuda/lib64:$LIBRARY_PATH
python2.7
sudo pip install chainer (version 1.21.0)
cupy 1.0.0a1
when i run at terminal 's@s-pc:~/myproject/brain_segmentation-master$ python train.py'
Traceback (most recent call last):
File "train.py", line 91, in
main()
File "train.py", line 73, in main
outputs = vrn(x_train, train=True)
File "/home/s/myproject/brain_segmentation-master/model.py", line 96, in call
c3 = F.clipped_relu(self.c3deconv(h))
File "/usr/local/lib/python2.7/dist-packages/chainer/links/connection/deconvolution_nd.py", line 69, in call
outsize=self.outsize, use_cudnn=self.use_cudnn)
File "/usr/local/lib/python2.7/dist-packages/chainer/functions/connection/deconvolution_nd.py", line 360, in deconvolution_nd
return func(x, W, b)
File "/usr/local/lib/python2.7/dist-packages/chainer/function.py", line 199, in call
outputs = self.forward(in_data)
File "/usr/local/lib/python2.7/dist-packages/chainer/functions/connection/deconvolution_nd.py", line 182, in forward
return self._forward_cudnn(x, W, b)
File "/usr/local/lib/python2.7/dist-packages/chainer/functions/connection/deconvolution_nd.py", line 118, in _forward_cudnn
y = cuda.cupy.empty(y_shape, dtype=x.dtype)
File "/usr/local/lib/python2.7/dist-packages/cupy/creation/basic.py", line 19, in empty
return cupy.ndarray(shape, dtype=dtype, order=order)
File "cupy/core/core.pyx", line 88, in cupy.core.core.ndarray.init (cupy/core/core.cpp:6333)
File "cupy/cuda/memory.pyx", line 280, in cupy.cuda.memory.alloc (cupy/cuda/memory.cpp:5988)
File "cupy/cuda/memory.pyx", line 431, in cupy.cuda.memory.MemoryPool.malloc (cupy/cuda/memory.cpp:9256)
File "cupy/cuda/memory.pyx", line 447, in cupy.cuda.memory.MemoryPool.malloc (cupy/cuda/memory.cpp:9162)
File "cupy/cuda/memory.pyx", line 342, in cupy.cuda.memory.SingleDeviceMemoryPool.malloc (cupy/cuda/memory.cpp:7817)
File "cupy/cuda/memory.pyx", line 368, in cupy.cuda.memory.SingleDeviceMemoryPool.malloc (cupy/cuda/memory.cpp:7592)
File "cupy/cuda/memory.pyx", line 260, in cupy.cuda.memory._malloc (cupy/cuda/memory.cpp:5930)
File "cupy/cuda/memory.pyx", line 261, in cupy.cuda.memory._malloc (cupy/cuda/memory.cpp:5851)
File "cupy/cuda/memory.pyx", line 35, in cupy.cuda.memory.Memory.init (cupy/cuda/memory.cpp:1772)
File "cupy/cuda/runtime.pyx", line 207, in cupy.cuda.runtime.malloc (cupy/cuda/runtime.cpp:3429)
File "cupy/cuda/runtime.pyx", line 130, in cupy.cuda.runtime.check_status (cupy/cuda/runtime.cpp:2241)
cupy.cuda.runtime.CUDARuntimeError: cudaErrorMemoryAllocation: out of memory
when i use pycharm to run my code, it happens the problem.
Traceback (most recent call last):
File "/home/s/myproject/brain_segmentation-master/train.py", line 91, in
main()
File "/home/s/myproject/brain_segmentation-master/train.py", line 73, in main
outputs = vrn(x_train, train=True)
File "/home/s/myproject/brain_segmentation-master/model.py", line 80, in call
h = F.relu(self.bnorm1a(h, test=not train))
File "/usr/local/lib/python2.7/dist-packages/chainer/links/normalization/batch_normalization.py", line 130, in call
ret = func(x, gamma, beta)
File "/usr/local/lib/python2.7/dist-packages/chainer/function.py", line 199, in call
outputs = self.forward(in_data)
File "/usr/local/lib/python2.7/dist-packages/chainer/functions/normalization/batch_normalization.py", line 161, in forward
mean = x.mean(axis=axis)
File "cupy/core/core.pyx", line 810, in cupy.core.core.ndarray.mean (cupy/core/core.cpp:17851)
File "cupy/core/core.pyx", line 818, in cupy.core.core.ndarray.mean (cupy/core/core.cpp:17722)
File "cupy/core/reduction.pxi", line 254, in cupy.core.core.simple_reduction_function.call (cupy/core/core.cpp:51824)
File "cupy/util.pyx", line 37, in cupy.util.memoize.decorator.ret (cupy/util.cpp:1458)
File "cupy/core/reduction.pxi", line 181, in cupy.core.core._get_simple_reduction_function (cupy/core/core.cpp:50325)
File "cupy/core/reduction.pxi", line 108, in cupy.core.core._get_simple_reduction_kernel (cupy/core/core.cpp:48118)
File "cupy/core/carray.pxi", line 87, in cupy.core.core.compile_with_cache (cupy/core/core.cpp:33111)
File "/usr/local/lib/python2.7/dist-packages/cupy/cuda/compiler.py", line 125, in compile_with_cache
env = (arch, options, _get_nvcc_version())
File "/usr/local/lib/python2.7/dist-packages/cupy/cuda/compiler.py", line 22, in _get_nvcc_version
_nvcc_version = _run_nvcc(cmd, '.')
File "/usr/local/lib/python2.7/dist-packages/cupy/cuda/compiler.py", line 61, in _run_nvcc
raise OSError(msg)
OSError: Failed to run nvcc command. Check PATH environment variable: [Errno 2] No such file or directory

mjiansun shi zz

In the former case, as an error says your environment does not have enough memory. Please reduce  batch size.
In the later case, it looks nvcc is not found in your PATH environment variable. Please check configuration of pycharm.

@unnonouno Thank you very much.The above problem is solved.
But the following problem comes up.
Using gpu device 0: GeForce GTX 960 (CNMeM is disabled, cuDNN 5005)
GPU: -1
unit: 1000
Minibatch-size: 10
epoch: 20
Traceback (most recent call last):
File "chainer-master/examples/mnist/train_mnist.py", line 126, in
main()
File "chainer-master/examples/mnist/train_mnist.py", line 96, in main
if chainer.training.extensions.PlotReport.available():
AttributeError: type object 'PlotReport' has no attribute 'available'
I have done the following operation.
sudo pip uninstall chainer
sudo CUDA_PATH=/usr/local/cuda pip install chainer

PlotReport.available is newest feature and is not supported in the latest stable release v1.21.0. Please use v1.21.0 tag or use https://github.com/pfnet/chainer/archive/v1.21.0.tar.gz

At Mnist,
I found this problem was caused by 'extensions.PlotReport.available()'.When i commented this code, i can run successfully.
    # Save two plot images to the result dir     # if extensions.PlotReport.available():     #     trainer.extend(     #         extensions.PlotReport(['main/loss', 'validation/main/loss'],     #                               'epoch', file_name='loss.png'))     #     trainer.extend(     #         extensions.PlotReport(     #             ['main/accuracy', 'validation/main/accuracy'],     #             'epoch', file_name='accuracy.png'))


Reduce navbar li tag font size and navbar button text change to Login/Register

Navbar  Login button modified and footer text font size change
#473

Title : Navbar li tag and button text change
Issue No. : 71
Code Stack :
Close #<issue_no>

Video/Screenshots (mandatory)

Checklist:

[x] I have mentioned the issue number in my Pull Request.
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have gone through the  contributing.md file before contributing

Additional context (Mandatory )
Are you contributing under any Open-source programme?

GSSoC'24

I have change some tags and add some styles.
please take this pull request and consider it.
under GSSoC'24


Camshaft 0.50.0

Update to camshaft 0.50.0

Please, @dgaubert or @rochoa could you please take a look at this PR. I've deployed in staging and works without any problem but I want to be sure everything is ok.

About promise issue in turbo-carto adapter,  I'm not sure why we weren't able to detect it before. Promises in turbo-carto are there since the beginning of turbo-carto. @rochoa, do you know why it throws error now?

It is explained in the cherry-picked commit.

Oh my.. !! I read that comment like three times but I wasn't able to understand it (Friday afternoon effect). Thanks @rochoa and sorry for the noise.

Ok, ready to deploy :)

🇨🇭


AST does not include an Any token for restructured bindings

The AST will not include an Any token when parsing restructured bindings. I wrote the following program to demonstrate.
test.ts
let {a: any, b: number} = {a: 2, b: 4};

print_tokens.js
var ts = require('typescript');
var fs = require('fs');

var txt = fs.readFileSync("test.ts").toString('utf-8');
var sf = ts.createSourceFile("test.ts", txt, 1 /* es5*/ , false);

function printKinds(node) {
  console.log(node.kind);
  ts.forEachChild(node, printKinds);
}

ts.forEachChild(sf, printKinds);

We expect two Any tokens (code=112).  The output is:
180
199
198
150
152
65
65
152
65
65
154
224
65
7
224
65
7
1

When I change test.ts to
let a: any = 2;

I get
180
199
198
65
112
7
1

which includes 112.
Is this expected behavior?

Yes. The names any and number in your example are identifiers in the value space, not keywords that are types. This destructuring means "Take the a member of the RHS and assign it to the variable any and take the b member of the RHS and assign it to the variable number".
let {a: any, b: number} = { a: 2, b: 4 };

any = 43;
any = 'foo'; // error
number = 100;
number = 'bar'; // error

For completeness, if you want a type annotation on a destructuring binding you need to apply it to the whole binding, not individual elements, since ES6 uses that syntax for renaming:
let {a, b}: { a: any; b: number } = { a: 2, b: 4 };
b = 'no'; // error


Fix environment pickling

I noticed that my previous PR had introduced an issue with the Sphinx "environment pickling" process. The net result of the issue is the loss of incremental builds, although the build speed has improved. Please accept this PR as a fix to the issue including further code cleanups and documentation. :)
--
Fix Environment Pickling
Goals
Primary

Repair the recently-broken Sphinx environment pickling process

Secondary

Improve documentation of the reredirects and sitemap extensions

Background
Sphinx Environment Pickling

The Sphinx build process consists of 5 phases:

Initialization
Reading
Consistency checks
Resolving
Writing

During the Reading phase, Sphinx gathers a list of all documents to be built
This list of documents, among other build information, is persisted in the build/doctrees directory as a "pickle" file named environment.pickle

pickle is Python's built-in object serialization library
It allows arbitrary objects to be serialized into binary and deserialized back from binary

Prior to Sphinx's Reading phase the existing environment.pickle file is loaded if it exists

The list of documents read during previous builds is included with this information

When Sphinx determines the list of files to build, the existing list of documents is taken into account

Only added documents, deleted documents, and modified documents are affected
This dramatically reduces the time to complete the build as only necessary changes are built

Pickling Issue

The recent environment-cleanup PR introduced parallel read and write support to the sitemap extension
The parallel read support, while technically functional, inadvertently caused the environment picking process to fail when reading the existing environment.pickle file
This issue results in a full build of all documents regardless of their current build status

In effect, it is the same as executing make clean html for each build

Technical Details

The parallel read solution was implemented using a first-class multiprocessing.Queue object
This Queue object, while technically suited to parallel processing, is not easily serializable with Python's pickle library

Changes
sitemap extension
Added

Documentation for all functions
Status output in a format consistent with Sphinx
Improved parallel read support, including:

Functionality to prune documents from the pickled environment when they are no longer included in the build
Functionality to merge document names collected from parallel readers

Changed

Changed the Queue implementation of parallel read to List, a Python built-in object which is known to serialize without issue
Changed the phase at which document information is collected from the Writing phase to the Reading phase

reredirects extension
Added

Documentation for all functions
Status output in a format consistent with Sphinx

Usage Notes

Run make clean before using the code in this PR to ensure the existing pickled environment files are removed.

Hello @neflyte,
Thanks for your pull request! A Core Committer will review your pull request soon. For code contributions, you can learn more about the review process here.

Great questions, @justinegeffen!
To test PR 5038

Switch to your local branch containing Alan's initial environment cleanup PR. (Or, clone Alan's branch from his latest PR if that branch is no longer available).
Run make clean html to ensure any existing pickled environment files are removed. The build will run for approximately the same amount of time as any other build.
When the build is complete, confirm that the pickled environment loads without error.

Run make html to build the docs again. This time, the build should be very fast because Sphinx can detect (though pickling) that nothing has changed since the last build). The pickled environment should not throw an error.

Review the sitemap
Compare the contents of the sitemap.xml you just generated locally against the sitemap.xml in Production.

Ensure the sitemap doesn't contain version information
It's okay that the contents and order of the sitemap differs due to site architecture updates over time

Is this update tied to dependencies?

No. The sphinx-sitemap extension we're using is custom and is no longer tied to the public version. Updates to the public extension repository will no longer impact our extension in any way.

This decoupling was deliberate and intentional since the public version of the extension was developed before parallel processing was supported in Sphinx. The public extension code hasn't been updated to take advantage of faster processing capabilities.
Over time, as Sphinx functionality and popularity grew, a number of contributors have submitted attempts to address this limitation.
Alan's initial PR for the Docathon applied those learnings; however, those community-driven fixes were applied used a method to organize the data that isn't compatible with the persistence method that Sphinx supports.

The original fix Alan applied went too far by using a queue object which is good for parallel processing but isn't compatible with the way that Sphinx persists its build information. As a result, the pickle file was being written, but couldn't be read, and a pickling error would be thrown during builds.
PR-5038 stores the build data differently using a basic Python list object (a built-in data type in Python). This means that builds are now using facilities Sphinx provides to do the parallel reading instead of the queue object.

The docs sitemap was being generated during the writing phase of the build process. With PR-5038, it's now being generated during the reading phase instead. This means that sitemap generation is no longer the last action performed during the build process; it's now the second action performed.

This aligns well with Sphinx's extension model because the sitemap is simply collecting a list of page names. It doesn't need to change the pages in any way -- it just needs the list of pages themselves. Because no writing is required, it's better to do this work during the reading phase where Sphinx has event hooks that retrieves the doc names, and this retrieval can be parallelized.

Future Upgrades

It's now our team's responsibility to maintain this custom code going forward. In the future, when we choose to upgrade Sphinx to a newer version, it will be our responsibility to ensure that all of our extensions continue to work.

Important Note

In Python, information is organized in a specific way, and persisting data for later retrieval is a platform-dependent. PR-5038 has been tested on macOS and Unix-based platforms. It has not been tested on Windows platforms.

Tested locally and working perfectly, thanks @neflyte and @cwarnermm!


scheduler : fix deviceshare plugin of add\remove pod

Ⅰ. Describe what this PR does
fix deviceshare plugin of add\remove pod. For example, pod A preempts a pod in node1 in the last round preemption. If the next to schedule pod is pod B, framework will add pod A when RunFiltersWithNominatedsPod. However, the deviceSharePlugin's allocation result of pod A is not stored. As a result, the resources nominated by pod A may be occupied by pod B, although pod B's priority is lower than pod A, this case will be happened in fractional gpu allocation or topology aware allocation.

Ⅱ. Does this pull request fix one issue?

Ⅲ. Describe how to verify it
Ⅳ. Special notes for reviews
V. Checklist

[ ] I have written necessary docs and comments
[ ] I have added necessary unit tests and integration tests
[ ] All checks passed in make test

/lgtm

/approve


supabase start CLI command failing to pull from AWS ECR

Describe the bug
When attempting to run supabase start, the CLI reports a failure response from AWS's ECR (Error response from daemon: Get "https://public.ecr.aws/v2/")
This error prevents a local supabase instance from starting.
To Reproduce

Have a pre-existing, linked Supabase project
if there's a local supabase instance running, supabase stop it
run supabase start

additionally i can reproduce an identical error by attempting to docker pull public.ecr.aws/supabase/storage-api:v1.6.8
Expected behavior
I'd expect to see a Docker Container with the Supabase Services start
Screenshots
(didn't want to attach a screenshot of nothing happening)
System information

Ticket ID: 6a1b483ab4d24f9e92a19612b13e879c
Version of OS: MacOS 14.4.1
Version of CLI: 1.191.3
Version of Docker: v24.0.6
Versions of services:

       SERVICE IMAGE      │      LOCAL       │  LINKED
  ─────────────────────────┼──────────────────┼────────────
    supabase/postgres      │ <IP_ADDRESS>        │ <IP_ADDRESS>
    supabase/gotrue        │ v2.158.1         │ v2.158.1
    postgrest/postgrest    │ v12.2.2          │ v12.2.2
    supabase/realtime      │ v2.30.23         │ -
    supabase/storage-api   │ v1.10.3          │ v1.10.3
    supabase/edge-runtime  │ v1.56.1          │ -
    supabase/studio        │ 20240729-ce42139 │ -
    supabase/postgres-meta │ v0.83.2          │ -
    supabase/logflare      │ 1.4.0            │ -
    supabase/supavisor     │ 1.1.56           │ -

Additional context
when running with --debug flag, the tail end of the logs gives us:
2024/08/30 07:21:55 Recv First Byte
2024/08/30 07:21:56 Sent Header: Host [api.moby.localhost]
2024/08/30 07:21:56 Sent Header: User-Agent [Docker-Client/unknown-version (darwin)]
2024/08/30 07:21:56 Sent Header: Content-Length [0]
2024/08/30 07:21:56 Sent Header: X-Registry-Auth [e30=]
2024/08/30 07:21:56 Send Done
2024/08/30 07:22:00 Recv First Byte
failed to pull docker image: Error response from daemon: Get "https://public.ecr.aws/v2/": proxyconnect tcp: dial tcp <IP_ADDRESS>:3128: connect: connection timed out
Retrying after 4s: public.ecr.aws/supabase/realtime:v2.30.23
2024/08/30 07:22:04 Sent Header: Host [api.moby.localhost]
2024/08/30 07:22:04 Sent Header: User-Agent [Docker-Client/unknown-version (darwin)]
2024/08/30 07:22:04 Sent Header: Content-Length [0]
2024/08/30 07:22:04 Sent Header: X-Registry-Auth [e30=]
2024/08/30 07:22:04 Send Done
2024/08/30 07:22:09 Recv First Byte
failed to pull docker image: Error response from daemon: Get "https://public.ecr.aws/v2/": proxyconnect tcp: dial tcp <IP_ADDRESS>:3128: connect: no route to host
Retrying after 8s: public.ecr.aws/supabase/realtime:v2.30.23
2024/08/30 07:22:17 Sent Header: Host [api.moby.localhost]
2024/08/30 07:22:17 Sent Header: User-Agent [Docker-Client/unknown-version (darwin)]
2024/08/30 07:22:17 Sent Header: Content-Length [0]
2024/08/30 07:22:17 Sent Header: X-Registry-Auth [e30=]
2024/08/30 07:22:17 Send Done
2024/08/30 07:22:21 Recv First Byte
Stopping containers...
Pruned containers: [27c99dcbeae676d542583631dc0048b3fd91e1e6e220d81e3b59e40085aa1aea 39af3872bf599695db12678a0e96be74e87d735dbf72ecb21068f263224412e6 90fad87f3964d60b3b6e82565a088aea5ac2131eed6a15a707abeef6566172fa 260f65b51753783a45f8eb6e27083963defcaaef7d4c4885be8de916226a689d]
Pruned network: [supabase_network_hono-api]
failed to pull docker image: Error response from daemon: Get "https://public.ecr.aws/v2/": proxyconnect tcp: dial tcp <IP_ADDRESS>:3128: connect: no route to hos

Does this suggestion work for you? https://github.com/supabase/cli/issues/2210#issuecomment-2076704407

hi, @sweatybridge  !
it does not 😞
failed to pull docker image: Error response from daemon: Get "https://registry-1.docker.io/v2/": proxyconnect tcp: dial tcp <IP_ADDRESS>:3128: connect: connection timed out
Retrying after 4s: supabase/postgres:<IP_ADDRESS>
failed to pull docker image: Error response from daemon: Get "https://registry-1.docker.io/v2/": proxyconnect tcp: dial tcp <IP_ADDRESS>:3128: connect: connection timed out
Retrying after 8s: supabase/postgres:<IP_ADDRESS>
Stopping containers...
failed to pull docker image: Error response from daemon: Get "https://registry-1.docker.io/v2/": proxyconnect tcp: dial tcp <IP_ADDRESS>:3128: connect: connection timed out
Try rerunning the command with --debug to troubleshoot the error.

okay, this has resolved itself after two reboots (which i suspect is a bit of a rain-dance, not an actual solution).
.  i think possibly:

something from the Self Control App had was causing network issues (though i didn't have an active session)
docker had forgotten me, so i had to re-auth through the desktop client  (i suspect this most likely)
another docker container with a postgres configuration was standing in the way (it started throwing similar errors, though not sure why, they've cohabited, happily, for months)

thanks for your time/attention, @sweatybridge !
i am happy to mark this as resolved.

resolved (see above)

Happy to hear that you managed to resolved it!


helm: Add bpf-root configuration value in helms

This commit is to allow user to configure bpf root filesystem mount, the
default value will be still /sys/fs/bpf.
Fixes https://github.com/cilium/cilium/issues/16751
Signed-off-by: Tam Mach<EMAIL_ADDRESS>helm: Add bpf-root configuration value in helms

I don't think full testing is required here, as conformance test is already covered this helm related changes.

The smoke tests are passing and this is not covered by end-to-end tests. Reviews are in. Merging.


[Bug]: Profile images get squeezed in Cards

Contact Details
No response
What happened?
e.g. on explore page

happens on profile and organizations, too
What browsers are you seeing the problem on?
No response
Relevant log output
No response


Is it possible to provide a way to determine the size of the compressed data block when data is transmitted in segments

Hello, I am using zstd-jni to write a pr(https://github.com/netty/netty/pull/10422), and currently encounter 2 problems:

Zstd.decompressedSize() may return 0, is there any way to return the compressed block size of the data block
In reality, network packs data in frames. It's a frequent use-case that data arrive to the server in multiple chunks of a different length. The expected length should be taken from zstd header and decoder should wait until that data available before attempting to decompress. At present, a method is needed to determine whether the size of a complete compressed data block has been reached

The problem is that the data may be coming in chunks also on the sender side so when the compressor sends the frame header it does not yet know the full size of the frame - this is the case of the OutputStream filter.
I see two options:

if you don't send the messages in a streaming manner but compress the whole message at once in the sender the decompressedSize will always be populated in the frame header. If you take this route I recommend using the ZstCompressCtx/ZstdDecompressCtx as you can reuse the context to process multiple messages.

if you want to use the OutputStream/InputStream interfaces you can configure the ZstdOutputStream with closeFrameOnFlush so that you can use output.flush() to close the frame. The problem here is that on the Input side we don't give indication when read completes if the frame was closed or just the output buffer is filled. This is something we can provide.

I have not looked at your PR details. Which of the approaches are you taking? If you want to take the streaming approach I can extend the ZstdInputStream to give indication when frame is finished, e.g add isFrameFinished() method.

Thanks for the reply, this pr is using Zstd.compress and Zstd.decompress for compression and decompression operations, ZstdInputStream and ZstdOutputStream are only used for test cases, so if you can directly add methods in Zstd, tell users whether a compression The boundary of the data block is the best
In addition, is there any way to solve the problem that the return value of Zstd.decompressedSize() is 0, especially when using directBuffer, so that redundant memory allocation can be avoided, thank you

@skyguard1 , I will check the Zstd.decompressedSize - it should not return 0 if it is in the header, i.e. the frame is produced by Zstd.compress methods. Agree we need to be able to return the unconsumed data back from the decompress.

In this pr, it is necessary to use Zstd to determine whether the data block has reached a complete zstd compressed data block, just like the isFrameFinished() method does, thanks for the reply

@luben, How is the progress, are there any special difficulties here?

Can you please provide a method, when Zstd.isError is true, return false instead of throwing ZstdException?
https://github.com/luben/zstd-jni/blob/master/src/main/java/com/github/luben/zstd/ZstdDecompressCtx.java#L120
and
https://github.com/luben/zstd-jni/blob/master/src/main/java/com/github/luben/zstd/ZstdDecompressCtx.java#L156
thanks

This methods return int, so it's not possible to return false. May be we can return negative int with the error number there.

What I mean is that a new method can be provided to return the value of Zstd.isError, so that can check whether the packet is a complete zstd compressed data block, thanks for the reply

Added in last commit

Thanks for the update. And Zstd.decompressedSize() on macos even if it is a complete zstd compressed ByteBuffer, the return value is still 0, thanks

Zstd.decompressedSize() reads the size from the frame header. If the chunk was compressed in streaming mode, e.g. using ZstdOutputStream it will not have it as the streams by definition don't know the whole size. If you compress your chunks with ZstdCompressionCtx.compress or Zstd.compress (and related methods) it will have the decompressed size.

Thanks for the reply. Now I have another problem. When I compress data with Zstd, I can read the return value of Zstd.decompressedSize(), but when compressing very large data, such as an array with a length of 102400, The return value of Zstd.decompressedSize() is 65536, but when I use this return value to allocate ByteBuffer, decompression will throw com.github.luben.zstd.ZstdException: Destination buffer is too small, and when this value is increased in the code, Zstd can decompress normally, thanks

Hmm, looks like a bug returning 65536 , that's 2^16 so may be there is truncation somewhere. I will look into it.

Just checked locally and it works as expected even with large arrays:
scala> val bytes = new Array[Byte](scala.math.pow(2, 28).toInt -1)
bytes: Array[Byte] = Array(0,...
scala> val compressed2 = ctx.compress(bytes)
compressed2: Array[Byte] = Array(40, -75,...
scala> Zstd.decompressedSize(compressed2)
res13: Long = 268435455

Thanks for the reply, it may also be the problem of using netty's byteBuf. In addition, when using ZstdOutputStream to compress data, is there any way to determine how much memory should be allocated for decompressed data, just like Zstd.decompressedSize() does, thanks

If the payload is compressed in one go (like using Zstd.compress) you can write a InputStream wrapper that inspects the first few bytes (pass them to Zstd.decompressedSize) to get the size. I still don't think this is the right approach - if you input is compressed in one go, it should be possible also to decompress in one go.

But in reality, network packs data in frames. So ZstdOutputStream compression may not be suitable for this way, thanks

Either compress/decompress each network frame independently in one go (Zstd.compress/Zstd.decompress) or have your network framing inside the compressed stream. Pseudo-code:
Sender
zos = ZstdOutputStream(socketStream);

fn send(buf) {
 zos.write(buf.size)
 zos.write(buf)
 zos.flush()
}

Receiver side:
zis = ZstdInputStream(socketStream)

fn recv() {
  frame_size = zis.read_int();
  if frame_size <= 0 {
   // socket closed
  }
  buf = alloc(frame_size)
  read = 0
  while (read < frame_size) {
     num = zis.read(buf, read, buf.len() - read)
     if (num <= 0) {
       // socket closed unexpectedly
     }
     read += num
  }
  return buf
}

Thanks for your suggestion, this is the same as done in the test case, thanks

I noticed that you added a method to determine zstd compressed data blocks in ZstdDecompressCtx, but not in Zstd, like Zstd.decompress(java.nio.ByteBuffer, java.nio.ByteBuffer) and Zstd.decompress(byte[], byte[]), is there any reason so that users cannot use these two methods to determine whether it is a zstd data block? thanks

I don't understand the question. In ZstdDecompressCtx there are no methods to determine compressed data blocks, all methods there just decompress buffers/bytes arrays. All ZstdDecompressCtx methods are also exposed under Zstd by creating a temp context.

Sorry, but I didn’t find a place to call decompressDirectByteBufferWithError() and decompressByteArrayWithError() in Zstd. In addition, can you please tell me when you release it, thanks

Aaa, I see. Any reason you prefer to use the Zstd - it will create more memory pressure as it allocates/deallocates the context for each operation?

For example, users usually do not specify so many parameters in decompressDirectByteBufferWithError(ByteBuffer dstBuff, int dstOffset, int dstSize, ByteBuffer srcBuff, int srcOffset, int srcSize), but use Zstd.decompress(java.nio.ByteBuffer, java.nio .ByteBuffer) and Zstd.decompress(byte[], byte[]), which is more convenient for users to use Zstd for decompression, thanks

Considering that ZstdDecompressCtx is stateful, even if users use ZstdDecompressCtx themselves, they usually create an instance every time, so there is no difference in decompressing with Zstd, thanks

ZstdDecompressCtx is not statfull apart from being able to load a dictionary.

Well, from my point of view, can you please provide a method in Zstd, so that users can choose whether to use Zstd, if they have higher requirements for memory allocation, thanks

I think the *WithError methods are mistake and I will remove them. Errors should be exceptional and they will still be propagated as exceptions.
If you put your own framing inside the compressed stream outside the compressed packets you are always going to get complete frames. The "inside" approach I showed you above, the outside approach is something like:
fn send(buf) {
  compressed = cctx.compress(buf)
  sock.write(compressed.len())
  sock.write(compressed)
}

fn recv () -> Buf {
  compressed_size = sock.read_int()
  in = sock.read(size)
  return dctx.decompress(in, Zstd.decompressedSize(in))
}

Sorry, but this situation only applies to a certain special format, but as a general network framework, netty should be universal, please see https://github.com/netty/netty/pull/10422#discussion_r470308514,The implementation of the first version is similar to the example you gave, but it does not meet the general requirements of netty. Could you please keep the return size without throwing ZstdException? thanks

You have to chose between 2 options:

add framing outsize the compressed stream so you can split it in packets/chunks.
don't add framing outside and expose Input/Output stream without packets/chunks and rely on the internal protocol to split it (framing is inside)

You are asking for Input/Output Stream to preserve message boundaries - this cannot be done without adding some form of explicit framing.

Considering the complexity of users reading the internal frame, is it possible to provide a method to read the internal frame? thanks

No, Zstd frames are internal detail.


Add an in-image worker to RemoteRunner

Current RemoteRunner only uses external workers.  There is a minimal in-image worker that is currently only used for testing.  Making this a first class part of the system will facilitate use by other components such as Coder.

Fixed by https://github.com/feenkcom/gtoolkit-remoterunner/commit/020e16ad1b988e6d875698d6767af536840931fa


Fix CI for MacOS and Windows

Couldn't get Windows to work for now. xref https://github.com/rust-lang/rust-bindgen/issues/2179


🐛 ensure relevant types are exported from the package

Thanks @kvendrik, I did want to export the other types, just in case they're needed by any other libraries, although they are indeed not needed for that PR in web. I like the export style you suggested; I didn't even know you could do that for a default export. I've updated the PR with your suggested changes.


Privatize most constants

A lot of parser-specific constants are public, and they have no reason to be - they clutter up the docs and shouldn't be used by users anyway.
The next time an API break happens, it's probably worth making these private.

Done as of 7ec7932a823013685be708e26af776a35351736e


Support nested type narrowing

Use cases:

#21
#22
#20

10587ff

As of 10587ff we have one nesting level, but to fully support elm-w3, we'd need to mirror its phantom type I think.

As of 9ecc04d, we can nest arbitrary Uis into wrappers. There is no way though to constrain type narrowing.


feature request: create environment from PEP73 script

It would be useful to be able to create a virtual environment from a PEP73 script.
For example if you specify uv venv --script scriptfile.py it could read the dependencies from the script and create a virtual environment in the same directory.
I know that you can run the script using uv run --script scriptfile.py, but when editing/debugging the script in an IDE (like vscode) you need an environment. This functionality would be useful to quickly create the environment without needing to manually read the dependencies from the script file and then creating the environment.

Can you share more about how you'd use this from an IDE? We're a bit hesitant about adding this interface.

Can you share more about how you'd use this from an IDE? We're a bit hesitant about adding this interface.

Yes I can. Although technically I didn't mean that I would use it from the IDE directly. I will describe my use case and hopefully that will make it clear what I mean.
If I have a PEP73 script file called myscript.py and inside this script, it defines the python version and some dependencies using the PEP73 format.
Right now, I am able to run the script using uv run --script myscript.py which will create a temporary virtual environment on the system (not in the local ./.venv directory) and it will install the dependencies. This is all great and I really appreciate this capability.
However, now, for example I want to edit the script and debug it using vscode for example. When I open the script and I with vscode, before I can debug, I will need to set the interpreter (virtual environment) to use to debug. But because it is a PEP73 script, there is no virtual environment set up for it so I would then have to manually create one using uv venv and then uv pip install to install the dependencies. This will create a virtual environment at ./.venv which I can now tell vscode is my interpreter and I can debug.
But I would like to instead, be able to do uv venv --script myscript.py which will understand that myscript.py is a PEP73 script and it will be able to read the dependencies from this script and create an environment at ./.venv with my dependencies. Now I can tell vscode that this is my interpreter and I can debug.
So essentially it makes it easier to create an environment from a script file so I don't have to manually read each dependency and do a uv pip install for each one of these dependencies.
I hope this is more clear. Thanks.

Haha, I did the exact same thing. It went like this:

"WOW, this script running thing is AMAZING!!!!"
"Wait... but now VSCode has no idea what's happening in my python script and I have to make a venv to work on it effectively."

It's a good problem to have considering the script running works like magic!

I wanted to comment that I have the exact same use case as https://github.com/astral-sh/uv/issues/6637#issuecomment-2312835746, but that the uv venv --script myscript.py UI might not be desirable if (close) parity with virtualenv is desired.


[Theme] Simplify getMuiTheme

This is the result of a discussion that took place here: #3150
If we remove baseThemes entirely! we can only pass in overrides. they will then get merged on the default theme values once, and then new fields get calculated from them, this way, we'll have only one theme, one way to modify theme, and one way to override and create themes. I'm not making any sense :| let me show you an example:
const theme = getMuiTheme({palette:{}, textField:{}, ...}, ...otherOverrides);

The Algorithm:

Merge all the inputs onto a new object.
Extract base values from that object ( palette, spacing, typography, etc. )
Put them inside a new object.
Merge the new object onto the default theme onto another new object.
Calculate the muiTheme and then merge the passed in value onto it.

This will allow:
const newTheme = getMuiTheme(oldTheme, {palette: {...}, textField:{...}});

Super Annoying Ping Jitsu: @mbrookes @newoga @oliviertassinari
P.S. this is surprisingly not a breaking change :heart_eyes:

I have a suggestion that's an extension of this. And it should also be able to do it in a non-breaking fashion since it's extending this idea. :smile:
Welcome theme transformers!
Similar to the style transformers, getMuiTheme is a function that composes other functions that modify and/or compute a new muiTheme. If you pass an ordinary object, then it simply uses a deep merge implementation.
For example, if you just want to modify palette, it may be nice to just give users a function that does it for them and handles how to modify the underlying structure of the theme without them having to look at getMuiTheme() source and figure it out themselves. It also allows them to provide customizes that aren't super nested. It also allows us the flexibility to change the underlying structure when want without introducing breaking changes to muiTheme (provided users use the appropriate theme transformers).
For example:
import { cyan500 } from 'material-ui/styles/colors';
import { applyPalette, textField } from 'material-ui/themes/transformers';

const muiTheme = getMuiTheme(
  applyPalette({primary1Color: cyan500}),
  { isRtl: true }, // Since this is an object, for backwards compatibility the function used with be merge()
  textField({
    textColor: 'blue'
  }));

Of course, we can technically get ride of baseLightTheme and darkRawTheme because they could be composed functions (and like @alitaheri said the concept of base themes is still gone).
// lightTheme.js
const lightTheme = (muiTheme) => compose(
  applyPalette({...}),
  applySpacing({...}),
  applyFontFamily({...}),
};

// users code
import { lightTheme } from 'material-ui/themes/transformers';
const muiTheme = getMuiTheme(
  lightTheme,
  textField({
    textColor: 'blue'
  }));

Functions fix things :smile:

Another point to consider, if you have nested <MuiThemeProvider /> components, does it make more sense from a user perspective that it will inherit themes passed from parent theme or should it be their responsibility to past the theme from parent as first argument to the getMuiTheme().
Technically since MuiThemeProvider has access to the theme in context, it could already inherit the theme from context if we wanted too.

const muiTheme = getMuiTheme(
  applyPalette({primary1Color: cyan500}),
  { isRtl: true },
  textField({
    textColor: 'blue'
  }));

=
const muiTheme = getMuiTheme(
  {palette: {primary1Color: cyan500},
  { isRtl: true },
  {textField: {textColor: 'blue'}}
);

=
const muiTheme = getMuiTheme({
  palette: {primary1Color: cyan500},
  isRtl: true,
  textField: {textColor: 'blue'},
});

With function, we'll end up with a lot of tiny functions that only return an object of the format:
xxx(values) => {xxx: values}, we still have to document those functions which is harder than documenting object structures. you just copy paste the object and be done with it. and they can do the same, copy paste the object, remove the things they don't want changed and modify the things they want changed.

Technically since MuiThemeProvider has access to the theme in context, it could already inherit the theme from context if we wanted too.

Inheritance is kinda unexpected. But a inherit={true} is kinda cute :+1: :+1: I like that idea. this way, it will be a lot easier for the users to change change some theme styles for a subtree, efficiently :+1:

If I understand correctly, here is the issue.
const getMuiTheme = require('material-ui/lib/styles/getMuiTheme');

const muiTheme = getMuiTheme({}, {userAgent: 'all'});
const muiTheme2 = getMuiTheme({fontFamily: 'bar'}, muiTheme);

console.log(muiTheme2.baseTheme.fontFamily); // Output Roboto, but we want bar

Yeah, we are trying to address that. With my proposal this will work as expected like this::
const getMuiTheme = require('material-ui/lib/styles/getMuiTheme');

const muiTheme = getMuiTheme({userAgent: 'all'});
const muiTheme2 = getMuiTheme(muiTheme, {fontFamily: 'bar'});

I think we should provide another copmonent for this. that would take in the overrides. because with inherit the muiTheme provided might need some calculations of its own. so it should either be a new component or we should leave it to the user.

I'm a little afraid to introduce more than one component for this, especially if it's something that can be handled in user space.

, we still have to document those functions which is harder than documenting object structures. you just copy paste the object and be done with it. and they can do the same, copy paste the object, remove the things they don't want changed and modify the things they want changed.

If the keys didn't change the behavior of how other key values, I would agree. But it's really confusing for users to keep track which keys redefine the values of other parts of the object. It's much easier to say execute this function to change redefine the colors for all components.

I'm a little afraid to introduce more than one component for this, especially if it's something that can be handled in user space.

Yeah me too... I don't think it's THAT hard for users to do it... it they are crazy enough to render different theme for different subtrees they are crazy enough to hack into this too. :laughing:

If the keys didn't change the behavior of how other key values, I would agree. But it's really confusing for users to keep track which keys redefine the values of other parts of the object. It's much easier to say execute this function to change redefine the colors for all components.

I was afraid you would say that :laughing: You have a point. I don't know how we can reflect the flow of data. there no conflicts, but it's a bit hard to understand... I don't know. let's hear more opinion on this.

@oliviertassinari @newoga Do you guys think this is now safe to close? I think we'll need another umbrella issue to migrate all the code inside the getMuiTheme to their corresponding components.

@alitaheri That makes sense.

Thanks :+1:


UnicodeDecodeError: 'utf-8' codec can't decode byte 0xd5 in position 100: invalid continuation byte

I run the demo test.py:
import model_search
from model_search import constants
from model_search import single_trainer
from model_search.data import csv_data
trainer = single_trainer.SingleTrainer(
data=csv_data.Provider(
label_index=0,
logits_dimension=2,
record_defaults=[0, 0, 0, 0],
filename="model_search/data/testdata/csv_random_data.csv"),
spec=constants.DEFAULT_DNN)
trainer.try_models(
number_models=200,
train_steps=1000,
eval_steps=100,
root_dir="/tmp/run_example",
batch_size=32,
experiment_name="example",
experiment_owner="model_search_user")
but there is an error and I can't find the reason. The error informations is:
(gpu) E:\src\model_search>python test.py
2021-02-23 16:24:06.170523: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'cudart64_101.dll'; dlerror: cudart64_101.dll not found
2021-02-23 16:24:06.175639: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
Traceback (most recent call last):
File "test.py", line 12, in
spec=constants.DEFAULT_DNN)
File "E:\src\model_search\model_search\single_trainer.py", line 33, in init
text_format.Parse(f.read(), self._spec)
File "d:\Documents\Application Data\Python\Python37\site-packages\tensorflow\python\lib\io\file_io.py", line 116, in read
self._preread_check()
File "d:\Documents\Application Data\Python\Python37\site-packages\tensorflow\python\lib\io\file_io.py", line 79, in _preread_check
self.__name, 1024 * 512)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xd5 in position 100: invalid continuation byte

I have the same issue. How to fix it ?

The same problem, top up

I have fixed the problem, please refer the link:
https://github.com/tensorflow/tensorflow/issues/37924

I fixed this issue:
try to print constants.DEFAULT_DNN
and you will find this path is wrong, just change this


[Marketplace] UI corrections for bookmarks

EPAM AI DIAL chat version
0.20.0
What happened?

on the cards with long names and long versions there is not nice view

on laptop need to add tooltip explanation

on mobile need to remove tooltip if to open the card

on laptop only need to show three dots context menu on hover

dots color should be text/secondary

Confidential information

[X] I confirm that do not share any confidential information

verified on staging successfully


v2 API: Static FTS code crashes on some devices

The method isFtsAvailable() in SQLDatabaseFactory crashes during the call to endTransaction() on certain devices. The crash ultimately occurs in the call to nativeExecute(...) in the execute(...) method in SQLiteConnection.java.
This appears to be a device specific issue rather than a bug in sync-android. It has currently only been observed on:

Motorola Moto G 2nd Gen (XT1068) running Android 6.0 (Marshmallow).

The output from adb logcat when testing with the todo-sync example app shows:
12-16 15:08:31.272 F/libc    (25724): Fatal signal 11 (SIGSEGV), code 1, fault addr 0x0 in tid 25724 (m.cloudant.todo)
12-16 15:08:31.374 F/DEBUG   ( 4024): *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** ***
12-16 15:08:31.374 F/DEBUG   ( 4024): Build fingerprint: 'motorola/titan_retgb/titan_umtsds:6.0/MPB24.65-34/31:user/release-keys'
12-16 15:08:31.374 F/DEBUG   ( 4024): Revision: 'p400'
12-16 15:08:31.374 F/DEBUG   ( 4024): ABI: 'arm'
12-16 15:08:31.374 F/DEBUG   ( 4024): pid: 25724, tid: 25724, name: m.cloudant.todo  >>> com.cloudant.todo <<<
12-16 15:08:31.374 F/DEBUG   ( 4024): signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0x0
12-16 15:08:31.399 F/DEBUG   ( 4024):     r0 b8c69398  r1 be811410  r2 00000000  r3 b8c92d20
12-16 15:08:31.400 F/DEBUG   ( 4024):     r4 b8c691f0  r5 b6897118  r6 00000000  r7 b8c68828
12-16 15:08:31.400 F/DEBUG   ( 4024):     r8 00000001  r9 b8c691f0  sl 00000000  fp 00000002
12-16 15:08:31.400 F/DEBUG   ( 4024):     ip b6e90ea0  sp be8113e8  lr b67eae5b  pc 00000000  cpsr 200f0010
12-16 15:08:31.404 F/DEBUG   ( 4024):
12-16 15:08:31.404 F/DEBUG   ( 4024): backtrace:
12-16 15:08:31.405 F/DEBUG   ( 4024):     #00 pc 00000000  <unknown>
12-16 15:08:31.405 F/DEBUG   ( 4024):     #01 pc 00024e59  /system/lib/libsqlite.so
12-16 15:08:31.405 F/DEBUG   ( 4024):     #02 pc 00024173  /system/lib/libsqlite.so
12-16 15:08:31.406 F/DEBUG   ( 4024):     #03 pc 0000e759  /system/lib/libsqlite.so
12-16 15:08:31.406 F/DEBUG   ( 4024):     #04 pc 0002be41  /system/lib/libsqlite.so
12-16 15:08:31.406 F/DEBUG   ( 4024):     #05 pc 00039ad7  /system/lib/libsqlite.so
12-16 15:08:31.406 F/DEBUG   ( 4024):     #06 pc 0000ffc5  /system/lib/libsqlite.so (sqlite3_step+724)
12-16 15:08:31.406 F/DEBUG   ( 4024):     #07 pc 00075071  /system/lib/libandroid_runtime.so
12-16 15:08:31.406 F/DEBUG   ( 4024):     #08 pc 71e6b8bb  /data/dalvik-cache/arm/system<EMAIL_ADDRESS>(offset 0x1fd1000)
12-16 15:08:31.779 W/ActivityManager( 1825):   Force finishing activity com.cloudant.todo/.TodoActivity
12-16 15:08:31.779 F/DEBUG   ( 4024):
12-16 15:08:31.779 F/DEBUG   ( 4024): Tombstone written to: /data/tombstones/tombstone_00
12-16 15:08:31.779 E/DEBUG   ( 4024): AM write failed: Broken pipe
12-16 15:08:31.780 I/ActivityManager( 1825): moveHomeStack, setupComplete:true
12-16 15:08:31.780 I/BootReceiver( 1825): Copying /data/tombstones/tombstone_00 to DropBox (SYSTEM_TOMBSTONE)
12-16 15:08:31.810 I/Zygote  (  437): Process 25724 exited due to signal (11)

Workaround
Investigation has shown that if the transaction is marked as successful, the crash does not occur.  This means we could potentially work around this issue by marking the transaction as successful and also adding a DROP TABLE statement to remove the table used for the check, thus having a similar effect to rolling back the transaction. For example, the following has been tested and successfully works around the issue - changing the call to execSQL() in isFtsAvailable() to also drop the table:
tempInMemoryDB.execSQL(
   String.format("CREATE VIRTUAL TABLE %1$s USING FTS4 ( col ); DROP TABLE %1$s;",
      FTS_CHECK_TABLE_NAME));

and marking the transaction as successful immediately before the call to endTransaction():
tempInMemoryDB.setTransactionSuccessful();

@brynh Given the nature of the native and workaround sounds like it could be a SQLite bug. It could be interesting to know what version is included on that device, which I think is normally output in the log somewhere.

The version of SQLite on the Motorola XT1068 on which the bug was observed is <IP_ADDRESS>

Further testing on the following devices:

Sony Xperia Z3 (D6603) running Android 6.0.1;
Google (ASUS) Nexus 7 (2013) running Android 6.0.1

shows both these also use SQLite <IP_ADDRESS> but do not crash in the way the Motorola XT1068 does.

Interesting, but sadly doesn't really help us get to the bottom of it! Let's proceed with the workaround.


RM/ERM - Create derived table for finance data

There should be a derived table for reporting that contains all financial data. The financial data must be linked in a very specific way to get a correct output. The derived table should make it easier to use the financial data.

Closed with PR #707


Add localdev documentation on accessing etcd (#3210)

Add documentation on accessing the etcd instance in a localev setup (a Kind cluster). This shows the steps for deploying a pod (named "etcdclient") so that users can go into that pod and run etcdctl (or whatever etcd client they want), to interact directly with the etcd instance in a Kind cluster.

Closing this PR, due to a mangled rebase adding many unrelated files to this PR; a new, clean PR will be created.


Update azure-nifi-content.md

Alternative added as Airflow

@MuazmaZ

Can you review this PR?

IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

#Sign-Off

Just a quick question (newbie!), how long does it take for something to go live after the merge with the main branch?

@neeagl - varies, but if these aren't live yet, they should be published today

Thanks a lot for it, this was my first time.


Nuxt not rendering in the Electron window

Hello!
I created a nuxt project with @latest. Then added the nuxt-electron module as I used to do.
Didn't work. So because I'm on Linux now not Windows, I went to Electron docs and installed dependencies for Linux.
Now those errors went away and the Electron windows opens, but the Nuxt app is not rendered.
Followed the quick-start example, read the docs again again, went to my old Issues to see if I messed up.
So my latest attempt was matching all the Nuxt deps to your versions, electron, nuxt, vite, vite-plugin-electron, vite-plugin-electron-renderer, electron-builder, and executed pnpm install.
Nuxt keeps not rendering, no Nuxt logo loading animation. Just the empty Electron window.
Attempts to Solve

Removed type: "module" from package.json.
Added "main": "dist-electron/main.js".
Tried with bun, now pnpm.
Added --no-fork in the dev script.
Added .npmrc with shamefully-hoist=true which Nuxt projects don't require nowadays, but apparently for electron package it's still needed.

Nothing.
So to test if Electron is working on my Kubuntu operating system, I created a new Node project, with the index.html and main.js, and installed electron v33, and its working, the HTML is rendered in the Electron window.
So this points to a nuxt-electron module issue or with one of the dependencies (vite-plugin-electron, vite-plugin-electron-rendererer...).
This is my package.json:
{
  "name": "nuxt-app",
  "private": true,
  "main": "dist-electron/main.js",
  "scripts": {
    "build": "nuxt build",
    "dev": "nuxt dev --no-fork",
    "generate": "nuxt generate",
    "preview": "nuxt preview",
    "postinstall": "nuxt prepare"
  },
  "dependencies": {
    "nuxt": "^3.11.2",
    "vite": "^5.2.8",
    "vue": "latest",
    "vue-router": "latest"
  },
  "devDependencies": {
    "electron-builder": "^24.13.3",
    "nuxt-electron": "^0.7.0",
    "vite-plugin-electron": "^0.28.4",
    "vite-plugin-electron-renderer": "^0.14.5"
  }
}

Environment
Node: 20.16.0
OS: Kubuntu 24.10 (Ubuntu, Debian)

Update
Also noticed that without --no-fork in the dev script, it picks up random port for the nuxt dev server. With --no-fork, it uses localhost:3000 as normal.

Update
When I add nuxt-electron module, nuxt app doesn't load on port 3000.

So that's why the electron window shows nothing. The nuxt app is not loading at all.
But when I removed nuxt-electron from modules array, then the nuxt app loads normally.

Update
Used this template https://vutron.cdget.com/installation-and-build/getting-started and it worked right away.

By putting the exact localhost URL in the electron/main.ts file I was able to get rid of the error and get the Nuxt starting page, but it just gets stuck there and never really loads the main page

By putting the exact localhost URL in the electron/main.ts file I was able to get rid of the error and get the Nuxt starting page, but it just gets stuck there and never really loads the main page

Same here, put the URL manually and got rid of the error, but Nuxt got stuck.
Hope the author helps us soon.
In the meantime, I continued my app using the Vue + Electron template. 🤷♂😅

Today installed Node 18 latest because I'm using Node 23.3.0 to rule out incompatibility.
Same issues.
I copied the code from the repo, and added it manually in my code, nuxt module and vite config to rule out dependency issues.
Same issues.
It must be a change in nuxt package, vite package, or vite-plugin-electron.
I had hope when I saw server.hot.send({type: 'full-reload'}) deprecated (they are using some env api for version 6),, but it didn't do anything removing that line.

https://github.com/caoxiemeihao/nuxt-electron/issues/90 apparently solves this!!!

It worked! I don't know what are the downsides of using this setting, but it seems that it's fine. Thanks for the heads up!


Modify location message

Now the clients send the three closest beacons in a single message instead of three separate messages.   More validation for the values on the server side needs to be done in the future.

@luisramalho check if it's ok and I can clean it up for merge later.

I'm not sure about the JS, it seems here are too many .map and .filter, but if it works then it should be OK. I don't really know much about RxJS (yet)


Tiny typo error, super minor

'Independent' misspelled on How To Pick drop down.
Look for independant pools to promote decentralization.

thanks for the feedback. Please submit it in https://github.com/tenonedesign/fogata-ui since it's related to the webpage.


test

testsesadfasdfa

nice

Hey! Sorry, we were running an experiment here with some unreleased stuff. Should be working now.


v3.3.2-3049

Fixed, The editor cannot be initialized for the second time with ng-if directive.
Ticket(s): https://github.com/froala-labs/froala-editor-js-2/issues/3049

@kapil2704 This change is breaking our ability to set the product key and causing a permanent "unlicensed" error message in our production environment.

We are seeing the same issue as @MSchip. We pinpointed this commit as the issue since our non-angular project does not have the license verification issue. Rolling back to 3.2.6-1 for this library fixed the license issue in our angular project.


Kite failed to given code suggestions for sub methods/functions of sys.argv[].*

Hi,
Spyer git master version, failed to autocomplete the following with kite plugin:
import sys
sys.argv[1].<tab>

While jedi will works smoothly.  I'm not sure this is due to spyder or kite, so I posted this issue here and kite's support maillist.
ps.  Tested with Ubuntu 19.10 + anaconda3-2019.10 + spyder git master version.
Regards

Ok, please let us know what the Kite people say about this.

This is not something we can solve here, as I mentioned before.


Entity submission backlog: apply create as update

This other issue https://github.com/getodk/central/issues/682 captured the main cases of force-applying submissions held in the backlog. An update could be applied without the right base version, and an update about a non-existent entity that appeared to be created offline could be applied as a create.
These didn't cover the case where a missing offline create comes in after an update was force-applied as a create. In this case, we need to apply the create as an update.

Tested with success!

Tested with Success!


Add dendron.createScratchNote command

Please select if your request is either something new or an enhancement

[x] Enhancement of an existing Feature.
[ ] Request of a new feature.

Please select the area your request applies to. (Multiple selections are possible)

[ ] Onboard. Initial vault setup and import/export pods
[x] Create. Note creation, lookup, snippets and templates
[ ] Retrieve. Backlinks, references, graph view
[ ] Structure. Refactoring, multi-vault and schemas
[ ] Publish. Sharing your repo with the world
[ ] Misc (Choose this if your not sure)

Is your feature request related to a problem? Please describe
I would like to use the scratch note functionality as described in the documentation, but I do not want to click the UI button to enable that mode.
Describe the solution you'd like
I would like a keyboard shortcut that auto-creates the appropriate scratch note at the current date/time. I would expect the behavior to be identical to creating a journal note via keyboard shortcut.
Describe alternatives you've considered
I tried clicking the UI button to enable the scratch mode.
In the meantime I have simply created a single catch-all scratchpad.md standard note.
Additional context
I'm on v0.69.1. I have not modified dendron.yml from its initial configuration.
I've confirmed that the available keybindings for dendron.create* are:

If I'm not mistaken, by default, pressing "ctrl+shift+s" brings up the lookup UI and activates the scratch modifier as if you clicked the UI button (I'm not sure how this differs on MacOS). As far as I can tell, it isn't very prominent in the text documentation, but I saw it being used that way in a video clip somewhere. Below is what I get on my system when I hit those keys, with UI focus on the lookup prompt:

The relevant action seems to be dendron.lookupNote, rather than dendron.create. The three keybinds below all point to the same action, but each passes in a different argument. The documentation that goes over how to customize this behaviour is here.

Thank you @bwobst for the issue and @benhsm for the explanation.
@benhsm is right. This definitely is confusing. It has been mentioned in our community in the past.
We can create a separate command for each of those so that they don't share the same dendron.lookupNote key in the keyboard shortcut settings to fix this confusion.
In the mean time, what @benhsm suggested would do the trick. scratch note creation can be done using the keybinding Ctrl/Cmd + Shift + S

Thanks @benhsm and @hikchoi for the quick responses. That solution works for me.


Feature Request: make images pickable

I want to use Carla to create a training data set for machine learning. For this I am adding a lot of sensors (50 to 100) to a car. In my testing, img.save_to_disk is what seems to be a CPU bottleneck (90% time spent). I tried to use multiprocessing to speed this up, but libcarla.image is not pickable. According to #1738 It is difficult to make everything pickable, but maybe that is not the case for the images?
Alternatively, would porting my data export client from python to C++ be a way to add multithreading to the process of saving images?

@cassfalg the implementation of save_to_disk is already multithreading.

I have seen my python script use multiple cores when I had directly used something like cam.listen(img.save_to_disk(...)), yes. But now I am using sync mode since I need images of all sensors of the same frame. So I use cam.listen(q.put) with a queue q, similar to what the sync mode example does, with one queue per sensor. Then for each frame = world.tick() I loop over the queues from each sensor and call img.save_to_disk() - and from my experience that is not multithreaded any more. I can see two cores busy basically - the server uses one, and the client another. There are more threads visible in htop, but only one of the client threads uses a lot of CPU.
If you're talking about the implementation, do you mean the underlying C++ function that the Python API is calling? Is that still the case in sync mode?
I can see if I can strip my script down to the basics if this is a bug and try to diagnose it further?

Only the callback you provide to listen is executed asynchronously, and of course as long as it's not executing "pure Python" code (see GIL, that's you need multiprocessing...), but save to disk will work. Maybe you can make a wrap, something like
def wrap(img):
    img.save_to_disk(...)
    q.put(img)

cam.listen(wrap)

not sure if that would speed up things, give it a try.
The problem for pickling the images is that they have a reference to the world, and that cannot be pickled. I tried before and eventually gave up, you could do a quick hack and ignore the world, but pickled versions would fail to find the world (that's required for other sensors, not images tho).
Otherwise you can try passing only the buffer (img.raw_data), then save with Pillow or similar.

The reason I use the queue is that I want all saved images to be from the same frame. The synchronous_mode.py example does that, it uses a queue to do it, and I had no better (or even other) idea on how to do it. If I save the image at the point where the callback is called, I do not know if I need this particular image. Unless there are some guarantees in sync mode when spawning sensors that I am not aware of? Like: If I spawn the sensor actors in sync mode and call world.tick(), the callback will be called exactly once for each sensor? Then yes I could skip the whole queue setup.
Another reason for it: I originally thought of making small video clips when the vehicle was moving, so I had a check before saving that skipped a frame if the quadratic sum of vehicle.get_velocity() was below a threshold. I am not using that currently though.
Why (as in for what functionality) does the image need the world reference? I am using img.frame_number and img.save_to_disk(filename, color_converter). Is that using the world reference somehow? Maybe an alternative could be to introduce a PicklableImage with limited functionality?

There is only going to be one image per tick per camera, the next image won't be generated until you call world.tick(). This won't be true for event based sensors though, collision sensor for instance.
The reference to the world is in the base class of all the sensor data objects, because some sensors require it (to look up actors and this sort of thing). I believe they shouldn't, there should be a better way of implementing this, but that's how it is now.


OracleDatabase <IP_ADDRESS> XE setPassword.sh not working

We re developing an app for a bigger customer using the oracle 11g DB in Production.
Since we use Docker to do TDD / CI/CD and so on we need a Express version of the oracle DB running in a controlled env using a specific password for the DBA.
I found out the setPassword.sh is not working correctly.
✔ Positive test with random password:
Server:
$ docker run --name oracle-1 --shm-size=1g -p 1521:1521 -p 8080:8080 oracle/database:<IP_ADDRESS>-xe
ORACLE PASSWORD FOR SYS AND SYSTEM: 74ef8c123b4a1128

Oracle Database 11g Express Edition Configuration
-------------------------------------------------
This will configure on-boot properties of Oracle Database 11g Express
Edition.  The following questions will determine whether the database should
be starting upon system boot, the ports it will use, and the passwords that
will be used for database accounts.  Press <Enter> to accept the defaults.
Ctrl-C will abort.

Specify the HTTP port that will be used for Oracle Application Express [8080]:
Specify a port that will be used for the database listener [1521]:
Specify a password to be used for database accounts.  Note that the same
password will be used for SYS and SYSTEM.  Oracle recommends the use of
different passwords for each database account.  This can be done after
initial configuration:
Confirm the password:

Do you want Oracle Database 11g Express Edition to be started on boot (y/n) [y]:
Starting Oracle Net Listener...Done
Configuring database...Done
Starting Oracle Database 11g Express Edition instance...Done
Installation completed successfully.

SQL*Plus: Release <IP_ADDRESS>.0 Production on Fri Jun 26 07:07:51 2020

Copyright (c) 1982, 2011, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Express Edition Release <IP_ADDRESS>.0 - 64bit Production

SQL>
PL/SQL procedure successfully completed.

SQL> SQL>
Database altered.

SQL>
Database altered.

SQL>
Database altered.

SQL>
System altered.

SQL>
System altered.

SQL>
System altered.

SQL>
Database altered.

SQL>
Database altered.

SQL> SQL>
System altered.

SQL> Disconnected from Oracle Database 11g Express Edition Release <IP_ADDRESS>.0 - 64bit Production
#########################
DATABASE IS READY TO USE!
#########################
The following output is now a tail of the alert.log:
  Current log# 5 seq# 4 mem# 0: /u01/app/oracle/oradata/XE/redo05.log
      ALTER DATABASE DROP LOGFILE GROUP 1
Deleted Oracle managed file /u01/app/oracle/fast_recovery_area/XE/onlinelog/o1_mf_1_hhc7nz4d_.log
Completed:       ALTER DATABASE DROP LOGFILE GROUP 1
      ALTER DATABASE DROP LOGFILE GROUP 2
Deleted Oracle managed file /u01/app/oracle/fast_recovery_area/XE/onlinelog/o1_mf_2_hhc7nzbr_.log
Completed:       ALTER DATABASE DROP LOGFILE GROUP 2
Cleared LOG_ARCHIVE_DEST_1 parameter default value
Using LOG_ARCHIVE_DEST_1 parameter default value as /u01/app/oracle/product/11.2.0/xe/dbs/arch
ALTER SYSTEM SET db_recovery_file_dest='' SCOPE=BOTH;
Fri Jun 26 07:12:48 2020
Starting background process SMCO
Fri Jun 26 07:12:48 2020
SMCO started with pid=28, OS id=930

✔ Connection via sqlplus form the same container:
$ docker exec -ti oracle-1 sqlplus sys/74ef8c123b4a1128@//localhost:1521/XE as sysdba

SQL*Plus: Release <IP_ADDRESS>.0 Production on Fri Jun 26 07:11:25 2020

Copyright (c) 1982, 2011, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Express Edition Release <IP_ADDRESS>.0 - 64bit Production

SQL> SELECT 1
  2  ;

*
ERROR at line 2:
ORA-00923: FROM keyword not found where expected

SQL> SELECT 1;
SELECT 1
       *
ERROR at line 1:
ORA-00923: FROM keyword not found where expected

SQL> SELECT 1 FROM DUAL;

         1
----------
         1

SQL>

❌Negative test with specific password:
Server:
$ docker run --name oracle11g-test --shm-size=1g  -p 1521:1521 -p 8080:8080 -e ORACLE_PWD=admin oracle/database:<IP_ADDRESS>-xebase:<IP_ADDRESS>-xe
ORACLE PASSWORD FOR SYS AND SYSTEM: admin

Oracle Database 11g Express Edition Configuration
-------------------------------------------------
This will configure on-boot properties of Oracle Database 11g Express
Edition.  The following questions will determine whether the database should
be starting upon system boot, the ports it will use, and the passwords that
will be used for database accounts.  Press <Enter> to accept the defaults.
Ctrl-C will abort.

Specify the HTTP port that will be used for Oracle Application Express [8080]:
Specify a port that will be used for the database listener [1521]:
Specify a password to be used for database accounts.  Note that the same
password will be used for SYS and SYSTEM.  Oracle recommends the use of
different passwords for each database account.  This can be done after
initial configuration:
Confirm the password:

Do you want Oracle Database 11g Express Edition to be started on boot (y/n) [y]:
Starting Oracle Net Listener...Done
Configuring database...Done
Starting Oracle Database 11g Express Edition instance...Done
Installation completed successfully.

SQL*Plus: Release <IP_ADDRESS>.0 Production on Fri Jun 26 07:16:56 2020

Copyright (c) 1982, 2011, Oracle.  All rights reserved.

Connected to:
Oracle Database 11g Express Edition Release <IP_ADDRESS>.0 - 64bit Production

SQL>
PL/SQL procedure successfully completed.

SQL> SQL>
Database altered.

SQL>
Database altered.

SQL>
Database altered.

SQL>
System altered.

SQL>
System altered.

SQL>
System altered.

SQL>
Database altered.

SQL>
Database altered.

SQL> SQL>
System altered.

SQL> Disconnected from Oracle Database 11g Express Edition Release <IP_ADDRESS>.0 - 64bit Production
#########################
DATABASE IS READY TO USE!
#########################
The following output is now a tail of the alert.log:
  Current log# 5 seq# 4 mem# 0: /u01/app/oracle/oradata/XE/redo05.log
      ALTER DATABASE DROP LOGFILE GROUP 1
Deleted Oracle managed file /u01/app/oracle/fast_recovery_area/XE/onlinelog/o1_mf_1_hhc85zow_.log
Completed:       ALTER DATABASE DROP LOGFILE GROUP 1
      ALTER DATABASE DROP LOGFILE GROUP 2
Deleted Oracle managed file /u01/app/oracle/fast_recovery_area/XE/onlinelog/o1_mf_2_hhc85zxs_.log
Completed:       ALTER DATABASE DROP LOGFILE GROUP 2
Cleared LOG_ARCHIVE_DEST_1 parameter default value
Using LOG_ARCHIVE_DEST_1 parameter default value as /u01/app/oracle/product/11.2.0/xe/dbs/arch
ALTER SYSTEM SET db_recovery_file_dest='' SCOPE=BOTH;
Fri Jun 26 07:18:07 2020

***********************************************************************

Fatal NI connect error 12170.

  VERSION INFORMATION:
        TNS for Linux: Version <IP_ADDRESS>.0 - Production
        Oracle Bequeath NT Protocol Adapter for Linux: Version <IP_ADDRESS>.0 - Production
        TCP/IP NT Protocol Adapter for Linux: Version <IP_ADDRESS>.0 - Production
  Time: 26-JUN-2020 07:18:07
  Tracing not turned on.
  Tns error struct:
    ns main err code: 12535

TNS-12535: TNS:operation timed out
    ns secondary err code: 12606
    nt main err code: 0
    nt secondary err code: 0
    nt OS err code: 0
  Client address: (ADDRESS=(PROTOCOL=tcp)(HOST=<IP_ADDRESS>)(PORT=48138))
WARNING: inbound connection timed out (ORA-3136)
Fri Jun 26 07:21:53 2020
Starting background process SMCO
Fri Jun 26 07:21:53 2020
SMCO started with pid=26, OS id=927

❌ Connection via sqlplus form the same container:
$ docker exec -ti oracle11g-test sqlplus sys/admin@//localhost:1521/XE as sysdba
SQL*Plus: Release <IP_ADDRESS>.0 Production on Fri Jun 26 07:17:07 2020

Copyright (c) 1982, 2011, Oracle.  All rights reserved.

ERROR:
ORA-01017: invalid username/password; logon denied

Enter user-name: sys
Enter password:
ERROR:
ORA-12547: TNS:lost contact

Enter user-name: SYSTEM
Enter password:
ERROR:
ORA-12547: TNS:lost contact

SP2-0157: unable to CONNECT to ORACLE after 3 attempts, exiting SQL*Plus

https://github.com/oracle/docker-images/blob/9834f3c2bcb4b3b2d7bd38fe4ac42c330a87b30d/OracleDatabase/SingleInstance/dockerfiles/<IP_ADDRESS>/setPassword.sh#L1-L10

@stefanwendelmann, IMO the tests above have nothing to do with setPasswords.sh.
runOracle.sh does not seem to invoke setPasswords.sh. The password you set with -e is assigned through xe.rsp. admin does not seem to be a valid value, do not know why though. Try anything other value, i.e. ADMIN, it works

@gvenzl is this issue due to admin not meeting password complexity requirements?

@gvenzl is this issue due to admin not meeting password complexity requirements?

Oracle does not support <IP_ADDRESS> XE now. Please migrate to 21.3 XE.


Add drag&drop navigation order

@a-fralou Rested navigation drag and drop reorder and input performance on preview environment.
Browsers:
Desktop — Chrome, Firefox, Safari
Mobile — iOS 18.0.1 — Safari, Android 14 — Chrome


This is not a issue but a question about xml

I wanna write a script that gets the xml properties of a url and then saves it in the websites folder do you have suggestions or methods to do that?

I just pushed the beginnings of v2 (https://github.com/lightos/credmap/tree/v2), which I started a year ago, but then got really busy with other things. In this version it is easier to create a generalized module which can handle many websites even if they are not in the websites folder.
For example, if you look at the code for the digitalocean module (https://github.com/lightos/credmap/blob/v2/websites/digitalocean.py#L23-L47), it is fairly general and that code could be expanded slightly to work on plenty of other websites, even if they are not in the websites folder.
I will try to finish v2 little by little, whenever I get the time to work on it.

Okay thanks for the reaction let me know when your done.


add datagrams support

add send and receieve message to StreamCreator so that datagrams can be sent and received
required for https://github.com/quic-go/webtransport-go/pull/99

This is incorrect, or at the very least maximally confusing. What you’re exposing here is QUIC datagrams, not HTTP/3 datagrams.

API proposal for an HTTP datagram API: https://github.com/quic-go/quic-go/issues/3522#issuecomment-1773671123