Cleanly separate the documents metrics.md and metrics-reference.md

The problem
The purposes of the documents metrics.md and metrics-reference.md have become a little muddled. We are adding metrics in some places and not others and it's not clear which document to read.
Detailed description
metrics.md should be describing how a user can get information from our metrics, whereas metrics-reference.md is supposed to be an exhaustive list giving a description of each metric.
As well as filling in any gaps in metrics-reference.md, we should try to avoid just dumping the names of every metric into metrics.md, instead we should simply say which prefix to look under for particular categories of information and then point readers to metrics-reference.md for more details.
Acceptance criteria

Add any missing metrics to metrics-reference.md
Avoid describing exact metrics in metrics.md (exceptions can be made if it is necessary to illustrate an example, but we should avoid overdoing it)

Action point: Dump all metrics and update the metrics reference accordingly.

Fixed by #469


Logloss

How to get the logloss score for the prediction?

Try this:
@tf.function
def test_step(inp, tar):
    tar_inp = tar[:, :-1]
    tar_real = tar[:, 1:]

    enc_padding_mask, combined_mask, dec_padding_mask = create_masks(inp, tar_inp)

    predictions, _ = transformer(
         inp, tar_inp,
         True,
         enc_padding_mask,
         combined_mask,
         dec_padding_mask
    )
    loss = loss_function(tar_real, predictions)
    test_loss(loss)

I am assuming you have the sequences in the same format as mine, or you can adjust the tar_inp and tar_real part.
The test_loss is the same as the train_loss from my code i.e. a tf.keras.metrics.Mean instance.
Moreover, you can call this function in the training loop as a validation step to monitor validation loss while training.

Sorry. I meant, how to get the softmax values as mentioned in the original paper?

Umm, still not sure about what exactly you meant, but if you want the softmax output from the logits, use tf.nn.softmax(logits).
Perhaps you can highlight the part from the paper that you are trying to point out?

yeah i want the logits only. from which block can i get the logits for the prediction?

predictions, _ = transformer(
     inp, tar_inp,
     True,
     enc_padding_mask,
     combined_mask,
     dec_padding_mask
)

This returns the logits for the generated sequence of shape (batch_size, sequence_length, vocab_size)

predictions[: ,-1:, :]
In this what are the three dimensions?
Sorry for asking so many doubts

No issues! I'll try to keep this as simple as possible:
While training, we put the complete target sequence as the decoder input, so for each word to be predicted, at the decoder, we have the original word as the decoder input instead of the supposedly incorrectly predicted word (I am assuming you know seq2seq basics). It's called Teacher Forcing
However, in the inference (prediction or testing) step, we do not have the expected output to be fed in the decoder, so we have to use the previously predicted word as the decoder input for the next word prediction.
So in the code, as and when we predict tokens (words), we append them to the decoder inputs. So the variable predictions contains the complete predicted sequence so far. But we only need the last word here; the -1 indicates the last token of the predicted sequence. To elaborate even further, consider a question answering task with the same model instead of summarization:
Q: What is your name?
Step 1:
Enc Input: What is your name?
Dec Input:
Output:  My                     ... (Hence we only take the last word)
Step 2:
Enc Input: What is your name?
Dec Input:  My
Output:  My name
Step 3:
Enc Input: What is your name?
Dec Input:  My name
Output:  My name is
...
Hope you got it :)


Fix authority-discovery cannot exit problem

Related #3452

BTW: there's some error message like:
2019-09-10 18:12:14 Failed to put hash 'Key(b"\x12 F \x87\x98\xc8\x0b\xe6S\x1cjdT1-\xb7\xd1PYb7k<\xca\x16\xcd\x18\xf9\x10\xd6\xfe\xa8^")' on Dht.
2019-09-10 18:12:14 Value for hash 'Key(b"\x12 \x94\xb4\x12\xff\xd7\x93J\xeay\xad\xf6\xdd\xb5\x19\x887\xaa\x9b&\xb3:T\xc1\xd7\xa4T\xc67\xd6\xdd\x81\xeb")' not found on Dht.

Ty, but already fixed by: https://github.com/paritytech/substrate/pull/3581

np


heartbeat check

wondering if a feature can be added to do a heartbeat check to see if the site is working, and if not, rollback the link to the previous build.
i've seen some of the deployment services do this and seems pretty nice.
thank you for the amazing project!

I think you can do this by yourself.
Add a new part to your playbook where you can do the heartbeart check after the deploy role. If the app is broken, you can include the rollback role.

ok, i'll try to add it into a task.
thank you very much.


Add LibriSpeech Base class for metadata

Add LIBRISPEECHBase class that returns the same information as LIBRISPEECH, but returns a file path instead of the loaded waveform. See #2539 for some context.
This design choice results in 2x API for the dataset -- one for metadata mode, and one for wav mode. We may want to think of a better way to arrange the docs on the website since most variables are repeated, so while this under discussion, I have simply left it out of the docs build for now.
TODO: testing
cc: @leo19941227

switching to different approach for enabling easy access to metadata, similar to https://github.com/pytorch/audio/issues/910#issuecomment-693564762

switching to a different approach for enabling easy access to metadata, similar to https://github.com/pytorch/audio/issues/910#issuecomment-693564762


v0.1.11 and main branch: error: MaybeUninit::<T>::zeroed is not yet stable as a const fn

Following the docs, compiling from source i can not get past this error.
Compiling vectors v0.1.1 (/opt/pgvecto.rs)
error: `MaybeUninit::<T>::zeroed` is not yet stable as a const fn
  --> src/postgres/index.rs:46:18
   |
46 |         unsafe { std::mem::MaybeUninit::<pgrx::pg_sys::IndexAmRoutine>::zeroed().assume_init() };
   |                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   |
   = help: add `#![feature(const_maybe_uninit_zeroed)]` to the crate attributes to enable

error: could not compile `vectors` (lib) due to previous error

The docs are not very detailed on the prerequisites of rust. After some previous errors, i activated nightly and miri and updated from my distros default rust version 1.71.1 to 1.74.1.
Is this a bug, something that is missing in the docs, or am i doing something wrong?
Thanks,
Norman

You should install rustup, instead of rustc. If you are using rustup to manage toolchains, the nightly rustc of proper version will be download automatically since there is a rust-toolchain.toml file. It's the recommanded way to develop and build from source.


Out of memory processing large FOV data

I am attempting to segment large 3D montages of thousands of cells. Each z stack is 696 mb, and there are 219 of them. Image size is 2880 x 2880 px. 43 planes per z stack.
I received an OOM error on a decent machine with 64 gb RAM available. First, I tried to segment all 219 of the z stacks using the command line. This is where the first error message occurred, before any prediction could begin at the data loading stage:
`(cellpose2) C:\Users\3i>python -m cellpose --dir E:/mydata/ --pretrained_model nuclei --diameter 24 --save_png --use_gpu --do_3D --save_tif --batch_size 8
matplotlib not installed
** CUDA version installed and working. **

using GPU
Traceback (most recent call last):
File "C:\Users\3i.conda\envs\cellpose2\lib\runpy.py", line 193, in run_module_as_main
"main", mod_spec)
File "C:\Users\3i.conda\envs\cellpose2\lib\runpy.py", line 85, in run_code
exec(code, run_globals)
File "e:\cellposelatest\cellpose-master\cellpose_main.py", line 265, in
main()
File "e:\cellposelatest\cellpose-master\cellpose_main.py", line 132, in main
images = [io.imread(image_names[n]) for n in range(nimg)]
File "e:\cellposelatest\cellpose-master\cellpose_main_.py", line 132, in
images = [io.imread(image_names[n]) for n in range(nimg)]
File "e:\cellposelatest\cellpose-master\cellpose\io.py", line 40, in imread
img = tifffile.imread(filename)
File "C:\Users\3i.conda\envs\cellpose2\lib\site-packages\tifffile\tifffile.py", line 715, in imread
return tif.asarray(**kwargs)
File "C:\Users\3i.conda\envs\cellpose2\lib\site-packages\tifffile\tifffile.py", line 2944, in asarray
typecode, product(series.shape), out=out
File "C:\Users\3i.conda\envs\cellpose2\lib\site-packages\tifffile\tifffile.py", line 8349, in read_array
result = numpy.empty(count, dtype) if out is None else out
MemoryError`

Then, I tried cutting the number of available files down to only 10 files (each a z stack of 680 mb). This time, the above memory error was avoided, but another memory error occurred during processing of the first image (I think during the 'running zy' stage.
Finally, I tried running cellpose via command line on a single z stack. This seemed to work, but then failed to save the masks as png, and the seg.npy file is unreadable in the cellpose GUI. From that, I received the following error message:
`flows computed 7939.92s
dynamics computed 8010.48s
masks computed 8409.50s
estimated masks for 1 image(s) in 8988.74 sec

TOTAL TIME 8988.74 sec
saving results
Traceback (most recent call last):
File "C:\Users\3i.conda\envs\cellpose2\lib\runpy.py", line 193, in run_module_as_main
"main", mod_spec)
File "C:\Users\3i.conda\envs\cellpose2\lib\runpy.py", line 85, in run_code
exec(code, run_globals)
File "e:\cellposelatest\cellpose-master\cellpose_main.py", line 265, in
main()
File "e:\cellposelatest\cellpose-master\cellpose_main.py", line 178, in main
io.masks_flows_to_seg(images, masks, flows, diams, image_names, channels)
File "e:\cellposelatest\cellpose-master\cellpose\io.py", line 187, in masks_flows_to_seg
masks_flows_to_seg(image, mask, flow, diam, file_name, channels_img)
File "e:\cellposelatest\cellpose-master\cellpose\io.py", line 219, in masks_flows_to_seg
'est_diam': diams})
File "C:\Users\3i.conda\envs\cellpose2\lib\site-packages\numpy\lib\npyio.py", line 536, in save
pickle_kwargs=pickle_kwargs)
File "C:\Users\3i.conda\envs\cellpose2\lib\site-packages\numpy\lib\format.py", line 633, in write_array
pickle.dump(array, fp, protocol=2, **pickle_kwargs)
OverflowError: cannot serialize a string larger than 4GiB`

I am using the MXNET version of cellpose, but plan to update to the Pytorch version today and try it there.
It seems to be that possibly, it might be better behaviour for cellpose to treat each z stack separately, performing memory dumps in between. Is such a thing possible?
Most appreciatively,
Michael

Hey!
The problem with this is numpy not being able to process strings of this size. you need to change the numpy working mode. I ran into the same issue and was able to solve the problem. Google will help you further, sadly I don't remember it 100%.

Hey!
The problem with this is numpy not being able to process strings of this size. you need to change the numpy working mode. I ran into the same issue and was able to solve the problem. Google will help you further, sadly I don't remember it 100%.

Hey :)
Thanks, that led to some digging. I can't find anything about changing the numpy mode at the moment.
I can find some stuff related to 'pickle', and that things might work better if I was able to change the pickle.dump protocol to 4 somewhere, instead of 2. I can find it myself given enough time, but as this is a fix that may help the community I will wait on that.
Others say that 4GiB is a hard coded limit, and so this would either require choice memory dumps or splitting files up into manageable chunks. I thought this might be already done by 'tiling' but perhaps that splits up files for normalizing the image size rather than for memory reasons?
Papalgirauscher -
Do you think I am having the same issue between the two error messages?
(Update, I got the PyTorch version up and running, and I see the same problem).
M

Hey :)
Thanks, that led to some digging. I can't find anything about changing the numpy mode at the moment.
I can find some stuff related to 'pickle', and that things might work better if I was able to change the pickle.dump protocol to 4 somewhere, instead of 2. I can find it myself given enough time, but as this is a fix that may help the community I will wait on that.
Others say that 4GiB is a hard coded limit, and so this would either require choice memory dumps or splitting files up into manageable chunks. I thought this might be already done by 'tiling' but perhaps that splits up files for normalizing the image size rather than for memory reasons?
Papalgirauscher -
Do you think I am having the same issue between the two error messages?
(Update, I got the PyTorch version up and running, and I see the same problem).
M

Update: perhaps you are describing mmap_mode in numpy
https://stackoverflow.com/questions/42727412/efficient-way-to-partially-read-large-numpy-file
This sounds like a potential option?

Update: perhaps you are describing mmap_mode in numpy
https://stackoverflow.com/questions/42727412/efficient-way-to-partially-read-large-numpy-file
This sounds like a potential option?

The first issue you're having I think has been resolved in the latest version of cellpose that loops in the CLI? there is no longer a line in __main__.py that tries to load all the files (images = [io.imread(image_names[n]) for n in range(nimg)]). instead the loop loads a single image at a time. Can you try upgrading if you haven't already?
If you are having issues saving NPY outputs you can turn that output off with the --no_npy flag in the command line interface. but if you're running out of memory due to the size of the tiff we don't currently have a workaround for that -- we recommend splitting the stack and stitching the masks afterwards.

The first issue you're having I think has been resolved in the latest version of cellpose that loops in the CLI? there is no longer a line in __main__.py that tries to load all the files (images = [io.imread(image_names[n]) for n in range(nimg)]). instead the loop loads a single image at a time. Can you try upgrading if you haven't already?
If you are having issues saving NPY outputs you can turn that output off with the --no_npy flag in the command line interface. but if you're running out of memory due to the size of the tiff we don't currently have a workaround for that -- we recommend splitting the stack and stitching the masks afterwards.

Thanks Carsen.
Yeah, the above was all from the new version that loops in the CLI.
The --no_npy flag is a good tip, but didn't solve the problem I was having and I still run out of memory (VRAM). I will investigate splitting and stitching, yes. I guess whatever I use to do that, the stitching can be computed based on the masks, and the same operation can be applied to the raw image data (rather than computing two separate stitchings, one for raw, one for masks).

Hello!
I tracked down how to create larger npy files. You need to change the protocol in numpy to 4.
python3.7/site-packages/numpy/lib/format.py
Change line 664
pickle.dump(array, fp, protocol=3 ...
to
pickle.dump(array, fp, protocol=4 ...
Best wishes,
Jan

Thanks! That seems to have worked. I can now produce .npy files from my largest images so far. The individual (z stack) images are about 700 mb each, whereas the npy file for each is 13 gb. I agree with Carsen and Marius that perhaps using npy arrays in this way for saving the data is suboptimal. I think they are checking whether there is a better format that can be used by all, for downstream processing. For now, just the tif masks are pretty good.

closing this issue, I agree that the npy format is not great, for now we'll keep it as the default, but I think soon we will only save the mask images


Revert "Update for clang dependency scanning API change"

Reverts apple/swift#64909
corresponds to https://github.com/apple/llvm-project/pull/6617

https://github.com/apple/llvm-project/pull/6617
@swift-ci please test


Update BlinkyApp to recognize the Minnowboard D0 board

BlinkyApp for the driver sample was hardcoded to only recognize the B3 version of the Minnowboard, but I have a D0 version. As far as I can tell, the pinout is the same for both models.
Not sure if there are other Minnowboards out there that have the same setup.

Hi @AndrewGaspar, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Andrew Gaspar). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;


[AT] Update BDT version

What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)
Please review http://spark.apache.org/contributing.html before opening a pull request.

Plese fill the PR template


support for long,float and double data types in systemdispatcher

This adds support for passing long , float or double data to/from QML/Java

Will Submit again.


Add backends origin

add backends origin
Introduces the backends origin where all the backend traffic will enter
the environment. E.g. of backends are publishers and signon. The
backends assets are served by the S3 bucket in a similar fashion to the
frontends origin.
Modifications done in this PR:

deploy concourse pipeline now uploads the rails assets of publisher
and signon to the backends-rails-assets S3 bucket
origin module is refactored to allow a third origin backends in
addition to the previous 2 origins www_frontends and
draft_frontends:
i. listerner rules are defined outside the module because backends
origin serves many apps and it is complex to create them inside the
module.
ii. providers are delegated from parent to child origin module, in
with: https://www.terraform.io/docs/language/modules/develop/providers.html

Refs:

trello card
publishers new image
signon new image

Is there a benefit to using a shared ALB+CloudFront (an 'origin') distribution for all 'backend' apps? If we instead created an ALB/other resources per app, that might be easier to follow. What do you think?

We discussed on Slack last week and the decision was Cloudfront + S3 per app is too much. It is similar for the Frontends but there it is hidden by the router proxy.

If this isn't possible, we should update the "add an app" docs to reflect that one needs to add backend apps to the backend origin - happy for you to put up a separate PR for this.

We can certainly do that.


C#: Improve CFG for assignments

Write accesses in assignments, such as the access to x in x = 0 are not
evaluated, so they should not have entries in the control flow graph. However,
qualifiers (and indexer arguments) should still be evaluated, for example in
x.Foo.Bar = 0;

the CFG should be x --> x.Foo --> 0 --> x.Foo.Bar = 0 (as opposed to
x --> x.Foo --> x.Foo.Bar --> 0 --> x.Foo.Bar = 0, prior to this change).
A special case is assignments via acessors (properties, indexers, and event
adders), where we do want to include the access in the control flow graph,
as it represents the accessor call:
x.Prop = 0;

But instead of x --> x.set_Prop --> 0 --> x.Prop = 0 the CFG should be
x --> 0 --> x.set_Prop --> x.Prop = 0, as the setter is called after the
assigned value has been evaluated.
An even more special case is tuple assignments via accessors:
(x.Prop1, y.Prop2) = (0, 1);

Here the CFG should be
x --> y --> 0 --> 1 --> x.set_Prop1 --> y.set_Prop2 --> (x.Prop1, y.Prop2) = (0, 1).

I have kicked off a dist comparison to check for performance regressions, and will report the numbers as soon as they are ready.

Here are the performance numbers (before first column, after second column):
Project              0d5f5b2291c02b46aead2fc256f847cf06c1ea32@26a0f4b100ec873cf3337434e6fe99c02b6b9c17  0d5f5b2291c02b46aead2fc256f847cf06c1ea32@23b450911bd9c01ddd269b90eba0ae4ab97c484b
monodevelop          722                                                                                253                                                                                0.350416
pythonnet            17                                                                                16                                                                                0.941176
mono                 473                                                                                465                                                                                0.983087
PowerShell           226                                                                                223                                                                                0.986726
runuo                307                                                                                304                                                                                0.990228
coreclr              253                                                                                251                                                                                0.992095
OneOf                201                                                                                200                                                                                0.995025
corefx               737                                                                                741                                                                                1.00543
EntityFrameworkCore  552                                                                                560                                                                                1.01449
ql                   45                                                                                46                                                                                1.02222
OrchardCore          178                                                                                183                                                                                1.02809

I must say, I am puzzled by the numbers for monodevelop, I don't believe in the speedup by this change. I will try to rerun the performance test, once I have fixed whatever needs to be fixed for the broken tests.

Here are the updated performance numbers, including a small bug fix:
Project              0d5f5b2291c02b46aead2fc256f847cf06c1ea32@26a0f4b100ec873cf3337434e6fe99c02b6b9c17  0d5f5b2291c02b46aead2fc256f847cf06c1ea32@8a66693a5aebcfa379bf9cdf32d751d6c4bc4c38
monodevelop          715                                                                                254                                                                                0.355245
runuo                310                                                                                150                                                                                0.483871
mono                 476                                                                                460                                                                                0.966387
OneOf                202                                                                                199                                                                                0.985149
corefx               735                                                                                725                                                                                0.986395
EntityFrameworkCore  551                                                                                547                                                                                0.99274
roslyn               703                                                                                701                                                                                0.997155
OrchardCore          180                                                                                180                                                                                1
pythonnet            17                                                                                17                                                                                1
coreclr              252                                                                                253                                                                                1.00397
PowerShell           223                                                                                225                                                                                1.00897
ql                   45                                                                                46                                                                                1.02222

As we can see, monodevelop still has a surprising speedup, but this time runuo also has a massive speedup 😕 I will try to run the tests one more time.

Not surprisingly, it turns out that the performance numbers above were incorrect (a bug in the performance framework). I have fixed the bug, and now the numbers look as expected (i.e., no regression in performance), the report is here (internal link).


Cannot drag explorer list filter widget back to right side

Issue Type: Bug
Testing #66902
repo

In explorer
Start filtering to type
Drag the filter widget to the left side.
Now try dragging it back to the right side

Bug
Widget is now stuck on left side. I can't drag it back to the right side
VS Code version: Code - Insiders 1.31.0-insider (7f136b44cff0cd3486ac88b43598b8c72b025d16, 2019-01-31T06:13:53.077Z)
OS version: Darwin x64 18.2.0

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-4770HQ CPU @ 2.20GHz (8 x 2200)

GPU Status
2d_canvas: enabledchecker_imaging: disabled_offflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: enabledrasterization: enabledsurface_synchronization: enabled_onvideo_decode: enabledwebgl: enabledwebgl2: enabled

Load (avg)
3, 3, 3

Memory (System)
16.00GB (1.08GB free)

Process Argv
-psn_0_22394202

Screen Reader
no

VM
20%

Can not repro. Forwarding to @joaomoreno to try to repro

I can repro weird behaviour when zoomed in... it also gets worse when sidebar is on the right. Could that be it @mjbvz?

I can only repo this reliably on a multi-monitor setup. I am using zoom level zero with the bar on the left side

OK that was embarrassing!


Fix data frame info while debugging

For #11657
Fix data frames while debugging and add a bunch of tests for debugger variable provider.

Codecov Report

Merging #11713 into master will decrease coverage by 0.02%.
The diff coverage is 33.33%.

@@            Coverage Diff             @@
##           master   #11713      +/-   ##
==========================================
- Coverage   60.72%   60.70%   -0.03%
==========================================
  Files         629      629
  Lines       34007    34001       -6
  Branches     4795     4793       -2
==========================================
- Hits        20651    20640      -11
- Misses      12350    12353       +3
- Partials     1006     1008       +2

Impacted Files
Coverage Δ

...active-common/intellisense/intellisenseProvider.ts
37.65% <0.00%> (ø)

src/client/datascience/jupyter/jupyterVariables.ts
25.71% <0.00%> (+0.71%)
:arrow_up:

src/client/datascience/types.ts
100.00% <ø> (ø)

src/client/datascience/constants.ts
99.73% <100.00%> (+<0.01%)
:arrow_up:

src/datascience-ui/react-common/arePathsSame.ts
75.00% <0.00%> (-12.50%)
:arrow_down:

src/client/common/utils/platform.ts
64.70% <0.00%> (-11.77%)
:arrow_down:

src/client/linters/pydocstyle.ts
86.66% <0.00%> (-2.23%)
:arrow_down:

src/client/datascience/debugLocationTracker.ts
76.56% <0.00%> (-1.57%)
:arrow_down:

src/client/common/process/proc.ts
14.49% <0.00%> (-0.73%)
:arrow_down:

src/client/debugger/extension/adapter/factory.ts
96.42% <0.00%> (-0.45%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bd12464...20484dd. Read the comment docs.


Issues with Licensing

C:/Users/xxx/Appdata/Local/Android/sdk\tools\bin\sdkmanager --update
Error: Could not find or load main class '-Dcom.android.sdklib.toolsdir=$APP_HOME
Caused by: java.lang.ClassNotFoundException: '-Dcom.android.sdklib.toolsdir=$APP_HOME
From previous threads, I have changed @rem execute sdkmanager and the other one where I appended additional arguments. How would I solve this error?

Hi, could you please confirm if this problem still exists with the latest versions on stable or master?
Thanks a lot

Without additional information, we are unfortunately not sure how to resolve this issue. We are therefore reluctantly going to close this bug for now. Please don't hesitate to comment on the bug if you have any more information for us; we will reopen it right away!
Thanks for your contribution.


[ASoC 2022] Enable data caching cross jobs to boost job performance with high memory efficiency

What would you like to be added:

Refactor the caching API to support inter-job caching, which means the lifecycle of datasets should be independent of training jobs.
Implement a caching policy that interacts with the distributed cache runtime to retain popular datasets in memory, such that the cache efficiency is maximized.

Why is this needed:
Caching datasets in memory of the local cluster helps to accelerate the training jobs. Typically, popular and public datasets might be used by multiple jobs. Therefore, it helps improve the caching efficiency to make datasets sharable across training jobs with a well-designed caching policy.

Hello everyone, I am Sanskar Bhushan, a student from Delhi Technological University, India. I am a Google Summer of Code 2022 participant with OSGeo. I am currently a member of the pgRouting project. Also, I have experience with backend development in Go working with various libraries and frameworks including Gin, GORM, and Ants. I have completed Kubernetes the hard way and have a thorough knowledge of its components and their dependencies including the working of API machinery. I am interested in the KubeDL ASoC project "Enable data caching cross jobs to boost job performance with high memory efficiency" and wanted to seek your approval and suggestions if I am qualified enough, so that I can start working on my proposal. Also, I think that @jian-he sir is the mentor of this project and has dropped a message to him on slack as an introduction, though it is almost similar to this one. Sorry for being somewhat lazy here. Any sort of additional remarks would be appreciated.


Object does not support property or 'getComputedStyle' method <=IE8

Hi Robin,
I´m get the error when the focus is set to the field:
Object does not support property or 'getComputedStyle' method
jquery.inputmask.bundle.3.2.3-9.min.js
Thanks for your help.

@chrisscasta ,
This should be fixed by getting the latest version from github.
Best regards,
Robin

Ready.
Thanks Robin.
Best regards.


Use callback ref instead of string

Not sure if you care about this, but I was browsing the source code and noticed you were still using a string ref. I just updated it to a callback ref.

Good call. I know some people may be relying on exact ref name in their test cases so I’ll probably hold this off until the next major.

Superseded by #416. (Sorry, JD!)

lol @timdorr, no worries :)


Keyboard layout changed after installing bloxstrap [BUG]

Acknowledgement of preliminary instructions

[X] I have read the preliminary instructions, and I am certain that my problem has not already been addressed.

What problem did you encounter?
After I installed Bloxstrap my layout in game changed from QWERTY to QWERTZ. It is set to a QWERTY layout in windows settings and everything works fine in other games.

Does this happen only when using Bloxstrap? https://github.com/pizzaboxer/bloxstrap/wiki/Switching-between-Roblox-and-Bloxstrap

Issue fixed on its own. Maybe restarting the pc helped. Not sure.


need an age requirement

...that is independent of gender

from Minimum Viable Vocab: 19 SiteService: hasAgeRequirement - without/independent of gender (this is not in the vocab and must be added)

Added a gender independent age requirement with v0.0.11: https://github.com/airs-linked-data/lov/blob/master/src/airs_vocabulary.ttl#L886 .


java.lang.IllegalStateException: Versions (Vector(0, 4)) are not contiguous. This can happen when files have been manually removed from the Delta log. Please contact Databricks support to repair the table.

Got this issue in Mircosoft databricks job running ''java.lang.IllegalStateException: Versions (Vector(0, 4)) are not contiguous. This can happen when files have been manually removed from the Delta log. Please contact Databricks support to repair the table.''
the only choice is to contact databricks support?
when request Azure support, it is stopped on step2: recommended solutions without 'next' button, in this case where and how to contact databricks support.
Any supports here?

Got this issue ''java.lang.IllegalStateException: Versions (Vector(0, 4)) are not contiguous. This can happen when files have been manually removed from the Delta log. Please contact Databricks support to repair the table.''

the only choice is to contact databricks support?
when request Azure support, it is stopped on step2: recommended solutions without 'next' button, in this case where and how to contact databricks support.
Any supports here?

@morningdew-tree
It would be great if you could add a link to the documentation you are following for these steps? This would help us redirect the issue to the appropriate team. Thanks!!

@morningdew-tree
We are going to close this thread if there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.


Add Subversion authentication options

This builds off work started in PR 838 (#838) which added basic Subversion support. There were no options for authentication, which is used in most Subversion servers (usually when used over HTTP/S).
This adds two configuration variables:
:svn_username - Username
:svn_password - Password
When both are set, authentication is passed to the relevant Subversion commands.

This has been superseded by #1402.


Define minimum number of characters

Define minimum number of characters in input, In base to vuejs-tips/v-money/issues/94

@joserick I think the v3.12.0 release of v-money3 implements this feature!


[Wait for 1.9.4 Maven Central release] Update latest javadoc 1.9.4

Cannot be merged, instead changed directly on gh-pages.


weird error message in Python

I get an undebuggable [builder] Error: failed to : exit status 100 while building a very simple Python app with heroku/buildpacks stack.
The app I'm using is https://github.com/knative/docs/tree/dee2bd07515f81179ff81715f4499807c9e2d79e/docs/serving/samples/hello-world/helloworld-python
I deleted dockerfile and added a requirements.txt containing
Flask
gunicorn

and Procfile:
web: exec gunicorn --bind :$PORT --workers 1 --threads 8 app:app

$ pack build gcr.io/ahmetb-samples-playground/helloworld-python:pack --builder heroku/buildpacks
Pulling image index.docker.io/heroku/buildpacks:latest
latest: Pulling from heroku/buildpacks
Digest: sha256:9f86541d462ca1d812028104566c6a47e37445a27ad55f729b0182a6614c1085
Status: Image is up to date for heroku/buildpacks:latest
Selected run image heroku/pack:18 from builder
Pulling image heroku/pack:18
18: Pulling from heroku/pack
Digest: sha256:2230feb0c968f556fc2bca711595fda6355cd2a8c19ecb4d5b483abc30e51c3a
Status: Image is up to date for heroku/pack:18
Using build cache image pack-cache-60844030afda
Warning: lifecycle version unknown
===> DETECTING
[detector] Trying group of 2...
[detector] ======== Output: Ruby ========
[detector] no
[detector] ======== Results ========
[detector] Ruby: error (1)
[detector] Procfile: pass
[detector] Trying group of 2...
[detector] ======== Results ========
[detector] Python: pass
[detector] Procfile: pass
===> RESTORING
[restorer] cache image 'pack-cache-60844030afda' not found, nothing to restore
===> ANALYZING
[analyzer] WARNING: image 'gcr.io/ahmetb-samples-playground/helloworld-python:pack' not found or requires authentication to access
[analyzer] WARNING: image 'gcr.io/ahmetb-samples-playground/helloworld-python:pack' has incompatible 'io.buildpacks.lifecycle.metadata' label
===> BUILDING
[builder] -----> Installing python-3.6.8
[builder] -----> Installing pip
[builder] -----> Installing SQLite3
[builder] Error: failed to : exit status 100

I wasn't able to reproduce this but I did have to fix the Procfile to get it working:
web: gunicorn --bind <IP_ADDRESS>:$PORT --workers 1 --threads 8 app:app

Here is my fork:
https://github.com/jamesward/knative-docs/tree/master/docs/serving/samples/hello-world/helloworld-python
I ran:
pack build hellworld-python --builder heroku/buildpacks

Then:
docker run -p8000:8000 -ePORT=8000 hellworld-python

@ahmetb Other than the abstruse error message this doesn't seem like a lifecycle issue to me.
The newest version of the heroku/buildpacks builder appears to contain lifecycle version v0.2.0
$ pack inspect-builder heroku/buildpacks
Inspecting builder: heroku/buildpacks

Remote
------

Stack: heroku-18

Lifecycle Version: 0.2.0
...

This lifecycle version should produce slightly clearer error messages (https://github.com/buildpack/lifecycle/pull/135). Are you still seeing this issues with the latest heroku/buildpacks builders?

I am not sure where to report this issue.
It’s very unclear where the heroku/buildpacks image comes from. So far I haven’t been able to find it.

@hone or @jkutner may be able to direct your question to the right place :)

@ahmetb I'm pretty sure this was due to a bug in the Python buildpack that was recently fixed. If you run docker pull heroku/buildpacks:18 and try again, I think you'll find that it works. Sorry about that.

I think the thing that Lifecycle could do is provide more details on what to do when errors occur. If there is a failure in the buildpack, point the user to the bug db for the buildpack. If something else goes wrong, maybe point them to the bug db for the builder?

I think the root problem here is that as a developer I spent an hour and:

I could not get any more verbose output from this toolchain
I could not find the source code of heroku buildpacks image from Docker Hub or anywhere else to debug more.

Fundamentally, this toolchain is not currently establishing trust on my side. When something like this blocks me, I should be at least able to open a bug report somewhere easily.

In cases like these, the lifecycle provided by this project doesn't have any additional information that could be useful to the user.
We could insist that all valid builders or buildpacks provide the lifecycle with metadata describing their origin and authorship, but in this case, the buildpack has all of the information about the failure and is much better equipped to direct you to the appropriate place.
Additionally, the v3 buildpack API is still in beta. It may take some time before all v3 buildpack authors have documented their new / converted buildpacks. Some builders may have more information published about them than others.

This was a bug in the python buildpack fixed in https://github.com/heroku/heroku-buildpack-python/issues/696
The lack of a "verbose" logging mode is captured in https://github.com/buildpack/pack/issues/271


Failing to compile when added as a swift package

I wanted to try the package out a bit and I added it to a brand new project and it fails to compile.
There is nothing else in the project and it is showing a failure when compiling ToastUI.
Here is the error
loading unsized types is not allowed
  load void, void* %53, align 8, !dbg !316
Function return type does not match operand type of return inst!
  ret void <badref>, !dbg !316
 doublein function $s7ToastUI07DefaultA9ViewStyleV0caD0V11_cornerSize33_E64FDF835852504B4904DF0A39BD1713LLAA20ScaledMetricPropertyVy12CoreGraphics7CGFloatVGvpfi
<unknown>:0: error: fatal error encountered during compilation; please file a bug report with your project and the crash log
<unknown>:0: note: Broken function found, compilation aborted!

Figured out that it has something to do with the machine I'm on. Not caused by this package.

For more information, I also got this error while compiling on Xcode 11.0 with Swift 5.1. It's so odd that the compiler just crashed when compiling the ScaledMetricProperty property wrapper, not sure what's the culprit here. Fortunately, Swift 5.2+ compiles without any problems.


Cleanup driver for MCP23S17

Move the content of the header for the MCP23S17 into the source file and remove the doxygen comments, as requested in a similar case in #54433.

I see the point in moving the definitions into the C file, but why remove code documentation that was already written?

@henrikbrixandersen In a different PR (https://github.com/zephyrproject-rtos/zephyr/pull/54433), for which I used this driver as a starting point, @cfriedt wanted to get rid of the doxygen documentation. Hence I assumed it is generally not desired to have such a documentation.

@cfriedt ping?

@cfriedt ping?

Is there a benefit to documenting self-descriptive, private / static functions?
It adds nothing to Zephyr documentation as far as I am aware, and is not mentioned anywhere in Code Documentation.
In this case, I found that the documentation was not really clarifying anything, so yes, I approve.


ppl: debug visualization for simulated annealing

Resolves #3720
I created a new Renderer to be used by any of the solver (as OR never uses more than one solver in the flow, it looks like there is no problem).
Currently there are two modes:
Default: One key argument for number of iterations between paintings.
No Pause: Additional flag for continuous printing.
In the future it is possible to think about updating odb data for correctly displaying the pin markers as the iterations go along.

Something is wrong with this PR - there are too many modified files.

I'm sorry, I messed up while updating my branch with the changes from master. I'll fix it and reopen.

Please remember to sign your commits with 'git commit -s' to avoid the DCO error.  I can waive it this time.

I missed signing while reverting the incorrect merge from master. I didn't know that it was necessary to use git revert -s. I'll be more careful. Should I consider clang-tidy suggestions?

I missed signing while reverting the incorrect merge from master. I didn't know that it was necessary to use git revert -s. I'll be more careful. Should I consider clang-tidy suggestions?

I didn't read all of them, but usually, clang-tidy suggestions are very helpful. I suggest you follow them.

Please address the clang-tidy as well.


NTR: positive regulation of autophagosome-lysosome fusion

Suggested term label:

positive regulation of autophagosome-lysosome fusion

Definition (free text)
Any process that activates or increases the rate which autophagosomes fuse with a vacuole (yeast) or lysosome (e.g. mammals and insects).

Reference, in format PMID:#######
PMID:38360932

Gene product name and ID to be annotated to this term
FBgn0029911, detr

Parent term(s)
GO:0061909 autophagosome-lysosome fusion

+[Term]
+id: GO:0160177
+name: positive regulation of autophagosome-lysosome fusion
+namespace: biological_process
+def: "Any process that activates or increases the rate which autophagosomes fuse with a vacuole (yeast) or lysosome (e.g. mammals and insects)." [PMID:38360932]
+intersection_of: GO:0065007 ! biological regulation
+intersection_of: positively_regulates GO:0061909 ! autophagosome-lysosome fusion
+property_value: term_tracker_item "https://github.com/geneontology/go-ontology/issues/27376" xsd:anyURI
+created_by: rynl
+creation_date: 2024-03-27T22:51:49Z


A suggestion for light/dark mode transitions

Hi there,
Is it possible to add a transition animation to the light/dark mode switching of the post page? just like the home page. I mean the About this Post area at the bottom of the post page.I always feel that the change of the post page is a bit abrupt.
Thank you.

e1a4e07 added this feature! 🎉
Thanks for your suggestion!

Wow, awesome. Thank you.
But just now I found another bug about light/dark mode. A problem has arisen since the theme doesn't use js-cookie. For example, I switched to dark mode on the page of an article, but I found that it was still light when I returned to other pages.

Cookie is a little bit confusing, but still, I've fixed it now. e7654a2


Add ThreadUtils

Add org.apache.commons.lang3.ThreadUtils which provide helper methods related to java.lang.Thread

getSystemThreadGroup()
getAllThreads()
getAllThreadGroups()
findThreadsByName(String threadName, String threadGroupName)
findThreadsByName(String threadName)
findThreadGroupsByName(String threadGroupName)
findThreadById(long threadId, String threadGroupName)
findThreadById(long threadId)

Cool, i will have a look

I've created https://issues.apache.org/jira/browse/LANG-1105 as a placeholder for this. This is a rather big addition, and I'd like to give others some time to comment.

Added

findThreadById(long threadId, ThreadGroup threadGroup)
findThreadsByName(String threadName, ThreadGroup threadGroup)
with commit 6b32ab8

the only remaining concern is that there is plenty of duplication (i am aware that I suggested to duplicate code  :-)) I wonder if its possible to fix this somehow.

Since Java 1.5, common api design practice is to use Iterable or Collection instead of arrays in the method signatures.  I would suggest updating ThreadUtils to use Iterable<Thread{Group}> or Collection<Thread{Group}>.

How about a set of apis which take a predicate or functor, enabling a visitor pattern?

as suggested by @chonton the methods return now a unmodifiable collection instead of an array (e48659a). I also played around with the hierarchical visitor pattern (d851e72).
Thoughts?

The collection change looks fine for me, but I dont like the visitor code.
I also think that @chonton was referring to the external API, rather to the implementation.
So if I want "findThread" why don't I pass in a Predicate which selects the Thread (which can check for Id, name, threadgroup and any combination or more). I would prefer such an api also over individual methods.

So lets fix the public api first. I suggest to keep some of the originally proposed methods as commons shortcuts and add something like this for a more "generic" api (or lets make the visitor public):
    public static interface ThreadPredicate{
        boolean accept(Thread thread);
    }

    public static interface ThreadGroupPredicate{
        boolean accept(ThreadGroup thread);
    }

    public static Collection<Thread> select(ThreadPredicate predicate)
    public static Collection<ThreadGroup> select(ThreadGroupPredicate predicate)

@CodingFabian why do you don't like the visitor? IMHO it solves the problem with code duplication and it adds the possibility (in contrast to the sole pedicate approach) to exit the loop prematurely and fits to the hierarchical nature of Threads/Threadgroups.

@salyh I think on API level, the Predicate as you proposed would be easier to understand and use.
From an implementation point of view I find it ok, yet also verbose, but I havent tried to implement that purely using a predicate.

I'm not sure we're going in the write direction here. Would it be okay to leave the predicate stuff out for now and get this integrated first? With Java 8 people can simply create a stream on the collection returned by the methods and use that to filter.

@britter well that would be pointless, the whole reason for the Util is to get exactly the threads/groups you want.

Well currently we can identify threads by name, group and ID. I don't think that's useless. But okay, if you come up with an API that takes a predicate, why not.

ok, but once you add the dedicated finder methods (byid, by name, by id and threadgroup, by name and threadgroup) you cannot remove them. thats why i think the latest proposal by @salyh is actually the best compromise between a useful helper api and stuff i have to do (mainly decide how to select)

@salyh @CodingFabian This does not seem to be ready for integration. The whole visitor API is private. I thought this was supposed to be public to enable users to select exactly the threads/threadgroups they want.

its not, the latest proposal was to offer two predicates for that.

We are still in the discussion about the public API IMHO and it seems we have to decide to either go the visitor way or the "predicate way". Another open question is if we should keep the shortcut methods (byid, by name, by id and threadgroup, by name and threadgroup). If we have this clear i am happy to provide the final implementation proposal.
I'll vote for what we currently have with commit d851e72 and just make the visitor public.
I am a fan of shortcuts for common operations and IMHO the (hierarchical) visitor fits the hierarchical nature of Threads/Threadgroups and gives enough flexibility for more advanced API users when the shortcuts are insufficient. An a predicate approach could easily me implemented on top of the visitor. But thats just my two cents and i don't know how this would fit in the general philosophy of commons-lang.

Some suggestions from @chonton : https://github.com/salyh/commons-lang/pull/1

This discussion is currently going out of hand. Since all major design decisions should go through the dev ML, I've started a discussion there (http://markmail.org/message/v7ulna3cojiqh3l5). I would like to ask you to share your thoughts there, so we can build consensus about how this API should look like.
Regards,
Benedikt

Changes Unknown when pulling 12edd41ec7563368b03fa540af5c9a127bbfd89d on salyh:threadutils into ** on apache:trunk**.

Changes Unknown when pulling 12edd41ec7563368b03fa540af5c9a127bbfd89d on salyh:threadutils into ** on apache:trunk**.

I don't like stuff like this at all:
if (threadGroup == null) {
  throw new IllegalArgumentException("The thread group must not be null");
}

For two reaons:

This must be a NullPointerException as in Objects. This is an abuse of IAE.
Why do you reinvent the wheel and don't use the Validate class?

@michael-o

This must be a NullPointerException as in Objects. This is an abuse of IAE.

We had this discussion several times on the dev ML. Currently Commons Lang signals illegal inputs using IAE. And passing null is an illegal input in this case. If we change this, we will change this for the hole code base at once. Using IAE in this case is in accordance to the rest of the code base.

Am 2015-04-26 um 12:17 schrieb Benedikt Ritter:

@michael-o

This must be a NullPointerException as in Objects. This is an abuse of IAE.

We had this discussion several times on the dev ML. Currently Commons Lang signals illegal inputs using IAE. And passing null is an illegal input in this case. If we change this, we will change this for the hole code base at once. Using IAE in this case is in accordance to the rest of the code base.

This isn't true. Have a look at ObjectUtils and EnumUtils. They handle
it correctly or use Validate.class which does the right thing. So the
code is not uniform.
Michael

@salyh Commons Lang has been migrated from svn to git. Because of this the main branch has been renamed to 'master'. Can you please rebase your work against the master branch? Thank you!

I created a new pull request https://github.com/apache/commons-lang/pull/78 for this so this one becomes obsolete.


Old secret value deleted and new lambda dissapears when pushing changes (with new secrets) into another environment.

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
v14.17.6
Amplify CLI Version
10.8.1
What operating system are you using?
Pop Os
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
No
Describe the bug
Merging and pushing changes from dev to staging caused an old secret value to be deleted, and newly added function not being created.
Things done in dev environment:

Added a new Lambda function with an environment variable and a secret
Added one new environment variable to existing old Lambda function
Added two new secrets to existing old Lambda function
Other non-cli things such as additions to graphql schema and modifications to Function code

Everything works great. Then moving changes into staging:
Not 100% sure if 1 and 2 were in this order

amplify env checkout staging
git checkout staging
git merge dev
amplify push
Add missing env variables and secrets
From git diff I see that I now have a missing secret on the old lambda, and the new lambda does not exist at all:

In the Old  lambda one secret that existed before is now removed from oldLambda-cloudformation-template.json , function-parameters.json  and also the automatically generated example of getting the secrets in the Lambdas index.js. From parameter store I can see that it is actually removed.
For the New lambda, in backend-config.json  I see that following parts are removed:

AMPLIFY_function_newLambda_deploymentBucketName
AMPLIFY_function_newLambda_s3Key
AMPLIFY_function_newLambda_secretsPathAmplifyAppId

Doing amplify status  on staging does not list the new function at all.
I see that there are still some references left:
  "function": {
    "newLambda": {
      "build": true,
      "dependsOn": [
        {
          "attributes": [
            "GraphQLAPIIdOutput"
          ],
          "category": "api",
          "resourceName": "urentdealer"
        }
      ],
      "providerPlugin": "awscloudformation",
      "service": "Lambda"
    },

....

    "AMPLIFY_function_newLambda_myEnvVar": {
      "usedBy": [
        {
          "category": "function",
          "resourceName": "newLambda"
        }
      ]
    },

Expected behavior
Existing secrets should not disappear and newly added Lamba should be created, when pushing changes into another enviornment
Reproduction steps

Add multiple secret values for existing Lambda function, which already has one secret
Add a new Lambda function
Release changes in dev
amplify env checkout staging
git checkout staging
git merge dev
amplify push
Add missing env variables and secrets
From git diff I see that I now have a missing secret on the old lambda, and the new lambda does not exist at all

Project Identifier
6b0d8978f235dda0a7c441c51bcf218f
Log output

# Put your logs below this line

Additional information
No response
Before submitting, please confirm:

[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

I can re-add the disappeared secret value by reverting everything done after the merge to staging, and then doing amplify function update -> update secret values -> selecting the deleted  secret. This re-creates it.
However when trying to do the merge again, I always seem to run into the same problems.
Doing the merge again I noticed that amplify status  results into the changes seen in backend-config.json. This time only reference left to new lambda is this:
    "newLambda": {
      "build": true,
      "dependsOn": [
        {
          "attributes": [
            "GraphQLAPIIdOutput"
          ],
          "category": "api",
          "resourceName": "urentdealer"
        }
      ],
      "providerPlugin": "awscloudformation",
      "service": "Lambda"
    },

Now also the environment variable I added to the Old lambda is removed from backend-config.json, and I don't see it when doing amplify function update ➝  update env variable in staging.
If i revert these changes and do amplify status, these items are always removed and I don't see the new Lambda on amplify status listing.

One more thing I noticed after resetting staging to previous state and trying to do the merge again. After merge I do amplify push and enter the missing env variables and secrets, and then at ? Are you sure you want to continue? (Y/n) ‣ I observe changes done by amplify. There are same things as listed above in amplify-dependent-resources-ref.d.ts, function-parameters.json and app.js, but now in **backend-config.json** I see the whole "parameters" section being removed. Is this section supposed to be there or not, and what does it actually do?
What is the way to proceed here? Currently since there seems to be so many problems at the same time (missing env variables, missing secrets and a missing function) I'm thinking of reverting everything in dev and adding them back one by one..

Hello @josefaidt . Doing this now shows the new function on "Create" status in staging. However when I do the push, like said the CLI automatically removes the whole "parameters" section from backend-config.json like before. At this point I have not proceeded with the push, since I don't know if those values should be there or not, and what might happen if I push without them. This now seems to happen even if I remove the lambda in dev and merge that into staging.

Hey @parvusville thanks for clarifying. I do see where the s3key and deploymentBucketName parameters are removed from amplify/backend/backend-config.json when we start the push, however they will reappear after pushing.
I also see the issue where we add a secret to a Function in one environment, merge it over, and the CLI shows "no change" for the function. After making an arbitrary change to the Function's source code and pushing I see the new secret added:

here's a few steps I captured in the reproduction process:

after merging the newly created "next" environment into "dev" where the secret was added https://github.com/josefaidt/a12188/commit/28ba2920886dfcc19101d8b64921145e897f6360
the arbitrary change https://github.com/josefaidt/a12188/commit/4c24259ff6ac17cf8ebf3d2e23dfe038a03f2332
"pre-push" state as I was pushing to the "dev" env https://github.com/josefaidt/a12188/commit/fa102e8bf867b0010d0f2f0bc28de6fff0bfbae4

same for "next" https://github.com/josefaidt/a12188/commit/fa102e8bf867b0010d0f2f0bc28de6fff0bfbae4

"post-push" state as the push completed https://github.com/josefaidt/a12188/commit/d816df7fb20eb3e6237728a1fab00a2aed028687

same for "next" https://github.com/josefaidt/a12188/commit/d816df7fb20eb3e6237728a1fab00a2aed028687

Additionally, I see the new secret is not created in SSM for the target environment "dev"

To workaround this, run amplify update function and choose to modify secrets configuration, then update the new secret to trigger a change to SSM Parameter Store

➜  amplify update function
? Select the Lambda function you want to update a121889f9a3b3e
General information
- Name: a121889f9a3b3e
- Runtime: nodejs

Resource access permission
- Not configured

Scheduled recurring invocation
- Not configured

Lambda layers
- Not configured

Environment variables:
- Not configured

Secrets configuration
- mysecret
- myothersecret
- anewsecret

? Which setting do you want to update? Secret values configuration
? What do you want to do? Update a secret
? Select the secret to update: anewsecret
? Enter the value for anewsecret: [hidden]
? What do you want to do? I'm done
? This will immediately update secret values in the cloud. Do you want to continue? Yes
Use the AWS SSM GetParameter API to retrieve secrets in your Lambda function.
More information can be found here: https://docs.aws.amazon.com/systems-manager/latest/APIReference/API_GetParameter.html
? Do you want to edit the local lambda function now? No

Hey, just as an update I have now successfully completed amplify push. @josefaidt . Like you witnessed before, apparently the parameters block re-appears after pushing. Before at your comment you just mentioned certain keys being removed from parameters and then re-added after push, and that left me worried as I noticed the whole parameters block being removed.
So for now I seem to be able to merge and push changes with the workarounds from previous messages, related to adding a new function and secrets.

Hey @parvusville thanks for clarifying!

I see this in git diff when I'm about to push, but I have not proceeded when CLI asks ✔ Are you sure you want to continue? (Y/n).

When you accept the prompt to proceed these parameters will be added back to the file

This issue was fixed in version 12.0.0.


Prevent sending notification to Slack when importing blog data

When importing blog posts and having an incoming webhook configured in apps/slack, Ghosts sends a notification to the webhook for every single post that got imported. This can lead to a lot of unwanted notifications in slack.
Slack is listening to the event post.published, so I assume this is something where we have to start looking.
Technical details:

Ghost Version: pre-release 0.10.0
Database: mysql

I feel like instead of changing this hook, there should be an option to deactivate/skip apps when a bulk import happens.

Me neither 😉  I also don't think we need to change the webhook. It just gets triggered by this event and therefore I reckon, that we need to look there first. Use a different event maybe for imported posts but without interfering on other processes that are depending on this event.


Recommendation for apex/@ domain.

How do you recommend mapping the root of a domain (like contoso.com, instead of www.contoso.com), since DNS doesn't support CNAME's for the @ record?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0b19a24a-e9e6-0296-69b2-d1fead57c16c
Version Independent ID: 9d0164f0-1b82-439d-c32d-c93a4c56f314
Content: Tutorial - Add a custom domain to your Azure Front Door configuration
Content Source: articles/frontdoor/front-door-custom-domain.md
Service: frontdoor
GitHub Login: @sharad4u
Microsoft Alias: sharadag

@xdansmith
Thanks for your feedback! We will investigate and update as appropriate.

@xdansmith Azure Front Door requires a CNAME record, so you would need to make a new CNAME record based on your @ (A) record.

@xdansmith We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.

@TravisCragg-MSFT can you elaboate on your recommendation to

Azure Front Door requires a CNAME record, so you would need to make a new CNAME record based on your @ (A) record.

as Apex records do not support CNAME records

@ADNewsom09 you should be able to create a CNAME to point to your @ record.

@TravisCragg-MSFT

@ADNewsom09 you should be able to create a CNAME to point to your @ record.

My registrar does not allow it (google domains), also speaking with several other registrars they will not allow it either. see https://serverfault.com/questions/613829/why-cant-a-cname-record-be-used-at-the-apex-aka-root-of-a-domain as an example

@TravisCragg-MSFT CNAMEs on the domain apex / @ record are not allowed by DNS.
This is because if there is a CNAME record for a name, there can not be any other records (other than DNSSEC records) on the name.
Since the domain apex must have SOA and NS records, it can never have a CNAME.
This special niggle of DNS can be found explained by a multitude of sources on the internet with a quick search, for example here: https://medium.freecodecamp.org/why-cant-a-domain-s-root-be-a-cname-8cbab38e5f5c (In fact, my explanation above is a quick and dirty paraphrase of the relevant paragraphs in that article).
Most DNS-based ownership verification methods use TXT records instead which are much less problematic.
(Technical pedantry note: There are DNS servers that do not enforce the CNAME exclusivity rule. For better or worse, these servers just allow users to build DNS zones that do not conform to the DNS standards. This doesn't change the fact that it is not allowed by DNS and is not good practice.)

@ckittel @duk3luk3  I am reopening this issue.
@sharad4u can you please elaborate on what the best practice would be for mapping apex domains using Azure Front Door?

@TravisCragg-MSFT thank you very much for reopening the issue.
On thinking about this some more and rereading the documentation, it is quite possible that Front Door will not be able to support hosting websites for Apex records, at least not in a blessed and supported way because Front Door will not offer fixed public IP addresses for its frontend servers.
There is some previous discussion here: https://feedback.azure.com/forums/217313-networking/suggestions/35530549-add-custom-apex-naked-domains-as-front-end-hosts
if this can be confirmed it would be good to add the information that apex domains cannot be used to the documentation.

How can Traffic Manager support alias records and this not?

It seems that you can now point an apex record at an Alias record set and use the Alias type of Front Door. However, when I try and select the Front Door resource that appears in the list, a Resource Not Found error is thrown. Which is odd as it was able to show the Front Door resource in the drop down list??

Currently, we deploy global solutions using Azure Traffic manager->AppGateway->Web App.
For customers hosting their DNS in Azure DNS we can use alias record and point apex domain to Azure Traffic Manager CName. This does require us to convert all of our traffic manager nest endpoints to be type external.     We want to start using Azure Front Door. Its WAF is GA now so we were hoping to get rid of Application Gateways. Before we can do down this we do want to have a solution for alias/apex/AFD issue referenced above.

This is a bug. And the current workaround/solution is that your AFD resource name and the is Resource Group name must be lowercase.

This appears to be worked, or at least it did just now for me.
As @deploymentking noted above, the Front Door service shows up in Azure DNS when creating an alias record. It worked for me though, no errors.

Created a new A record for the @ apex domain, and set it to alias.
The Front door service showed up and was able to select and save without error. It created an adverify cname automatically for the apex as well.
Back on the Frontdoor service, I was able to then add the frontend host successfully and it now routes traffic properly.

Now the one bit that still doesn't work is the automatic SSL certificate - have to use my own.

This worked for me with a .com domain but fails with a .cc domain :( - Logging a support ticket

If the Public DNS server that is in use does not support the Alias record then this can be achieve very simple:
Use CNAME with afdverify option to pass the validation step:
https://docs.microsoft.com/en-us/azure/frontdoor/front-door-custom-domain#map-the-temporary-afdverify-subdomain
Add the Public IP to the backend pool with the correct backend host header in this case "contoso.com"
Then once ready to steer the traffic via the FD just modify the A record on your public DNS server to point to the FD IP: <IP_ADDRESS>, is very unlikely that this IP change.

#reassign: amitsriva

Closing this for now since there is a documentation for onboarding APEX domain now.
#please-close


[.NET] Integration of new mode termed "TasksMode" in DatetimeOption.cs

TasksMode: When the input text is in the form of tasks (i.e., Schedule 1:1 call on Monday), this mode modifies the value of datetime reference of the input text.
Implemented four-digit number handling rule under Tasksmode:
Should not treat a four-digit number as a "daterange" if the input text does not include other reference of month or year. It should not treat 2005 as a daterange in statements like "Total no of milk packet is 2005."

@Neelisha-saxena Build passed. So now only the new mirror DateTimeModel.json specs are missing.
For the case(s) where the default mode produce false positives (like in "2000 pieces"), mark it as NotSupported in .NET
and add a Comment attribute with a message saying the default more produces a false positive for it and that it's a case from TasksMode.
Once we have the specs, we can merge this.
Thanks!

@tellarin, I have made changes as asked please review it.


Better Favorites

What's the Problem?
I feel like it is a better approach to make Favorites tools inside a tab like all other tools categories and maybe add commonly used or latest used title to the current favorite approach and by the title to separate it from the All Tools tab.
Solution/Idea
I am not sure how to draw/describe it
Alternatives
none
Priorities

Capability
Priority

This proposal will allow developers to accomplish W
Must

This proposal will allow end users to accomplish X
Should

This proposal will allow developers to accomplish Y
Could

This proposal will allow end users to accomplish Z
Won't

DevToys Version
No response
Comments
No response

I didn't even realize there was a favorite system until seeing this issue and thinking of right-clicking on the navigation view...
Was expecting to see a ⭐ to fill-in or something in the top-right of the tool page to mark something as a favorite, would be a lot more discoverable:

I would also expect to see a favorites group at the top of the home page as well when on the 'All tools' page.

Done in 2.0 https://github.com/veler/DevToys/commit/9a9eab5e29c4a494bd1e52248c2163a105da3d84


Add "select all rows" checkbox to table header in validation step

I think it would be helpful to add a checkbox to the table header on the validation step to select all rows. I know shift-click works to select multiple rows, but I'm not sure that's always obvious. Plus, I think there are other benefits to having a select all rows checkbox.
I have this working in a fork and could easily open a PR here if you'd like.

I would like this feature. Currently I have added it to my fork as well, but I think adding it to this repo would be beneficial.


cURL error 6: Could not resolve host: www.googleapis.com

I get such exception trying to authenticate in Google-API:
GuzzleHttp\Exception\ConnectException: cURL error 6: Could not resolve host: www.googleapis.com (see http://curl.haxx.se/libcurl/c/libcurl-errors.html) in ../vendor/guzzlehttp/guzzle/src/Handler/CurlFactory.php:186
Stack trace:
#0 ../vendor/guzzlehttp/guzzle/src/Handler/CurlFactory.php(150): GuzzleHttp\Handler\CurlFactory::createRejection(Object(GuzzleHttp\Handler\EasyHandle), Array)
#1 ../vendor/guzzlehttp/guzzle/src/Handler/CurlFactory.php(103): GuzzleHttp\Handler\CurlFactory::finishError(Object(GuzzleHttp\Handler\CurlHandler), Object(GuzzleHttp\Handler\EasyHandle), Object(GuzzleHttp\Handler\CurlFactory))
#2 ../vendor/guzzlehttp/guzzle/src/Handler/CurlHandler.php(43): GuzzleHttp\Handler\CurlFactory::finish(Object(GuzzleHttp\Handler\CurlHandler), Object(GuzzleHttp\Handler\EasyHandle), Object(GuzzleHttp\Handler\CurlFactory))
#3 ../vendor/guzzlehttp/guzzle/src/Handler/Proxy.php(28): GuzzleHttp\Handler\CurlHandler->__invoke(Object(GuzzleHttp\Psr7\Request), Array)
#4 ../vendor/guzzlehttp/guzzle/src/Handler/Proxy.php(51): GuzzleHttp\Handler\Proxy::GuzzleHttp\Handler{closure}(Object(GuzzleHttp\Psr7\Request), Array)
#5 ../vendor/guzzlehttp/guzzle/src/PrepareBodyMiddleware.php(72): GuzzleHttp\Handler\Proxy::GuzzleHttp\Handler{closure}(Object(GuzzleHttp\Psr7\Request), Array)
#6 ../vendor/guzzlehttp/guzzle/src/Middleware.php(30): GuzzleHttp\PrepareBodyMiddleware->__invoke(Object(GuzzleHttp\Psr7\Request), Array)
#7 ../vendor/guzzlehttp/guzzle/src/RedirectMiddleware.php(68): GuzzleHttp\Middleware::GuzzleHttp{closure}(Object(GuzzleHttp\Psr7\Request), Array)
#8 ../vendor/guzzlehttp/guzzle/src/Middleware.php(57): GuzzleHttp\RedirectMiddleware->__invoke(Object(GuzzleHttp\Psr7\Request), Array)
#9 ../vendor/guzzlehttp/guzzle/src/HandlerStack.php(67): GuzzleHttp\Middleware::GuzzleHttp{closure}(Object(GuzzleHttp\Psr7\Request), Array)
#10 ../vendor/guzzlehttp/guzzle/src/Client.php(275): GuzzleHttp\HandlerStack->__invoke(Object(GuzzleHttp\Psr7\Request), Array)
#11 ../vendor/guzzlehttp/guzzle/src/Client.php(96): GuzzleHttp\Client->transfer(Object(GuzzleHttp\Psr7\Request), Array)
#12 ../vendor/guzzlehttp/guzzle/src/Client.php(104): GuzzleHttp\Client->sendAsync(Object(GuzzleHttp\Psr7\Request), Array)
#13 ../vendor/google/auth/src/HttpHandler/Guzzle6HttpHandler.php(34): GuzzleHttp\Client->send(Object(GuzzleHttp\Psr7\Request), Array)
#14 ../vendor/google/auth/src/OAuth2.php(492): Google\Auth\HttpHandler\Guzzle6HttpHandler->__invoke(Object(GuzzleHttp\Psr7\Request))
#15 ../vendor/google/apiclient/src/Google/Client.php(190): Google\Auth\OAuth2->fetchAuthToken(Object(Google\Auth\HttpHandler\Guzzle6HttpHandler))

Resolved :)

@irasmaster Can you explain how did you fixed this error, please?

@irasmaster i have a same error with you. can you talk more about the solution? thx

@omarllorens @go-yaro In my case, it was a server problem. Puppet updated libc, after what apt should restart dependant services, including php-fpm, but it didn't. So solution was the script to restart PHP after every package update.

Thank you @irasmaster !

@ianbarber it works for me. thank you.

just restart your server from whm

Just restart your server

Hello, We are also getting Same Daily at the same time. So can you someone please help me how to resolver this permanently?

When I was on localhost, Some requests would return that error and sometimes they would pass and return results, but since I went live, I have never seen them, even the speeds increased

I also restarted my server and it worked

Sometimes this happens when the nameservers for google are not set in your /etc/resolv.conf file. You can fix it by doing this: https://stackoverflow.com/questions/24967855/curl-6-could-not-resolve-host-google-com-name-or-service-not-known

At the risk of being redundant, restarting also works when encountering this error in a docker instance.

Had the same issue today. It was a VPN issue. Once ExpressVPN was disconnected: worked again!


References not saved/incompletely saved on MacOsX in both stencila and texture

This issue also posted on stencila forum and soon also on the texture repository (these problems appear to be originating from Texture)
References are saved erratically. Sometimes they are not saved at all (I have a manuscript being edited that I can send you for testing that replicates this).
With newly created empty files, references with only their title field filled out are saved but said title is missing when reopening the file. In one instance when reopening the file I got the following error:
Importing JATS
Parse XML
Validate JATS
<element-citation> is incomplete. Schema: (inline-supplementary-material|related-article|related-object|hr|string-date|bold|fixed-case|italic|monospace|overline|overline-start|overline-end|roman|sans-serif|sc|strike|underline|underline-start|underline-end|ruby|alternatives|inline-graphic|private-char|chem-struct|inline-formula|label|tex-math|mml:math|abbrev|milestone-end|milestone-start|named-content|styled-content|annotation|article-title|chapter-title|collab|collab-alternatives|comment|conf-acronym|conf-date|conf-loc|conf-name|conf-sponsor|data-title|date|date-in-citation|day|edition|email|elocation-id|etal|ext-link|fpage|gov|institution|institution-wrap|isbn|issn|issn-l|issue|issue-id|issue-part|issue-title|lpage|month|name|name-alternatives|object-id|page-range|part-title|patent|person-group|pub-id|publisher-loc|publisher-name|role|season|series|size|source|std|string-name|supplement|trans-source|trans-title|uri|version|volume|volume-id|volume-series|year|fn|target|xref|sub|sup|x)+
<element-citation publication-type="data">
</element-citation>
Transform JATS -> TextureArticle
Validate Dar Article
Transform TextureArticle -> InternalArticle
Validate Texture Article

Essentially saving behavior is erratic. I deem this issue as blocking/high priority since it makes using stencila or texture on real manuscript drafting impossibile, even as a willing beta tester.

Closing this as a duplicate of https://github.com/substance/texture/issues/643


Include list of fixed files in stderr output

This PR adds the list of fixed files to Ruff's output (send to stderr, and omitted for --silent and --quiet settings):

Closes #1667.

@smackesey - Not urgent but just looking for some user feedback -- does this seem useful, or too noisy? (I reverted this change for now so it won't go out yet.)


Communicate how long extraction can roughly be expected to take

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/1399
Originally created by @bencodezen on 2019-12-06 22:18:21

Problem
In a client meeting, we made a point to express that we know that certain extractors take longer than others, so don't worry. It's the extractor, not us. But this won't scale and we need a better way to solve this.
Proposal
When the extractor is connecting and doing things like "Test connection", we need a better modal overlay that makes the user wait and not do anything else for now. And more importantly, we should provide a rough estimate of messages that goes something like:

Initially: "Currently connecting to SalesForce..."
After 3 seconds: "SalesForce connections can take a little longer due to data load..."
After 6 seconds: "Wrapping things up..."
Completed: "Success!"

Or otherwise. We wouldn't need this lengthly transition / animation for everything, but for ones we specifically know that are problematic, this is pretty critical to not having users drop off randomly.
cc @dmor @derek-knox @iroussos @mbergeron

View 27 previous comments from the original issue on GitLab


Pin shapely to 1.7a3

The only difference I could spot between the last working and current failing build...

@martinfleis now the pin started to fail https://github.com/anitagraser/movingpandas/issues/75


Moderation: migrate to new openai api

Fixes issue #13685 : OpenAIModerationChain still uses the old OpenAI API.
Description
The following snippet:
from langchain.chains import OpenAIModerationChain
from openai import moderations

print(OpenAIModerationChain(client=moderations).run("i want to kill you"))

Gives the following error :
Traceback (most recent call last):
  File "moderate.py", line 4, in <module>
    print(OpenAIModerationChain(client=moderations).run("i want to kill you"))
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "\Lib\site-packages\langchain\chains\base.py", line 507, in run
    return self(args[0], callbacks=callbacks, tags=tags, metadata=metadata)[
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "\Lib\site-packages\langchain\chains\base.py", line 312, in __call__
    raise e
  File "\Lib\site-packages\langchain\chains\base.py", line 306, in __call__
    self._call(inputs, run_manager=run_manager)
  File "\Lib\site-packages\langchain\chains\moderation.py", line 94, in _call
    results = self.client.create(text)
              ^^^^^^^^^^^^^^^^^^^^^^^^
  File "\Lib\site-packages\openai\lib\_old_api.py", line 39, in __call__
    raise APIRemovedInV1(symbol=self._symbol)
openai.lib._old_api.APIRemovedInV1:

You tried to access openai.Moderation, but this is no longer supported in openai>=1.0.0 - see the README at https://github.com/openai/openai-python for the API.

You can run `openai migrate` to automatically upgrade your codebase to use the 1.0.0 interface.

Alternatively, you can pin your installation to the old version, e.g. `pip install openai==0.28`

A detailed migration guide is available here: https://github.com/openai/openai-python/discussions/742

Should be compatible with v0 and v1, but reviews are appreciated.

@hwchase17 is it mergeable ?

We also need this fix urgently? Can this be merged? cc: @vaibhavbhuva

CheeseDurger, thanks for suggesting this fix for 13685.
I also wanted to comment to share I am eagerly awaiting a solution as well. Thanks all for coding & reviewing efforts!

CC @efriis, @eyurtsev, @nfcampos I see all of you have also successfully committed changes to this file and are associated with https://github.com/langchain-ai. Could you help @CheeseDurger with a review, more suggestions, or if appropriate, successfully merge this fix to continue to support OpenAI Moderation functionality?

closing in favor of #17025


Deploying to aws shows 502 bad gateway

Describe the bug
while deploying to aws:
when DART SDK version is 3.1.0 and serverpod version is 2.0.0.
everything works fine and api. shows ok.
But if the DART SDK version becomes the latest(3.5.0) and serverpod is 2.0.2(Also the latest). I see the 502 Bad gateway.
Why is this so.
I Also have correct dart sdk version updated at aws linux machine.
This also doesn't help.

502 Bad Gateway
I am faced with the same problem. Even though the installation was very difficult, I did it.

aws
[ec2-user@ip-10-0-6-131 ~]$ dart --version
Dart SDK version: 3.5.0 (stable) (Tue Jul 30 02:17:59 2024 -0700) on "linux_x64"
[ec2-user@ip-10-0-6-131 ~]$
vscode
hidayet@192 terraform % dart --version
Dart SDK version: 3.5.0 (stable) (Tue Jul 30 02:17:59 2024 -0700) on "macos_arm64"
Flutter 3.24.0
serverpod: 2.0.2
conclusion:  502 Bad Gateway
please help

I made changes as stated in other issues before merging. But this is still showing 502 bad gateway. I made dart version to 3.5.3 and serverpod to 2.1.4. Also the dart version on ec2 is also 3.5.3. Please help me with detailed reply on how to fix this. As my whole project is stucked.


Add NetBSD support.

The one path to freebsd in scripts/toolchain.lua is by purpose, NetBSD needs the same compatibility headers.
Signed-off-by: Thomas Klausner<EMAIL_ADDRESS>

I've now added a genie binary to the commit.
Does that make it more acceptable?
Please give feedback what you need to get this merged.

Reason why I don't want to accept it is because there is no difference between _FREEBSD and _NETBSD. Basically _FREEBSD needs to become _BSD and that's it.

This:
 #elif defined(__FreeBSD__) || defined(__NetBSD__)
 #	undef  BX_PLATFORM_FREEBSD
 #	define BX_PLATFORM_FREEBSD 1

Ok, some more questions then:

Should it be "BX_PLATFORM_BSD" then?

NetBSD binaries do not run on FreeBSD. Do you see that as a problem? They'll share a directory.

What do you want to happen in the toplevel makefile?

Don't rename defines for now, just add || defined(__NetBSD__) to define BX_PLATFORM_FREEBSD, I'll unify/rename those once you confirm there are no other changes to source code needed specifically for NetBSD.

Add netbsd to bx/scripts/toolchain.lua, just follow FreeBSD, so they build to different destination directory.


Global media playback Issues.

The media button present on the navbar, which changes the global media playback doesn't work.

fixed.


Link error for static glog library

I build static glog library with commands below:
cmake3 -S . -B build -G "Unix Makefiles" -DBUILD_SHARED_LIBS=0 -DBUILD_TESTING=OFF
the libglog.a generated successfully. But when i link the lib, the ld report error like:

/bin/ld: starlet_fslib_test: hidden symbol `_ZN6google10LogMessageC1EPKcii' in ../third_party/glog_install/lib64/libglog.a(logging.cc.o) is referenced by DSO

This looks like an error in your setup. You need to properly link against glog.

We need a full reproducer since our CI successfully builds the static version of glog. Also: are you able to build the tests?

Closing due to lack of response.


Create localhost echo server

Create localhost echo server to be connected by freertos+tcp echo posix and winSim demos.

Forcing the merge since C-SDK doxygen version being old is a known failure.


ValueError: Must have exactly one of create/read/write/append mode

after changing all 'rb' and 'bw' to 'r' and 'b' it gives the following error
File "data.py", line 76, in prepare_dataset
files.append(open(os.path.join(config.PROCESSED_PATH, filename),'b'))
ValueError: Must have exactly one of create/read/write/append mode and at most one plus
does anybody knows? what to do

why still there is 'b' ??   use just  r  and w
for filename in filenames:
    files.append(open(os.path.join(config.PROCESSED_PATH, filename),'w'))

on replacing 'b' with 'a+'
Traceback (most recent call last):
  File "data.py", line 250, in <module>
    prepare_raw_data()
  File "data.py", line 176, in prepare_raw_data
    prepare_dataset(questions, answers)
  File "data.py", line 78, in prepare_dataset
    files[0].write(questions[i] + '\n')
  File "C:\Users\APPBAKERZ-PC\AppData\Local\Programs\Python\Python35\lib\encodin
gs\cp1252.py", line 19, in encode
    return codecs.charmap_encode(input,self.errors,encoding_table)[0]
UnicodeEncodeError: 'charmap' codec can't encode character '\x97' in position 16
8: character maps to <undefined>

with 'w'
Traceback (most recent call last):   File "data.py", line 250, in <module>     prepare_raw_data()   File "data.py", line 176, in prepare_raw_data     prepare_dataset(questions, answers)   File "data.py", line 78, in prepare_dataset     files[0].write(questions[i] + '\n')   File "C:\Users\APPBAKERZ-PC\AppData\Local\Programs\Python\Python35\lib\encodin gs\cp1252.py", line 19, in encode     return codecs.charmap_encode(input,self.errors,encoding_table)[0] UnicodeEncodeError: 'charmap' codec can't encode character '\x97' in position 16 8: character maps to <undefined>
with 'r'
Traceback (most recent call last):   File "data.py", line 250, in <module>     prepare_raw_data()   File "data.py", line 176, in prepare_raw_data     prepare_dataset(questions, answers)   File "data.py", line 78, in prepare_dataset     files[0].write(questions[i] + '\n') io.UnsupportedOperation: not writable

As, i changed as,
files.append(open(os.path.join(config.PROCESSED_PATH, filename), 'w'))
and it work. While opening file you should change rb and wb to r and b . That's all!

Normally, files are opened in text mode, that means, you read and write strings from and to the file, which are encoded in a specific encoding. If encoding is not specified, the default is platform dependent (see open()). 'b' appended to the mode opens the file in binary mode: now the data is read and written in the form of bytes objects. This mode should be used for all files that don’t contain text.  As i remember there no binary files used in this example


SideBySideEditorControl: can not read property done of undefined

Can not easily repro this. But I got it with having two editor groups, and closing all of the tabs in one group one by one. Got an exception in the console

@isidorn yes I am hunting this down for a while, super hard to reproduce. Happy to hear if you can find steps to reproduce.

@isidorn if it helps to reproduce, this must be related to closing the last editor in a group in the left area such as the right group moves to the position of the left one. Somehow during this move, I end up opening an editor which does not know in which group it belongs to...

I hate to close this but I really cannot reproduce this anymore, trying for 5 minutes. This is a tough one, please report back if you have any clue how to reproduce.

I did not see it since then - I will reopen if I hit it again - I also tried reproducing but failed.


fix: bump mindthegap to preserves image IDs

What problem does this PR solve?:
This version comes with https://github.com/mesosphere/mindthegap/pull/185
See https://mesosphere.slack.com/archives/C02GXHVTCPL/p1663163626582799
Which issue(s) does this PR fix?:

https://jira.d2iq.com/browse/D2IQ-NUMBER

Special notes for your reviewer:

Does this PR introduce a user-facing change?:

Lets not merge yet, there is going to be a v1.0.0 soon.


Automatic language selection not working

When I access the site without being logged in, my native language is no longer chosen by default and "English (US)" is the chosen one instead.

Can you check your Accept-Language headers at this site and let me know what they are? (Example: en-US,en;q=0.8,zh-CN;q=0.6,zh;q=0.4)

Mine are pt-PT,pt;q=0.8,en-US;q=0.6,en;q=0.4.

Fixed in 049dc59, can't believe we didn't catch it earlier–thanks for noticing!


Redundant flag --reporter.type=grpc when used along with --reporter.grpc.host-port?

Requirement - what kind of business use case are you trying to solve?
Make agent config flags more intuitive.
Problem - what in Jaeger blocks you from solving the requirement?
Jaeger agent deployment as of now requires the use of --reporter.type=grpc --reporter.grpc.host-port=host:port to report to collector using grpc.
Proposal - what do you suggest to solve the problem or improve the existing situation?
Remove the redundant flag as passing --reporter.grpc.host-port=host:port is sufficient to specify GRPC usage; similar to how --reporter.tchannel.host-port=host:port is sufficient to specify tchannel use.
Any open questions to address
_

similar to how --reporter.tchannel.host-port=host:port is sufficient to specify tchannel use.

this is because of backward compatibility. Before we had only one reporter - tchannel. We will be changing default reporter to grpc in the next release https://github.com/jaegertracing/jaeger/issues/1218.

Ah, that makes sense @pavolloffay
We could in the next release, check for the presence of either --reporter.tchannel.host-port or --reporter.grpc.host-port and decide on the reporter.type without having the user explicitly pass the flag.
We could mark this a "good first issue".

I prefer to keep the selector flag until we remove tchannel completely, because if we only rely on the presence of the host-port flag, we have an ambiguity when it's provided for both transports, and we'd need to default to one (or crash, which is perhaps better).

@annanay25 I will close this for now. We also don't want to remove flags as it causes a breaking change so this could happen soonest with the next major version.

Sure, thanks! :)


Rename icon not working when selecting multiple files

Description
In File Explorer, when I select multiple files and right-click them, I then click the Rename icon to rename them. In Files, when I do the same and try to click on the Rename icon, nothing happens. Note: If I have only one file selected, Rename icon works, but if I have multple files selected, nothing happens.
Steps To Reproduce

Open Files
Select more than one file
Right-click on the files selected (or just click the Rename icon on the toolbar)
Click the Rename icon at the top of the menu
Nothing happens

Requirements
I should be able to rename the multiple files selected.
Files Version
<IP_ADDRESS>
Windows Version
10.0.22000.2538
User ID
files-community
Log File
debug.log

Thanks for the feedback, This is already added for the next update

The preview version has support for renaming multiple files together. https://files.community/download


Provide simpler emitted code for browser-friendly setups

Hello,
I've found this library to be very useful for both helping with the migration of existing codebases to typescript, but also in describing enforceable contracts between system boundaries.
One item that has prevented adopting this library more widely, however, is that the emitted code contains circular references between modules which is incompatible with the build tools we are using.
Is there any chance a browser-friendly distribution can be provided - one that perhaps consists of a single-file output that's more easily ingested by the less-feature bundler tools out there?

I've taken a stab at providing a potential solution to this: https://github.com/pelotom/runtypes/pull/144
Let me know what you think!

I've just released a fork of Runtypes, https://github.com/ForbesLindesay/funtypes which has both CommonJS and ESModules bundles. They're also pre-prepared with rollup so you don't need to handle cycles etc. in your bundler of choice.

Does anyone have any updates on this? I haven't tried to use it on the browser yet, but am wondering if people have found later versions to be generally satisfactory or have gone with other solutions.


use sync.Pool to optimize db.Put operation

Now the db.Put operation will create a new batch every time, which may cause too much memory allocation.
We can use sync.Pool to avoid this.
The goleveldb has done this, see https://github.com/syndtr/goleveldb/blob/master/leveldb/db_write.go#L362

I will do this.


resource updated time is updated on view and download

With the resource landing page redesign, a view and download count was introduced to the Resource model.  These counts are updated each time the resource page is loaded or the resource is downloaded, which triggers a save that hooks into mezzanine's TimeStamp model which automatically updates the updated time.
https://github.com/hydroshare/hydroshare/blob/develop/hs_core/models.py#L1672
Proposed changes:
Instead of using mezzanine's updated field, we should add our own and only update it in the resource_modified method here. https://github.com/hydroshare/hydroshare/blob/develop/hs_core/hydroshare/utils.py#L455
This will fix the bug we're currently experiencing and avoid accidentally creating this bug again.

@pkdash @hyi - Please review and let me know if you agree with the proposed changes or have any other ideas.  We noticed after 1.19.1 was released that the last updated time always reflects the current time that you're viewing.  We initially thought it was due the resource size change, but after further investigation, I've found the view_count and download_count on the resource model to be the real culprits.

@sblack-usu Since we store the resource update as part of the metadata, we can use that in resource landing page.
https://github.com/hydroshare/hydroshare/blob/develop/hs_core/hydroshare/utils.py#L469
https://github.com/hydroshare/hydroshare/blob/develop/hs_core/models.py#L646

Mezzanine is a big headache for HydroShare. Hope one day we can get rid of it.

Thanks @pkdash.  I think we should be able to use that date easily.  And it will restore the actual "last updated" time... which is a pretty big win.

@sblack-usu @pkdash Agreed - it should be pretty easy just to use modified date type in resource metadata for display on resource landing page to address this issue.

released in 1.20


Angle between two vectors?

Could we get a method for angle between two vectors?`
Something like:
var v1 = new Victor(10, 10);
var v2 = new Victor(20, 20);
var angle = v1.angle(v2);

This would be inherently useful for game programming.

Here is a Gist that I've starred and use currently:
https://gist.github.com/conorbuck/2606166
var p1 = {
	x: 20,
	y: 20
};

var p2 = {
	x: 40,
	y: 40
};

// angle in radians
var angleRadians = Math.atan2(p2.y - p1.y, p2.x - p1.x);

// angle in degrees
var angleDeg = Math.atan2(p2.y - p1.y, p2.x - p1.x) * 180 / Math.PI;


fix(css): convert map returned by vite:css transform to SourceMap (fixes #4939)

(fixes #4939)
Description
the map returned by postcss can be a SourceMapGenerator. Use a function to check and call toJSON() on it.
additionally throw an error if the returned map is not something we can pass on as part of the transform result.
An alternate solution would be to roll back the offending commit as this change would not lead to satisfactory sourcemap support on it's own and getting it done isn't a short term endeavor
Additional context
I wasn't able to come up with a testcase for this due to that fact that this map isn't turning up in any results. vite css sourcemaps are completely broken at the moment, especially for bundled and minified output a lot of things need to be added.

capture and merge maps in css bundling
pass on sourcemap option to esbuild minifier (careful, esbuild has different options, eg. no "hidden")
output css maps on dev somehow, maybe even for css turned to js modules?
... ?

there is an old enhancement ticket about it https://github.com/vitejs/vite/issues/2830  maybe it's time to revisit that someday

What is the purpose of this pull request?

[x] Bug fix
[ ] New Feature
[ ] Documentation update
[ ] Other

Before submitting the PR, please make sure you do the following

[ ] Read the Contributing Guidelines.
[ ] Read the Pull Request Guidelines and follow the Commit Convention.
[ ] Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
[ ] Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. fixes #123).
[ ] Ideally, include relevant tests that fail without this PR but pass with it.

@dominikg thanks for digging into this. We are aiming to start the beta period for 2.6 (probably next Monday). And then there will be likely a week for the community to test it. If you think you or others can work on this to try to support it and use the beta for testing, I think it is good. If not, IMO better we revert and do this more calmly for 2.7

revert PR is here: https://github.com/vitejs/vite/pull/4951


Output window not accessible when watchOnLaunch is on

Have to turn the watch off and on again to see output window when the watchOnLaunch option is set to true.

Thanks for highlighting this, I was experiencing this yesterday but couldn't remember how to replicate it when I got home 😁
Fixed for next release. Which I can publish tonight when I get back home 👍

Thanks for highlighting this, I was experiencing this yesterday but couldn't remember how to replicate it when I got home 😁
Fixed for next release. Which I can publish tonight when I get back home 👍


"def of non-name" error seen when ingesting some PDF files.

Steps to reproduce the problem:

Try to ingest a pdf file  this PDF file - 1000-Ways-to-Make-1000-Dollars.pdf

ingestion fails with "def of non-name" error
 knowledge ingest -d mytestpdflarge /Users/sangeethahariharan/Downloads/1000-Ways-to-Make-1000-Dollars.pdf
2024/05/03 14:50:02 INFO IngestOpts opts="{Filename:0x1400cae2a40 FileMetadata:0x1400b154a00 IsDuplicateFuncName: IsDuplicateFunc:0x105e68920}"
2024/05/03 14:50:02 ERROR Failed to load PDF filename=1000-Ways-to-Make-1000-Dollars.pdf error="def of non-name"
2024/05/03 14:50:02 ERROR Failed to load documents error="failed to load PDF \"1000-Ways-to-Make-1000-Dollars.pdf\": def of non-name"
2024/05/03 14:50:02 failed to load documents: failed to load PDF "1000-Ways-to-Make-1000-Dollars.pdf": def of non-name

I get this with every single PDF Text extractor I have been testing so far, including the commercial offering of MuPDF.
No idea if we'll be able to solve this anytime soon. Did you find any other PDFs apart from this one that yielded this error?
It appears to be a structural error in the file itself.

I have not encountered this error with other PDF files I have tested so far. But I was able to ingest this PDF file successfully previosuly when testing with python version of the tool from. - https://github.com/gptscript-ai/knowledge-retrieval-api

Tested with latest knowledge.
Able to ingest and retrieve information successfully from the PDF file attached in this issue.