Attribute error with --filter option

Hi all,
I am trying the --filter option that, as long as I understand, should take care of the filtering for PRIMAVERA output automatically.  However, the code crashes pretty soon. The command I run is (I removed the fullpath to increase readability)
ece2cmor.py filtered 2002-01-01 --exp qsh0 --conf metadata-qsh0-leg000.json
 --vars varlist-cmip6.json --npp 1 --tmpdir CMIP6 --tabid CMIP6
--mode append --atm --filter

Here below the log I get, any suggestion is welcome!
Thanks,
Paolo
INFO:ece2cmor3.taskloader:Found 210 cmor target variables in input variable list.
INFO:ece2cmor3.taskloader:Created 194 ece2cmor tasks from input variable list.
INFO:ece2cmor3.ece2cmorlib:Selected 194 IFS tasks from 194 input tasks
INFO:ece2cmor3.grib_filter:Searching for previous month file of /marconi_scratch/userexternal/pdavini0/tmp_cmor/qsh0_3946/tmp_2002_1/filtered/ICMGGqsh0+200201
INFO:ece2cmor3.ifs2cmor:Inspecting 194 tasks.
INFO:ece2cmor3.ifs2cmor:Validated 194 tasks for processing.
INFO:ece2cmor3.ifs2cmor:Executing 194 IFS tasks...
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 139.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 248.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 246.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 247.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 157.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 133.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 135.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 132.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 135.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 132.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 132.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 133.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 135.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 129.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 157.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 248.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 246.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 247.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 54.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 170.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 139.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 139.128, level type 1, level 0
Traceback (most recent call last):
  File "/marconi_work/Pra13_3311/ecearth3/PRIMAVERA/cmorize/ece2cmor3/ece2cmor3/ece2cmor.py", line 76, in <module>
    main()
  File "/marconi_work/Pra13_3311/ecearth3/PRIMAVERA/cmorize/ece2cmor3/ece2cmor3/ece2cmor.py", line 69, in main
    maxsizegb = args.tmpsize)
  File "/marconi_work/Pra13_3311/opt/anaconda/envs/ece2cmor3/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/ece2cmorlib.py", line 153, in perform_ifs_tasks
    ifs2cmor.execute(ifs_tasks,cleanup = cleanup)
  File "/marconi_work/Pra13_3311/opt/anaconda/envs/ece2cmor3/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/ifs2cmor.py", line 110, in execute
    tasks_todo = grib_filter.execute(tasks_todo, start_date_.month)
  File "/marconi_work/Pra13_3311/opt/anaconda/envs/ece2cmor3/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/grib_filter.py", line 204, in execute
    proc_mon(month, path, prev_path, filehandles)
  File "/marconi_work/Pra13_3311/opt/anaconda/envs/ece2cmor3/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/grib_filter.py", line 279, in proc_mon
    proc_prev_month(month, grib_file.create_grib_file(fin), handles)
  File "/marconi_work/Pra13_3311/opt/anaconda/envs/ece2cmor3/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/grib_filter.py", line 350, in proc_prev_month
    code = grib_tuple_from_string(gribfile.get_field(grib_file.param_key))
  File "/marconi_work/Pra13_3311/opt/anaconda/envs/ece2cmor3/lib/python2.7/site-packages/ece2cmor3-1.0.0-py2.7.egg/ece2cmor3/grib_filter.py", line 53, in grib_tuple_from_string
    codes = s.split('.')
AttributeError: 'int' object has no attribute 'split'
```

Hi Paolo, this is a bug you discovered, I will fix it asap.

Ok, this should fixed after 51520a51231a07cafc8447e80cedb9bf80dbf924

Hi @goord thanks a lot.
I have pulled the last version
Author: gvdoord<EMAIL_ADDRESS>Date:   Thu Mar 8 17:16:42 2018 +0100

    Fixed bug in previous month processing

diff --git a/ece2cmor3/grib_filter.py b/ece2cmor3/grib_filter.py
index ea11b15..583ed1b 100644
--- a/ece2cmor3/grib_filter.py
+++ b/ece2cmor3/grib_filter.py
@@ -347,7 +347,7 @@ def write_record(gribfile, shift=0, handles=None):
 def proc_prev_month(month, gribfile, handles):
     while gribfile.read_next():
         if get_mon(gribfile) == month:
-            code = grib_tuple_from_string(gribfile.get_field(grib_file.param_key))
+            code = grib_tuple_from_int(gribfile.get_field(grib_file.param_key))
             if code not in accum_codes:
                 write_record(gribfile, handles=handles)
         gribfile.release()

But I am getting the same error as before:
AttributeError:` 'int' object has no attribute 'split'

Also I am noticing that
INFO:ece2cmor3.grib_filter:Searching for previous month file of /marconi_scratch/userexternal/pdavini0/tmp_cmor/qsh0_14079/tmp_2002_2/filtered/ICMGGqsh0+200201

In the previous filtering, it was possible to specify the path of the previous month file: is it possible to do it now?
Thanks a lot

Hi Paolo, did you run python setup.py install again? If the problem persists after that, can you post the full backtrace?
The program looks for the previous month file automatically, both in the current dir and recursively one directory up (so it should find it if it is in the previous leg). Does it print that it didn't find this file? Otherwise it's been found and everything is fine.

Hi @goord, sorry for my silence but it was my turn on vacation ;-)
It was my fault, I was not aware of that I need to reinstall it. Now it seems working fine.
Re. the previous month, I solved linking the files I need to a new folder (at CNR we use a different directory tree which was not compatible to the original script).
Now the code is crashing in another instance with var hfdsn_LImon.nc, I will open a differenti issue if the problem persists!
Thanks for the help

Sorry but I need to reopen it.
I am getting plenty of variables at high frequency, both instanteneous and cumulated so I think that filtering is working fine.
However, I am getting this series of errors in the logfile. What is strange is that they many of them, as 40.128 or 139.128 are present in the "previous" month file.
So it seems that the filtering is not able to read it. I have noticed that this error is related often to soil variables, indeed var mrsos is missing at every frequency (which is based on var 39.128 and 40.128, and they are both present in my previous and present month file).
Could it be possible that there is some mismatch on the vertical grid on which they are searched?
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 139.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 248.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 246.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 247.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 157.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 133.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 135.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 132.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 135.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 132.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 132.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 133.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 135.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 129.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 157.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 248.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 246.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 247.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 54.128, level type 109, level -1
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 170.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 40.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 139.128, level type 1, level 0
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 139.128, level type 1, level 0

Yes I have also noticed these error messages, I will have a look at it today.

Hi @goord,
thanks a lot, I have seen you fixed in a recent commit. I tested it and I am getting soil variable, great.
However, continuing my debugging - sorry for that - I have still a few variables not correctly recognized:
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 248.128, level type 109, level -1. Dismissing task cl in table Amon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 246.128, level type 109, level -1. Dismissing task clw in table Amon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 247.128, level type 109, level -1. Dismissing task cli in table Amon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1. Dismissing task ta in table CFmon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 157.128, level type 109, level -1. Dismissing task hur in table CFmon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 133.128, level type 109, level -1. Dismissing task hus in table CFmon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 135.128, level type 109, level -1. Dismissing task wap in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1. Dismissing task u2 in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 132.128, level type 109, level -1. Dismissing task v2 in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 135.128, level type 109, level -1. Dismissing task wap2 in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1. Dismissing task t2 in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1. Dismissing task uv in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1. Dismissing task uwap in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 132.128, level type 109, level -1. Dismissing task vwap in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1. Dismissing task ut in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1. Dismissing task vt in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1. Dismissing task twap in table Emon
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 131.128, level type 109, level -1. Dismissing task ua in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 132.128, level type 109, level -1. Dismissing task va in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 130.128, level type 109, level -1. Dismissing task ta in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 133.128, level type 109, level -1. Dismissing task hus in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 135.128, level type 109, level -1. Dismissing task wap in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 129.128, level type 109, level -1. Dismissing task zg in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 157.128, level type 109, level -1. Dismissing task hur in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 248.128, level type 109, level -1. Dismissing task cl in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 246.128, level type 109, level -1. Dismissing task clw in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 247.128, level type 109, level -1. Dismissing task cli in table CFday
ERROR:ece2cmor3.grib_filter:Field missing in the first day of file: code 54.128, level type 109, level -1. Dismissing task pfull in table CFday

As long as I understand, all these are requests on the hybrid levels (alevel).  These have not been saved in our simulations, so it makes sense that they are missing.
If you can confirm I can now finally close the issue.
Thanks again.

Hi Paolo, if you haven't got these fields on model levels in your output, it is intended that ece2cmor3 notifies you. If you want to get rid of these messages, you can remove the corresponding variables from your request varlist

Thanks for the clarification. I can close the issue then!
Best,
Paolo


Handling multiple files (incl. import and export)

Current thinking is that - with the benefit of simple outlining - there is far less need to split a program across multiple files. The case for doing so is when you want to create a mini-library that can be used in multiple programs.  As such, there would be no issue with requiring an import statement for each library, and the dependency must be one way, not circular.
In other words, each file would act like a separate .dll.  Whether it could/should in fact be a separate .dll is up for discussion.
Another nice-to-have (but certainly not a requirement) would be if the user could have multiple complete, independent programs -  each with own main and each in a separate file - viewable in the IDE. 'Run' would apply to the program that is open (or the tab with focus).
We need to think about the need/advantage of having an explicit export keyword, which specifies what global capabilities are visible when a file is imported.
When a file is imported, all references should be qualified by the name of the file or by an alias e.g.
import statistics
...
  var std set to statistics.standardDeviation(myList)

or
import statistics as stats
...
  var std set to stats.standardDeviation(myList)

There also needs to be a mechanism that is outside of the Files that holds a dictionary of available Types, Constants, Methods associated with their appropriate file names.
Consider adopting the export keyword where you want Elan globals to be visible to other files or JavaScript frameworks?

For the time being we are no longer think of multiple files. We still need to deal with importing other libraries in due course


release: Real release of opentelemetry-api 0.6.0

Closing. We'll open a normal release request PR once #374 is merged.


Update openapi-generator to 5.4.0

Update openapi-generator to the latest 5.0 minor version, 5.4.0.
Resolves #6555.

As part of 1.0.0, we're going straight to 7.0.0 (we need a newer version to provide backwards compatible clients).  Do we need this before?

@arielshaqed I was following the issue stating we want a minor version upgrade.

Misunderstanding: this issue refers to the tool we use to generate our Go code.


how to de-activate sms/phone 2FA autentication

I wonder how users can de-activate sms/phone 2 factor authentication once they enabled it.
Thank you

@lgn21st Any updates on this?

This is possible actually. If you log into the backend as an administrator and you select the user whose 2FA you want to disable and you'll see an option to disable 2FA

Oh, my mistake.
I thought of the feature to disable sms/phone auth by default for the whole site, because I don't want to use it.


added support for setting color by name

I totally understand if this is out of scope but thought it wouldn't hurt to write it. It is not editor-agnostic but maybe there is a way for that to work as well?

Ignore this:)


Files of .oh-my-zsh, .zshrc are not created

Just installed zsh 5.6.2. (Mojave 10.14.1). However, files like .oh-my-zsh, .zshrc are not created neither in root directory, nor in the /bin. The only file installed is zsh in the /bin. Cannot figure out how to install themes after 3 hours of fiddling with diff. solutions found in the web. Nothing helps.
What am I doing wrong?

Try with locate to find this files.

Try with locate to find this files.

Nope, doesn't find .oh-my-zsh.

try to use vim ~/.zshrc

try to use vim ~/.zshrc

Thank you, Liu. I've done a couple of reinstalls and finally got it working.


Import graph output type from protobuf

The graph output shape/elem_type is discarded when translating from protobuf to mlir.
I renamed and polished the function ImportInputTensorType and applied it on graph outputs.

Can one of the admins verify this patch?

@jenkins-droid test this please.

@chentong319 @tjingrant
I have fixed the backend test error. The reason is

onnx-mlir doesn't run shape inference on ops without dynamic shape output.
The shape and optional attributes are both inferred in shape inference pass.
Some passes use the value of optional attributes (which is null).

I think the shape inference and attribute inference should be done in two single passes? Shape inference is more complicated and not always doable (for example, a reshape op with a non-constant shape input). But the "attribute inference" is trivial. It just sets the optional attributes to the default value.
As a workaround, I force running the shape inference if the op is followed by a return op.

I fixed the CI error on onnx_lowering.mlir. It turns out the failed test case is taken from an incorrect example in onnx gather op docs (https://github.com/onnx/onnx/issues/2346, https://github.com/onnx/onnx/issues/2765, https://github.com/onnx/onnx/issues/1708). Since this PR enables shape inference on more ops, the inferred shape overwrites the original incorrect shape and then the check fails. I have updated the test to make the shape correct.

I think the shape inference and attribute inference should be done in two separate passes? Shape inference is more complicated and not always doable (for example, a reshape op with a non-constant shape input). But the "attribute inference" is trivial. It just sets the optional attributes to the default value.

@daquexian thanks a lot for your detailed investigation! This is a corner case that never crossed our minds, I will need to chat with other folks to tease out a more systematic fix. Thanks again for your work to uncover this issue.

@jenkins-droid test this please.


Substract virtual keycode not sent in WindowEvent

This issue was originally reported by @NickeZ in jwilm/alacritty#1010.
I've tested this with a slightly modified version of the window.rs example:
https://gist.github.com/chrisduerr/5dead96a0279592d2e320e088b611a87
The general issue is that when the Shift key and the Substract key are pressed at the same time, the WindowEvent's KeyboardInput will have None as virtual_keycode.
However reading the DeviceEvent's KeyboardInput, it will report Some(Substract) as the virtual_keycode.
To compare the two outputs directly, here's the WindowEvent output:
KeyboardInput { device_id: DeviceId(X(DeviceId(3))), input: KeyboardInput { scancode: 12, state: Released, virtual_keycode: None, modifiers: ModifiersState { shift: true, ctrl: false, alt: false, logo: false } } }

And here's the DeviceEvent output:
Key(KeyboardInput { scancode: 12, state: Released, virtual_keycode: Some(Subtract), modifiers: ModifiersState { shift: false, ctrl: false, alt: false, logo: false } })

To be it seems like the WindowEvent should also report Some(Substract) as the virtual_keycode, or report Some(Underline) at least. However not reporting any virtual_keycode seems a bit strange to me.
Simililar problems have been reported for the Key0 virtual_keycode.

Was this ever fixed? (This also belongs on winit, obviously.)

No, I never submitted a PR because my patch doesn't solve the general problem that there are a lot of commented out keys in src/platform/linux/x11/events.rs.

That problem will honestly never be fixed unless someone decides to push for more rigorous keyboard API design (tomaka/winit#71) which I don't see as likely to happen in the foreseeable future.


Collinearity checking bug in FEIV

I think this line presumes that the IV model is just-identified. I get a dimension error when the system is over-identified.
https://github.com/s3alfisc/pyfixest/blob/c9cb184b34333c82cb11bec9e73e387efd63c170/pyfixest/feiv.py#L42C1-L43C1
len(self._collin_index) is 1 + dim(exogenous covariates) whereas the dimension of Z should be dim(exogenous instruments) + dim(exogenous covariates)
A hacky but working solution is to pad self._collin_index with Falses if the model is overidentified
if self._collin_index is not None:
    # TODO: this does not implement collinearity checking for the instruments
    collin_index_z = np.array([False] * (Z.shape[1] - len(self._collin_index)) + list(self._collin_index))
    self._Z = Z[:, ~collin_index_z]

I imagine something goes wrong if the instruments are collinear though.

Hi @jiafengkevinchen - thanks for reporting this! This is yet another bug.
Here is what I think happens: the multicollinearity check is based on the set of exogenous regressors X and produces self._collin_index, which is a boolean of length X.shape[1]. Z is equal to the instrumental variables plus X, i.e. Z = [I, Z]. For just identified models, X.shape[1] = Z.shape[1], but with more than one instruments, this of course no longer holds and ´Z[:, ~collin_index_z]´ should produce a dimensionality error. So I think that I simply need to conduct the multi col check for IVs based on Z instead of X.
I am currently struggling with my local setup and R / Python interoperatibility but am hopeful that I can still fix this by the end of the day.
Best, Alex

Just for reference, here is a reproducible example:
from pyfixest.estimation import feols
from pyfixest.utils import get_data
data = get_data()

fit = feols("Y ~ f1 | f1 | X1 ~ Z1 + Z2 ", data=data)
#            The following variables are collinear: ['f1'].
#            The variables are dropped from the model.

produces the following error:
IndexError: boolean index did not match indexed array along dimension 1; dimension is 3 but corresponding boolean dimension is 2

I have added another collinearity check for Feiv here. You should be able to install the newest version 0.11.4 git by running
pip install git+https://github.com/s3alfisc/pyfixest.git

I will wait a little longer with a new PyPi release as there are some additional bugs I want to tackle, and I also have some new features in the dev branch.
Typing this, I just saw that you've found another issue, so there we go 😄

Thank you!


Feature/adding test

Description
Adds unit tests and E2E tests
fixes #45
Type of Change

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

How Has This Been Tested?
Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas

This PR has been stale for way too long (and is very outdated witth the codebase), i'll close it for now


Get Scraper API working

There were two main reason that prevent scholarly from using Scraper API so far:

Using SSL Certificate verification when the documentation explicitly tells not to verify it. There is a note under Method 3 for Python in https://www.scraperapi.com/documentation/

The particular Netflix CDN URL that was used to check if proxy works was never successful with ScraperAPI and this failure made scholarly never use ScraperAPI as it marked it as not working. Replacing it with http://httpbin.org/ip for instance fixes this bug, with the added advantage that we can now report the IP address used.

There were a few other minor timeout changes that I made before getting it to work, and creating this PR a draft for now while I play around to see if they make any difference.
After these changes, for the very first time I had all* unit tests pass! 🎉
*Not quite all, but the only failure was in fetching more than 20 coauthors. I never had this issue until I made ScraperAPI work. Could @ipeirotis may be confirm that fetching 20+ coauthors works with Luminati or other proxy services?

I've checked that the documentation builds and that requests are routed via ScraperAPI when a valid key is provided (hits seen on the dashboard). It takes about 600 seconds to run the unit tests. Getting requests via ScraperAPI is slow, which can be seen even with curl. I think this is good to get a v1.4.2


Having issue in fragment

Hi i am using this library in my project and it's working perfect in Activity but in fragment i am facing issue issue
onActivityResult not working can you help?

@DkKhan786 Sure, Did you pass activity object in ImagePicker?
ImagePicker.with(this)
Here this refers to a fragment when used in Fragment Class. I belive you have used ImagePicker.with(getActivity()) or ImagePicker.with(requireActivity()).

Yes i have pass
ImagePicker.with(FragmentName.this)

@Override
    protected void onActivityResult(int requestCode, final int resultCode, Intent data)
    {
        super.onActivityResult(requestCode, resultCode, data);
        if (resultCode == Activity.RESULT_OK)
        {
            photoPath = ImagePicker.Companion.getFilePath(data);
            Bitmap bmImg = BitmapFactory.decodeFile(photoPath);
            img_property_logo.setImageBitmap(bmImg);
        }
        else
        {
            Toast.makeText(MyProfileActivity.this, "Task Cancelled", Toast.LENGTH_SHORT).show();
        }
    }

i have removed your condition so its working is it correct?

This looks correct? Are you getting any error on logcat?

No i have change it like now its working when i put condition it's not working
@Override
    protected void onActivityResult(int requestCode, final int resultCode, Intent data)
    {
        super.onActivityResult(requestCode, resultCode, data);
        photoPath = ImagePicker.Companion.getFilePath(data);
        Bitmap bmImg = BitmapFactory.decodeFile(photoPath);
        img_property_logo.setImageBitmap(bmImg);
    }

@DkKhan786 This is strange behavior. Can you debug what is the value of resultCode when onActivityResult called?
Thank you!

My Code when Image Picker Call
img_avatar.setOnClickListener(new View.OnClickListener() {
            @Override
            public void onClick(View v) {
                ImagePicker.Companion.with(MenuFragment.this)
                        .crop()	    			//Crop image(Optional), Check Customization for more option
                        .compress(1024)			//Final image size will be less than 1 MB(Optional)
                        .maxResultSize(1080, 1080)	//Final image resolution will be less than 1080 x 1080(Optional)
                        .start();
            }
        });

On Activity Result Code
@Override
    public void onActivityResult(int requestCode, int resultCode, @Nullable Intent data) {
        super.onActivityResult(requestCode, resultCode, data);
        if (photoPath != null)
        {
            photoPath = ImagePicker.Companion.getFilePath(data);
            Bitmap bmImg = BitmapFactory.decodeFile(photoPath);
            img_avatar.setImageBitmap(bmImg);
        }
    }

And Code i am getting
Request Code = 2404
Result Code = -1

@DkKhan786 why   if (photoPath != null) condition? this return always false.

@appukrb Sorry for the delayed reply
photoPath is always null because you're only setting its value when is not null.
if (photoPath  != null) {
     photoPath = ImagePicker.Companion.getFilePath(data);
}

I believe, following is the proper way to handle the result
if (resultCode == Activity.RESULT_OK) {
    photoPath = ImagePicker.Companion.getFilePath(data);
    Bitmap bmImg = BitmapFactory.decodeFile(photoPath);
    img_property_logo.setImageBitmap(bmImg);
}

Thank you!


Add packaging folder to consolidate systemd,build,selinux,rpm files

Signed-off-by: Sally O'Malley<EMAIL_ADDRESS>Which issue(s) this PR addresses:
Consolidate packaging files under /packaging folder
Closes #320
/assign @fzdarsky

chicken/egg problem with Dockerfile paths and CI, so, added a temporary commit to ln -s packages/images to images
then once this passes/merges we can update CI, then once that passes/merges we can remove the link.

/test e2e-openshift-conformance-sig-network

/assign @fzdarsky

/retest-required


Add target search concurrency to TieredMergePolicy

Closes https://github.com/apache/lucene/issues/12877
Adds a minimum number of segments to TieredMergePolicy. This allows to ensure that a minimum search concurrency parallelism is achievable using inter-segment parallelism.

Hi @jpountz , thanks for your thoughts!
Let me check whether I got your suggestion right:

There are at most 2 segment tiers. The first has minNumSegments at most, the second minNumSegments-1 to ensure we maintain minNumSegments total segments at the most.
The max number of docs allowed in a segment is (maxDocs - numDeletes) / minNumSegments. That avoids creating larger segments than necessary so we ensure there's minNumSegments segments at a minimum.

Does it align with your thoughts?
Some questions I have:

segsPerTier is not taken into account if minNumSegments is specified, correct?
In case segments reach  maxMergedSegmentBytes, should we fall back to the previous segsPerTier behaviour?

I see that minNumSegments is not a good name with this approach - I think targetSearchConcurrency makes sense to be explicit.
Thanks!

There are at most 2 segment tiers.

Well, there can be more tiers, but since tiers have exponential sizes (e.g. if you merge factor is 10, each tier has segments that are 10x bigger than the previous tier) it's almost certainly fine to ignore segments on tiers beyond the 2nd higher tier, they would account to very few documents compared with the first 2 tiers.

segsPerTier is not taken into account if minNumSegments is specified, correct?

If minNumSegments is bigger than segsPerTier, then the highest tier should indeed allow for up to minNumSegments (or maybe minNumSegments-1 if there are multiple tiers, though it may introduce complexity for little value, maybe it's better/easier to keep things simple and allow for minNumSegments on the highest tier all the time). But lower tiers should still aim for segsPerTier segments.

In case segments reach maxMergedSegmentBytes, should we fall back to the previous segsPerTier behaviour?

I can understood this question in different ways, so I'll try to clarify how I think these two parameters should interact:

Even if minNumSegments is configured, we should still honor maxMergedSegmentBytes and not create segments that are bigger than that.
If your merge policy has segsPerTier = 10, maxMergedSegmentMB = 5GB, floorSegmentBytes = 100MB, minNumSegments = 12, and the total index size is 15GB, it should aim for allowedSegCount=23 segments (10 100MB segments ~=1GB, 14 1GB segments). So even though we could have created a segment of the maximum merged size by merging 10 1GB segments, we did not do it because then we would have ended up with a segment that had more than maxDoc/12 documents (assuming all docs contribute equally to the index size).

Thank you for tackling this @carlosdelest!   TMP really is its own little baby chess engine, with many things it is trying to optimize towards (what the ML world now calls "multi-objective"), playing against a worthy opponent (the indexing application that keeps indexing different sized docs, doing some deletions/updates, refresh/commit, etc., producing all kinds of exotic segments).  And of course in addition to the app exotically birthing new segments, TMP itself is causing new big segments to appear when each merge completes!  This really is a game theory problem, heh.
+1 for the name targetSearchConcurrency -- it makes it clear this is about optimizing the "inter-segment concurrent search latency" in the resulting index, and, I think it also makes it clear that maxMergedSegmentBytes still wins.  I think simply aiming for the largest tier to allow targetSearchConcurrency segment count when that exceeds segsPerTier is a good approach.  After all it is those biggest segments that you really need for concurrency since searching them takes the most CPU / latency -- the lower tiers (1/10th, 1/100th, ... the size of the top tier) will be super fast by comparison and not the long pole in each query's latency.

Thanks @mikemccand and @jpountz for your explanations! This is much clearer now.
I've updated the PR, LMKWYT about the approach!
I'm looking into effective ways of testing in terms of ensuring that the last tier contains the target number of segments for search concurrency. Any suggestions on how can I check that the last tier eventually contains the expected number of segments?

I spent some time digging into the new behavior introduced by this PR, as I'd like to get it over the finish line. :) I am getting disappointing results for the write amplification. This seems to be due to the fact that we compute the segment count as if segments could magically be close to the doc count limit, but in practice this is not the case, and it forces TieredMergePolicy to perform sub-optimal merging.
I tried to play with other approaches, and one that seems to perform closer to what I would expect consists of removing the targetConcurrency biggest segments from the list of eligible segments, in a similar way to how we remove too big segments. And then let the merge policy do merging on the long tail of smaller segments.

@carlosdelest I took the freedom of pushing some changes to your fork, I hope you don't mind!

FWIW I have been playing with BaseMergePolicyTestCase's doTestSimulateAppendOnly and doTestSimulateUpdates. With this change, I'm observing a number of segments in the order of targetSearchConcurrency on the highest tier while  increasing the segment count by a bit less targetSearchConcurrency on average and without affecting the write amplification significantly.

Thanks for taking a look into this @jpountz !
Your approach makes sense to me, and addresses some of the problems I was having with bigger segments not being merged because of the number of documents, and smaller segments being discarded.
The test checks makes sense as well. I've added setting target search concurrency for testSimulateUpdates()
Is there any other work / checks we should be doing for this?

I would suggest improving LuceneTestCase#newTieredMergePolicy(Random) should randomly set the target concurrency on the merge policy. And remove the call to the setter to the BaseMergePolicyTestCase#testSimulate* test cases?

Done in 2d8031581ad1df603c59f5f02d9c0c9afed8ca28


ModuleNotFoundError: No module named 'communication'

win10
when to run ：bash scripts/deploy_policy.sh idp3 gr1_dex-3d 0913_example，
here will occur ModuleNotFoundError: No module named 'communication' and ModuleNotFoundError: No module named 'retarget',
and i can't found  "communication" and "retarget"  pip python  modules or python code.
can you help me?
thanks

Hi, thank you for your interest. As I mention in README, the deployment file is tailored for the specific robot. Thus it needs some robot API. The robot API for the used humanoid robot is provided here:
https://github.com/YanjieZe/Humanoid-Teleoperation/blob/main/humanoid_teleoperation/teleop-zenoh/communication.py


Need default info.json file

Need to return an empty info.json file data if it doesn't exit in the project. This is important for deleting games or projects that don't have it.

This is fixed.


Need help for Adobe UXP

Hi!
I'm trying to add a connection to the Mercure hub from the Adobe UXP plugin, it seems to connect, but cannot receive any message from the hub. (Topic is same)
2023-02-09T09:51:45.218+0200    INFO    mercure/subscribe.go:137        New subscriber  {"subscriber": {"id": "urn:uuid:7f783236-c799-4118-8cb3-1aeadc0d5b66", "last_event_id": "", "remote_addr": "<IP_ADDRESS>:57685", "topics": ["test"]}}
2023-02-09T09:51:50.554+0200    INFO    mercure/publish.go:79   Update published        {"update": {"id": "urn:uuid:ce15199e-aa76-486e-8a8c-a533ec5b1019", "type": "", "retry": 0, "topics": ["test"], "private": false, "data": "{\"hello\":\"there\"}"}, "remote_addr": "<IP_ADDRESS>:57692"}
<IP_ADDRESS> - - [09/Feb/2023:09:51:50 +0200] "POST /.well-known/mercure HTTP/1.1" 200 45 "" "Symfony HttpClient/Curl"
2023-02-09T09:51:50.554+0200    INFO    mercure/subscribe.go:86 Update sent     {"subscriber": {"id": "urn:uuid:7f783236-c799-4118-8cb3-1aeadc0d5b66", "last_event_id": "", "remote_addr": "<IP_ADDRESS>:57685", "topics": ["test"]}, "update": {"id": "urn:uuid:ce15199e-aa76-486e-8a8c-a533ec5b1019", "type": "", "retry": 0, "topics": ["test"], "private": false, "data": "{\"hello\":\"there\"}"}}
2023-02-09T09:52:30.556+0200    DEBUG   mercure/subscribe.go:53 connection closed by the client {"subscriber": {"id": "urn:uuid:7f783236-c799-4118-8cb3-1aeadc0d5b66", "last_event_id": "", "remote_addr": "<IP_ADDRESS>:57685", "topics": ["test"]}}
2023-02-09T09:52:30.556+0200    INFO    mercure/subscribe.go:234        Subscriber disconnected {"subscriber": {"id": "urn:uuid:7f783236-c799-4118-8cb3-1aeadc0d5b66", "last_event_id": "", "remote_addr": "<IP_ADDRESS>:57685", "topics": ["test"]}}
<IP_ADDRESS> - - [09/Feb/2023:09:51:45 +0200] "GET /.well-known/mercure?topic=test HTTP/1.1" 200 79 "" "UXP:XMLHttpRequest"
2023-02-09T09:52:31.262+0200    INFO    mercure/subscribe.go:137        New subscriber  {"subscriber": {"id": "urn:uuid:261c5462-a14c-4878-97c5-24ffe3755971", "last_event_id": "", "remote_addr": "<IP_ADDRESS>:57727", "topics": ["test"]}}

It should work since they have some internal class that provides socket connection WebSocket
Any suggestions on how to proceed, or just to scrap this plugin for a later time?

@fire1 , you could try to use WebSocket as a transport like at https://github.com/Yaffle/EventSource/issues/87#issuecomment-562852095

@fire1 , you could try to use WebSocket as a transport like at #87 (comment)

I'll give it a try, but with little hope...
Аll I see currently working in UXP is from a timeout, even a socket content is there, (even heartbeat). For me, UXP request does not support "stream-like" responses.
Thanks for suggestion, will report back after tests

Hi again, what is the minim version to support this polyfill, from what  I check, UXP is based on javascript ES3, (or maybe even older...)
but also running on Chromium ...???
I can't even begin to imagine what a mess Adobe has made and how this is possible!

@fire1 ES5


Dev/jgough/v2 schema

PR for creating a v2 schema that doesn't force us to use permissioned identities for the canonical simple hash anchoring schema.
Fixes AB#7958

So v1.py has been modified to remove 'public' where appropriate and v2.py does not bother (i.e. its the same as the original v1.py). Is that correct and expected.
Also are there unittests and has the README.md been modified to mention v2 as well as v1?

Yes! thats exactly it, have updated the unittests, will also update the readme!

updated readme


Avoid useless recursion in aria.utils.Json.inject if objects are identical

If you inject an object into another setting the merge flag to true, if the objects are identical and contain cyclic references, then the maximum call stack size is exceeded.

:ok: ff63f58552d4c26a45a4ae2e55e93ceea7d0a567 seems fine for me

@flongo Thank you for your pull request. It solves the issue in case the source and destination are identical.
However, in the general case, aria.utils.Json.inject does not currently support cyclic sources if the destination is also cyclic in the similar way (without identical objects).
For example, the following piece of code still has the infinite recursion problem:
function f() {
   var a = {
      b: "c"
   }
   a.d = a;
   return {
      a : a
   };
};
aria.utils.Json.inject(f(), f(), true);

If such a use case needs to be supported as well, maybe, we could store visited objects with an instance of aria.utils.StackHashMap in a way similar to what is done in b384881ce9b64d95f2afd7aa5a21de48f5519b26...

Thank you @divdavem for the remark. For the time being we are happy with the identical objects fix. Can I merge?

@flongo yes, you can merge


ondidichangecontent (event=>{})

I want to know if the event '\t' can be counted as an alphabetic column instead of a standpoint. Such as tabsize = 4.
I want his column position to be 4 instead of 1. Is that OK

Sorry, can you elaborate on your question?

I've been working on LSP recently and his ondidichange requires parameter calculations that are very similar to Monaco's didChangeContent but not quite the same especially in Monaco where the TAB button is a column and the JDT in Java needs to be calculated as the length of the tabsize Let's say I delete a TAB and I want to know if the event parameter of Monaco can be calculated as tabsize

I want the character that the LSP needs but the event's column here is not going to be right if it's a TAB column minus one because she's treating the TAB as a character column instead of a tabsize character column. I wonder if I can change some parameter to make it return this event by the size of tabSize


Support for ?presentation query param

Resolves https://github.com/dreampuf/GraphvizOnline/issues/26
Quick fix for https://github.com/dreampuf/GraphvizOnline/issues/26, our team needs a way to link to the full screen graph as well.
This gets the job done, if there's a presentation query param, then hide the editor and make the rendered graph full screen. I'm sure a better solution would be to make the editor expandable and collapsible, but that seems like it would be a bit more involved.
Without presentation query param

With presentation query param

Thank you for your contribution. It looks great. It would be better if there was an interactive button to enter or exit the presentation mode.


Implementation of max pooling

Binarization adapted to multiclass models. Takes the maximum prediction across classes to binarize. This was the sum of all classes (including the background) is always 1.
Apply it this way in the config file:
"postprocessing": {"binarize_maxpooling": {}}

Pull Request Test Coverage Report for Build 401733879

1 of 10 (10.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.1%) to 90.506%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

ivadomed/postprocessing.py
1
10
10.0%

Totals

Change from base Build 399931239:
-0.1%

Covered Lines:
5844

Relevant Lines:
6457

💛  - Coveralls

Yep love it!
2 sentenes about it in RTD and good to go!!

Oups my bad! Updated here :) 5fd6091

Pull Request Test Coverage Report for Build 404602160
Warning: This coverage report may be inaccurate.
This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

For more information on this, see Tracking coverage changes with pull request builds.
To avoid this issue with future PRs, see these Recommended CI Configurations.
For a quick fix, rebase this PR at GitHub. Your next report should be accurate.

Details

1 of 10 (10.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.03%) to 90.597%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

ivadomed/postprocessing.py
1
10
10.0%

Totals

Change from base Build 399931239:
-0.03%

Covered Lines:
5906

Relevant Lines:
6519

💛  - Coveralls


Virtual text affects gq format behavior.

Steps to reproduce

minimal vimrc and text file

prop.vim
call prop_type_add('exampleType', #{highlight: 'Comment'})
call prop_add(1, 1, #{type: 'exampleType', id: 1, text: 'I am Virtual!'})

set textwidth=30
set colorcolumn=30
set conceallevel=2

a simple input.md file
apple orange banana watermelon

apple orange banana watermelon

**apple orange banana watermelon**

start vim vim --clean -S prop.vim input.md

type gqG to format the whole text file

Expected behaviour
input.md is expected to be formatted as
apple orange banana watermelon

apple orange banana watermelon

**apple orange banana
watermelon**

But actually, it is formatted as
apple orange
banana watermelon

apple orange banana watermelon

**apple orange banana
watermelon**

I also tested concealed text. It works as expected.
I think the virtual text should not affect gq format. When a text with virtual text is formatted, its behavior should remain consistent with the original text. But I'm not sure if formatting together with virtual text could be considered a feature, or if it's needed in some scenarios.
Version of Vim
9.1.199
Environment
Ubuntu 24.04 WSL2
Logs and stack traces
No response

If someone truly needs to bypass the issue, they can set formatprg to use external formatter tools such as fmt or par.

I guess this depends. I actually find the current behaviour better, because re-formatting takes the virtual text into account and makes sure, that the whole line, including the virtual text does stay within the specified width.

OK, I have no more questions about this issue. Some one can use external format tool if they want to ignore virtual text.


Include personal data for bookings report

See ticket #1535 on the CAS3 Trello board.

This PR introduces columns containing personal data to the bookings report. These columns are:

personName
pncNumber
gender
ethnicity
dateOfBirth

Of these columns, four are populated as expected - pncNumber is currently not available and is always presented as a blank cell. This is because we do not store personal information within our service and have to obtain it elsewhere. Although we cache results from the Community API, the number of results expected in a typical spreadsheet is between 200 and 400 rows, and performing a request to the cache for each CRN incurs an unacceptable performance degradation (see below). The alternative solution is to use the AP-Delius Integration API, which provides an endpoint for accessing personal data in bulk, but this endpoint only provides a subset of the personal data and does not currently include the PNC number.
Performance testing
We are beginning to run into performance limits in various aspects of the service. Including another external integration has the potential to introduce significant performance impacts, so a Gatling test has been introduced to quantify the impact of this integration on creating booking reports.
The performance test is structured in the following way:

1200 bookings are created for the same CRN, distributed randomly over a period spanning from 60 days before to 60 days after the current date, using the following steps:

creating a premises
creating a room in that premises
creating an application
updating that application
submitting that application
creating a booking for that room

100 reports are generated for random months over this period.

Each run was performed on an M1 Macbook Pro under similar background load conditions. Prior to each test, the database was cleared and all caches purged to ensure each run was fully independent.
The control test was measured using the current main branch:

The single CRN endpoint test:

The bulk data endpoint test:

The findings, summarised in a table:

Test
Success rate
Minimum time (s)[1]
Maximum time (s)[1]
Mean time (s)[1]
Median time (s)[1]
Std. Dev. (s)[1]

Control
100.0%
8.658
49.901
29.526
31.704
11.488

Single CRN[2]
9.8%
47.878
57.193
53.311
54.885
3.429

Bulk CRNs
100.0%
8.609
48.642
26.669
26.485
12.527

[1]: As measured for the successful subset of requests.
[2]: Calculated from a reduced sample of 61 requests due to how Gatling schedules users in its simulations.

It looks ok to me.


Tensorflow version updated to 2.3.0

Thanks a lot. I made this change in AutoEq proper but forgot to update this repo.


Use Tangram as basemap engine

For demo site, use @Tangrams to power the basemap.

Switched the primary demo to Tangram here: https://github.com/pelias/leaflet-geocoder/blob/v1.0.0-alpha/index.html
There is also a barebones Tangram implementation here as a learning-friendly example: https://github.com/pelias/leaflet-geocoder/blob/v1.0.0-alpha/examples/tangram.html
We'll have to keep other examples / demos on stock Leaflet with raster tiles for old-browser compatibility.

FYI this issue comes up if you google using tangram for basemaps, but both of the links above no longer work.

@easherma, good call. I've updated the links.


Fix config.from_pyfile on Python 3

Fix #2118

I manually verified that the tests fail without the bugfix applied BTW


[Typo ?] tree:childret() call causes a nil value error

https://github.com/s1n7ax/nvim-comment-frame/blob/05be8b4cf2138d341ed5135dc704d9fccf51a3cb/lua/nvim-comment-frame/util.lua#L252
This causes a nil value error when I attempt to add a frame in my init.lua config, although I have not seen this line get called elsewhere.
tree:children() instead of tree:childret() seems to fix it.

Good catch. I made the change. Try updating. 9284b7b


Notification Permission & Geolocator issues

While testing your great plugin to track location with Geolocator, I inadvertently denied permissions.
Now, no matter if I uninstall the app, I still get Permission denied by default and the foreground service doesn't work.
How can I ensure that notifications permissions are allowed before launching the service?
I have honestly been struggling to get Location tracking working on Android and using your plugin seemed to be the right solution, but I don't seem to be able to get it to work and I think the notification issue might be the reason...

Also, using your example code for Geolocator Stream, I only seem to get one event when Foreground service is started, then none after that, even though I am walking.
`// The callback function should always be a top-level function.
void startCallback() {
// The setTaskHandler function must be called to handle the task in the background.
FlutterForegroundTask.setTaskHandler(FirstTaskHandler());
}
class FirstTaskHandler extends TaskHandler {
StreamSubscription? streamSubscription;
@override
Future onStart(DateTime timestamp, SendPort? sendPort) async {
LocationSettings locationSettings = AndroidSettings(
accuracy: LocationAccuracy.high,
distanceFilter: 10,
// intervalDuration: const Duration(seconds: 1),
);
final positionStream =
    Geolocator.getPositionStream(locationSettings: locationSettings);
streamSubscription = positionStream.listen((event) {
  // Update notification content.
  FlutterForegroundTask.updateService(
      notificationTitle: 'Current Position',
      notificationText:
          '${event.latitude}, ${event.longitude} - Alt: ${event.altitude}');

  // Send data to the main isolate.
  sendPort?.send(event);
});

}
@override
Future onEvent(DateTime timestamp, SendPort? sendPort) async {}
@override
Future onDestroy(DateTime timestamp) async {
await streamSubscription?.cancel();
}
@override
void onButtonPressed(String id) {
// Called when the notification button on the Android platform is pressed.
}
}`

Nevermind, I finally found a way to do this.
Thanks!

Nevermind, I finally found a way to do this. Thanks!

Hey, I am in the same hole. Please let me know :how you solved it?


PYPATH is overridden during instrumentation

Describe the bug
We are using odigos to autoinstrument a python application, but the app is written/containerized with a predefined PYPATH and the autoinstrumention overrides it and breaks the application startup.
To Reproduce
Create a containerized python app with a PYPATH set in the container build.
PYTHONPATH=/pylib:/src

but odigos changes it to
PYTHONPATH=/var/odigos/python/opentelemetry/instrumentation/auto_instrumentation:/var/odigos/python

at which point the app does not find its own python libraries and fails
Expected behavior
It would great to append the PYPATH instead of overwriting it, similar to
https://github.com/keyval-dev/odigos/pull/1031 for node

Hi @esara, thanks for opening this issue.
We are aware of this problem, and we could add PYTHONPATH to the env vars we append  (similar to what was added to node in #1031), however, that approach is only valid for env vars that are declared as part of the k8s deployment. Unfortunately, we can't use that approach for env vars which are part of the container build, for that we will need a more involved solution.

Thanks @RonFed , I understand, env vars that are spelled out in the deployment/template spec can be reliably parsed
It is probably not as reliable, but it may be possible to parse out the runtime PYPATH of the running process (to be instrumented) as an option? something like this:
$ xargs --null --max-args=1 echo < /proc/1/environ|grep PYTHON
PYTHONPATH=/pylib:/src


is_integer_graph=False crashes

[fandreuz@fatou fandreuz]$ python3 bisi/src/timer.py
[(1, 2), (2, 4), (3, 3)]
doing n=10
Traceback (most recent call last):
  File "bisi/src/timer.py", line 45, in <module>
    fba = timeit.timeit('dovier_piazza_policriti(graph, is_integer_graph=False)', setup=setup, number=number) / number
  File "/usr/lib64/python3.6/timeit.py", line 233, in timeit
    return Timer(stmt, setup, timer, globals).timeit(number)
  File "/usr/lib64/python3.6/timeit.py", line 178, in timeit
    timing = self.inner(it, self.timer)
  File "<timeit-src>", line 14, in inner
  File "/u/f/fandreuz/.local/lib/python3.6/site-packages/bisimulation_algorithms/dovier_piazza_policriti/fba.py", line 370, in bisimulation_contraction
    return back_to_original(collapsed_graph_nodes, node_to_idx)
  File "/u/f/fandreuz/.local/lib/python3.6/site-packages/bisimulation_algorithms/utilities/graph_normalization.py", line 74, in back_to_original
    return [tuple(idx_to_node[idx] for idx in block) for block in partition]
  File "/u/f/fandreuz/.local/lib/python3.6/site-packages/bisimulation_algorithms/utilities/graph_normalization.py", line 74, in <listcomp>
    return [tuple(idx_to_node[idx] for idx in block) for block in partition]
TypeError: 'int' object is not iterable

Fixed in 0dab654.


Funds lost after Loop Out got stuck

I initiated a Loop Out on LiT but it was stuck for several hours showing the "initiated" message.
I then found this report:
https://github.com/lightninglabs/loop/issues/354
So I decided to restart both LND and LiT as advised.
The status now shows "Off-chain Failure" but the payment (over 1.000.000 SATs!) was not redirected to my off-chain funds.
Any ideas how I can get it back?

Hi @M31andromeda thanks for your report!
Can you please share the swap hash so we can look closer into it?

Sure. Can you please point me towards the place where I can find it? Sorry, I'm a noob. ;)

On the command line you can do loop listswaps and check for the id of the affected swap.
Or within LiT you should be able to find the swap id on the Loop page or in the history view of your LiT.

Thanks for your help. I just rechecked and my balance is now correct again. So no more lost funds!!!
It was this ID: 808a4ccf73f4c5e7c3b66ad828eda9b2328474d10a4208fb16b038aa7de492a0

Thanks for the report and glad it got resolved!


[0.2.4] Preview feature is broken

Unity: 2020.3.4f1
Tested package version: 0.2.4
I already used this package version 0.1.6 and I upgraded to 0.2.4 lately.
The preview feature of version 0.2.4 is broken.
The origin value is not restored when the preview ends.

I just tested with unity 2020.3.17f and everything is working fine, could you explain a little bit better what you mean by broken?
Unity: 2020.3.17f1
AnimationPackage: v0.2.4
DOTween: v1.2.632 [Release]

Same issue : with 0.2.4 - I'm using older version of the DOTween - and it does not have DotweenEditorPreview.isPreviewing field/property.

I'm fixing it locally with a reflexion call for now...
@brunomikoski  please take a look

@brunomikoski  also, please update all of the Assembly definition to not use GUID but prefer to use name of the assembly. This way there will be no import error when using this with older versions of Unity or when re-importing project with large amount of files (duplicate GUID s may be encountered )

Same issue : with 0.2.4 - I'm using older version of the DOTween - and it does not have DotweenEditorPreview.isPreviewing field/property.

I'm fixing it locally with a reflexion call for now...
@brunomikoski please take a look

Sadly I need to use the new updated version of DOTween to fix some issues with sequences playing on the editor, can't you upgrade DOTween on your project?

@brunomikoski also, please update all of the Assembly definition to not use GUID but prefer to use name of the assembly. This way there will be no import error when using this with older versions of Unity or when re-importing project with large amount of files (duplicate GUID s may be encountered )

I will upgrade on the next release, but from what I saw the only one using GUID is the Editor right? That's embedded inside the package so should not be a problem


Radzen Inputs allow adding css

<RadzenNumeric TValue="decimal" ShowUpDown="false"
               Format="#,###.00"
@bind-Value=SupplierQuote.Price class="form-control" />

this class will be applied to span and not to the input
<span class="rz-spinner valid rz-text-align-left form-control" id="-TUSQSD-H0" _bl_5=""><!--!-->
        <input type="text" inputmode="decimal" class="rz-spinner-input valid rz-inputtext" tabindex="0" autocomplete="off" onkeypress="Radzen.numericKeyPress(event, false)" onblur="" onpaste="" _bl_6=""><!--!-->
    </span>

would be nice to see a class to apply the input like InputClass etc..

You can access through CSS selectors to the input to apply the styles you need.
If a property like this is implemented, it should be implemented for all inputs, in the various scenarios, as a formfield, as well as separately.
If you want, you could identify all the inputs that have this problem of lack of css class in the "input" tag and reply to this commit, and I will elaborate a PR.
Regards.

Probably some API similar to the existing Attributes - InputAttributes maybe. Won't be as convenient but would allow people to set various attributes .


please remove package: owl_example

I've published it by accident, it is a demo sub-project for owl_codegen, and unusable on its own.
https://pub.dartlang.org/packages/owl_example

Done.


Use returnClass parameter in call to EntityManager.createNamedQuery in generated methods

Minor change. Creating named query as TypedQuery is avoiding (irritating) compilation warnings

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license
and can be relicensed under the terms of the LGPL v2.1 license in the future at the maintainers' discretion.
For more information on licensing, please check here.

Thanks!


Scan screen with red top and bottom bars

When I set this on my theme :
       <item name="android:background">#00000000</item>
The scan screen has red bars that are really ugly

My current styles config :
 <style name="AppBaseTheme" parent="Theme.AppCompat">

    </style>

<style name="AppTheme" parent="@style/AppBaseTheme">
    <!-- All customizations that are NOT specific to a particular API-level can go here. -->
    <item name="android:background">#00000000</item>
</style>

It happen with and without the EXTRA_KEEP_APPLICATION_THEME parameter.


Impossible to use computeHintedClassHash hash function

Describe the bug
In utils/hash, the computeHintedClassHash() function is set a default export :
https://github.com/starknet-io/starknet.js/blob/66a5c0341eccfef0dcdf1312c15627b7d4f6b675/src/utils/hash/classHash.ts#L115
As a Starknet.js library user, I am not able to import and use this function.
Error message :
TSError: ⨯ Unable to compile TypeScript:
src/tmp/26.testSepolia.ts:33:25 - error TS2551: Property 'computeHintedClassHash' does not exist on type 'typeof index$1'. Did you mean 'computeCompiledClassHash'?

33     const result = hash.computeHintedClassHash()
                           ~~~~~~~~~~~~~~~~~~~~~~

To Reproduce
In a ts-node script :
import { hash } from "starknet";
const result = hash.computeHintedClassHash();

Expected behavior
To be able to use this function.
Screenshots
N/A
Desktop (please complete the following information):

Browser & version [e.g. chrome, safari, webworker] : any
Node version [e.g. 16.0.1]<EMAIL_ADDRESS>Starknet.js version :  v6.9.0
Network [devnet, testnet]: any

Additional context
N/A

@PhilippeR26  can i hop on this?

Not yet.
I am creating today several issues, that have to be first discussed internally.
The team will then decide if it will be solved internally or with contributors.

FIx:
Add into starknet.js/src/utils/hash/index.ts
export { default as computeHintedClassHash } from './classHash';

But I don't think we need to have default export anyway, so just remove default, run test if all ok resolved.


how to install in  windows10 system?

how to install in  windows10 system?

Doesn't that NSIS install build script working for you?

I'm going to close this for now. If you're look for appx for windows 10. It's planed in the next release.
Use scripts/build.py nsis for now.


[is-it-a-bug] The IPFS artefact containing the output data always adds an ./outputs/ directory

The issue here is that as a user, I expect the IPFS result to contain the contents of the/outputs directory. E.g.
If I were to view IPFS CID<PHONE_NUMBER>32, then I would expect the directory structure to look like:
.
├── foo.txt
└── some-dir
    └── bar.txt

But in fact, the structure is:
.
└── outputs
    ├── foo.txt
    └── some-dir
        └── bar.txt

So for example, when reusing a CID in a subsequent job, I have to look for files inside the inputs then outputs directory, which very quickly gets confusing. Like this:
bacalhau docker run --download --inputs Qma5e6EDpPe2TsKuz3tumSPSta6vtx48A18f9k99HJATfp ubuntu -- ls -l /inputs/outputs/

Huh! Not good - I'll try to find today

So I think that this needs a bit more thinking because we have the option to have multiple output volumes and so the single "results" cid has to encompass outputs (the automatically created output volume) and data and mycustomoutputvolume
Now - we could say that there is always a single output volume but then that might constrict jobs where containers already will write to multiple locations and we want to capture all of those outputs - for example - if we run some kind of data processing container - it might write files to:

/data
/logs/thing
/artifacts

And now it's really hard to make that container to write all of it's files to the same output location.
Having said that - I can see why the above comment is bad UX - how about we print the CIDs of each output volume as part of the results summary - e.g.:
Your job has complete - the CID of the results are:

  * all results: Qma5e6....
  * volumes
    * `outputs`: Qme7b2...
    * `data`: Qmc9d2...
    * `logs`: Qm67e2..

This could also be included in the describe output
Then - to directly consume the contents of a single output volume in another job - the user just has to copy the CID of the output volume they want without having to do path munging or ipfs lookups themselves - also we get to keep multiple output volumes which I think is quite important

yeah sounds fine, thanks!


File Icons aligned to top when using Remote-Edit

When using the package remote edit, the icons seem to be aligned to the top of the tab instead of the window. This occurs with many different file types.
Here are a variety of remotely opened files:

Here is a remotely opened file next to a local one:

Not quite sure whether this is an issue more appropriate for your project, or the other! I posted to both, just in case.

@arda- Can you pop the inspector tools open and examine the CSS class of the misaligned icon? (View → Developer → Toggle Developer Tools).
I currently don't have access to a remote server where I can reproduce this.

A local file tab has only a class of "title" while a remote-edit tab has "title icon icon-globe". It seems as if remote-edit is trying to do icon functionality (which sounds good) but it's incompatible with at least this other icon package.

Right, found it. These lines are the culprit:

Patching it right now.

Alright, done. Sorry about the delay, I was adding a new icon. :) Figure I may as well push both out with the one release.


Add tests for flowbit oring

Goes with https://github.com/OISF/suricata/pull/4778

Replaced with #211


Random Number Generator Command

Malcolm already has dice, don't need an RNG as well.

Malcolm already has dice, don't need an RNG as well.


Move to beginning / end

Adding support for moveToBeginningOfDocument / moveToEndOfDocument

Thanks! 🍨  Just a couple comments.

Awesome! Thanks. 👍


[Android] MultiplatformBleAdapter integration

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: scibas:x: Bartosz WilkBartosz Wilk seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Set cloud build number based on official build version

See cloud build considerations for options.
In this repo you have 3 unique version.json files, which begs the question of which version you consider to be "official" or most broadly applicable that you'd want to use as the cloud build number.

which begs the question of which version you consider to be "official"

At the moment are all three "official" we are  treating three package as "separate" product with some difference, we have different feature support between console(dotnet tool) msbuild and collector usage.

Interesting. Do you intend to continue with 3 distinct versions of packages shipping from each commit?
If so, the a cloud build number probably would be more confusing than anything and you can Won't Fix this.
And FYI, when you want to translate a version number back into a commit, you'll need to specify the path to the project whose version you're starting from:
nbgv get-commits -p src\coverlet.console 1.2.3

Interesting. Do you intend to continue with 3 distinct versions of packages shipping from each commit?

I think so, but maybe @tonerdo can answer better than me he published coverlet before I started to help.
Personally I don't mind for now keep three product separated, as I've said they are "different product" with different features, they share a core lib but with different "supported features", for instance we could fix a collector without touch core lib in that case we bump only collector version.

And FYI, when you want to translate a version number back into a commit, you'll need to specify the path to the project whose version you're starting from:

Oh ok thank's


stub out Linux specific syscalls on other platforms

What this PR does / why we need it:
This allows things like linters, etc. work on other platforms as well.

Codecov Report

Merging #45 into master will increase coverage by 0.35%.
The diff coverage is 0%.

@@            Coverage Diff             @@
##           master      #45      +/-   ##
==========================================
+ Coverage    52.8%   53.15%   +0.35%
==========================================
  Files          10       10
  Lines        1356     1347       -9
==========================================
  Hits          716      716
+ Misses        529      520       -9
  Partials      111      111

Impacted Files
Coverage Δ

syscalls.go
37.39% <0%> (+2.54%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4cd01fe...ec891f0. Read the comment docs.


Bus, engine and trailer icons

Requirements before reporting

[X] No duplicated issue reported
[X] I have read the contribution guidelines
[X] I have checked the lastest version if the feature exist there

Type of feature request
Design
What is your feature request?
I'd like Tegel to add icons for buses, engines and trailers to the library.
All of the above are tightly connected to our business and used across multiple systems.
Today there is no support for them, hence we are forced to use icons with different styles, or pictograms.
Background
.
Idea
No response
Goals and objectives
No response
Timeline
No response
Resources
No response
Contact information
<EMAIL_ADDRESS>

Thanks for your request Alex!
I'll forward it to the team.

This feature request is added to our backlog, both design and development work is needed. If you have any further questions reach out to our PO, Johan Nilo.


Bound the size of cache in deprecation logger

The current implementation of the map used to de-duplicate deprecation log messages can grow without bound. This replaces the ConcurrentHashMap implementation with an o.o.common.cache.Cache implementation configured for a fixed maximum size. To reduce memory overhead, this also changes to storing only a hash of the key instead of the full text since we never need to retrieve the original entry.
Related Issues
Resolves #16702
Check List

[x] Functionality includes testing.
[ ] ~API changes companion pull request created, if applicable.~
[ ] ~Public documentation issue/PR created, if applicable.~

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Is not using a concurrent hash map a premature optimization?

@dblock I don't think using the OpenSearch Cache is an optimization. It's definitely slower! The code is simple though, which is why I chose it.
What alternative do you have in mind with a concurrent hash map? The choices I see are: (1) stop deduplicating when the map hits a certain capacity, or (2) track insertion order to know which ones to evict. I could maybe be convinced that option 1 is good enough, but option 2 is what I implemented using the existing Cache data structure.

The choices I see are: (1) stop deduplicating when the map hits a certain capacity,

I would agree with @dblock here, the Cache does much more than (expiration tracking, etc) that we need, plus we actually introduce more boxing operations using hash code  (int -> Integer). May be ConcurrentHashMap is not a bad idea:
    public boolean isAlreadyLogged() {
        return keys.size() <  MAX_DEDUPE_CACHE_ENTRIES && keys.putIfAbsent(keyWithXOpaqueId) == null;
    }

stop deduplicating when the map hits a certain capacity

@reta Agreed that Cache does a lot more than we need (mostly around stats...time-based expiration is a no-op if you don't configure it), but it does give us the LRU semantics which seem beneficial here. The pattern I worry about if we have a simple capacity limit is if you have clients that periodically rotate their opaque ID, then at some point if you leave an OpenSearch server running long enough then it will just stop de-duplicating deprecation warnings.

@reta Agreed that Cache does a lot more than we need (mostly around stats...time-based expiration is a no-op if you don't configure it), but it does give us the LRU semantics which seem beneficial here.

Thanks @andrross , I would have expected us to use LRU semantics but Cache is configured without any expiration policies set (please  correct me if I am wrong), so LRU is not used. I also very much aligned with @dblock on the simplicity part, this flow is far from critical and it look to me that logging the deprecation warning 65k times (which I believe would very likely be the same deprecate feature triggered over and over again) is sufficient to be noticeable.

I would have expected us to use LRU semantics but Cache is configured without any expiration policies set (please correct me if I am wrong), so LRU is not used

@reta Without expiration policies the Cache will track insertion order, so you're correct it is not LRU, but the basic point is that the Cache will allow new entries to be deduplicated after the limit is reached. However, I can totally buy the argument that this is not a critical code path and it is better to be simple and fast than adding overhead to handle edge cases.

@reta I pushed a simple version that simply enforces a size limit in the map. Let me know what you think.

@dblock I think you would like it ;-)


Refactoring Needed

Small changes I would like to see:

[ ] Rename ChatsFragment to ConversationFragment and such to avoid confusion
[ ] Delete interactor interfaces (seem a bit useless to me now)
[ ] Create base activity and fragment to avoid code duplication (progress loader and toast methods)

Free free to take on any of these and let the team know, @blong1996 and @corybrooks.


JU does not provide cumulative number of deceased

The number of deceased on the table of canton Jura are not cumulative, so the scraper must calculate the value if a number is provided.

Check if our data needs to be updated accordingly

Updated our data.

#583


Unable to build OpenSSL 3.0.2 for arm64 MacOS

I am trying to build OpenSSL 3.0.2 on x64 (Intel) MacOS for arm64 11.6.2 with the following command line:
./Configure darwin64-arm64 no-shared no-module no-ssl2 no-ssl3 no-idea no-psk no-srp no-ec2m no-weak-ssl-ciphers no-legacy --openssldir=ssl
make

The build fails unfortunately:
${LDCMD:-cc} -arch arm64 -O3 -Wall -L. -Wl,-search_paths_first  \
                -o apps/openssl \
                apps/lib/openssl-bin-cmp_mock_srv.o \
                apps/openssl-bin-asn1parse.o apps/openssl-bin-ca.o \
                apps/openssl-bin-ciphers.o apps/openssl-bin-cmp.o \
                apps/openssl-bin-cms.o apps/openssl-bin-crl.o \
                apps/openssl-bin-crl2pkcs7.o apps/openssl-bin-dgst.o \
                apps/openssl-bin-dhparam.o apps/openssl-bin-dsa.o \
                apps/openssl-bin-dsaparam.o apps/openssl-bin-ec.o \
                apps/openssl-bin-ecparam.o apps/openssl-bin-enc.o \
                apps/openssl-bin-engine.o apps/openssl-bin-errstr.o \
                apps/openssl-bin-fipsinstall.o apps/openssl-bin-gendsa.o \
                apps/openssl-bin-genpkey.o apps/openssl-bin-genrsa.o \
                apps/openssl-bin-info.o apps/openssl-bin-kdf.o \
                apps/openssl-bin-list.o apps/openssl-bin-mac.o \
                apps/openssl-bin-nseq.o apps/openssl-bin-ocsp.o \
                apps/openssl-bin-openssl.o apps/openssl-bin-passwd.o \
                apps/openssl-bin-pkcs12.o apps/openssl-bin-pkcs7.o \
                apps/openssl-bin-pkcs8.o apps/openssl-bin-pkey.o \
                apps/openssl-bin-pkeyparam.o apps/openssl-bin-pkeyutl.o \
                apps/openssl-bin-prime.o apps/openssl-bin-progs.o \
                apps/openssl-bin-rand.o apps/openssl-bin-rehash.o \
                apps/openssl-bin-req.o apps/openssl-bin-rsa.o \
                apps/openssl-bin-rsautl.o apps/openssl-bin-s_client.o \
                apps/openssl-bin-s_server.o apps/openssl-bin-s_time.o \
                apps/openssl-bin-sess_id.o apps/openssl-bin-smime.o \
                apps/openssl-bin-speed.o apps/openssl-bin-spkac.o \
                apps/openssl-bin-storeutl.o apps/openssl-bin-ts.o \
                apps/openssl-bin-verify.o apps/openssl-bin-version.o \
                apps/openssl-bin-x509.o \
                apps/libapps.a -lssl -lcrypto
Undefined symbols for architecture arm64:
  "_FMT_istext", referenced from:
      _app_get_pass in libapps.a(libapps-lib-apps.o)
      _app_load_config_verbose in libapps.a(libapps-lib-apps.o)
      _bio_open_default_ in libapps.a(libapps-lib-apps.o)
      _app_load_modules in libapps.a(libapps-lib-apps.o)
      _load_index in libapps.a(libapps-lib-apps.o)
      _dup_bio_in in libapps.a(libapps-lib-apps.o)
      _dup_bio_out in libapps.a(libapps-lib-apps.o)
      ...
  "_ossl_kdf_pbkdf2_default_checks", referenced from:
      _kdf_pbkdf2_new in libcrypto.a(libdefault-lib-pbkdf2.o)
      _kdf_pbkdf2_reset in libcrypto.a(libdefault-lib-pbkdf2.o)
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[1]: *** [apps/openssl] Error 1
make: *** [build_sw] Error 2

Here is my output of perl configdata.pm --dump:
Command line (with current working directory = .):

    perl ./Configure darwin64-arm64 no-shared no-module no-ssl2 no-ssl3 no-idea no-psk no-srp no-ec2m no-weak-ssl-ciphers no-legacy --openssldir=ssl

Perl information:

    perl
    5.30.2 for darwin-thread-multi-2level

Enabled features:

    aria
    asm
    async
    autoalginit
    autoerrinit
    autoload-config
    bf
    blake2
    bulk
    cached-fetch
    camellia
    capieng
    cast
    chacha
    cmac
    cmp
    cms
    comp
    ct
    deprecated
    des
    dgram
    dh
    dsa
    dtls
    ec
    ecdh
    ecdsa
    engine
    err
    filenames
    gost
    makedepend
    md4
    mdc2
    multiblock
    nextprotoneg
    ocb
    ocsp
    padlockeng
    pic
    pinshared
    poly1305
    posix-io
    rc2
    rc4
    rdrand
    rfc3779
    rmd160
    scrypt
    secure-memory
    seed
    siphash
    siv
    sm2
    sm3
    sm4
    sock
    srtp
    sse2
    ssl
    ssl-trace
    static-engine
    stdio
    tests
    threads
    tls
    ts
    ui-console
    whirlpool
    tls1
    tls1-method
    tls1_1
    tls1_1-method
    tls1_2
    tls1_2-method
    tls1_3
    dtls1
    dtls1-method
    dtls1_2
    dtls1_2-method

Disabled features:

    acvp-tests          [cascade]        OPENSSL_NO_ACVP_TESTS
    afalgeng            [not-linux]      OPENSSL_NO_AFALGENG
    asan                [default]        OPENSSL_NO_ASAN
    buildtest-c++       [default]
    crypto-mdebug       [default]        OPENSSL_NO_CRYPTO_MDEBUG
    devcryptoeng        [default]        OPENSSL_NO_DEVCRYPTOENG
    dso                 [cascade]        OPENSSL_NO_DSO
    dynamic-engine      [cascade]
    ec2m                [option]         OPENSSL_NO_EC2M
    ec_nistp_64_gcc_128 [default]        OPENSSL_NO_EC_NISTP_64_GCC_128
    egd                 [default]        OPENSSL_NO_EGD
    external-tests      [default]        OPENSSL_NO_EXTERNAL_TESTS
    fips                [default]
    fips-securitychecks [cascade]        OPENSSL_NO_FIPS_SECURITYCHECKS
    fuzz-afl            [default]        OPENSSL_NO_FUZZ_AFL
    fuzz-libfuzzer      [default]        OPENSSL_NO_FUZZ_LIBFUZZER
    idea                [option]         OPENSSL_NO_IDEA (skip crypto/idea)
    ktls                [default]        OPENSSL_NO_KTLS
    legacy              [option]
    loadereng           [cascade]        OPENSSL_NO_LOADERENG
    md2                 [default]        OPENSSL_NO_MD2 (skip crypto/md2)
    module              [option]
    msan                [default]        OPENSSL_NO_MSAN
    psk                 [option]         OPENSSL_NO_PSK
    rc5                 [default]        OPENSSL_NO_RC5 (skip crypto/rc5)
    sctp                [default]        OPENSSL_NO_SCTP
    shared              [option]
    srp                 [option]         OPENSSL_NO_SRP (skip crypto/srp)
    trace               [default]        OPENSSL_NO_TRACE
    ubsan               [default]        OPENSSL_NO_UBSAN
    unit-test           [default]        OPENSSL_NO_UNIT_TEST
    uplink              [no uplink_arch] OPENSSL_NO_UPLINK
    weak-ssl-ciphers    [option]         OPENSSL_NO_WEAK_SSL_CIPHERS
    zlib                [default]
    zlib-dynamic        [default]
    ssl3                [option]         OPENSSL_NO_SSL3
    ssl3-method         [default]        OPENSSL_NO_SSL3_METHOD

Config target attributes:

    AR => "ar",
    ARFLAGS => "qc",
    CC => "cc",
    CFLAGS => "-O3 -Wall",
    HASHBANGPERL => "/usr/bin/env perl",
    RANLIB => "ranlib -c",
    RC => "windres",
    asm_arch => "aarch64",
    bn_ops => "SIXTY_FOUR_BIT_LONG",
    build_file => "Makefile",
    build_scheme => [ "unified", "unix" ],
    cflags => "-arch arm64",
    cppflags => "-D_REENTRANT",
    defines => [ "OPENSSL_BUILDING_OPENSSL" ],
    disable => [  ],
    dso_scheme => "dlfcn",
    enable => [  ],
    includes => [  ],
    lflags => "-Wl,-search_paths_first",
    lib_cflags => "",
    lib_cppflags => "-DL_ENDIAN",
    lib_defines => [  ],
    module_cflags => "-fPIC",
    module_cxxflags => undef,
    module_ldflags => "-bundle",
    perl_platform => "Unix",
    perlasm_scheme => "ios64",
    shared_cflag => "-fPIC",
    shared_defines => [  ],
    shared_extension => ".\$(SHLIB_VERSION_NUMBER).dylib",
    shared_ldflag => "-dynamiclib -current_version \$(SHLIB_VERSION_NUMBER) -compatibility_version \$(SHLIB_VERSION_NUMBER)",
    shared_rcflag => "",
    shared_sonameflag => "-install_name \$(libdir)/",
    shared_target => "darwin-shared",
    sys_id => "MACOSX",
    thread_defines => [  ],
    thread_scheme => "pthreads",
    unistd => "<unistd.h>",

Recorded environment:

    AR =
    ARFLAGS =
    AS =
    ASFLAGS =
    BUILDFILE =
    CC =
    CFLAGS =
    CPP =
    CPPDEFINES =
    CPPFLAGS =
    CPPINCLUDES =
    CROSS_COMPILE =
    CXX =
    CXXFLAGS =
    HASHBANGPERL =
    LD =
    LDFLAGS =
    LDLIBS =
    MT =
    MTFLAGS =
    OPENSSL_LOCAL_CONFIG_DIR =
    PERL =
    RANLIB =
    RC =
    RCFLAGS =
    RM =
    WINDRES =
    __CNF_CFLAGS =
    __CNF_CPPDEFINES =
    __CNF_CPPFLAGS =
    __CNF_CPPINCLUDES =
    __CNF_CXXFLAGS =
    __CNF_LDFLAGS =
    __CNF_LDLIBS =

Makevars:

    AR              = ar
    ARFLAGS         = qc
    CC              = cc
    CFLAGS          = -O3 -Wall
    CPPDEFINES      =
    CPPFLAGS        =
    CPPINCLUDES     =
    CXXFLAGS        =
    HASHBANGPERL    = /usr/bin/env perl
    LDFLAGS         =
    LDLIBS          =
    PERL            = perl
    RANLIB          = ranlib -c
    RC              = windres
    RCFLAGS         =

NOTE: These variables only represent the configuration view.  The build file
template may have processed these variables further, please have a look at the
build file for more exact data:
    Makefile

build file:

    Makefile

build file templates:

    Configurations/common0.tmpl
    Configurations/unix-Makefile.tmpl

If you try ar t apps/libapps.a | grep fmt is there  fmt.o object file included? And same for ar t libcrypto.a | grep pbkdf2_fips

I can replicate this result if I configure+build for x86_64 then arm64 back-to-back without a make clean between them:
$ tar xfz openssl-3.0.2.tar.gz
$ cd openssl-3.0.2
$ perl Configure darwin64-x86_64 no-shared no-module no-ssl2 no-ssl3 no-idea no-psk no-srp no-ec2m no-weak-ssl-ciphers no-legacy
$ make -j4
perl Configure darwin64-arm64 no-shared no-module no-ssl2 no-ssl3 no-idea no-psk no-srp no-ec2m no-weak-ssl-ciphers no-legacy
$ make -j4

leads to
:
Undefined symbols for architecture arm64:
  "_ossl_kdf_pbkdf2_default_checks", referenced from:
      _kdf_pbkdf2_new in libcrypto.a(libdefault-lib-pbkdf2.o)
      _kdf_pbkdf2_reset in libcrypto.a(libdefault-lib-pbkdf2.o)
Undefined symbols for architecture arm64:
  "_ossl_kdf_pbkdf2_default_checks", referenced from:
      _kdf_pbkdf2_new in libcrypto.a(libdefault-lib-pbkdf2.o)
      _kdf_pbkdf2_reset in libcrypto.a(libdefault-lib-pbkdf2.o)
ld: symbol(s) not found for architecture arm64
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[1]: *** [fuzz/asn1-test] Error 1
make[1]: *** Waiting for unfinished jobs....
make[1]: *** [fuzz/asn1parse-test] Error 1
make: *** [build_sw] Error 2

but if I extract the release in a fresh directory and just build for arm64 it works:
$ tar xfz openssl-3.0.2.tar.gz
$ cd openssl-3.0.2
$ perl Configure darwin64-arm64 no-shared no-module no-ssl2 no-ssl3 no-idea no-psk no-srp no-ec2m no-weak-ssl-ciphers no-legacy
$ make -j4

leads to
:
${LDCMD:-cc} -arch arm64 -O3 -Wall -L. -Wl,-search_paths_first  \
                -o test/x509aux \
                test/x509aux-bin-x509aux.o \
                test/libtestutil.a -lcrypto
rm -f apps/openssl
${LDCMD:-cc} -arch arm64 -O3 -Wall -L. -Wl,-search_paths_first  \
                -o apps/openssl \
                apps/lib/openssl-bin-cmp_mock_srv.o \
                apps/openssl-bin-asn1parse.o apps/openssl-bin-ca.o \
                apps/openssl-bin-ciphers.o apps/openssl-bin-cmp.o \
                apps/openssl-bin-cms.o apps/openssl-bin-crl.o \
                apps/openssl-bin-crl2pkcs7.o apps/openssl-bin-dgst.o \
                apps/openssl-bin-dhparam.o apps/openssl-bin-dsa.o \
                apps/openssl-bin-dsaparam.o apps/openssl-bin-ec.o \
                apps/openssl-bin-ecparam.o apps/openssl-bin-enc.o \
                apps/openssl-bin-engine.o apps/openssl-bin-errstr.o \
                apps/openssl-bin-fipsinstall.o apps/openssl-bin-gendsa.o \
                apps/openssl-bin-genpkey.o apps/openssl-bin-genrsa.o \
                apps/openssl-bin-info.o apps/openssl-bin-kdf.o \
                apps/openssl-bin-list.o apps/openssl-bin-mac.o \
                apps/openssl-bin-nseq.o apps/openssl-bin-ocsp.o \
                apps/openssl-bin-openssl.o apps/openssl-bin-passwd.o \
                apps/openssl-bin-pkcs12.o apps/openssl-bin-pkcs7.o \
                apps/openssl-bin-pkcs8.o apps/openssl-bin-pkey.o \
                apps/openssl-bin-pkeyparam.o apps/openssl-bin-pkeyutl.o \
                apps/openssl-bin-prime.o apps/openssl-bin-progs.o \
                apps/openssl-bin-rand.o apps/openssl-bin-rehash.o \
                apps/openssl-bin-req.o apps/openssl-bin-rsa.o \
                apps/openssl-bin-rsautl.o apps/openssl-bin-s_client.o \
                apps/openssl-bin-s_server.o apps/openssl-bin-s_time.o \
                apps/openssl-bin-sess_id.o apps/openssl-bin-smime.o \
                apps/openssl-bin-speed.o apps/openssl-bin-spkac.o \
                apps/openssl-bin-storeutl.o apps/openssl-bin-ts.o \
                apps/openssl-bin-verify.o apps/openssl-bin-version.o \
                apps/openssl-bin-x509.o \
                apps/libapps.a -lssl -lcrypto

This is with
$ sw_vers
ProductName:	macOS
ProductVersion:	12.3
BuildVersion:	21E230
$ clang --version
Apple clang version 13.1.6 (clang-13<IP_ADDRESS>)
Target: x86_64-apple-darwin21.4.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

@thomasreiser can you try in a new directory, please?

Do we think this is an issue with 3.0.2 that requires a fix, or is it a local problem on the OP's system?

Hi there, sorry for the late response. It works indeed when I copy the source dir and configure/build them separately.

I do not think this is a bug. You should use out of tree builds with separate build dirs if you're building for multiple targets.

Agreed. Unless an out-of-tree build is used; configuring and building OpenSSL for two different targets will cause problems, as it would with any other piece of software that doesn't automatically build out-of-tree.
I suppose a check to see if the config target changes could cause an error to be generated. But this is easily resolved by the user.

Should this issue therefore be closed?


Add NLP CheatSheet

@aryankashyap7 Can I work on it!?

@nishant3721 Sure, You can start working on it! Even check out the Machine Learning Cheatsheet as a reference and proceed as you would like to contribute :)


Show the release version

It'd be nice to have the release version somewhere without having to go to the app properties in android.
For example, with a less invasive font of course:

Good idea

Do you ever sleep?😃
Thanks!! 🙏


[ISSUE #3265]add GrayRelease AllocateMessageQueue strategy

Make sure set the target branch to develop
What is the purpose of the change
#3265
Brief changelog
#3265
Verifying this change
#3265
Follow this checklist to help us incorporate your contribution quickly and easily. Notice, it would be helpful if you could finish the following 5 checklist(the last one is not necessary)before request the community to review your PR.

[x] Make sure there is a Github issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a Github issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
[x] Format the pull request title like [ISSUE #123] Fix UnknownException when host config not exist. Each commit in the pull request should have a meaningful subject line and body.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Write necessary unit-test(over 80% coverage) to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add integration-test in test module.
[x] Run mvn -B clean apache-rat:check findbugs:findbugs checkstyle:checkstyle to make sure basic checks pass. Run mvn clean install -DskipITs to make sure unit-test pass. Run mvn clean test-compile failsafe:integration-test  to make sure integration-test pass.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Coverage decreased (-0.005%) to 54.167% when pulling 23f58463581ba95d1010ac263672b1ec5090e678 on makabakaboom:gray-release into ec985ee67354a55607c3b5fde2e110dfb1268fea on apache:develop.

Codecov Report

Merging #3266 (23f5846) into develop (ec985ee) will increase coverage by 0.50%.
The diff coverage is 100.00%.

@@              Coverage Diff              @@
##             develop    #3266      +/-   ##
=============================================
+ Coverage      48.02%   48.53%   +0.50%
+ Complexity      4563     3190    -1373
=============================================
  Files            552      418     -134
  Lines          36521    26319   -10202
  Branches        4818     3487    -1331
=============================================
- Hits           17541    12775    -4766
+ Misses         16768    11897    -4871
+ Partials        2212     1647     -565

Impacted Files
Coverage Δ

...c/main/java/org/apache/rocketmq/common/MixAll.java
44.44% <100.00%> (+0.25%)
:arrow_up:

...org/apache/rocketmq/common/stats/StatsItemSet.java
41.79% <0.00%> (-5.98%)
:arrow_down:

...ava/org/apache/rocketmq/filter/util/BitsArray.java
59.82% <0.00%> (-2.57%)
:arrow_down:

.../rocketmq/broker/filter/ConsumerFilterManager.java
72.19% <0.00%> (-1.80%)
:arrow_down:

...a/org/apache/rocketmq/store/StoreStatsService.java
29.50% <0.00%> (-1.32%)
:arrow_down:

...java/org/apache/rocketmq/logging/inner/Logger.java
52.15% <0.00%> (-0.48%)
:arrow_down:

...he/rocketmq/remoting/protocol/RemotingCommand.java
78.22% <0.00%> (-0.41%)
:arrow_down:

.../apache/rocketmq/logging/inner/LoggingBuilder.java
63.76% <0.00%> (-0.32%)
:arrow_down:

...main/java/org/apache/rocketmq/store/CommitLog.java
73.53% <0.00%> (-0.12%)
:arrow_down:

...lient/impl/consumer/DefaultMQPushConsumerImpl.java

... and 136 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ec985ee...23f5846. Read the comment docs.


Add new KIS and KAS

Add the following mods:

KIS-1.2.3
KAS-0.5.5

Forcing a rebuild

Merging. Thanks a lot for all the metadata help overall. I sincerely appreciate it.


Add section on ClinVar ingest caveats

thanks @calbach

@calbach, @deflaux This is nice but it probably might be better to use ClinVar's XML file - in conjunction with its other annotation files - rather than just the tab-delimited one, since the tab-delimited one can at times be limited in information as compared to the XML.  I think something similar was previously discussed in the following thread last year:
https://github.com/googlegenomics/bigquery-examples/issues/6
Below is a link to the latest ClinVar XML file:
ftp://ftp.ncbi.nlm.nih.gov/pub/clinvar/xml/ClinVarFullRelease_2015-04.xml.gz
Also I thought we were using Tute Genomics' processed annotation data.  Is that also integrated?
Thanks,
~p


v0.23.0

New Features

Images are now cached with the HTTP ETag. This conserves bandwidth and improves page load time. (resolves #213, thanks to @Leeingnyo)
Mango now preloads pages when in the paged mode. You can configure or disable the behavior from the reader modal. (resolves #196, thanks to @Leeingnyo)

Improvements

You can now adjust the continuous mode page margin on the frontend with a slider. This deprecates the page_margin field in the config file. (resolves #211)
You can now disable the page flipping animation in the paged reader. (partly #147, thanks to @Leeingnyo)

Bug-Fixes

Fix a UI bug where the buttons are stacking in the reader modal when viewed on mobile.
Fix paged mode image stretching issue. (fixes #218, thanks to @Leeingnyo)
Fix a bug where unnecessary pages are loaded in paged mode. (fixes #217, thanks to @Leeingnyo)

Misc.

Remove MangaDex integration, as it's not working due to their changes of the API. We will be moving the functionalities to an official MangaDex plugin. See https://github.com/hkalexling/Mango/issues/170#issuecomment-788772900
Upgrade to Crystal 1.0.0 (thanks to @Leeingnyo)

Thank you for implementing the feature request.
I think the /upload/img/ path should also be cached for uploaded image.

@Elastic1 Currently uploaded images are only used as custom thumbnails, and all thumbnails are being cached at the API level.