[BUG] Library "libkmagick.so" not found

Prerequisites
Please answer the following questions for yourself before submitting an issue.

[x] I am running the latest version
[x] I checked the documentation and examples and found no answer
[x] I checked that it wasn't user error; it was not an ordinary exception that I could've found out and fixed by running wand.getException()
[x] I checked that this isn't an ImageMagick bug itself, and is an actual problem with the bindings
[x] I checked to make sure that this issue has not already been filed
[x] I'm reporting the issue to the correct repository

Context
Please provide any relevant information about your setup. This is important in case the issue is not reproducible except for under certain conditions.

Android SDK version (if using Android): Android 11.0
Product (Android Studio, Flutter, etc): Android Studio
Kotlin version: 1.6.21

A 100% working app example would be far more useful than the current sample directory which is just a repeat of the readme instructions.
I've tried changing the name and location of the jni library folder and location of the .so file (libs, jniLibs, jniLibs/arm6-v8a, res, etc...)

05/10 22:15:34: Launching 'app' on Pixel 3 API 30.
Install successfully finished in 3 s 667 ms.
$ adb shell am start -n "world.gregs.android.receipt/world.gregs.android.receipt.MainActivity" -a android.intent.action.MAIN -c android.intent.category.LAUNCHER
Connected to process 27550 on device 'Pixel_3_API_30 [emulator-5554]'.
Capturing and displaying logcat messages from application. This behavior can be disabled in the "Logcat output" section of the "Debugger" settings page.
D/NetworkSecurityConfig: No Network Security Config specified, using platform default
D/NetworkSecurityConfig: No Network Security Config specified, using platform default
D/libEGL: loaded /vendor/lib/egl/libEGL_emulation.so
D/libEGL: loaded /vendor/lib/egl/libGLESv1_CM_emulation.so
D/libEGL: loaded /vendor/lib/egl/libGLESv2_emulation.so
D/AndroidRuntime: Shutting down VM
E/AndroidRuntime: FATAL EXCEPTION: main
    Process: world.gregs.android.receipt, PID: 27550
    java.lang.UnsatisfiedLinkError: dlopen failed: library "libkmagick.so" not found
        at java.lang.Runtime.loadLibrary0(Runtime.java:1087)
        at java.lang.Runtime.loadLibrary0(Runtime.java:1008)
        at java.lang.System.loadLibrary(System.java:1664)
        at com.cherryleafroad.kmagick.Magick.<clinit>(Magick.kt:12)
        at world.gregs.android.receipt.MainActivity.onCreate(MainActivity.kt:40)
        at android.app.Activity.performCreate(Activity.java:8000)
        at android.app.Activity.performCreate(Activity.java:7984)
        at android.app.Instrumentation.callActivityOnCreate(Instrumentation.java:1309)
        at android.app.ActivityThread.performLaunchActivity(ActivityThread.java:3422)
        at android.app.ActivityThread.handleLaunchActivity(ActivityThread.java:3601)
        at android.app.servertransaction.LaunchActivityItem.execute(LaunchActivityItem.java:85)
        at android.app.servertransaction.TransactionExecutor.executeCallbacks(TransactionExecutor.java:135)
        at android.app.servertransaction.TransactionExecutor.execute(TransactionExecutor.java:95)
        at android.app.ActivityThread$H.handleMessage(ActivityThread.java:2066)
        at android.os.Handler.dispatchMessage(Handler.java:106)
        at android.os.Looper.loop(Looper.java:223)
        at android.app.ActivityThread.main(ActivityThread.java:7656)
        at java.lang.reflect.Method.invoke(Native Method)
        at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
        at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)
I/Process: Sending signal. PID: 27550 SIG: 9

In your screenshot, libkmagick.so isn't in the same folder as the others.

In your screenshot, libkmagick.so isn't in the same folder as the others.

It seemingly makes no difference

I take it's probably because I'm using a x86 emulator?

Can you zip up your project and send it? If it's proprietary, you can create a minimal example which fails.

I take it's probably because I'm using a x86 emulator?
Well, as the arch says, it's arm64-v8a. x86 isn't the same architecture

Well, as the arch says, it's arm64-v8a. x86 isn't the same architecture

Yeah okay I tried it on a real device and it works fine, windows machines don't support arm64-v8a emulators :(


Is there a training script?

Hi:
Thanks for your interest!
We have released a new version of our MPI-Flow, which supports the online training of RAFT.
Code is released at https://github.com/Sharpiless/Train-RAFT-from-single-view-images.
Please carefully modify the camera params at https://github.com/Sharpiless/Train-RAFT-from-single-view-images/blob/f6016555dd93cd5c27b50828a4eb913fce8e4ce7/core/utils/utils.py#L118
All the best,
Yingping Liang


Support proxy setting, including https-proxy-agent

Hi @mbr74  isn't this a duplicate of https://github.com/storyblok/storyblok-nuxt/pull/39, could you align with @marymar to join efforts in one PR only? Thanks


Single VM: container network connectivity test failure

The docker network connectivity tests fail due to changes in the upstream ubuntu image.
Checking Docker Networking

sudo docker exec 0388c9b5b568 /bin/ping -c 3 <IP_ADDRESS>
rpc error: code = 2 desc = oci runtime error: exec failed: exec: "/bin/ping": stat /bin/ping: no such file or directory
'[' 126 -ne 0 ']'
echo 'FATAL ERROR: Unable to ping across containers'
FATAL ERROR: Unable to ping across containers
exit 1

Fixed by https://github.com/albertomurillo/ciao/commit/276f6b839b20e579eb667b380e9b9153418d8335


#656 Upgrades coverall and mkdirp version to fix security issues

The current version of coverall and mkdirp used in node-tap have a transitive dependency of minimist below 1.2.2 and those versions have security issues. The pull request upgrades and coverall and mkdirp to their current latest version and hence fixes all security issues.

Hi @isaacs @kusor could you guys please have a look at this pr  and if things looks good to you, merge it and publish the version so that other packages which depend on this can resolve the security issues.

Changes looks fine @ashishkujoy. You should wait for @isaacs confirmation anyway, it's being ages since the last time I looked at this code :-)

@isaacs pls ! Don't forget that PR. I'm looking forward :)

Changes looks fine @ashishkujoy. You should wait for @isaacs confirmation anyway, it's being ages since the last time I looked at this code :-)

Sure

mkdirp cannot be upgraded in tap v14.  tap v14 supports node.js 8 where mkdirp 1.x requires node.js 10.
Note tap v15 (still in development) will not use mkdirp.

mkdirp cannot be upgraded in tap v14. tap v14 supports node.js 8 where mkdirp 1.x requires node.js 10.
Note tap v15 (still in development) will not use mkdirp.

If that is the case then how come build passes on the Travis CI even on node8?
https://travis-ci.org/github/tapjs/node-tap/builds/664510495?utm_source=github_status&utm_medium=notification

The fact that mkdirp 1.x currently works on node 8 does not change the fact that it's not supported.  A patch release was made to mkdirp 0.x so you can update to latest 0.x.

The fact that mkdirp 1.x currently works on node 8 does not change the fact that it's not supported. A patch release was made to mkdirp 0.x so you can update to latest 0.x.

Well going by that theory then the node JS 8 is not even a LTS now.


error in the train_minst.py image classification example

Description
when running the gpu training validation example listed in https://mxnet.apache.org/install/validate_mxnet.html
python example/image-classification/train_mnist.py --network lenet --gpus 0
the script throws an error about mx.lr_scheduler.MultiFactorScheduler() not having the argument 'base_lr'
this is the complete error
INFO:root:start with arguments Namespace(add_stn=False, batch_size=64, disp_batches=100, dtype='float32', gc_threshold=0.5, gc_type='none', gpus='0', image_shape='1, 28, 28', ini tializer='default', kv_store='device', load_epoch=None, loss='', lr=0.05, lr_factor=0.1, lr_step_epochs='10', macrobatch_size=0, model_prefix=None, mom=0.9, monitor=0, network='l enet', num_classes=10, num_epochs=20, num_examples=60000, num_layers=None, optimizer='sgd', profile_server_suffix='', profile_worker_suffix='', save_period=1, test_io=0, top_k=0,  warmup_epochs=5, warmup_strategy='linear', wd=0.0001) Traceback (most recent call last):   File "example/image-classification/train_mnist.py", line 97, in <module>     fit.fit(args, sym, get_mnist_iter)   File "/root/incubator-mxnet/example/image-classification/common/fit.py", line 220, in fit     lr, lr_scheduler = _get_lr_scheduler(args, kv)   File "/root/incubator-mxnet/example/image-classification/common/fit.py", line 53, in _get_lr_scheduler     base_lr=args.lr)) TypeError: __init__() got an unexpected keyword argument 'base_lr'
Environment info (Required)
----------Python Info----------
('Version      :', '2.7.12')
('Compiler     :', 'GCC 5.4.0 20160609')
('Build        :', ('default', 'Nov 12 2018 14:36:49'))
('Arch         :', ('64bit', 'ELF'))
------------Pip Info-----------
('Version      :', '18.1')
('Directory    :', '/usr/local/lib/python2.7/dist-packages/pip')
----------MXNet Info-----------
('Version      :', '1.3.1')
('Directory    :', '/usr/local/lib/python2.7/dist-packages/mxnet')
('Commit Hash   :', '19c501680183237d52a862e6ae1dc4ddc296305b')
----------System Info----------
('Platform     :', 'Linux-3.10.0-862.14.4.el7.x86_64-x86_64-with-Ubuntu-16.04-xenial')
('system       :', 'Linux')
('node         :', '13dfa5d30337')
('release      :', '3.10.0-862.14.4.el7.x86_64')
('version      :', '#1 SMP Wed Sep 26 15:12:11 UTC 2018')
----------Hardware Info----------
('machine      :', 'x86_64')
('processor    :', 'x86_64')
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                40
On-line CPU(s) list:   0-39
Thread(s) per core:    2
Core(s) per socket:    10
Socket(s):             2
NUMA node(s):          2
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 62
Model name:            Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz
Stepping:              4
CPU MHz:               1650.000
CPU max MHz:           3000.0000
CPU min MHz:           1200.0000
BogoMIPS:              5992.37
Virtualization:        VT-x
Hypervisor vendor:     vertical
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              25600K
NUMA node0 CPU(s):     0-9,20-29
NUMA node1 CPU(s):     10-19,30-39
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb intel_ppin ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts spec_ctrl intel_stibp flush_l1d
----------Network Test----------
Setting timeout: 10
Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.2172 sec, LOAD: 0.6428 sec.
Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0006 sec, LOAD: 0.5706 sec.
Timing for FashionMNIST: https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.2158 sec, LOAD: 1.1902 sec.
Timing for Conda: https://repo.continuum.io/pkgs/free/, DNS: 0.0008 sec, LOAD: 0.0529 sec.
Timing for Gluon Tutorial(en): http://gluon.mxnet.io, DNS: 0.0294 sec, LOAD: 0.1301 sec.
Timing for Gluon Tutorial(cn): https://zh.gluon.ai, DNS: 0.2173 sec, LOAD: 0.0973 sec.
Steps to reproduce
(Paste the commands you ran that produced the error.)
1.docker pull mxnet/python:gpu
2.nvidia-docker run -it mxnet/python:gpu  /bin/bash
inside the container
1.apt-get install git
2.git clone https://github.com/apache/incubator-mxnet.git
2.cd incubator-mxnet
3.python example/image-classification/train_mnist.py --network lenet --gpus 0
What have you tried to solve it?
1.removing the argument 'base_lr=args.lr' from line 53 in
incubator-mxnet/example/image-classification/common/fit.py seems to fix the issue

Thanks for reporting @giordyb
I had filed a similar issue earlier - https://github.com/apache/incubator-mxnet/issues/13211
Please follow steps mentioned in the above issue and let us know if this still persists.

@mxnet-label-bot add [Question, pending-requester-info]

Hi,
I was able to get it to work by checking out the v1.3.x release

@giordyb Glad you were able to resolve the issue, requesting to close this issue, if it has been resolved .

@mxnet-label-bot can we close this issue?


Add close method to RPC session

Add close method to RPCSession and make sure we call it when we finish using it.
For more context, see this discussion

@eqy @echuraev Please review


Fix android ndk clang

This is a fix of Android triplets that using clang as the default compiler.

What does your PR fix?
Fix vcpkg_configure_make based port cannot find gcc (aka clang) compiler during config stage
Fix ANDROID_NATIVE_API_LEVEL only detected from CMAKE_SYSTEM_VERSION, add ENV{ANDROID_API_LEVEL} for customizing

Which triplets are supported/not supported? Have you updated the CI baseline?
android, No

Does your PR follow the maintainer guide?

No

If you are still working on the PR, open it as a Draft: https://github.blog/2019-02-14-introducing-draft-pull-requests/

The only notification is that, please add Android NDK toolchain executable path:
export PATH=$ANDROID_NDK_HOME/toolchains/llvm/prebuilt/<host-tag>/bin:$PATH

host-tag is linux-x86_64 on linux and 'darwin-x86_64' on osx. Windows is not tested yet.

Failed to build python3:x64-osx:
configure: WARNING: unrecognized options: --disable-silent-rules, --enable-static
Configured with: --prefix=/Library/Developer/CommandLineTools/usr --with-gxx-include-dir=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/c++/4.2.1
./../src/v3.10.0-dcf0f0f52f.clean/configure: line 10530: PKG_PROG_PKG_CONFIG: command not found
./../src/v3.10.0-dcf0f0f52f.clean/configure: line 10673: /usr/local/bin/pkg-config --static: No such file or directory
configure: WARNING: unrecognized options: --disable-silent-rules, --enable-static

Failed to build python3:x64-osx

I wonder how this PR can have a side effect on /usr/local/bin/pkg-config --static being considered a single value ("No such file or directory") instead of a list for python3:x64-osx.

Failed to build python3:x64-osx

I wonder how this PR can have a side effect on /usr/local/bin/pkg-config --static being considered a single value ("No such file or directory") instead of a list for python3:x64-osx.

Well, there is one changed line which is unrelated to android, but very much related to x64-osx:
if(host_arch MATCHES "(amd|AMD|x86_|X86_)64")

This change is reasonable, but maybe it needs investigation in a separate PR. By changing host detection, the cross-build property will change to, and this can uncover bugs in other ports.

made a little changes for the z_vcpkg_determine_autotools_host_cpu. if it doesn't resolve the problem, I cannot fix it now. My Macbook is dead.....

More tests on Android libraries are needed. Anyone who have problems are welcome.

Please ping me if this PR is ready for review.
Also, cc @Neumann-A for review the configure_make part.

@JackBoosY Yes, it is ready for review. @Neumann-A

Again I feel like the default android toolchain vcpkg provides should be removed and replaced with specialized toolchains for each architecture and case. There seems to be a bigger misunderstanding of vcpkg is supposed to work and what work should be done by the configure scripts.

@holmescn You just closed this PR while I was writing a comment. I actively invited this PR, and I hoped we could help to form an acceptable result, no matter how hard it is to get Android right in vcpkg. I don't see another effort to move things for Android in vcpkg.

@dg0yt Thank you for your invite. Since @Neumann-A made a difficult goal that needs to solve the problem genetically. I don't think I have the time and skill to accomplish that target. This is a temporary solution that has many problems unknown. I hope any successor could find more elegant ways to touch the goal, maybe inspired by this effort or not. I would like to give any help if I could.

As a generic solution, we need to consider from scratch that how vcpkg passthrough each detected variable down to the build system and why they are not catched by the Android NDK toolchain. It needs more knowledge about how vcpkg works.

Thank you for opening this issue and the work in the PR. It would be nice to have a solution for android in vcpkg.
For reference, I'd also like to reference previous work by @xandox https://github.com/microsoft/vcpkg/pull/15605


452 vault client retries transaction submission for unrecoverable errors

Closes #452
Changes

Uses the string data filed on the parsed error to detect recoverable errors (lack of funds, incorrect nonce).
Otherwise, the service will avoid retry of the same call, since it is impossible to obtain a different result without modifying it (except vault operator's input).
A new condition is added so that if the error is of type POOL_UNACTIONABLE or POOL_UNKNOWN_VALIDITY (which are not necessarily invalid transactions) the vault will retry the transaction.
If the service fails to start it will send a shutdown signal to avoid waiting a dead process.

is it possible to recreate POOL_UNACTIONABLE and/or POOL_UNKNOWN_VALIDITY and test it?
examples: POOL_INVALID_TX POOL_TOO_LOW_PRIORITY

I am not sure we can test this since we would need to modify the pool logic. I could not find much information about these errors, but the assumption was that a pool error would not be a problem with the transaction itself.

Thanks @b-yap for testing this. I found that there is a second call to notify_retry inside the vault module. Most likely this is why you still were able to see the vault retrying an unrecoverable error.
As soon as I can test this and replicate that scenario I will update this comment.

Or do you remember if there was a good reason to also add the retry here @b-yap? It makes sense in this error block but not in the other one IMO.

But if there is a Skip and we keep retrying (inner retry loop) we could eventually hit here which will also return an error, but not necessarily unrecoverable as we have defined. Perhaps we could break unless it is a Timeout variant.

Yes you may be right about the outer retry loop. Either way, if we needed more retries just changing the backoff policy would be enough. Let's wait for @b-yap take on it? Otherwise we just remove the counter there and put a break like you say.


Set a size limit so large snippets aren't stored.

As usual, I can add this if you're open to the suggestion.
Not sure if it's feasible to use text length or actual size, the latter would work with images as well of course.

Does copying large snippets cause any issues?

Does copying large snippets cause any issues?
It's more related to cluttering the search results, especially with larger jsons and other dev stuff.
Wouldn't be a big deal with the second task here as you could just single disable it.

I'm going to close this then since it works as expected.


vulkaninfo: new vkconfig_outptut backend

This commit adds a new backend, full_json, that prints the same information
as the text & html versions. This output will be used in vkconfig.
To enable the output, use the --full-json flag from the command line.
Many parts of the code needed refactoring to handle the json_full output.
Replacing PrintElement with PrintString, requiring StartObject instead of
StartArray, and removing many branches to make the code simpler to read.
json_full does not nest json objects within json arrays, thus keeping every
non-leaf node of a json object named.
files modified
- scripts/vulkaninfo_generator.py
- vulkaninfo/generated/vulkaninfo.hpp
- vulkaninfo/outputprinter.h
- vulkaninfo/vulkaninfo.cpp
- vulkaninfo/vulkaninfo.h
- vulkaninfo/vulkaninfo.md
Change-Id: I33d036a75b65942db1ad62b2a1e0c341a2b5e36c

@charles-lunarg I'm freed up, is it time to review or still in flux?

There is still the concern of whether it should print to standard out or a file. Richard requested as a file as if any errors occurs, it is impossible to detect since the desired output and errors all go into the same place and overlap. I believe a separate file is best in this situation with that in mind.
Also, I need to do a once over tomorrow for all output formats, make sure none of the other outputs were altered. But that is more a sanity check than any impedance towards code-review.

There is still the concern of whether it should print to standard out or a file. Richard requested as a file as if any errors occurs, it is impossible to detect since the desired output and errors all go into the same place and overlap. I believe a separate file is best in this situation with that in mind.
Also, I need to do a once over tomorrow for all output formats, make sure none of the other outputs were altered. But that is more a sanity check than any impedance towards code-review.

I have made some minor edits to make the output more uniform and confirmed none of the outputs are totally bugged.
And as per the broader discussion, outputting vkconfig_output to a file is the desired choice.
@mikew-lunarg it's ready to be reviewed


sql: allow ALTER TABLE DROP COLUMN to drop dependent indices

PR: https://github.com/cockroachdb/cockroach/pull/12782

Docs already fine.


HTML syntax not working

I would like to use HTML syntax inside the editor for custom styles. However, nothing shows up.

Any idea how to get this working?

Forgive my stupidity, but I'm still having trouble getting this working. If you can show me where to use .use(remarkRehype, { allowDangerousHtml: true }) it would be a great help. Take your time and thanks

This should work:
const carta = new Carta({
    rehypeOptions: { allowDangerousHtml: true },
    sanitizer: false
});

ahh its in the carta const. Thanks


template compiler: generic types are dropped

This occurs when I compile using dart2js,
Say I have a Component defined as such:
class MyComponent<T extends something>
and I want to inject the following property:
final Container<T> myContainer;
I use @Inject(Container) this.myContainer; (generic type is not allowed here)
This generates the following warning:
[Warning from Dart2JS on ...]:
packages\...:
Cannot resolve type 'T'.
(Container<T> myContainer) => new MyComponent(myContainer),
          ^

We currently don't retain type information during the compile.
Blocked by #48.

What about something like @Inject(const InjectionToken(Container, const[String]))

This is not planned for 4.0.0 at this time (other lower-hanging fruit).

Open question: How should we implement this?

I think based on how Dart2 works, this is not likely to happen for V5.
I've marked this to revisit in V6+.


script doesn't work any more

it returns me this:
./update.sh: line 10: jq: command not found
./update.sh: line 11: jq: command not found
./update.sh: line 12: jq: command not found
./update.sh: line 13: jq: command not found
these parts of script are about json results. Maybe somthing with API has changed?

Hey @tischra. As you can see in the commit history the code for the script didn't change. Out of your logs I would say the jq program isn't installed on your machine anymore.


gnu(39546)=304

gnu(39546)=304
GAP      4.8.3
GrpConst 2.5
Runtime: 4052237 ms (1.13 hrs)
Isomorphic groups eliminated
In case this value is new, add the next line to data/gnudata.g
GNU_SAVE( 39546, 304, WITH_GC );

gap>
System : Windows Vista

Thank you for submitting new gnu(n). We will recalculate it and add to the database if we get the same result.
Checklist for the reviewer:

[ ] checked and assigned labels "new (n<50000)" or "recomputation", if needed
[ ] set "replication needed" label (unless it starts immediately)
[ ] changed it to "replication in progress" label when the replication has been started
[ ] changed it to "replicated" after successful replication review
[ ] reproducible value of gnu(n)
[ ] no essential runtime differences
[ ] sufficient level of technical details

Checklist for the maintainer:

[ ] correct arguments of command to store data
[ ] correct location of new line in the data file
[ ] mention submitter and reviewer in the commit message
[ ] Close corresponding issue from the commit message

gnu(39546)=304
GAP      4.8.4
GrpConst 2.5
Runtime: 2167608 ms (36.12 min)
Isomorphic groups eliminated
Replicated by @alex-konovalov on Ubuntu 16.04 on Azure cloud standard DS3 v2 instance (4 cores, 14 GB RAM)
In case this value is new, add the next line to data/gnudata.g
GNU_SAVE( 39546, 304, WITH_GC );


fix: cast of int-to-byte when int is boolean (#596)

Fixes #596
Please merge #601 first, since it is already included.

@asashour @skylot
I would also recommend to do the same for boolean -> int casts, because such cases are also generated by a wrong way

I would also recommend to do the same for boolean -> int casts, because such cases are also generated by a wrong way

I thought about int-to-char, int-to-short, but I guess there is no boolean to int cases here, I would try to make some test cases and fix them in other PRs.
I am not experienced in davlik, so appreciate if you can provide some tests.


UNSUPPORTED_CLIENT: TLS 1.0

Post sandbox update to block TLS1.0 unable to use local workbench install via Workbench Tools for Google Chrome.  Others having issues?

same here


Extract Gitops and plnsvc app-sre secrets from new cluster

The RDS and S3 resources moved from cluster app-sre-stage-01 to appsres07ue1. The databases and bucket were not re-created, they are the same on AWS side. The only thing that change is the location of the secrets we extract as the secrets names include the name of the cluster it is created on.
RHTAPSRE-310

/lgtm


linux-41 lost external connection from phone device.

Type of Request
bug
Infrastructure Environment
LUCI, Github, Cocoon scheduler, Autosubmit, etc...
What is happening?
linux-41 lost external connection from phone device.

Steps to reproduce
Step 1:
Step 2:
..
Step n:
Expected results
I expect to see X when Y is finished.

Rebooting the phone device to restore external connection.


Serialize TypeOwner::None to JSON null

This is a minor update to the JSON serialization introduced in #1203. It modifies the output so the TypeOwner value of None in Rust serializes to null in JSON.
Before
    {
      "kind": {
        "type": "u32"
      },
      "name": "example",
      "owner": "none"
    }

After
    {
      "kind": {
        "type": "u32"
      },
      "name": "example",
      "owner": null
    }

A better solution might be to change the owner field in TypeDef to Option<TypeOwner>, but that would change the public API of this crate:
#[derive(Debug, Clone, PartialEq, Serialize)]
pub struct TypeDef {
    pub name: Option<String>,
    pub kind: TypeDefKind,
    pub owner: Option<TypeOwner>,
    #[serde(skip_serializing_if = "Docs::is_empty")]
    pub docs: Docs,
}

Thanks! If you'd like I think it'd be reasonble to skip the field entirely if the field is None too

That would work too. The output would be more concise… see my previous comment on Option<TypeOwner> vs a None variant?


Program not writing password

At the enter password page, the logs says writing password but the password not entered at all. I have checked that the password given is correct. I have noticed that it immediately stops after the writing passord log appears

Hello. Are there any errors in the log window? The log window errors would include [WARNING], [ERROR], [CRITICAL] if they show up.
You could also try entering your password manually, and seeing if the farmer continues running.
I’m currently working on two things that will make problems easier to debug:

An error reporter which creates a full error report of: current browser state, account data from rewards.bing.com, the browser HTML source at the time of the error, and a screenshot of the browser at the time of the error.
Removing account information from log window, so they can be shared here, without including your emails/passwords.

Without more information it’s hard to replicate. If it’s a common login problem i will likely find it in my testing.

There isn't any errors, the farmer stops after writing password. I tried entering the password manually too but doesn't work


NETOBSERV-397 Kafka TLS

New TLS api based on CM / Secret
Helper functions to generate volumes for certificates
new "make deploy-kafka-tls"

makefile: create kafka user for TLS
Add Kafka TLS to agent & transformer
At the moment thre's a manual hack to do in order to copy kafka secrets
in the netobserv privileged namespace. Without it, ebpf pods can't mount
/bin/bash: line 1: q: command not found
Update vendor flp

/retest

/retest
we need to investigate those flaky tests...

/approve

/retest


Issue of using DeepSpeed with ZeRO Stage 3 optimization

Hi, I recently encountered an issue with training on multi-gpus. Basically, I train a cross-encoder model with DeepSpeed Zero 3, but the codebase is the same. Errors can be seen below, and it has been issued and solved at this DeepSpeed issue.
I don't know if you have encountered this issue, it works fine on one GPU. I tried with deepspeed==0.15.0 as the requirements.txt and failed, but it works with 0.15.4.
As the problem is shown very recently. Maybe you guys could check it out.
12/03/2024 07:54:53 - INFO - __main__ - ***** Running training *****
12/03/2024 07:54:53 - INFO - __main__ -   Num examples = 40723
12/03/2024 07:54:53 - INFO - __main__ -   Num Epochs = 2
12/03/2024 07:54:53 - INFO - __main__ -   Instantaneous batch size per device = 1
12/03/2024 07:54:53 - INFO - __main__ -   Total train batch size (w. parallel, distributed & accumulation) = 64
12/03/2024 07:54:53 - INFO - __main__ -   Gradient Accumulation steps = 32
12/03/2024 07:54:53 - INFO - __main__ -   Total optimization steps = 1274
  0%|                                                                                | 0/1274 [00:00<?, ?it/s]Traceback (most recent call last):
  File "/root/rag-ler-update/finetune_reranker.py", line 862, in <module>
    main()
  File "/root/rag-ler-update/finetune_reranker.py", line 750, in main
    with accelerator.accumulate(model):
  File "/root/miniconda3/envs/rag-ler/lib/python3.10/contextlib.py", line 135, in __enter__
    return next(self.gen)
  File "/root/miniconda3/envs/rag-ler/lib/python3.10/site-packages/accelerate/accelerator.py", line 1064, in accumulate
    cm_stack.enter_context(contextlib.nullcontext() if allow_gradient_sync else self.no_sync(m))
  File "/root/miniconda3/envs/rag-ler/lib/python3.10/contextlib.py", line 492, in enter_context
    result = _cm_type.__enter__(cm)
  File "/root/miniconda3/envs/rag-ler/lib/python3.10/contextlib.py", line 135, in __enter__
    return next(self.gen)
  File "/root/miniconda3/envs/rag-ler/lib/python3.10/site-packages/accelerate/accelerator.py", line 945, in no_sync
    with context():
  File "/root/miniconda3/envs/rag-ler/lib/python3.10/contextlib.py", line 135, in __enter__
    return next(self.gen)
  File "/root/miniconda3/envs/rag-ler/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1995, in no_sync
    assert not self.zero_optimization_partition_gradients(), \
AssertionError: no_sync context manager is incompatible with gradient partitioning logic of ZeRO stage 3
[rank0]: Traceback (most recent call last):
[rank0]:   File "/root/rag-ler-update/finetune_reranker.py", line 862, in <module>
[rank0]:     main()
[rank0]:   File "/root/rag-ler-update/finetune_reranker.py", line 750, in main
[rank0]:     with accelerator.accumulate(model):
[rank0]:   File "/root/miniconda3/envs/rag-ler/lib/python3.10/contextlib.py", line 135, in __enter__
[rank0]:     return next(self.gen)
[rank0]:   File "/root/miniconda3/envs/rag-ler/lib/python3.10/site-packages/accelerate/accelerator.py", line 1064, in accumulate
[rank0]:     cm_stack.enter_context(contextlib.nullcontext() if allow_gradient_sync else self.no_sync(m))
[rank0]:   File "/root/miniconda3/envs/rag-ler/lib/python3.10/contextlib.py", line 492, in enter_context
[rank0]:     result = _cm_type.__enter__(cm)
[rank0]:   File "/root/miniconda3/envs/rag-ler/lib/python3.10/contextlib.py", line 135, in __enter__
[rank0]:     return next(self.gen)
[rank0]:   File "/root/miniconda3/envs/rag-ler/lib/python3.10/site-packages/accelerate/accelerator.py", line 945, in no_sync
[rank0]:     with context():
[rank0]:   File "/root/miniconda3/envs/rag-ler/lib/python3.10/contextlib.py", line 135, in __enter__
[rank0]:     return next(self.gen)
[rank0]:   File "/root/miniconda3/envs/rag-ler/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1995, in no_sync
[rank0]:     assert not self.zero_optimization_partition_gradients(), \
[rank0]: AssertionError: no_sync context manager is incompatible with gradient partitioning logic of ZeRO stage 3

Hi thanks for raising the issue. I can confirm out model was trained with deepspeed 0.15.0. Though deepspeed 0.15.4 will prob work just as well.
If you want to replicate our exact setup, please follow the readme instructions.


Make the data csv (and adapt JabRef accordingly)

Can the data in https://github.com/JabRef/abbrv.jabref.org/blob/master/journals be stored as CSV?
Since CSV files are more structured and is a standard way of storing data. Unless jabref is more comfortable with data in its present format.

I would like to work on this!

@Siedlerchr Please not that there really is more information. See the README.md in the root of this repository (https://github.com/JabRef/abbrv.jabref.org#format-of-the-file). I highlighted the important parts:

I would really ❤ to see the information converted to CSV and JabRef adapted accordingly.

So if it is to be converted to csv jabref itself would need to be changed. Okay. The change has to be done there first then. Thanks for your replies.
Closing this issue.

The issue is very valid. I keep it open. Maybe during #hacktoberfest someone wants to dive into this.

It is not a definitive version, but all you can check the data files in CSV format and the JabRef adaptation.
Please give me your feedback! :smile:

Just create a PR and we can discuss the changes :)


Issues/321 support node

Fixes #321

Resolving issues in the @xchainjs/xchain-crypto package when running from a node environment

Hey @mikewyszinski - any thoughts on the approach here? Would love to get this in if we can!

@matt-scientist i merged these changes into PR #362 , so going to close this one


Add a progress bar

From Rebecca Lea,
To indicate how much effort is involved for the user, a bar at the top of the tool to show your progress through it may be helpful

I like this, it is relatively simple, so added to the pull request


Web - The user is able to send the message with more than 15,000 characters

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Insert a text exceeding 15,000 characters in the text box
Add an emojis
Hit backspace to remove the space

Expected Result:
Send button should remain disabled with a message indicating the number of inserted characters
Actual Result:
The user is able to send the message with more than 15,000 characters
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[x] MacOS / Chrome / Safari
[ ] MacOS / Desktop

Version Number: <IP_ADDRESS>
Reproducible in staging?: n/a
Reproducible in production?: n/a
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
limit-bug-n.webm
Expensify/Expensify Issue URL:
Issue reported by: @hichamcc
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1692880491617199
View all open jobs on GitHub

I guess in theory the problem is that we're not counting the actual character amount after the user deletes the backspace and preventing them from sending. But this is...really edge case. Closing it


Adding Manufacturer specific clusters

In order to add manufacturer specific clusters I have to recompile: https://github.com/google-home/sample-app-for-matter-android/tree/main/app/third_party/connectedhomeip/libs
Can you publish a repository showing exactly how these libs were built? When I build from CHIP source my libs don't match yours.

I have been talking with Apple people about the same issue. The Google team should look at how IOS solved this problem. They have come up with a solution which does not require recompiling the CHIP libraries.
Apple has made a parallel versions of the API where you can access the clusters by cluster number instead of name. That lets me easily access my manufacturer specific cluster by the id number. This whole CHIP lib rebuild process is done just to make named access work.

how these libs were built?

We simply build the examples for the various android targets,
./scripts/build/build_examples.py \
  --target android-arm-chip-tool \
  --target android-arm64-chip-tool \
  --target android-x86-chip-tool \
  --target android-x64-chip-tool \
  build

And then copy the libraries found in src/android/CHIPTool/app/libs
Because of https://github.com/google-home/sample-app-for-matter-android/issues/56, we're currently looking at making these libraries available via a maven repo.

The Google team should look at how IOS solved this problem.

If someone can provide us with complete details, will be happy to look into it.

Adding custom clusters into these libraries requires significant CHIP knowledge. You have to add the cluster into the XML files. Then zap regenerate everything. Then you have to patch up three other C files to add in the custom cluster. Then you have to run interactive zap over the controller definition to turn the cluster on. Then finally build all four Android libraries. Not a simple process.
The Apple solution:  they don't let customers recompile the CHIP libraries. In fact they say Google is not following CHIP rules by  making the customer recompile to add custom clusters (customer would have to certify the recompiled library with CSA).  Instead Apple has made two parallel APIs. One API is the one you are using which uses all of the cluster names, structures, etc.  They also made a second API which lets you access the clusters and fields by numericID.
Since the second API works using numbers not names, you can access custom clusters without changing the library. You just supply the custom cluster numericId and then use numericIds for the attributes, command, etc.  In the IOS support -- "You use the MTRDevice/MTRBaseDevice APIs."

You don't need a device with a custom cluster to work on this issue. If you can utilize a standard cluster by numericID instead of name that is enough of a demo. The same process will work for a custom cluster just with a different ID.

Apple is also bringing up the point that the CHIP libraries need to be certified by the CSA. How is Google going to achieve that?

This is Apple's solution, note how these APIs use clusterID: [NSNumber] and attributeID: [NSNumber] instead of names.
The Java API is missing this.
https://developer.apple.com/documentation/matter/mtrbasedevice
https://developer.apple.com/documentation/matter/mtrdevice

Things which would be helpful

Create the Maven repository now. That lets me get rid of LFS which is a pain.
Put controlled releases on Maven. How to deal with Apple saying you need to certify?
Add a Java version of Apple's MTRBaseDevice and MTRDevice.  That will let me access custom clusters without modifying and recompiling the chip source code.

This explains how to add add custom clusters to the CHIP source code.  It is a painful procedure that breaks every few weeks and it is currently broken on CHIP master (works on <IP_ADDRESS>).  After you copy the library in Java will have support for the new cluster. https://github.com/Lowpan-com/connectedhomeip/pull/3
This is NOT a good long term solution. The long term solution is to copy what Apple did.

@jonsmirl This looks like Apple is shipping the CHIP libraries themselves and wrap them into this simpler API for you for communication and commissioning, do I understand that correctly? Can you currently provide your own fabric certificates/credentials for device attestation this way?

You can provide your own fabric key.  I am not sure how the attestation step works, I think it involves network calls to verify the certificate chain up to the CSA.

Apple is also bringing up the point that the CHIP libraries need to be certified by the CSA. How is Google going to achieve that?

I would assume you (as a CSA member) will be responsible for certifying your CHIP libraries (as you are also responsible for certifying the stack on the devices themselves). This doesn't necessarily lay with Google if you build your own controller application, except for their own internal CHIP libraries used by their controllers.

Building a controller does not require rebuilding the CHIP libraries. If you can use an unmodified CHIP library which has been certified, that should be good enough.
This bug is addressing something different. CHIP supports vendors defining their own clusters to extend Matter allowing proprietary settings (maybe your auto-watering dog bowl has a value that needs a special API not covered by Matter).  That cluster get assigned a cluster number form the vendor cluster range.   Apple's CHIP library supports accessing clusters by cluster ID number, attribute ID number, command ID number, etc.
The Google CHIP library only supports accessing clusters by name which means it doesn't know about your special dog watering bowl. To work around this you can go into the CHIP source code and provide the definitions needed to generate names for your custom cluster, but then you've modified the CHIP library. What's I'd like to see from Google is support for numeric access like Apple has, then I won't need to modify the Android CHIP library any more.

In general looks to me as Google and Apple choose two fundamental different ways to approach integration of custom Matter controllers on their platforms.

Behind the scenes both approaches are almost identical. Apple is just hiding their version CHIP library in a pod, while Google exposes it.

BTW, the Google library has partial support for this. It has APIs to read attributes using numerical access. It is just missing the API to write them. And these is no API for numerical access to commands.


requirements.txt包版本

可不可以不要把requirements.txt里面的包的版本固定，在与其他包在一个环境里安装的时候经常产生冲突，请把依赖包的版本改成大于等于吧

most of the third-party library fiary-doc used have already specified with version.  could you provide the library that lead to conflict in you environment?


Show popup message if queue ticket state changes to 'unstaffed'

Description:
This PR is very similar to https://github.com/salemove/android-sdk-widgets/pull/395 but uses subscription to a specific QueueTicket state changes rather than a subscription to all Queue Tickets updates.
So the difference is in:

GliaQueueRepository.java
QueueTicketStateChangeToUnstaffedUseCase.java
GliaQueueRepositoryTest.java
GliaCore.java
GliaCoreImpl.java

⚠ Bitrise will fail the build because Core SDK changes are missing now
Jira issue:
https://glia.atlassian.net/browse/MOB-1592
Screen recording:
https://user-images.githubusercontent.com/57521863/202743755-9e33e708-a346-4a0c-a95a-bddf689d336a.mov

!merge


realsense2_camera: 2.2.17-1 in 'melodic/distribution.yaml' [bloom]

Increasing version of package(s) in repository realsense2_camera to 2.2.17-1:

upstream repository: https://github.com/IntelRealSense/realsense-ros.git
release repository: https://github.com/IntelRealSense/realsense-ros-release.git
distro file: melodic/distribution.yaml
bloom version: 0.9.7
previous version for package: 2.2.16-1

realsense2_camera
* Fix for ROS on Windows
* Contributors: Lou Amadio, doronhi

realsense2_description

No changes

We're holding melodic packages for the moment: https://discourse.ros.org/t/preparing-for-melodic-sync-2020-09-10/16350/2.


feat(network): tag consensus peer

What type of PR is this?
feat
What this PR does / why we need it:
Don't share consensus peer info with sync peers
BREAKING CHANGE:

Configuration

genesis.toml

add consensus public key

chain.toml

use peer id instead of hex encoded public key to do bootstrapping
change whitelist to allowlist
change whitelist_peer_only to allowlist_only

Internal api

change users_cast to multicast, use peer id bytes instead

Other:

tag consensus peer on every committed block
use validator's public key bytes instead of  chain address bytes

Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:

/test chaos

/test all

/test all

/hold

/test all

/test chaos

/test chaos

/test chaos

/test chaos

/retest

/retest

/test chaos

/test chaos

/test chaos

/test all

/lgtm

/hold cancel


[pt-br] Add docs/tasks/configure-pod-container/assign-cpu-resource.md

[pt-br] Add content/pt-br/docs/tasks/configure-pod-container/assign-cpu-resource.md

/retitle [pt-br] Add docs/tasks/configure-pod-container/assign-cpu-resource.md

Hello there, @DonatoHorn! 👋
This PR has a commit message issue that prevents us from accepting it. Would you feel comfortable fixing this so we can provide you with a new review and move your contribution forward? 😃

If you need any help fixing this commit message, please feel free to ask us on the #kubernetes-docs-pt channel in Kubernetes Slack.

/cc
/label tide/merge-method-squash

/cc @edsoncelio

/uncc

@DonatoHorn  Could you please squash your commits: https://kubernetes.io/docs/contribute/new-content/open-a-pr/#squashing-commits , as this PR is open from long ago . Try to address the https://github.com/kubernetes/website/pull/38492#issuecomment-1427083694

Hey @DonatoHorn!
Due to the lack of response, we will close this PR but feel free to reopen it If you want to make the requested changes.
/close


Set sensitive value at atttribute level to fix terraform destroy exposing sensitive values

Terraform Destroy currently reveals sensitive values as a result of the issue described with nested element in:
https://github.com/hashicorp/terraform-plugin-sdk/issues/736
Output:
❯ terraform destroy
sigsci_site.terraform_site: Refreshing state... [id=terraform_site]

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
  - destroy

Terraform will perform the following actions:

  # sigsci_site.terraform_site will be destroyed
  - resource "sigsci_site" "terraform_site" {
      - agent_level            = "block" -> null
      - block_duration_seconds = 86400 -> null
      - block_http_code        = 406 -> null
      - display_name           = "jeremys terraform site" -> null
      - id                     = "terraform_site" -> null
      - primary_agent_key      = {
          - "access_key" = "567707e6-477e-4303-87ae-a902348093"
          - "name"       = "terraform_site"
          - "secret_key" = "8mvsgjrL_-oaIKN3tgOP2abgM_XXXXX"
        } -> null
      - short_name             = "terraform_site" -> null
    }

A good explanation of the issue can be found at:
https://github.com/hashicorp/terraform-provider-helm/issues/793#issuecomment-1061004986

It seems that what happened here is that the provider or remote API internally copy values from the values argument into a provider-populated attribute metadata, which has its own attribute values. Although Terraform can see that values is sensitive, there's nothing here to tell Terraform that metadata.values is derived from values and therefore Terraform can't trace the sensitivity through the provider's "black box" and automatically understand that metadata.values ought to be sensitive too.

This PR performs changes from what I can see occurring as workarounds in the linked issues.
Resulting in the output
❯ terraform destroy
sigsci_site.terraform_site: Refreshing state... [id=terraform_sensitive]

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
  - destroy

Terraform will perform the following actions:

  # sigsci_site.terraform_site will be destroyed
  - resource "sigsci_site" "terraform_site" {
      - agent_level            = "block" -> null
      - block_duration_seconds = 86400 -> null
      - block_http_code        = 406 -> null
      - display_name           = "jeremys terraform meep" -> null
      - id                     = "terraform_sensitive" -> null
      - primary_agent_key      = (sensitive value)
      - short_name             = "terraform_sensitive" -> null
    }

Plan: 0 to add, 0 to change, 1 to destroy.

We do suffer visibility of the name element (which just reflects resource), so implications seem quite minimal around the actual issue.
Cheers!

@cdtzabra Your issues is related to the helm terraform provider. This PR referenced that issue as it quoted the terraform developers explanation of the problem and how one could possibly fix it inside their own provider. Our fix implements changes based on that explanation inside our own provider, which is unrelated to helm.


Updated with simple requirements from ISO/IEC 29147:2014

There must be a way to report vulnerabilities to the company, so they need a published email. Ideally this will have a gpg key for such activities or another method of receiving secure reports.

Waiting for the original contributor's feedback. @benrito @billfitzg @mrerecich @stephtngu-CR

No reply was received from the contributor. Close with comment.


gnome3.webkitgtk: 2.20.5 -> 2.22.0

Semi-automatic update generated by https://github.com/ryantm/nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/webkitgtk/versions.
meta.description for gnome3.webkitgtk is: '"Web content rendering engine, GTK+ port"'.

Checks done (click to expand)

built on NixOS
/nix/store/72v1y2yqprhhdgmmdfawcqqs70zfmjpg-webkitgtk-2.22.0/bin/WebKitWebDriver passed the binary check.
1 of 1 passed binary check by having a zero exit code.
0 of 1 passed binary check by having the new version present in output.
found 2.22.0 with grep in /nix/store/72v1y2yqprhhdgmmdfawcqqs70zfmjpg-webkitgtk-2.22.0
directory tree listing: https://gist.github.com/d24987f55d611435a300321559734ebf
du listing: https://gist.github.com/86f92d84870f87966e4c668d1f405894

Instructions to test this update (click to expand)

One-time optional setup to skip building using Cachix:

Install cachix from https://cachix.org/
Use r-ryantm's cache:cachix use r-ryantm

Test this update by entering a nix shell, seeing what is inside the
result, and if applicable, running some binaries:
nix-shell --pure -I nixpkgs=https://github.com/r-ryantm/nixpkgs/archive/993fd0f901b0742f2516977120b4b02a2a38f8a2.tar.gz -p gnome3.webkitgtk
ls -la /nix/store/72v1y2yqprhhdgmmdfawcqqs70zfmjpg-webkitgtk-2.22.0

This is part of https://github.com/NixOS/nixpkgs/pull/45950#issuecomment-422899247


i would like to upload my porfolio

i would like to upload my portfolio under hactoberfest2024

sure, create a pull request


Animation cilp changes after exporting

Hi, I am developing my gltf parser but I ran into some problems about animations.
My program can't play some gltfs animation correctly .
However, it plays correctly after I import the gltf and export back to gltf using blender.
After debugging a little, I found some frames' translations have changed after exporting.
For example in the attached file:low-poly_character.zip
The first three frame of a node named mixamorig:RightFoot_062's translation has change from
(1.0265402e-05, 3923.1528, -6.2052213e-06)
(1.0265402e-05, 3923.1528, -6.2052213e-06)
(1.0265403e-05, 3923.1528, -6.2052213e-06)

to
(0.19024743, 3923.1577, 0.06728477)
(0.19027266, 3923.1575, 0.067232735)
(0.19030312, 3923.1584, 0.067215264)

Heres' my questions:
Why does this gltf's animation changed after exporting from blender?
Why does the animation works correctly only after I exported it?
Did I not load the animation sampler correctly or is there something wrong with the original file that I need pay attention to?
Here's my code snippet for reading the translation data in case someone needed.
    template <typename T>
    T getBufferData(Index accessorIdx, size_t element = 0) const
    {
        const GLTF::Accessor &accessor = Accessors[accessorIdx];
        BD_ASSERT(element < accessor.Count);
        const GLTF::BufferView &bufferView = BufferViews[accessor.BufferView];
        const GLTF::Buffer &buffer = Buffers[bufferView.Buffer];
        size_t stride = math::max<size_t>(bufferView.Stride, sizeof(T));
        const char *ptr = buffer.Data.data() + bufferView.Offset + accessor.Offset;
        return *(T *)(ptr + element * stride);
    }

Here's a more complete debug info  of the node named mixamorig:RightFoot_062
original:
pos:(1.0265402e-05, 3923.1528, -6.2052213e-06)
pos:(1.0265402e-05, 3923.1528, -6.2052213e-06)
pos:(1.0265403e-05, 3923.1528, -6.2052213e-06)
rot:(0.852193, 0.5218879, 0.03671618, -0.007217273)
rot:(0.85310113, 0.5203972, 0.036796004, -0.0071592517)
rot:(0.8540047, 0.51891154, 0.036800355, -0.007246166)

exported:
pos:(0.19024743, 3923.1577, 0.06728477)
pos:(0.19027266, 3923.1575, 0.067232735)
pos:(0.19030312, 3923.1584, 0.067215264)
rot:(0.8520978, 0.52204347, 0.036704946, -0.007262041)
rot:(0.85323244, 0.5201817, 0.03678597, -0.0072257575)
rot:(0.85432506, 0.51838535, 0.036752265, -0.0074049723)
scale:(0.9999999, 0.9999998, 0.99999994)
scale:(0.9999999, 0.99999994, 0.99999994)
scale:(0.99999994, 0.99999994, 0.9999998)

Much appreciated for any helps!

Hello,
Some inputs to help you find your problem on your parser:

Seems the original glTF has some errors, regarding the glTF validator : https://github.khronos.org/glTF-Validator/

Why does this gltf's animation changed after exporting from blender?

glTF joint & Blender bones are not exactly the same way of working. Than means, depending on your case, you have an option at import named "Bone dir", hat can convert data for joints. Exporter then exports Blender data. This may lead to differences for rest post / animation. Blender is not a glTF editor : We try as much as possible to not convert / change data. But sometimes this is not possible / not simple.

Why does the animation works correctly only after I exported it?
Did I not load the animation sampler correctly or is there something wrong with the original file that I need pay attention to?

I don't know. Seems Blender and https://sandbox.babylonjs.com/ are able to read it.
Unfortunately, https://gltf-viewer.donmccurdy.com/ still have the issue about camera that prevent to see the animation correctly. But as far as we can see, the animation is imported

Thanks for you detailed explaination! I managed to solve it.
Turns out that my program has some bugs handling animated nodes that don't have all of the TRS channel.
And blender exported gltf fill the blank for me!


convert-dlrs-rules.apex fails when run with the namespaced version install

I installed the namespaced version of apex-rollup (04t6g000008So66AAC) and then tried to run the convert-dlrs-rules.apex script via anonymous apex and got an error:
Starting Execute Anonymous Apex

Error: Line: 4, Column: 14
Error: Invalid type: RollupControl__mdt

I assume that the script (and probably deactivate-converted-dlrs-rules.apex)  needs to be modified to call the namespaced references. It would be helpful if a namespaced version of the scripts be provided for users that are not familiar with how to do so.

@MarcDBehr that's a great call, I can add a namespace-compatible script in the next release

@MarcDBehr there's a link now to a working version of those files. Including that as a resource for you in the event that the next release is held up.


Spark random forest low AUC etc

Splitting https://github.com/szilard/benchm-ml/issues/5 in two: random forest here, logistic regression in different issue.
Summary: Random forest in Spark has low AUC (and is slower/larger memory footprint).
For  n = 100K Spark gets AUC = 0.65 vs e.g. 0.72/0.73 in H2O/xgboost.
Code here https://github.com/szilard/benchm-ml/blob/master/2-rf/5b-spark.txt
Train data here https://s3.amazonaws.com/benchm-ml--spark/spark-train-0.1m.csv test data here https://s3.amazonaws.com/benchm-ml--spark/spark-test-0.1m.csv
Originally ran on 1.3.0, but same in 1.4.0 (a bit faster, but same AUC).
Can you guys look at the code and optimize it/make it better, especially get better AUC?

Continued here https://github.com/szilard/benchm-ml/issues/19


MAVLink improvement

*Three message parsers: generic, mission and parameter
*Support handling different transactions at the same time
*Broadcast task for sending quad info message only
*Receiver task for ground station message/transaction/command handling
*New timeout mechanism
And more...
If the Pull Request is ready to merge, please notify me to disable the mavlink DEBUG print setting.

Maybe we can change communication.c to more general name?
e.g. mavlink_manager.c ?

How about "mavlink_task"?

It does not only contain task.

any proposal now?

Did you merge Ming's new commita?

Could you give me the link?

Could you change target branch to 'dev/mavlink'? I don't want to merge it too soon. And Please change 'communication.c'c to reasonable one.


[Nightmare|Bugfix] Init browser with about:blank so browser does not hang if scenario fails before I.amOnPage() is called

Highlights

Initialise Nightmare (in _startBrowser) on a blank page
Fixes following issues, #786 & #898

Root Cause
If a scenario fails before I.amOnPage is called, then the subsequent call to the _failed hook in the Nightmare helper, tries to take a screenshot of the browser. Before a screenshot is taken the height and width of the browser is retrieved using browser.evaulate, however if Nightmare has not had .goto called on it, then .evaulate will timeout.

Thanks!


Minimum/maximum rule doesn't work when number is zero

Plunker example:
http://plnkr.co/edit/NfhwLeXPzmo9SANJuOrQ?p=preview
Looking for a fix.
--
EDIT: possible workaround is using a function rule as below:
myField: {
  required: true,
  type: 'number',
  minimum: function () { return 0; }
}

Ok, got it, the problem is here:
https://github.com/bvaughn/angular-form-for/blob/master/source/services/model-validator.ts#L421
@bvaughn is there any reason to check if minimum is set/not-null/not-zero?
Could we simply check if it's a valid number !isNaN(validationRules.minimum) ?

Ah. The general problem is that we shouldn't show a min/max validation error if the user didn't supply a value. That's more in the realm of required validation. (A field may have min/max constraints while at the same time being optional.) The problem is that 0 is a falsy value in JavaScript so we need to be careful about deciding when the user has supplied a value. That's why I'm checking to make sure there's a non-empty string (eg. '123') and that it's a legit number (eg '123' vs 'abc') and only then validating.

Yes, sure, I know a field could be optional and, at the same time, have a minimum constraint.
Isn't it enough to check if validationRules.minimum || validationRules.minimum === 0?

Oh! Haha! I was completely misunderstanding your question. I thought you were saying that it didn't work when the user supplied value was 0. You're saying it doesn't work when the minimum value is 0!
Looks like we maybe need to do a similar, more robust form of checking for the min/max validation rules as we're doing for their values. (Not just rely on falsy checks, but more strictly check for undefined, null, or ''.)

Aha, don't worry. Well, we must remember that minimum rule could be a number, an object or a function.
So, don't re-invent the wheel, let's use angular utilities:
function checkValue(value) {
   if (angular.isObject(value) || angular.isFunction(value) || angular.isNumber(value))
      console.log('valid');
   else
      console.log('invalid');
}

I made some tests with this fn, and these are the results:

Input
Output

0
"valid"

1
"valid"

function () { }
"valid"

{ rule: 0 }
"valid"

null
"invalid"

undefined
"invalid"

true
"invalid"

false
"invalid"

" "
"invalid"

What are your thought?

Just checking if it's not falsy or 0 (a number) would be sufficient though
because functions and objects are both truthy things in JavaScript :)
On Saturday, December 12, 2015, indrimuska<EMAIL_ADDRESS>wrote:

Aha, don't worry. Well, we must remember that minimum rule could be a
number, an object or a function.
So, don't re-invent the wheel, let's use angular utilities:
function checkValue(value) {
if (angular.isObject(value) || angular.isFunction(value) || angular.isNumber(value))
console.log('valid');
else
console.log('invalid');
}
I made some tests with this fn, and these are the results:
Input Output 0 "valid" 1 "valid" function () { } "valid" { rule: 0 }
"valid" null "invalid" undefined "invalid" true "invalid" false "invalid" "
" "invalid"
What are your thought?
—
Reply to this email directly or view it on GitHub
https://github.com/bvaughn/angular-form-for/issues/179#issuecomment-164138324
.

Ok, but, as you said, this will accept inputs like " " or true and convert them to integer 1. This means that if you set minimum validation to true and your field is equal to 0 it will cause a validation error.
Anyway, I know that setting minimum rule to true is not a correct behavior, so if you like we can just use the same simplest rule I already described before.

Hmm. I'm all for robust checking of user input but it seems unlikely to
me that someone would configure their validation rules that way. I don't
feel strongly about this though- either approach would be fine,
On Saturday, December 12, 2015, indrimuska<EMAIL_ADDRESS>wrote:

Ok, but, as you said, this will accept inputs like " " or true and
convert them to integer 1. This means that if you set minimum validation
to true and your field is equal to 0 it will cause a validation error.
Anyway, I know that setting minimum rule to true is not a correct
behavior, so if you like we can just use the same simplest rule I already
described before
https://github.com/bvaughn/angular-form-for/issues/179#issuecomment-163994561
.
—
Reply to this email directly or view it on GitHub
https://github.com/bvaughn/angular-form-for/issues/179#issuecomment-164168340
.

Ok, I will create a PR with the simplest one. :)


Multiple megamenus

Hi,
When using Orange Megamenu with multiple instances, opening a second megamenu does not hide the first opened megamenu. Quite annoying.
Could you please help with this, at least providing a simple way to close a megamenu?
Using this I do know if there's already an opened megamenu:
jQuery(document).ready(function ($) {
    $('.nav-link[data-toggle="collapse"]').on('click', function(e) {
        $open = $('.mega-menu > [aria-expanded="true"]');
    });
});

But that may not be the better approach. Thanks :)

Hi,
Fixed in commit 8760940e265b113ce63e4b0b7debb1a49c74a9bb

Hi,
for now as I'm sticking to alpha 5 on the project I'm working on, I didn't try to incorporate your fix in Boosted sources. I preferred a much more simple way:
jQuery(document).ready(function ($) {
    $('.nav-link[data-toggle="collapse"]').on('click', function(e) {
        $open = $('.mega-menu > [aria-expanded="true"]');

        if($open.length) {
            $open.collapse('hide');
        }
    });
});

This may be useful for other projects sticking to alpha 5. But your fix did the trick so I'm closing the issue, thanks :)


no mention of --local option in KV commands

Existing documentation URL(s)
https://developers.cloudflare.com/kv/reference/kv-commands/
What changes are you suggesting?
Some KV commands have a --local option which is not docummented in the HTML docs.
The option works when doing eg:

wrangler kv:key put some_key --path=file.json --binding=NAMESPACE --local

And it also appears in the documentation of the CLI:

Additional information
No response

This has since been fixed, btw.
(apologies for the radio silence in the meantime)
https://developers.cloudflare.com/kv/reference/kv-commands/


Allow additional customization options for fields

Hi! 👋
Firstly, thanks for your work on this project! 🙂
While using this alertbox (which works very nicely!), I wanted to make it so that one of the fields did not autocapitalize the first letter and also hid the text. However, I was not able to perform this level of customization with the way the code is currently written.  I was able to make a small change to the package that allowed me to make the changes I needed, and I think it would be neat if these and other customization options were included in the package.
Here are the changes that solved my problem:
diff --git a/node_modules/react-native-alertbox/src/alertbox.js b/node_modules/react-native-alertbox/src/alertbox.js
index 6910047..e142136 100644
--- a/node_modules/react-native-alertbox/src/alertbox.js
+++ b/node_modules/react-native-alertbox/src/alertbox.js
@@ -75,6 +75,8 @@ export default function Alertbox({
                     <TextInput
                       name={field.name}
                       placeholder={field.placeholder}
+                      autoCapitalize={field.autoCapitalize}
+                      secureTextEntry={field.secureTextEntry}
                       onChangeText={(text) =>
                         setFieldState((prevState) => ({
                           ...prevState,

This issue body was partially generated by patch-package.

@TEvans00 Thank you for feedback. It's great to get feedback like that. I haven't updated this for a long time. It's great chance to update it. I will try to make TextInput more functional this weekend.

I have published new version. You can pass all input props to fields now. I have also added dark mode support.
If you see any improvements you can share with me any time.

Thank you for working on this! I just upgraded to the new version this morning to test it out and it works great!


Alloy smelter duplication bug

Issue Description:
Alloy smelter duplication bug
What happens:
the bug is produced by using the shortcuts from the ''simple inventory sorting'' mod by cpw. By inserting items in the top slot of the alloy smelter and then middle clicking on one of the items, the total number of items in the tops slots will go up by 1 or more, depending on how many items are already inserted. The more items are inserted, the more items appear.
Steps to reproduce:

put down an alloy smelter and put at least 4 items in the top slots. it has to be at least 4, as the smelter will immediatly smelt 3 of the inserted items. ( I don't know if the smelter has to be powered, but i didn't have enough time to thoroughly test it.)
click with the scroll wheel on one of the top 3 slots.
the total number in the top slots should increase by 1 or more, depending on the amount of items already present in the top slots.
...

Affected Versions (Do not use "latest"):

EnderIO: 1.8.9-<IP_ADDRESS>_alpha
EnderCore: 1.8.9-<IP_ADDRESS>_alpha
Simple Inventory Sorting: 0.7.7+27
Minecraft: 1.7.10
Forge Mod Loader: <IP_ADDRESS>
Minecraft Forge: <IP_ADDRESS>2

Are You sure you didn't messed the version info?

This sounds like one of many bugs in inventory sorter that have been fixed in the meantime. : https://github.com/cpw/inventorysorter/issues?q=is%3Aissue+is%3Aclosed


notifyDataSetChange doesn't refresh UI

notifyDataSetChange doesn't refresh UI

Have you looked into the sample application? E.g. notifyDataSetChanged() is used when an object is added to the stack by pressing the FAB. It should work as expected.

If the data is not drawn, notify is effective, but if have onLayout, update the top view data, is invalid

my English is not good, reply late,i'm sorry

try this method
mSwipeStack.resetStack()


Int and Date datatypes is not accessible from tableau

First of all thank you for your product. But I'm faced with issue in using it from Tableau.
Error appears in Tableau while trying to use columns with (Int8,Int16,Int32,Int64,Date,DateTime) datatype in ClickHouse.
ODBC driver tries to send to CH query:

SELECT SUM({fn CONVERT(test_tableau.i, SQL_BIGINT)}) AS sum_i_ok FROM test_tableau HAVING (COUNT(1) > 0)

Obviously as a result it returns:

syntax error

I'm using the last realese of driver (2017-11-07) and ClickHouse v.1.1.54310

Released - https://github.com/yandex/clickhouse-odbc/releases/tag/2018-02-01


CI Build failing: Investigate order of fields in JSON

The automated CI failed upon submission for Kindly
Look into the positions of the JSON keys
"implementBestPractices": "Yes",
"griefAbuseHarassmentProtection": "Yes",
https://github.com/unicef/publicgoods-candidates/runs/4385086080?check_suite_focus=true

FYI, from what I can see this would be an issue of the schema of the submission form, so I recommend to start there, and possibly open an issue in that repo instead of this one, but your investigations will confirm this hypothesis ;)

@lacabra after investigating again, I believe this is coming from screening-schema.json in this repo.
So I'm currently comparing it to the submissions repo schema.js
I believe they should be the same. Am I correct?

@nathanfletcher Yes, they should match (they aren't exactly the same because the data structure is different). And if you have to make changes in one of the two, make them in the submission form one


custom Html output

Are you requesting a feature, reporting a bug or ask a question?
Question
What is the current behavior?
We had Html control and i am putting input tag as checkedbox. i need to find value of checked in html.
What is the expected behavior?
how to fetch value in html control.
How would you reproduce the current behavior (if this is a bug)?
Provide the test code and the tested page URL (if applicable)
Tested page URL:https://surveyjs.io/Editor/Editor/#1a13c97f-26cd-41ac-ba69-7af60ddd9251
Test code
your_code_here

Specify your

browser:chrome
browser version: Version 60.0.3112.113
surveyjs platform : jquery
surveyjs version:

@AvinashVarmaSagi Somebody from your team has already asked this question.  Use survey.setValue and survey.getValue functions, here is the demo.
You may wait until we implement QuestionBoolean. We are working on it.
Thank you,
Andrew


Created Fibonacci_Triangle.c

Dhanyawad Dada amhala contribute karu dilya badal

Please Talk in English

Please Talk in English

you do it man


Pipeline skips first day

Dear Zipline Maintainers,
By running a very basic pipeline I have noticed that on SimplePipelineEngine.run_pipeline call the first day of the data in my csv bundle gets excluded from the pipeline. I don't get the rationale of this. I would expect all days to be included.
bundle_data = load('my_bundle')

my_pipeline = Pipeline(domain=US_EQUITIES)

pipeline_loader = USEquityPricingLoader.without_fx(bundle_data.equity_daily_bar_reader, bundle_data.adjustment_reader)

def choose_loader(column):
    return pipeline_loader

spe = SimplePipelineEngine(get_loader=choose_loader, asset_finder=bundle_data.asset_finder)

results = spe.run_pipeline(my_pipeline,
                           start_naive,
                           end_naive)
print("RESULTS")
display(results)

supposing that I have data in my CSV(actually minute data but I don't know this makes a difference) from 2021-08-02  to 2021-08-12, the results to the pipeline call will be:
2021-08-03 00:00:00+00:00   Equity(1 [GOOGL])
2021-08-04 00:00:00+00:00   Equity(1 [GOOGL])
2021-08-05 00:00:00+00:00   Equity(1 [GOOGL])
2021-08-06 00:00:00+00:00   Equity(1 [GOOGL])
2021-08-07 00:00:00+00:00   Equity(1 [GOOGL])
2021-08-08 00:00:00+00:00   Equity(1 [GOOGL])
2021-08-09 00:00:00+00:00   Equity(1 [GOOGL])
2021-08-10 00:00:00+00:00   Equity(1 [GOOGL])
2021-08-11 00:00:00+00:00   Equity(1 [GOOGL])
2021-08-12 00:00:00+00:00   Equity(1 [GOOGL])
This becomes a problem when I attach the pipeline as I don't have access to the 2021-08-02 data through the handle_data(). I only have access to the last record of that day. Any way I can get access to the first day's minute data through the pipeline?
Thank you
Sincerely,
Ricc

So I still haven't resolved the issue on the pipeline side. However there was the same problem in other two situations in the zipline code. I don't understand if is a coding error or if it's  voluntary to prohibit trades in the first day. Anyhow, to avoid can_trade() to return a False, I have changed the following code:
return ref_start <= session_label.value <= ref_end
to this:
```
return (ref_start_dt.date() == session_label_dt.date() or
ref_start <= session_label.value <= ref_end)
in _protocol.pyx . For the less experts(like I am), this codes need to be compiled with cython by using a setup.py file I can provide if needed.
Also I have changed
`if normalized_date < asset.start_date:`
into
`if normalized_date.date() < asset.start_date.date():`
in algorithm.py to correct order placing blockage.
I will update as I resolve the pipeline issue.

So I got the pipeline issue resolved too. I have substituted this
mask = lifetimes.start <= raw_dates
with
            def todate(tstamp):
                return np.array([datetime.utcfromtimestamp(tstamp[0] // 10**9).date()])

            mapped = np.array(list(map(todate,raw_dates)))
            converted = np.array([datetime.utcfromtimestamp(lifetimes.start[0] // 10**9).date()])

            mask = converted <= mapped

in assets/assets.py.
And I changed include_start_date to True in pipeline/engine.py.

@RiccaDS Hi. I found a similar issue. In trading live mode (launched on the current date, for example), pipeline requests data from the previous day. But the data is returned as of 2 days ago. That is, the data is shifted back one day.
I couldn't fix it.

Hi, could you provide a reproducible example?

Example with sharadar zipline bundle. He uses original pipeline from zipline package.
from exchange_calendars import get_calendar
import os
import datetime
import time
import numpy as np
import pandas as pd
import zipline.api as algo
from sharadar.pipeline.engine import symbols, symbol
from sharadar.util.run_algo import run_algorithm
from zipline.pipeline import Pipeline
from zipline.pipeline.data import USEquityPricing
from sharadar.util.logger import StrategyLogger
from zipline.pipeline.factors import SimpleMovingAverage, ExponentialWeightedMovingStdDev
from sharadar.pipeline.factors import Exchange, AverageDollarVolume, CustomFactor, IsDomesticCommonStock
from zipline.pipeline.filters import AllPresent, All, StaticAssets, StaticSids
from zipline.finance.execution import MarketOrder, LimitOrder
from zipline.finance.commission import PerShare
from zipline.finance import slippage, commission

from sharadar.live.brokers.ib_broker import IBBroker

from ib_insync import IB, Stock, util as ib_insync_util
import nest_asyncio
log = BacktestLogger(__file__)

def make_pipeline():
    pipeline = Pipeline(
        columns = {
            'close': USEquityPricing.close.latest,
        },
        screen=( StaticAssets([symbol('BRBR')]) )
    )

    return pipeline

def initialize(context):
    algo.attach_pipeline(make_pipeline(), 'pipeline')

def handle_data(context, data):
    pass

def before_trading_start(context, data):
    context.candidates = algo.pipeline_output('pipeline')
    log.info('context.candidates: {}'.format(context.candidates))

if __name__ == "__main__":

    xnys = get_calendar("XNYS")

    run_algorithm(
        handle_data=handle_data,
        initialize=initialize,
        before_trading_start=before_trading_start,
        data_frequency = 'minute',
        broker=IBBroker(tws_uri='localhost:7496:1239'),
        state_filename='./statefile',
        trading_calendar = xnys
        # bundle=bundle_name,
    )

Result:
[2022-05-18 14:04:01] INFO: Connecting: localhost:7496:1239
[2022-05-18 14:04:01] INFO: [2104] Market data farm connection is OK:usfarm.nj (-1)
[2022-05-18 14:04:01] INFO: [2104] Market data farm connection is OK:usfarm (-1)
[2022-05-18 14:04:01] INFO: [2106] HMDS data farm connection is OK:ushmds (-1)
[2022-05-18 14:04:01] INFO: [2158] Sec-def data farm connection is OK:secdefnj (-1)
[2022-05-18 14:04:01] INFO: Managed accounts: ['DU12345']
[2022-05-18 14:04:01] INFO: Local-Broker Time Skew: 0 days 00:00:00.598403
[2022-05-18 14:04:01] INFO: Using bundle 'sharadar'.
[2022-05-18 14:04:01] INFO: Live Trading on 2022-05-18.
[2022-05-18 14:04:01] INFO: Initialized blotter_live
[2022-05-18 14:04:01] INFO: Loading state from ./statefile
[2022-05-18 14:04:01] INFO: initialization done
[2022-05-18 14:04:01] INFO: (self.get_datetime() : 2022-05-18 00:00:00+00:00
[2022-05-18 14:04:01] INFO: today in _pipeline_output : 2022-05-17 00:00:00+00:00
[2022-05-18 14:04:01] INFO: KeyError self.run_pipeline
Pipeline from 2022-05-17 to 2022-05-17  [####################################]  100%[2022-05-18 14:04:02] INFO: Pipeline from 2022-05-17 to 2022-05-17 completed in 0:00:00.
[2022-05-18 14:04:02] INFO: (self.get_datetime() : 2022-05-18 00:00:00+00:00
[2022-05-18 14:04:02] INFO: today in _pipeline_output : 2022-05-17 00:00:00+00:00
[2022-05-18 14:04:02] INFO: self._pipeline_cache.get
[2022-05-18 14:04:02] INFO: context.candidates:                        close
Equity(110458 [BRBR])  24.39

If we look at the data on the history:
from sharadar.pipeline.engine import prices as get_pricing, symbols
get_pricing(symbols(['BRBR']), '2022-05-17', '2022-05-17', 'close', 2)

2022-05-13 00:00:00+00:00    24.72
2022-05-16 00:00:00+00:00    24.39
2022-05-17 00:00:00+00:00    25.82
Freq: C, Name: Equity(110458 [BRBR]), dtype: float64

Close on 2022-05-17 it should be 25.82, but pipeline gives the close price on 2022-05-16.
In my opinion, this is a error and should not be.

Without having actually tried your script, I noticed  the direct import and use of exchange-calendars.
Please, don't import and use exchange_calendars directly, the package is NOT compatible with zipline-reloaded because it uses a different start date.
I am actually surprised that the code is actually running.
You have to instead import all the calendar functionalities like  'get_calendar'  from zipline.utils.calendar_utils

Here is a reproducible example zipline-reloaded install to clean conda env with AAL symbol:
from zipline.data.bundles import load
from zipline.pipeline import Pipeline
from zipline.pipeline.domain import US_EQUITIES
from zipline.pipeline.loaders import USEquityPricingLoader
from zipline.pipeline import SimplePipelineEngine
from zipline.api import order_target, record, symbol
from zipline.pipeline.data import USEquityPricing
from zipline.pipeline.filters import AllPresent, All, StaticAssets, StaticSids
import pandas as pd
from zipline.data.bundles import register, csvdir

bundle_data = load('quandl')

my_pipeline = Pipeline(
        columns = {
            'close': USEquityPricing.close.latest,
        },
        screen=( StaticSids([2]) ),
        # domain=US_EQUITIES
    )

pipeline_loader = USEquityPricingLoader.without_fx(bundle_data.equity_daily_bar_reader, bundle_data.adjustment_reader)

def choose_loader(column):
    return pipeline_loader

spe = SimplePipelineEngine(get_loader=choose_loader, asset_finder=bundle_data.asset_finder)

results = spe.run_pipeline(my_pipeline,
                           pd.Timestamp('2015-05-13', tz = 'utc'),
                           pd.Timestamp('2015-05-13', tz = 'utc'))

Result:
2015-05-13 00:00:00+00:00 | Equity(2 [AAL]) | 48.85
If we get data from this bundle on this date:
from zipline.data.data_portal import DataPortal
from zipline.data import bundles
from zipline.data.bundles import load, register
from zipline.utils.calendar_utils import get_calendar
import pandas as pd
from zipline.data import bundles

bundle_name = 'quandl'
ticker_name = "AAL"
end_date = pd.Timestamp('2015-05-13', tz='utc')
window=3
bundle_data = bundles.load(bundle_name)

data_por = DataPortal(bundle_data.asset_finder,
                      get_calendar('XNYS'),
                      bundle_data.equity_daily_bar_reader.first_trading_day,
                      equity_minute_reader=bundle_data.equity_minute_bar_reader,
                      equity_daily_reader=bundle_data.equity_daily_bar_reader,
                      adjustment_reader=bundle_data.adjustment_reader)

sym = data_por.asset_finder.lookup_symbol(ticker_name, end_date)
data = data_por.get_history_window(assets=[sym],
                                   end_dt=end_date,
                                   bar_count=window,
                                   frequency='1d',
                                   data_frequency='daily',
                                   field='close')

Result:
2015-05-11 00:00:00+00:00	49.645
2015-05-12 00:00:00+00:00	48.850
2015-05-13 00:00:00+00:00	48.490

48.85 is price on 2015-05-12, but we request data in pipeline on 2015-05-13.
I used according to your advice get_calendar from zipline.utils.calendar_utils module.

https://github.com/stefan-jansen/zipline-reloaded/blob/b066f1cc7e463c64634911094e6215d0889477c9/src/zipline/pipeline/loaders/equity_pricing_loader.py#L74
This is actually an intended behavior, to avoid looking ahead your are only presented data from the previous session.
" load_adjusted_array is called with dates on which the user's algo
will be shown data, which means we need to return the data that would
be known at the start of each date. We assume that the latest
data known on day N is the data from day (N - 1), so we shift all
query dates back by a trading session."

I got it, thanks for direction. I'll try to experiment with load_adjusted_array.
In my opinion, in real live trading mode, the behavior of pipeline should be different from the backtest.
For example, we run the algorithm today, May 20th. The pipeline will be executed on the date of the last trading session, May 19th. And the data according to this logic will be loaded on May 18. That is, we will operate with data with a delay of 1 day. Perhaps for some strategies this is not so critical, but, for example, for intraday strategies it is very critical. They won't work correctly.
Please correct me if I'm wrong.

This can become very confusing especially when using daily data.
The way I understand it, is that you cannot act on data that you haven't received yet, therefore the lag.
Supposing you want to trade at time T the only data that you have is coming from T-1 that's the reasoning behind this shift.

I can't help on this issue because I am working on backtests and don't know the live mode code. Backtests do have a shift  issue and in the end I think it is a little bug that will bother only some people with the result of not being able to use the first day of intraday data. It almost surely derives from the fact that with daily data(only 24h close/open prices) you cannot run a trading code without having at least the last closing price. So zipline was conceived to run tradings only when you provide a last closing price for the day before. However it seems that part of the code wasn't updated for intraday trading, for which the correct behavior is to run tradings when you have at least one minute closing price at the market opening.
The last code I provided, which is a correction I made for this issue in backtests environment, needed some more work. Here is the updated code if needed(don't judge too bad, not a professional programmer here). Use this as lifetimes() function in assets.py.

        if isinstance(country_codes, str):
            raise TypeError(
                "Got string {!r} instead of an iterable of strings in "
                "AssetFinder.lifetimes.".format(country_codes),
            )

        # normalize to a cache-key so that we can memoize results.
        country_codes = frozenset(country_codes)

        lifetimes = self._asset_lifetimes.get(country_codes)
        if lifetimes is None:
            self._asset_lifetimes[
                country_codes
            ] = lifetimes = self._compute_asset_lifetimes(country_codes)

        raw_dates = as_column(dates.asi8)

        def todate1(tstamp):
             return np.array([datetime.utcfromtimestamp(tstamp[0] // 10**9).date()])
        def todate2(tstamp):
             return datetime.utcfromtimestamp(tstamp // 10**9).date()

        raw_dates_map = np.array(list(map(todate1,raw_dates)))
        start_map          = np.array(list(map(todate2,lifetimes.start)))
        end_map           = np.array(list(map(todate2,lifetimes.end)))

        if include_start_date:
            mask = start_map <= raw_dates_map
        else:
            mask = start_map < raw_dates_map

        mask &= raw_dates_map <= end_map

        return pd.DataFrame(mask, index=dates, columns=lifetimes.sid)

Thank you, please feel free to open a PR if you still feel this should be included so we can test the implications.


Generate valid InstanceId

! @charleso
Can get upgraded at some point to 16

Seems legit 👍  Any reason for not adding a 16 character version now as well?


[ERROR PDN-0179] Unable to repair all channels.

Description
PDN phase generates the following error:
[ERROR PDN-0179] Unable to repair all channels.

after generating a bunch of warnings:
[WARNING PDN-0178] Remaining channel (635.2600, 146.6400) - (639.8600, 158.0000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 282.6400) - (639.8600, 294.0000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 445.8400) - (639.8600, 457.2000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 581.8400) - (639.8600, 593.2000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 978.9600) - (639.8600, 990.3200) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 1114.9600) - (639.8600, 1126.3200) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (935.1800, 1150.3200) - (939.7800, 1161.6800) on met1 for nets: vccd1

The manual macro placement seems ok, since there's no overlapping. The flow (up to the PDN phase) works if I leave the macro placement automatic (with the addition of PL_BASIC_PLACEMENT).
Expected Behavior
.
Environment report
open_pdks cd1748bb197f9b7af62a54507de6624e30363943
WARNING: issue-survey appears to be running inside the OpenLane
container.

This makes it difficult to rule out issues with your
environment.

Unless instructed specifically to do so, please run this command
outside the OpenLane container.
---

Kernel: Linux v6.5.0-18-generic
Distribution: centos 7
Python: v3.6.8 (OK)
OpenLane Git Version: 9dbd8b5ea2bd891bed4dcc97df5c7439083f0368
python-venv: INSTALLED
---
PDK Version Verification Status: OK
---
Git Log (Last 3 Commits)

9dbd8b5e 2024-01-11T15:26:56+02:00 Fix `-synth_explore` crash (#2085) - Kareem Farid -  (HEAD, tag: 2024.01.12, origin/master, origin/HEAD, master)
a005df1f 2024-01-08T10:51:06+02:00 Updated link to newer version of spanish docs (#2082) - Laboratorio de Investigación en Microelectrónica y Arquitectura de Computadoras, EIE -- UCR -  (tag: 2024.01.09)
8bea8c51 2023-12-26T13:17:21+02:00 Update `OpenROAD` (#2062) - Kareem Farid -  (tag: 2023.12.27)
---
Git Remotes

origin	git@github.com:The-OpenROAD-Project/OpenLane.git (fetch)
origin	git@github.com:The-OpenROAD-Project/OpenLane.git (push)

Reproduction material
issue_reproducible.tar.gz
Relevant log output
Contents of `runs/run1/logs/floorplan/7-pdn.log`

OpenROAD 75f2f325b7a42e56a92404f33af8e96530d9b202
This program is licensed under the BSD-3 license. See the LICENSE file for details.
Components of this program may be licensed under more restrictive licenses which must be honored.
[INFO]: Reading ODB at '/openlane/designs/HIDDEN_LAYER/runs/run1/tmp/floorplan/6-tapcell.odb'…
define_corners Typical
read_liberty -corner Typical /home/scorbetta/work/tools/pdk/sky130A/libs.ref/sky130_fd_sc_hd/lib/sky130_fd_sc_hd__tt_025C_1v80.lib
read_liberty -corner Typical /openlane/designs/HIDDEN_LAYER/../HL_NEURON/runs/run1//results/final/lib/HL_NEURON.lib
Using 1e-12 for capacitance...
Using 1e+03 for resistance...
Using 1e-09 for time...
Using 1e+00 for voltage...
Using 1e-03 for current...
Using 1e-09 for power...
Using 1e-06 for distance...
Reading design constraints file at '/openlane/scripts/base.sdc'…
[INFO]: Setting output delay to: 4.0
[INFO]: Setting input delay to: 4.0
[INFO]: Setting load to: 0.033442
[INFO]: Setting clock uncertainty to: 0.25
[INFO]: Setting clock transition to: 0.15
[INFO]: Setting timing derate to: 5.0 %
[INFO PDN-0001] Inserting grid: stdcell_grid
[WARNING PDN-0178] Remaining channel (335.3400, 146.6400) - (339.9400, 158.0000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (335.3400, 282.6400) - (339.9400, 294.0000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (335.3400, 445.8400) - (339.9400, 457.2000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (335.3400, 581.8400) - (339.9400, 593.2000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (335.3400, 978.9600) - (339.9400, 990.3200) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (335.3400, 1114.9600) - (339.9400, 1126.3200) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 146.6400) - (639.8600, 158.0000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 282.6400) - (639.8600, 294.0000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 445.8400) - (639.8600, 457.2000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 581.8400) - (639.8600, 593.2000) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 978.9600) - (639.8600, 990.3200) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (635.2600, 1114.9600) - (639.8600, 1126.3200) on met1 for nets: vssd1
[WARNING PDN-0178] Remaining channel (935.1800, 1150.3200) - (939.7800, 1161.6800) on met1 for nets: vccd1
[ERROR PDN-0179] Unable to repair all channels.
PDN-0179

@scorbetta looks like you're trying to place hard macros. Does your config file have EXTRA_GDS_FILES and EXTRA_LEFs defined for the HL_NEURON macro?

@d-m-bailey Yes. As I said, the flow works without the manual macro placement. And yet manual macro placement seems correct since there is no overlapping.

@scorbetta This is one of the reported locations by OpenROAD.
In the decap cells between the macros, if there isn't a vertical stripe passing through they wouldn't be powered and cause such an error. You may want to increase FP_TAP_HORIZONTAL_HALO such that these cells wouldn't exist in these  location.

@kareefardi Perfect! Many thanks for your help. It indeed is consistent with the way the tool places the macros automatically, so close each other that there is no space to be filled with decaps.


Fixes redirect behavior to correctly set host/port

We currently supply options to follow-redirects in the format { host, port }, but the port is incorrectly dropped during redirect due to the way that url.format handles host vs hostname. For the purposes of http, host and hostname are aliases, but when building the redirect URL, host is assumed to be the full origin. We should supply hostname instead.
I have added a test for this case. I you change the options to use host instead of hostname, the tests will hang as the request is being incorrectly redirected to "http://localhost/two" instead of "http://localhost:4444/two".

This fix is available in 0.9.1

Great, thanks :+1:


NEW - Adds careers landing page

Adds careers landing page.
Additions

Adds /careers/ landing page.

Removals

content-l_col__before-inset-divider cf-enhancement.

Changes

Adds fix for Youtube macro on /application-process/index.html
Fixes coding style spacing issues in cf-enhancements.less.

Testing

Visit /careers/

Review

@sebworks
@KimberlyMunoz
@jimmynotjim

Preview
Desktop:

Mobile:

Notes

Added adjustments for passing in a column value to the latest activities sidebar. @sebworks will be opening a PR for just this change, which will likely be merged before this and I'll rebase into here... so changelog update will happen there.

Merged based on :+1: in cloned branch.


added strong-log-transformer to logging section

Link to package - https://github.com/strongloop/strong-log-transformer
I think this should be added to the awesome list because it's a lightweight to perform the operations for the most common log format and mask operations.

Thanks for the suggestion, but I'm going to pass on this.


Got a cpacr crash

Hello,
i tried this on my 5s (GSM) on ios 10.2 with both, the old and the new offsets after the last commit.
But everytime it crashes at
got a cpacr

The full log is:
sysname: Darwin
nodename: Jailed
release: 16.3.0
version: Darwin Kernel Version 16.3.0: Tue Nov 29 21:40:09 PST 2016; root:xnu-3789.32.1~4/RELEASE_ARM64_S5L8960X
machine: iPhone6,2
2017-01-26 10:00:48.799088 yalu102[232:5204] found corruption 1407
2017-01-26 10:00:51.983734 yalu102[232:5204] found kernel text at fffffff012004000
2017-01-26 10:00:51.985978 yalu102[232:5204] got tfp0 -> f07
2017-01-26 10:00:51.995221 yalu102[232:5204] found procs at fffffff0125af1b0
2017-01-26 10:00:51.997046 yalu102[232:5204] seg: __TEXT
2017-01-26 10:00:51.997130 yalu102[232:5204] seg: __DATA_CONST
2017-01-26 10:00:51.997176 yalu102[232:5204] seg: __TEXT_EXEC
2017-01-26 10:00:51.997219 yalu102[232:5204] seg: __KLD
2017-01-26 10:00:51.997314 yalu102[232:5204] seg: __LAST
2017-01-26 10:00:51.997379 yalu102[232:5204] seg: __DATA
2017-01-26 10:00:51.997421 yalu102[232:5204] seg: __PRELINK_TEXT
2017-01-26 10:00:51.997461 yalu102[232:5204] seg: __PLK_TEXT_EXEC
2017-01-26 10:00:51.997502 yalu102[232:5204] seg: __PRELINK_DATA
2017-01-26 10:00:51.997588 yalu102[232:5204] seg: __PLK_DATA_CONST
2017-01-26 10:00:51.997649 yalu102[232:5204] seg: __PLK_LINKEDIT
2017-01-26 10:00:51.997691 yalu102[232:5204] seg: __PRELINK_INFO
2017-01-26 10:00:51.997731 yalu102[232:5204] seg: __LINKEDIT
2017-01-26 10:00:51.997771 yalu102[232:5204] fffffff0111bc000 - fffffff012898000
2017-01-26 10:00:52.070428 yalu102[232:5204] ffffffff03d98000
2017-01-26 10:00:52.113052 yalu102[232:5204] fffffff0120655a0
2017-01-26 10:00:52.152024 yalu102[232:5204] pmap: fffffff012514850
2017-01-26 10:00:52.191465 yalu102[232:5204] got phys at 0 for virt fffffff000848000
2017-01-26 10:00:52.191662 yalu102[232:5204] found cpu 0
2017-01-26 10:00:52.191711 yalu102[232:5204] found physz: fffffff012087000
2017-01-26 10:00:52.191765 yalu102[232:5204] found cpu 1
2017-01-26 10:00:52.191805 yalu102[232:5204] found physz: fffffff012087000
2017-01-26 10:00:52.191952 yalu102[232:5204] fffffff01218733c - fffffff01218719c
2017-01-26 10:00:52.193792 yalu102[232:5204] ttbr0: 8024c5000 fffffff012065590
2017-01-26 10:00:52.194428 yalu102[232:5204] got a cpacr

I hope this helps.
-Noim

5s is not supported at this moment.


localStorage seems to be cleared when PWA is closed on mobile

Should not be cleared and remember values on next launch instead

Related to the initial $route, which inside the PWA is /index.html and currently triggers clearing of the stored Collective

Finally fixed with https://github.com/cb109/payshare/releases/tag/2.11.2


First field of a struct not recognized appropriately

In the following source, the first field of the global struct is not recognized appropriately:
/* first-field.c */
#include <stdio.h>

struct {
    char s0[32];
    char s1[32];
} foo;

int main(int ac, char **av)
{
    if (ac != 3)
        return -1;
    snprintf(foo.s0, sizeof(foo.s0), av[1]);
    snprintf(foo.s1, sizeof(foo.s1), av[2]);
    return 0;
}

gcc -O2 -Wall first-field.c -o first-field
In Ghidra, it can be reconstructed to:
int main(int ac,char **av)

{
    if (ac == 3) {
        snprintf((char *)&foo,32,av[1]);
        snprintf(foo.s1,32,av[2]);
        return 0;
    }
    return -1;
}

The first snprintf doesn't seem to recognize that the first field is a string, it should be snprintf(foo.s0,32,av[1]);

Env: Ghidra 9.0.4, Linux x86-64, GCC 8.3.0

This is ambiguous. During compilation you lose information that can not be reconstructed during decompilation. E.g. what if your original code actually was:
snprintf((char *)&foo,32,av[1]);

Ghidra wouldn't know!
Also what if you have:
struct {
union {
    char s0[32];
   char ambiguous[32];
}
    char s1[32];
} foo;

Which would it be? foo.s0 or foo.ambiguous?
This is all because you lose information during compilation that can not be recovered during de-compilation.
As an enhancement (in case using the first member of a structure results in less casts) this could create cleaner code and I fully support it. But this is not a bug per se.

As an enhancement (in case using the first member of a structure results in less casts) this could create cleaner code and I fully support it.

It's more than "less casts" here, it's 0 cast.

But this is not a bug per se.

Sure, the code is not incorrect in itself, but I consider this the bug because Ghidra is not honoring the non-ambiguity: first field type is known, not a union, and non-ambiguous, therefore re-interpreting the struct instead of pointing to the first field is incorrect (as in: it's not using all the information it's given / honoring user input).

A raw pointer to the base of foo (which is ultimately what Ghidra sees) could just as easily refer to either the entire struct with sizeof=64 or just s0 with sizeof=32. With the second argument to snprintf a human could easily infer that the real target is foo.s0 -- I suspect this is too much to ask of a decompiler. Maybe the best way is to let users resolve the exact type in cases of ambiguity. This would also fix the union problem.

This is addressed by 31b30adf2dfdd2688cc0e4e7cd01d125fc27c45b


Do not remove file extensions making table name?

Current
data/data.csv -> data__data

Proposed
data/data.csv -> data__data__csv

Rationale
To have ability to store other types of files.

CANCELLED
Bad idea because for now not prepared SQL database could be exported as datapackage.