Catalog Next Package - Initialization

This issue covers the initial setup of the package plus the Catalog Next (CN) initialization feature.
DoD:

[ ] Repo catalog-next-toolkit created
[ ] Styleguidist demos of package initialization
[ ] Unit Tests

Description of Initialization Features
The CN component requires initialization when the application starts. This initialization will proceed in the background, so that app is not required to wait until it is done.
The initialization parameters are:

SERVER: this points to the copy of DCS to use. Default will be
https://qa.door43.org; and for production: https://git.door43.org.
OWNER: this is the owner of the resources. The default is 'unfoldingWord'.
LANGID: this provides the language to be used in identifying resources. Default will be en.
RESOURCES: this is a comma delimited list of resource IDs. The complete list is:
'ta', 'tw', 'twl', 'tn', 'tq', 'obs', 'obs-tq', 'obs-tn', 'obs-sn', 'obs-sq'.
Original Language Resources: The Greek and Hebrew published content will be included as a resource. Since they are fixed in ownership and language, they require special treatment. The repos are:

unfoldingword/hbo_uhb (at this writing, the latest published version is v2.1.19)
unfoldingword/el-x-koine_ugnt (at this writing, the latest published version is v0.20)

STAGE: this is the value for CN component which determines the release level to work with. It must be one of the following: 'latest', 'preprod', 'prod', 'draft'. The default is 'latest'.
APIVERSION: this may be hard coded for now to be api/catalog/v5.

The demo will simply show the latest production release tag for each resource. This is a very simple demo showing that the CN API is functioning and is being correctly used.
Technical Requirements

Will use a headless design approach and will exclude any React UI components
The demo will be segregated into a different folder and excluded from the published NPM component. See https://github.com/unfoldingWord/uw-content-validation/tree/master/src for how this was done for the uw-content-validation package.
Consider use of Typescript to benefit from static typing and long term maintainability. For how to setup Styleguidist with Typscript, see this example and its references: https://github.com/mandolyte/typescript-styleguidist-tester

The demo will allow manual updates to the essential parameters and then will show the correct tags for each resource in a simple text list.

@BincyJ @birchamp
Questions:

Should the Original Languages always use the highest prod release? (I think "yes")
Should the tag parameter be optional and, if not specified, default to use the highest tag? (I think "no", but see below for implications)
Should this API enforce the entanglement of language and resource? (I think "yes"). In other words:

if language is specified first, only show resources which exist with that language
if resource is specified first, only show languages which exist with that resource
this devolves to having two API searches, one for each way

On the tag being optional: I doubt there is a use case for a GL team to prefer the highest production release. Instead, they want to point to a release and stick with it until they intentionally want to switch.
The upshot of this is that this component can never just go off and pre-load the resources. The app must always direct which resources are to be used, including the case of the "sticky" tag.
This will simplify the API some at the cost of complicating the UI/X.
Let me know as soon as possible your answers to the above questions. Thanks!

@mandolyte @birchamp @BincyJ
@cckozie @elsylambert
If we set source version PER BOOK, does that risk continuity when the GL publishes?
For example, let's say the English team says something like "starting in tN v98, every conjunction has a translator note" (or something)
If SOME books are sourced from an OLDER version, the final product would be inconsistent with "NEWER" books

@ancientTexts-net
So here's the problem:

GL team translates Titus TN from en_tn v. 43
uW announces that Mark TN is released in en_tn v.44
uW also made a few corrections to Titus TN
GL team wants to translate the latest Mark TN (with v.44 as the source)
GL team wants to check their translation of Titus TN (translated from v.43)
GL team checker marks Titus TN as wrong because he's looking at the v.44 source.

This issue is closed since it is superseded by user requirements.


Remove the Commented dividers (#)

It would be easy if I can just copy and paste this whole thing straight into the  whitelist box, I don't understand why there's comments, now I have to put in text editor and delete each one out. Do you know an easier method to get this list onto my whitelist?

I assume you're talking about optional-list.txt. The reason it has comments is that not everyone is going to add all the domains in that file and comments provide a useful information about the domains and services that are affected.
For example, a domain is affecting National Express, UK while booking a journey. People outside the UK are not affected by this domain.
You can remove the comments quickly buy running this command in you terminal :-
curl -sS https://raw.githubusercontent.com/anudeepND/whitelist/master/domains/optional-list.txt | grep -Ev '(#.*$)|(^$)'


Workaround found for: Unable to attach or mount volumes mount.nfs Connection timed out

What is the bug?
@thesuperzapper (Mathew Wicks) suggested I post the workaround that I found for this EFS problem I experienced setting up my PV/PVC for AirFlow. This is not an issue with AirFlow itself, it was a Persistent Volume issue that should work but did not. Please close this bug as the intention here is to be a source of documentation to anyone who might experience this same issue and would like to find a working solution.
When I specified a path: other than "/" in the PersistentVolume manifest, K8s failed to mount the volume to the AirFlow web and scheduler pods with this message:
 unmounted volumes=[k8s-cluster-dev], unattached volumes=[scripts k8s-cluster-dev airflow-devops-test-token-7bq9s]:
 timed out waiting for the condition

Warning  FailedMount  109s  kubelet, ip-10-4-4-44.ec2.internal  MountVolume.SetUp failed for volume "k8s-cluster-dev-efs-airflow-devops-test" :
 mount failed: exit status 32
Mounting command: systemd-run
Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/xxxxxx-0d08-4b4f-b2e6-f97971d9dbd0/volumes/kubernetes.io~nfs/k8s-cluster-dev-efs-airflow-devops-test --scope -- mount -t nfs fs-xxxxxxxx.efs.us-x-x.amazonaws.com:/a.domain.com/airflow-devops-test /var/lib/kubelet/pods/xxxxxxx-0d08-4b4f-b2e6-xxxxxxxx/volumes/kubernetes.io~nfs/k8s-cluster-dev-efs-airflow-devops-test
Output: Running scope as unit run-28953.scope.
mount.nfs: Connection timed out

The PersistentVolume.yaml looks like this (redactions with xxxx here):
apiVersion: v1
kind: PersistentVolume
metadata:
  name: k8s-cluster-dev-efs-airflow-devops-test
spec:
  capacity:
    storage: 100Gi
  accessModes:
    - ReadWriteMany
  nfs:
    server: fs-xxxxxxxx.efs.us-x-x.amazonaws.com
    path: "/some/path"
  persistentVolumeReclaimPolicy: Retain
  volumeMode: Filesystem

There was no error from K8s when this manifest was used (with the real server name of course) and it showed Bound, and indeed the PVC could also be Bound to it. But when AirFlow tried to mount the volume, that's when the weird nfs timeout errors occurred. Changing the path: on the PV to "/" fixed the issue and allowed the volume to mount to AirFlow.
What are your Helm values?
Any relevant parts of your custom_values.yaml
  extraVolumeMounts:
    - name: k8s-cluster-dev
      mountPath: /opt/airflow/efs
  extraVolumes:
    - name: k8s-cluster-dev
      persistentVolumeClaim:
        claimName: k8s-cluster-dev-efs-airflow-devops-test

What is your Kubernetes Version?:
$ kubectl version
Client Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.10", GitCommit:"575467a0eaf3ca1f20eb86215b3bde40a5ae617a", GitTreeState:"clean", BuildDate:"2019-12-11T12:41:00Z", GoVersion:"go1.12.12", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"16", GitVersion:"v1.16.15", GitCommit:"2adc8d7091e89b6e3ca8d048140618ec89b39369", GitTreeState:"clean", BuildDate:"2020-09-02T11:31:21Z", GoVersion:"go1.13.15", Compiler:"gc", Platform:"linux/amd64"}

What is your Helm version?:
$ helm version
version.BuildInfo{Version:"v3.2.4", GitCommit:"0ad800ef43d3b826f31a5ad8dfbb4fe05d143688", GitTreeState:"clean", GoVersion:"go1.13.12"}

@epmccormick thanks for putting this info here!

Hello, I got this error when trying to mount an existing pv to airflow on gke:
Events:
  Type     Reason       Age    From                                             Message
  ----     ------       ----   ----                                             -------
  Normal   Scheduled    2m59s  default-scheduler                                Successfully assigned airflow-dev/apache-airflow-release-scheduler-89cdfdc76-66pnx to gke-airflow-default-pool-4c9482d6-8fmf
  Warning  FailedMount  56s    kubelet, gke-airflow-default-pool-4c9482d6-8fmf  MountVolume.SetUp failed for volume "nfs-airflow" : mount failed: exit status 1
Mounting command: /home/kubernetes/containerized_mounter/mounter
Mounting arguments: mount -t nfs <IP_ADDRESS>:/ /var/lib/kubelet/pods/1bef6888-3ea9-43d6-bbb2-034a330daa73/volumes/kubernetes.io~nfs/nfs-airflow
Output: Mount failed: mount failed: exit status 32
Mounting command: chroot
Mounting arguments: [/home/kubernetes/containerized_mounter/rootfs mount -t nfs <IP_ADDRESS>:/ /var/lib/kubelet/pods/1bef6888-3ea9-43d6-bbb2-034a330daa73/volumes/kubernetes.io~nfs/nfs-airflow]
Output: mount.nfs: Connection timed out
  Warning  FailedMount  56s  kubelet, gke-airflow-default-pool-4c9482d6-8fmf  Unable to attach or mount volumes: unmounted volumes=[logs], unattached volumes=[apache-airflow-release-scheduler-token-5zlxt config logs]: timed out waiting for the condition

Is it relevant with this issue?  Could find the way to work around yet.

Hello, I got this error when trying to mount an existing pv to airflow on gke:
Events:
  Type     Reason       Age    From                                             Message
  ----     ------       ----   ----                                             -------
  Normal   Scheduled    2m59s  default-scheduler                                Successfully assigned airflow-dev/apache-airflow-release-scheduler-89cdfdc76-66pnx to gke-airflow-default-pool-4c9482d6-8fmf
  Warning  FailedMount  56s    kubelet, gke-airflow-default-pool-4c9482d6-8fmf  MountVolume.SetUp failed for volume "nfs-airflow" : mount failed: exit status 1
Mounting command: /home/kubernetes/containerized_mounter/mounter
Mounting arguments: mount -t nfs <IP_ADDRESS>:/ /var/lib/kubelet/pods/1bef6888-3ea9-43d6-bbb2-034a330daa73/volumes/kubernetes.io~nfs/nfs-airflow
Output: Mount failed: mount failed: exit status 32
Mounting command: chroot
Mounting arguments: [/home/kubernetes/containerized_mounter/rootfs mount -t nfs <IP_ADDRESS>:/ /var/lib/kubelet/pods/1bef6888-3ea9-43d6-bbb2-034a330daa73/volumes/kubernetes.io~nfs/nfs-airflow]
Output: mount.nfs: Connection timed out
  Warning  FailedMount  56s  kubelet, gke-airflow-default-pool-4c9482d6-8fmf  Unable to attach or mount volumes: unmounted volumes=[logs], unattached volumes=[apache-airflow-release-scheduler-token-5zlxt config logs]: timed out waiting for the condition

Is it relevant with this issue? Could find the way to work around yet.

did you find the solution. im facing the same in AWS EKS

Thats great. How did you do it?

Would it be possible for a GKE to use EFS for persistent volume? My cluster needs to be in google.

did you find the solution. im facing the same in AWS EKS, my manifest has path set as "/".
I am trying to use the same efs for both dags and logs persistence. It was working fine with just dag persistence. Any ideas?

Have you solved this? If not, just got EKS with dags+logs persistence on EFS working, so may try to help.

Still curious on this; dags sync fine, but as soon as I try logs most containers are in permanent backoff and retry, with no other logs as to why.

did you find the solution. im facing the same in AWS EKS, my manifest has path set as "/".
I am trying to use the same efs for both dags and logs persistence. It was working fine with just dag persistence. Any ideas?

Have you solved this? If not, just got EKS with dags+logs persistence on EFS working, so may try to help.

Still curious on this; dags sync fine, but as soon as I try logs most containers are in permanent backoff and retry, with no other logs as to why.

Nah!! It didn't support the same EFS. So i had used two volumes separately

did you find the solution. im facing the same in AWS EKS, my manifest has path set as "/".
I am trying to use the same efs for both dags and logs persistence. It was working fine with just dag persistence. Any ideas?

Have you solved this? If not, just got EKS with dags+logs persistence on EFS working, so may try to help.

Still curious on this; dags sync fine, but as soon as I try logs most containers are in permanent backoff and retry, with no other logs as to why.

I have met the same issue like what you mentioned above. no solution for it now. .... Terrible


File Upload creates blank file - Error: Passive socket timeout

Hi @zonak ,
I was trying to configure this plugin for my custom Node Application.
I am trying to upload the application files to a GoDaddy domain and while doing so, the connection is made, eventually the utility creates a remote directory if it doesn't exists or uploads the first file.
However, it stops and nothing outputs afterwards. After exactly 10 minutes, the message is shown as: >> Cannot upload file: about.html --> Error: Passive socket timeout
The server has an uploaded file with 0 kb size though.
Below is the output in verbose mode. I have inserted some debug logs to pinpoint the error but was unable to.
$ grunt deploy --verbose
Initializing
Command-line options: --verbose

Reading "Gruntfile.js" Gruntfile...OK

Registering Gruntfile tasks.
Initializing config...OK
Loading "Gruntfile.js" tasks...OK
+ default, test

Running tasks: test

Running "test" task
Writing .ftppass...OK

Loading "grunt-ftp-deploy" plugin

Registering "/Users/xxxxxx/Projects/xxxxxx/node_modules/grunt-ftp-deploy/tasks" tasks.
Loading "ftp-deploy.js" tasks...OK
+ ftp-deploy

Running "ftp-deploy:test" (ftp-deploy) task
Verifying property ftp-deploy.test exists in config...OK
Files: ./test/ -> /test/
Calling FTPdone: (none)
FTP Initialised
Local Root: ./test/
Remote Root: /test/
Reading /Users/xxxxx/Projects/xxxxxxx/.ftppass...OK
authVals: [object Object]
exclusions: .DS_Store, Thumbs.db
toTransfer: [object Object]
authVals<EMAIL_ADDRESS>password="xxxxxxxxxxxxxxx"
FTP Done
FTP Authenticated
Error: (none)
locations: /
ftpProcessLocation: (none)
inPath: (none)
toTransfer: /=["test.html"]
toTransfer[inPath]: test.html
/test/
err in switching remote folder: (none)
currPath: (none)
files: test.html
FTP Put Called
localRoot: (none)
path.sep: (none)
currPath: (none)
inFilename: (none)
>> Cannot upload file: test.html --> Error: Passive socket timeout
err in File Put: (none)
Warning: Failed uploading files! Use --force to continue.

Aborted due to warnings.

Execution Time (2020-06-02 16:47:07 UTC+8)
loading tasks                 56ms  0%
deploy                         4ms  0%
loading grunt-ftp-deploy     228ms  0%
ftp-deploy:test          10m 0.6s  ▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇▇ 100%
Total 10m 0.9s

Any help would be appreciated.

Hey @j-saraiya can you share the solution?


[vcpkg baseline][nuspell] Add and fix feature tools

Add feature tools and fix its dependency getopt since getopt_long isn't provided in Win32 api.
Related: https://github.com/microsoft/vcpkg/pull/22676
Fixes #24533
Already tested this feature on x86-windows.

Thanks for the baseline fix!


cstor pool can't claim blockdevice

Description

disk status
[root@node1 k8s]# fdisk -l
Disk /dev/vda: 214.7 GB,<PHONE_NUMBER>00 bytes, 419430400 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0x000bb9c1

   Device Boot      Start         End      Blocks   Id  System
/dev/vda1   *        2048   419430366   209714159+  83  Linux
WARNING: fdisk GPT support is currently new, and therefore in an experimental phase. Use at your own discretion.

Disk /dev/vdb: 214.7 GB,<PHONE_NUMBER>00 bytes, 419430400 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: gpt
Disk identifier: 1A616F71-B1AE-4E89-8218-FB71DF5958EA

#         Start          End    Size  Type            Name
 1         2048    419430366    200G  Linux filesyste OpenEBS_NDM

The blockdevice status
[root@node1 k8s]# kubectl get blockdevice -n openebs
NAME                                           NODENAME   SIZE           CLAIMSTATE   STATUS   AGE
blockdevice-07e6f112e3f7eee01f2d964c12e2bec1   node3<PHONE_NUMBER>28   Unclaimed    Active   25m
blockdevice-1bdac699155e80c017842ca35888052b   node2<PHONE_NUMBER>28   Unclaimed    Active   25m
blockdevice-5f92efaa0d9206fc185bbb827feb2902   node1<PHONE_NUMBER>28   Unclaimed    Active   25m

spc yaml
apiVersion: openebs.io/v1alpha1
kind: StoragePoolClaim
metadata:
  name: cstor-disk-pool
  annotations:
    cas.openebs.io/config: |
      - name: PoolResourceRequests
        value: |-
            memory: 2Gi
      - name: PoolResourceLimits
        value: |-
            memory: 4Gi
spec:
  name: cstor-disk-pool
  type: disk
  poolSpec:
    poolType: striped
  blockDevices:
    blockDeviceList:
    - blockdevice-07e6f112e3f7eee01f2d964c12e2bec1
    - blockdevice-1bdac699155e80c017842ca35888052b
    - blockdevice-5f92efaa0d9206fc185bbb827feb2902
---

csp status
[root@node1 k8s]# kubectl get csp
No resources found

bdc status
[root@node1 k8s]# kubectl get bd --all-namespaces -o wide
NAMESPACE   NAME                                           NODENAME   PATH        FSTYPE       SIZE           CLAIMSTATE   STATUS   AGE
openebs     blockdevice-07e6f112e3f7eee01f2d964c12e2bec1   node3      /dev/vdb1   zfs_member<PHONE_NUMBER>28   Unclaimed    Active   8s
openebs     blockdevice-1bdac699155e80c017842ca35888052b   node2      /dev/vdb1   zfs_member<PHONE_NUMBER>28   Unclaimed    Active   51s
openebs     blockdevice-5f92efaa0d9206fc185bbb827feb2902   node1      /dev/vdb1   zfs_member<PHONE_NUMBER>28   Unclaimed    Active   5m14s

describe bdc ststus
Status:
  Phase:  Pending
Events:
  Type     Reason           Age                From                       Message
  ----     ------           ----               ----                       -------
  Warning  SelectionFailed  2s (x17 over 78s)  blockdeviceclaim-operator  no devices found matching the criteria

Expected Behavior

Current Behavior

Possible Solution

Steps to Reproduce

Screenshots

Your Environment

kubectl get nodes:
kubectl get pods --all-namespaces:
kubectl get services:
kubectl get sc:
kubectl get pv:
kubectl get pvc:
OS (from /etc/os-release):
Kernel (from uname -a):
Install tools:
Others:

@dhcn  The BDCs are not bound because of the zfs_member filesystem on the disk.
Can you share the output of udevadm info /dev/vdb1 from node1.?
Also, was there a previous installation of cstor on this cluster ? or was this disk vdb used in a ZFS pool earlier?

@dhcn  The BDCs are not bound because of the zfs_member filesystem on the disk.
Can you share the output of udevadm info /dev/vdb1 from node1.?
Also, was there a previous installation of cstor on this cluster ? or was this disk vdb used in a ZFS pool earlier?

@dhcn The BDCs are not bound because of the zfs_member filesystem on the disk.
Can you share the output of udevadm info /dev/vdb1 from node1.?
Also, was there a previous installation of cstor on this cluster ? or was this disk vdb used in a ZFS pool earlier?

seems it is, I clean that disk
fdisk /dev/vdb
gdisk /dev/vdb
lsblk -f
wipefs -fa /dev/vdb

@dhcn Does the BlockDevice get claimed after wiping the disk?


2024 [frontend]: update prettier up to ^2.3.1 and run it through the codebase

Since on:precommit task runs linters on staged files I had to disable quite a lot of eslint rules
Issue: #2024

@korneev-andrew thank you for contribution!


Documentation: Specify the required OAuth scope for the access-token

It would be nice to document what scope is needed for the access-token so consumers of the action can generate one with just what is needed.

 I wasn't aware of the fact that Github automatically created the GITHUB_TOKEN that is used in the example and thought it was a placeholder for a secret that I needed to add.


Make bare (on fork)

If anyone wants to create a quick bare variant of the latest advancements.
This seems to work:
$ git show bare:mkbare.sh | zsh

(I'll try to find out how to do git format patch on the diff so that history will remain consistent and no force pushing is required, so that in principale #91 workflows can be supported also for bare)

I think the simplest thing to do would be to invert the flow. So instead of making template bare. We rebase template off of the bare branch, probably by clearing all profiles and modules with a given commit to make bare, then adding them back in on top of the bare repo so we can just simply rebase with git rebase bare from template.

I think the simplest thing to do would be to invert the flow. So instead of making template bare. We rebase template off of the bare branch, probably by clearing all profiles and modules with a given commit to make bare, then adding them back in on top of the bare repo so we can just simply rebase with git rebase bare from template.

Yep that sounds great! I was trying to invent something with git filter-repo but it failed loudly.

Yep that sounds great! I was trying to invent something with git filter-repo but it failed loudly.

Does this mean bare would become the default branch for new commits?

Does this mean bare would become the default branch for new commits?

Essentially yes, we could rename it to something like core. We'd probably also want to make it the default branch

Essentially yes, we could rename it to something like core. We'd probably also want to make it the default branch

Ohh nice, that would make it much easier to add new nixflk features to forks once you've changed things.

Ohh nice, that would make it much easier to add new nixflk features to forks once you've changed things.


Add method to add a secondary destination in BaseMessage

Request from Aihua T. (UT):
I would like a method to add a second destination in BaseMessage. The existing method:
public void setMessageDestination(String value) {
  messageHeader.getDestination().clear();
  MessageHeader.MessageDestinationComponent dest = new MessageHeader.MessageDestinationComponent();
  dest.setEndpoint(value);
  messageHeader.getDestination().add(dest);
}

Is this a reasonable ask? Surely you can do something akin to...
messageheader.getDestination().add(new MessageDestinationComponent(value));

The setter is just a guardrail for useability but if they need a 2nd destination using the components as HAPI intended would be a reasonable expectation.


voterUpdate API endpoint and some other APIs related to voter images updated with respect to cached all size image urls

👍


[Simple Reminder] input text has tokens cut out of the topic

Extension
https://www.raycast.com/comoser/simple-reminder
Description
When the extension takes the input text to pass it to the AI natural language interpretors (for the time related strings and the topic of the reminder), there are certain words that are being removed in a hardcoded way.
These keywords are stored in EXCLUDED_TOKENS and are removed in any part of the input text.
Current behaviour

remind me to set something to clear tomorrow at 11am
Result: set something clear
Expected: set something to clear

Steps To Reproduce

Enter the Add Reminder command
Input "remind me to set something to clear tomorrow at 11am"

Current Behaviour
Outcome is set something clear
Expected Behaviour
Expect topic to be set something to clear

Thank you for opening this issue!
🔔 @pernielsentikaer you might want to have a look.
💡 Tip: Once the issue is resolved, comment @raycastbot close this issue to close it.

@pernielsentikaer don't worry about this, I have people wanting to tackle this 😁

The changes mentioned and merged were by mistake. This issue has not been started yet.


[Anomaly Detector] CodeGen

Summary
The focus of these changes is to regenerate code based on the v1.1-preview.1 version of the swagger.

API changes have been detected in Azure.AI.AnomalyDetector. You can review API changes here

@jsquire I've seen some checks still not successful for this PR and no reviewer approved. Is there any other things need me to do? Or you will help cover following things before merge?

Hi @mengaims.   There are still issues that need to be addressed.   To echo what I reported on the email thread:

Please be aware that the new swagger version did cause a couple of issues that you’ll want to review:

It introduced breaking changes due to new parameters being inserted in client constructors in the middle of the list.
The “ApiVersion” type introduced is redundant to the “ServiceVersion” type in the client options and contains the same members
The use of “ApiVersion” changes the pattern of specifying the service versions with the client options that is defined in the .NET guidelines.  (ref)

I fixed the build issues with the tests that the breaking changes introduced, but did not re-record the tests using the new API which will be needed prior to merging.

I don't have much context around this package, but since it's under an Azure.[[ AREA ]] namespace, my assumption is that it is considered track two and should follow the API guidelines.

@jsquire Thanks for your comments!
I've commited some changes in this PR to resolve the build issues, including: update snippets and record tests. I also ran the Export-API.ps1 in local successfully but it seems the generated file could not be committed. Could you please help review and merge my PR? And if it's possible, could you add me to the contributor of your branch so that I could push commits directly to check the build status timely.
And for your previous comments, here are my answers:
Regarding to the breaking change, yes this version we have some breaking changes so that we upgrade the api version.
And for the "ApiVersion", we introduced this parameter following the API swagger guidance, what will happen when different values are assigned to "ApiVersion" and "ServiceVersion"? Is it possible to fix this redundant in our next version?

@mengaims:  I merged your updates in.   Unless you made additional changes to the API surface by regenerating the code, you shouldn't need to export the API again - I did that after generating and it's included here.   We'll see if something gets cranky during CI.   So long as CI passes, you're free to sign off on this PR and we'll get things merged into main.
With respect to resolving the breaking changes and resolving the issues with the ApiVersion redundancy - that's not my call to make, that would be a discussion that is needed with the Azure SDK Architecture Board.   To my knowledge, they're good with the preview going out as-is, but @lmazuel has been driving those conversations and would have the latest.

what will happen when different values are assigned to "ApiVersion" and "ServiceVersion"?

I honestly have no idea.

@mengaims:  Looks like CI is happy.   Please feel free to approve at your convenience and I'll get things merged in.


Provide regal fix and LSP Code Action for directory-package-mismatch

Having restructured our own code as part of building the directory-package-mismatch rule, I'm now more convinced that this change is good, or even great, for large projects in particular. In order to make it simpler for users to remediate this though, we'll need to follow up with a regal fix fixer (that potentially can fix entire projects) and a Code Action that can fix this for a single file from within the comfort of one's editor.
regal fix
One thing we need to ensure here is that the fix must not run if there are notices emitted by the linter. Notices mean we don't have enough information to determine whether the package is correct or not. So either we respect that, or we make a new and better attempt to find out.
Another thing we'll need to ensure is that this command cleans up empty directories that it has left behind. So for example, if there's a project that looks like this:
code/
  foo/
    policy1.rego  # package policy.foo.bar
    policy2.rego. # package policy.foo.baz
README.md

Running regal fix . in the project root directory, the result would be:
policy/
  foo/
    bar/
      policy1.rego  # package policy.foo.bar
    baz/
      policy2.rego. # package policy.foo.baz
README.md

And the code directory no longer there.

Ideally, we'd have a --dry-run option, that would print the structure after change without actually changing anything.. similar to the output of tree. But a better approach to be able to get this into the next release might be to try and detect if we're in a git repo, and that the working tree is clean. That way the user can try it out and easily revert using just git.

Code Action
Should not be too complicated. Really just a new code action triggering an execute command which does the fix. Since it'll involve moving a file, we'll want to ensure the result is immediately apparent in the editor, and that things like possible issues are now reported at the new location.

One obvious thing to take into account is whether a file of that name already exists in the directory targeted 😅 If that's the case, we could just add a number, or some identifer like _moved, or simply fail.


python and curl code blocks added for deployment

📝 Changed routes:

/docs/graphQL

(view full size)

Commit 18823312c26eb362a11cdfdb9670ffcbf98b4e52 (https://site-luimhhxyk-lamatic.vercel.app).


Broken history recall layout after console resize with multiline prompt

I use multiline prompt, and everything works fine:

Except when I resize my console window then the layout of the history (Up/Down arrow) gets broken after resize:

When advance to new command (via Enter) it gets recovered to "valid" state. It looks like readline is recovering the prompt using the "spaces" from the old window size, rather than new lines.
Here's a profile.ps1 prompt setting that can be used to replicate the issue:
function Prompt {
    Write-Host $($ExecutionContext.SessionState.Path.CurrentLocation) -NoNewline
    return "`n" + '>' * ($nestedPromptLevel + 1) + ' '
}

This should be fixed in 2.0.0-beta1, feel free to reopen with additional details if you update and can still repro.

I confirm this is fixed in 2.0.0-beta1. Thank you!


orientation label ignored on Reddit

Using the MM in portrait mode. When setting orientation to either "vertical" or "auto", the module still pulls and displays landscape images from the subreddit. Tested with multiple channels, e.g. r/EarthPorn, r/MostBeautiful. Please advise.

Is your expectation that it would skip landscape oriented images from reddit?  "vertical" and "auto" currently only mean something to the bing source, since it provides 1920x1080 and 1080x1920 versions of each background.

Yeah, that kinda was what I expected. I'll stick with bing until I'll grow the stones to fork your module.
Maybe you could add that detail regarding orientation only working for bing to the Readme.md.
Last but not least, a) great module and b) thx for getting back to me so quickly.


Minified build doesnt include TG.RadialGradient

The build file isn't updated !
TG.RadialGradient doesnt exist in the min version

Fixed!


Filter the dialogs with no messages and deleteds users

What filter should I use to not get a list of dialogs without messages or in case it is a dialog of 2 users, not get it if one was deleted?
The documentation mentions these filters, but how should I use them?
Retrieve dialogs with the exact data specified in the request with applying additional filters. Available filters: lt (Less Than operator), lte (Less Than or Equal to operator), gt (Greater Than operator), gte (Greater Than or Equal to operator), ne (Not Equal to operator), in (Contained IN array operator), nin (Not contained IN array), all (ALL contained IN array), ctn (Contains substring operator)

There is no filter to skip dialogs w/o messages
The best way is to do it on client side using array.filter function.
Regarding deleted 1-1 chats, you basically does not know whether it's deleted at other side or now, so there is no way to filter by this param


docs: fix ng lint and tools lint command in documentation

Description:
This PR tries to fix the ng lint and the tools lint command of the documentation site (see also https://github.com/ReactiveX/rxjs/pull/7364#pullrequestreview-1720976136).
It is quite a substantial change, as introducing eslint into the build requires to change also changes in some of the source or tests files.

Related issue (if exists):
This is trying to address the request for fixing ng lint sufaced in PR https://github.com/ReactiveX/rxjs/pull/7364#pullrequestreview-1720976136

@jakovljevic-mladen or @niklas-wortmann can you please take a look at this one?

ping @jakovljevic-mladen or @niklas-wortmann

Hey sorry for the delay, I am going to have a look at this after the holidays. Happy holidays everyone

I rebased the PR against master and addressed the review comments

One more question: Should we add the lint command to the build pipeline or should that be a separate PR once this PR is merged?

Should we add the lint command to the build pipeline or should that be a separate PR once this PR is merged?

You can do that in the next PR.


Weird Behavior with #include

So with the newest update to wiremod that is released to the workshop, I noticed some weird behavior with "#include "
I narrowed it down to when you include another file that has some kind of a "print()" in the "if(first())", it causes all following "print()'s, printColor()'s, hint()'s" to not show up at all on the hud/chat/console. And the only way to fix the bug is to reconnect to the server, the server is running AtlasChat, so that may have an effect on it, but I doubt as hints and prints to console wouldn't show up either.
Here's My Code.
Main:
interval(1000)

if(first()){
    #include "testBug"
}
customFunc()

Include File "testBug.txt":
if(first()){
    print("testBug.txt included")

    function void customFunc(){
        print("called function")
    }
}

If you were to remove the "print("testBug.txt included")" the e2 would work as intended. Just some strange behavior that I found

Latest version of wire doesn't have this issue.

I'm referring to the github version, not the workshop one.

@kbarber1998 Before reporting issues, please, make sure that server is running on the 'latest' version of Wire from GitHub. You can check your Wire version by using wireversion console command.
/external compatibility
/unable-to-reproduce


Setting user SSH keys fails when authorized_keys file is a symlink

Describe the bug
Tasks like server.user and server.user_authorized_keys check to make sure the user's ~/.ssh/authorized_keys file is indeed a regular file, and fail if it isn't. However, the assumption that authorized_keys is a regular file doesn't necessarily hold everywhere.
On Proxmox, /root/.ssh/authorized_keys is a symlink to /etc/pve/priv/authorized_keys because /etc/pve is a filesystem that's synchronized across all nodes in a Proxmox cluster. In this scenario this operation will fail.
To Reproduce
Make a file somewhere else and link .ssh/authorized_keys to it. Use the "user_authorized_keys" task to try to set that user's authorized SSH keys.
touch ~/.ssh/authorized_keys
mv ~/.ssh/authorized_keys ~/.ssh/real_authorized_keys
ln -s ~/.ssh/real_authorized_keys ~/.ssh/authorized_keys
pyinfra @local server.user_authorized_keys public_keys=~/.ssh/id_rsa.pub user=$USER

Expected behavior
If ~/.ssh/authorized_keys is a symlink, Pyinfra should instead check to see if the link target is a regular file, then proceed as normal.
Meta

Include output of pyinfra --support.

    System: Linux
      Platform: Linux-6.9.6-arch1-1-x86_64-with-glibc2.39
      Release: 6.9.6-arch1-1
      Machine: x86_64
    pyinfra: v3.0b1
    Executable: /home/taliaferro/.local/share/virtualenvs/infra-gRqFrJWx/bin/pyinfra
    Python: 3.12.3 (CPython, GCC 13.2.1 20240417)

How was pyinfra installed (source/pip)? Pip

Setting authorized_key_filename/authorized_key_directory to the values of the actual file fixes the issue for me (at least for server.user_authorized_keys()).
Unfortunately server.user() does not support those two keyword arguments.

If ~/.ssh/authorized_keys is a symlink, Pyinfra should instead check to see if the link target is a regular file, then proceed as normal.

Of course this would be nicer for end users :slightly_smiling_face:


Context information is not shown when using LF Line endings, only with CRLF

I added the contextive to my project using VS Code command.
The extension nicely highlights the domain words when hovering over them.

However for old files it seems not working:

I created a new file next to that one, and copied the contents. In that file the tooltip actually shows:

Turns out that the new file I created was using CRLF. The original file had LF.
Toggling the LF file to CRLF enables the extension to show popup.

Seems to work fine on Linux using both line-endings.
On Windows it only works with CRLF

It is working fine now. Thanks @chrissimon-au


Misconfiguration of Auth Page with Localhost. {GSSoC '23}

Detailed Description:
I would like to report a misconfiguration issue regarding the authentication page when attempting to get started. Currently, the auth page is misconfigured with the localhost page, preventing the proper functioning of the authentication process.
Context:
The misconfiguration of the auth page with the localhost page hinders users from successfully starting their authentication journey. This issue affects the initial setup and usability of the application, leading to frustration and inconvenience.
This change is important to me as it is crucial to provide a seamless onboarding experience for users, allowing them to authenticate without any obstacles. By addressing this misconfiguration, we can ensure that users can smoothly proceed with the authentication process on the localhost page.
Possible Solution:

Review the configuration settings of the authentication page to identify the source of misconfiguration.
Verify that the correct redirect URLs and callback URLs are specified for the localhost environment.
Update the auth page configuration to match the appropriate localhost URL, ensuring compatibility with the application's backend.
Test the authentication process on the localhost page to confirm that the misconfiguration has been resolved.

Additional Information:
I think this is a serious issue. Please assign this task to me under GSSoC '23 so that we could fix it ASAP.

Sure! would love to see the changes!

Hi @nawed2611 , May I know the deployment link of the backend server? So that I can replace the localhost URL with the original backend server URL.

Hi, @GVishnudhasan @nawed2611  has there been any progress on this issue? I still haven't been able to log in through local host and access the dev environment yet.

@Urmi-Jana ,
The reason of no progress is that I haven't gotten updated regarding the deployment link of the backend URL.


FeedbackChallenge : Glow Formal verification

FeedbackChallenge : Glow Formal verification
In the spirit of Project Catalyst's #FeedbackChallenge we are assessing to what extent the Catalyst Funding Process and it's Proposals are open source as part of the proposal Quality-Assurance-DAO. Your proposal has been selected because "open source" is mentioned in it's text or comments.
We would appreciate it if you could respond to the following questions (in the reply to my comments below) :

Open - Is your Organisation open-source ?

Yes, triple yes! We believe that Open Source is our moral imperative and intend to produce all our code this way.

Accessible -  Can community contributors issue pull requests or raise issues on your source code ?

Yes, we value that very much.

Transparent - Can community contributors access and propose changes to the source text of your documentation ?

Yes as well: since we are building a language that aims at helping the whole community grow stronger, we of course value evaluation and modification of our documentation.

To keep the assessment transparent each comment is recorded as a GitHub Issue on Quality-Assurance-DAO's proposal repository (Apache-2.0 License) where a more detailed explanation can be found.
Together we can build a community of open source contributors on the Cardano platform.
Thank You
Stephen Whitenstall, QA-DAO
Detailed explanation
Your Issue reference includes a more detailed explanation of the methodology of this FeedbackChallenge : Open Source. There is also a Open Source Assessment Project Board and a GitHub bot post Issues in my channel #quality-assurance-dao on Project Catalyst's Discord.
We believe this is important because many developers are concerned with the lack of a clear commitment to open source and fear their free contributions will be locked into a proprietary platform.
Open Source Assessment Method

[x] Draft a basic Open Source Assessment Method.
https://github.com/Quality-Assurance-DAO/DAO-Open-Source/tree/main/Documents/Assessments

Basic Open Source Assessment

Open - Is your Organisation open-source ?
Accessible -  Can your users issue pull requests or raise issues on your organisation's source code ?
Transparent -  Can your users access and propose changes to the source of your organisation's documentation ?

Method

[x] Do text search of "open source" on Catalyst Projects.
[x] Post assessment questions in comments of proposal.
[x] Raise Issue for each proposal's assessment.
[x] Record response to assessment.
[ ] Close Issue once proposal submitted and record responses

Report

[ ] Collate and publish report of findings with a Creative Commons License

Gauthier Lamothe (gauthierlamothe)
Team Member

swhitenstall Hello there!

Yes, triple yes! We believe that Open Source is our moral imperative and intend to produce all our code this way.
Yes, we value that very much.
Yes as well: since we are building a language that aims at helping the whole community grow stronger, we of course value evaluation and modification of our documentation.

Thank you for your response, Gauthier Lamothe (gauthierlamothe), It is very helpful and informative.
I have captured your response at [ https://github.com/Quality-Assurance-DAO/F5-Developer-ecosystem-Proposal/issues/50] and moved the status of the Issue to "Done".
As I set out in the "Detailed explanation" section of each Issue: I will collect all data in a report of findings to be published on GitHub with a Creative Commons License by 26/05/2021
Good Luck with your proposal.
Stephen Whitenstall QA-DAO


Lous has been renamed to Hanami

http://hanamirb.org/blog/2016/01/22/lotus-is-now-hanami.html

Quick! Thanks!

You're welcome


[TVer] Some URLs are not recognized

Checklist

[X] I'm reporting a broken site
[X] I've verified that I'm running yt-dlp version 2022.05.18 (update instructions) or later (specify commit)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[x] I've read about sharing account credentials and I'm willing to share it if required

Region
Japan
Description
TVer Extractor may not recognize some URLs.
for ex.
https://tver.jp/episodes/epm8kjl7ze
https://tver.jp/episodes/epmf7b32xx
The URL in question can be opened in the browser without any problem, but yt-dlp will display "Not Found".
(This is at 17:00:00 on 6/8/2022)
Verbose log
$ yt-dlp -vU https://tver.jp/episodes/epm8kjl7ze
[debug] Command-line config: ['-vU', 'https://tver.jp/episodes/epm8kjl7ze']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2022.05.18 [b14d52355]
[debug] Python version 3.8.10 (CPython 64bit) - Linux-<IP_ADDRESS>-microsoft-standard-WSL2-x86_64-with-glibc2.29
[debug] Checking exe version: ffprobe -bsfs
[debug] Checking exe version: avprobe -bsfs
[debug] Checking exe version: ffmpeg -bsfs
[debug] Checking exe version: avconv -bsfs
[debug] exe versions: none
[debug] Optional libraries: Cryptodome-3.14.1, brotli-1.0.9, certifi-2019.11.28, mutagen-1.45.1, secretstorage-2.3.1, sqlite3-2.6.0, websockets-10.3
[debug] Proxy map: {}
Latest version: 2022.05.18, Current version: 2022.05.18
yt-dlp is up to date (2022.05.18)
[TVer] Creating session
[debug] [TVer] Extracting URL: https://tver.jp/episodes/epm8kjl7ze
[TVer] epm8kjl7ze: Downloading JSON metadata
[TVer] epm8kjl7ze: Downloading JSON metadata
[debug] [brightcove:new] Extracting URL: http://players.brightcove.net/6191645753001/default_default/index.html?videoId=ref:2302810259_20220604#__youtubedl_smuggle=%7B%22geo_countries%22%3A+%5B%22JP%22%5D%7D
[debug] Using fake IP <IP_ADDRESS> (JP) as X-Forwarded-For
[debug] Loading brightcove.6191645753001_default from cache
[brightcove:new] ref:2302810259_20220604: Downloading JSON metadata
ERROR: [brightcove:new] Unable to download JSON metadata: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
  File "/home/hide/.local/lib/python3.8/site-packages/yt_dlp/extractor/common.py", line 642, in extract
    ie_result = self._real_extract(url)
  File "/home/hide/.local/lib/python3.8/site-packages/yt_dlp/extractor/brightcove.py", line 648, in _real_extract
    json_data = self._download_json(api_url, video_id, headers=headers)
  File "/home/hide/.local/lib/python3.8/site-packages/yt_dlp/extractor/common.py", line 1030, in _download_json
    res = self._download_json_handle(
  File "/home/hide/.local/lib/python3.8/site-packages/yt_dlp/extractor/common.py", line 1009, in _download_json_handle
    res = self._download_webpage_handle(
  File "/home/hide/.local/lib/python3.8/site-packages/yt_dlp/extractor/adobepass.py", line 1364, in _download_webpage_handle
    return super(AdobePassIE, self)._download_webpage_handle(
  File "/home/hide/.local/lib/python3.8/site-packages/yt_dlp/extractor/common.py", line 801, in _download_webpage_handle
    urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
  File "/home/hide/.local/lib/python3.8/site-packages/yt_dlp/extractor/common.py", line 786, in _request_webpage
    raise ExtractorError(errmsg, cause=err)

  File "/home/hide/.local/lib/python3.8/site-packages/yt_dlp/extractor/common.py", line 768, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/home/hide/.local/lib/python3.8/site-packages/yt_dlp/YoutubeDL.py", line 3596, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.8/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.8/urllib/request.py", line 569, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found

Thanks for the quick response!


usermanagement needed

for the openid connect login a user management is needed.
it should be configurable that

users that do not exist are created
users that are available are updated in their memberships
groups that are not present are updated
all users should be clearly marked as created via the pam module
at every new login it should be checked if users who have not been logged in for more than x days and were created by pam module are deleted again

this request is no longer needed. the development is requested by the metal-stack owner.


[Feature Request] Can we have more descriptive worker side error log?

Is your feature request related to a problem? Please describe.
While we changed the workflow/activity code and redeployed it, we expected the running workflow to use the new code. But instead, we faced a burst of the below message
  2022-09-16T04:51:36.050908Z ERROR temporal_sdk_core::worker::workflow::managed_run: Error in run machines, error: RunUpdateErr { source: Nondeterminism("Complete workflow machine does not handle this event: HistoryEvent(id: 66, Some(ActivityTaskScheduled))"), complete_resp_chan: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) }

I wanted to understand the log and make the following actions but we didn't have any additional log nor any hint from above log line about what to check. I wish the description of the error log from the worker side is more verbose.
Describe the solution you'd like
More descriptive error logs from worker side

To clarify here, we need contextual state on our Core logs. We need workflow ID, run ID, workflow type, etc.

Will be fixed by #410

There's more info available by default now.


Cannot build RubyMotion 'hello world' Application in XCode7-beta6 / IOS9 SDK

I am attempting to get a head start on upgrading my app to IOS9 compatibility, but it seems that RM3.14 is not ready to work with the latest XCode-beta6 and the IOS9 SDK.
I am using the latest developer build of OSX 10.11.
I have confirmed this works on latest XCode 6 / IOS8.4.
Do you have any timing or update on RM support for IOS9 ?  I would be happy to help debug any issues.
This is the output of an app created by running
motion create test-app
El-Capitan-MacBook-Pro:test-app fandordeveloper$ bundle exec rake debug=1
Provisioning Profile: Development
     Build ./build/iPhoneSimulator-9.0-Development
    Create ./build/iPhoneSimulator-9.0-Development/test-app.app/Info.plist
  Simulate ./build/iPhoneSimulator-9.0-Development/test-app.app
*** Starting simulator
2015-08-28 11:09:21.232 sim[3606:175492] [MT] DVTAssertions: Warning in /Library/Caches/com.apple.xbs/Sources/DVTFrameworks/DVTFrameworks-8194.5/DVTFoundation/PlugInArchitecture/PlugInManager/DVTPlugInManager.m:257
Details:  Requested but did not find extension point with identifier Xcode.DVTFoundation.DevicePlatformMapping
Object:   <DVTPlugInManager: 0x101956b50>
Method:   -extensionPointWithIdentifier:
Thread:   <NSThread: 0x100110380>{number = 1, name = main}
Please file a bug at http://bugreport.apple.com with this warning message and any useful information you can provide.

================================================================================
The application terminated. A crash report file may have been generated by the
system, use `rake crashlog' to open it. Use `rake debug=1' to restart the app
in the debugger.
================================================================================
rake aborted!
TypeError: no implicit conversion from nil to integer
/Library/RubyMotion/lib/motion/project/template/ios.rb:234:in `exit'
/Library/RubyMotion/lib/motion/project/template/ios.rb:234:in `block in <top (required)>'
Tasks: TOP => default => simulator

This is an issue we're aware of, and will be fixed in the next version of RubyMotion:
http://hipbyte.myjetbrains.com/youtrack/issue/RM-933
Meanwhile please use the Xcode 7 beta 5.
PS: This repository is only for the open source part of RubyMotion. Next time please use either our community forums or file a private ticket with us.


Improve events emissions

Context
Currently in most modules, events are emitted inside the msg_server methods. While this is by default the best way to emit events, it actually does not us allow to emit them when a module uses another module's methods. For this reason, I think we should move all the events possible from the msg_server to the keeper methods. When doing so, we should always think if such events are worth emitting every time we call that method or not.

@RiccardoM Considering what you've wrote, shouldn't we move events only in those methods who are shared between modules?
Otherwise isn't this worthless?

@bragaz Yes I agree

I've checked around the code and we only use subspaces module to make some checks inside other modules which I think it's not the case to add events for IMO

Closing as no longer necessary


Issue 422

As this is my first contribution here. I just want to start by thanking you guys for the work you have put into this library! I have enjoyed working with it and seeing the performance improvements compared to ClosedXML
When fiddling around trying to export a large dataset using an IEnumerable I encountered some strange issues due to it being enumerated multiple times. I didn't open a new issue as it was already covered by #422.
I could not find any contribution guidelines, so feel free to let me know if there is anything else I should do 😃

@Discolai Awesome, could I invite you to our team? 🙌

@Discolai Awesome, could I invite you to our team? 🙌

Great, I got an invite a couple of days ago which I accepted 🙂

I tried closing #422, but I guess I don't have permissions to do so. Could you do it for me @shps951023 ?

@Discolai Closed, and I'm trying to set up the permissions this few days, github setting is different from other software.

Hi there
Thank you for addressing this issue.
Is there any scheduled plan for rolling out the patch?


Symbol 'type scala.ScalaObject' is missing from the classpath

After import argonaut successfully,
import $ivy.{
            `io.argonaut::argonaut:6.2.3`
            }

https://repo1.maven.org/maven2/io/argonaut/argonaut_2.13/6.2.3/argonaut_2.13-6.2.3.pom
  100.0% [##########] 1.7 KiB (1.9 KiB / s)
https://repo1.maven.org/maven2/io/argonaut/argonaut_2.13/6.2.3/argonaut_2.13-6.2.3-sources.jar
  100.0% [##########] 32.8 KiB (82.5 KiB / s)
https://repo1.maven.org/maven2/io/argonaut/argonaut_2.13/6.2.3/argonaut_2.13-6.2.3.jar
  100.0% [##########] 783.8 KiB (384.2 KiB / s)

and trying to import the package would fail.
argonaut._, Argonaut._

cmd4.sc:2: Symbol 'type scala.ScalaObject' is missing from the classpath.
This symbol is required by 'trait argonaut.ACursors'.
Make sure that type ScalaObject is in your classpath and check for conflicting dependencies with -Ylog-classpath.
A full rebuild may help if 'ACursors.class' was compiled against an incompatible version of scala.
def $main() = { ammonite.repl.ReplBridge.value.Internal.combinePrints(
^
Compilation Failed

seems to work now?
$ amm
Loading...
Welcome to the Ammonite Repl 2.4.1 (Scala 2.13.7 Java 11.0.7)
@ import $ivy.{
              `io.argonaut::argonaut:6.2.3`
              }

import $ivy.$

@ import argonaut._, Argonaut._
import argonaut._, Argonaut._


Zone

Finished the zone with alternatives, questions showed by its title.

This looks good. Wondering about the search terms being referenced to both the new descriptive title as well as the old IDs. Is this intentional?


Forceban Command

At the moment, we do not have a force ban command which means that people can only ban people from their guild.
Should we:

Add a force ban command which retrieves a user
Add a way for the current ban command to "force ban" a user

@weeryan17 Opinion please 😄

BAGSY

@binaryoverload we should add a force ban option to the current command. Perhaps if the end of the command contains -forceban then it'll force ban them?

I like the idea of implementing it into the ban command, but we need to find a good way to do it.

Maybe if we don't find the member in the guild but find a user we could tell them we couldn't find [user] in the guild would you like to force ban them? with a button. I believe we could even use confirm utils for this.

Thing is, I don't want to always be making requests to discord if the user doesn't exist in any of the guilds the bot is in cause that will end up being a lot of requests. This is why we originally used the forceban command as we would only make the request if the user wanted us to.

I mean we could look for them in the guild first and if they're not found their look to discord only if they provided an id

Could do yeah

@JamesHawkinss You okay to have a look at this?

I'll see what I can come up with :)

#67


TestResult.getEndMillis() returns 0 for skipped configuration - after upgrading testng to 7.0 +

TestNG Version

Note: only the latest version is supported

Expected behavior
TestResult.getEndMillis() should return the endtime for skipped configuration.
Actual behavior
TestResult.getEndMillis() returns 0 for skipped configuration.
Is the issue reproductible on runner?

[x] Maven

Test case sample
package com.logmein.piranha.macdriver.systemtests;

import org.testng.Assert;

import org.testng.annotations.BeforeClass;
import org.testng.annotations.BeforeMethod;
import org.testng.annotations.Test;
public class CalculatorTest  {
    /**
     * This is a very basic test that launches Calculator on Mac and performs an addition operation
     * and verifies the result.
     */
    @Test(description = "Simple calculator test.")
    public void calculatorUiTest() {

    }
    /**
     * Setup.
     */
    @BeforeClass
    public void setup() {
        // Fail this configuration

        Assert.assertTrue(false);
    }
    @BeforeMethod
    public void setup1() {
       //This configuration will be skipped.
    }
}

While creating report the method TestResult.getEndMillis() returns 0 for method setup1

@soumyathampi - What version of TestNG are you working with? Why would a skipped configuration have an endtime when it never even ran ?

I tried with TestNG 7.3. We add the duration of all methods in our report, which is calculated as StartTime-EndTime. EndTime is supposed to be same as Starttime, if it never ran. That was the behavior before and duration would be 0.

@soumyathampi - The latest released version of TestNG is 7.4.0. Please try that and post back the results.

Reproducible on TestNG 7.4.0 also.


Add donating instructions to the aid package page

Purpose

The purpose of this PR is to fix #325

Goals

Add donating instructions to the aid package page

Approach

Added donating instructions

Screenshots

Thanks for the PR @anjula-sack.
Could you please remove the description header as well?
#325 (comment)

done


Fixed Timer(timeInterval:,repeats:,block:) not accounting timeInterval for the first fire date.

https://github.com/OpenCombine/OpenCombine/blob/master/Sources/OpenCombineFoundation/Helpers/Portability.swift#L58-L64
It looks like this was a typo/something overlooked, but basically, this fire: Date() breaks at least every timer publisher like Timer.publish(every: timeInterval, on: .main, in: .default), as it basically results in the first event fired immediately vs in timeInterval. (Just in case, no, Combine does not fire that extra event).

LGTM

  Generated by :no_entry_sign: Danger Swift against adf53081b9d8a0389fa71456c29212fcd7f841f5


Support Using TestContainers for our Integration Tests

This PR adds a test suite utilizing TestContainers. It support spinning up docker compose stacks with all bacalhau components, thus resembling production setup.
This is not a complete TestSuite, but a big initial step towards consolidating out testing and evaluating TestContainers usage.
1- Allow us to run integration tests against a docker compose
deployment of bacalhau
2- Bacalhau compute/requestor configuration can be injected in the
container before start. We do not need to rebuild it every time
3- Tests are separated into suites which allows the combination of
similar tests together that will use the same docker compose
deployment. Help speed up things
4- Docker compose deployment has a local registry as well as a minio
server running. This expands out testing ability and scope.
5- Test Suite Works with Github Actions
Linear issue tracker: ENG-263
Github Issue: #4597

Closing For better PR wording.


[feature request] Expose metric aggregation information in segment metadata

Is this captured in the metadata database already and just a matter of surfacing it in the API call, or is it not captured outside of the segments themselves?

The rollup isn't captured in the segment metadata right now. However, we are adding support for this. This is actually a duplicate of https://github.com/druid-io/druid/issues/1514


fix(core): ensure consistent casing in resource names for access control

PR Checklist

[x] The commit message follows our guidelines: https://refine.dev/docs/guides-concepts/contributing/#commit-convention

Bugs / Features

[x] Related issue(s) linked
[ ] Tests for the changes have been added
[x] Docs have been added / updated
[ ] Changesets have been added https://refine.dev/docs/guides-concepts/contributing/#creating-a-changeset

What is the current behavior?
The current behavior intermittently lower cases resources due to inconsistent handling of resource names.
What is the new behavior?
The new behavior ensures consistent casing of resource names, addressing the issue of intermittent lower casing.
fixes #6004
Notes for reviewers

This PR addresses the intermittent issue where resource names were being lower-cased. The fix ensures consistent casing throughout the access control logic.

Hey @JayBhensdadia thanks for the PR! Can you add some tests to reproduce the problem, so we make sure these changes fixes the issue?

sure, i'll do that!

@BatuhanW
i have added tests
and ran across all four ui libraries (antd, chakra-ui, mantine, mui)
got consistent behaviour
please review!

Sure, I'll start working on it!

hey @aliemir
I've added the changeset for @refinedev/ui-tests and the UI packages as requested. Please review the updates. Thank you!

Sorry, I missed that change about versioned_docs !


Invalid area when using create_multipolygon()

Hi!
I have downloaded the latest pbf from http://osm-estratti.wmflabs.org/estratti/Lazio/Roma_Capitale/Roma and I am trying to convert leisure features in geojson format.
After geojsonfab = osmium.geom.GeoJSONFactory() and geojsonfab.create_multipolygon(feat) it works for almost all the node and way but with polygon id 2984683 I get the following message: "invalid area (area_id=5969367)". But if I visit http://polygons.openstreetmap.fr/?id=2984683 it can generate an apparently correct geoJson, and the place is the same.
I loaded the pbf using geojsonHandler.apply_file(sys.argv[1], locations=True, idx='sparse_mem_array').
I also noticed it is apparently not possible to create a geojson for relations, isn't it?
Thank you

This is just a guess, but might it be that you didn't get the full relation 2984683 with all its members from the place you downloaded the data from? https://www.openstreetmap.org/relation/2984683 is the relation and it looks to me like it is outside Rome mostly.


Possible bug in _beforeEvent() Base.ts?

Is this a bug?
https://github.com/6RiverSystems/blueshell/blob/c0685c0d170bf095d9c5bd5f767945ce016791ce/lib/nodes/Base.ts#L109
Note the comment and the code isParentNode(this) in Base.ts _beforeEvent() do not match:
// Reset the lastResult unless it was previously RUNNING and we're not a parent
if (nodeStorage.lastResult !== rc.RUNNING || isParentNode(this)) {
  nodeStorage.lastResult = '';
}

I believe the comment is correct and the code should be ! isParentNode(this).
Thoughts?

After reviewing the code again I believe it is correct. My BAD! Please disregard this PR.


Third-Party Sharing/Data Use

The only test and criteria under "Third-Party Sharing" are "Data use" and "The company explicitly discloses every way in which it uses my data." But then the indicators are about third-party sharing.
I would have separate tests for "Data use" and "Third-party sharing." An indicator under "Data use" could be "The company puts limits on the use of my data that are consistent with the purpose for which the data is collected." Or something like that to reflect reasonable use limitations.
For "Third-Party Sharing," I would expand beyond transparency, and include an indicator encouraging limitation: "The company only shares data as is reasonably necessary for the service to work."
The indicator around "types" of third parties could also be adjusted to encourage specific disclosure of service providers were possible.

I have also made related recommendations under purpose of data collection and use. Copy pasting here:
We should consider adding indicators on the purpose of information collection and use, in line with internationally recognized privacy principles (e.g., OECD Privacy Principles). Companies should specify the purpose of data collection and limit the subsequent uses to the fulfilment of the specified purposes. I recommend adding the following indicators under a new criterion in the privacy category.
•	The company clearly discloses its purpose for collecting user information.
•	The company clearly discloses its purpose for sharing user information.
•	The company clearly discloses that it limits its use of user information to the purpose for which it was collected.
•	The company clearly discloses the purpose for combining user information from various services (if it does combine).

I also agree that we need to need to go beyond "types" of third parties. Copy pasting my recommendation from another thread:
We should set a higher standard and expect companies to disclose both the types and the names of third parties with whom they share user information. Ranking Digital Rights, for example, has two indicators (called elements) that look for disclosure of the types and the names of third parties with whom the company shares user information.

Also reflected in Issue #25

Addressed original comment in pull request #128


fix: don't connect to Redis during build

LGTM :+1:

LGTM :+1:

@raminjafary Can you update package in npmjs?
https://www.npmjs.com/package/@raminjafary/nuxt-cache-module

@raminjafary Can you update package in npmjs?
https://www.npmjs.com/package/@raminjafary/nuxt-cache-module


Use boolean masks

It is possible to use a boolean mask, in place of the current mask which is always 0.0 or 1.0.
This also has the effect of reducing GPU memory usage.
No other changes are required, but the pretrained model "transformer.row_mask", "transformer.col_mask", and "transformer.conv_mask" can also be updated.

My GPU has 6 GB and memory is always at the limit when using the Malevich (XL) model on cuda.
For me, the change in #47 causes a repeatable CUDA out of memory error (#18).
The error goes away when using a boolean mask.


Error: No OpKernel was registered to support Op 'NcclAllReduce'

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): Custom code/ but copy from the stock example (nothing out of the ordinary)
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Win10 1903
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
TensorFlow installed from (source or binary): binary
TensorFlow version (use command below): 2.0.0
Python version: 3.7
Bazel version (if compiling from source): N/A
GCC/Compiler version (if compiling from source): N/A
CUDA/cuDNN version: 10.0/7.6
GPU model and memory: 4x GTX780ti 3GB each
Exact command to reproduce: model_distributed.fit(X_train, y_train, epochs=4, batch_size=25)

Describe the problem
Describe the problem clearly here. Be sure to convey here why it's a bug in TensorFlow or a feature request. 4x GPUs are recognised. but failed to train. The train on the CPU works well, but then when moving to do it with the distributed strategy shows the error below. I've uninstalled and re-installed "pip install tensorflow-gpu" twice. Updated drivers. nothing seems to help. Code below. Any help will be highly appreciated. Thanks.
import time
import numpy as np
import tensorflow as tf
print(tf.version)
(X_train, y_train), (X_test, y_test) = tf.keras.datasets.mnist.load_data()
X_train = X_train / 255.
X_test = X_test / 255.
X_train = X_train.reshape(-1, 2828)
X_test = X_test.reshape(-1, 2828)
model_normal = tf.keras.models.Sequential()
model_normal.add(tf.keras.layers.Dense(units=128, activation='relu', input_shape=(784,)))
model_normal.add(tf.keras.layers.Dropout(rate=0.2))
model_normal.add(tf.keras.layers.Dense(units=10, activation='softmax'))
model_normal.compile(optimizer='adam', loss='sparse_categorical_crossentropy', metrics=['sparse_categorical_accuracy'])
strategy = tf.distribute.MirroredStrategy()
print('Number of devices: {}'.format(strategy.num_replicas_in_sync))
with strategy.scope():
model_distributed = tf.keras.Sequential([
tf.keras.layers.Dense(units=128, activation='relu', input_shape=(784,)),
tf.keras.layers.Dropout(rate=0.2),
tf.keras.layers.Dense(units=10, activation='softmax'),
])
model_distributed.compile(loss='sparse_categorical_crossentropy',
optimizer=tf.keras.optimizers.Adam(),
metrics=['accuracy'])
start_time = time.time()
model_normal.fit(X_train, y_train, epochs=4, batch_size=25)
print("Normal training took: {}".format(time.time() - start_time))
start_time = time.time()
model_distributed.fit(X_train, y_train, epochs=4, batch_size=25)
print("Distributed training took: {}".format(time.time() - start_time))
Source code / logs
Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached. Try to provide a reproducible test case that is the bare minimum necessary to generate the problem.
2019-10-24 07:50:25.464075: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
2.0.0
2019-10-24 07:50:29.987980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library nvcuda.dll
2019-10-24 07:50:30.090327: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.15
pciBusID: 0000:01:00.0
2019-10-24 07:50:30.097223: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 1 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.0455
pciBusID: 0000:02:00.0
2019-10-24 07:50:30.104573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 2 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.0845
pciBusID: 0000:03:00.0
2019-10-24 07:50:30.111754: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 3 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.15
pciBusID: 0000:04:00.0
2019-10-24 07:50:30.118501: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2019-10-24 07:50:30.126709: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0, 1, 2, 3
2019-10-24 07:50:30.131151: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2019-10-24 07:50:30.809583: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.15
pciBusID: 0000:01:00.0
2019-10-24 07:50:30.816475: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 1 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.0455
pciBusID: 0000:02:00.0
2019-10-24 07:50:30.823594: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 2 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.0845
pciBusID: 0000:03:00.0
2019-10-24 07:50:30.831552: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 3 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.15
pciBusID: 0000:04:00.0
2019-10-24 07:50:30.839507: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2019-10-24 07:50:30.848211: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0, 1, 2, 3
2019-10-24 07:50:32.420376: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix:
2019-10-24 07:50:32.465449: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165]      0 1 2 3
2019-10-24 07:50:32.491610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 0:   N N N N
2019-10-24 07:50:32.494431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 1:   N N N N
2019-10-24 07:50:32.506160: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 2:   N N N N
2019-10-24 07:50:32.544545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 3:   N N N N
2019-10-24 07:50:32.572199: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2154 MB memory) -> physical GPU (device: 0, name: GeForce GTX 780 Ti, pci bus id: 0000:01:00.0, compute capability: 3.5)
2019-10-24 07:50:32.614321: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:1 with 2154 MB memory) -> physical GPU (device: 1, name: GeForce GTX 780 Ti, pci bus id: 0000:02:00.0, compute capability: 3.5)
2019-10-24 07:50:32.670375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:2 with 2154 MB memory) -> physical GPU (device: 2, name: GeForce GTX 780 Ti, pci bus id: 0000:03:00.0, compute capability: 3.5)
2019-10-24 07:50:32.725417: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:3 with 2154 MB memory) -> physical GPU (device: 3, name: GeForce GTX 780 Ti, pci bus id: 0000:04:00.0, compute capability: 3.5)
2019-10-24 07:50:33.211267: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.15
pciBusID: 0000:01:00.0
2019-10-24 07:50:33.310413: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 1 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.0455
pciBusID: 0000:02:00.0
2019-10-24 07:50:33.383430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 2 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.0845
pciBusID: 0000:03:00.0
2019-10-24 07:50:33.423598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 3 with properties:
name: GeForce GTX 780 Ti major: 3 minor: 5 memoryClockRate(GHz): 1.15
pciBusID: 0000:04:00.0
2019-10-24 07:50:33.446267: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2019-10-24 07:50:33.463455: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0, 1, 2, 3
2019-10-24 07:50:33.467760: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix:
2019-10-24 07:50:33.472212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165]      0 1 2 3
2019-10-24 07:50:33.475053: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 0:   N N N N
2019-10-24 07:50:33.478236: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 1:   N N N N
2019-10-24 07:50:33.481176: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 2:   N N N N
2019-10-24 07:50:33.486383: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 3:   N N N N
2019-10-24 07:50:33.492208: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/device:GPU:0 with 2154 MB memory) -> physical GPU (device: 0, name: GeForce GTX 780 Ti, pci bus id: 0000:01:00.0, compute capability: 3.5)
2019-10-24 07:50:33.501615: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/device:GPU:1 with 2154 MB memory) -> physical GPU (device: 1, name: GeForce GTX 780 Ti, pci bus id: 0000:02:00.0, compute capability: 3.5)
2019-10-24 07:50:33.510891: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/device:GPU:2 with 2154 MB memory) -> physical GPU (device: 2, name: GeForce GTX 780 Ti, pci bus id: 0000:03:00.0, compute capability: 3.5)
2019-10-24 07:50:33.520186: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/device:GPU:3 with 2154 MB memory) -> physical GPU (device: 3, name: GeForce GTX 780 Ti, pci bus id: 0000:04:00.0, compute capability: 3.5)
Number of devices: 4
Train on 60000 samples
Epoch 1/4
2019-10-24 07:50:35.783397: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cublas64_100.dll
2019-10-24 07:50:35.958561: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
2019-10-24 07:50:35.963318: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
2019-10-24 07:50:35.967782: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
2019-10-24 07:50:35.974357: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
60000/60000 [==============================] - 10s 165us/sample - loss: 0.2815 - sparse_categorical_accuracy: 0.9183
Epoch 2/4
60000/60000 [==============================] - 8s 132us/sample - loss: 0.1353 - sparse_categorical_accuracy: 0.9603
Epoch 3/4
60000/60000 [==============================] - 8s 133us/sample - loss: 0.1052 - sparse_categorical_accuracy: 0.9674
Epoch 4/4
60000/60000 [==============================] - 8s 131us/sample - loss: 0.0841 - sparse_categorical_accuracy: 0.9741
Normal training took: 33.73987317085266
Train on 60000 samples
Epoch 1/4
25/60000 [..............................] - ETA: 3:18:14Traceback (most recent call last):
File "c:\program files (x86)\microsoft visual studio\2019\community\common7\ide\extensions\microsoft\python\core\ptvsd_launcher.py", line 119, in
vspd.debug(filename, port_num, debug_id, debug_options, run_as)
File "c:\program files (x86)\microsoft visual studio\2019\community\common7\ide\extensions\microsoft\python\core\Packages\ptvsd\debugger.py", line 39, in debug
run()
File "c:\program files (x86)\microsoft visual studio\2019\community\common7\ide\extensions\microsoft\python\core\Packages\ptvsd_main_.py", line 316, in run_file
runpy.run_path(target, run_name='main')
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\runpy.py", line 263, in run_path
pkg_name=pkg_name, script_name=fname)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\runpy.py", line 96, in _run_module_code
mod_name, mod_spec, pkg_name, script_name)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\runpy.py", line 85, in _run_code
exec(code, run_globals)
File "C:\Users\Javier\Desktop\Personal files\VS\TensorFlow 2.0 Complete guide\distributed training.py", line 53, in
model_distributed.fit(X_train, y_train, epochs=4, batch_size=25)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\keras\engine\training.py", line 728, in fit
use_multiprocessing=use_multiprocessing)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\keras\engine\training_v2.py", line 324, in fit
total_epochs=epochs)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\keras\engine\training_v2.py", line 123, in run_one_epoch
batch_outs = execution_function(iterator)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\keras\engine\training_v2_utils.py", line 86, in execution_function
distributed_function(input_fn))
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\eager\def_function.py", line 457, in call
result = self._call(*args, **kwds)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\eager\def_function.py", line 520, in _call
return self._stateless_fn(*args, **kwds)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\eager\function.py", line 1823, in call
return graph_function._filtered_call(args, kwargs)  # pylint: disable=protected-access
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\eager\function.py", line 1141, in _filtered_call
self.captured_inputs)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\eager\function.py", line 1224, in _call_flat
ctx, args, cancellation_manager=cancellation_manager)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\eager\function.py", line 511, in call
ctx=ctx)
File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\tensorflow_core\python\eager\execute.py", line 67, in quick_execute
six.raise_from(core._status_to_exception(e.code, message), None)
File "", line 3, in raise_from
tensorflow.python.framework.errors_impl.InvalidArgumentError: No OpKernel was registered to support Op 'NcclAllReduce' used by {{node Adam/NcclAllReduce}}with these attrs: [reduction="sum", shared_name="c1", T=DT_FLOAT, num_devices=4]
Registered devices: [CPU, GPU]
Registered kernels:

     [[Adam/NcclAllReduce]] [Op:__inference_distributed_function_33245]

Press any key to continue . . .

Hi gadagashwini,
managed to get it to work if I replace "strategy = tf.distribute.MirroredStrategy()" with "strategy = tf.distribute.MirroredStrategy(cross_device_ops=tf.distribute.HierarchicalCopyAllReduce())".
But the performance is way slower than doing it directly on the CPU.
When on CPU only: 39secs
When on GPU:1 only: 18.5 secs
When on tf.distribute.mirrorstrategy(cross_device_ops=tf.distribute.HierarchicalCopyAllReduce()): 65 secs
When on tf.distribute.mirrorstrategy(cross_device_ops=tf.distribute.HierarchicalCopyAllReduce(), device=GPU:1): 21 secs
All GPUs are the same. a bit confused why this is happening and wondering is getting it to work with the NCCL will make any difference.
I did implemented the tf.config.experimental.set_memory_growth(device=GPUdevice,enable=True)... all I noticed was the GPU memory was not allocated 100%. apart from that no difference.
 I want to be able to have better performance over 4x GPUs than a single one.
  The main point is to take advantage of the peering connections and bypass the CPU / PCI, so even if you got it working (I suspect that you still have a misconfigured nccl, but unfortunately don't have time to debug your setup) I would expect that you would get similar performance to hierarchical copy because there's nothing a library can do but go through the host if there are no peering connections. A simple way to check this is with the tensorflow profiler (https://www.tensorflow.org/api_docs/python/tf/summary/trace_on?version=stable). If you see a giant block of reductions and cross device copies in the timeline, then you're probably device interconnect bound. Hope that helps.

This is fixed latest tf-nightly. Thanks!

Hi.  I am getting the same error, yet I am using the tf-nightly.  The workaround works for me as well.

tf.distribute.MirroredStrategy() uses NCCL in default. Apparently NCCL is not installed in your system, tha's why your have to change the call to tf.distribute.mirrorstrategy(cross_device_ops=tf.distribute.HierarchicalCopyAllReduce()). See the documentation about cross_device_ops parameter https://www.tensorflow.org/api_docs/python/tf/distribute/MirroredStrategy. can you confirm?

I'll give it a try.
On Tue, Sep 15, 2020 at 9:22 AM Hicham Bellafkir<EMAIL_ADDRESS>wrote:

tf.distribute.MirroredStrategy() uses NCCL in default. Apparently NCCL is
not installed in your system, tha's why your have to change the call to
tf.distribute.mirrorstrategy(cross_device_ops=tf.distribute.HierarchicalCopyAllReduce()).
See the documentation about cross_device_ops parameter
https://www.tensorflow.org/api_docs/python/tf/distribute/MirroredStrategy
http://url. can you confirm?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/33656#issuecomment-692710505,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AJLIJ7EXEDA6KEQV3J6F77DSF5TANANCNFSM4JEM4IXQ
.

@PepeLotudo,
With respect to this comment, can you please confirm if the issue is resolved? If you face problems please check if you have installed NCCL as mentioned in this comment. Thanks!

I dont know if it was fixed or not. Not using TF anymore. I moved to
pytorch.
Regards
On Mon, 31 May 2021, 20:17 rmothukuru, @.***> wrote:

@PepeLotudo https://github.com/PepeLotudo,
With respect to this comment
https://github.com/tensorflow/tensorflow/issues/33656#issuecomment-601958566,
can you please confirm if the issue is resolved? If you face problems
please check if you have installed NCCL as mentioned in this comment
https://github.com/tensorflow/tensorflow/issues/33656#issuecomment-692710505.
Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/33656#issuecomment-851451158,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ANPXRY7ZLGBLKWKEB4NLNJLTQN45JANCNFSM4JEM4IXQ
.

I will test it this week.
On Mon, Jun 7, 2021, 8:51 AM google-ml-butler[bot] @.***>
wrote:

This issue has been automatically marked as stale because it has not had
recent activity. It will be closed if no further activity occurs. Thank you.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/tensorflow/tensorflow/issues/33656#issuecomment-855897412,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AJLIJ7HMBMSOMZWYD727YXTTRS6FBANCNFSM4JEM4IXQ
.


Function that some windows like the create 911 call, do not close when you click outside the window with the mouse.

Describe the feature
I would wish that there is a function that certain important windows do not close when someone clicks outside the active window or at least the entered data is preserved.
Additional Context
No response

Duplicate of #928


Unable to use Powershell code containing the $ sign as value for the Text key of the KeyValuePairFile resource

Problem description
Hello,
I want to modify a .conf file using the KeyValuePairFile resource.
The key UserParameter in the .conf file should be the following powershell command:
Get-ChildItem -Recurse CERT:LocalMachine/My | ? { $_.NotAfter -lt (Get-Date).AddMonths(2) } | % { $s=$_.Subject -replace "CN=",""; $e=$_.NotAfter.ToString(); $l=$s+"|"+$e; write-output $l }
However, the resource fails to handle the $ sign, and the result is not as desired.
Expected result:
UserParameter=Get-ChildItem -Recurse CERT:LocalMachine/My | ? { $_.NotAfter -lt (Get-Date).AddMonths(2) } | % { $s=$_.Subject -replace "CN=",""; $e=$_.NotAfter.ToString(); $l=$s+"|"+$e; write-output $l }
Current result with the resource:
UserParameter=Get-ChildItem -Recurse CERT:LocalMachine/My | ? { # This is a configuration file for Zabbix agent 2 (Windows)...
I have the impression that as soon as the resource meets the $ sign, it replaces it with the content of the file.
Thank you.
Verbose logs
VERBOSE: [SRV]: LCM:  [ Start  Test     ]  [[KeyValuePairFile]ZabbixConf]
VERBOSE: [SRV]:                            [[KeyValuePairFile]ZabbixConf] Searching for key 'UserParameter' in file 'C:\Temp\zab.conf'.
VERBOSE: [SRV]: LCM:  [ End    Test     ]  [[KeyValuePairFile]ZabbixConf]  in 0.0490 seconds.
VERBOSE: [SRV]: LCM:  [ Start  Set      ]  [[KeyValuePairFile]ZabbixConf]
VERBOSE: [SRV]:                            [[KeyValuePairFile]ZabbixConf] Searching for key 'UserParameter' in file 'C:\Temp\zab.conf'.
VERBOSE: [SRV]:                            [[KeyValuePairFile]ZabbixConf] Key 'UserParameter' found in file 'C:\Temp\zab.conf' and has been updated.
VERBOSE: [SRV]: LCM:  [ End    Set      ]  [[KeyValuePairFile]ZabbixConf]  in 0.0780 seconds.
VERBOSE: [SRV]: LCM:  [ End    Resource ]  [[KeyValuePairFile]ZabbixConf]

DSC configuration
Configuration ZabbixConf{

    Import-DscResource -ModuleName PSDesiredStateConfiguration
    Import-DscResource -ModuleName FileContentDsc -moduleversion 2.0.0

    Node SRV {
        KeyValuePairFile ZabbAgent {
            Path = 'C:\Temp\zab.conf'
            Name = 'UserParameter'
            Ensure = 'Present'
            Text = 'Get-ChildItem -Recurse CERT:LocalMachine/My | ? { $_.NotAfter -lt (Get-Date).AddMonths(2) } | % { $s=$_.Subject -replace "CN=",""; $e=$_.NotAfter.ToString(); $l=$s+"|"+$e; write-output $l }'
        }
    }
}

Suggested solution
No :(
Operating system the target node is running
OsName               : Microsoft Windows 10 Enterprise
OsOperatingSystemSKU : EnterpriseEdition
OsArchitecture       : 64-bit
WindowsVersion       : 2009
WindowsBuildLabEx    : 19041.1.amd64fre.vb_release.191206-1406
OsLanguage           : en-US
OsMuiLanguages       : {en-US}

PowerShell version and build the target node is running
Name                           Value
----                           -----
PSVersion                      5.1.19041.1320
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.19041.1320
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>

FileContentDsc version
Name           Version   Path
----           -------   ----
FileContentDsc 2.0.0     <C:\Program Files\WindowsPowerShell\Modules\FileContentDsc\2.0.0\FileContentDsc.psd1>

Thanks for logging this @RidaLeFou. I haven't looked at this in detail, but it does look like the issue is in this line: https://github.com/dsccommunity/FileContentDsc/blob/main/source/DSCResources/DSC_KeyValuePairFile/DSC_KeyValuePairFile.psm1#L242 - and it should be fixable - although I haven't done any detailed examination of this. I suspect it's a behavior of the [regex]::Replace() method, but will need to do some digging. I'm super short on time at the moment, so if anyone else gets to it first. PRs welcome!


Added stats chart code cypress

Signed-off-by: Naman Chaturvedi<EMAIL_ADDRESS>Description
Added cypress  test case for stats chart
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.
@abasatwar @spattnaik

Codecov Report

Merging #988 (9519f20) into main (e8edc0c) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##               main     #988   +/-   ##
=========================================
  Coverage     71.87%   71.87%
  Complexity      291      291
=========================================
  Files            42       42
  Lines          2311     2311
  Branches        240      240
=========================================
  Hits           1661     1661
  Misses          509      509
  Partials        141      141

Flag
Coverage Δ

opensearch-observability
71.87% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Closing this PR as it is not needed any more .


ActiveRecord::StatementInvalid: PG::Error: ERROR:  prepared statement "a1" does not exist : INSERT INTO "synchronization_oauths"

https://rollbar.com/vizzuality/CartoDB/items/7790/
... 37 non-project frames
38
File "/home/ubuntu/www/production.cartodb.com/releases/20150610163456/app/models/carto/user.rb", line 187 in add_oauth
39
File "/home/ubuntu/www/production.cartodb.com/releases/20150610163456/app/services/carto/data_imports_service.rb", line 104 in validate_callback
40
File "/home/ubuntu/www/production.cartodb.com/releases/20150610163456/app/controllers/carto/api/imports_controller.rb", line 78 in service_oauth_callback
... 6 non-project frames
47
File "/home/ubuntu/www/production.cartodb.com/releases/20150610163456/app/controllers/application_controller.rb", line 54 in wrap_in_profiler
... 68 non-project frames

cc @rafatower @kartones

:+1:  :( but upgrading rails looks more of an issue in a near future


TruncateEnd property in Layout component is not truncating content with ellipsis.

Bug Report
Steps
The truncateEnd property in Layout component is just truncating the text without showing ellipsis.
Expected Result
The result that you expected.

Actual Result
The actual result that happened 💣

MitigationSteps
The truncateEnd property should have display:"block" instead of "flex" to truncate with ellipsis.

@vini-gupta - thanks for reporting this, it's something we should fix.
Here are some attempts and after that our resolution and solution.
Attempt no. 1: display: 'block' instead of display: 'flex' (proposed by @vini-gupta )
Using display: 'block' instead of display: 'flex' (or display: 'grid' for the main area) won't work for us because it'll break alignment of the items inside the start, main and end areas.
See: https://codesandbox.io/s/1rm85vyyl7

Attempt no. 2: Wrap ReactText (strings or numbers) in a span to achieve the ellipsis
Following https://css-tricks.com/flexbox-truncated-text/ article we could detect if the user passes string | number primitives to start, main and end areas and wrap them with a span.
However, we cannot do that because it'd imply that Layout component will have opinions on the elements we pass and the structure of the rendered DOM will change based on that. This contradicts Stardust principles.
Resolution
Since truncate* props (truncateStart, truncateMain, truncateEnd) failed to handle all truncation cases we decided to remove them from the API. We will do the same for ItemLayout. (BREAKING CHANGE)
Solution
Wrap the element that you need truncated with truncated Text component and pass that element to Layout's end slot
<Layout
  // ...
  truncateEnd // TODO: remove prop after it disappears from API
  end={<Text truncated>My long text that I need truncated</Text>}
/>

See complete code: https://codesandbox.io/s/pm4vn7j0mm