Retry on CreateCommitError?

See https://huggingface.co/datasets/diffusers/pokemon-gpt4-captions/discussions/1#65662af89593e6086aff9bed
I imagine that two steps tried to send a commit at the same time.
The error was:
{
    "error": "Commit 0/1 could not be created on the Hub (after 6 attempts).",
    "cause_exception": "HfHubHTTPError",
    "cause_message": "412 Client Error: Precondition Failed for url: https://huggingface.co/api/datasets/diffusers/pokemon-gpt4-captions/commit/refs%2Fconvert%2Fparquet (Request ID: Root=1-6565929c-547a1b5e442f9b9801ce82c4;f7b09dc5-dfe6-4889-bf81-50a6bebcd94b)\n\nA commit has happened since. Please refresh and try again.",
    "cause_traceback": [
        "Traceback (most recent call last):\n",
        ' File "/src/services/worker/.venv/lib/python3.9/site-packages/huggingface_hub/utils/_errors.py", line 270, in hf_raise_for_status\n response.raise_for_status()\n',
        ' File "/src/services/worker/.venv/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status\n raise HTTPError(http_error_msg, response=self)\n',
        "requests.exceptions.HTTPError: 412 Client Error: Precondition Failed for url: https://huggingface.co/api/datasets/diffusers/pokemon-gpt4-captions/commit/refs%2Fconvert%2Fparquet\n",
        "\nThe above exception was the direct cause of the following exception:\n\n",
        "Traceback (most recent call last):\n",
        ' File "/src/services/worker/src/worker/utils.py", line 205, in decorator\n return func(*args, **kwargs)\n',
        ' File "/src/services/worker/.venv/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn\n return fn(*args, **kwargs)\n',
        ' File "/src/services/worker/.venv/lib/python3.9/site-packages/huggingface_hub/hf_api.py", line 1150, in _inner\n return fn(self, *args, **kwargs)\n',
        ' File "/src/services/worker/.venv/lib/python3.9/site-packages/huggingface_hub/hf_api.py", line 3534, in create_commit\n hf_raise_for_status(commit_resp, endpoint_name="commit")\n',
        ' File "/src/services/worker/.venv/lib/python3.9/site-packages/huggingface_hub/utils/_errors.py", line 330, in hf_raise_for_status\n raise HfHubHTTPError(str(e), response=response) from e\n',
        "huggingface_hub.utils._errors.HfHubHTTPError: 412 Client Error: Precondition Failed for url: https://huggingface.co/api/datasets/diffusers/pokemon-gpt4-captions/commit/refs%2Fconvert%2Fparquet (Request ID: Root=1-6565929c-547a1b5e442f9b9801ce82c4;f7b09dc5-dfe6-4889-bf81-50a6bebcd94b)\n\nA commit has happened since. Please refresh and try again.\n",
        "\nThe above exception was the direct cause of the following exception:\n\n",
        "Traceback (most recent call last):\n",
        ' File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 913, in create_commits\n commit_info = retry_create_commit(\n',
        ' File "/src/services/worker/src/worker/utils.py", line 210, in decorator\n raise RuntimeError(f"Give up after {attempt} attempts. The last one raised {type(last_err)}") from last_err\n',
        "RuntimeError: Give up after 6 attempts. The last one raised <class 'huggingface_hub.utils._errors.HfHubHTTPError'>\n",
    ],
}

Done


ga_connector.py only send single response

Hi,
I have created an assistant in rasa which uses google assistant channel. I have scenarios where I need to utter multiple messages like "sure can do" and then send actual message. but I see ga_connector.py only uses first message and send it to assistant. Also buttons aren't working either. Please help updating connector.

Hi, I am having the same issue. Did you manage to find a fix? :)

Hi @ushannn, The connector has very basic features currently. Someone needs to write the connector to handle other scenarios.


[BUG][v1.7.0-rc1] Require unexpected long time to remount RWX volume after share manager restarted

Describe the bug
Test case test_rwx_delete_share_manager_pod failed on v1.7.0-rc1. Because after the share manager is deleted and restarted, An unexpected long time (> 700 seconds) is required for the workload to remount the RWX volume:
https://ci.longhorn.io/job/private/job/longhorn-tests-regression/7214/
To Reproduce
Run test case test_rwx_delete_share_manager_pod.
Expected behavior

Support bundle for troubleshooting
longhorn-tests-regression-7214-bundle.zip
Environment

Longhorn version: v1.7.0-rc1
Impacted volume (PV):
Installation method (e.g. Rancher Catalog App/Helm/Kubectl): helm
Kubernetes distro (e.g. RKE/K3s/EKS/OpenShift) and version: v1.30.0+k3s1

Number of control plane nodes in the cluster:
Number of worker nodes in the cluster:

Node config

OS type and version: sles 15-sp6
Kernel version:
CPU per node:
Memory per node:
Disk type (e.g. SSD/NVMe/HDD):
Network bandwidth between the nodes (Gbps):

Underlying Infrastructure (e.g. on AWS/GCE, EKS/GKE, VMWare/KVM, Baremetal):
Number of Longhorn volumes in the cluster:

Additional context

@c3y1huang Can you help check it? Thank you.
cc @james-munson

Investigation (WIP):
Regression from: https://github.com/longhorn/longhorn-manager/pull/2815
Suspicious logs:
2024-07-15T03:25:14.543851705Z time="2024-07-15T03:25:14Z" level=warning msg="Failed to unmount /var/lib/kubelet/pods/0b426d6e-1fca-4c5e-821b-072752b6dc68/volumes/kubernetes.io~csi/pvc-224655f6-117e-4129-84ba-a0e37c98c93c/mount during cleanup" func=csi.unmountAndCleanupMountPoint file="util.go:369" error="unmount failed: exit status 16\nUnmounting arguments: /var/lib/kubelet/pods/0b426d6e-1fca-4c5e-821b-072752b6dc68/volumes/kubernetes.io~csi/pvc-224655f6-117e-4129-84ba-a0e37c98c93c/mount\nOutput: umount.nfs4: /var/lib/kubelet/pods/0b426d6e-1fca-4c5e-821b-072752b6dc68/volumes/kubernetes.io~csi/pvc-224655f6-117e-4129-84ba-a0e37c98c93c/mount: device is busy\n"
2024-07-15T03:25:14.543862615Z time="2024-07-15T03:25:14Z" level=error msg="NodeUnpublishVolume: err: rpc error: code = Internal desc = failed to cleanup volume pvc-224655f6-117e-4129-84ba-a0e37c98c93c mount point /var/lib/kubelet/pods/0b426d6e-1fca-4c5e-821b-072752b6dc68/volumes/kubernetes.io~csi/pvc-224655f6-117e-4129-84ba-a0e37c98c93c/mount: unmount failed: exit status 16\nUnmounting arguments: /var/lib/kubelet/pods/0b426d6e-1fca-4c5e-821b-072752b6dc68/volumes/kubernetes.io~csi/pvc-224655f6-117e-4129-84ba-a0e37c98c93c/mount\nOutput: umount.nfs4: /var/lib/kubelet/pods/0b426d6e-1fca-4c5e-821b-072752b6dc68/volumes/kubernetes.io~csi/pvc-224655f6-117e-4129-84ba-a0e37c98c93c/mount: device is busy\n" func=csi.logGRPC file="server.go:136"

The remount eventually always succeeded after ~700 seconds.

@ejweber any ideas?

Verification passed on v1.7.x-head (longhorn-manager 2351239) and master-head (longhorn-manager b615732). Test case test_rwx_delete_share_manager_pod doesn't fail on corresponding Jenkins pipeline anymore.


PR: Add new "Plotting library" option, defaulting to Matplotlib (Variable Explorer)

Description of Changes
Added new option "Plotting library" to Variable Explorer plugin:

This allows to choose one of the compatible libraries (currently: matplotlib or guiqwt) for plotting data from the Variable Explorer. Until this PR, default plotting library was guiqwt (if installed) or matplotlib (if guiqwt was not found). This option works for the %varexp magic command (i.e. within currently running IPython kernel) and for nested arrays (i.e. within Spyder main process).
Affirmation
By submitting this Pull Request or typing my (user)name below,
I affirm the Developer Certificate of Origin
with respect to all commits and content included in this PR,
and understand I am releasing the same under Spyder's MIT (Expat) license.

I certify the above statement is true and correct:

Note: I'm marking this for Spyder 6 because it requires changes both in the kernel and Spyder to work. Those kind of changes are released on minor or major versions (e.g. 5.5.0 or 6.0.0), but the core team decided that we're not going to have more minor versions to try to release Spyder 6 sooner.


Remove non-API docs

This is the same as https://github.com/Qiskit/qiskit/pull/11352. Now that qiskit.org/ecosystem/ibm-provider redirects to docs.quantum.ibm.com, we can simplify the docs.
See the PR description in https://github.com/Qiskit/qiskit/pull/11352 for details on the motivation for each change.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 51.88%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
3422

Relevant Lines:
6596

💛  - Coveralls

Ready for review @kt474 (I'm not able to add reviewers)


MoE Models: option to add load balancing loss

This is the implementation of #1544
It optionally enables adding the load balancing loss (also aux_loss) of Mixture of Experts models in DPO, KTO, CPO or ORPO.
We are using this for a while now and in our experiments, the models that were fine-tuned using this option perform best at the moment. Maybe that applies to other project as well, so I wanted to open-source the idea and leave it to the users to enable it or not.
This option is simply enabled by setting output_router_logits=True in the MixtralConfig and optionally scale it with router_aux_loss_coef =...(default is 0.001)
@kashif @lewtun

thanks @claralp could you kindly also add something in the docs too?

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@kashif do you know why tests / tests (3.8, windows-latest) (pull_request)  is failing ? does not seems to be related to any of the changes in this PR

@kashif do you know why tests / tests (3.8, windows-latest) (pull_request)  is failing ? does not seems to be related to any of the changes in this PR

It is a HTTP timeout:
E   urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='cdn-lfs.huggingface.co', port=443): Read timed out. (read timeout=10)

For me this smells like a flaky test.

its a flakey teest i believe too


Polishing the CLI and methods

Polished the CLI with the help of rich. Also made some improvements to the testing suite
removed the update functionality and now using deploy since you can do the update using the deploy command also. is that okay?

/test-e2e-deploy sha=a01a7ee

/test-e2e-deploy sha=b6dbfb2

/help

/test-e2e-deploy sha=4caf765

/help

/help

/test-e2e-deploy sha=de6ed55


chore: add formats check

Codecov Report

Merging #317 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #317   +/-   ##
=======================================
  Coverage   86.99%   86.99%
=======================================
  Files           7        7
  Lines        1276     1276
=======================================
  Hits         1110     1110
  Misses        103      103
  Partials       63       63

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c5b05a6...4ce5572. Read the comment docs.


process does not exit

Tried different node versions, but doesn't help.
Using latest 3.6.0 gulp.
Running on latest OSX Mavericks.
Strange that on another laptop with Mountain Lion everything works.
I would guess that with such inconsistency it's hard to do something, but maybe someone can give me some tips regarding possible debugging of my situation. Maybe some console.log's would help is some gulp or orchestrator sources?
This is a similar issue:
https://github.com/gulpjs/gulp/issues/18
but in my case I am running as usual

@blopker
are you still using this fix?
gulp.task('default', ['build'], function() {
process.exit(0);
});
it works for me on Jenkins build, but I want to be sure if I can push this code as solved.
do you think I can leave it this way or I there is fix for this?

The fix is to return an async-done compatible value.
    b.bundle()
     .pipe(source('build.js'))
     .pipe(gulp.dest(__dirname + '/../public/js/'))
     .on('error', function (err) { console.error(err); });

should be returned: return b.bundle(). <...>;


Added Filament A60

Hi ...
Added Filament A60 according to specs in Issue request for A60
Also realized I had made a copy paste error on class name for last added G93 ... I apologize for that.
-- Gem

Awesome addition!


Matrix/List view has to be open for breadcrumbs trail to show

Makes sense, I just need to separate the two views into their own areas.
There is alot of overlap between the two view's functionality. Try find a way to reduce duplicate code. Maybe having a parent class which MatrixView and TrailView each extend

Fixed in 0.3.8


Add missing case to getOrderDisplayStatus

What I did
I've added a missing combined status placed:partially_refunded:not_required to allow trigger attributes on that type of order.
How to test

Checklist

[x] Make sure your changes are tested (stories and/or unit, integration, or end-to-end tests).
[ ] Make sure to add/update documentation regarding your changes.
[x] You are NOT deprecating/removing a feature.

included in #401


Warn when pages patterns overlapping with server routes

Context: @manniL / https://github.com/nuxt/nuxt/issues/25707
If there is a page pattern for rendering /foobar and also server/routes/foobar or (more commonly) a wildcard pattern, we shall warn users that it is happening.

Hey @pi0
I am attempting this as my first issue! I was looking through the codebase for the first time last night and I have some questions.
My plan was as follows

Find where the pages are being read and stored
Find where the routes are being read and stored
Find some sort of "build complete" lifecycle hook
Get both states into this hook
Call an algorithm that will check for any overlap in naming between pages and routes
Log a warning

I managed to find where the pages are stored inside Nuxt.apps context object that is being passed to the hook but I was unable to find any of the server routes. They must be being read somewhere but I couldn't find them inside the Nitro context object that is passed into build(nitro).
I don't want to arbitrarily read all the filenames if I am certain they are happening somewhere in the pipeline. My assumption is the reading is happening inside the nitropackage but I could be 100% incorrect on this!
My questions:

Where, if anywhere, can I find the server route names?
Does my plan sound like I am on the right track?
When you say a wildcard route can trigger the warning do you mean that server/api/[...].ts would cause an overlap with pages/foobar.vue and if that is the case would having this wildcard not overlap with every pages route in the root dir?

What would be awesome is when Nitro matches the route, have some way to abort handling the request and allow Nuxt to handle the request.
Example Route Structure
server/routes/[slug].get.ts
pages/index.vue
If the the param in [slug].get.ts in Nitro doesn't match a certain criteria, you should be able to defer handling the request to Nuxt and render index.vue

Does my plan sound like I am on the right track?

I don't know about that since I'm not familiar with the nuxt core, but I'd like to find that out as well and help if needed! I've come across this in one of my projects and think a warning would really help.

When you say a wildcard route can trigger the warning do you mean that server/api/[...].ts would cause an overlap with pages/foobar.vue and if that is the case would having this wildcard not overlap with every pages route in the root dir?

Testing around, I realised that server/routes/[...].ts doesn't work, while server/routes/test/[...].ts does. So one example is if you have server/routes/test/[...].ts and something like pages/test/foobar.vue.
I think that server/routes/[...].ts doesn't work is to prevent that someone blocks page rendering by accident, but wouldn't that also be worth a warning?
Thinking about it, there come more questions to my mind:

Would having something like server/routes/foobar.post.ts still be worth a warning? It would overlap with the path of pages/foobar.vue, but since the method is different, both will be accessible.
When someone uses a catch-all route for pages like pages/[...].vue, do we still want to have a warning? Effectively it will clash with every middleware route defined. A use case for that is if you have a CMS. The nuxt application doesn't know about the paths, it just sends them to the CMS. In that case you usually just have a couple of Nuxt pages or just this catch-all route. The warning would not be helpful here, so do we want to ignore this case?

What would be awesome is when Nitro matches the route, have some way to abort handling the request and allow Nuxt to handle the request.
[...]
A great use case would be a url shortner app. If the slug param isn't in the redirect database, render the index.vue page instead of a 404.

I feel like this would make things more complex than necessary. In your use case I would suggest to let the pages handle what is shown and create an endpoint in api rather then routes. If you want to handle redirects before the user enters the page, you can even add a router middleware that calls /api/some-slug and decides if the user should be redirected to home based on the result. I've done that in a chat application where I generated invitation links for chat rooms that are only available as long as someone is still in there.
But I also might be wrong here and my approach was not a best practice. So further thoughts to this topic are appreciated. :)

Thanks for the valuable feedback dear @Gonzo17. The warning should be for GET/HEAD/ALL handler collisions only you are right.
I am thinking more about it and it is probably worth more consideration, especially with Nitro v3 and the new router we have a chance to expose a hook that allows the Nuxt framework to predict renderer route match and actually merge two routers. (it definitely has a cost and i am trying to find a way to minimize it)


Make infer_schema! skip views

Rebased version of #374. Added some test migrations, will add actual tests later on.

@sgrif I'm not sure how to elegantly test the Postgres version. For SQLite we can just open a new :memory: database, create tables and views, and see that it works (i.e. ignore the views). For Postgres this is more tricky. Would it make sense to write compile-tests for this? Or do we just trust that it works based on the fact that we call infer_schema! in diesel_test and the migrations now include views?

You should be able to just create the view in a transaction and it'll be fine.

Added a simple test for postgres. Tell me if you want to have more.

Feel free to merge or squash-merge this as soon as travis likes it. I just pushed a revert for the migrations.


Not able to install Ruby 2.3.4 on MacOS 11.5.1

I have tried almost all the methods and nothing worked, hence opening this issue.

Can anyone please help.

I could install 2.3.8 with macOS 11.5.1
$ rbenv install 2.3.8
Installing openssl-1.0.2u...
Installed openssl-1.0.2u to /Users/hsbt/.local/share/rbenv/versions/2.3.8

Installing ruby-2.3.8...

WARNING: ruby-2.3.8 is past its end of life and is now unsupported.
It no longer receives bug fixes or critical security updates.

ruby-build: using readline from homebrew
lsInstalled ruby-2.3.8 to /Users/hsbt/.local/share/rbenv/versions/2.3.8

Same issue with 2.6.7.

Seems like I handled this issue, just run terminal using Rosetta like in this suggestion

I could install it with macOS 12.0.1 (Monterey).

If it is caused by M1 arch, it's duplicate of https://github.com/rbenv/ruby-build/issues/1691


Fix timestamp error in chat

Sometimes timestamp disappear in chat regardless of GIF feature that I'm developing.

Isn’t it intended? If the same time, then it doesn’t show it.


Template actions invoked more than one time in a request

Is your feature request related to a problem? Please describe.
I have a use case where a request is composed of a serie with N events. For example:
{
    "SerieID":"94083c9c-0683-4407-a00c-58b9787aca83",
    "Time":1597388282,
    "Events":[
        {
            "EventID":"8881c0cc-6d62-4d2a-9a81-36dbfd1e2f1c",
            "EventType":"credit",
            "ObjectKey":"f95f8288-8f1f-4338-bb68-53a1cd61c25f"
        },
        {
            "EventID":"6491b357-8163-4cc7-bc8c-af3b3c6b92f9",
            "EventType":"debit",
            "ObjectKey":"75221e12-bccb-4010-ac3e-41b0aa5f9dad"
        }
    ]
}

EventID must be unique, in a request.
I tried to pass the following parameter to ghz cli:
$ ghz ... -d '{"SerieID":"{{.UUID}}", "Time":"{{.Timestamp}}", "Events":[{"EventID":"{{.UUID}}", "EventType":"credit", "ObjectKey":"f95f8288-8f1f-4338-bb68-53a1cd61c25f"},{"EventID":"{{.UUID}}", "EventType":"debit", "ObjectKey":"75221e12-bccb-4010-ac3e-41b0aa5f9dad"}]}'
In my use case, each EventID must be unique. Reading the docs, I understood that UUID template action is unique for each call invocation/request.
Describe the solution you'd like
In a request, for each "{{.UUID}}", a new UUID is generated.
Describe alternatives you've considered
I tried to implement using the package, with "runner.WithDataFromReader". But WithDataFromReader reads all the stream at the start.
With few series (10K), it's ok, but with 500K, isn't feasible to load all the stream in memory.

@bojand could you take a look at this? maybe we are doing something wrong here and haven't noticed it yet

Hello, it would have been helpful to post the proto definition, as  I am not sure if I am understanding the issue and question correctly. But if I am understanding it right, the entire request message is like the JSON posted above. Given that, every call will get new template data and be filled with it. That is every request gets new data, new UUID in your case. We do not generate new template values for each occurrence of the template variable within the template. Hope this makes the distinction clear.
So provided data like:
{
  "SerieID": "{{.UUID}}",
  "Time": "{{.Timestamp}}",
  "Events": [
    {
      "EventID": "{{.UUID}}",
      "EventType": "credit",
      "ObjectKey": "f95f8288-8f1f-4338-bb68-53a1cd61c25f"
    },
    {
      "EventID": "{{.UUID}}",
      "EventType": "debit",
      "ObjectKey": "75221e12-bccb-4010-ac3e-41b0aa5f9dad"
    }
  ]
}

First call might get data like:
{
  "SerieID": "6d3a9ab1-7310-4964-8338-fdeb8c4b960f",
  "Time": "{{.Timestamp}}",
  "Events": [
    {
      "EventID": "6d3a9ab1-7310-4964-8338-fdeb8c4b960f",
      "EventType": "credit",
      "ObjectKey": "f95f8288-8f1f-4338-bb68-53a1cd61c25f"
    },
    {
      "EventID": "6d3a9ab1-7310-4964-8338-fdeb8c4b960f",
      "EventType": "debit",
      "ObjectKey": "75221e12-bccb-4010-ac3e-41b0aa5f9dad"
    }
  ]
}

2nd call we create will get new UUID:
{
  "SerieID": "3ded7836-b860-43cd-b88b-3ae78d67c834",
  "Time": "{{.Timestamp}}",
  "Events": [
    {
      "EventID": "3ded7836-b860-43cd-b88b-3ae78d67c834",
      "EventType": "credit",
      "ObjectKey": "f95f8288-8f1f-4338-bb68-53a1cd61c25f"
    },
    {
      "EventID": "3ded7836-b860-43cd-b88b-3ae78d67c834",
      "EventType": "debit",
      "ObjectKey": "75221e12-bccb-4010-ac3e-41b0aa5f9dad"
    }
  ]
}

and so on... The timestamp would be filled in and I am ignoring it for purpose of demonstration.
Note that request data for each call will get new template variable values. But just a single {{.UUID}} within the call will be generated.
If you desire a new uuid within a single call that's not something ghz can accomplish now. I think the simplest way we could support that would be to add a template function, something like newUUID. Where then the data would look like:
{
  "SerieID": "{{newUUID}}",
  "Time": "{{.Timestamp}}",
  "Events": [
    {
      "EventID": "{{newUUID}}",
      "EventType": "credit",
      "ObjectKey": "f95f8288-8f1f-4338-bb68-53a1cd61c25f"
    },
    {
      "EventID": "{{newUUID}}",
      "EventType": "debit",
      "ObjectKey": "75221e12-bccb-4010-ac3e-41b0aa5f9dad"
    }
  ]
}

And the newUUID function would be called each time to generate a new UUID.
Is this more in line to the behaviour you're looking for?

Hello this should be resolved in 0.58.0. Please see the changelog for details.

I tried to use now, and worked very well :-)
Thanks a lot for your help.


Support for aws-secretsmanager-jdbc Driver

https://github.com/aws/aws-secretsmanager-jdbc
We are using AWS Aurora RDS database. Credentials are stored in secret manager with automatic rotation. See this video for implementation details:
https://www.youtube.com/watch?v=gIbr6-AR6T8
We request to add aws-secretsmanager-jdbc driver in dependencies of the services where datasource is used.

You may close this issue as it is resolved after merging MR https://github.com/datahub-project/datahub/pull/5968


BUG FIX: should support react-dom 16 and 17

Description
The version of the peer dependency react-dom should be 16 || 17 instead of 17 || 17. This bug prevents projects using React Dom 16 from installing version 9.6.3.
References
Right version (9.6.0): https://github.com/wbkd/react-flow/commit/f835f85e65545ac87eb5bd2247a4ea1ebaee85ec
Changed to 17 only (9.6.1 ?): https://github.com/wbkd/react-flow/commit/290ba99f7048c04687255e4ff2cb175675d5432f
Got typo when you changed it back (9.6.3): https://github.com/wbkd/react-flow/commit/8c4ae0cb5deda608b990df7cf9c900baac3245e0
How Has This Been Tested?
This haven't been tested yet, but it should work 😄

argh .. how could this happen :D thanks!


Need to fix getNLCDdata()

COMIDs aren't linking explicitly for each site, need to update the background dataset to include some sites.

They are. Just some sites that don't have COMIDs that were throwing an error. Need to add a line to exclude NA values from dataset that feeds into the streamcat API.

Another issue: StreamCat updated column names to all caps, so need to update all code to match case change.


gutter shift when hovering the currently debugged line

debug with a breakpoint and hit the breakpoint
hover over the breakpoint
:bug: the breakpoint moves and I click a different icon

Duplicate https://github.com/microsoft/vscode/issues/180439


[BUG] The waiting timeout for creating interactive engine is not long enough.

Describe the bug
I have noticed some successfully launching of interactive instances during debugging CI that requires longer than 60 seconds (70+seconds before successing), could we increase the waiting limit to 2 minutes?
See: https://github.com/alibaba/GraphScope/blob/main/coordinator/gscoordinator/coordinator.py#L689
@lidongze0629  I'm not sure if there's any other timeout value that need to change to accomplish this goal.

See also #1019, I have no idea about why such unrelated changes makes GIE frontend slower....

Close as the timeout as been adjusted to 120 in #1044


Remove support for linter configuration that isn't @disable or args

There are too many ways to get the same effect. Linter config options like max-line-length put a mapping in between the user and the tool that doesn't need to be there. It's simply a shorthand for a command line argument that the user probably already knows about. Mappings like these make SublimeLinter harder to understand, harder to use and harder to maintain.

If executable winds up as being implemented in the core linter, it should obviously be excluded from this as well. (#653)

Well, after a short survey there doesn’t seem to be that many settings out there that are really problematic. The “shorthand” stuff is something to discourage, but I’m not going to waste too much energy on this.

I'm not sure I understand this sentiment.

Well, it’s a bit of a process for me, and it all comes down to simplifying settings for everyone. Most linter settings are actually useful. At the same time, having any settings at all for a fully configurable linter like Flake8 just confuses people and they should all go. So I don’t think I can force anything from this repo, but will continue to look into the other issue about settings and work on existing plugins to reduce the overload.

The thing is that many of the options available for linters are only specified that way in order to allow for inline overrides. There is no benefit from those otherwise. So this kind of depends on removing support for inline overrides altogether before they can be purged from the linters's options.

Well, there is stuff like the 'stric' setting in SublimeLinter-json where I can see its usefulness as a global or project setting.


The process '/usr/bin/tar' failed with exit code 1 -- file changed as we read it

There is not a clear approach on how to work around this or force it to tar up the files.
I've tried force killing the running process before calling actions/cache/save and it complains files are being changed. I don't understand how best to debug this but seems like with the compression program used.
There needs to be a verbose option to see what's happening under the hood to better understand why this fails the workflow.
/usr/bin/tar --posix -cf cache.tzst --exclude cache.tzst -P -C /home/github/actions-runner/_work/artifacts --files-from manifest.txt --use-compress-program zstdmt
/usr/bin/tar: artifacts/: file changed as we read it
Warning: Failed to save: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 1
Warning: Cache save failed.

Configuration used:
    - name: Save ${{ matrix.target }} Corpus
      if: always()
      uses<EMAIL_ADDRESS>      with:
        path: ${{ github.workspace }}/artifacts
        key: ${{ matrix.target }}-corpus-${{ github.run_id }}

Hello.
This problem seems to be caused by a change in the image used by ubuntu-latest.
https://github.com/actions/runner-images/issues/10636
There are many solutions, but since it seems that ubuntu 22 will be supported for 2 years, I decided to temporarily specify the ubuntu22 version
runs-on: ubuntu-22.04

Hello,
This issue may be caused by changes to the image used by ubuntu-latest.
https://github.com/actions/runner-images/issues/10636
There are many solutions, but since Ubuntu 22.04 will be supported for two years, I decided to temporarily specify Ubuntu 22.04.
runs-on: ubuntu-22.04


Swiping on apexcharts-card graph causes view to change

When dragging a custom:apexcharts-card graph to see more data, the view is changed. Can you kindly add an exception for Apex Charts?
My Apex Chart is inside another card so just in case I am providing the YAML of the whole thing:
type: custom:tabbed-card
tabs:
  - card:
      type: custom:apexcharts-card
      header:
        show: true
        title: Fridge
        show_states: true
        colorize_states: true
      yaxis:
        - id: temperature
          decimals: 1
          max: 10
          min: 0
        - id: humidity
          decimals: 0
          max: 100
          min: 0
          opposite: true
      apex_config:
        legend:
          show: false
      all_series_config:
        stroke_width: 2
        curve: smooth
      series:
        - entity: sensor.fridge_sensor_temperature
          yaxis_id: temperature
          name: Temperature
        - entity: sensor.fridge_sensor_humidity
          yaxis_id: humidity
          name: Humidity
          unit: '%Rh'
    attributes:
      label: Fridge
  - card:
      type: statistics-graph
      chart_type: line
      period: hour
      days_to_show: 2
      entities:
        - sensor.fridge_sensor_temperature
      stat_types:
        - mean
        - min
        - max
      card_mod:
        style:
          .: |
            h1 {
              font-size: 18px;
              padding: 2px 15px 2px 15px
            }
          statistics-chart$ha-chart-base$: |
            .chartLegend {
              display: none;
            }
    attributes:
      label: Temperature
  - card:
      type: statistics-graph
      chart_type: line
      period: hour
      days_to_show: 2
      entities:
        - sensor.fridge_sensor_humidity
      stat_types:
        - mean
        - min
        - max
      card_mod:
        style:
          .: |
            h1 {
              font-size: 18px;
              padding: 2px 15px 2px 15px
            }
          statistics-chart$ha-chart-base$: |
            .chartLegend {
              display: none;
            }
    attributes:
      label: Humidity

I didn't know apexcharts-card had the ability to drag the view to see more data. 🤔
Anyway, an update with the exception will come soon.

Please, test the last beta v1.8.1.


feat:add react native sdk for oss

add react native sdk for oss
(1) authoraztion
(2) bucket management
(3) upload
(4) download
(5) object management

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


adding ct and equinix packages to registry

second try at https://github.com/pulumi/registry/pull/1274

@ar4mirez are you able to add the docs in your repos? let me know if i can help in any way!!

@susanev thanks for checking, :D I've a little busy with work, but I'll make time to update my PR over the weekend.

gonna close this out, pls reopen once you have the time to make the changes. thank you!!


Error on Ember 3.5/3.6/3.7 -  Cannot set property placement of [object Object] which has only a getter

Output from ember bootstrap:info:
Npm packages:
ember-bootstrap: ^1.2.2 -> 1.2.2
ember-cli: ~3.8.1 -> 3.8.1
bootstrap: ^4.3.0 -> 4.3.1
bootstrap-sass: n/a
ember-cli-sass: ^7.1.7 -> 7.2.0
ember-cli-less: n/a
Bower packages:
bootstrap: n/a
bootstrap-sass: n/a
ember-bootstrap configuration:
bootstrapVersion: 4
importBootstrapFont: false
importBootstrapCSS: false

From a very preliminary investigation this seems to be stemming from ember-bootstrap's usage of ember-popper, and the attempt to assign to placement...

@vmalloc I must assume this is due to the quite old version of the addon you are using, and should have been fixed meanwhile, as our test suite does pass for latest Ember versions. Please try with the latest one (2.6), and feel free to reopen if the problem it still occurs!

@simonihmig That's strange, for some reason yarn upgrade-interactice did not suggest to upgrade ember-bootstrap :-/
Will try and report back. Thanks!

Seems to have worked. Thanks and sorry for your trouble!


Use variadic or in flip-coin

The or function is variadic, thus all conditions can be in a single expression instead of nested:
https://github.com/friedger/clarity-smart-contracts/blob/7813f54ec12d8e34d4cd37b8f73b81aad89e27d1/contracts/experiments/flip-coin.clar#L158-L162
=>
(define-private (even (value (buff 1)))
  (or (even1 value)
      (even2 value)
      (even3 value)
      (even4 value)))

Implemented in https://github.com/friedger/clarity-smart-contracts/commit/b917d82c462f7084b28dc5a6ab5a30dbb6693ecf


CHAPTER 11: 1CYCLE SCHEDUALER

Hi,
I have a problem with understanding the _interpolate function's details.
def _interpolate(self, iter1, iter2, rate1, rate2):
         return ((rate2 - rate1) * (self.iteration - iter1) / (iter2 - iter1) + rate1)

I understand it calculates and controls the shrinkage and growth of the learning rate; what I do not get is the mathematical detail that how it works!
any explanation about its math and also a bit of detail about its surroundings (the related parts of code) will be appreciated.

Hi @kasrahabib ,
Suppose the learning rate must be at rate1 at iteration iter1, and it must then change linearly until it reaches rate2 at iteration iter2. If it helps, give these variables some values, for example rate1=0.1, iter1=100, rate2=0.5 and iter2=300. Since the change is linear, we know that _interpolate() will return a value equal to a * self.iteration + b (a linear equation). The question is: what's the value of a and b? Well, we know that _interpolate() should return rate1 when self.iteration=iter1, and it should return rate2 when self.iteration=iter2, so:
a * iter1 + b = rate1
a * iter2 + b = rate2

If you subtract the first equation from the second, you get:
(a * iter2 + b) - (a * iter1 + b) = rate2 - rate1

which can be simplified to:
a * (iter2 - iter1) = rate2 - rate1

and therefore:
a = (rate2 - rate1) / (iter2 - iter1)

Great, we found a! Now let's find b by looking at the first equation again:
a * iter1 + b = rate1

We get:
b = rate1 - a * iter1

So we now have everything we need to define the _interpolate() function. As discussed above, it should return a * self.iteration + b. Let's start by replacing b with rate1 - a*iter1:
result = a * self.iteration + rate1 - a*iter1

Then we factor out a:
result = a * (self.iteration - iter1) + rate1

And lastly, we can replace a with the value we calculated above:
result = (rate2 - rate1) / (iter2 - iter1) * (self.iteration - iter1) + rate1

Which can be rewritten as:
result = (rate2 - rate1) * (self.iteration - iter1) / (iter2 - iter1) + rate1

Hope this helps.

Hi,
Thanks a lot.
So far I understand everything and it is much clear now.
Just one more thing: Why we subtract the equation 2 from equation 1?
I think I am the only one who asked a lot of questions.😁
I know you might be very busy, so I appreciate your time answering.
Thanks in advance! 😊

Hi,
Thanks a lot.
So far I understand everything and it is much clear now.
Just one more thing: Why we subtract the equation 2 from equation 1?
I think I am the only one who asked a lot of questions.😁
I know you might be very busy, so I appreciate your time answering.
Thanks in advance! 😊

Hi,
I know, I am the only one who asks a lot (several issues opened by me) of questions. 😁
The _interpolate() function is very clear now: just one further thing, why we subtract eq1 from eq2?
I know you are very busy, so I appreciate answering back! ☺
Thanks in advance!

Hi @kasrahabib ,
Since there's one b in equation 1, and one b in equation 2, if we subtract one equation from the other, it gets rid of b. This means we are left with one equation with one unknown variable a, and that's easy to solve. More generally, when you have N equations with N unknowns, the trick is to get rid of one variable at a time. Say there are five b in one equation, and seven b in another equation, you can get rid of b by multiplying the first equation by 7 (so there are now 35 b) and subtracting the second equation times 5 (so it also has 35 b).
If this is unclear, check out this Khan Academy course.
Hope this helps.

Hi @ageron,
Just kicked in.
I was completely forgotten about that part of linear algebra.
we are only doing the math to find a and b.
I was trying to relate that to something else and much bigger, even did not think about that part.


Create about page

Link to webpage, version, Open source licenses

Upload by Laurent Sutterlity from the Noun Project


Xiaomi Aqara motion sensor cannot be added

Home Assistant release with the issue:

0.90.0b1
Last working Home Assistant release (if known):
none
Operating environment (Hass.io/Docker/Windows/etc.):

Ubuntu Linux in virtualenv
Component/platform:

zha
Description of problem:
When trying to pair a Xiaomi Aqara motion sensor, no entities are created.  home-assistant.log shows
2019-03-15 13:59:41 INFO (MainThread) [homeassistant.components.zha.api] Permitting joins for 60s
2019-03-15 13:59:50 INFO (MainThread) [zigpy.application] Device 0x040f (00:15:8d:00:02:b7:f8:65) joined the network
2019-03-15 13:59:50 INFO (MainThread) [zigpy.device] [0x040f] Discovering endpoints
2019-03-15 13:59:50 INFO (MainThread) [zigpy.application] Device 0x040f (00:15:8d:00:02:b7:f8:65) joined the network
2019-03-15 13:59:51 ERROR (MainThread) [bellows.ezsp] Exception running handler
Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/ezsp.py", line 194, in handle_callback
    handler(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 160, in ezsp_callback_handler
    self._handle_frame(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 181, in _handle_frame
    tsn, command_id, is_reply, args = self.deserialize(device, aps_frame.sourceEndpoint, aps_frame.clusterId, message)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/application.py", line 74, in deserialize
    return sender.deserialize(endpoint_id, cluster_id, data)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/device.py", line 98, in deserialize
    return self.endpoints[endpoint_id].deserialize(cluster_id, data)
KeyError: 1
2019-03-15 13:59:51 ERROR (MainThread) [bellows.ezsp] Exception running handler
Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/ezsp.py", line 194, in handle_callback
    handler(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 160, in ezsp_callback_handler
    self._handle_frame(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 181, in _handle_frame
    tsn, command_id, is_reply, args = self.deserialize(device, aps_frame.sourceEndpoint, aps_frame.clusterId, message)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/application.py", line 74, in deserialize
    return sender.deserialize(endpoint_id, cluster_id, data)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/device.py", line 98, in deserialize
    return self.endpoints[endpoint_id].deserialize(cluster_id, data)
KeyError: 1
2019-03-15 13:59:53 ERROR (MainThread) [bellows.ezsp] Exception running handler
Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/ezsp.py", line 194, in handle_callback
    handler(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 160, in ezsp_callback_handler
    self._handle_frame(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 181, in _handle_frame
    tsn, command_id, is_reply, args = self.deserialize(device, aps_frame.sourceEndpoint, aps_frame.clusterId, message)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/application.py", line 74, in deserialize
    return sender.deserialize(endpoint_id, cluster_id, data)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/device.py", line 98, in deserialize
    return self.endpoints[endpoint_id].deserialize(cluster_id, data)
KeyError: 1
2019-03-15 13:59:53 ERROR (MainThread) [bellows.ezsp] Exception running handler
Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/ezsp.py", line 194, in handle_callback
    handler(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 160, in ezsp_callback_handler
    self._handle_frame(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 181, in _handle_frame
    tsn, command_id, is_reply, args = self.deserialize(device, aps_frame.sourceEndpoint, aps_frame.clusterId, message)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/application.py", line 74, in deserialize
    return sender.deserialize(endpoint_id, cluster_id, data)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/device.py", line 98, in deserialize
    return self.endpoints[endpoint_id].deserialize(cluster_id, data)
KeyError: 1
2019-03-15 13:59:54 ERROR (MainThread) [bellows.ezsp] Exception running handler
Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/ezsp.py", line 194, in handle_callback
    handler(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 160, in ezsp_callback_handler
    self._handle_frame(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 181, in _handle_frame
    tsn, command_id, is_reply, args = self.deserialize(device, aps_frame.sourceEndpoint, aps_frame.clusterId, message)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/application.py", line 74, in deserialize
    return sender.deserialize(endpoint_id, cluster_id, data)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/device.py", line 98, in deserialize
    return self.endpoints[endpoint_id].deserialize(cluster_id, data)
KeyError: 1
2019-03-15 13:59:56 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=244 command=32773 args=[<Status.SUCCESS: 0>, 1039, [1]]
2019-03-15 14:00:00 ERROR (MainThread) [bellows.ezsp] Exception running handler
Traceback (most recent call last):
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/ezsp.py", line 194, in handle_callback
    handler(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 160, in ezsp_callback_handler
    self._handle_frame(*args)
  File "/srv/homeassistant/lib/python3.6/site-packages/bellows/zigbee/application.py", line 181, in _handle_frame
    tsn, command_id, is_reply, args = self.deserialize(device, aps_frame.sourceEndpoint, aps_frame.clusterId, message)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/application.py", line 74, in deserialize
    return sender.deserialize(endpoint_id, cluster_id, data)
  File "/srv/homeassistant/lib/python3.6/site-packages/zigpy/device.py", line 98, in deserialize
    return self.endpoints[endpoint_id].deserialize(cluster_id, data)
KeyError: 1
2019-03-15 14:00:01 INFO (MainThread) [zigpy.device] [0x040f] Discovered endpoints: [1]
2019-03-15 14:00:01 INFO (MainThread) [zigpy.endpoint] [0x040f:1] Discovering endpoint information
2019-03-15 14:00:06 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=1 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:00:06 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:00:07 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=246 command=32772 args=[<Status.SUCCESS: 0>, 1039, <SimpleDescriptor endpoint=1 profile=260 device_type=263 device_version=1 input_clusters=[0, 65535, 1030, 1024, 1280, 1, 3] output_clusters=[0, 25]>]
2019-03-15 14:00:13 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=2 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:00:13 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:00:14 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=247 command=32772 args=[<Status.SUCCESS: 0>, 1039, <SimpleDescriptor endpoint=1 profile=260 device_type=263 device_version=1 input_clusters=[0, 65535, 1030, 1024, 1280, 1, 3] output_clusters=[0, 25]>]
2019-03-15 14:00:19 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Failed ZDO request during device initialization: Message send failure: EmberStatus.DELIVERY_FAILED
2019-03-15 14:00:22 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=0 command=266 args=b'\x00\x00!3\x00'
2019-03-15 14:00:22 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:00:22 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=1 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:00:22 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:00:25 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=2 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:00:25 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:00:32 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=3 command=266 args=b'\x00\x00!2\x00'
2019-03-15 14:00:32 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:00:32 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=4 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:00:32 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:00:35 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=5 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:00:35 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:00:41 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=6 command=266 args=b'\x00\x00!!\x00'
2019-03-15 14:00:41 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:00:41 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=7 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:00:41 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:00:47 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=8 command=266 args=b'\x00\x00!\x1e\x00'
2019-03-15 14:00:47 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:00:47 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=9 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:00:47 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:00:49 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=10 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:00:49 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:00:55 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=11 command=266 args=b'\x00\x00!M\x00'
2019-03-15 14:00:55 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:00:55 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=12 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:00:55 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:01:00 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=13 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:01:01 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:01:05 INFO (MainThread) [homeassistant.components.http.view] Serving /api/websocket to <IP_ADDRESS> (auth: False)
2019-03-15 14:01:06 INFO (MainThread) [homeassistant.components.http.view] Serving /manifest.json to <IP_ADDRESS> (auth: False)
2019-03-15 14:01:09 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=14 command=266 args=b'\x00\x00!C\x00'
2019-03-15 14:01:09 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:09 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=15 command=266 args=b'\x00\x00!C\x00'
2019-03-15 14:01:09 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:09 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=16 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:01:09 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:01:15 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=17 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:01:15 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:01:22 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=18 command=266 args=b'\x00\x00!V\x00'
2019-03-15 14:01:22 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:22 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=19 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:01:22 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:01:28 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=20 command=266 args=b'\x00\x00!S\x00'
2019-03-15 14:01:28 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:28 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=21 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:01:28 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:01:34 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=22 command=266 args=b'\x00\x00!O\x00'
2019-03-15 14:01:34 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:34 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=23 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:01:34 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:01:35 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=24 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:01:35 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:01:43 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=25 command=266 args=b'\x00\x00!i\x00'
2019-03-15 14:01:43 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:44 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=26 command=266 args=b'\x00\x00!e\x00'
2019-03-15 14:01:44 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:44 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=27 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:01:44 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:01:45 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=28 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:01:45 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:01:53 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=29 command=266 args=b'\x00\x00!h\x00'
2019-03-15 14:01:53 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:55 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=30 command=266 args=b'\x00\x00!g\x00'
2019-03-15 14:01:55 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:56 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=31 command=266 args=b'\x00\x00!\\\x00'
2019-03-15 14:01:56 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:01:56 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=32 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:01:56 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:02:02 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=33 command=266 args=b'\x00\x00!A\x00'
2019-03-15 14:02:02 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:04 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=34 command=266 args=b'\x05\x00B\x16lumi.sensor_motion.aq2'
2019-03-15 14:02:04 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0000
2019-03-15 14:02:10 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=35 command=266 args=b'\x00\x00!O\x00'
2019-03-15 14:02:10 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:10 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=36 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:02:10 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:02:16 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=37 command=266 args=b'\x00\x00!P\x00'
2019-03-15 14:02:16 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:16 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=38 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:02:16 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:02:22 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=39 command=266 args=b'\x00\x00!C\x00'
2019-03-15 14:02:22 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:22 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=40 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:02:22 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:02:27 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=41 command=266 args=b'\x00\x00!]\x00'
2019-03-15 14:02:27 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:27 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=42 command=266 args=b'\x00\x00\x18\x01'
2019-03-15 14:02:27 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0406
2019-03-15 14:02:34 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=43 command=266 args=b'\x00\x00!<\x00'
2019-03-15 14:02:34 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:36 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=44 command=266 args=b'\x00\x00!4\x00'
2019-03-15 14:02:36 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:39 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=45 command=266 args=b'\x00\x00!3\x00'
2019-03-15 14:02:39 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:41 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=46 command=266 args=b'\x00\x00!1\x00'
2019-03-15 14:02:41 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:43 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=47 command=266 args=b'\x00\x00!1\x00'
2019-03-15 14:02:43 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:45 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=48 command=266 args=b'\x00\x00!1\x00'
2019-03-15 14:02:45 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:47 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=49 command=266 args=b'\x00\x00!0\x00'
2019-03-15 14:02:47 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:49 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=50 command=266 args=b'\x00\x00!2\x00'
2019-03-15 14:02:49 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400
2019-03-15 14:02:51 WARNING (MainThread) [bellows.zigbee.application] Unexpected response TSN=51 command=266 args=b'\x00\x00!0\x00'
2019-03-15 14:02:51 WARNING (MainThread) [zigpy.endpoint] [0x040f:1] Message on unknown cluster 0x0400

Problem-relevant configuration.yaml entries and (fill out even if it seems unimportant):

Traceback (if applicable):

Additional information:
I have to long press the button on the motion sensor to reset it and force it to leave the network in order to stop the repeating log messages above.

Xiaomi devices could be tricky to join, because they tend to be slow responding, especially if connected through another zigbee router.
Device joined at 13:59:50 but only discovered the endpoint at 14:00:01 after you stopped pressing the button to keep xiaomi awake, so it failed to complete the discovery of the endpoint.
Try a few more times, with reseting of xiaomy by holding the button over 5s. Once you see in the logs Device 0xxxxx (00:15:8d:00:02:b7:f8:65) joined the network , keep short pressing the button, about once aver 1.5s-2s especially after you get [0x040f:1] Discovering endpoint information line in the log.
You do get the response from the device, it just coming a tad too late. Pressing the button keeps the device awake  and you get better chances for zigpy to discover the device.

Xiaomi devices could be tricky to join, because they tend to be slow responding, especially if connected through another zigbee router.
Device joined at 13:59:50 but only discovered the endpoint at 14:00:01 after you stopped pressing the button to keep xiaomi awake, so it failed to complete the discovery of the endpoint.
Try a few more times, with reseting of xiaomy by holding the button over 5s. Once you see in the logs Device 0xxxxx (00:15:8d:00:02:b7:f8:65) joined the network , keep short pressing the button, about once aver 1.5s-2s especially after you get [0x040f:1] Discovering endpoint information line in the log.
You do get the response from the device, it just coming a tad too late. Pressing the button keeps the device awake and you get better chances for zigpy to discover the device.
PS: I know you were short pressing it (the KeyError: 1 in the logs) but did you stop right after 10s at 14:00:00 ? Just when it got the number of endpoints, but not the endpoint info

Yeah I was trying to work this sensor the same as I had done with the Xiaomi Aqara vibration, weather, and leak sensors.  I'd hit the button once every 5s or so.  I just tried increasing the button push frequency on the motion sensor to once ever 1.5s-2s, and it paired successfully.
At 14:00:00 I would have still been doing 1 press every 5s or so.  I try to keep that up until the 60s on the permit runs out.
So the motion sensor seems a little more finicky than the others, but it works now. thanks!

Excelent!


Update loop syntax for arrays and objects, deprecate $index and $key

Deprecating $index and $key
Both of these are being deprecated in favor of more explicit named indices and keys. This syntax is a bit magical and has limitations in nested loops. As a bonus, there will be two fewer points of syntax for newcomers to learn.
New array syntax

value in arr
(value, index) in arr (switched order of arguments to be more consistent with JavaScript's forEach and map)

New object syntax

value in obj
(value, key) in obj (switched order of arguments, partly to be more consistent with many common object iterators, such as lodash's)
(value, key, index) in obj (index will now be available in object iteration for visual purposes, such as table striping)

How would this be supported in 2.0-migration?

@simplesmiler as of now I don't think it's feasible to provide a "seamless" migration build like the 0.12 to 1.0 upgrade, due to how much underlying implementations have changed. The deprecation warnings will mostly be used for features that can be simulated.

@yyx990803
I believe this can be simulated in 2.0-migration by adding an optional parameter oldArgsOrder which defaults to true in 2.0-migration build and false in 2.0 build.
This is how it will work:

2.0-migration build, using 1.0 syntax will give warnings to switch order and use oldArgsOrder = false, default is true in this build.
In 2.0 build, using oldArgsOrder parameter will encourage new syntax as default and mark this feature as deprecated for 3.0+

It certainly does not look like elegant but I prefer it over no seamless-migration build.

@prog-rajkamal hmm, that's a good idea. Toggle between incompatible interfaces using flags would definitely make a migration build more feasible.


new blank rules - move "any" to top of list

@jim-p wanted this split out from PR #3139 as it wasn't related to that PR.
Users should not have to search for the "any option in the list of protocols. This moves "any" at the logical place people look for it (top of list not 2/3 down it at rafields default = tcp and extra ports etc fields visible.
Will probably need debasing after previous PR merged, but will deal with that at the time.

Change looks good, but perhaps gettext("Any") (capital 'A') would be better still. All the other options in the selector have caps.


create a content card

One need to make this component using HTML and Tailwind CSS. I would suggest to use Tailwind Playgrounds to make things faster and quicker.
Here is a reference to the component.

After building the component please raise a PR with a screenshot of the component and add the component in path of the file.
If you need to use any icon please use it from Hero Icons
Good luck.

i want to work on this issue under jwoc

I am interested to work on this under JWOC, can u assign me this issue?

@bhumi-125 It is already completed https://github.com/Clueless-Community/seamless-ui/blob/main/Content Cards/src/content-card-2-white.html


Part type detection breaks with '>' in attribute content

Lit fails to correctly parse the type of the following part:
html`<div a=">" b=${0}></div>`

This is because to detect the part type, lit checks the last occurrence of a < character, and tests if it is proceeded by a > character to check if the last HTML tag has been closed. This does not work in the above case, because the string
" b= has a > character after the last < character. In this example the ${0} part is incorrectly identified as a NodePart.
More generally, if any > character occurs inside an attribute before an AttributePart on the same Node, lit incorrectly identifies that part as a NodePart.
Here is a reproduction
I have not found an easy solution to this problem yet.

The solution I am pursuing is changing the node marker tag to something like this:
`<!--${nodeMarker} " ${brokenMarker} -->`

When a node contains the value of brokenMarker as a boolean attribute, I know that the above issue has occurred, and I can raise an error. The above tag works both if the attribute that is escaped is and is not surrounded with ", so it works in both of the following cases:

" attr=${0}>

" attr="${0}">

I haven't found a way to gracefully fix the situation, but at least this reliably detects it without any overhead.

There are lots of ways to write broken templates. While it'd be great to catch all of these at runtime, it's a tradeoff on difficult and cost. I'm pretty comfortable saying that users need to use > in place of > in attribute value literals. I think a static linter can catch these errors more reliably.

I have done some research on this problem specifically and I think there is no good solution. The best we can do is detect it at runtime if you accept some limitations to attributes (no surrounding "), but without a full HTML parser it is not possible to fix at runtime.
Fixing it through linter is a good idea.

With a rule in eslint-plugin-lit, I think we'll be good here, or as good as we can be for now. I'm going to close this to track for the upcoming releases. Thanks for the report!


Allow enabling all rules in rule set

Expected Behavior
There should be a way either with the configuration file or the API to enable all rules in a rule set, rather than having to write each one in the yaml file.
Current Behavior
My only options are:

Manually add all custom rules to both my RuleSetProvider and my yaml file.
Use the gradle property allRules  = true, which would enable tons of rules that I do not want.

Context
I am creating a custom rule set. I have to add the list of rules to my custom RuleSetProvider as well as to my configuration file, which is redundant. There is a risk that I will add a rule to the RuleSetProvider, but forget to add it in the yaml file.
Is there a way to make all the rules for my custom RuleSetProvider enabled by default, either in the API or config? This would need to be on a per-ruleset basis and not affect other rulesets as allRules=true would.

Nope there is no easy way for doing that.

Manually add all custom rules to both my RuleSetProvider and my yaml file.

What's wrong with this approach?

🤔 for custom rules you should provide your own default configuration. Here you have an example: https://github.com/BraisGabin/detekt-compiler-rules/blob/main/src/main/resources/config/config.yml
If you do that in the consumer side they should do nothing to enable the rules. The detekt-generator cli should help to automatically create this file. But I think that no too much people are using it right now so it can be a bit buggy for third parties. But we are willing to improve that tool. So any issue is more than welcome. We want to improve development experience for third party rule authors.


DISCUSSION: Improve Dataset docs

See #704 for context.
Pro: Putting example use cases directly in Dataset docs
Con: Bitrot when the referenced code changes

Closing this as #911 due to lost steam

Closing this as #911 due to lost steam


part of migration to TRAPI 1.3: API_LIST and Smartapi yamls

The TRAPI KPs that we use may put their TRAPI 1.3 tools in separate registrations.
Then in our code for TRAPI 1.3 (currently on the trapi1.3 branches), we then want to change our API_LIST entries to point to the TRAPI 1.3 registrations.
This involves ~ weekly checking the SmartAPI registry for the APIs we ingest, currently Automat stuff, COHD, and CHP...

and a related thing...having copies of our own SmartAPI yamls updated for TRAPI 1.3:
Can have trapi1.3 branch in registry + bte-trapi: modify the registration yamls for TRAPI 1.3
set additional properties on QNode/QEdge to false

And an easy way to track what KP tools there are and their x-maturity levels and urls and what trapi version they are https://arax.ncats.io/?smartapi=1

done for now, 8/9. see commits in bte-trapi repo trapi1.3 branch from this day.

Made more edits due to changes to the COHD registrations and deciding to add BTE/Service Provider TRAPI1.3 registrations...
see commits from this day in bte-trapi for the main branch and trapi1.3 branch...

On our own smartapi yamls (BTE and Service Provider), we may want to continue watching for TRAPI 1.3 updates. However, this can be a separate on-hold issue...
I have updated the original yamls, so they are on TRAPI 1.3 and list all server instances. I deleted the temporary yaml files / registrations that were for advertising TRAPI 1.3 on the development server only (when the other instances were TRAPI 1.2).

Currently, we are using TRAPI 1.3 APIs on all TRAPI KPs that we ingest.

COHD's TRAPI 1.3 registration has all the expected server urls (ITRB prod/test/ci and non-ITRB dev)
CHP's registration has become TRAPI 1.3 now. And it has 3 ITRB server urls...but their x-maturity levels for ITRB test/ci seem incorrect. Slack messaging them here (internal Translator link).
Automat still has separate registrations for all server urls. Currently we're still using the correct urls (which have TRAPI 1.3 and are development/non-ITRB).

Perhaps we can keep this issue open until we get clarification on what Automat is going to do...


Installation query

I was trying to configure green API in my home assistant. I got struck at following step. Can you tell me which files I need to download. If possible can you provide some screenshots.
"Download the green-api-custom-notifier, place it under the custom_components folder"

I managed to figure it out. I created a folder named greenapi inside the custom_components directory, then downloaded the zip file, navigated to the greenapi folder inside, and uploaded the files into the folder I created. After checking the configuration and restarting Home Assistant, I added the configuration and restarted again. It worked fine after that. Earlier, I got an error when I tried updating the configuration without restarting, but everything looks good now.

I managed to figure it out. I created a folder named greenapi inside the custom_components directory, then downloaded the zip file, navigated to the greenapi folder inside, and uploaded the files into the folder I created. After checking the configuration and restarting Home Assistant, I added the configuration and restarted again. It worked fine after that. Earlier, I got an error when I tried updating the configuration without restarting, but everything looks good now.


JSDoc hover disapper after upgrading langium from 1.0.1

Langium version:1.2.0
Package name: langium
Steps To Reproduce

It used to have the JsDoc hover hint by default when using langium 1.0.1.  After upgrading to 1.1.0, it's gone.   It is still not there even after upgrading to 1.2.0.
Is there any place we need to manually turn on it now?

I cannot reproduce this issue on 1.2.0:

Can you give some better reproduction steps for this issue?

@msujew,  after taking a deep look, I found that JSdoc comments require two stars in the beginning line, whereas in our code we only use one star, which I don't know why it was working in langium 1.0.1.
Anyway, thanks for the efforts on it, and sorry for the trouble, I will update our code instead.

Right, the old version didn't follow JSDoc at all. It basically just stripped the /*, * and */ symbols and displayed everything in between in the hover. The new JSDoc parser actually follows the spec and therefore requires /** at the start. You can change that if you like though. You just need to override the DocumentationProvider.


Add song genre field

Based on @sorianog work.
I've added a table with genres, a list of those can be fetched via it's own api endpoint.
Endpoints responding with a song should now also respond with a genreId and a text genre.
Frontend has been updated to ask for an genre on upload, which has to be set. Will default to the first item at the moment.
Genres will also be shown on each song item in the frontend.
I did not test what happens with songs that have no genre set, so that might cause problems at the moment.
There is also no way to change a genre on an already uploaded song.

Fixed the layout and added editing for already created songs.
We do need to figure out how to migrate the old songs. Give them a genre "None" by default and don't let anyone save new Songs with that genre.

Rebased and added another commit that handles the migration from not having any genres on songs to having to add them.
We initially set the values in our database to null, but enforce setting genre via all the frontends.
I've tested this locally migrating a database with a song from development to this version. I was able to successfully do that and add a genre on that song.
As far as I know this should be everything that's needed.

Conflict resolved.


This program using recurse hogs CPU and memory when compiled to AGC

When I alan compile to AGC and then alan run the following program, the alan process starts taking a huge amount of CPU and memory, starting to crash my computer before I terminate the process. The problem is caused by the executions on the last print line. The program works correctly when compiled for JS and ran with node. The problem is not resolved by changing triangularRec to from inline to 'bracketed' function syntax.
import @std/app
from @std/seq import seq, Self, recurse

fn triangular(x: int) : int = div(x ** 2 + x, 2)

fn triangularRec(x: int) : int = seq(x).recurse(fn (self: Self, x: int) : Result<int> {
    if x == 0 {
        return ok(x)
    }
    else {
        return ok(x + (self.recurse(x - 1) || 0))
    }
}, x) || 0

on app.start {
    app.print(triangularRec(1)) // 1
    app.print(triangularRec(2)) // 3
    app.print(triangularRec(3)) // 6

    const xs = [1, 2, 3]
    app.print(xs.map(triangular).map(toString).join(" ")) // 1 3 6
    app.print(xs.map(triangularRec).map(toString).join(" ")) // 1 3 6 with js, problem with agc

    emit app.exit 0
}

There were actually two bugs in here that caused problems. After I fixed the main bug that was causing the infinite looping (not updating the recursion termination check correctly in parallel situations) I was getting weird results. The output from the AVM was 1 4 9 instead of 1 3 6.
It was adding the original number n times instead of decrementing it as expected.
While trying to debug that, I realized there was another bug with setting up the arguments for the recursive function itself that could cause the wrong value to be pulled, and it was pulling an array value and placing it where the code expects a fixed numeric value.
After I fixed that, I realized that that sort of bug should've prevented the code from working at all, and then I finally realized there's an aliasing issue in the ammtoaga layer of the compiler. triangularRec aliases the x variable, but the scope evaluation in the aliasing was pulling the wrong value. Replacing the inner x with y fixes the runtime.
I'm now digging into the compiler to try and fix that aliasing bug, but I'm not sure how long this will take, so I'm putting up my notes now in case I need to continue on Monday (my weekend is packed so I won't be able to touch anything then).

Of course I prepare all of those thoughts and then very quickly find the bug in the compiler. :)
PR coming soon.


Request: Filter by Low, High or G-Rank

As a new MH4U player I'm finding the amount of information in this app a little overwhelming which makes finding what I need a little harder.
I would like to request an application wide 'filter' if possible.  If set to Low, it would only include monsters that appear at low rank, items found at low rank, skills contained by low rank items and the parts of weapon trees that can be crafted by low rank.
For high rank, only show high rank items. You still find low rank monsters at high rank, so there needs to be an option to either hide low rank monsters, or simply mark them differently such as greyed out.  The same applies to weapon trees.  Some may want to see the full tree, others only the parts that concern them.
G-Rank works similairly to high rank.
Alternatively to Low, High or G, filtering can be done by the *'s of the content.

Filtering items by rank is/was planned. We were going to add app settings into the nav drawer, so this could go in there. I like the idea.

Filtering of armor has been implemented by rank.


Added athletes.stats endpoint

I have added a new endpoint and associated test for the athletes.stats endpoint documented here: http://strava.github.io/api/v3/athlete/#stats

Much appreciated, thanks for the contribution!


error

AttributeError: type object 'Colors' has no attribute 'YELLOW'
how do I fix this? btw great work on this

use lowercase, yellow


Strange backup behavior

Hello!
Yesterday, I set up hourly backups to S3, but it appears the backup process is malfunctioning. Manual backups through a button sometimes work, but occasionally result in 0-byte files. Automatic backups, however, fail entirely, producing a single 0-byte file and then ignoring the scheduled tasks.

I'm not able to reproduce it.
Check the Admin UI > Logs for any error related to the backups.
It could be also something related to the S3 compatibility APIs of the S3 provider you are using (see similar issue with R2 in https://github.com/pocketbase/pocketbase/discussions/2068).

Will try disabling s3 for a while and test on local storage.

Also I just noticed from the screenshot that the 0-byte file you mentioned is pb_settings_test_* and this is not the auto generated backup but the file that is generated during the settings test to check whether your S3 configuration is correct.
If the file wasn't removed then that means that either S3 delete api for some reason doesn't work with your provider or you have a file retention policy setup.
But in any case this file is not the backup. Check your logs and cron expression. Try also to manually initialize a backup to see if it will be uploaded.
And I remember you from your other question in https://github.com/pocketbase/pocketbase/discussions/4315. Please if you think it is a PocketBase issue make an attempt to provide simple reproduce steps (for example try locally without S3 or with other S3 providers) otherwise there is really no way for me to help you and it will be a waste of time to try to guess what has gone wrong.

What S3 would you recommend it works fine with?

Seems indeed a tebi issue

If you are looking for a free S3 storage for backups, Blackblaze has free plan - https://www.backblaze.com/.
With the next release Cloudflare R2 should also work and the SVG/JSON error reported in https://github.com/pocketbase/pocketbase/discussions/2068 should no longer occur.

Thanks, will try.


Feature request: Add set-back and comfort temperatures as input_numbers

Every few hours to few days, my temperature setpoint reverts to a default temperature. In the web UI of the control box, it is possible to change this value. It would be nice if this would be included in this integration.
I'm looking around a bit in the controller, and I can find the web UI where I can change the values. The value can be read out from http://CONTROLLER_IP/api/room/list and looking for the "groups" and then "rooms" key. Each room has the following data:
  {'id': 7,
   'appid': '01070002',
   'actualTemperature': 21,
   'isComfortMode': False,
   'desiredTemperature': 19.5,
   'roomstatus': 99,
   'desiredTempDay': 19.5,
   'desiredTempDay2': 18,
   'desiredTempNight': 18,
   'scheduleTempMin': 15,
   'scheduleTempMax': 28,
   'minTemperature': 18,
   'maxTemperature': 28,
   'cooling': False,
   'coolingEnabled': True,
   'imagepath': '/assets/images/room/default.png',
   'name': 'Woonkamer',
   'orderindex': 7,
   'originalName': 'Woonkamer',
   'status': 'problem',
   'groupid': 1,
   'windowPosition': 0}],
 'orderindex': 1}

The comfort temperature in the UI modifies both the desiredTempDay and desiredTemperature. The setback temperature in the UI modifies both the desiredTempDay2 and desiredTempNight.
Please let me know if you require additional information in order to add this.

Do you know if the keys desiredTempDay and desiredTempDay2 are used in exactly the same way for everybody?

Actually, what I do for this: in the Alpha Home app (for your phone/tablet), you can set the Cycle time, ("schakeltijden" in Dutch) (see settings). There, make sure you set the normal temperature (full sun) for the whole day. Normally, the system is set up to go to "comfort temperature" at night, but if you have a heat pump, you don't want this, you want the temperature to be the same always. This way, the temperature never drops back to the comfort temperature, but always stays on the temperature you set (in the app, or what we do: in home assistant by using this great integration!).
When the Alpha Innotec support guy was here, this was the first thing he did.. so maybe check that out.
I have no idea where to set this in the control box web UI (perhaps in the advanced part, but I don't have the code for that). Also, I'm not sure if you should change the desiredTemp temperature... because then you'd mess up the way the system works. I think you should change these parameters, once, in the app.. set them to what you want.. and then use this integration to set the temperature to what you want. For me it'd be better to use the app for setting up the system, and the integration for the daily interaction.

Thanks for the response Chris! I already have this apparently. I'd need to check if my system indeed switches back and if so, when.


超长了 max length96

please try the latest code. if there's  still the same issue, please post your env and full log screenshot.


Cannot use typing.Generic with pytypes

Using pytypes 1.0b5:
Python 3.7.3rc1 (default, Mar 13 2019, 11:01:15)
[GCC 7.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import typing
>>> import pytypes
>>> class PCollection(typing.Generic[typing.TypeVar('T')]):
...   pass
...
>>> PCollection()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/google/home/ehudm/virtualenvs/beam-py37/lib/python3.7/site-packages/pytypes/__init__.py", line 567, in __Generic__new__
    if cls.__origin__ is None:
AttributeError: type object 'PCollection' has no attribute '__origin__'

This is the version of typing I have installed: https://github.com/python/cpython/blob/v3.7.3rc1/Lib/typing.py

This is a manifestation of #40. That issue is significant work, so don't expect a fix too soon. However, there is steady progress and current master is readily miles better than 1.0b5.
Especially various __origin__-related issues were fixed, so its worth a try for your usecase.

It would be good if you could test this using current pytypes master. If it fails with master I would reopen in order to keep track and assert that my work on pytypes' Python 3.7 compatibility actually solves this issue as well.

It works on master.

Sadly, it does not work for me.
Python 3.7.4 (default, Aug 10 2019, 01:56:59)
[Clang 10.0.1 (clang-1<IP_ADDRESS>)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from pytypes import typechecked
>>> from typing import Generic, TypeVar
>>> T = TypeVar('T')
>>> class My(Generic[T]):
...     def __init__(self, arg: T) -> None:
...         self._arg = arg
...
>>> @typechecked
... def test(m: My[int]) -> None:
...     print(m)
...
>>> test(M(1))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
NameError: name 'M' is not defined
>>> test(My(1))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
pytypes.exceptions.InputTypeError:
  __main__.test
  called with incompatible types:
Expected: Tuple[My[int]]
Received: Tuple[My]

I have installed pytypes from master on this commit: https://github.com/Stewori/pytypes/blob/b7271ec654d3553894febc6e0d8ad1b0e1ac570a/setup.py
Version shown: pytypes==1.0b5.post38

Your example is beyond the scope of typechecking, it's about type inference.
Typechecking in sense of @typechecked is performed w.r.t. given types. If you use test(My[int](1)) it should work. That is the intended use by PEP 484 AFAIK.
Pytypes can actually do some type inference, e.g. get types from default args or write designated runtime observations to stubfiles. However it does not perform the on-the-fly type inference your example would require. Does this work with other typecheckers?
I think it might be doable to perform this type of type inference but it would be a significantly new feature. If you like, file it as a feature request in a separate issue. Bugfixing and Python 3.7+ support are currently dominant priorities, so don't expect feature requests to be handled soon (unless you make a PR). Still, it might be worth to track it...

Yes, it works with mypy.  It would be awesome to have something similar, but for runtime.

It wouldn't be feasible without any decorator  or agent on My.__init__ (or inderectly e.g. frm a decorator over My) that hooks in to infer the type of T when the call happens. There are more questions to be answered: Should types be inferred on every call or only on __init__? The decorator could control this. Please open a separate issue for this.

In python/mypy#949 you wrote:

I mean: are there any reliable ways to ensure that x is instance of List[int] or MyCustomGeneric[str]?

Note that that demand is rather different from what you bring up here. You can use pytypes.is_of_type to check if x is instance of List[int] or MyCustomGeneric[str].
is_of_type nowadays has more optional args than are documented there (doc needs an update). E.g. you can provide a dictionary as optional argument bound_typevars to that function, e.g. {T: int} to tell it parameters for free typevars.

Oh, great @Stewori! That's exactly what I need. But, sadly it does not work either.
>>> X = TypeVar('X')
>>> class My(Generic[X]):
...     def __init__(self, arg: X) -> None:
...         self._arg = arg
...
>>> is_of_type(My(1), My[str])
False
>>> is_of_type(My(1), My[int])
False

Any ideas?

is_of_type(My[int](1), My[int])
is_of_type(My[X](1), My[int], bound_typevars={X: int})
both work as expected. Without type inference, types are handled in strictly declarative fashion.
I admit it is a little bit disappointing that
is_of_type(My(1), My[int], bound_typevars={X: int}) does not work. If I find time I may revisit that one.

Also consider My[type(1)](1) or My[pytypes.deep_type(1)](1) to assess the type in more dynamic fashion.


Special characters in source text need escaping

This is a problem... VerbPhrase uses up a lot of memory. I can try it on a small text to see if the same issue occurs. This query should be possible, but the scope of fixing it might be beyond the development of this function.

Special characters don't seem to be an issue. + since I've removed the use of RegularExpressions I don't suspect the backslash Q and backslash E messages to crop up.


Add support for ConfTr

This ICLR 2022 paper shows how to train conformal classifiers.

[x] Add losses for prediction step (prediction step)
[ ] Add support for differentiable quantile computations (calibration step)
[ ] Implement batch training procedure
[ ] Test and document

Some questions that have come up so far:

Is the Direc delta really supposed to be an indicator function? Equation (5) on page 5.
Doesn't the smooth size loss depend a lot on the scale of the (non-)conformity scores? For $E_{\theta}(x,k)=\pi_{\theta,k}(x)\in[0,1]$, for example, we have that $\sigma(E_{\theta}(x,k) - \tau) \in [0.27,0.73]$. We can use temperature scaling, but can we really speak of 'probabilities' that labels are assigned to the set?

Re:

You can find a reference implementation for Equation (5) here.
Reference implementation for that is here - but this does indeed depend on the scale. That's what the temperature term $T$ is for: $\sigma((E_\theta(x, k) - \tau)/T)$. Also, you can use the log-probabilities $E_\theta(x, k) = \log \pi_{\theta,k}(x)$ which works a bit better in practice.
They can be penalized but this is generally not necessary. Basically, as long as there is one true label for each example, and $\alpha$ is reasonably low, the majority of prediction sets will contain at least the true label (so not be empty). This is mainly a result of the simple conformity score (for other conformal predictors this can be different). Beyond that, you are of course free to penalize that, but I am just saying that it is generally not required to learn good classifiers.
Gradients wrt. to what is the question? Generlly, gradient is not a problem as long as the sorting is fixed. The key is getting gradients through the sorting - this is what the smooth sorter is for.

Hope that helps. If I am slow to respond on here, feel free to send me an email to follow-up - always curious to see what people do with conformal training especially as I had some follow-up ideas but couldn't really pursue them.

Wow this was quick, thanks a lot 🙏
That all makes sense. Regarding the quantile computation, thanks for the clarification. For my current use case, I just need to differentiate with respect to a conformal model that has already been calibrated, but I see now why you need information about the sorting itself for training.
Thanks again for being responsive!


Charts & SQL query box

Apologies if I'm missing something obvious but my installation displays list of records fine and I can search on columns, edit & add records but I can't see any way to access the SQL query box or the charts shown in the screenshots.
Do I need to write some plug-ins in PHP?

You need to put the link to the query functionality somewhere. The query editor is available by appending ?mode=query to the URL. To place a link in a custom menu entry, you could follow the way it is done in the dbWebGen demo repository. See the demo_menu_complete function there in https://github.com/eScienceCenter/dbWebGen-demo/blob/master/plugin.php . For your plugin file to be included, you need to register the file in the app settings: $APP['plugins'] = [ 'plugin.php' ]


Update the documentation

Update the documentation
Describe the solution you'd like
I've tried setting up PRAW, in order to read the inbox for mentions and then grab the original post from there, but I cannot do it. Looking at the documentation does not help. I've posted my question on stackoverflow https://stackoverflow.com/questions/64794244/get-post-object-from-mention-praw-reddit-api and for the first time no one answered meaning either that it's the silly question i've ever poster (though people are quite happy to point this out) or maybe it's something that is not trivial.
Would it be possible to get an update on the documentation to describe this case. I feel that it would be a common thing to do isn't it?
Here's the stackoverflow post

I cannot for the life of me gather the post object using PRAW v7.1 (reddit api) in python.
I saw old articles online that use get_comment() but this is not in the 7.1 version as far as I can tell.
Here's my goal, I wish to make a bot that answers mentions in order to repost a post on another subreddit when someone > mentions it in the comments, and of course answer the comment.
Here's what I got so far

import praw

def main():
    r = praw.Reddit(
        client_id='##CENSORED##',
        client_secret='##CENSORED##',
        password='##CENSORED##',

    i = r.inbox.mentions()

    for f in i:
        print(f, dir(f), type(f))

if __name__ == "__main__":
    main()

This indeed outputs the mention object i.e. the comment. I can view the comment's body by looking at f.body, but when looking at the f.parent, or f.context, I cannot find the original post object.
I known there is not much in my code, but I looked at most of the output from dir(f), and at the readthedoc and can't do it.
What am I missing?

You should be able to get the original post with f.submission.

What you're looking for is https://praw.readthedocs.io/en/latest/code_overview/models/comment.html#praw.models.Comment.submission.


selectpicker not refreshing after form submit

I have a selectpicker in a dynamic table inside of a form (can add rows, delete rows).
My form submits correctly with all data. I am passing the index of the row where the selectpicker is located back to the success function in ajax. I need the selecpicker to refresh to pick-up the new product that was just inserted into the database. I know the index of the row that was clicked, just can't figure out how to refresh the selectpicker. Any help would be greatly appreciated.
$("#frmAddProduct").on('submit', function(e){
e.preventDefault();
	var form_data = new FormData(this);
	var post_url = $(this).attr("action");

	$.ajax({
		url: post_url,
		type: 'POST',
		data: form_data,
		contentType: false,
		cache: false,
        processData: false,
		mimeType:'multipart/form-data',
		success: function(data){
			var rowIdx = data;
			//console.log(rowIdx);
			$('.selectpicker').selectpicker('refresh');
		}
	});

});`

same issue am facing any solution??

Provide environment details. Provide your operating system, browser(s),
jQuery version, Bootstrap version, and bootstrap-select version.

Create an isolated and reproducible test case. Create a reduced test
case.

Include a live example. Use this Plunker debugging template to share your isolated test cases. You can also make use of jsFiddle or jsBin.

ninguna solucion que soporte


UI not usable after Nomad restart

Problem
When Nomad is not reachable while the UI is initialized and an instance is expanded, the allocated tasks cannot be loaded. When Nomad becomes reachable again, the page needs to be refreshed for the allocated tasks to show up because the UI keeps showing the spinner otherwise.
Also the instance control buttons don't work. You cannot start or stop a job until refreshing the page.
How To Reproduce

Start Cluster Broccoli (don't start Nomad, yet)
Create a new HTTP Server instance
Expand this instance and observe allocated tasks not being fetched

Start Nomad and observe that allocated tasks are still not being fetched although Nomad is reachable

Refresh web page and see the correct message "No tasks have been allocated, yet."

Expected Behaviour

UI stops working when Nomad is not reachable
UI starts working again when Nomad is reachable again without having to refresh

@FRosner Did you look at the websocket messages exchanged?  Did any errors appear in the console?

No error message. The run request is submitted but nothing happens: