HTTP Error 403: Forbidden

Checklist

[x] I'm reporting a broken site support issue
[x] I've verified that I'm running youtube-dl version 2020.03.24
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read bugs section in FAQ

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--username', u'PRIVATE', u'--password', u'PRIVATE', u'-o', u'~/Downloads/%(playlist)s/%(chapter_number)s - %(chapter)s/%(playlist_index)s - %(title)s.%(ext)s', u'--verbose', u'--sleep-interval', u'120', u'https://app.pluralsight.com/library/courses/jenkins-2-getting-started/', u'--playlist-start', u'1']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.03.24
[debug] Python version 2.7.16 (CPython) - Darwin-19.4.0-x86_64-i386-64bit
[debug] exe versions: none
[debug] Proxy map: {}
[pluralsight:course] jenkins-2-getting-started: Downloading JSON metadata
[download] Downloading playlist: Getting Started with Jenkins 2
[pluralsight:course] playlist Getting Started with Jenkins 2: Collected 64 video ids (downloading 64 of them)
[download] Downloading video 1 of 64
[pluralsight] Downloading login page
[pluralsight] Logging in
ERROR: Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 627, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2238, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 435, in open
    response = meth(req, response)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 548, in http_response
    'http', request, response, code, msg, hdrs)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 473, in error
    return self._call_chain(*args)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 407, in _call_chain
    result = func(*args)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 556, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

Description

I was trying to download pluralsight course and found this bug

how did you closed that issue if it's not resolved yet in the other duplicated one that you closed too!

how did you closed that issue if it's not resolved yet in the other duplicated one that you closed too!

I'm wondering the same thing. I tried finding the original one, and it was also closed, but no solution seem to have been provided. I'm confused

This is not a duplicate nor the usual forbidden issues dstftw is used to seeing. To be fair, it is rare for this to be the case.
I am experiencing this too from multiple locations/environments. New issue, only started noticing it this week. It is not consistent. If you attempt the same file over and over you will see successes and errors.
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://www.youtube.com/watch?v=Vs6sWjiE9Yo']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2020.03.24
[debug] Python version 3.8.0 (CPython) - macOS-10.15.4-x86_64-i386-64bit
[debug] exe versions: ffmpeg 4.2.2, ffprobe 4.2.2, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] Vs6sWjiE9Yo: Downloading webpage
[youtube] {18} signature length 112, html5 player vflset
[youtube] {137} signature length 108, html5 player vflset
[youtube] {248} signature length 108, html5 player vflset
[youtube] {136} signature length 112, html5 player vflset
[youtube] {247} signature length 108, html5 player vflset
[youtube] {135} signature length 108, html5 player vflset
[youtube] {244} signature length 112, html5 player vflset
[youtube] {134} signature length 112, html5 player vflset
[youtube] {243} signature length 112, html5 player vflset
[youtube] {133} signature length 112, html5 player vflset
[youtube] {242} signature length 112, html5 player vflset
[youtube] {160} signature length 112, html5 player vflset
[youtube] {278} signature length 112, html5 player vflset
[youtube] {140} signature length 108, html5 player vflset
[youtube] {249} signature length 112, html5 player vflset
[youtube] {250} signature length 112, html5 player vflset
[youtube] {251} signature length 112, html5 player vflset
[debug] Default format spec: bestvideo+bestaudio/best
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[debug] Invoking downloader on 'https://r5---sn-5ualdn7r.googlevideo.com/videoplayback?expire=1586502501&ei=BMePXtzHOayYkATIxK7ADQ&ip=XXXXXXXXXXX&id=o-AAH0LVoUlAR7RQ1qGwQvTPRuyctCFU5JhzcD7iKPqh6K&itag=137&aitags=133%2C134%2C135%2C136%2C137%2C160%2C242%2C243%2C244%2C247%2C248%2C278&source=youtube&requiressl=yes&mh=Ks&mm=31%2C29&mn=sn-5ualdn7r%2Csn-5uaeznkl&ms=au%2Crdu&mv=m&mvi=4&pl=21&gcr=us&initcwndbps=891250&vprv=1&mime=video%2Fmp4&gir=yes&clen=13539610&dur=156.840&lmt=1569617025630284&mt=1586480860&fvip=5&keepalive=yes&beids=9466585&c=WEB&txp=8311222&sparams=expire%2Cei%2Cip%2Cid%2Caitags%2Csource%2Crequiressl%2Cgcr%2Cvprv%2Cmime%2Cgir%2Cclen%2Cdur%2Clmt&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=ALrAebAwRQIhAIEA4w3kS1womr49qUNdh7X_1lgpaqrXG1UHaqBREOw0AiAzqzIdcowPg-N4dnZH_fJ8cZas3R8Lf2PHlH6Nj5TDdQ%3D%3D&sig=3E777ERE4ptxjqiscEOQz9-1bIMNfwXTJYu9tIti7Tr23jV0BICMYEARq7df8huONwV0uC4INSsqOY_Yn_o0Lkg2lb5rhNgIARwsLlPpJk&ratebypass=yes'
ERROR: unable to download video data: HTTP Error 403: Forbidden

Going to try again #24713 if you would like to +1


json status updates

If brimcap analyze or load is not writing to stdout (load never is), and if
stdout is not a terminal (or the -json flag is enabled) write json status
updates to stderr.
The json status messages are mostly the same as the status updates sent back by
the zqd pcap post endpoint; this should be an easy transition for the when the
brim desktop application starts calling brimcap directly.

This pr isn't sufficient. Error messages also need to be output in json in order for this to work. Closing for now.


Compilation error when running the http-2.0-server-push sample

Description:
error: .\http-2.0-server-push.bal:73:5: undefined field 'targets' in struct 'ballerina.http:ClientEndpointConfig'
compilation contains errors

Affected Product Version:
Ballerina beta 3 nightly
OS, DB, other environment details and versions:
JDK - 1.8.0_171
Windows 10

This is fixed


Cannot deploy External Secret on AWS

Describe the solution you'd like
I would like to deploy this to AWS EKS
What is the added value?
I followed the instructions
1.) in config/backend-config/kustomization.yaml commented out backend-config-dummy.yaml
2.) in config/backend-config/kustomization.yaml uncommented backend-config-asm.yaml
3.) Filled in my AWS details
4.) make deploy failed (MacOS X)
Give us examples of the outcome
namespace/externalsecret-operator-system created
customresourcedefinition.apiextensions.k8s.io/externalsecrets.secrets.externalsecret-operator.container-solutions.com created
role.rbac.authorization.k8s.io/externalsecret-operator-leader-election-role created
clusterrole.rbac.authorization.k8s.io/externalsecret-operator-manager-role created
clusterrole.rbac.authorization.k8s.io/externalsecret-operator-proxy-role created
clusterrole.rbac.authorization.k8s.io/externalsecret-operator-metrics-reader created
rolebinding.rbac.authorization.k8s.io/externalsecret-operator-leader-election-rolebinding created
clusterrolebinding.rbac.authorization.k8s.io/externalsecret-operator-manager-rolebinding created
clusterrolebinding.rbac.authorization.k8s.io/externalsecret-operator-proxy-rolebinding created
secret/externalsecret-operator-config created
service/externalsecret-operator-controller-manager-metrics-service created
deployment.apps/externalsecret-operator-controller-manager created
error: unable to recognize "STDIN": no matches for kind "ExternalSecret" in version "secrets.externalsecret-operator.container-solutions.com/v1alpha1"
Provide templates if you are proposing changes in the CRD. Provide example workflows or code snippets if they make sense to present.
Observations (Constraints, Context, etc):
Give here all extra information that could be interesting. Such as Golang version and Kubernetes version if you are reporting a bug/problem. You can also foresee technical constrains like "this could only be implementing using this specific technology or approach, because of this and that".
Kubectl 1.18.8
AWS EKS 1.17.19
go 1.13.15
Mac OS X 10.14.6

Hi @udemy-darnone1, thanks for reaching out!
So, before running make deploy, you need to run make install. make install will create the ExternalSecret CRD, and make deploy will actually deploy the templates including the template for the ExternalSecret (that needs the CRD to be applied first).

If that is the case , then your instructions in the README on the main page are missing the make install. Do you need to make  the external secret in config /sample explicitly?  And is this command correct as the secret specifies namespace system:
kubectl get secret externalsecret-operator-externalsecret-sample -n externalsecret-operator-system
-o jsonpath='{.data.example-externalsecret-key}' | base64 -d
this string is a secret

Included make install in the readme.
We did some big changes recently and we still have to get the docs right for everything. Thanks a lot for pointing things out.
The ExternalSecret that is in the samples template is just an example to see things initially. After having the operator and CRD created on your cluster you can create any ExternalSecret that you desire.

@udemy-darnone1 hey! Please check the new docs in the repo.
You can deploy with the current image with
IMG=containersol/externalsecret-operator:pr-119 make deploy
Or
IMG=containersol/externalsecret-operator:latest make deploy
Since we are close but not ready yet to make a new release
I will close this issue. Feel free to re open in case of any problems.


Use primitive types where appropriate

Since BSON is a binary format, there are no readability advantages justifying the use of strings where primitive types would be more appropriate.

type switches from string to int
key switches from string to int
hash switches from string to binary

Switching to those types

reduces the file size, especially for large playlists.
makes implementation of the specification in lower level languages and FFI easier.

Note that I didn't update the code to respect those changes, I will do it if requested once the changes are accepted.

Will edit the codebase itself later this week.


chore(travis): add previous and current NodeJS LTS

Mind adding "6" as well?

Ugh, GitHub UI added an extraneous commit. I'll open a new PR.


Add gomplate

Tool name
gomplate
Tool license
MIT
Add or update?

[X] Add
[ ] Update

Desired version
v3.11.5
Approximate size
10 - 52 MiB
Brief description of tool
From repo:
gomplate is a template renderer which supports a growing list of datasources, such as: JSON (including EJSON - encrypted JSON), YAML, AWS EC2 metadata, Hashicorp Consul and Hashicorp Vault secrets.
URL for tool's homepage
https://docs.gomplate.ca/
Provide a basic test case to validate the tool's functionality.
It is used to render templates into completed files, given the data sources and/or environments, straight from cli.

For example, render templates of K8s Deployment YAML manifest to have proper container image name and tag.

Platforms where you need the tool

[X] Azure DevOps
[X] GitHub Actions

Runner images where you need the tool

[X] Ubuntu 20.04
[X] Ubuntu 22.04
[X] macOS 11
[X] macOS 12
[ ] Windows Server 2019
[ ] Windows Server 2022

Can this tool be installed during the build?
There are various ways to install the latest version of this tool without the need of building from scratch.

For Linux-based:
$ npm install --location=global gomplate

For macOS-based:
$ brew install gomplate

For more information: https://docs.gomplate.ca/installing/

Tool installation time in runtime
binary installation should takes less than 30s, given good connection
Are you willing to submit a PR?
yes

Hey @Thammachart! We would not like to install the tool due to small installation time and maintenance concerns. Please, install it in runtime by adding additional step in your pipeline. I am closing this issue, but if you have additional questions feel free to ask.


Update NuSpec package license from url to expression

Replace PackageLicenseUrl with PackageLicenseExpression.
PackageLicenseUrl is deprecated since Visual Studio 15.9.4, .NET SDK 2.1.502 and 2.2.101 according to https://docs.microsoft.com/en-us/dotnet/core/tools/csproj#packagelicenseurl  .
See https://docs.microsoft.com/en-us/dotnet/core/tools/csproj#packagelicenseexpression for more info about PackageLicenseExpression.
A follow-up of #432, relates to #429.

Closing as stale.


Feature/api id update

Purpose
Change API parameters from 'pk' to more specific descriptions ('node_id', 'user_id')
Closes: https://github.com/CenterForOpenScience/osf.io/issues/3055
Changes
Changed url routes and processing to allow for new format.
Side Effects
Parameters have more specific description.  This makes the OSF Api have a different format than the standard Rest Api

First pass done. :penguin:  My primary concern is understanding the modifications to _get_attr_from_tpl.

@PatrickEGorman There are failing tests. Can you look into those?

Looks good. :octopus:


Update for zoneinfo 2022b

Update to reflect timezone offset change to Europe/Stockholm in recent zoneinfo file. Arguably, it may be better to just remove this test, I would also be open to that.

We may want to hold off on merging this until all the JVM vendors catch up.


about vad model

Hi, any plans to add VAD models?

No plans to add any VAD model, the only focus of this library is speech recognition.
I suggest taking a look at pyannote and speechbrain.


Improve doc per customer feedback

This PR resolves 2 feedbacks:

Customer does not know where should put the auth property mentioned in this doc. This PR adds more context for the auth property.
Customer does not know where to get the real values for the properties. This PR makes the reference doc more obvious for customer's scenario.

Acrolinx Scorecards
We currently enforce a minimum score of 80.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology:

Article
Score
Issues
Scorecard
Processed

msteams-platform/toolkit/provision.md
95
62
link
:white_check_mark:

More info about Acrolinx
Use the Acrolinx extension, or sidebar, in Visual Studio Code to check spelling, grammar, style, tone, clarity, and key terminology when you're creating or updating content. For more information, see Use the Visual Studio Code extension to run Acrolinx locally.

Acrolinx Scorecards
We currently enforce a minimum score of 80.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology:

Article
Score
Issues
Scorecard
Processed

msteams-platform/toolkit/provision.md
95
62
link
:white_check_mark:

More info about Acrolinx
Use the Acrolinx extension, or sidebar, in Visual Studio Code to check spelling, grammar, style, tone, clarity, and key terminology when you're creating or updating content. For more information, see Use the Visual Studio Code extension to run Acrolinx locally.

Acrolinx Scorecards
We currently enforce a minimum score of 80.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology:

Article
Score
Issues
Scorecard
Processed

msteams-platform/toolkit/provision.md
95
62
link
:white_check_mark:

More info about Acrolinx
Use the Acrolinx extension, or sidebar, in Visual Studio Code to check spelling, grammar, style, tone, clarity, and key terminology when you're creating or updating content. For more information, see Use the Visual Studio Code extension to run Acrolinx locally.

Acrolinx Scorecards
We currently enforce a minimum score of 80.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology:

Article
Score
Issues
Scorecard
Processed

msteams-platform/toolkit/provision.md
96
60
link
:white_check_mark:

More info about Acrolinx
Use the Acrolinx extension, or sidebar, in Visual Studio Code to check spelling, grammar, style, tone, clarity, and key terminology when you're creating or updating content. For more information, see Use the Visual Studio Code extension to run Acrolinx locally.

Acrolinx Scorecards
We currently enforce a minimum score of 80.
Click the scorecard links for each article to review the Acrolinx feedback on grammar, spelling, punctuation, writing style, and terminology:

Article
Score
Issues
Scorecard
Processed

msteams-platform/toolkit/provision.md
96
60
link
:white_check_mark:

More info about Acrolinx
Use the Acrolinx extension, or sidebar, in Visual Studio Code to check spelling, grammar, style, tone, clarity, and key terminology when you're creating or updating content. For more information, see Use the Visual Studio Code extension to run Acrolinx locally.


Add piano/keyboard[-midi]/file-music variations

For MIDI files, DAW files etc…

I think these icons need some more exploring… For the other icons MIDI, I think we can better discuss this in an issue or discussion.

Originally posted by @ericfennis in https://github.com/lucide-icons/lucide/issues/1124#issuecomment-1529127632

I believe it is important to differentiate between a 'MIDI keyboard' and a standard 'mini keyboard'.


Invalid task data

Marathon 0.7.6, Mesos 0.21.0.
We've seen an issue where Marathon restarted abnormally and lost a bunch of task data, including the hostname and the port, which causes the haproxy script to write an invalid config and fail.
We have no idea what caused the issue at this stage.

This one really is a blocker. I get this quite often on our production cluster, using Docker. I only saw it once I think in my dev environment.
Any new insights on this?

Seeing a lot of "No staged task for ID ...." lines in the logs, coming from TaskTracker.running. I believe this code is responsible for creating the bad tasks, i.e. the second "case _" branch in that function.

Is anyone still seeing this behavior with latest master?

Never seen again since #945.


JDK21+ exclude javax/rmi/ssl/SSLSocketParametersTest.java

JDK21+ exclude javax/rmi/ssl/SSLSocketParametersTest.java
related to https://github.com/eclipse-openj9/openj9/issues/12168
Signed-off-by: Jason Feng<EMAIL_ADDRESS>

@llxia @LongyuZhang could you please review?
FYI @smlambert


Add status to console log during sync

By default, there's no way to know if the sync script is working without checking the node log. Add logging to the sync console.

https://github.com/gridcoin-community/BlockExplorer/commit/02dc0d7fc2ae8f30dd88f31668bf5e0c373d4b9f

Code already implemented in fork.


Trivial Tone.Player example plays unstable volume

Describe the bug
I'm finding Tone.js to will play a one shot sample with a double volume on Chrome on its 2nd or third time in the loop.
It doesn't appear to be impacting Safari. It seems particularly sensitive to the certain BPM of 125 (crazy I know)
https://codepen.io/jtwigg/pen/jOGMGaJ?editors=1111
To Reproduce
https://codepen.io/jtwigg/pen/jOGMGaJ?editors=1111

Use Chrome on a Mac. In particular I'm using a new M1
In the example, you need to wait just a little for the JS to load, but when it does
a) Click the Play 125BPM and listen for it to loop a few times. About the 2nd or 3rd time it plays it will play twice as loud.
b) Restart/refresh the page to restart the test
c) Try the 125.1 BPM and it play stably.

Expected behavior
The volume shouldn't be extra loud.
What I've tried
Different BPM's have different don't cause the issue.
I've tried loops, longer Transport loop points.
Additional context
Definitely Chrome related as Safari is not producing the issue.
I'm pulling out my hair here. I can't even do the most trivial or trivial things right now.
I really need this to work...

might be related to #944

@dirkk0 Thanks for replying. I'll keep an eye on this issue, but I'm now looking at talking to Web Audio API directly to see if I can achieve what I need. I was really hoping to use the Tone.js scheduling etc which was powerfull.

Seems like this double scheduling was due to a floating point error. Just pushed a change which should fix that, will be deployed in the tone@next once it passes through CI


Add 'transform' option for custom key transform function (e.g. PascalCase to kebab-case) (closes #5)

This PR replaces the 'lowercase' option with a more generic 'transform' option that allows to supply a custom function that does key transforms. This is useful for models that respond to an item whose name is written in kebab-case (e.g. 'blog-article' or 'secondary-hero').
A PascalCase (Class name standard) to kebab-case (usually keys for Kirby items) transformer is included and added as default for models. Items previously using the 'lowercase' option have been replaced by the function.
This PR also updates a test (AmazeBlock -> VeryAmazeBlock) and adds a new page test (JustAnotherPage) to ensure the feature works.

No idea how to fix that composer mismatch - but you should probably know better.

thanks. i will merge that later today or tomorrow.


Revisit file view analytics

The Issue

We are only recording a file_view is a user clicks play. We should also extend this to the case where a user clicks download.  (This was solved in https://github.com/lbryio/lbry-desktop/pull/1901)

If a user is viewing content outside of render media (MP4s/images/GIFs), the file view is not counted until they leave the claim - this may be confusing from a rewards perspective if they are viewing non render media content.

A view is counted even if the stream doesn't start when the user leaves the claim.

System Configuration

LBRY Daemon version:
LBRY App version:
LBRY Installation ID:
Operating system:

Anything Else

Screenshots

Check to see if similar timing issues as in lbry_file_view entry 391277

There are a few users complaining that their file_views are not being counted. I've been able to confirm that this is occurring but have not reproduced it or seen it in action. Will continue to dig in.

2 is fixed, 3 is to be expected. 1 is now filed under https://github.com/lbryio/lbry-desktop/issues/2768


STATE value replacement doesn't work in services except normal notification.

Home Assistant release with the issue:

Home Assistant 0.103.5
Last working Home Assistant release (if known):
Never, I guess.
Operating environment (Hass.io/Docker/Windows/etc.):

Docker on Raspberry-Pi 3.
Integration:

https://www.home-assistant.io/integrations/joaoapps_join/
Description of problem:
Joaoapp_join provides two main functions. One is a normal notification, the other is for  Join's specific features like sending SMS, or sending data to the Tasker app, etc.
Nomal notification works well, which I mean HA's STATES variable replacement works well.
alias: Send Message to Tasker
  sequence:
  - data:
      message: Family room receiver is set to {{ states('sensor.family_room_receiver_source') }}
    service: notify.s10plus

With this, Join's message on phone is “Family room receiver is set to Sonos.” Which is perfect.
But if we use the same logic with sending a Tasker command, it fails.
alias: Send Variable to Tasker
  sequence:
  - data:
      command: setvar=:=FrRec=:={{ states('sensor.family_room_receiver_source') }}
    service: joaoapps_join.android_send_tasker

The variable FrRec in Tasker will change to “{{ states(‘sensor.family_room_receiver_source’) }}”, not “Sonos” like it should.
I didn't check the state-replacement feature of all other Joaoapps_join's services like ring/sms/send_url etc. However I guess all services except normal notification might fail in replacing states variables. Which results from my browing the sources.
Problem-relevant configuration.yaml entries and (fill out even if it seems unimportant):

Traceback (if applicable):

Additional information:

@alogblog the notify service is somewhat unique in that it will accept (and render) a template in its message and title parameters. However, for most other services you should use data_template (instead of data) in the service call. E.g., you should try:
sequence:
- data_template:
    command: setvar=:=FrRec=:={{ states('sensor.family_room_receiver_source') }}
  service: joaoapps_join.android_send_tasker

See this doc page for more details about data_template.

@pnbruckner After editing scripts.yaml directly (data: --> data_template:) and restarting HA, it worked well. Howeverr if I open that script in HA's UI, then HA didn't display the data_template in  "Service data" section, although after switching "Edit as YAML", it displayed well. I'm not sure this UI mechanism is right or not. Anyway we can use that feature with no problem. Thanks.

Yeah the UI still needs work. Glad you got it working.


Updated information about defense.

Claims Partitioned Caches is available in most browsers
States Navigation limitation
States Subdomain limitation

@terjanq @arxenix

lg2m, we may want to add info on how ff and chrome key resources to https://xsleaks.dev/docs/defenses/secure-defaults/partitioned-cache/
(ff uses <top-frame-site eTLD+1, resource-url> , chrome uses <top-frame-site eTLD+1, framing-site eTLD+1, resource-url>)

we may want to add info on how ff and chrome key resources to https://xsleaks.dev/docs/defenses/secure-defaults/partitioned-cache/
(ff uses <top-frame-site eTLD+1, resource-url> , chrome uses <top-frame-site eTLD+1, framing-site eTLD+1, resource-url>)

I have not added this to the partitioned-cache page :D


Properly use the new API

creatorFlagEnabled is always true due to the API being enabled.
This results in isCreator being true too, acting as if the player owns the current place.
Apparently, actually using the new API wasn't implemented here.
This commit should switch from checking the game's CreatorId to the new API, if it's (still) disabled.
Proper error handling is included. When the new method fails, it'll resort to the old method again.

Commandbar is still visible in all places for everyone.

Also serverside internally, LogService:ExecuteScript(source) doesn't seem to work in group games.
I assume that it doesn't check if the player using the commandbar can edit the (group) place.

Thanks for pointing this out. It will be fixed with the release of the new developer console.


Fix release 79

Ensembl 79's GTF added another surprise: entries in the last column with multiple spaces. This isn't really their fault, since the spaces were within quotes. Added a bandaid fix, but need to implement a real parser before Ensembl 80 comes out.

Added some missing biotypes.

PEP8 fixes in gtf_parsing

Fixed FASTA path for protein sequences for Ensembl releases <= 75

Comments from the review on Reviewable.io
Reviewed files:

pyensembl/biotypes.py @ r1
pyensembl/gtf.py @ r1
pyensembl/gtf_parsing.py @ r1
pyensembl/transcript.py @ r1
pyensembl/url_templates.py @ r1
setup.py @ r1

Looks good, just a minor comment or two.

pyensembl/gtf.py, line 338 [r1] (raw file):
Get rid of the True comment?

pyensembl/gtf_parsing.py, line 164 [r1] (raw file):
I'm confused, and assume I'm just misreading. If the maxsplit that generated pairs is 2, how did we get more than 2 elements? (Edit: oh, the number of elements is maxsplit + 1!)


Add or remove users from teams permission

Hello,
Here at my company we want to give the permission to add or remove users from teams to the data managers, but Openmetadata doesn't has this possibility yet. It would be very could to add this permission to a role.
A second step, but I think it is a more complicated one, it is the possibility to give permission to a person to manage only specific or a list of teams.
thank you

@rubenssoto
Possible related question:
At your company, do you sync users from a system like LDAP or directly create users from OpenMetadata UI?

@mithmatt they are using SSO to login and it will prompt the sign up page.
@rubenssoto

When the user signups they will get a prompt to chose a team
Right now it will list all the teams available , which means users can be part of all teams or any team. Do you want to restrict this?
If So we can provide a config option to disable this behavior so when user sign ups they won't be assigned to any team
Next admin can create a role and designate user to manage team or teams . Now that person needs to add or remove users from teams

For 4, we can add a new permission called UpdateTeam which can be assigned to a role. And ensure that this is enforced at team API level

See mocks in #3057

For 0.9 release let's attempt a smaller scope: " give the permission to add or remove users from teams to the data managers" to get a preview of the feature out

We have implemented the part where one can create a role and provide the role permissions to update users in all teams.

Tasks:

[ ] #3056
[ ] #3152


BSC Pancakeswap not syncing

Hi there,
I'm running a graph-node point to the BSC with a couple of subgraphs. The node itself seems to work as expected, the problem is that the PancakeSwap subgraph isn't syncing fast enough (I'm about a week around 97%).
It looks like a well know issue (https://twitter.com/PancakeSwap/status/1362428932545372163).
Could you please share more information about it?
I've tried to change some env parameters [1] to improve the performance but didn't change too much so far, there is some recommended setup?
From the infra perspective, I didn't found an obvious bottleneck too. My current env is a large instance (running all services from docker-compose) connected to a BSC full-node from the local network.
There is something that I can do to speed the sync up?
[1] Custom parameters that I'm using right now:
      RUST_LOG: info
      ETHEREUM_POLLING_INTERVAL: 50
      ETHEREUM_RPC_MAX_PARALLEL_REQUESTS: 128
      ETHEREUM_BLOCK_BATCH_SIZE: 200
      GRAPH_ETHEREUM_MAX_BLOCK_RANGE_SIZE: 2000
      STORE_CONNECTION_POOL_SIZE: 20

Thank you very much!

One thing to try out is to set GRAPH_ETHEREUM_CLEANUP_BLOCKS=true in the env, though this shouldn't be an issue in large infras. We will be looking into PancakeSwap performance.

For the records, the GRAPH_ETHEREUM_CLEANUP_BLOCKS parameter made the performance even worst, I've back to the default value.

Get a lot of this result:
Feb 18 09:50:03.481 INFO Possible reorg detected, retrying, id: QmdhgJsqjzB9igR4m2FExP6ybM48oSqeSMbdswfEYGbDQR, error: "Failed to process trigger in block #4843590

Is this also because of pancake swap?

Hi there, any progress with this issue?
Thanks!

We have this syncing on the hosted service now https://thegraph.com/explorer/subgraph/pancakeswap/exchange. And we have some performance improvements coming up #2222 and #2223. It will take weeks to sync at the current pace, lets see how it goes.

PancakeSwap is revamping their subgraphs for better performance.


sensors: voltage_divider: Reconfigure ADC for the channel to be used

Some ADCs (e.g. SAM0) can only convert one channel at a time and therefore need to be reconfigured for every voltage divider prior to startin the conversion.
In the current implementation only one channel (whichever was initialized last) will be converted.
Fixes: #76732

Please squash the fixup commit into the original commit

done

@guenzel-kinexon Could you please rebase and help fix the merge conflict

@guenzel-kinexon friendly ping :)

friendly pong :)
Changes should be ok now.

@MaureenHelm please revisit


add InvalidObject

adds InvalidObject with example and test

@InsaneZein Can you run the lint command with --fix to fix the linting errors?

Just some little comments, we are close!


multiline paragraphs with emphasis within quotes

Do I miss something, but I do experience similar/same problem with e.g.:
In #64 the problem was solved for footnotes, but it still does exist for quotes:
#+BEGIN_QUOTE
Ipsum is simply dummy text of the printing and typesetting
industry. Lorem Ipsum has been the industry's standard dummy text ever
since the 1500s, when an unknown printer took a galley of type and
scrambled it to make a type specimen book. It has survived not only
five centuries, but also the leap into electronic typesetting,
remaining essentially unchanged. *It was popularised in the 1960s with
the release of Letraset sheets containing Lorem Ipsum passages, and
more recently with desktop publishing software like Aldus PageMaker
including versions of Lorem Ipsum.*
#+END_QUOTE

renders as:

The commit likely needs to be updated in the Hugo vendor json. Will check when I get a chance today and PR if that's the case.

Sorry for the delay, I tested  (org-html-export-as-html) with this block quote and org-mode itself doesn't support block quotes with inner element parsing:

Ipsum is simply dummy text of the printing and typesetting
industry. Lorem Ipsum has been the industry's standard dummy text ever
since the 1500s, when an unknown printer took a galley of type and
scrambled it to make a type specimen book. It has survived not only
five centuries, but also the leap into electronic typesetting,
remaining essentially unchanged. *It was popularised in the 1960s with
the release of Letraset sheets containing Lorem Ipsum passages, and
more recently with desktop publishing software like Aldus PageMaker
including versions of Lorem Ipsum.*

It should be possible for goorgeous to check for a parameter on the block like "render-inner" or something so that it knows to render the inner elements. How does that sound?

I had a branch I was getting ready to PR into Hugo this week that fixed this, but it looks like @niklasfasching PR'ed a new org parser, so I'm closing all the issues here, deprecating and archiving goorgeous.


Switched TestCase to SimpleTestCase where possible in Django's tests.

Crude identification methodology:
diff --git a/django/test/testcases.py b/django/test/testcases.py
index 9f549f626f..6352310991 100644
--- a/django/test/testcases.py
+++ b/django/test/testcases.py
@@ -874,8 +874,8 @@ class TransactionTestCase(SimpleTestCase):
         # Clear the queries_log so that it's less likely to overflow (a single
         # test probably won't execute 9K queries). If queries_log overflows,
         # then assertNumQueries() doesn't work.
-        for db_name in self._databases_names(include_mirrors=False):
-            connections[db_name].queries_log.clear()
+        # for db_name in self._databases_names(include_mirrors=False):
+        #     connections[db_name].queries_log.clear()

     @classmethod
     def _databases_names(cls, include_mirrors=True):
@@ -997,6 +997,9 @@ def connections_support_transactions():
     return all(conn.features.supports_transactions for conn in connections.all())

+_queries = False
+
+
 class TestCase(TransactionTestCase):
     """
     Similar to TransactionTestCase, but use `transaction.atomic()` to achieve
@@ -1040,14 +1043,22 @@ class TestCase(TransactionTestCase):
                 except Exception:
                     cls._rollback_atomics(cls.cls_atomics)
                     raise
+        global _queries
+        _queries = False
         try:
+            cls._has_test_data = True
             cls.setUpTestData()
+            if cls._has_test_data:
+                _queries = True
         except Exception:
             cls._rollback_atomics(cls.cls_atomics)
             raise

     @classmethod
     def tearDownClass(cls):
+        global _queries
+        if not _queries:
+            print(cls)
         if connections_support_transactions():
             cls._rollback_atomics(cls.cls_atomics)
             for conn in connections.all():
@@ -1057,6 +1068,7 @@ class TestCase(TransactionTestCase):
     @classmethod
     def setUpTestData(cls):
         """Load initial data for the TestCase."""
+        cls._has_test_data = False
         pass

     def _should_reload_connections(self):
@@ -1073,8 +1085,14 @@ class TestCase(TransactionTestCase):

         assert not self.reset_sequences, 'reset_sequences cannot be used on TestCase instances'
         self.atomics = self._enter_atomics()
+        for db_name in self._databases_names(include_mirrors=False):
+            connections[db_name].queries_log.clear()

     def _fixture_teardown(self):
+        global _queries
+        for db_name in self._databases_names(include_mirrors=False):
+            _queries |= bool(connections[db_name].queries_log)
+
         if not connections_support_transactions():
             return super()._fixture_teardown()
         try:

buildbot, test on oracle.

buildbot, test on oracle.


feat(mat-sort): add exact sorting function

Allows to sort by exact value.
closes #15714

I signed it!


Can't run simulator, missing symbol _Z27dollar_test_dollar_plusargsP9tSimStatePKcPKSs

$ git clone https://github.com/nixos/nixpkgs
$ nix-shell -I nixpkgs=`pwd`/nixpkgs -p bluespec verilog
$ git clone https://github.com/bluespec/Piccolo
$ cd Piccolo/builds/RV32ACIMU_Piccolo_bluesim
$ make compile
$ make simulator
$ ./exe_HW_sim
Error: dlopen: ./exe_HW_sim.so: undefined symbol: _Z27dollar_test_dollar_plusargsP9tSimStatePKcPKSs
    invoked from within
"sim load $model_name $top_module"
    invoked from within
"if {$wait} {
sim load $model_name $top_module wait
} else {
sim load $model_name $top_module
}"
    (file "/nix/store/p4byndpkpmd2blkqzk0l9wv9g1n3lfwz-bluespec-unstable-2020.02.09/lib/tcllib/bluespec/bluesim.tcl" line 193)

Apologies for the hassle.  The is a C compiler version issue (version used to build the bsc release, vs. version one used while building Piccolo for Bluesim).  I have added a section at the bottom of the README that explains how to work around this.  Please try it; hopefully it works for you!

Apologies for the hassle. The is a C compiler version issue (version used to build the bsc release, vs. version one used while building Piccolo for Bluesim). I have added a section at the bottom of the README that explains how to work around this. Please try it; hopefully it works for you!
hi @rsnikhil can you please tell me where the readme file is?
Thank you


Multithread mode in Unity - ArgumentException: GCHandle value belongs to a different domain

Required Info

Camera Model
D435

Firmware Version
<IP_ADDRESS>

Operating System & Version
Win10

Kernel Version (Linux Only)
-

Platform
PC

SDK Version
2.17.0

Language
Unity C#

Segment
others

Issue Description
Argument Exception is randomly occurred when streaming is stopped.
Especially, When I use VideoFrame.CopyTo function in Update function, That problem is occurred more frequently.
However, this problem is only occurred when RsDevice is set to multithread mode. When I change multithread mode to unity thread mode, argument exception isn't occurred. I don't know why...
ArgumentException: GCHandle value belongs to a different domain
System.Runtime.InteropServices.GCHandle.op_Explicit (System.IntPtr value) (at <ac823e2bb42b41bda67924a45a0173c3>:0)
System.Runtime.InteropServices.GCHandle.FromIntPtr (System.IntPtr value) (at <ac823e2bb42b41bda67924a45a0173c3>:0)
Intel.RealSense.CustomProcessingBlock.ProcessingBlockFrameCallback (System.IntPtr f, System.IntPtr u) (at <4fd4dfd1857e4955a500c05c5081d4c2>:0)
Intel.RealSense.FrameSource.FrameReady (System.IntPtr ptr) (at <4fd4dfd1857e4955a500c05c5081d4c2>:0)
Intel.RealSense.FrameSource.FrameReady (Intel.RealSense.Frame f) (at <4fd4dfd1857e4955a500c05c5081d4c2>:0)
RsProcessingPipe.ProcessFrame (Intel.RealSense.Frame frame, Intel.RealSense.FrameSource src) (at Assets/RealSenseSDK2.0/Scripts/RsProcessingPipe.cs:103)
UnityEngine.Debug:LogException(Exception)
RsProcessingPipe:ProcessFrame(Frame, FrameSource) (at Assets/RealSenseSDK2.0/Scripts/RsProcessingPipe.cs:110)
Intel.RealSense.CustomProcessingBlock:ProcessingBlockCallback(IntPtr, IntPtr, IntPtr)
Intel.RealSense.NativeMethods:rs2_process_frame()
Intel.RealSense.CustomProcessingBlock:ProcessFrame(Frame)
RsDevice:RaiseSampleEvent(Frame) (at Assets/RealSenseSDK2.0/Scripts/RsDevice.cs:146)
RsDevice:WaitForFrames() (at Assets/RealSenseSDK2.0/Scripts/RsDevice.cs:159)
System.Threading.ThreadHelper:ThreadStart()

This should have been addressed, see this.
Happens when a managed callback is called from unmanaged code but the handle has been freed.
Not sure how VideoFrame.CopyTo is related here, we're already using something similar in RsStreamTextureRenderer.Update and RsPointCloudRenderer.Update without issues...
If this is still an issue I'll need to see more code to be of assistance.

During 3 weeks I upgraded unity version and changed camera to D415. I try to use multithread mode in unity today, and It works well. Now It's not issue. I appreciate your reply.

Same problem is occurred, I'm going to find what is problem in my sourcecode.

I want to get raw data of RGB, Depth, and Point Cloud because of image processing in Unity. So I merged '''RsStreamTextureRenderer.Update''' and '''RsPointCloudRenderer.Update'''. Then I copied vertices, RGB data, Depth data.

I updated realsense SDK to 2.24.0. The problem is not occurred now.


[FEATURE] Footer Enhancements

Description
Some additional information can be added to the footer of the webpage, like Release Version, Open Issues, etc.
Probable Solution
This can be achieved by embedding a markdown code for the badges we need in the streamlit app itself. We just need to take care of its dynamic nature, i.e., it should change when the values of the respective field (like Issue numbers, Release version) change.

hey can you provide more information like screen-shot of UI elements of footer how you want. so it is easier to understand and build


add rhcs_rosa_classic cluster import test case

Test case: https://polarion.engineering.redhat.com/polarion/#/project/OSE/workitem?id=OCP-65684
I noticed that there are parts of this specific test case that cannot be automated, are complicated and also interfere with other automated test cases that will run after (such as destroying the resource), hence, this test case will test the process of importing the cluster and checking the operation was successful.
the negative part of this test will be automated on a separate PR.
we can open a discussion on that if there are other opinions ofcourse :)

@amalykhi @xueli181114 @tshefi please review :) I will also appreciate your opinion on the way we should automate the test

/lgtm

/test rosa-sts-private-critical-high-presubmit
/test rosa-sts-advanced-critical-high-presubmit

/lgtm

/approve


Add Generic Get/Put for INetSerializable objects

Add Generic Get/Put for INetSerializable objects. This will let Serialize/Deserialize INetSerializable object in other INetSerializable object. Therefore, helping with code reusability and organization.

Usage example:
//Regular INetSerializable class
public Foo : INetSerializable
{
public int Value1;
public void Serialize(NetDataWriter writer)
{
    writer.Put(Value1);
}

public void Deserialize(NetDataReader reader)
{
    Value1 = reader.GetInt();
}

}
//INetSerializable that De/Serialize another INetSerializable as one of its members
public Bar: INetSerializable
{
public Foo FooObject;
public int Value2;
public void Serialize(NetDataWriter writer)
{
    writer.Put(FooObject);
    writer.Put(Value2);
}

public void Deserialize(NetDataReader reader)
{
    FooObject= reader.Get<Foo>();
    Value2 = reader.GetInt();
}

}

Cool! But replace tabs to spaces.

Will do! Sorry about that, we use tabs where i work and this is actually the first time contributing on a open source project.

@jblai but remember that new T() calls Activator.CreateInstance which calls reflection and works very slow

Interesting, I didn't know that. I've just seen this kind of functionality on UNET and DarkRift and found it useful in terms of compositing serializable objects. Would there be another way to achieve this?
Or should we put a warning in the documentation tags.
In the project i'm working in, we're not sending at constant and rapid intervals, just on demand in a average of 2-3 messages sent per second between server client. It's probably why we were not concerned much yet about it, but i'll take into consideration if you say so.

@RevenantX Was thinking about it this weekend. I guess the best way to achieve something similar is to implement GetFoo()/GetBar() as an extension to NetDataWriter for each the classes that implements INetSerializable. In that case, the actual constructor can be called instead of new T().
Kinda hard to put this into library... or maybe it can be documented in the documentation comments for Get()?


stdenv: Fix overriding + overrideAttrs

Motivation for this change
The old stdenv adapters were subtly wrong in two ways:

overrideAttrs leaked the original, unoverridden mkDerivation.

stdenv.override would throw away any manually-set mkDerivation
from a stdenv reverting to the original.

Now, mkDerivation is controlled (nearly directly) via an argument, and
always correctly closes over the final ("self") stdenv. This means the
adapters can work entirely via .override without any manual stdenv // ..., and both those issues are fixed.
Note hashes are changed, because stdenvs no previously overridden like
stdenvNoCC and crossLibcStdenv now are. I had to add some
dontDisableStatic = true accordingly. The flip side however is that
since the overrides compose, we no longer need to override anything but
the default stdenv from which all the others are created.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
21.11 Release Notes (or backporting 21.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

This break musl somehow:
./tools/install.sh -D obj/ld.musl-clang /nix/store/v27r72r03h873j895qg9phq4j6175msq-musl-static-x86_64-unknown-linux-musl-1.2.2/bin/ld.musl-clang
Moving /nix/store/v27r72r03h873j895qg9phq4j6175msq-musl-static-x86_64-unknown-linux-musl-1.2.2/bin/musl-gcc to /nix/store/iphgzmq6c5fi5pr84lh9sbzmhz8aikwa-musl-static-x86_64-unknown-linux-musl-1.2.2-dev/bin/musl-gcc
rmdir: failed to remove '/nix/store/v27r72r03h873j895qg9phq4j6175msq-musl-static-x86_64-unknown-linux-musl-1.2.2/bin': Directory not empty
Moving /nix/store/v27r72r03h873j895qg9phq4j6175msq-musl-static-x86_64-unknown-linux-musl-1.2.2/bin/musl-clang to /nix/store/iphgzmq6c5fi5pr84lh9sbzmhz8aikwa-musl-static-x86_64-unknown-linux-musl-1.2.2-dev/bin/musl-clang
rmdir: failed to remove '/nix/store/v27r72r03h873j895qg9phq4j6175msq-musl-static-x86_64-unknown-linux-musl-1.2.2/bin': Directory not empty
Moving /nix/store/v27r72r03h873j895qg9phq4j6175msq-musl-static-x86_64-unknown-linux-musl-1.2.2/bin/ld.musl-clang to /nix/store/iphgzmq6c5fi5pr84lh9sbzmhz8aikwa-musl-static-x86_64-unknown-linux-musl-1.2.2-dev/bin/ld.musl-clang
rmdir: failed to remove '/nix/store/v27r72r03h873j895qg9phq4j6175msq-musl-static-x86_64-unknown-linux-musl-1.2.2/bin': Directory not empty
Moving /nix/store/v27r72r03h873j895qg9phq4j6175msq-musl-static-x86_64-unknown-linux-musl-1.2.2/lib/musl-gcc.specs to /nix/store/iphgzmq6c5fi5pr84lh9sbzmhz8aikwa-musl-static-x86_64-unknown-linux-musl-1.2.2-dev/lib/musl-gcc.specs
rmdir: failed to remove '/nix/store/v27r72r03h873j895qg9phq4j6175msq-musl-static-x86_64-unknown-linux-musl-1.2.2/lib': Directory not empty
/nix/store/ak7vllbyx80qz6ifhjvipxgai7axsay9-x86_64-unknown-linux-musl-binutils-2.35.1/bin/x86_64-unknown-linux-musl-ld:INSTALL: file format not recognized; treating as linker script
/nix/store/ak7vllbyx80qz6ifhjvipxgai7axsay9-x86_64-unknown-linux-musl-binutils-2.35.1/bin/x86_64-unknown-linux-musl-ld:INSTALL:2: syntax error
collect2: error: ld returned 1 exit status
builder for '/nix/store/zwppa911qs55y0pv3xs1iyn7rqfa1ydm-musl-static-x86_64-unknown-linux-musl-1.2.2.drv' failed with exit code 1

@symphorien I think pkgsStatic.musl was broken before that.
I tried fixing it yesterday, but there are many things seemingly going wrong in the postInstall script...
cc @dtzWill @thoughtpolice (maintainers of musl)

well I rebased #133008 on this and got new failures due to that, so there must be a regression somewhere...

On the parent commit of this pr, pkgsStatic.hello build, but not on this commit. The failure involves musl but maybe it's a red herring, since as you pointed out pkgsStatic.musl has not been building for a long time.

@symphorien My guess is that this PR has just made the failure of pkgsStatic.musl apparent (i.e. happen when building other pkgsStatic packages - as if musl was used before, and now pkgsStatic.musl is).

OK fixed the issue.  Comparing it with nix-diff we see that since stdenvNoCC and crossLibcStdenv now pick up the overrides from stdenv, which means that Musl no longer was building the dynamic linker, which meant that the on-the-fly compilation of iconv was failing.
No, I am not sure why we want the dynamic build of Musl, but I didn't want to make a big behavioral change like that, so I just added dontAddStaticConfigureFlags = true instead.

I think this somehow removed pkgsStatic.__bootPackages:
> nix-build . -A pkgsStatic.stdenv.__bootPackages
error: attribute '__bootPackages' in selection path 'pkgsStatic.stdenv.__bootPackages' not found

Oh, I think this is happening because __bootPackages and __hatPackages are added to each stdenv stage using //.
https://github.com/NixOS/nixpkgs/blob/abeef13d12fbc2eecc75c1138bdcc0b9ad22b32d/pkgs/stdenv/booter.nix#L92-L96
So if stdenv is overridden, these extra attributes are discarded.

Yup that's why. I feel like the cure might be worse than the disease. In any event, I hope we might finally get away from that and the way bootstrapping is done today once https://github.com/NixOS/nixpkgs/pull/132343 is done.

I can confirm this ^ . Breaks enableDebugging too (since it calls keepDebugInfo).

Should enableDebugging still work? Comment says it should:
  # intended to be used like nix-build -E 'with import <nixpkgs> {}; enableDebugging fooPackage'
  enableDebugging = pkg: pkg.override { stdenv = stdenvAdapters.keepDebugInfo pkg.stdenv; };

Filed https://github.com/NixOS/nixpkgs/issues/136756

We should seriously consider simplifying the problem away. https://github.com/NixOS/nixpkgs/issues/136903#issuecomment-915883835
I have no confidence that we can use a redundant layer of overriding correctly.
tl;dr: we can remove the fixpoint we don't need by improving the one we do need, makingoverrideAttrs more powerful.

@bluescreen303 See #136756


Handle duplicate entries in converted dataframe

Hi @fahimirfanalam, I discovered an issue in pydicer where issues arose when there were multiple RTDOSE files for a patient. There was also an issue when re-converting data after having generated the auto-segmentations (the auto-segmentation tracking in pydicer was lost). Both issues should be resolved in this PR.
Would you mind reviewing the code and leaving an approval if you're happy with it? Thanks :)

Hi @fahimirfanalam, would you possibly have a chance to review (and approve) this soon? Thanks :)


Inconsistency in auto-configuration between spring-cloud-function-web and stream

See this stack overflow discussion for more details

The issue is related to the lifecycle phase where ContextFunctionCatalogAutoConfiguration gathers functional beans. Currently it is InitializingBean and gathers all functions in afterPropertioesSet, hence initiating their creation. However, if such function bean takes argument (e.g. MessageChannel, Source etc) it is not yet created/available due to the EnableBinding driven logic.


Update Project Gantt Chart view

Various updates to the code and the requirements

Q
A

Bug fix?
no

New sample?
no

Related issues?
No related issues

First of all, it is cleaner. The bar is no longer changing colours depending on the state of the task. It is just blue or lightblue, using the same shades of blue as Project for the web. And for the rest, this new version now supports/includes:

Milestones
Progressbar
Clicks to update the progress
Task description
Task assignment
Labels that move from right to left based on the amount of space.

Thanks for your contribution! Sharing is caring.

So Amazing!!!!!! Thank you very much🤩🤩✨

fixed #296


Appveyor support

This is #35 with some cleanup of setup.py. Visual C++ has a nifty auto-linking feature which means we don't need to care about the exact name of the boost library. Makes the code quite a bit more simple.
I've also tried to add python 2.7 to the matrix but that fails because half the include paths are missing. @alex85k you said that you had that working already. Is there any special treatment required?

Currently Python 2.7 tries to use extremely old Visual Studio. It can be switched to VS2015 by adding
SET VS90COMNTOOLS=%VS140COMNTOOLS%

to the build script. It will also need different boost_python lib+dll but it happens to be inside the development pack already.

Hmm, VS90COMNTOOLS not working... Testing more

Solved the puzzle with outdated VS  used for Python2.7. We have to make old compilers unusable so setuotools will not find it:
  - SET VS90COMNTOOLS=%VS140COMNTOOLS%
  - SET VS100COMNTOOLS=%VS140COMNTOOLS%
  - SET VS110COMNTOOLS=%VS140COMNTOOLS%
  - SET VS120COMNTOOLS=%VS140COMNTOOLS%
  - cd "c:\Users\appveyor\AppData\Local\Programs\Common\Microsoft\"
  - ren "Visual C++ for Python" "Visual C++ for Python Do Not Use"
  - cd "C:\Program Files (x86)\"
  - ren "Microsoft Visual Studio 9.0" "Microsoft Visual Studio 9.0 Do Not Use"

However, the boost-auto linking seems to not work this time:
https://ci.appveyor.com/project/alex85k/pyosmium/build/1.0.25
(or .lib is incorrectly generated)

It's actually the old compiler I want. python libraries must be built with the same compiler as the python interpreter and for 2.7 that happens to be this ancient VC9. I would expect that the boost-python libraries are built with that compiler as well.

Or maybe not. boost-python itself looks like they are building against VC14. I'm confused.
I'll commit the python3 part for now, so that there is something to start with.


Integrate namespace in SafeMath

Resolves #307.

Looks good! I suggested a function renaming. Why the rename of the test contract functions though?

I think using the actual method name is easier to follow especially when calling it in the tests contract.uint256_add() vs contract.test_add(). I can switch it back if you prefer the other way

No strong opinions


Add fast path for T::Props setters

Instead of figuring out what kind of type check we need to do for each setter at each invocation at runtime, we figure it out at prop definition time, and create an appropriate proc. We then use that proc with define_method to define a setter that doesn't need to go through the decorator, if there are no prop_set hooks (for which we check by the same mechanism we're now using for prop_get.)
To minimize divergent code paths, we still use this proc even when going through prop_set, via instance_exec. A new benchmark shows that this slow path is still marginally faster than the old implementation (~10%, but plausibly within the margin of error when generalizing past my laptop).
Motivation
A ~4x improvement in the fast path
Unfortunately neither models nor Chalk::ODM::Document can take advantage of this in pay-server currently because the implementation of soft_freeze relies on a prop_set hook, but at least this will help T::Struct users
This is also a building block for optimizations to constructors (in a later PR)
Test plan
Passing tests here plus in pay-server via https://git.corp.stripe.com/stripe-internal/pay-server/compare/djudd/t-props-setter-fast-path
(Note that there are still a couple cases I need to fix there, but I'm opening this for comment)

This is now passing the pay-server build except for some trivial changes to error messages.
(I pulled out some cleanup of prop_get that I'd originally stuck in here and will make it a separate PR.)


[BUG]: Space is not reflecting right on Unity

Bug Description
Citing the customer's problem statement:
Currently, we can read\write from and to the Unity XT 380F machine, the LUNS in the machine are still holding 2TB of data each, and on the application side (our k3s cluster) we can see that they should be 1TB each.
This issue from our side is backed up with local cli commands in the cluster, that indicates 1TB size for each LUN, we checked it with tools such as df -h.
The issue is that we are seeing in our Debian servers the LUNs with 1TB and on the Unity WebUI we are seeing 2TB, which means that the unity storage doesn't reflect the same status as the cluster.
Logs
All the relevant logs were submitted to Tech Support, Case number 172118799.
Screenshots
No response
Additional Environment Information
The customer submitted another issue on the same system today, #901
Steps to Reproduce
LUN deletion
Expected Behavior
Same LUN size to be reflected on Debian servers and on the Unity WebU
CSM Driver(s)
CSI Driver for Unity XT v2.1
Installation Type
No response
Container Storage Modules Enabled
NA
Container Orchestrator
Kubernetes v1.24.7
Operating System
Debian 10.9

Could this be because the NAS server is configured in an Active-Backup configuration so that CSI configures 1 TB LUN it actually configures 1 TB for the source NAS server and 1 TB for the destination NAS server in order to facilitate the LUN replication?

No as they are not using NAS in order to access the Unity .
Customers environment is block only, Debian servers with CSI  (K3s) are connected and access the LUNs by ISCSI.

In addition, the customer in this case is the submitter of the issue #901
His github nickname is oribenzvi5 and I may definitely share his contact details for further insights and direct communication.

/sync

Hello and thank you for the update.
The issue has been already worked and resolved about a month ago. It also ended up with KB article 000216326, kindly refer to it.
Regards,
Evgeniy Serebrier
Consultant, Service Account Manager
Dell Technologies | DT Services
Office: +972 3 350-1208
From: panigs7 @.***>
Sent: Wednesday, August 30, 2023 10:32 AM
To: dell/csm
Cc: Serebrier, Evgeniy; Mention
Subject: Re: [dell/csm] [BUG]: Space is not reflecting right on Unity (Issue #902)
[EXTERNAL EMAIL]
The issue is from the unity storage perspective and csi driver is behaving as expected. Customer was requested to raise ticket with the platform team.

Reply to this email directly, view it on GitHub [github.com]https://urldefense.com/v3/__https:/github.com/dell/csm/issues/902*issuecomment-1698645293__;Iw!!LpKI!nKcvatOqrW8mOT30kgSTT8P_fSdoDBGiFEUVn0QEf5A5iEQ4PfbG9QhoD5AN9T657HEr1TH9OSakp6J4YuqcAmJXfauK9w$, or unsubscribe [github.com]https://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/BBMBTC7DBT2ZDQUE7K5Y45TXX3T7ZANCNFSM6AAAAAA2QGFPVM__;!!LpKI!nKcvatOqrW8mOT30kgSTT8P_fSdoDBGiFEUVn0QEf5A5iEQ4PfbG9QhoD5AN9T657HEr1TH9OSakp6J4YuqcAmKbDIgr9A$.
You are receiving this because you were mentioned.Message ID<EMAIL_ADDRESS>Internal Use - Confidential

Thanks for the update! I will be closing the issue now.


VM boxes have different height

VM boxes in grid view have different height.

And on iPad then can appear blank space.

It's caused by non-standard dimensions of cake icon. We should specify set dimensions of containing element.

also when there is no OS (e.g. pool)


'debug adapter' error in jupyter notebook

Type: Bug
ACTUAL BEHAVIOR
When running debug on a particular cell in the notebook below, the debugging halts and an error message appears.
https://github.com/phlippe/uvadlc_notebooks/blob/master/docs/tutorial_notebooks/tutorial5/Inception_ResNet_DenseNet.ipynb
The cell is the one with the first line: imgs, _ = next(iter(train_loader)).
With a breakpoint on that cell, the debugger stops normally.  I then seek to step to the next line and then the debugger greys out VSCode and shows the following error message:
"Couldn't find a debug adapter descriptor for debug type 'Python Kernel Debug Adapter' (extension might have failed to activate)"
This occurs with multiple instances of the message:  "I also get a "Failed to launch debugger for child process XXX"
I ran the debugger for multiple cells above this cell and had no problems.  I've tried reinstalling and switching to the pre-release versions of both the Python and Jupyter extensions (both Microsoft) and restarting vscode each time.  The error occurs in all cases.  (BTW, I tried to submit this bug report by using 'Python: Report Issue', but I do not have that option.)
EXPECTED BEHAVIOR:
On debugging the cell, after stepping over the first line of code, the debugger should move to the 2nd line of code with no error message.
Extension version: 2022.20.1
VS Code version: Code 1.74.2 (e8a3071ea4344d9d48ef8a4df2c097372b0c5161, 2022-12-20T10:27:19.253Z)
OS version: Linux x64 5.10.0-20-amd64
Modes:
Sandboxed: No

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz (8 x 3247)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: disabled_offdirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okskia_renderer: enabled_onvideo_decode: disabled_softwarevideo_encode: disabled_softwarevulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: disabled_off

Load (avg)
1, 1, 1

Memory (System)
23.44GB (4.06GB free)

Process Argv
--unity-launch --crash-reporter-id d556c1c3-5a8d-4575-970a-2b1a16582954

Screen Reader
no

VM
0%

DESKTOP_SESSION
plasma

XDG_CURRENT_DESKTOP
KDE

XDG_SESSION_DESKTOP
KDE

XDG_SESSION_TYPE
x11

A/B Experiments
vsliv368cf:30146710
vsreu685:30147344
python383:30185418
vspor879:30202332
vspor708:30202333
vspor363:30204092
vswsl492:30256859
vslsvsres303:30308271
pythonvspyl392:30443607
vserr242cf:30382550
pythontb:30283811
vsjup518:30340749
pythonptprofiler:30281270
vshan820:30294714
vstes263:30335439
vscoreces:30445986
pythondataviewer:30285071
vscod805:30301674
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
cmake_vspar411:30581797
vsaa593:30376534
pythonvs932:30410667
cppdebug:30492333
vsclangdf:30486550
c4g48928:30535728
dsvsc012cf:30540253
azure-dev_surveyone:30548225
pyindex848cf:30577861
nodejswelcome1cf:30587006
3biah626:30602489
gswce1:30612156
iaj6b796:30613358
f6dab269:30613381
fim-prod:30623723
vscup:30628656

Here's a copy of my log from VS CODE start to attempted execution of the problematic line of code.  I can't tell what is triggering the problem.
vscode-app-1672085861288.log

I've found that by simply executing rather than debugging the cell that is giving me the above problem, many subsequent cells can be debugged without problems.  However, there is at least one other line of code that gives the 'debug adapter' error and it is near the start of a lot of lines I'd like to better understand using the debugger.  So now I cannot examine those lines because I cannot get past the new line giving me problems.  That line is the one that starts with:  trainer = pl.Trainer( ...

Evidently, the problem is due to the debugger having problems with multiprocessing.  I also get the "Failed to launch debugger for child process XXX" error once per multiprocessing thread.
I can make the error disappear by removing multiprocessing (where it is possible to do so).
I can debug the line imgs, _ = next(iter(train_loader)) without problems by altering train_loader to use no multiprocessing (that is, by removing 'num_workers=4').
That's mildly helpful.  However, most of the later code depends on Pytorch Lightening, specifically the pl.Trainer module, for which multiprocessing cannot be turned off--as far as I can tell.  So, I can't run the debugger on this code to better understand it.
I did find a suggestion on the web to add "subProcess": true, to my launch.json file.  This made no difference for me (I'm using the Community version of VSCode).

Note that using just one thread does not prevent the problem, multiprocessing has to be turned off entirely.  So, for example, if I set 'num_workers=1' in train_loader, the debugger problem occurs.  It only disappears with num_workers removed entirely.  As for pl.Trainer, even if I tell it to use one device (thread in case my case), I still get the debugger error.  There seems to be no way to turn of multiprocessing for pl.Trainer.  It would be tremendously helpful if the debugger would work if multiprocessing were set to just one thread.


Tool for loss surfaces?

Hello,
Could you disclose the tool you used for visualizing the loss surfaces of models in the publication?

They are plain matplotlib 3D plots (see https://matplotlib.org/mpl_toolkits/mplot3d/tutorial.html).

Got it, thank you!
Also, in this expression:

how do you pick the gradient from modelB that is in the orthogonal adversarial direction to g of modelA_adv? or am I missing something basic?

The gradient of modelB actually happens to be roughly orthogonal to that of modelA_adv so we don't have to do anything special here.

Oh, that's interesting. So what I tried was:

pre-train modelA_adv
pre-train modelB
generate x_star (notations from your publication) samples (using g and g_orthogonal, with the same epsilon=0.3), like this:

modelA_adv(x)
g = x.grad
modelB(x)
g_orthogonal = x.grad

x_star[i] = x + epsilon * (_g + _g_orthogonal)

run all x_star through modelA_adv and collect losses

Now, maybe for some trivial reason, I am stuck on how to plot the loss surfaces?
interpolate eps1 and eps2 between 0.0 - 0.3 and tri-surface plot them? or am I completely lost?

Yes, the typical workflow would look something like this (I haven't tested this specific code so there might be some small bugs):
import numpy as np
from mpl_toolkits.mplot3d import axes3d, Axes3D
from matplotlib import cm

# bounds for the x and y axis
x1, x2, y1, y2 = [0.0, 0.3, 0.0, 0.3]

# step size
h_x = (x2 - x1) / 100.0
h_y = (y2 - y1) / 100.0

# create a grid (of size 100x100) of (x,y) coordinates
xx, yy = np.meshgrid(np.arange(x1, x2, h_x), np.arange(y1, x2, h_y))

perturbs = xx.reshape((-1, 1)) * g.reshape((1, -1)) + yy.reshape((-1, 1)) * g_ortho.reshape((1, -1))

X_perturbs[i] = X[i] + perturbs.reshape((-1, X.shape[1], X.shape[2], X.shape[3]))

# evaluate the model on X_perturbs[i]
losses = ...

fig = plt.figure(figsize=(10, 8))
ax = Axes3D(fig, rect=[0.0, 0.0, 0.9, 1.0])
surf = ax.plot_surface(xx, yy, np.asarray(losses).reshape(xx.shape), cmap=cm.coolwarm,
                       linewidth=0, antialiased=False)
fig.colorbar(surf, shrink=0.5, aspect=5)
plt.show()

Thank you for clarifying. I tried it:
print(f'min loss: {min(losses)}, max loss: {max(losses)}')
fig = plt.figure(figsize=(10, 8))
ax = Axes3D(fig, rect=[0.0, 0.0, 0.9, 1.0])
surf = ax.plot_surface(xx, yy, np.asarray(losses).reshape(xx.shape),
                       cmap=cm.coolwarm, linewidth=0, antialiased=False)
fig.colorbar(surf, shrink=0.5, aspect=5)
plt.show()

which results in:
min loss: 0.0, max loss: 4.505677223205566

From the colorbar, I see that the losses need to be normalized or moved to some other scale, but for some reason, it does not give the landscape (like in the publication) :/

I get the idea behind and will look further for any mistakes I'm doing.
Thanks a lot for all the explanation.


chore: Docs/superset1.3 release notes

Release notes for Superset 1.3
Attempt to re-cycle @garden-of-delete 's Release Notes work in this branch:
https://github.com/apache/superset/pull/16106

@michael-s-molina thanks for proofreading ! applied all your change request :)


Radios: Impossible to use DOM API to update checked value and get Twine in sync

Consider this codepen @ http://codepen.io/qq99/pen/wgBBzL?editors=1010#0
2 radios, both bound to some Twine variable, and you want to, from somewhere else, say radioEl.checked = true.  However, Twine will not update state properly, even if you call Twine.refresh() after setting this.
Ideally, the API for such a thing would look like either:

radioEl.checked = true; and Twine reflects that state, but this would probably require https://developer.mozilla.org/en/docs/Web/API/MutationObserver (if that's the correct thing)
radioEl.checked = true; Twine.refresh() is more inline with workarounds we do today when bypassing Twine, but it doesn't work for this usecase

The only workaround today is:
radioEl.checked = true
$(radioEl).trigger('change')

cc @Shopify/tnt

Twine.refresh is designed to only output to the DOM, not read from it. The idea is that you change the JS variable rather than the element.
I assume you're asking this because of a 3rd-party library that is mutating the DOM without emitting events. What you need is for the change handler to be called. It would be possible to make a function that does this for all Twine-tracked elements. How necessary is this?

That's fair @pushrax
In this case, it was our own code mutating DOM via radioEl.checked = true, not a 3rd party lib.  I think it was an attempt to implement a delegated bind-event-click on a parent of many radios (bubbles up to container, code finds specific radio in child, tries to turn it on).  I guess the bug wasn't seen because it looked visually checked, but Twine didn't reflect it.
I can imagine other scenarios where 3rd party libs would do such things though.  I also imagine there must be at least one other spot in our JS hoping to do something similar (maybe we can search for .value = and .checked =)

How necessary is this?

not sure tbh, I think it's low in priority but I figured I'd log it with the codepen for posterity.  To be able to use DOM API directly and have Twine minimally just work is more of an "in the ideal world" thing for me.  Depends I guess on the future evolution of our JS FED system and Twine in general.
Rather than make a custom function for it, would mutation observers work? I guess the downside is browser support for those


Responsive img

img{width:auto;height:auto;-ms-interpolation-mode:bicubic}

But not all image responsible, may be usage .img-responsive instead all img

That could be a good idea. I'll look into it. Thanks for the suggestion!


Does the navigation commands considered

Thanks for your great work, but I am confused about the navigation commands?
As M represents the number of future positions of the ego vehicle that the model aims to predict, and the waypoint decoder pred M waypoints.
Does the navigation commands, such as "turn left", "turn right" and "go straight" in vad, considered? Thus should predict 3M waypoints?

In the initial version, we do not use the navigation commands. If you want to use the navigation commands, you should predict 3M waypoints.


Tabs not spaces in _config.yml lead to parsing errors

In the wiki page for the configuration file it states:

You cannot use spaces in configuration files. This will either lead to parsing errors, or Jekyll will use the default settings.

This does not seem true. I used tabs in my _config.yml
pygments: true

sitemap:
[tab]url: "www.example.com"

and got a parsing error. Replacing the tab with 2 spaces solved the issue.

Isn't that exactly as described in the wiki?

No? The wiki say you cannot use spaces. While it should say tabs.

Fixed it. Thanks!

np, you are welcome! Great lib!


Change BDN network MTU to 9000

Thanks, feel free to merge, as the deployment appears to have propagated. I used these runes for anyone interested in the future:
Updating MTU to 9000
# Prepare environment:
cd src/kayobe-config
git checkout BRANCH-NAME
git pull
source kayobe-env
export KAYOBE_VAULT_PASSWORD=**ASK SOMEONE**
cd ../kayobe
source ../../venv/kayobe/bin/activate

# Install the latest requirements
pip install -U .

# Add users_default ssh keys to stack and kolla users
kayobe overcloud host configure --tags users --kolla-tags none
(worked after updating hosts to seed2:overcloud2 inside src/kayobe/ansible/kayobe-ansibler-user.yml)

# Update the galaxy packages
kayobe control host upgrade

# Update network interfaces on the hosts
kayobe overcloud host configure --tags network --kolla-tags none

# Reconfigure neutron config
kayobe overcloud service reconfigure --kolla-tags neutron  --kolla-skip-tags common


chore: change translation engine of Crowdin

Summary
To switch the translation engine, the Google Machine Translation Engine ID is required

Please use small letters and fix in the message commit.
like this:
fix: change crowdin machine translation to google translate


API returns numbers from get that it can't parse when fed into update

I spin up a new cluster using GKE at version 0.9.2. Then I run:
$kubectl get minion  -o yaml > minion.yaml
This returns a yaml file:
apiVersion: v1beta1
creationTimestamp: 2015-02-03T01:16:46Z
hostIP:
id:
kind: Node
labels:
diskSize: "massive"
resourceVersion: 12
resources:
capacity:
cpu: "1"
memory: 4.0265318e+09
selfLink: /api/v1beta1/minions/
status:
conditions:

kind: Ready
lastTransitionTime: null
status: Full
uid: 526a4156-ab42-11e4-9817-42010af0258d

I delete the hostIp and status so that the update request won't get rejected (#3005 should fix that), then run:
$ kubectl update -f minion.yaml
ERROR: F0202 18:08:19.054514     767 resource.go:212] error unmarshaling JSON: json: cannot unmarshal number 4.0265318e+09 into Go value of type int
I'm not sure whether the marshaling or the unmarshaling is what needs to be fixed, but the API shouldn't be returning numbers that it can't parse.

It looks like Quantity is unmarshalling wrong?
On Mon, Feb 2, 2015 at 6:10 PM, Alex Robinson<EMAIL_ADDRESS>wrote:

I spin up a new cluster using GKE at version 0.9.2. Then I run:
$kubectl get minion -o yaml > minion.yaml
This returns a yaml file:
apiVersion: v1beta1
creationTimestamp: 2015-02-03T01:16:46Z
hostIP:
id:
kind: Node
labels:
diskSize: "massive"
resourceVersion: 12
resources:
capacity:
cpu: "1"
memory: 4.0265318e+09
selfLink: /api/v1beta1/minions/
status:
conditions:

kind: Ready lastTransitionTime: null status: Full uid:
526a4156-ab42-11e4-9817-42010af0258d

I delete the hostIp and status so that the update request won't get
rejected (#3005
https://github.com/GoogleCloudPlatform/kubernetes/issues/3005 should
fix that), then run:
$ kubectl update -f minion.yaml
ERROR: F0202 18:08:19.054514 767 resource.go:212] error unmarshaling JSON:
json: cannot unmarshal number 4.0265318e+09 into Go value of type int
I'm not sure whether the marshaling or the unmarshaling is what needs to
be fixed, but the API shouldn't be returning numbers that it can't parse.
--
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/issues/4041.

That's very likely. And sorry, I didn't realize yaml didn't paste into comments well. Here's the actual yaml:
apiVersion: v1beta1
creationTimestamp: 2015-02-03T01:16:46Z
hostIP: <ip>
id: <minion-id>
kind: Node
labels:
    diskSize: "massive"
resourceVersion: 12
resources:
  capacity:
    cpu: "1"
    memory: 4.0265318e+09
selfLink: /api/v1beta1/minions/<minion-id>
status:
  conditions:
  - kind: Ready
    lastTransitionTime: null
    status: Full
uid: 526a4156-ab42-11e4-9817-42010af0258d

Yeah, on the client-side, apparently, since the error is in kubectl/cmd/resource.go. It's possible that was missed during the Quantity refactoring.
https://github.com/GoogleCloudPlatform/kubernetes/blob/master/pkg/kubectl/cmd/resource.go#L212
It may be troublesome that the v1beta1 API accepts a util.IntOrString for resources rather than a Quantity:
https://github.com/GoogleCloudPlatform/kubernetes/blob/master/pkg/api/v1beta1/types.go#L635

/cc @vishh

The (external) yaml library that we use is the cause for this. I will send a patch to fix the yaml library.

Sent a PR to our yaml dependency.

If we are only fixing our yaml unmarshalling, we are still losing precision.
E.g.
The yaml that Alex posted above is supposed to be representing 3.75 GiB.
3.75 GiB * 2^30 =<PHONE_NUMBER>, which we are representing as 4.0265318e+09.
The amount of memory we are "losing" here is trivial, but if this is actually using scientific notation, we could be rounding up half the time as well (creating a very very low chance of an unexpected OOM).
Both of these are pretty small problems, but it seems silly to needlessly lose precision.
Can we just not write these in scientific notation?

Resource quantities must be lossless.
On Wed, Feb 4, 2015 at 11:20 AM, CJ Cullen<EMAIL_ADDRESS>wrote:

If we are only fixing our yaml unmarshalling, we are still losing
precision.
E.g.
The yaml that Alex posted above is supposed to be representing 3.75 GiB.
3.75 GiB * 2^30 =<PHONE_NUMBER>, which we are representing as 4.0265318e+09.
The amount of memory we are "losing" here is trivial, but if this is
actually using scientific notation, we could be rounding up half the time
as well (creating a very very low chance of an unexpected OOM).
Both of these are pretty small problems, but it seems silly to needlessly
lose precision.
Can we just not write these in scientific notation?
--
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/issues/4041#issuecomment-72919684
.

+1. These are supposed to be strings, not integers nor floats.

What does -o json return?

{
    "kind": "Node",
    "id": "k8s-arob-node-2.c.cloud-kubernetes-dev.internal",
    "uid": "526a4156-ab42-11e4-9817-42010af0258d",
    "creationTimestamp": "2015-02-03T01:16:46Z",
    "selfLink": "/api/v1beta1/nodes/k8s-arob-node-2.c.cloud-kubernetes-dev.internal",
    "resourceVersion": 363,
    "apiVersion": "v1beta1",
    "resources": {
        "capacity": {
            "cpu": "1",
            "memory":<PHONE_NUMBER>
        }
    },
    "status": {
        "conditions": [
            {
                "kind": "Ready",
                "status": "Full",
                "lastTransitionTime": null
            }
        ]
    },
    "labels": {
        "disksize": "massive"
    }
}

{
    ...
    "resources": {
        "capacity": {
            "cpu": "1",
            "memory":<PHONE_NUMBER>
        }
    },
}

That does look like an API bug. It should be a string, IIUC.

Legacy CPU and memory are int and int64, respectively.
Resource.Quantity should always produce strings.

This can't possibly work. IntOrString is a 32-bit signed int. This value doesn't fit in 32 bits.

#2264

Yes - this isn't a problem with the YAML library. This is a problem with trying to render a number larger than 32 bits<PHONE_NUMBER>) as a 32-bit integer (IntOrString), which instead ends up rendering as a floating point. #2264 (or something that keeps this value as a 64-bit integer the whole time) is the right fix.

@ghodss: The yaml library converts an int64 into a float64 as part of Marshal. Isn't that an issue with the yaml library? I agree that the kubernetes API has another issue which is that of not being able to represent resources greater than MaxInt. But to me these are two separate issues.

@ghodss: Even an int32 gets marshaled into a floating point number. I don't see how that is valid. The underlying golang json package has separate APIs to address this behavior and the YAML library will also have to do that.

IntOrString stores things as "int", which is 32 or 64 bits depending on the platform. We should explicitly use int32 or int64 in our api objects.
These values should be stored as a Quantity in v1beta3, and converted to a string in v1beta1 & 2.

@dbsmith: Ack
On Fri, Feb 13, 2015 at 1:29 PM, Daniel Smith<EMAIL_ADDRESS>wrote:

IntOrString stores things as "int", which is 32 or 64 bits depending on
the platform. We should explicitly use int32 or int64 in our api objects.
These values should be stored as a Quantity in v1beta3, and converted to a
string in v1beta1 & 2.
—
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/issues/4041#issuecomment-74330057
.

If someone changed IntOrString to use int64 I would approve.
On Fri, Feb 13, 2015 at 1:32 PM, Vish Kannan<EMAIL_ADDRESS>wrote:

@dbsmith: Ack
On Fri, Feb 13, 2015 at 1:29 PM, Daniel Smith<EMAIL_ADDRESS>wrote:

IntOrString stores things as "int", which is 32 or 64 bits depending on
the platform. We should explicitly use int32 or int64 in our api objects.
These values should be stored as a Quantity in v1beta3, and converted to
a
string in v1beta1 & 2.
--
Reply to this email directly or view it on GitHub
<
https://github.com/GoogleCloudPlatform/kubernetes/issues/4041#issuecomment-74330057

.

--
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/issues/4041#issuecomment-74330621
.

@thockin: Assigned #2264 to myself.


Knative integration takes too long to make the service ready

When trying to create a Knative integration I observe that the Knative service is taking too long to get to ready state and sometimes its struck in RevisionMissing state.  This happens in both --dev mode as well as in production mode. This is highly inconsistent as sometimes it refreshes the state of the service soon but after few runs its starts to get hung .
It is also noted it takes very long time to trigger the service deployment after we call kamel run, wondering something to do with Knative Serving reconcilation ? There should be a way to force the knative recocilation, so that new reivision is updated with Ready state as soon as possible.
Example integation:
- from:
    uri: "knative:endpoint/echoer"
    steps:
      - log:
          message: "Got Message: ${body}"
      - convert-body: "java.lang.String"
      - choice:
          when:
            - simple: "${body} != null && ${body.length} > 0"
              steps:
                - set-body:
                    simple: "${body.toUpperCase()}"
                - set-header:
                    name: ContentType
                    simple: text/plain
                - log:
                    message: "${body}"
          otherwise:
            steps:
              - set-body:
                  constant: "no body received"
              - set-header:
                  name: ContentType
                  simple: text/plain
              - log:
                  message: "Otherwise::${body}"

Sample output of ksvc
NAME     URL                                         LATESTCREATED   LATESTREADY   READY     REASON
echoer   http://echoer.knativetutorial.example.com   echoer-kpcmz                  Unknown   RevisionMissing

I also observe that in these cases the containerConcurrency of the ksvc and its related configuration is set to 0.  Wondering this is causing the revision not to become ready immediately ??
CC: @nicolaferraro

I've hit the issue of services taking a long time to deploy on minikube, I've opened this: https://github.com/knative/serving/issues/5802, but no luck.
I'm not experiencing the issue anymore after I started to follow the exact procedure when installing Knative, like:

using the suggested minikube/kube version
using the exact istio version, with no injection
installing the full monitoring stack

I've also noticed that sometimes the service state is not aligned with the pod state but didn't investigate becaus the service was running in my case. Will try to figure out.

using the suggested minikube/kube version

you mean as per Knative upstream docs ? I am doing exactly the same my start script for minikube is
#!/bin/bash

set -eu

PROFILE_NAME=${PROFILE_NAME:-knativetutorial}
VM_DRIVER=${VM_DRIVER:-virtualbox}
MEMORY=${MEMORY:-8192}
CPUS=${CPUS:-6}

EXTRA_CONFIG="apiserver.enable-admission-plugins=\
LimitRanger,\
NamespaceExists,\
NamespaceLifecycle,\
ResourceQuota,\
ServiceAccount,\
DefaultStorageClass,\
MutatingAdmissionWebhook"

minikube start --memory=$MEMORY --cpus=$CPUS \
  --kubernetes-version=v1.14.0 \
  --vm-driver="$VM_DRIVER" \
  --disk-size=50g \
  --extra-config="$EXTRA_CONFIG" \
  --insecure-registry='<IP_ADDRESS>/24'

I usually the problem more often when you try updating the service with updates either via redeploy or  in --dev mode

using the exact istio version, with no injection

yes injection is diabled and I use the istio-lean install

installing the full monitoring stack

Dont know why this is needed ? With 8GB RAM this will not make us to run any other applications :(

Can we more narrow down what component/event takes long time? For example:

Examine event logs during the deploy - kubect get event -w.
Investigate controller logs - kubectl -n knative-serving logs controller-xxx -c controller. (like https://github.com/knative/serving/issues/5802 did.)

Also, it would be worth to look into some suspicious stuff like:

CPU/memory usage on the host to verify no problem - $ top.
The status of sub resource in the cluster. - eg. the log says RevisionMissing, but kubect get rev -o yaml shows anything?)

releated to #1172

@kameshsampath @nak3 I remember I had some issues in the past similar to this one and were related to the default requests that knative sets-up. Lowering them did fix the issue.

Fixed by #1259 (which reference images directly via digest, so that Knative does not try to contact the registry to find it)


[Issue-1330] - adds missing capabilities

fixes #1330

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/incubator-trafficcontrol-PR/376/

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/incubator-trafficcontrol-PR-trafficops-test/333/


[Toolkit feature]: Popup windows (or checkbox) asking to delete original asset when replacement asset is imported

Contact Details (Optional)
No response
What is the context of the feature/improvement?
Would really like a Popup windows asking if we want to delete original asset when a new 3D asset is imported/replaced (convenience for asset replacements) Or a checkbox with the same option whenever a new 3D asset is imported.
Please describe the feature/improvement?
As described above
What would be your solution? (optional)
...
Version
2024.1.1

Hi,
"Would really like a Popup windows asking if we want to delete original asset"
Can you explain why? Like, the reason.
There is a button to reset an asset.

Hi,
"Would really like a Popup windows asking if we want to delete original asset"
Can you explain why? Like, the reason.
There is a button to reset an asset.

Because it would help a lot when replacing the vanilla "parent", to automatically delete or hide it when spawning a replacement mesh. Or maybe my thought process about this is wrong?

Hi,
To replace an asset, you don't need to "Add mew reference" + "Remove the original".
You can directly replace the path of the selected asset:


Hidden comment (spoiler) still available to see at dashboard page.

It may be matter of cache, but I saw comment in dashboard that I recognized as spoiler. I flagged it so, and is now hidden:

but at main page still is available to see:

Ok, nevermind, it is hidden now. Sorry for bother you!

This is some kind of caching issue. I've seen similar thing many times, it takes a minute to actually hide the spoiler content.


Inconsistancy in naming

https://github.com/ntucllab/striatum/blob/master/striatum/bandit/bandit.py#L35
The attributes here have underline in the front
https://github.com/ntucllab/striatum/blob/master/striatum/bandit/bandit.py#L35
While others have them in the end
It seems underline in the front means protected members, though there is access
of these attributes in the test file. I think we should keep them in the end?

The two links are the same.
We should first think about whether we need to protect them.

Only the generators in Exp3 and UCB1 use suffix _, but they will be removed after resolving #89


Create v10.2 release

Background
After the v11 mainnet release happens, we should tag v10.2. The core item in it is #2268 which fixes the issue in the v10.1 line
We are currently holding off on releasing it until after v11 upgrade, to mitigate chaos in upgrading.

Closed!


v1.6.3 hasn't been released on PyPi

The latest version on the PyPi is still 1.6.2 https://pypi.org/project/blinker/#history

Now fixed.


Add MicroTVM support for the STM32F746 Discovery board

This one line patch adds support for the ST STM32F746 Discovery board with µTVM.
Signed-off-by: Tom Gall<EMAIL_ADDRESS>

@areusch @gromero

@areusch @gromero

@tom-gall want to add discovery board to the list of supported boards? in practice I think we'll likely distribute this elsewhere in the future, but for now it'd be nice to keep it up to date.

@tom-gall want to add discovery board to the list of supported boards? in practice I think we'll likely distribute this elsewhere in the future, but for now it'd be nice to keep it up to date.


[ADVISOR-2338] Create systems table

This PR adds a modal when you click the Run Task button from the "Available tasks" tab on the tasks page. This modal should have details about the task and a system table.
This PR does not include the toolbar (other than the pagination) because tasks api does not support filtering and sorting yet. The code for filters is commented out for now and will be switched over when supported in the api.

Codecov Report

Merging #14 (9a91875) into master (9feb4da) will decrease coverage by 4.72%.
The diff coverage is 38.46%.

@@            Coverage Diff             @@
##           master      #14      +/-   ##
==========================================
- Coverage   87.78%   83.06%   -4.73%
==========================================
  Files          31       35       +4
  Lines         614      679      +65
  Branches      199      213      +14
==========================================
+ Hits          539      564      +25
- Misses         72      104      +32
- Partials        3       11       +8

Impacted Files
Coverage Δ

src/SmartComponents/SystemTable/hooks.js
7.69% <7.69%> (ø)

src/SmartComponents/SystemTable/helpers.js
16.66% <16.66%> (ø)

src/SmartComponents/RunTaskModal/RunTaskModal.js
62.50% <58.33%> (-12.50%)
:arrow_down:

src/SmartComponents/SystemTable/SystemTable.js
61.11% <61.11%> (ø)

src/SmartComponents/SystemTable/constants.js
75.00% <75.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9feb4da...9a91875. Read the comment docs.

@mkholjuraev I'll leave the anonymous function thing undone. Could you give this an approval if you do approve?