Tasks in  state TASK_LOST should expunged by marathon?

I found when mesos slave is down , the task in that node become TASK_LOST in marathon, and marathon will rebuild the lost task, should  marathon expunge the lost task?
otherwise when I delete the APP will cause like "Cannot kill task XXX because it is unknown; performing reconciliation" and at the meantime I can‘t create the APP with the same name.

Just a question, which Mesos version are you using? I got the same problem when I upgraded Mesos to 1.0.0, then I downgraded Mesos back to 0.28.2 because of it.

Mesos version 1.0.0, you mean  Mesos  0.28.2  is good?

Since Marathon didn't release any version after Mesos 1.0.0, I thought it was some kind of incompatibility. At least with Mesos 0.28.2 the problem didn't happen with me. I guess you should give a try. :)

OK,  I will have a try, thanks for your suggestion :)

Hi @kongbo1987,
which version of marathon are you using? Can you post the marathon logs around the slave lost timestamp?
Thanks
Johannes

I have same issue:
OS: Centos 7
Mesos: Package mesos-1.0.0
Marathon: Package marathon-1.1.2
Is it possible to install marathon 1.2 or 1.3 from the rpm similar to Mesos:
yum -y install --enablerepo=mesosphere-unstable mesos

We have the same issue:
OS: Ubuntu 14.04
Mesos: 0.28.2
Marathon: 1.1.2
If a worker goes down, the tasks on it get stuck in a Starting or Unknown state in the Marathon UI. Unable to remove those tasks.
I notice that there is mention of a fix for TASK_LOST behaviour in the 1.3.0 changelog here that will be backported? Any news about that?
Upgrading to 1.3.0 is quite difficult for us with the requirement that we shut down all Marathon instances and also do a major Mesos upgrade.

Apologies, what we were seeing was the new TASK_LOST behaviour. After setting the task_lost_expunge parameters to smaller values, the tasks got cleaned up. These parameters don't seem to be documented in the official documentation website yet, but you can see them here.

@JayH5 good catch. thanks

@meichstedt @gkleiman sounds like we need some docs for new features, probably should land in 1.3?

Seeing similar issues with mesos 0.28.2 with marathon 1.1.2, voting here for back porting fix to 1.1.2.
Its not possible for us to upgrade to mesos 1.x right now.

Looks like (version 1.1.2) expunge is only triggered on leader election and those new options take effect, reconciliation settings are default.

Need to reduce --task_lost_expunge_interval also. Working now as expected.
--task_lost_expunge_gc 180000 --task_lost_expunge_initial_delay 120000 --task_lost_expunge_interval 300000

@r4um it works for me .  marathon-1.1.2 mesos-1.0.1, and add --task_lost_expunge_gc 180000 --task_lost_expunge_initial_delay 120000 --task_lost_expunge_interval 300000. the TASK_LOST  gone

@r4um same issue. It's very useful for me, thanks.

I had this issue on a bunch of different marathon deployments, and the '--task_lost_expunge_*' settings fixed the problem in every one of them.
Probably worthy setting those properties as the default or making sure they're documented in the main marathon documentation, and then close this issue.

With 1.4 one can define expunge behaviour per App. That should solve this issue.


Product specification: Authorisation

Product specification: Authorisation
User authorisation in BRISKHOME should be based on session mechanics. Sessions should have an expiration date set to 1 year in the future and prolong automatically upon reaching a middle point between date of issue (prolongation) and date of expiry.
JSON Web Tokens should be used to hold session information, both client side and server side. Example payload of such JWT:
{
  "iss": "BRISKHOME",
  "sub": "testuser",
  "azp": "device_uuid",
  "aud": "server_uuid // certificate fingerprint base64'd",
  "iat": "1433978353",
  "exp": "1433981953",

  "email"<EMAIL_ADDRESS>  "name" : "Test User"
}

The application should have an open section (with onboarding and access-denied pages) and a closed section (containing the webapp itself). When an unauthorised user attempts to access the closed section they should be redirected to access-denied page.
Update: Session considerations

Using JWT for sessions is an overkill. Why? Because even if we used JWT we still would query the database each time to deserialize user from JWT payload.
We should use long unique strings (tokens) for sessions. When a session is issued it should be linked to a particular user with all relevant information like browser fingerprint, device name etc.
JWT tokens are great for passing signed data between parties. In our scenario we only have one party. So I guess using random strings for tokens is good enough.

Tasks and decomposition
Use sessions in web application – 6 tasks

[ ] feat(core.config): support configuration via environment variables
[x] feat(core.webapp): add mongo-based sessions (#106)
[ ] feat(core.webapp): add unauthorised section (#125)
[ ] feat(core.webapp): display logged in user info in the interface
[ ] feat(core.webapp): serve closed section of the webapp via HTTPS
[ ] feat(core.pki): generate self-signed root certificate on install

User section – 1 task

[ ] feat(core.webapp): display all active sessions and allow session revokation

User widget – 2 tasks

[ ] refactor(core.webapp): redesign a user widget to be responsive
[ ] feat(core.webapp): allow all types of user operations via widget

Login and Onboarding (Initial registration) – 4 tasks

[ ] feat(core.config): implement saving updated plugin configuration (#54)
[ ] feat(core.webapp): disable onboarding when initial setup is complete
[x] feat(core.webapp): add login page (#118)
[ ] feat(core.webapp): add onboarding page

Documentation – 1 task

[ ] docs(core.webapp): describe user authorisation

While using sessions for user authentication is sufficient a problem of user authorisation (especially checking permissions) still stands. One of the options for authorisation is presented in this repo and it requires almost no additional actions from a client.


feat: update scheduler PeerResult validation

Signed-off-by: Gaius<EMAIL_ADDRESS>
Description

Update scheduler PeerResult validation.

Related Issue

Motivation and Context

Screenshots (if appropriate)
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Documentation Update (if none of the other choices apply)

Checklist

[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.

Codecov Report

Merging #1294 (77bb97d) into main (e8a7df5) will decrease coverage by 0.10%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #1294      +/-   ##
==========================================
- Coverage   46.29%   46.19%   -0.11%
==========================================
  Files         137      137
  Lines       11625    11625
==========================================
- Hits         5382     5370      -12
- Misses       5651     5663      +12
  Partials      592      592

Flag
Coverage Δ

Object-compatibility-e2etests
?

unittests
46.19% <ø> (-0.11%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

client/daemon/peer/peertask_piecetask_poller.go
47.10% <0.00%> (-3.63%)
:arrow_down:

...ent/daemon/peer/peertask_piecetask_synchronizer.go
44.10% <0.00%> (-1.03%)
:arrow_down:

client/daemon/peer/peertask_conductor.go
58.04% <0.00%> (-0.84%)
:arrow_down:

scheduler/service/service.go
83.33% <0.00%> (+0.63%)
:arrow_up:


tests

added .travis.yml
added tox support
use pytest for testing
setup tests for Python 2.7 and several 3.x versions
re-organized tests into its own tests directory
separated integration from unit tests
added test dependencies into requirements-tests.txt
updated .gitignore rules
added Python3 classifiers (integration tests pass Python 3 so code is supposed to work)
added unit test for stencil.tokenise

@funkybob if you like this structure I'll continue adding unit tests (code coverage is now 34% (+1%)).

helps with #9

Ideally, also, the hand-crafted test loop should be broken out into proper test method.

travis-ci.org report here


Setting Page - Other Settings - Account Print Preview

Make preview with actual data / Sample Data
User wants to know how it would look with actual data,
So preview should be with sample or Actual data
Initiated by @vinpahilwani
Verified by @mitulpanch

This will take 4-5 days to develop with sample data


Swift syntax error in generated model files

Describe the bug
The generated models are having partly some syntax error:

'Invalid redeclaration of 'init(XXX'.

I cleaned the workspace, re(installed) pods for this project, deleted the generated models and run again 'amplify codegen models'
In the case, you want to download my graph.ql this my app id dl91s1m9oit3p and the region is us-east-1.
Steps To Reproduce
Steps to reproduce the behavior:

Project Dependencies:
AWSAuthCore (2.24.3)
AWSCognitoIdentityProvider (2.24.3)
AWSCognitoIdentityProviderASF (2.24.3)
AWSCore (2.24.3)
AWSMobileClient (2.24.3)
AWSPluginsCore (1.12.0)
AWSS3 (2.24.3)
Amplify (1.12.0)
AmplifyPlugins (1.12.0)
AppSyncRealTimeClient (1.5.0)
SQLite.swift (0.12.2)
Starscream (3.1.1)

Pulling from backend and generating model files:
1. $ amplify pull --appId dl91s1m9oit3p --envName staging
✔ Successfully received Amplify Admin tokens.
2.Choose your default editor: Xcode (Mac OS only)
3.Choose the type of app that you're building iOS
4.Do you plan on modifying this backend? Yes
✔ Successfully pulled backend environment staging from the cloud.
-- ✅ Amplify project found.
-- ✅ Amplify config files found.
-- ✅ Successfully updated project
🚫 folderNotFound: Amplify generated models not found
$ amplify codegen models

GraphQL schema compiled successfully.
Successfully generated models.

Open Xcode, build and run: Syntax error..

Expected behavior
Compiling the Xcode project successful.
Amplify Framework Version
1.12.0
Amplify Categories
API
Dependency manager
Cocoapods
Swift version
5.0
CLI version
5.1.2
Xcode version
12.5.1
Relevant log output
No response
Is this a regression? (i.e. was this working before a version upgrade)
No response
Device
iPhone 12 - simulator
iOS Version
14.5
Specific to simulators
No response
Additional context
No response

@nielsautrata even though manually editing generated models is something we usually discourage, as a temp workaround you can manually remove the internal initializer while the fix in this PR gets released https://github.com/aws-amplify/amplify-codegen/pull/205#pullrequestreview-714074600

I'll optimistically close this issue as a PR has been published, but feel free to re-open it if you have further questions


Update crate for Rust 2018

Run 'cargo fix --edition' to update crate for Rust 2018.
Run 'cargo fmt' to format code

nice job

btw, It'll not work untill to update this submodule of CITA
Thanks!


Possible to limit POPs to those within a particular region?

I would like to use FD, but due to regulatory requirements I can only host within the US regions.  Is it possible to restrict FD to only deploy my apps to edge nodes within the US regions?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f7be424c-f540-a753-6ecc-6ff3913368d5
Version Independent ID: dc80b25f-374d-8775-16e7-ae7d57b4b94f
Content: Azure Front Door Service - Frequently Asked Questions for Front Door
Content Source: articles/frontdoor/front-door-faq.md
Service: frontdoor
GitHub Login: @sharad4u
Microsoft Alias: sharadag

@markarnolditpro , Thank you for posting here. Will review and get back to you.

@markarnolditpro , This isn’t supported and usually CDNs or reverse proxies do not work this way.You can deploy their app in US regions only and so the database, app compute etc. can all stay in US. AFD only acts as a reverse proxy and doesn’t store any content in POPs other than the request processing.

@markarnolditpro , I will go ahead and close this issue. If you have any further questions, please tag me.


Rate Limiting Queue

You can now pass in a "limiter" to a queue, for example:
queue = Queue("test_queue", limiter={"max": max, "duration": duration})

The queue will start at most max tasks in any given duration seconds.
This is useful when submitting jobs to rate-limited APIs.
For example, if your API only accepts 100 requests per minute, set a max of 100 and a duration of 60.

First comment - can we make it milliseconds?

First comment - can we make it milliseconds?

I switched the type to float--that way it's consistent with other Python duration APIs like sleep or DBOS.sleep that expect a float time in seconds.


Works Well

Hi kamilkp,
this is not an issue but rather a comment to say that this autogrow Angular directive works really well. I have tried other angular directives but the problem I had with them all was autogrow doesnt work when the model is updated dynamically via $http. But your directive works perfect.
Thanks for sharing this. :)
Cheers,
Neel.

Nice to hear that Neel. I also want to use because I update my model dynamically with $http but I'm having trouble getting it started. All you do is include the angular-autogrow.js file and add the autoheight attribute to the textarea. Correct?

Hi @lakartoza , Yes. I did the following to get it to work:

I include the angular-autoheight.js file
I add the autoheight module dependancy and
Added the autoheight directive to the textarea.


Readiness probe failed: cat: /var/run/container.ready: No such file or directory

Once deploy azdata bdc create --config-profile custom --accept-eula yes
Pod Name: mgmtproxy-7jk75 event log displays following.
Readiness probe failed: cat: /var/run/container.ready: No such file or directory
Please let me know how to resolve this issue

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 3f789883-5a24-a045-21d5-4b95951cb798
Version Independent ID: fadbef40-b033-7e4f-533a-abd7a8e303db
Content: Deployment guidance - SQL Server Big Data Clusters
Content Source: docs/big-data-cluster/deployment-guidance.md
Product: sql
Technology: big-data-cluster
GitHub Login: @MikeRayMSFT
Microsoft Alias: mikeray

@marasinghe82 -- Jinesh, thank you for your feedback.  To make sure we have all the information needed to process your issue, please provide more context around your general task.  Meanwhile, you may find answers here:

DBA Stack Exchange
Stack Overflow

Duplicate of closed issues #4158 and #4159

Dear Wiliam,
I have setup 3 node cluster using following guideline and it's working   as required
https://docs.microsoft.com/en-us/sql/big-data-cluster/deploy-with-kubeadm?view=sql-server-ver15
After have created custom config using following script
azdata bdc config init --source aks-dev-test --target custom
default Storage clasee
cat > storage-class.yml <<EOF
kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
name: default
provisioner: kubernetes.io/no-provisioner
volumeBindingMode: WaitForFirstConsumer
EOF
kubectl create -f storage-class.yml
root@k8s-master:~# kubectl get svc controller-svc-external -n mssql-cluster
NAME                      TYPE           CLUSTER-IP     EXTERNAL-IP   PORT(S)           AGE
controller-svc-external   LoadBalancer   <IP_ADDRESS>        30080:31707/TCP   37m
root@k8s-master:~#
root@k8s-master:~#
root@k8s-master:~# azdata login --endpoint https://<IP_ADDRESS>:30080 --username admin
Password:
Logged in successfully to https://<IP_ADDRESS>:30080 in namespace mssql-cluster. Setting active context to mssql-cluster.
root@k8s-master:~# azdata bdc status show
(404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Connection': 'close', 'Date': 'Mon, 24 Feb 2020 04:32:35 GMT', 'Content-Type': 'application/json', 'Content-Length': '167'})
HTTP response body: {"code":404,"reason":"BDC mssql-cluster does not exist.","internalStatus":"NOT_FOUND_BDC","help":"https://docs.microsoft.com/en-us/sql/sql-server/sql-server-get-help"}
also I have notice following on my POD "mgmtproxy-5qv7p" event
Readiness probe failed: cat: /var/run/container.ready: No such file or directory
kubelet k8s-worker-node1
spec.containers{service-proxy}
6
2020-02-24T04:43 UTC
2020-02-24T04:44 UTC

@marasinghe82 -- Jinesh, thank you for clarifying.  This repo is for documentation issues, with limited technical support.  Please try the following:

All the ways to get help

I am closing this issue now.  You are welcome to @ mention me for any followup.  We hope to hear from you again.

It would be helpful to get a link to the technical support bug that fixed this. I am facing the same issue, how was this resolved? @marasinghe82 , did you find a fix or workaround?


Remove incomplete error state in transaction_new

Discovered what looked like a potential memory leak in the 'error' state of transaction_new. However it wasn't actually possible to hit this state without a programmer error (utils_intToText will never fail with a length 6 buffer and a uint16_t int)... but the state did exist and didn't properly clear up. One option was to correct it, so that it cleaned up properly:
error:
    LOG("Exiting on failure");
    if(transacP->message)
    {
        coap_free_header(transacP->message);
        lwm2m_free(transacP->message);
    }
    lwm2m_free(transacP);
    return NULL;

But I figured it was cleaner to just remove the unused & incomplete code.

I'm torn between approving of removing code paths that can't be executed and disapproving of the removal of error checking that could catch future problems. I'm leaning toward approval. Any other opinions?

Classic dilemma.
I guess this is a bet based on :

cost of checking
risk prevented by this check

My 2 cts in this case : I feel that cost checks is very low but in a meantime I don't to see which kind of risk it could concretely prevent.(but maybe I just missed it)
So I would rather go for removing. (Clearly not strong opinion)

@qleisan  any opinion about this ?

The potential malloc runtime error is handled and that is great. Potential runtime errors should always be checked and handled.
Removal of the check for result == 0 is questionable I think. Programming errors cannot / should not always be checked for but in this case it is a) a pattern used on many other places when the function is called b) a call to a function that explicitly returns 0 in several places. If the result == 0 check is removed I think a comment should be added to help others feel good about this when reading the code, It does get cleaner without the check...

I'm not sure we helped @CiaranWoodward to know what he should do :sweat_smile:
My understanding :  I feel that the team is not totally comfortable with the idea of removing the check
But  this sounds clearly not to be a strong opinion.
So @CiaranWoodward, I guess this is up to you to decide what to do :

either keep the error check
or remove it (but in this case a comment would be appreciated)

@sbertin-telular, @qleisan  do not hesitate to correct me if I misunderstood the situation.

Hi, apologies for being pretty silent here. I'll take another look and see if I can find a more graceful fix - can always fall back to the snippet I posted in the initial comment.
What is this project's stance on `assert``s? I noticed that there weren't any in the codebase, but they can be a good way to catch coding errors. Any thoughts?

I looked into it and seeing as it isn't that big of a deal for code size or stability, I reverted 25e495b5e76b1eec6b366e34938dc3a5abebfa04 and replaced it with the snipped from the comment. It does still seem out of place to me to catch an error that can never happen, but can chalk it up to different style. It may be worth looking into solutions like assert, that can signal programmer intent and just crash the program upon error.
The new commit has been pushed - hopefully that solves the issue!

@CiaranWoodward thx for your contribution :pray:
@tuve, @qleisan , @sbertin-telular  do not hesitate to share your point of view about assert usage. (Just in case I added a comment about this in #513)


upgrade release script

Interesting that it didn't need so much to make the python lint pass!

Actually it looks like there is an error on line 26 https://github.com/ada-url/ada/blob/8be84228c3846092adaa8646492877f82fd70827/.github/workflows/lint_and_format_check.yml#L26


ticdc: disable span replication in mysql/tidb changefeed

What problem does this PR solve?

Issue Number: ref #7720
What is changed and how it works?
Force disable span replication on MySQ/TiDB changefeeds.
Check List
Tests

Unit test

Questions
Will it cause performance regression or break compatibility?
No.
Do you need to update user documentation, design documentation or monitoring documentation?
No.
Release note
None

Will MySQL sink support region based replication in the future?

Yes, and it needs to solve "REPLACE INTO" issue first.

/merge


Reuse of AES initialization vector in AESCipher / UsernamePasswordMako / Server

The Server class randomly generates a fixed 16-byte initialization vector (IV) for the purpose of encrypting data. Then, via the UsernamePasswordMako class, that fixed IV makes its way to the AESCipher class, where it is consistently reused for encrypting data.
Initialization vector reuse like this is a security concern, since it leaks information about the encrypted data to attackers, regardless of the encryption mode used. For example, if the IV is reused with the same key in AES-CTR mode, the attacker will very likely be able to entirely decrypt the encrypted data: https://crypto.stackexchange.com/questions/2991/why-must-iv-key-pairs-not-be-reused-in-ctr-mode
Instead of relying on a fixed, randomly-generated IV, it would be better to randomly-generate a new IV for every encryption operation. Here are a couple of links that have more information on why that is the preferred approach:

https://defuse.ca/cbcmodeiv.htm
https://crypto.stackexchange.com/questions/39615/best-way-to-generate-a-iv-for-aes-cbc-when-encrypting-files

CC

This issue has been assigned CVE-2017-1000246.

Hi there, thanks for the interesting report and congrats on getting your CVE.
Although I agree with you in principle and we are going to fix this shortly, I'm trying to look into the applicability of an attack based on your report and I'd appreciate your feedback.

. For example, if the IV is reused with the same key in AES-CTR mode,

We do not use or support CTR mode
https://github.com/rohe/pysaml2/blob/4375361939e942c4dd666d3ca4e1159858404bc4/src/saml2/aes.py#L11-L15
Even if the attacked could decrypt the data, the only thing we encrypt is the username of the authenticated user before we store that to a cookie. This username is not secret ( in fact it would probably be included in a possibly non encrypted SAML Assertion a few steps down the line ) and I would be more concerned with the attacks against the integrity(authenticity) of the value rather than its confidentiality. **
For CBC mode, since the username vocabulary is limited, I would argue that it would be difficult to mount a chosen plaintext attack ( plaintext = username) and thus, even though the IV reuse is bad practice, I don't see how anyone using this code would be vulnerable to any attacks.
What do you think @obi1kenobi ?
** We don't do a pretty good job with that too admittedly, but I will be opening a separate issue for that.

Hi @jkakavas, thanks for the reply.
The issue exists inside the class that handles AES encryption generically for the entire library, and not just for encrypting usernames. I'd argue that even if usernames are indeed the only thing being encrypted right now, it isn't safe to assume that will continue to be the case in the future.
I agree that attacks on the message authenticity are concerning, as you point out.
I'd suggest three things:

Remove support for ECB mode, since it essentially can't be used safely (also note that it currently points to the CFB mode's constant).
Remove the IV argument to the AESCipher class, and instead randomly generate the IV for each encryption.
Switch to AES-GCM mode as the default, thereby ensuring authenticity as well as confidentiality.

The IV reuse problem must be fixed before switching to AES-GCM though, since AES-GCM has a similar construction to AES-CTR and fails in the same way when the IV is reused. Also, you might consider AES-GCM-SIV, which is resistant to reused IVs but is slightly more expensive in terms of computation time.

The issue exists inside the class that handles AES encryption generically for the entire library, and not just for encrypting usernames. I'd argue that even if usernames are indeed the only thing being encrypted right now, it isn't safe to assume that will continue to be the case in the future.

Yes, we only use it to encyrpt the username in the cookie, so it is not currently something that can e exploited. I agree though that it should be changed so we will not unknowingly inject any vulnerabilities in future versions.
I will make a pull request to address this. Thanks again for reporting it.

Sounds great -- thank you for looking into fixing this.

@jkakavas Is there a PR addressing this?

@kylegibson No, not yet. I can work on it soon-ish but if you have something you can contribute, please do by all means

Was this issue ever resolved? My team is working on resolving all the CVEs, and we're not sure if simply upgrading the version does it, or what commit fixes it if any, or if we have a solid reason for ignoring it.

@dcripplinger as far as I can tell, the issue appears to not be resolved, at least not on the master branch. I believe it is still a problem that should be addressed, and it should be addressable by simply generating a new IV for every encryption operation.

@jkakavas :wave: Hello! I'm on the GitHub team responsible for sending security alerts for vulnerable versions of Python libraries. It appears that the issue described here (assigned CVE-2017-1000246) affects all versions as of its writing (<= 4.4.0). Since its writing, version 4.5.0 was released. Can you share whether version 4.5.0 fixes this issue?
As it stands now, we plan to alert pysaml2 users today on vulnerable versions <= 4.5.0 (all currently released versions), providing no remediation steps as no fixed version has yet been identified. Can you please confirm that this information is accurate? Thank you! 💛

I am not a cryptographer so I cannot easily decide whether using AES-GCM or AES-GCM-SIV (as proposed by @obi1kenobi ) is the right thing.

Instead of relying on a fixed, randomly-generated IV, it would be better to randomly-generate a new IV for every encryption operation

However, to generate a new random IV for every encryption operation, one only needs not provide an IV in the first place. I will work on @obi1kenobi proposals immediately.

we plan to alert pysaml2 users today

@laserlemon sending security alerts is really helpful and mindful to do. It is great to have a team like that and thanks for doing that 👍 A security alert though, usually panics people, and as such it should be of actual value; it should be an actual issue. Even though there is a CVE assigned, there is nothing of real interest here as @jkakavas already explained earlier. I wouldn't like to wake up with a security alert that ends up not being an actual issue.
Ofcourse, this is no excuse by the pysaml2-team not having acted upon this for so long 😟. I am here to fix this.

[offtopic] 🐰
I would be really interested to that list. I would like to be able to contact users of pysaml2 to understand their use cases and alert for breaking changes. Is this something the pysaml2-team can have access to? Can we generate that list somehow?

Again, thanks for doing this :octocat:
I will prepare a PR soon.

Pull Request #519 created to address this.

I agree with @c00kiemon5ter's comments. Although this is a valid finding, I can't see how this can be exploited in any way (my thoughts/analysis on above) so I'm not sure the notification is helpful in that context. At least maybe since there is no 4.5 released, the notification could at least point to this issue in order for anyone interested to see why this is considered not exploitable.

@c00kiemon5ter maybe information on this can go out to the pysaml mailing lists so that folks are not taken by surprise by a potential GH notification ?

I would be really interested to that list. I would like to be able to contact users of pysaml2 to understand their use cases and alert for breaking changes. Is this something the pysaml2-team can have access to? Can we generate that list somehow?

-1 for me. I would rather invite people to voluntarily join the mailing list by pointing it out in the Readme, than obtaining such a list via Github ( which I don't think they're in a place to provide eitherway ) and sending out unsolicited emails. ( We probably shouldn't also, GDPR being one of the reasons at least )  WDYT ?

I am not planning to start a campaign 😜I am mostly interested in which parts of the library are being used, and which can be replaced or dropped without making the users inconvenient. It is mostly about us peeking into their projects and learning about their use cases, rather than contacting them.
If we know there are users of a part of the library that is being changed (a breaking change) we can work on a migration path or propose a complementary tool.

Thank you everybody for your comments! After hearing your feedback, we decided not to send notifications to repos that currently use a version of pysaml2 that's "vulnerable" to this specific issue. Please note though, should someone push a new requirements.txt that targets a vulnerable pysaml2 version, they will receive a notification at that time.
Also, in regards to your question:

I would like to be able to contact users of pysaml2 to understand their use cases and alert for breaking changes. Is this something the pysaml2-team can have access to? Can we generate that list somehow?

Yes, you can see the public repos that depend on pysaml here on your Dependency Graph page. We are not able to provide additional contact information for users of pysaml2.
Thanks for providing such helpful feedback and for maintaining pysaml2! :clap:

The library we use to implement AESCipher is cryptography. I've looked into AES, the different modes and how they are supported. The recommended practice by cryptography is to use Fernet (spec).

Fernet guarantees that a message encrypted using it cannot be manipulated or read without the key. Fernet is an implementation of symmetric (also known as “secret key”) authenticated cryptography.

The interface is also very simple 👍Fernet provides generate_key, encrypt and decrypt. Behind the scenes:

Implementation
Fernet is built on top of a number of standard cryptographic primitives. Specifically it uses:
AES in CBC mode with a 128-bit key for encryption; using PKCS7 padding.
HMAC using SHA256 for authentication.
Initialization vectors are generated using os.urandom().

I think Fernet fills our use case and it is recommended practice. It does not use GCM or GCM-SIV (both of which are supported by cryptography, but introduce the authentication tag that needs to be kept available.)
I think I will go ahead and wrap Fernet to replace AESCipher.

Thank you everybody for your comments! After hearing your feedback, we decided not to send notifications to repos that currently use a version of pysaml2 that's "vulnerable" to this specific issue. Please note though, should someone push a new requirements.txt that targets a vulnerable pysaml2 version, they will receive a notification at that time.

I think this is reasonable 👍 Thanks!

Yes, you can see the public repos that depend on pysaml here on your Dependency Graph page. We are not able to provide additional contact information for users of pysaml2.

That's great, thanks for pointing us there - I did not know about the dependency graph.
Cheers :octocat:

I think the decision to show the warning on GitHub is wrong. This issue doesn't actually cause any issues anyone would care about. The big warning is just going to scare people for no good reason. It's not like using pysaml will mean someone will be able to hack your site.


Throttle greedy clients in orderer Broadcast API

This commit implements a shared rate limiter for connections authenticated with mutual TLS. The throttling and rate limiting is applied at both the Authority Key Identifier and Subject Key Identifier level, which guarantees no single organization or client can bombard the orderer with endless transactions on the expense of others.
The effective rate is divided across all clients and orgs for a time period specified by InactivityTimeout.
By default this feature is turned off.

@yacovm
Why didn't you use an off-the-shelf library like golang.org/x/time/rate?

@yacovm Why didn't you use an off-the-shelf library like golang.org/x/time/rate?

I am not sure it fits our need. I need a dynamic rate limiter that limits on a per client basis and the budget is adjusted dynamically according to how many clients are connected.

@yacovm Why didn't you use an off-the-shelf library like golang.org/x/time/rate?

I am not sure it fits our need. I need a dynamic rate limiter that limits on a per client basis and the budget is adjusted dynamically according to how many clients are connected.

I used it for dynamic loading. Conditionally: the TPS of the system had to be X and had to be divided by all nodes. Nodes could crash and restart. And the throughput of the system should not change.

There are already rate limiters implemented for Endorsering, Deliver, and Gateway services; wouldn't it be better to extend its usage for ordering service as well? See here: https://github.com/hyperledger/fabric/pull/647 . I understand the existing approach probably doesn't provide the desired granularity, though still, even putting rate limits with the grpc interceptor is a little bit cleaner approach rather than extending the broadcast handler.

@yacovm, btw, do you also intend to add metrics to expose limiter budget utilization so operators can trace down setup and alerts to notify whenever the limit is exhausted per client or organization? Now, where the model is to use gateway service, meaning peers are collecting endorsements and submitting transactions, this might be crucial.

@yacovm Why didn't you use an off-the-shelf library like golang.org/x/time/rate?

I am not sure it fits our need. I need a dynamic rate limiter that limits on a per client basis and the budget is adjusted dynamically according to how many clients are connected.

I used it for dynamic loading. Conditionally: the TPS of the system had to be X and had to be divided by all nodes. Nodes could crash and restart. And the throughput of the system should not change.

I think you're talking about sending transactions and not receiving them, am I mistaken?

There are already rate limiters implemented for Endorsering, Deliver, and Gateway services; wouldn't it be better to extend its usage for ordering service as well? See here: #647 . I understand the existing approach probably doesn't provide the desired granularity, though still, even putting rate limits with the grpc interceptor is a little bit cleaner approach rather than extending the broadcast handler.

They are not rate limiters, they are simply locks that limit too many gRPC streams being opened. This does not address the problem solved here.

@yacovm, btw, do you also intend to add metrics to expose limiter budget utilization so operators can trace down setup and alerts to notify whenever the limit is exhausted per client or organization? Now, where the model is to use gateway service, meaning peers are collecting endorsements and submitting transactions, this might be crucial.

The idea is cool but I have no intention of doing this, as this piece of work is not meant to be used in this manner.
This is only to prevent a client from spamming an orderer with too many transactions.
As long as you're an "average" client and you don't over saturate your budget on a timely manner, you should be good.


look for python in the form python38

I also had Issue #37 on Gentoo.  Issues #33 and #26 seem related too.
This should let more distributions find python without (hopefully) breaking any current ones.
Nice examples

I tried it on python 2.7 and 3.7 which both worked, not sure what the problem in the build is.


How to keep the content of Parameter suggestions displayed by Pylance in the original style?

How to keep the content of Parameter suggestions displayed by Pylance in the original style?
Just like Jedi, clearer.
For example:
def add(x: int, y: int) -> int:

    """ Add two numbers

    Parameters
    ----------
    x : int
        First integer
    y : int
        Second integer

    Returns
    int
        Results

    """
    return x + y

Use Pylance:

Use Jedi:

Related stack overflow link: https://stackoverflow.com/questions/65284696/how-to-make-pylance-parse-numpy-style-docstring-properly-in-vscode/
Thanks a lot!

Good issue, jedi's paramter displayed style is easier to read.

We're tracking this in #48 so I'm going to close this as a duplicate.


Not sure if this is a theme issue

Please see attached image what could be going wrong ?

Hi,
It is, if you have steps to reproduce it. 🙂

Jim,
There are no know ways to reproduce it. When did it happen to you? What did you do in particular?

I accessed the apache module for virtualmin some how I can not remember how I did that but I can not reproduce it via webmin->servers->apache->servername

I know why it could happen and I know how to trigger it manually to break the page like that but there is no way I can reproduce it in real life situation. I wonder, if there are exact steps that you took to make it happen but you are not sure either.
I will keep this issue closed for now, and if you find the way to reproduce it, please let me know.
What browser was that, by the way?

I am using Google Chrome Version 83.0.4103.97 (Official Build) (64-bit)

Yeah, I use Google Chrome as well. Please let me know, if you can reproduce it again. If you can remember where you were prior to that and/or what you were doing exactly, would be great. For example, how did you get on that page or if you canceled any current page loads and etc?


Function for full preprocessing pipeline packaging

Single function/class for entire preprocessing pipeline given a config of parameters.

Closed with #130


Can gitea automatically compress rolled log files?

Can the rolled log files be automatically compressed by gzip or xz?

I'm afraid it can't at present. It probably wouldn't be too hard to add...


Uncaught TypeError: Cannot read property 'push' of undefined

I have upgraded react-router-redux package from 3.0.0 to 4.0.0
In my code, I need to use push method defined in routeActions to manually change routes
import { routeActions } from 'react-router-redux';

...

routeActions.push('/');

This reports error:
Uncaught TypeError: Cannot read property 'push' of undefined

I figure it out that the name  has changed from routeActions to routerActions.
Should this be documented somewhere?

@fuyi thanks for finding that! it was driving me nuts!

I did changed to routerActions but i'm getting too  Cannot read property 'push' of undefined
import { routerActions } from 'react-router-redux'

function mapDispatchToProps(dispatch) {
    return {
        ...bindActionCreators({
            routerActions,
            loadSystems
        }, dispatch)
    }
}

export default connect(mapStateToProps, mapDispatchToProps)(Dashboard);

...routerActions,


Access runtime config in serverMiddleware

Is your feature request related to a problem? Please describe.

Actually, is it possible to access privateRuntimeConfig in a custom serverMiddleware?

Not at the moment, no.

https://github.com/nuxt/nuxt.js/issues/2033#issuecomment-773181809
Describe the solution you'd like
Either the ability to access privateRuntimeConfig from Nuxt serverMiddleware, or automatic injection of environment variables within serverMiddleware.
Describe alternatives you've considered

Using built-in dotenv support

=> Do not work using Firebase Hosting / Functions deployment combo, without exposing .env vars.

Using Firebase Functions Config

=> Works, but much less convenient to use (need to import firebase lib and set env vars manually).
Describe alternatives you've not considered
Creating an express API to access credentials (with some secure encryption or authentication in between)
=> Add a lot of complexity and cost to such a basic feature.
Additional context
Althought Nuxt runtime config is supposed to be a replacement to the dotenv module, it does not offer most of its main features today.
Example : Specifying a custom .env file path

I also feel this pain. Had to wrap a super simple serverMiddle as a module because of it. Almost feels like it would be simpler to at least point people towards modules and explain how to do serverMiddleware that way. Since I'm almost always going to care about some config item for serverMiddleware.

This is now possible in Nuxt 3 with useRuntimeConfig().

Hi, is this fixed for Nuxt 2 as well?

No, not unless you use Nuxt Bridge.

Thank you.


Playwright/Browsers hang when having more than 3 (sometimes 2) instances running at the same time when testing a Blazor Server App

Context:

Playwright Version: 1.23.0
Operating System: Windows 11
Node.js version: 16.13.0
Browser: Chromium, Firefox

Code Snippet
using var playwright = await Playwright.CreateAsync();
await using var browser = await playwright.Firefox.LaunchAsync(
    new BrowserTypeLaunchOptions
    {
        Headless = false
    }
);

await Parallel.ForEachAsync(
    Enumerable.Range(1, options.Iterations),
    new ParallelOptions { MaxDegreeOfParallelism = options.Iterations },
    async (iteration, cancellationToken) =>
    {
        await using var browserContext = await browser.NewContextAsync();
        var page = await browserContext.NewPageAsync();

        page.GotoAsync("https://localhost/");
        page.ClickAsync("body > header > nav > button");

        await Task.Delay(10000); // This is just for debugging purposes
    }
);

Description
I have a Blazor Server App that is hosted in IIS. In this App, I have a Button (HTML) that has a Click handler () => NavigationManager.NavigateTo(url, true);. All the handler does is navigate to a Login Page.
I wanted to test my Application with Playwright and it works OK when I start only 1-2 instances. When I try with more than 3 instances then it hangs as soon as the click page.ClickAsync("body > header > nav > button"); is executed. if I close some instances then other instances continue working as they should.
What I have noticed is that if the second parameter in NavigationManager.NavigateTo(url, true); is set to false then it works.
This can be reproduced with the default Blazor Server Template.
P.S.
If I just run the App with dotnet run then it works!

I see that you never await these two calls, it should be:
        await page.GotoAsync("https://localhost/");
        await page.ClickAsync("body > header > nav > button");

Otherwise I don't see something which is wrong, if you could submit a minimal repro, we'd be happy to take a look.

@mxschmitt thanks for the swift reply.
The missing await part was my mistake when I was trying to remove the clutter from the code. The actual code has it.
Here you can find the minimal repo.
There is a Blazor Server project there BlazorTests that has to be published and put on IIS.
There is also a Test project there BlazorTests.E2ETests where you can find two tests. One of them passes because it starts with only two Tasks and the other with four Tasks fails.
Let me now if you need something else from me.

Oh you are using XUnit, this is discouraged, because their parallelism mode is not compatible with Playwright, see here: https://playwright.dev/dotnet/docs/test-runners#xunit-support
Could you use Nunit or MSTest instead? There it works most likely.

Just tried it with NUnit and I got the same result. I have also updated the repo for you to check.
I have previously checked the link you provided, but the way I understand it, it does not cover my case.
Based on the link, the Test Runner will run tests in parallel but they have to be separate tests.
What I want, is to run the same test many times.

I tried to reproduce it, but for me it was working fine. I'd adjust the parallelism model a bit tho, so you don't do CreateAsync all the time. The best would be that you have N workers, e.g. 3 and inside of them you create Playwright instances. These workers stay alive and then work on your jobs over and over again.
This is very similar to what we do in our nunit harness: https://playwright.dev/dotnet/docs/test-runners

Sorry for the late reply. I'm unfortunately not familiar with Blazor either but, happy to accept any PRs/research in that direction.

I've been experimenting with this since my last comment. It seems the issue is on the IIS side. I was using IIS on Windows Home and not on Windows Server and based on some online documentation, IIS on Windows Home has a limit on the number of concurrent connections.
I have created a virtual machine with Windows Server and I am not facing the same issue - I was able to execute 100 parallel tests.
Sorry if I bothered you and thanks a lot for your time.


stm32 usart: Fix RX interrupt flag handling

On v1 interrupts cannot be cleared individually.
Instead they are cleared implicitly by reading or writing DR (which we do now).
Multiple error flags can be set at the same time:
Handle them all in one go intstead of re-entering the ISR for each one so that
we do not lose any error flags on v1 hardware.
Wake when the RX buffer becomes full: This allows fast running chips to pull data
from the buffer before receiving the next byte.

Tested on v1 hardware, lets see if v2 still succeeds on CI.

bors r+


Container fails with exit code 100

sudo docker run -d -p <IP_ADDRESS>:27017:27017 mongo:3.6

2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten] MongoDB starting : pid=1 port=27017 dbpath=/data/db 64-bit host=4380abe1e27f
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten] db version v3.6.8
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten] git version: 6bc9ed599c3fa164703346a22bad17e33fa913e4
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.1.0f  25 May 2017
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten] allocator: tcmalloc
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten] modules: none
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten] build environment:
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten]     distmod: debian92
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten]     distarch: x86_64
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten]     target_arch: x86_64
2018-11-09T14:33:26.453+0000 I CONTROL  [initandlisten] options: { net: { bindIpAll: true } }
2018-11-09T14:33:26.460+0000 I STORAGE  [initandlisten] exception in initAndListen std::exception: open: Permission denied, terminating
2018-11-09T14:33:26.460+0000 I CONTROL  [initandlisten] now exiting
2018-11-09T14:33:26.460+0000 I CONTROL  [initandlisten] shutting down with code:100

docker --version
Docker version 18.03.1-ce, build 9ee9f40

I am using linux distro based on debian

Your issue looks related to something in your environment, I'm not able to reproduce it and can't find a definite solution for your specific error exception in initAndListen std::exception: open: Permission denied.
This were the most relevant resources I found https://jira.mongodb.org/browse/SERVER-31542?attachmentViewMode=list
$ run -d -p <IP_ADDRESS>:27017:27017 --name mongo --rm mongo:3.6
1448d3653803ebf09840f80e826f071dc65b9865a0077c91ea72873cb18d89f9
$ docker logs mongo -f
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten] MongoDB starting : pid=1 port=27017 dbpath=/data/db 64-bit host=1448d3653803
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten] db version v3.6.8
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten] git version: 6bc9ed599c3fa164703346a22bad17e33fa913e4
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.1.0f  25 May 2017
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten] allocator: tcmalloc
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten] modules: none
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten] build environment:
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten]     distmod: debian92
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten]     distarch: x86_64
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten]     target_arch: x86_64
2018-11-09T17:51:34.317+0000 I CONTROL  [initandlisten] options: { net: { bindIpAll: true } }
2018-11-09T17:51:34.318+0000 I STORAGE  [initandlisten]
2018-11-09T17:51:34.318+0000 I STORAGE  [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
2018-11-09T17:51:34.318+0000 I STORAGE  [initandlisten] **          See http://dochub.mongodb.org/core/prodnotes-filesystem
2018-11-09T17:51:34.318+0000 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=979M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),cache_cursors=false,compatibility=(release="3.0",require_max="3.0"),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress),
2018-11-09T17:51:35.121+0000 I STORAGE  [initandlisten] WiredTiger message [1541785895:121815][1:0x7f93b49c1580], txn-recover: Set global recovery timestamp: 0
2018-11-09T17:51:35.263+0000 I CONTROL  [initandlisten]
2018-11-09T17:51:35.263+0000 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
2018-11-09T17:51:35.263+0000 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
2018-11-09T17:51:35.263+0000 I CONTROL  [initandlisten]
2018-11-09T17:51:35.264+0000 I STORAGE  [initandlisten] createCollection: admin.system.version with provided UUID: 72040292-e468-4112-8ba4-06dc054b7c28
2018-11-09T17:51:35.318+0000 I COMMAND  [initandlisten] setting featureCompatibilityVersion to 3.6
2018-11-09T17:51:35.323+0000 I STORAGE  [initandlisten] createCollection: local.startup_log with generated UUID: 780943b2-ce7b-4278-bb6f-f27be608b5c7
2018-11-09T17:51:35.359+0000 I FTDC     [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db/diagnostic.data'
2018-11-09T17:51:35.360+0000 I NETWORK  [initandlisten] waiting for connections on port 27017
2018-11-09T17:51:35.360+0000 I STORAGE  [LogicalSessionCacheRefresh] createCollection: config.system.sessions with generated UUID: 225488b5-ea55-4fc8-83ac-e57fb5cb8113
2018-11-09T17:51:35.431+0000 I INDEX    [LogicalSessionCacheRefresh] build index on: config.system.sessions properties: { v: 2, key: { lastUse: 1 }, name: "lsidTTLIndex", ns: "config.system.sessions", expireAfterSeconds: 1800 }
2018-11-09T17:51:35.431+0000 I INDEX    [LogicalSessionCacheRefresh]     building index using bulk method; build may temporarily use up to 500 megabytes of RAM
2018-11-09T17:51:35.434+0000 I INDEX    [LogicalSessionCacheRefresh] build index done.  scanned 0 total records. 0 secs

Since the issue isn't reproducible and doesn't seem to be an error with the image there's not much we could do, you could try asking the Docker Community Forums, the Docker Community Slack, or Stack Overflow.

(Closing, given that we cannot seem to reproduce the issue.)

I ran into this same issue it was due to a full /dev/sda1 mount on my boot2docker VM in VirtualBox.
I was able to remove images and containers.  Once I had free space this resolved my issue.


Setup Smoke Test Script

When changes are made to the Installation setup it would be good to have an automated script we could run in order to verify the changes. This could later be added to our release pipeline in order to automate the process before any major release. Current Installations that need to be tested are:

Helm
Kustomize

@Spazzy757 do you think we can close this following #180?

Yeah definitely


Compound Interest Calculator

Is your feature request related to a problem? Please describe.
No its not a problem. I want to add a new feature called Compound Interest Calculator.
Describe the solution you'd like
Compound interest is the interest on a loan or deposit calculated based on both the initial principal and the accumulated interest from previous periods. This tool will calculate the compound interest using HTML, CSS, and javascript.
Additional context
Please assign this issue to me under GSSOC 21.

Similar project already exist

Similar project already exist

I've checked. The project that already exists is of simple interest. I want to make Compound Interest Calculator

@harshgupta20


How to have a custom rendered for a container type

Say I have a type like
@dataclasses.dataclass
class TimeSeries:
   x: np.ndarray
   y: np.ndarray
   name: str

my_data = TimeSeries(np.arange(100), np.random.uniform(100), "value")

how can I define the method __treescope_repr__ such that I get something similar to
        res = treescope.figures.inline(
            "TimeSeries object containing the following data: ",
            px.line(
                x=self.x,
                y=self.y,
                labels={"x": "Iterations", "y": self.name},
            ),
            )

It's unclear from the documentation..

Option 1: Custom autovisualizer
The simplest way to accomplish something like this is using the "autovisualizer" system, which is a higher-level API that is designed to replace particular components with rich visualizations. Something like this should work:
def my_autovisualizer(value: Any, path: tuple[Any, ...] | None):
  if isinstance(value, TimeSeries):
    return treescope.IPythonVisualization(
        # Most IPython-displayable objects can go here
        treescope.figures.inline(
            "TimeSeries object containing the following data: ",
            px.line(
                x=value.x,
                y=value.y,
                labels={"x": "Iterations", "y": value.name},
            ),
        ),
        # Configure whether the visualization should replace the original object or appear next to it
        replace=True,
    )
  # uncomment the below line to also automatically visualize arrays
  # return treescope.ArrayAutovisualizer()(value, path)

You can then turn this on globally using
treescope.active_autovisualizer.set_globally(my_autovisualizer)

or turn it on in a particular cell using
%%autovisualize my_autovisualizer

# cell contents here

Doing it this way allows you to easily disable the custom rendering by turning off the automatic visualization.
(Right now there's a bit of an issue where the sizing can be a bit messed up, but I'll try to fix that in the next release.)
Option 2: __treescope_repr__
If you want to make this custom rendering appear all the time, you can override the __treescope_repr__ method. This is a lower-level API that requires you to manage the different rendering states (e.g. folded vs unfolded) and convert between types yourself.
@dataclasses.dataclass
class TimeSeries:
  x: np.ndarray
  y: np.ndarray
  name: str

  def __treescope_repr__(self, path, subtree_renderer):
    # Custom reprs should almost always start with "<" and end with ">", and
    # need to support folding/unfolding if they are on multiple lines:
    return treescope.rendering_parts.build_custom_foldable_tree_node(
        label=treescope.rendering_parts.text(
            "<TimeSeries object containing the following data:"
        ),
        contents=treescope.rendering_parts.siblings(
            treescope.rendering_parts.fold_condition(
                collapsed=treescope.rendering_parts.text("..."),
                expanded=treescope.rendering_parts.indented_children([
                    treescope.figures.treescope_part_from_display_object(
                        px.line(
                            x=self.x,
                            y=self.y,
                            labels={"x": "Iterations", "y": self.name},
                        )
                    )
                ]),
            ),
            treescope.rendering_parts.text(">")
        ),
        path=path
    )

Hope that helps!


Karpenter has small batch size and unpredictable time between batches

Version
Karpenter Version: v0.18.0
Kubernetes Version: v1.23.10
Expected Behavior
Karpenter is able to quickly obtain big amount of spot nodes or relax preferred affinity & spawn ondemands
Actual Behavior
Because of https://github.com/aws/karpenter/issues/1681 we have 5 spot provisioners configured (1 per AZ).
Karpenter sees that there're lots of pods to be scheduled, there're messages like
Found 890 provisionable pod(s)
However, it tries to create nodes in pretty small batches (120-190 nodes per turn) every 40-90s. They're getting UnfulfillableCapacity exception one by one, they're getting banned for 3 minutes but in the end because of long pauses between tries it tried spots for 9 minutes and only after that it relaxed constrains and started spawning ondemands.\
karpenter uses 3Gb memory out of 5 requested, CPU usage is 1-1.5 out of 2 requested
So I have 3 questions:

How batch size is selected? - we have 900 pods in queue and karpenter schedules 150 in one time
Why the time between launching batches differs (40s-90s)?
Is there any way to speed up relaxing constraints?

Steps to Reproduce the Problem

Resource Specs and Logs

Community Note

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
If you are interested in working on this issue or have submitted a pull request, please leave a comment

karpenter_logs.txt
Attaching log files
We're using a single instance type, so it shouldn't take long time to return error from fleet, right?

The number of nodes launched might be hitting the cloud provider's batching window for launch instances (10ms idle 100ms max). It looks like the nodes stop launching after ~10ms, so there may be a bug there...
// 25ms
2022-10-28T14:54:29.154Z	INFO	controller.provisioning	Launching node with 1 pods requesting {""cpu"":""15520m"",""memory"":""61411Mi"",""pods"":""10""} from types m5.4xlarge	{""commit"": ""1d8eb34"", ""provisioner"": ""provisioner-spot-regular-us-east-1f""}
2022-10-28T14:54:29.179Z	INFO	controller.provisioning	Launching node with 1 pods requesting {""cpu"":""15520m"",""memory"":""61411Mi"",""pods"":""10""} from types m5.4xlarge	{""commit"": ""1d8eb34"", ""provisioner"": ""provisioner-spot-regular-us-east-1f""}

// 12ms
2022-10-28T14:55:11.670Z	INFO	controller.provisioning	Launching node with 1 pods requesting {""cpu"":""15520m"",""memory"":""61411Mi"",""pods"":""10""} from types m5.4xlarge	{""commit"": ""1d8eb34"", ""provisioner"": ""provisioner-spot-regular-us-east-1a""}
2022-10-28T14:55:11.682Z	INFO	controller.provisioning	Launching node with 1 pods requesting {""cpu"":""15520m"",""memory"":""61411Mi"",""pods"":""10""} from types m5.4xlarge	{""commit"": ""1d8eb34"", ""provisioner"": ""provisioner-spot-regular-us-east-1a""}

// 11ms
2022-10-28T14:58:12.196Z	INFO	controller.provisioning	Launching node with 1 pods requesting {""cpu"":""15520m"",""memory"":""61411Mi"",""pods"":""10""} from types m5.4xlarge	{""commit"": ""1d8eb34"", ""provisioner"": ""provisioner-spot-regular-us-east-1f""}
2022-10-28T14:58:12.207Z	INFO	controller.provisioning	Launching node with 1 pods requesting {""cpu"":""15520m"",""memory"":""61411Mi"",""pods"":""10""} from types m5.4xlarge	{""commit"": ""1d8eb34"", ""provisioner"": ""provisioner-spot-regular-us-east-1f""}

// 12ms
2022-10-28T14:59:00.178Z	INFO	controller.provisioning	Launching node with 1 pods requesting {""cpu"":""15520m"",""memory"":""61411Mi"",""pods"":""10""} from types m5.4xlarge	{""commit"": ""1d8eb34"", ""provisioner"": ""provisioner-spot-regular-us-east-1a""}
2022-10-28T14:59:00.190Z	INFO	controller.provisioning	Launching node with 1 pods requesting {""cpu"":""15520m"",""memory"":""61411Mi"",""pods"":""10""} from types m5.4xlarge	{""commit"": ""1d8eb34"", ""provisioner"": ""provisioner-spot-regular-us-east-1a""}

@bwagner5 we don't set anything custom to configmap:
Namespace:    karpenter
Labels:       app.kubernetes.io/instance=karpenter
              app.kubernetes.io/managed-by=Helm
              app.kubernetes.io/name=karpenter
              app.kubernetes.io/version=0.18.0
              helm.sh/chart=karpenter-v0.18.0
Annotations:  meta.helm.sh/release-name: karpenter
              meta.helm.sh/release-namespace: karpenter

Data
====
batchIdleDuration:
----
1s
batchMaxDuration:
----
10s

BinaryData
====

Events:  <none>

@bwagner5 did you find anything regarding

It looks like the nodes stop launching after ~10ms, so there may be a bug there...

?

I haven't found anything yet. The 10ms is the batch window, so if that is the issue, it's not necessarily a bug, just potentially a bad default. I'm not sure if that's what the issue is though since there's significant time between provisioning loops which I don't think should be there.

Batching performance has been improved and the batching periods have been adjusted which should result in significantly larger batches. This should fix the issue you were seeing.


[DO NOT MERGE] Break bpf unit tests

This change is

test-me-please

Coverage decreased (-0.01%) to 44.246% when pulling 17a72817e1d743d886414260a0dad308795cba7a on nebril:break-bpf-tests into 4b8242d93d03aa8fe4aea30d8c0f5745e8221da3 on cilium:master.


Fixing influxdb Bug

The time field in the influxdb schema is now called 'time' instead of 'timestamp'. Changed since influxdb version 0.8.

@dscrobonia thanks man - also congrats - this PR contained within it the 1,000th commit!

Nice!
On Tue, Jun 13, 2017 at 7:34 PM, John Melton<EMAIL_ADDRESS>wrote:

@dscrobonia https://github.com/dscrobonia thanks man - also congrats -
this PR contained within it the 1,000th commit!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/jtmelton/appsensor/pull/78#issuecomment-308302627,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AE6Y4JuTPcDlV3PrRa0sHeNfjIADCoGOks5sD0bAgaJpZM4N5POS
.


onClick not firing on duplicates

Hey! Thanks for a great component!
I'm trying to figure out why onClick is not firing on carousel elements that's been generated by the component (duplicates). The original elements works just fine, but whenever I try onClick on the duplicates, nothing happens.
export default class fullScreenCarousel extends React.Component {

  state = { enableFullScreen: false }

  toggleFullScreen = () => {
    console.log('hello');

    this.setState({
      enableFullScreen: !this.state.enableFullScreen
    })
  }

  render() {
    const params = {
      slidesPerView: 'auto',
      centeredSlides: true,
      loop: true,
      slideToClickedSlide: true,
      shouldSwiperUpdate: true,
    }

    const isFullScreen = this.state.enableFullScreen ? `${styles.isFullScreen}` : '';

    return(

          <div className={`${styles.carousel} ${isFullScreen}`}>
            <Swiper {...params} ref={this.swiperRef}>
              {this.props.images.map(({ path }, index) => (

                    <button onClick={this.toggleFullScreen} className={styles.fullScreenButton} aria-label="View full-screen" title="View full-screen">
                      <svg viewBox="0 0 32 32"><path d="M15,20,7,28h5v4H0V20H4v5l8-8Zm5-5,8-8v5h4V0H20V4h5l-8,8Z"></path></svg>
                    </button>

              ))}
            </Swiper>

    )
  }
}

I have the same issue, for the last generated items in the list.
By inspecting the code with the React dev Tool, I don't see those items in the react code
Can someone give an help?

I found the solution here
Basically, the point is that in loop mode, duplicated are not managed from react, therefore they do not trigger events. The solution is to add an eventListener in ComponentDidMount.
I have done it and it works.


How to change a saved model input shape in Tensorflow?

I have a pretrained saved model, input shape is [1, None, None, 3], i want to change model input shape to [1, 320, 320, 3], what should i do?

Have you tried looking at this Link

@sun2011yao
As you say it is [1,none,none,3] then you can just pass the 320,320,3 image to it.None input shape is just a placeholder and can take any value.
This is not a bug, i suggest you open this in discussion forum/stackoverflow for any further queries.


feature request: download & upload json file through browser

As far as I could tell, we could make this a completely standalone/ offline-friendly app if the user could upload & download json files, correct?
I ask because this would let non-technical people (who wouldn't run a node server on their machine) use create training data just by going to a URL

Yes, definitely! I will add this as soon as i can :)

Cool! I'm also happy to help out

Thanks, i just updated the online version with upload/download buttons :) 👍


Detected blocking call (Part 2)

Describe the issue
Hey, it seems that there might be one more piece of code that's triggering this warning.
Detected blocking call to listdir with args ('/usr/local/share/ca-certificates',) inside the event loop by custom integration 'additional_ca' at custom_components/additional_ca/utils.py, line 27: for filename in os.listdir(CA_SYSPATH): (offender: /config/custom_components/additional_ca/utils.py, line 27: for filename in os.listdir(CA_SYSPATH):), please create a bug report at https://github.com/Athozs/hass-additional-ca/issues For developers, please see https://developers.home-assistant.io/docs/asyncio_blocking_operations/#listdir Traceback (most recent call last): File "<frozen runpy>", line 198, in _run_module_as_main File "<frozen runpy>", line 88, in _run_code File "/usr/src/homeassistant/homeassistant/__main__.py", line 223, in <module> sys.exit(main()) File "/usr/src/homeassistant/homeassistant/__main__.py", line 209, in main exit_code = runner.run(runtime_conf) File "/usr/src/homeassistant/homeassistant/runner.py", line 190, in run return loop.run_until_complete(setup_and_run_hass(runtime_config)) File "/usr/local/lib/python3.12/asyncio/base_events.py", line 674, in run_until_complete self.run_forever() File "/usr/local/lib/python3.12/asyncio/base_events.py", line 641, in run_forever self._run_once() File "/usr/local/lib/python3.12/asyncio/base_events.py", line 1990, in _run_once handle._run() File "/usr/local/lib/python3.12/asyncio/events.py", line 88, in _run self._context.run(self._callback, *self._args) File "/usr/src/homeassistant/homeassistant/setup.py", line 167, in async_setup_component result = await _async_setup_component(hass, domain, config) File "/usr/src/homeassistant/homeassistant/setup.py", line 404, in _async_setup_component result = await task File "/config/custom_components/additional_ca/__init__.py", line 43, in async_setup await update_ca_certificates(hass, config, store) File "/config/custom_components/additional_ca/__init__.py", line 81, in update_ca_certificates remove_all_additional_ca(additional_ca_data) File "/config/custom_components/additional_ca/utils.py", line 27, in remove_all_additional_ca for filename in os.listdir(CA_SYSPATH):

Describe your setup (please complete the following information):

Installation type:  HAOS
Core 2024.7.1
Supervisor 2024.06.2
Operating System 12.4
Additional CA integration version: 0.2.3
Kind of certificate you use: Self-signed

@Athozs I'm not seeing the warning anymore. Bless your soul and have a wonderful weekend.


Remove Python 2 compatibility layer

Remove all __future__ imports
Remove dependency on six

See also #2296
There are still remaining changes like the nltk/compat.py file and various version-dependent branches. Additionally the documentation needs an update.

Thanks @pyfisch - great contribution!


Feature: implement labels in uniform time strings

Currently, the only format of a universal time string Purple Tools supports is

[X U @ HH:MM:SS]

This issue is to add support for the following format:

[{label}: X U @ HH:MM:SS]

To possibly add some clarification as to what this time string is referring to.

[WEIGHT: 3.415 U @ 01:25:22]


[MRM-2011] Change configuration and pattern matching to be compatible with windows

@effrafax, changes are more in the core source that in the test. I hope this is semanticaly correct.

I change to Paths and give a try to getPathMatcher. It's ok on windows and on linux for my point of view.


Regarding Zoom In and Out

Hi Team,
I am using this plugin in flutter, using IPhone 13 pro max, while zoom in and out it is zooming too late, is there any option to do.

@Avinash-kommareddy
Which plugin are you refering to ?
Your question is better suited for support channels like StackOverflow, so please ask the same there. If you find any genuine issue with the flutter first party plugin you are using, please open new issue using template and fill out requested details.
Closing for now.


Support Greater Than 2 Axis Grid Image

Feature Idea
i generate a grid like

it was saved as an image one column and 15 rows
why not real XYZ image?
how can i get an image like in FORGE
3 column (CFG)
5 rows (Steps)
Other
No response

"Grid Image" format only supports 2 axes.
"Web Page" will render up to 4 axes at once (with clickables to swap the axes at will between as many more as you have)

thy... why not automatic? you can copy/paste from forge  ;)
and these "Dry Run", its possible to get a grit with black images how it would be look like ?


[BUG] error_score not working in ForecastingGridSearchCV

Describe the bug
error_score not working in ForecastingGridSearchCV

@asernat Please add a minimal reproducible example. I'm not sure what you mean.

Not enough info to understand the bug.


[DO NOT MERGE] Docs for v2.0

This is a PR to update docs for v2.
Todos

[ ] useSWRMutation — dedicated API for remote mutations, e.g. POST (https://github.com/vercel/swr/pull/1450)
[ ] 🏃♂ Fetcher no longer accepts multiple arguments (https://github.com/vercel/swr/pull/1864) #326
~[ ] Internal structure of the cached data (https://github.com/vercel/swr/pull/1863)~
[ ] 🏃♂ feat: support functional optimisticData https://github.com/vercel/swr/pull/1861 #333
[ ] New isLoading state (https://github.com/vercel/swr/pull/1928)
[ ] New keepPreviousData option (https://github.com/vercel/swr/pull/1929)
[ ] Avoid using Suspense on the server-side (https://github.com/vercel/swr/pull/1931)
[ ] Preload API (https://github.com/vercel/swr/pull/2026)
[ ] Function as SWRConfig value (https://github.com/vercel/swr/pull/2024)
[ ] Mutate Multiple Keys (https://github.com/vercel/swr/issues/1946, https://github.com/vercel/swr/pull/1989)
[ ] feat: Add DevTools hook https://github.com/vercel/swr/pull/2016
[ ] Blog Post (Migration Guide)

@koba04 Thanks for noticing this! I think it's still internal, but I marked it as "TODO" because it's a breaking change if someone relies on the old structure. So we should document this change in the 2.0 migration guide (like how we did for 1.0).

@shuding Thank you! That makes sense, I missed the migration guide😅

📝 Changed routes:

/docs/mutation.en-US
/docs/mutation.es-ES

(view full size)
(view full size)

/docs/mutation.ja
/docs/mutation.ko

(view full size)
(view full size)

/docs/mutation.pt-BR
/docs/mutation.ru

(view full size)
(view full size)

And 1 other route:

/docs/mutation.zh-CN

Commit be07f87b01c2f67bddba6564bb1c8a6cd6191e39 (https://swr-site-pjzb21g6x.vercel.sh).

@koba04 is the force-push for rebasing the new updates on main branch? Maybe we can leave it like this for now and cherry-pick the missing change after the major work is done. Rebasing will override the commits hash, and may have some conflicts if there's any

@huozhi Thank you. That makes sense👍 I'll merge main instead of rebasing when we'll need it.

⚠ We have to update the publish date before merging this 🗒


It doesn't run on OS X

MusicPlayer doesn't run on OS X El Capitan 10.11.6
Run recent jar file.
I imported a directory for the first time and no reaction.

Neither @Mpmart08 nor I have OS X on our machines so we can't do any testing on the issue.

it also cannot run on my mac(Mojave) with java version "10.0.1", may i ask you what is wrong with my computer?


Update to Spree 3.x & Add coverage.

What's new?

Updated dependencies to work with Spree 3.x
Formatting changes.
Fixed generator JS and stylesheet issues.
Underscored the gem name.
Added coverage to extensions code.

@vinniefranco   :+1:  Looks good to me and nice work on the specs.   @eric1234 can you review and merge if you agree?

Yea, thanks for the clean-up. When I integrated this into a 3.x app recently I hit some of the same issues but didn't have time/budget to do the clean-up. This will make the next application that much smoother. Merging.

Wow. Fastest OSS merge ever! Thanks @eric1234 and @dhonig


WIP on fix for tests in InternalUsersScoreBasedPasswordRulesRestApiIntegrationTest

Description
WIP on https://github.com/opensearch-project/security/issues/4845
Check List

[ ] New functionality includes testing
[ ] New functionality has been documented
[ ] New Roles/Permissions have a corresponding security dashboards plugin PR
[ ] API changes companion pull request created
[ ] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@cwperks, thank you for fixing it! Now, each test initializes only once, right?

@cwperks, thank you for fixing it! Now, each test initializes only once, right?

Yes that's the idea. It also switches to using the @Before method which does not need to be static and will allow the use of polymorphism for the test. I'm not sure this is the best way just yet which is why it's in a PR on my fork, but I wanted to open this PR to show the code I've already created.

@cwperks, thank you for fixing it! Now, each test initializes only once, right?

Yes that's the idea. It also switches to using the @ Before method which does not need to be static and will allow the use of polymorphism for the test. I'm not sure this is the best way just yet which is why it's in a PR on my fork, but I wanted to open this PR to show the code I've already created.

I was planning to do the same. The original idea was to boot up the cluster only once as result all tests passed fast and you can run in you IDEA :-) but unfortunately it was a good idea.

@cwperks, thank you for fixing it! Now, each test initializes only once, right?

Yes that's the idea. It also switches to using the @ Before method which does not need to be static and will allow the use of polymorphism for the test. I'm not sure this is the best way just yet which is why it's in a PR on my fork, but I wanted to open this PR to show the code I've already created.

I was planning to do the same. The original idea was to boot up the cluster only once as result all tests passed fast and you can run in you IDEA :-) but unfortunately it was a good idea.

If it can be dynamically changed in a single cluster that would be great, but I don't think it's possible. Please feel free to push to this branch. I'm not sure this is the best way to solve these tests.

@cwperks, thank you for fixing it! Now, each test initializes only once, right?

Yes that's the idea. It also switches to using the @ Before method which does not need to be static and will allow the use of polymorphism for the test. I'm not sure this is the best way just yet which is why it's in a PR on my fork, but I wanted to open this PR to show the code I've already created.

I was planning to do the same. The original idea was to boot up the cluster only once as result all tests passed fast and you can run in you IDEA :-) but unfortunately it was a good idea.

If it can be dynamically changed in a single cluster that would be great, but I don't think it's possible. Please feel free to push to this branch. I'm not sure this is the best way to solve these tests.

Yes it is. It is my bad :-)


Rfc592 cred proposal filter

Also set MIME types to application/json consistently, touch up old references to hlindy-zkp etc

Good to have @dhh1128 review this as well.

I will go back to the text and propose changes here in a couple of hours.

How about now? Is this OK? I want it to work for everyone. Thanks.

This looks quite good now, and I think I'm aligned with the intent. However, I think I'm seeing a couple typos. I'll review more carefully in an hour or so.


ARROW-1023: Python: Fix bundling of arrow-cpp for macOS

you can prob push dev wheels here
https://7933911d6844c6c53a7d-47bd50c35cd79bd838daf386af554a83.ssl.cf2.rackcdn.com
i think @matthewbrett would need to enable


ISPN-11687 Try harder not to leave dangling lock files around

https://issues.redhat.com/browse/ISPN-11687

Let's see what the testsuite says

@tristantarrant checkstyle fails.
Also, it doesn't work. When I tried to create a cache I got
`Caused by: java.nio.file.NoSuchFileException:.../server/data/caches.xml.lck


Unable to access camera in webview - iOS

[x] I have read the Get Started - Installation section
[x] I have read and done the Get Started - Setup Android section
[x] I have read and done the Get Started - Setup iOS section
[x] I have already searched for the same problem

Environment

Technology
Version

Flutter version      3.0.3

Plugin version       ^5.4.3+7

Android version
n/a

iOS version
14.7.1

Xcode version
13.4.1

Device information:  iPhone 7 MN88X2ZD/A
Description
I am unable to access to the camera in a webview
Expected behavior:
I expect to be able to test the camera when I click on 'test camera'
Current behavior:
It doesnt work.  I get this error : Received memory pressure event 2 vm pressure 0
Steps to reproduce

This
Here's a minimal example.
Create a new flutter project and in main.dart :
import 'package:flutter/material.dart';
import 'package:flutter_application_ios_test/webview.dart';
import 'package:flutter_inappwebview/flutter_inappwebview.dart';
import 'package:permission_handler/permission_handler.dart';

void main() async {
WidgetsFlutterBinding.ensureInitialized();
await Permission.camera.request();
await Permission.microphone.request();
runApp(const MyApp());
}
class MyApp extends StatelessWidget {
const MyApp({Key? key}) : super(key: key);
@override
Widget build(BuildContext context) {
return MaterialApp(
title: 'Flutter Demo',
theme: ThemeData(
primarySwatch: Colors.blue,
),
home: const Home(),
);
}
}
class Home extends StatelessWidget {
const Home({Key? key}) : super(key: key);
@override
Widget build(BuildContext context) {
return Scaffold(
appBar: AppBar(title: const Text('iOS test')),
body: Center(
child: ElevatedButton(
child: const Text('Webview'),
onPressed: () {
Navigator.push(
context, MaterialPageRoute(builder: (context) => const Webview()));
},
),
),
);
}
}
class Webview extends StatelessWidget {
const Webview({Key? key}) : super(key: key);
@override
Widget build(BuildContext context) {
final GlobalKey webViewKey = GlobalKey();
String url = 'https://webcamtests.com/';
return Scaffold(
appBar: AppBar(title: const Text('Webview')),
body: InAppWebView(
key: webViewKey,
initialUrlRequest: URLRequest(url: Uri.parse(url)),
),
);
}
}
In ios/Runner/info.plist, add :
NSBonjourServices

_dartobservatory._tcp

NSAppTransportSecurity

NSAllowsArbitraryLoads

NSAllowsArbitraryLoadsInWebContent

io.flutter.embedded_views_preview
YES
NSMicrophoneUsageDescription
Flutter requires acess to microphone.
NSCameraUsageDescription
Flutter requires acess to camera.
in pusbspce.yaml, add in dependencies:
flutter_inappwebview: ^5.4.3+7
permission_handler: ^10.0.0

Than that
Run. Click on webview. Once ce page appears, click on 'Test my cam'
Then
Nothing happens

Hi there,
I couldn't manage to to use the camera in neither the inAppWebView nor the inAppBrowser. Fortunately it works in hte ChromeSafariBrowser.
2 comments : 1/ perhaps remind users that specific setup is needed with permissionHandler package. Maybe a few users overlooked that and then placed an unecessary issue with you.
2/ Would it be possible to add an "hideToolbarBottom" boolean in ChromeSafariBrowser's ios options (just like in inAppBrowser's options)? I'll open a new request for improvement on git.
Thanks again for your great work.


Inference Time

Hi! Thanks for your great work @youmi-zym :)
I have some questions about your experiment results.

In Table 4, the performance results of NLSPN are different from the original paper (ECCV'20). Can you tell me how you tested it and why it differs from the original paper results?

In Section 5 Conclusion and Limitations, you mentioned CompletionFormer runs at about 10 FPS. Is it a result of using 4 3090 GPUs?

Hi @Sabo-99,
Thanks for your interest.

We got the results in Tab.4 by rerunning the NLSPN with 1, 4, 16, and 64 lidar lines. I checked the original paper of NLSPN, their result with 64 lidar lines is 884.1mm (RMSE), which is very close to our test (889.4mm in RMSE) in Table 4.
The runtime is tested on one single 3090 GPUs. Only training needs more gpus.

Best,
Youmin


Observable Response Discrepancy - CWE - 204

Hello team, we did a pentest and was found a low vulnerability.
OWASP-Top10: A05:2021 – Security Misconfiguration
CWE: CWE-204: Observable Response Discrepancy
Expected behaviour:
Not show information parameter: userId
Actual behaviour
When user write '/' and click reset password  we have this information below:
Parameter "userId" for route "core.lost.resetform" must match "[^/]++" ("/" given) to generate a corresponding URL
Environment general
Oracle Linux 8
Are you using an external user-backend, if yes which one:
LDAP/ActiveDirectory
Environment ownCloud Infinite Scale
Version:10.12.2 (stable)

Regards,
Fabio

This is core 10.12.2


404 at /contributing/ & /contributing/contributing

URL: /contributing/
Trying to access the link within Docker Weekly (#192, #193), I got 404.
A screenshot of the link within the Docker Weekly newsletter is attached at the bottom

I found docker.com/contribute page which may work for contributing to Docker link within the newsletter mentioned above.
Assuming there are other Docker pages that points to docs.docker.com/contributing/, I suggest one of the following:

Redirecting the docs.docker - contributing to docker.com/contribute
Auditing existing links to docs.docker.com/contributing/, and edit them


Infinite loading spinner

I have an infinite loading spinning on mac
I have orange bolt on iOS

Steps

Opened Sphinx on Windows
Now iOS and Mac won't work

@tomastiminskas @Evanfeenstra
Hey both, after trying to test your newest build on Windows, it seems to have messed up my mac/ios keys.
Unable to load anything and have the infinite spinner (It may cause lots of requests to relay again)

@tomsmith8 I will spend some time trying to recreate on my side. Good to know that it happens when using Windows app. There might be an issue somewhere on the Windows app causing it. I would suggest to uninstall and restore account on iOS and Mac after closing Windows app. Let me know please if that works

My restore is stuck on 1% for Mac:

I wonder if hmac key is the issue and there is a race condition causing Windows to take prio and iOS/Mac not

@tomsmith8 still not able to restore account? I tries with my proxy test account and I could even when some requests fail. Send me you WhatsApp if you have so we ca talk there and try to figure this out


Gradle dependency issue for Android

Here is what went wrong:
Could not determine the dependencies of task ':app:compileDebugRenderscript'.

Could not resolve all task dependencies for configuration ':app:debugCompileClasspath'.
Could not find org.kodein.di:kodein-di-core-jvm:6.2.0.
Required by:
project :app > org.kodein.di:kodein-di-generic-jvm:6.2.0
project :app > org.kodein.di:kodein-di-framework-android-core:6.2.0

N:B: I have read previous issues and possible solutions regarding this but those didn't help out.
Can anyone help please?

I think this is the same problem as https://github.com/Kodein-Framework/Kodein-DI/issues/192

Duplicate of #192


Update winui3.md

It makes more sense to use the word "if" here

@scout208 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Looks good; we'll merge. Thanks for contributing @scout208.


histogram with observations of all the same value

when you run a mean random number provider and put all the results in a histogram, some of the histogram methods are dysfunctional - e.g. inverse CDF. If we allow the user to run things without uncertainty, we'll run into issues.

yeah. we shouldnt allow meanrandomprovider to have iterations be more than 1 i think. but the point still remains, if there is no variation in the values, should we handle that case.
I think we could query if sampleMin=sampleMax and hanlde that case (in inversecdf cdf and pdf?)

histogram things should work on 1 observation, right? I suppose that having 1 observation or 1000 observations of the same value would give us a similar histogram, with data in just one bin.

i think so, any number of bins should work i think. we might check if _N = 0 also... if someone asks for cdf inverse cdf or pdf and no values are in the bin?


Version 3.2.2 does not work out of the box with puppet version < 5.0

Running onceover on a Puppet 4.7.0 control-repo gives the environment relative hiera path as
spec/hiera.yaml
Whereby no hiera lookups are working.
IMHO it should be
hiera.yaml

@sandymcp Puppet 4.7.0 Supports Hiera 3 & 4, meaning that you can use a hiera v3 file in spec/hiera.yaml or a hiera v4 file in hiera.yaml (It should just pick it up). It's a bit confusing as 4.7 and other releases were in a kind of limbo where Hiera worked in multiple different ways, plus it all gets changed again in 4.10 when Hiera 5 is released D: If you think there is a bug here please give detail around current and expected behaviour, otherwise I'll close this


Bug in Crystal, can't assign instance var?

I hope I am just being daft in some way, but I can't make sense of this. Please see:
https://groups.google.com/forum/#!topic/crystal-lang/Qf9aYUbygDE
Basically I can change an instance variable in place, but I can't reassign it. Worse, when I do reassign it, the method in which it is reassigned clearly shows that it has been reassigned. But then when I access the same instance variable from another method, it is as if hasn't been been.

The cli macro passes args, but it's in a loop that's constantly shifting from args. So replace works because it copies the data from the array, but reassigning does not because it uses the same array reference.

Oh, I'm passing a reference. Just need to dup it. Thank you!!!


Tests 142 search clear filters behaviour with keyword search

Nice one. Do we also want to add a specific test to check that the clear filters link points to the correct search terms (i.e the text in the search box is the same before/after clicking the link)?

@samuelhwilliams Done 😡 😩 😭 I had to learn xpath syntax!

@benvand xpath can be fairly awesome, especially on the python side with lxml and the extra tricks it provides.


Fix spelling of "whether"

I am sure the original authors were thinking about castrated rams: http://www.thefreedictionary.com/wether
Seriously, thanks.  Much appreciated. :)


add clusteroperator resource to CVO payload

Adding this resource should give the CVO visibility into whether our component is working or not.
/assign @sttts

/retest

/retest

/retest

/lgtm

/retest


samples: add sample for streaming file upload

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

[ ] Make sure to open an issue as a bug/issue before writing your code!  That way we can discuss the change, evaluate designs, and agree on the general idea
[ ] Ensure the tests and linter pass
[ ] Code coverage does not decrease (if any source code was changed)
[ ] Appropriate docs were updated (if necessary)

Fixes #<issue_number_goes_here> 🦕

@ddelgrosso1 I don't see the actual sample file here.


p2p: rewrite SecretConnection handshake using the state machine pattern

Rewrite the SecretConnection handshake using the learnings from https://github.com/informalsystems/tendermint-rs/pull/708. The state machine pattern hopefully will allow us: a) to test each step (~state) separately b) enforce the rules (i.e. one can't go to creating challenge (state 2) before receiving the remote ephemeral key (state 1).
Resources:

https://hoverbear.org/blog/rust-state-machine-pattern/
https://deislabs.io/posts/a-fistful-of-states/

Another one on the topic: Type-level Programming in Rust


Incorrect call to sync Any method in the CategoryController of the AdminPanel project template

Currently, there is a wrong call to the sync Any linq method in the following line which should be changed to an async call:
https://github.com/bitfoundation/bitplatform/blob/fcb83f2c6da2a1b42c792497b39f977426e96917/src/Templates/AdminPanel/Bit.AdminPanel/src/Server/Api/Controllers/Categories/CategoryController.cs#L76
the ideal change should be something like this:

Can i take this up?

Note that this issues are for first contributes only and for the next contributions consider working on issues with "up for grab" label that need more efforts.
So I'd recommend deleting your comment on other issues (I'll handle it, don't worry 💯)

sure, Thanks Yaser 😊. I'll be raising a PR for the same.


fix(tabsWithNumbers): fix deleted tabs updates

Fixes this issue ⬇. Deleted tabs in recenlyFocused/opened modes also need handling

@zardoy can we merge?


Add Skew bar to mobile Futures Markets

Initial design didn't have the current Skew bar, incl. Open Interest Long and Short, included.
Deliverables

Create mockup for mobile
Implement Skew bar on mobile

<!-- Uploading "image.png"... —>


AdvertisingPacketUtil:getAdvertisingPacketsBetween() Skip one advertising packet

Hello,
According to the description, the method below "Returns an ArrayList of AdvertisingPackets that have been received in the specified time range."
public static <P extends AdvertisingPacket> ArrayList<P> getAdvertisingPacketsBetween(final ArrayList<P> advertisingPackets, long startTimestamp, long endTimestamp) {
          ...
    }

I am testing this method right now, Here is my input data :
long startTimestamp =<PHONE_NUMBER>;
long endTimestamp =<PHONE_NUMBER>;

ArrayList<AdvertisingPacket> advertisingPackets = new ArrayList<AdvertisingPacket>();
advertisingPackets.add(new AdvertisingPacket(1,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(2,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(3,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(4,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(5,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(6,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(7,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(8,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(9,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(10,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(11,<PHONE_NUMBER>));
advertisingPackets.add(new AdvertisingPacket(12,<PHONE_NUMBER>));

After calling getAdvertisingPacketsBetween method with the input above the result returned is
[ 2, 3, 4, 5, 6, 7, 8, 9], Why we aren't taking the index number 10 with the array ?
I think it's a bug, Every endTimestamp chosen > 6 ( which it's the middle of the list), the last index is skipped.
To Solve the issue above, we should add 1 to the endIndex calculated when
endTimestamp >= midstAdvertisingPacket.getTimestamp()
    // find the index of the last advertising packet with a timestamp
        // smaller than the specified endTimestamp
        int endIndex = advertisingPackets.size() - 1;
        if (endTimestamp < latestAdvertisingPacket.getTimestamp()) {
            // figure out if the end timestamp is before or after the midst advertising packet
            ListIterator<P> listIterator;
            if (endTimestamp < midstAdvertisingPacket.getTimestamp()) {
                // end timestamp is in the first half of advertising packets
                // start iterating from the beginning
                listIterator = advertisingPackets.listIterator(startIndex);
                while (listIterator.hasNext()) {
                    if (listIterator.next().getTimestamp() >= endTimestamp) {
                        endIndex = listIterator.previousIndex();
                        break;
                    }
                }
            } else {
                // end timestamp is in the second half of advertising packets
                // start iterating from the end
                listIterator = advertisingPackets.listIterator(advertisingPackets.size());
                while (listIterator.hasPrevious()) {
                    if (listIterator.previous().getTimestamp() < endTimestamp) {
                        endIndex = listIterator.nextIndex() + 1;  <------ HERE
                        break;
                    }
                }
            }
        }

I have run this test over and over again,
It seems that the code below never executed, I set the breakpoint in the else statement where I made the changes.
} else {
    // end timestamp is in the second half of advertising packets
    // start iterating from the end
       listIterator = advertisingPackets.listIterator(advertisingPackets.size());
       while (listIterator.hasPrevious()) {
             if (listIterator.previous().getTimestamp() < endTimestamp) {
                        endIndex = listIterator.nextIndex() + 1;  <------ HERE
                        break;
                    }
              }
         }

You are correct, i originally used other values for numberOfPackets (greater 2) which will result in the described behaviour while executing this code block.
My test revealed a bug in our code.
        // find the index of the last advertising packet with a timestamp
        // smaller than the specified endTimestamp
        int endIndex = advertisingPackets.size() - 1;
        if (endTimestamp < latestAdvertisingPacket.getTimestamp()) {
            // figure out if the end timestamp is before or after the midst advertising packet
            ListIterator<P> listIterator;
            if (endTimestamp < midstAdvertisingPacket.getTimestamp()) {
                // end timestamp is in the first half of advertising packets
                // start iterating from the beginning
                listIterator = advertisingPackets.listIterator(startIndex);
                while (listIterator.hasNext()) {
                    if (listIterator.next().getTimestamp() >= endTimestamp) {
                        endIndex = listIterator.previousIndex();     // ---> a)
                        break;
                    }
                }
            } else {
                // end timestamp is in the second half of advertising packets
                // start iterating from the end
                listIterator = advertisingPackets.listIterator(advertisingPackets.size());
                while (listIterator.hasPrevious()) {
                    if (listIterator.previous().getTimestamp() < endTimestamp) {
                        endIndex = listIterator.nextIndex();            // ---> b)
                        break;
                    }
                }
            }
        }

        return new ArrayList<>(advertisingPackets.subList(startIndex, endIndex + 1));

In the line a) the index of the first incorrect packet will be found, while in line b) the index of the last correct packet will be found. The problem is, that we did not adjust line b) but line c) resulting in adjusting both cases, a) and b).
To get back to the original question if you would like to make endTimestamp inclusive you must adjust the line above a) from >= to > and the line above b) from < to <=.

Where is the line c) ?

Fixed in #122


document.defaultView is not an instance of Window

if (window instanceof window.Window) {
    console.log('(:'); // browser
} else {
    console.log(';('); // jsdom
}

https://tonicdev.com/muroc/577e64d26d5f74130004ab40
I could fix this if it's not too much work.

I think this might be a bug with vm / our sandbox which'd probably not be easy to fix.

Yeah I believe this is classic vm issues in action. This should work "from the inside" though: I believe window.eval("window instanceof Window") will give true.
We may be able to hack this in Node v6 using Symbol.hasInstance.

var window = jsdom.jsdom().defaultView
window.eval('window instanceof Window')

returns false
var Window = require('jsdom/lib/jsdom/browser/Window');
var window = new Window({ parsingMode: 'html' });

window instanceof window.Window

returns true
https://tonicdev.com/muroc/577e7ce46d5f74130004ba2a

Interesting. Maybe we are doing something wrong that can be fixed, but given how troublesome these issues have been, I'm betting it's either a vm bug or a VM by-design issue. I can certainly look into it to confirm.
I think we can try for a Node v6 fix though, as I said.


Enhancement: Databricks Connect support

By default, the Databricks Data Connector will use Databricks Connect based on spark-connect-rs for query (not deltalake/delta-rs).
Databricks Connect example
datasets:
  - from: databricks:spiceai.datasets.my_awesome_table  // A reference to a table in the Databricks unity catalog
    name: my_delta_lake_table
    params:
      db_cluster_id: 12345
      endpoint: "https://dbc-a1b2345c-d6e7.cloud.databricks.com"

DeltaLake example
The current implementation using delta-rs will continue to be supported, and can be invoked using
Example:
datasets:
  - from: databricks:spiceai.datasets.my_awesome_table  // A reference to a table in the Databricks unity catalog
    name: my_delta_lake_table
    params:
      object_store_token: 123
      format: delta
      endpoint: "https://dbc-a1b2345c-d6e7.cloud.databricks.com"

After looking into this,  I propose we tackle the issue in this way:

Simple working version
Adding validation removed from the databricks module within the various data connectors

Closed in https://github.com/spiceai/spiceai/pull/1110