Update contributing.md

Summary of the Pull Request
Add's Information to contributing.md, how you can get write access.
PR Checklist

[x] Applies to #6380
[x] CLA signed. If not, go over here and sign the CLA

So ... if you do a good PR, that would be checked into the main branch.  The main branch also has protection on it so only admins can force something into it if needed.
Write permissions lets you create branches in the open, honestly, that is about it.  A PR from the community is no different in our eyes than a PR from even me.  Everything gets a code review.

How does this sound:
How can I become a contributor on the PowerToys team
Be a great community member. Just help out a lot and make useful additions, filing bugs/suggestions, help develop fixes and features, code reviews, and always, docs. Lets continue to make the PowerToys repository a great spot to learn and make a great set of utilities.
When the time comes, Microsoft will reach out and help make you a formal team member. Just make sure they can reach out to you :)

@crutkas I changed it.

do we want the phrase "microsoft" or the "PowerToys team" will reach out ...


[5.1] Fix eloquent pagination count column

Added fix for #9385 along with test to reproduce bug ocured with those changes.
Also added fix as proposed by @zot24 in https://github.com/laravel/framework/pull/9385#issuecomment-118385042.
Inside \Illuminate\Database\Query\Builder::getCountForPagination  method only first column will be used for counting total and if columns have not been passed - default $columns value will be used ['*'].

Thanks @loginwashere this look great!

Going to hold off on this for now.


Add guessFirmwareFormat function

Actually guessFirmwareFormat is not present in zwave-js

PRs welcome - the method can be copied 1:1 from https://github.com/AlCalzone/ioBroker.zwave2/blob/master/src/lib/firmwareUpdate.ts and put into https://github.com/zwave-js/node-zwave-js/blob/master/packages/core/src/util/firmware.ts
Don't forget to export from https://github.com/zwave-js/node-zwave-js/blob/master/packages/zwave-js/src/Utils.ts


[BD-46] fixed replacing CSS variables on the Colors page

Description

fixed replacing CSS variables on the Colors page.

Deploy Preview
Include a direct link to your changes in this PR's deploy preview here (e.g., a specific component page).
Merge Checklist

[ ] If your update includes visual changes, have they been reviewed by a designer? Send them a link to the Netlify deploy preview, if applicable.
[ ] Does your change adhere to the documented style conventions?
[ ] Do any prop types have missing descriptions in the Props API tables in the documentation site (check deploy preview)?
[ ] Were your changes tested using all available themes (see theme switcher in the header of the deploy preview, under the "Settings" icon)?
[ ] Were your changes tested in the example app?
[ ] Is there adequate test coverage for your changes?
[ ] Consider whether this change needs to reviewed/QA'ed for accessibility (a11y). If so, please add wittjeff and adamstankiewicz as reviewers on this PR.

Post-merge Checklist

[ ] Verify your changes were released to NPM at the expected version.
[ ] If you'd like, share your contribution in #show-and-tell.
[ ] 🎉 🙌 Celebrate! Thanks for your contribution.

Thanks for the pull request, @PKulkoRaccoonGang!
When this pull request is ready, tag your edX technical lead.

@PKulkoRaccoonGang 🎉 Your pull request was merged!  Please take a moment  to answer a two question survey so we can improve your experience in the future.

:tada: This PR is included in version 22.0.0-alpha.4 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Poland Addresses

Description
I encountered an issue while using the "Poland Addresses" feature.
I suggest reducing the time intervals for updating missing addresses to
avoid unintended duplicate imports.
Screenshots
No response
Version
2.1.1
What browser are you seeing the problem on? What version are you running?
Firefox v102
The OS you're using
Win10
Steps to reproduce
After selecting a missing address to add, I press "A" as a keyboard shortcut, then confirm it at the top right, enter a change description, and publish. After waiting a few minutes, I refresh the page to make the
yellow items (proposed additions) disappear, assuming they have already been added. Unfortunately, the items that have already been added to OSM still appear.
The browser URL at the time you encountered the bug
https://rapideditor.org/rapid#background=MAPNIK&datasets=c66d1c8f60524ff09f88563c7c3be1a3&disable_features=traffic_roads,service_roads,paths,building_parts,indoor,landuse,boundaries,water,rail,pistes,aerialways,power,past_future,others&map=19.29/49.71654/19.12799
The auto-detected useragent string for your browser (leave blank if you're manually filling this form out)
No response

Oh, yeah this makes sense.  Only some of the data layers (roads, buildings) are run through a service which can conflate/dedupe them against what exists in OSM.  The address points do not go through that service.
I'll leave this open for now because I think there may be improvements planned for the service, but I don't know much about it.


Separate files for pacman and AUR pkgs

Hi Chris,
I just took your pkgs in setup and user and made separate files containing those packages. This way all packages can be installed together and not one by one like what you have in the scripts. This also addresses this issue  #20.
To know more about pkgfiles visit this arch-wiki page.
I hope you find this useful.
Thank you

I'll test this out, as I'd love to commit this to main.


Provide a way to set an initial default input text

Hello, I'm looking on a cli search engine and I was looking for a way to put a default text in the search bar but that was not possible.
Here is an implementation of this feature.
And here is an example of how I want to use it:
https://github.com/irevoire/mieli/commit/ccaae2e13f2b18d93316da795efc735ad9815e08
And here is a video of what it would allow me to do:

I really like the idea, thanks for that!
Before merging, I'd like to think a bit more about the behavior and the API of this feature.
I'm thinking if I should remove/change the current behavior for default, which uses the default text when the actual input is empty.
Or if I should keep both make their differences clear on the API/documentation

Personally, I would keep both.
But I think we could improve the naming, text is not super explicit.


To easy to follow people

Especially for people who participated and not uploaded but even in general, it is too easy to click on follow, when really what you want is to get to their game in current event.
Suggestion, add the following button to the user-profile:

Adding a LD 38 Game button to users with no games does not help the user experience. It suggest that the user has authored games and when some one clicks it they will be taken to an empty page.
And in the case of users who have published games your moving the game button even closer to the follow button, and so your more likely to hit follow by accident.
I don't think we should add a LD 38 GAME button to user for the reason you suggested, but i may be worth considering for other reasons.
After a couple of LD's (or jammer being a thing). Users game pages are going to be quite full. So adding a quick link to games from the featured event might be a good idea.

I didn't mean for ppl without games, then it really shouldn't be there. But right now if you were part of a team you don't get the games below the user profile while the game is listed on your games (separate bug), and even more in that case it would be nice with game link in profile to current event.

Yeah, I'm using the wrong method to calculate the total number of games belonging to a node right now, so the games button doesn't know to appear.

How about instead you make the Game list the default and not the Feed? I would argue that most people are more interested in what games someone made, instead of what they wrote.

Well @Cerno-b, if there are hotlinks to games entered in currently active event, then the feed is probably nicer, but it could be a quick fix before that logic is in.

I guess if the games appear next to the name in the feed then having the feed as the default would be better I agree.

 I forget the issue, but I like how event pages have a row of buttons in the post bottom itself, that outright change what is going on below (theme selection, results, etc).


Need a DirectManipulationCompleting event for ScrollViewer

The DirectManipulationCompleted event of the ScrollViewer fires too late - it only gets called when the animation of the scrolling finishes.
What would be really helpful is to provide an event (maybe something like DirectManipulationCompleting) that would fire as soon as the pointer is released (e.g. finger lifts up from screen).
I had to create hacks for this missing feature. Ugly timers were used in my pull-to-refresh sample here as well as in my Tab control here. I understand that in order to achieve the best performance, the ScrollViewer control uses direct manipulation that swallows normal pointer events. But by providing one extra direct manipulation event it would make many scrolling-based animations possible/easier.

Something like this would be a godsend. It's great that the ScrollViewers in XAML are butter-smooth, but they take complete control over the pointer events, making any kind of custom interactions impossible without horrible, horrible hacks. The ScrollViewer has to be the most mysterious control in how it works, most of which is undocumented.
Exposing the ScrollViewer property set was one unexpected bonus at the time, props to the XAML+Composition teams for doing that 👏

Thanks for the feedback. Please feel free to file a feature request in the backlog here so we can prioritize this among our other backlog items.

I wish this could be the place for us to post Composition-specific feature requests though.
Anyway, here is the link.

Please definitely continue to post Composition feature requests here (we do actively monitor and look at all issues posted here on GitHub). It is helpful to have an additional posting discoverable on UserVoice for people to vote on who are not actively watching our GitHub.


[ERROR] AttributeError in twint.output module

Hi,
I recently installed Twint (python 3.6.9 ; Linux OS ; installation by "pip3 install . -r requirements.txt" after dowloading twint.git).
I tried the first simple example of https://pielco11.ovh/posts/twint-osint/ and I have an error when I ran this one :
import twint
get the followers first
c = twint.Config()
c.Username = "target"
c.Store_object = True
c.User_full = True
twint.run.Followers(c)
save them in a list
target_followers = twint.output.user_object
My "target" has only 50 followers which are correctly printed in the prompt but at the end I have :
"target_followers = twint.output.user_object
AttributeError: module 'twint.output' has no attribute 'user_object'"
What can I do ?
What can I provide to you ?
Thanks
Issue Template
Please use this template!
Initial Check

If the issue is a request please specify that it is a request in the title (Example: [REQUEST] more features). If this is a question regarding 'twint' please specify that it's a question in the title (Example: [QUESTION] What is x?). Please only submit issues related to 'twint'. Thanks.

Make sure you've checked the following:

[] Python version is 3.6;
[] Updated Twint with pip3 install --user --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint;
[] I have searched the issues and there are no duplicates of this issue/question/request.

Command Ran

Please provide the exact command ran including the username/search/code so I may reproduce the issue.

Description of Issue

Please use as much detail as possible.

Environment Details

Using Windows, Linux? What OS version? Running this in Anaconda? Jupyter Notebook? Terminal?

Hi @davidgithub14 and thanks for pointing it out, I've to update the article. The correct variable is twint.output.users_list, https://github.com/twintproject/twint/wiki/Storing-objects-in-RAM#users-info

Thanks ! Quick and precise.
It works.


Fixed sample

What do these changes do?
Fixes column attribute errors in sample
Related issue number
Resolves #248

[x] passes git diff upstream/master -u -- "*.py" | flake8 --diff
[x] passes black --check modin/

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-Performance-Testing/43/
Test PASSed.

Merged build finished. Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Modin-PRB/54/
Test PASSed.


Gradle plugin for result aggregation: camunda-process-test-coverage-report-aggregator-gradle-plugin

It will be nice to create the gradle plug-in for result aggregation:
https://camunda-community-hub.github.io/camunda-process-test-coverage/snapshot/getting-started.html#aggregating-results

I agree, having the result aggregation for Process test will usefull for reporting purposes and also for checking what has and what has not been tested

Any plan to release this plugin?

Any plan to release this plugin?

Wanted to wait for https://github.com/camunda-community-hub/camunda-process-test-coverage/issues/259 to be resolved. But it seems it will take a while longer, so I'll do a release of 2.1.0 in the next days.


Added optional logging

Closes #32

logging call should use "%s" and not {}, so the formatting is not done when the loglevel is not reached.
I mean like:
logging.debug("Got %s", something)

@all-contributors please add @JulienPalard  for review and code

Good bot

@all-contributors please add @awecx for review, data and code

Hello @Seluj78! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file potodo/potodo.py:

Line 41:80: E501 line too long (83 > 79 characters)
Line 50:80: E501 line too long (86 > 79 characters)
Line 353:80: E501 line too long (87 > 79 characters)

@JulienPalard Can you review the changes I made ? I am mostly concerned about if I missed some logs somewhere and also their severity, I am unsure of when I should put info or debug or even sometimes warning


[WIP] start a gzip compression CLI

First steps toward a command line tool that can compress data. Designed to be compared to the unix gzip tool (TODO: make sure this tool performs as well)

The binary should probably not be called gzip, that could be confusing.

Won't have time to finish this, so closing.


Issue for 1D problem

The issue arises for the problem:
using Clarabel, LinearAlgebra, SparseArrays
settings = Clarabel.Settings(verbose = true)
settings.direct_solve_method=:cholmod
settings.tol_feas =10^-4
settings.tol_gap_abs=10^-4
settings.max_iter=1
solver   = Clarabel.Solver()
P = sparse(Matrix(I,1,1))
q = [0.]
nothing  #hide
A = sparse([1.;
])
b = [0*ones(1)]
cones =
[Clarabel.NonnegativeConeT(1)]
nothing  #hide
Clarabel.setup!(solver, P, q, A, b, cones, settings)
result = Clarabel.solve!(solver)
The Stacktrace:
[1] Dict{Symbol, Union{}}()
@ Base .\dict.jl:88
[2] Dict
@ .\dict.jl:101 [inlined]
[3] dict_with_eltype
@ .\abstractdict.jl:537 [inlined]
[4] Dict(kv::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
@ Base .\dict.jl:129
[5] setup!(s::Clarabel.Solver{Float64}, P::SparseMatrixCSC{Bool, Int64}, c::Vector{Float64}, A::SparseVector{Float64, Int64}, b::Vector{Vector{Float64}}, cone_types::Vector{Clarabel.NonnegativeConeT}; kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})

The issue is that the A argument is a 1 element sparse vector, not a SparseMatrixCSC.   You could use
A = sparse(I(1).*1.)

instead.   Does that work?

I think it still doesn't work.
I also tried A=sparse(Matrix(I,1,1).*1.) and sparse(I,1,1).*1. which give SparseMatrixCSC{Bool, Float64}, but this does not work either.

The issue was that this line
b = [0*ones(1)]

produces a b that is of type Vector{Vector{Float64}}.   It should instead be
b = zeros(1)

The following works:
settings = Clarabel.Settings(verbose = true)
solver = Clarabel.Solver()

P = A = sparse(I(1).*1.)
q = [0.]

A = A = sparse(I(1).*1.)
b = zeros(1)

cones = [Clarabel.NonnegativeConeT(1)]

Clarabel.setup!(solver, P, q, A, b, cones, settings)
result = Clarabel.solve!(solver)


Move sssom_to_robot_template to mondolib

Overview
We created sssom_to_robot_template.py in mondo-ingest in https://github.com/monarch-initiative/mondo-ingest/pull/521, but we want its home to be in mondolib.
Implementation
As a prerequisite for this, which will possibly be handled in the same PR, we may need to generally refactor the mondolib CLI; right now it is pretty focused on a single use case.

Personal notes:
Needs to be called from the makefile in mondo-ingest, as a command. Look at how I did this w/ owl-to-fhir. Did Harshad already set it up? If he has, then I would need to tie this work into his CLI. Otherwise, make a new CLI. If the refactoring takes more than 2-3 days talk to Trish.


fix(server): Download artifacts from UI. Fixes #4338

Signed-off-by: Alex Collins<EMAIL_ADDRESS>Checklist:

[x] Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this is a chore.
[x] The title of the PR is (a) conventional, (b) states what changed, and (c) suffixes the related issues number. E.g. "fix(controller): Updates such and such. Fixes #1234".
[x] My organization is added to USERS.md.
[x] I've signed the CLA.
[ ] I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
[x] My builds are green. Try syncing with master if they are not.

Fixes #4338

Back-ported to v2.11


lostfilm problem

Переехали на новую версию сайта.
Старая доступна по http://old.lostfilm.tv/

Looks at least strange, very strange.
But I'm parsing SD string

Bugs and bugs on new design... :(
And I'm afraid this is the same episode with different quality uploaded to different episodes.

😄

Was fixed quite fast, we still has episode 2, but without any torrent files.

Urls with: _ in cat doesn't work, and is not redirected by lostfilm itself:
https://www.lostfilm.tv/browse.php?cat=_301 not redirect to right show
https://old.lostfilm.tv/browse.php?cat=_301 - works without any issues


Bug: DHCP MACs bleed into other DHCP VLAN configurations, rendering "deny unknown clients" not to work properly

Describe the bug
It is a bit tricky to describe what I figured out. So let's take baby steps...
I am using DHCPv4 only.
Prerequisites
2 VLANs setup with DHCP
The first VLAN ("VLAN1") is set to "deny unknown clients". It has a DHCP range configured though.
The other ("VLAN2") is just pure DHCP, "deny unknown clients" is not ticked. The available range is the whole network.
You have hosts setup in VLAN2(!) with their MAC and a static IP address (within the assigned range).
It is important to note, that those hosts are not connected to VLAN1 network or configured on DHCP on VLAN1  in any sort of form.
To Reproduce
Steps to reproduce the behavior:
You take one of the hosts from VLAN2 and hook them up to a port in VLAN1, the device is configured to use DHCP.
That host gets an IP from the DHCP range from VLAN1.
Expected behavior
Considering that VLAN1 has "deny unknown clients" I expect that the DHCP server is refusing to serve these clients, same what you get when connecting any new device not having assigned a DHCP static yet.
Yes, you could argue that it behaves as expected, as I have configured a DHCP range. But in this instance it grants technically network access to this client (I am aware DHCP is not  a security feature).
Also, the tooltip on "deny unknown clients" states: If this is checked, only the clients defined below will get DHCP leases from this server.
Describe alternatives you considered
It appears "deny unknown clients" is ignored when the host's MAC is listed in other DHCP VLAN configs. This is not
expected behaviour. DHCP MACs somewhat "bleed" into other DHCP VLAN configurations.
Environment
OPNsense 21.7.3_3
Intel(R) Atom(TM) CPU D425 @ 1.80GHz (2 cores)

I really don't know what's missing here.
I will leave it at that. There is nothing to add from my side.

Today morning I found out that I have the same exact situation on OPNsense 22.1.6.
I have two VLAN's and both have the option "deny unknown clients" ticked.
My client A is registered with a static DHCPv4 lease in VLAN 1.
I connected it by mistake to VLAN 2 and I immediately got an ipv4 address from within the DCHP range of VLAN.
I would also expect that I will not get any up address for client A in VLAN 2.
Only in VLAN 1 where I have the static lease.
Could you please check this issue here, because it's pending long?
Thank you very much :)
BR
Crapi

Isn't really fixable within the current implementation scope "unknown-clients" is a global operator (https://kb.isc.org/docs/isc-dhcp-41-manual-pages-dhcpdconf).  A documentation / help label update is likely the best we can do. Just open a pull-request with suggestions.

@AdSchellevis to change that scope is not possible? If this is more a feature as an issue, I would create a feature request, but after reading your message I'm not sure if this would ever be developed?
I'm not a developer who can help, I could only describe my feature wish and do some donations 😊.
Btw I love OPNsense... Coming from AVM only hardware as a consumer with no deep network knowledge 😅

@Crapshit without an easy option in isc-dhcpd it's not likely we will spend time on such a feature given the low demand and huge costs involved. Most implementation examples I've seen so-far use a single dhcpd for multiple interfaces (same as on our end), in which case you're pretty much bound to the options upstream (isc-dhcp) provides.

Considering it is global, as you said, what if it is only a "global option" then within OPNsense?
Right now it is an option for each DHCP scope/network and that at least made me assume it is local and configurable to each scope.


Question: Risk of SQL injection?

https://github.com/facebook/ent/blob/3038bb5ab12a7980434c778bdcbb23344213ba90/dialect/sql/builder.go#L8-L10
First of all, thanks for open-sourcing this library! I loved the ent framework when I was at FB and I'm excited about this Go version.
My question is about the linked code in sql/builder.go, specifically the warning about the lack of SQL protection that's implemented in the generated SQL statements. In light of this, is there a recommendation for how we can guard against SQL injection? Is there potential for a fix here that changes the generated code to use VALUES($1, ..) alongside db.Exec for inserts?
Appreciate any insight, and thanks again!

Hey @christopherwalter!

First of all, thanks for open-sourcing this library! I loved the ent framework when I was at FB and I'm excited about this Go version.

Wonderful! Feel free to suggest features or improvements if you think something is missing or can be improved (compared to the PHP version).
Please see my comment from https://github.com/facebook/ent/issues/708#issuecomment-689360199:

Thanks for the kind words jaredallard and christie-zhao 😃

This solved it! I didn't know I can get TreeQuery outside. You are so helpful and awesome!!! 💯

You can add methods to the query builder from another file, and external-templates can help you to generate those methods. If you're struggling with it, create a temporary repository with a reproducible example (and some schema) and I'll create a PR for helping you with it.

Just a small question, How do you prevent sql injection when using fmt.Sprintf?

In general, we use parametrized statement/queries for executing the SQL queries, so you don't need to worry if you're passing untrusted user-inputs to the builtin builder methods (like predicates, or when inserting data). You can see the generated SQL statement when calling client.Debug().
However, the select expression is part of the SQL syntax and can't be passed using placeholders (SELECT ? FROM ...) - this is why we're accepting only fields for selection, and users should use the generated constants for passing those fields. We can enforce this, but injections are not expected to be on the SQL syntax level. There's a good discussion in the SQLAlchemy issue tracker - we can add a check for enforcing this (I'll do it) - Update: the check was added.
If you're adding new functionalities using external-templates, you should verify user-inputs or use placeholders where it's possible.
Regarding the question about sql.Selector in #742 - the query builders in dialect/sql are used for providing a statically-typed API for the generated ent code. They don't do syntax check nor escaping or other magic. It's considered an "internal" package of ent, and it's exposed only because the generated packages need them. I'll add it in doc comment.

Now, regarding your question:

Is there potential for a fix here that changes the generated code to use VALUES($1, ..) alongside db.Exec for inserts?

We already use parametrized statement/queries in the generated code, including INSERTs, and using the generated API is safe to use.
Closing because issues is addressed, but please feel free to continue the discussion or open it if you still it wasn't addressed.


Optimal execution order

With reference to #5, we should test which execution order and chunking allows for fastest processing of the data and design the file format accordingly to allow loading the data in continuous blocks. In Test for ideal chunking size and processing order.docx I've summarized discussions with @sk1p  to specify the issue more precisely together with a way to test for it. What do you think?

The overhead of HDF5 is quite significant indeed. I did some initial profiling of the 48_48_128_128 case, and most of the time is spent in Dataset.__getitem__ of h5py - though I don't think compression is the culprit, as it has to be explicitly enabled for each HDF5 dataset, right?
Attached it a screenshot of a kcachegrind view of the profile. The profile itself was recorded with yappi for multi threading support.

@sk1p, compression is not enabled by default in h5py. So those datasets (should) all be uncompressed. What would be interesting to know is how the compression effects the file reading time, vs file size, and how/if the chunking also effects this.
group.create_dataset(name='data', data=data, chunks=chunks, compression='gzip', compression_opts=4)

which could also include the other in-built compressions: 'szip' and 'lzf'. This might have been done elsewhere, but I haven't seen it yet.
(I'm guessing this got a little offtopic...)

@magnunor yeah, we definitely want to experiment with compression, too. I'd also like to know if blosc is of any use for this case, especially if it's used as a hdf filter, and how it compares with the built-in compression methods. The idea of blosc is to decode in blocks that are small enough to fit into CPU caches, and "increase" memory bandwidth that way, but I don't know if we will see any advantages if used as a hdf filter with relatively large blocks.
Regarding your comment about optimizing lazy loading in hyperspy: I think that's worth pursuing and I'd like to give it a shot. I'll ask in the hyperspy gitter later if anyone is willing to give me a high level introduction to the lazy/dask code.

I could imagine that blosc brings the biggest gains on high-end systems like http://www.fz-juelich.de/ias/jsc/EN/Expertise/Supercomputers/JURECA/Configuration/Configuration_node.html where we have to keep 2*12 cores plus 4 NVidia cards fed with data.

Maybe an interesting comparison laptop vs. Jureca. A typical laptop has more than 2x the memory bandwidth per core, and the throughput per core is much lower. For our algorithm, Jureca has maybe 1/4 of the effective memory bandwidth compared to a laptop. And that's just for the CPUs, not even taking GPUs into account!
https://ark.intel.com/de/products/81018/Intel-Core-i3-4030U-Processor-3M-Cache-1_90-GHz
https://ark.intel.com/de/products/81908/Intel-Xeon-Processor-E5-2680-v3-30M-Cache-2_50-GHz

A strategy to use on Jureca would be to start one independent process per CPU (each stays within one NUMA domain and we avoid cache synchronization), load and decompress a chunk that fits together with the full mask set into the shared L3 cache and then spawn lightweight threads that eat through that chunk with small tiles where the mask tile set fits into the L1 or L2 on each core. That way we minimize transfers with the main memory. The main job of the main memory is to cache the contents of the compressed source file.

Probably we can find an implementation where people did the work for us already: #14
See for example:

http://www.cs.utexas.edu/~flame/pubs/GotoTOMS_revision.pdf
http://www.netlib.org/lapack/lug/node120.html
https://software.intel.com/en-us/mkl-developer-reference-c-blas-level-3-routines

I had a look at the effects of the different chunking parameters, profiling using the dask built-in Profiler, ResourceProfiler, and CacheProfiler.
The first case is test_chunks_01_01_*:

Doesn't look too bad, right? Except for it taking forever. If you zoom in, you get this:

As I understand it, a lot of very small tasks are created, and time is dominated by the overhead of managing them/communication. The following is a screenshot of a small part of the graph created:

It was not directly created from the computation of the benchmark, but should be very similar - and yes, the thick black line at the bottom is a bunch of edges! The access pattern to the chunks in the file then depends on the dask scheduler, and I don't know if they try to create a linear access pattern on the data.
In contrast, these are the profiles for test_chunks_48_48_*:

This looks better! Even though we get little benefit from multi-threading, if any.
Now my question would be: what are the effects on processing larger files? If the input was (1024, 1024, 128, 128) or larger, we would get a large number of chunks, too, and pay basically the same (avoidable)  overhead.
An idea would be to have a fixed amount of tasks, each working on a "stream" of hdf5 chunks. I guess this can be arranged by having small-ish hdf5 chunks (~1MB), but mapping them to larger dask chunks? That would also fit the rule of thumb for dask chunking: "A task should take longer than 100ms."

A nice presentation with lots of details and information about the issues we are working on: http://www.pytables.org/docs/LargeDataAnalysis.pdf

@sk1p Do you have an overview of PyTables vs dask? My feeling is that PyTables+Numexpr is made for distributing and blocking trivial "number crunching" tasks efficiently on out-of-core data sets, while dask works at a higher abstraction level with complicated dependencies and heterogeneous sub-tasks. That means one would use dask to coordinate a complicated analysis workflow while PyTables+Numexpr does the heavy lifting on each sub-task.

I committed the benchmark scripts, based on the one by @magnunor, into git. There is also an eager version, and a h5py+numpy version, to compare "plain" hyperspy vs lazy hyperspy vs numpy.
Now we can also compare the impact of chunking without taking lazy processing into account. For example, using emd_sum_np:
test_chunks_01_01_128_128.emd
init 0.5138914585113525
0.6539206504821777
3131.878460314532 MB/s (overall)
14625.521801387647 MB/s (without init)

test_chunks_48_48_128_128.emd
init 0.3355224132537842
0.48197388648986816
4249.192865852603 MB/s (overall)
13984.154305491793 MB/s (without init)

(The emd_sum_hs version performs comparably)
To establish a baseline for what performance can be attained, and to account for hdf5 overhead, I also wrote benchmarks for working on binary files (both in Python using np.tofile / np.fromfile and in C reading raw doubles). The Python version has comparable performance to the lazy hyperspy version (~4700MB/s), whereas the C version is quite a bit faster (~6300MB/s).
Comparing the binary version with the hdf5 version, I'd say hdf5 does perform quite well, if you apply large enough chunks. I also want to write a C version that reads hdf5 as another comparison point (hdf5 vs raw binary).

@uellue I haven't looked into pytables in depth yet

I'm closing this since it works well for matrix-matrix multiplication. For other algorithms we can open dedicated issues.


adds validation of reference path

According to JSON reference spec http://tools.ietf.org/html/draft-pbryan-zyp-json-ref-02#section-4 reference must be represented by valid URI which is not only a "link" with schema, but also a path to local file.
This PR supports #159

thanks for the contribution but this breaks the build. There is a panic with a stackoverflow

superseded by: #387

@casualjim thanks! I'm sorry, didn't notice the problem on my local, because it didn't reproduce at the first time. Following test runs revealed the problem.


Update osc_api_config.py

update API domain to get working links, e.g. after uploading the link to sequence

waiting to have api.kartaview.org up and running without any redirects.


Fix incorrect bounds check in RenderingDevice push constant

It also prevented its purpose of using a smaller slice of the buffer.

Thanks!


macOS Support

Pow seems really rad, but I'd really like to use it in some macOS applications! This is just an issue to start the discussion around this potentially rather large feature request.

Hi Brian, there's macOS support in Pow for everything but the most recent SoundEffects, even if it's poorly advertised.
I realize the Package.swift doesn't specify but we support macOS 12.6 and up, will try to get that fixed and add an macOS target to the Example app.
Let me know if there's anything else I can help with in the meantime!

Here's a quick first pass at a macOS version of the Pow Example app: https://github.com/movingparts-io/Pow-Examples/pull/2.

Thanks Robb, I’ll take a peak, please consider this issue closed for the
time being!
On Mon, Jan 23, 2023 at 12:00 PM Robb Böhnke @.***>
wrote:

Here's a quick first pass at a macOS version of the Pow Example app:
movingparts-io/Pow-Examples#2
https://github.com/movingparts-io/Pow-Examples/pull/2.
—
Reply to this email directly, view it on GitHub
https://github.com/movingparts-io/Pow/issues/18#issuecomment-1400674818,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAPTL73PW7GRJ5CAORLWRDWT22LPANCNFSM6AAAAAAUCPE6Z4
.
You are receiving this because you authored the thread.Message ID:
@.***>

Cool, feel free to reopen if you have any questions!

See #20

I figured it would be better to add to this issue rather than create a new issue. I was wondering if it makes more sense in a cross-platform codebase to make code like this no-op rather than throwing an error, Type 'AnyChangeEffect' has no member 'feedbackHapticSelection'.
.changeEffect(.feedbackHapticSelection, value: self.isShuffling, isEnabled: self.isShuffling)

I'm porting an over to the Mac and while it's possible for me to add conditional compilation flags to solve this, there are a lot of call-sites (as I love Pow) and I figured it might be worth asking if the better approach was to have the API work but just not do anything on the Mac.

Yeah, good call – I have done similar things for navigationBarTitleDisplayMode.


vagrant: use xenial64 instead of vivid64

The vivid64 image is no longer available.
Fixes https://github.com/appc/acbuild/issues/187.

LGTM


Masks inside of variants do not render correctly

Having a mask inside of a variant causes the object to render incorrectly:
Rendered

Expected

example project is attached
Ex4Google-variant-mask.zip

@HooHaa-code is this with 0.22-rc or 0.21? I'm wondering if the layout changes improve matters.
Alternatively, there's a new implementation of masking in main if you enable "SQUOOSH" here: https://github.com/google/automotive-design-compose/blob/3d8f2e9f5e39ff32476e6d3ee3e576e9e612b339/designcompose/src/main/java/com/android/designcompose/DesignView.kt#L971 -- this will break all kinds of other things (lists and grids, content substitution, etc) but it improves some rendering fidelity, e.g.: multiple masks on a single object should work, some basic animations are present, etc.

I have '+' set for design compose in libs.versions.toml.  So it should be 0.25.0

Ok, I am not sure if that would have gotten you the 0.25.0-rc release (@timothyfroehlich knows how these rules work). We just pushed 0.25.0 to Maven (about 30 minutes ago) so updating dependencies now should definitely pull it in.

I guess I assumed that when a release it git hub is made that we would get it though maven.  I was wrong in that assumption.  I just did a sync and say the 0.25.0 artifacts get pulled in.
The behavior is still the same


Migrations Support

I'm working on a new ASP.NET Core project using EF and Identity. We're testing the use of Postgres in this scenario and I've run into a couple of issues where we're trying to setup some seed data.
If we create a database via migrations using the command line, it does indeed create all of the Identity tables. I can even call CreateAsync which adds a user record. However if I call AddClaimsAsync it seems to do nothing. I stepped through into the Identity code and can see a call to the SaveChanges with the correctly updated model but the data never gets saved. I get no exceptions though.
I then tried to create the database using context.Database.EnsureCreated(); rather than the migration approach. In this case I get the tables (obviously without the migrationHistory table). In this scenario it seems that AddClaimAsync then works.
As a separate option I tried using context.Database.MigrateAsync(); In this case no database is created at all. I'm wondering if the migration implementation is complete or if this could be a bug.
All scenarios worked fine if I switched back to an SQL store instead of Postgres so I believe this would be something at the provider level?

I have very little knowledge about ASP.NET and its Identity functionality... To understand what's going on it would be very helpful to see an example that uses EFCore directly, rather than through ASP.NET. I'm not aware of any issues with the migration implementation, so it would be good to reproduce this and find the cause. I can't imagine why creating the database via EnsureCreated() would lead to different results with regards to migrations...
Turning on EFCore logging may provide some more information (you can also take a look at Npgsql logging and at PostgreSQL statement logging).

@roji Thanks for the quick reply. I'll try to spend some time on this and get a better understanding of what's happening and how to reproduce. I'm not sure exactly when I'll be able to put something together but will try to find some time. I've temporarily moved to the EF in memory database for the piece I'm working on, but I will need to get other environments working with Postgres soon.

I have a similar problem. In my case is then executing the command to add the migration. The archivo.cs is created, but the UP and DOWN generates empty methods .
I was told that it may be problem with the package Npgsql , so then I leave the link posted yesterday.
Newly I am beginning with Visual Studio and decided to start directly with NET Core. The tutorials I made so far are armed with SQL Server, and decided to start a new project solution Contoso University but using PostgreSQL.
Regards.
https://stackoverflow.com/questions/39027389/dotnet-ef-migrations-methods-generates-up-and-down-empty-when-migration-is-renam

@ceciliaf your problem doesn't have anything to do with this issue... Please open a new, separate that describes your problem. Also, please post the model and results in the issue (in addition to linking to the SO).

@stevejgordon have you had any time to look into this?

@roji Sorry I'm afraid I haven't recently. We switched to using the EF in memory provider during dev at the moment but will be revisiting PostGres at some stage.

@roji I've had a chance to look at this again and found out what I was doing wrong. Using the default Identity migrations that are created in a new project the migration file looks to be MsSQL specific where it defines the identity columns. I hadn't noticed this. I naively assumed that the migration code would be provider/db agnostic but it seems that is not the case.
Therefore when using context.Database.MigrateAsync() it's only partially setting up the schema in postgres, specifically not setting autogenerate for the id property. Of course when I then try to seed it fails to save the records as I'm not providing an ID.
I blew away the default migrations file and created a new one while the connection string was set to postgres and it seems to be working as expected now.


WoA Installer does not run

Trying to run mono Installer.Raspberry.Application.exe (the one from https://github.com/WOA-Project/WoA-Installer/releases/tag/1.5) results in following message:

The entry point method could not be loaded due to Could not load file or assembly 'PresentationFramework, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies.

and exits immediately afterwards.

Mono? This only run on Windows 10 😅

Why?

Mono does not support WPF

Not only that, this tool uses DISM, BCDEDIT and BCDBOOT tools internally. I seriously doubt it could work in Linux some day.


Restore setattr when subclassing and we didn't write a new setattr

Currently if you do this:
@attr.s(frozen=True)
class A:
    a = attr.ib()

@attr.s
class B(A):
    b = attr.ib()

B is frozen too, because we don't write a new __setattr__ to overwrite the old one. Once #660 is merged, this will become an even bigger problem.
We have to restore __setattr__ to object.__setattr__ if we don't have a reason to overwrite the existing one ourselves.
auto_detect=True should be considered.

OK turns out, the inheritance of frozeness is on purpose #128. Whether or not that was a good idea I'm not sure, but it's not something I'm willing to break.


Fix texture exporting.

Addresses #237
References:
https://github.com/Thar0/n64texconv/blob/main/n64texconv.py#L534
https://github.com/ata4/angrylion-rdp-plus/blob/master/src/core/n64video/rdp/tmem.c

I think there may still be an issue with the textures.  Looking at the do_action_static textures, the colours appear to be #000000 for the outline, and #e0e0e0 for the fill/text colour.
The original textures would have been pure black #000000 and pure white #FFFFFF
Now importing these PNGs obviously have no visual difference because of how the data is interpreted, but if we know what these colours should be, and the export/extraction process is not matching that - is this something to look at?

I think there may still be an issue with the textures. Looking at the do_action_static textures, the colours appear to be #000000 for the outline, and #e0e0e0 for the fill/text colour.
The original textures would have been pure black #000000 and pure white #FFFFFF
Now importing these PNGs obviously have no visual difference because of how the data is interpreted, but if we know what these colours should be, and the export/extraction process is not matching that - is this something to look at?

 Opacity on ia8 images no longer appears to be at 97% either. This PR should be good to merge.


[SPARK-24956][Build][test-maven] Upgrade maven version to 3.5.4

What changes were proposed in this pull request?
This PR updates maven version from 3.3.9 to 3.5.4. The current build process uses mvn 3.3.9 that was release on 2015, which looks pretty old.
We met an issue to need the maven 3.5.2 or later.
The release note of the 3.5.4 is here.
From the release note of the 3.5.0, the followings are new features:

ANSI color logging for improved output visibility
add support for module name != artifactId in every calculated URLs (project, SCM, site): special project.directory property
create a slf4j-simple provider extension that supports level color rendering
ModelResolver interface enhancement: addition of resolveModel(Dependency) supporting version ranges

How was this patch tested?
Existing tests

@kiszk, thanks! I am a bot who has found some folks who might be able to help with the review:@tomdz, @pwendell and @marmbrus

cc @srowen  @HyukjinKwon

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/1436/
Test PASSed.

Test build #93711 has started for PR 21905 at commit a8a545c.

hmm, interesting suggestions https://github.com/apache/spark/pull/21905#issuecomment-408580441

Test build #93711 has finished for PR 21905 at commit a8a545c.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93711/
Test FAILed.

retest this please

Test build #93718 has started for PR 21905 at commit a8a545c.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/1442/
Test PASSed.

Test build #93718 has finished for PR 21905 at commit a8a545c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93718/
Test PASSed.

Merged build finished. Test PASSed.

Oh darnit, as soon as I merge this (which is fine) it triggers me to think -- this should also have updated the version of Maven that the build script downloads for you. I'll do that.


Question : indicators and Ichimoku

Indicators can be used to Ichimoku ?

Ichimoku cloud added.

Good ! :)

Only on v2 ?


Initial routing state is null

Issue Type

[x] Bug (https://github.com/mxstbr/react-boilerplate/blob/master/.github/CONTRIBUTING.md#bug-reports)

Description
It seems that when any page is loaded the initial routing state (which is supposed to be kept in sync by react-router-redux) is null. I have the sneaking suspicion that an initial LOCATION_CHANGE event is firing before everything is initialized and is thus not being persisted in the store, but that's just a guess. On a fresh install of the boilerplate you can see loading the /features page shows an empty route state:

Steps to reproduce

Clone & start react-boilerplate
Navigate to /features page
Refresh the page
Inspect redux route store

Versions

Node/NPM: 6.9/3.10
Browser: All

Navigation to /features page

@zsherman I presume you are referring to entering /features in the browser's address bar, resulting in a 404 when any "page" other than "/" is requested?
This is covered in the docs:

Rewrite all pages (e.g. yourdomain.com/subpage) to yourdomain.com/index.html to let react-router take care of presenting the correct page.

This seems acceptable if the finished app is to run on a server where you control such configuration, but it would be nice if the router could receive and act on any URL.

@gihrig there is no 404, I'm running it locally as you can see in the screenshot above.

@zsherman You're right, I was thinking of a different issue (offline mode).
I was not able to produce your results on latest dev branch. You are testing against master?
OS X 10.11.6
Node 6.9.1
Chrome 55.0.2883.95 (64-bit)

@gihrig I can see from your screenshot that the route state is indeed empty – locationBeforeTransitions is null, isn't it?

@zsherman OK I see now.
I was confused when I did not see the "null" label in your screenshot.
'locationBeforeTransitions' is indeed labeled "null" when hovered.
The screenshot below is the condition I see after navigating away and back to /features using the buttons in the application.

If you or anyone else would like to dig into this and open a PR, that would be much appreciated.

What is that GUI tool you both guy's using for displaying your store ?

@kopax it's part of redux-devtools

I think react-router-redux forced LOCATION_CHANGE action on every page load, so the routing state  always has the initial data.
However, react-boilerplate skips the initial LOCATION_CHANGE action on page load, mainly because sagas are loaded and cancelled dynamically on route change.
My walk around solution to this is replacing the following piece
const routeInitialState = fromJS({   locationBeforeTransitions: null, });
to this
const query = window.location.search.substring(1); const routePayload = {   action: 'POP',   hash: '',   key: null,   pathname: window.location.pathname,   search: window.location.search,   query: query ? JSON.parse({"${decodeURI(query).replace(/"/g, '\"').replace(/&/g, '","').replace(/=/g, '":"')}"}) : {},   state: undefined, }; const routeInitialState = fromJS({   locationBeforeTransitions: routePayload, });
Just manually initiating the route data instead of setting null.

I think react-router-redux forced LOCATION_CHANGE action on every page load, so the routing state  always has the initial data.
However, react-boilerplate skips the initial LOCATION_CHANGE action on page load, mainly because sagas are loaded and cancelled dynamically on route change.
My walk around solution to this is replacing the following piece from 'app/reducer.js'
const routeInitialState = fromJS({
  locationBeforeTransitions: null,
});

to this
const query = window.location.search.substring(1);

const routePayload = {
  action: 'POP',
  hash: '',
  key: null,
  pathname: window.location.pathname,
  search: window.location.search,
  query: query ? JSON.parse(`{"${decodeURI(query).replace(/"/g, '\\"').replace(/&/g, '","').replace(/=/g, '":"')}"}`) : {},
  state: null,
};
const routeInitialState = fromJS({
  locationBeforeTransitions: routePayload,
});

Just manually initiating the route data instead of setting null.

@devmtnaing This feels to me like the correct solution:

Only reducers should mutate state.
2.All reducers should provide an appropriate initial state.

@zsherman Does this solve the problem for you?

like @devmtnaing answer, there are another solution:
replace
const routeInitialState = fromJS({
  locationBeforeTransitions: null,
});

to
import { browserHistory } from 'react-router';
...
const routePayload = browserHistory.getCurrentLocation();
const routeInitialState = fromJS({
  locationBeforeTransitions: routePayload,
});

Closing due to inactivity


Start-DbaAzMigration

No idea if this is even useful but Start-DbaAzMigration would be similar to Start-DbaMigration but it'd use bacpacs and just migrate whats supported (Databases and logins?) Also gotta test if you can create a db that doesn't exist yet.
Here's some code that I used for a single db
$bacpac = Export-DbaDacPackage -SqlInstance localhost -Database $dbname -Type Bacpac
$results = $bacpac | Publish-DbaDacPackage -Database $dbname -SqlInstance $aserver -Confirm:$false -Type Bacpac

sqlpackage is available on Linux, I could make it core compat too.

Yes, bacpac can be used on new Azure SQL DBA server to create new databases. That is the primary function of it in Azure.


sparseml integration

Add option to use sparseml. This is still a little rough around the edges, but I welcome the feedback! Implementation on Google Colab.
Still needs:

Implementation of MODELS_PATH and RECIPE_PATH through Hydra instead of environment variable
"test" stage needs to work, only training and evaluation work at the moment
stylistic coding changes

Will continue to add more changes after my reactions engineering exam tomorrow. Feel free to give me pointers or links to tutorials if you see any changes I need to make.

Wow, that's a lot of red. I think I may be able to get rid of the dependency to pytorch-lightning-bolts, which isn't even listed as a dependency yet. Also, @SeanNaren I've tested sparseml with torch 1.9, and it works!? I'll do a more thorough test after my test tomorrow and add the appropriate changes.

Thanks @mathemusician I'll be able to assist next week :)

PR looks good! Any chance you could add a quick test for one of the tasks to ensure the callback works end to end?

PR looks good! Any chance you could add a quick test for one of the tasks to ensure the callback works end to end?

I'll try, it's my first time writing tests. Gotta start somewhere.

PR looks good! Any chance you could add a quick test for one of the tasks to ensure the callback works end to end?

I'll try, it's my first time writing tests. Gotta start somewhere.

let me know if you get stuck, more than happy to help out! Code is really well thought out so far, so I have no hesitations that you can't do it :D

The logger and callback tests need certain imports that aren't in requirements.txt. But I wasn't sure if we wanted to add more import statements. The logger test needs wandb; and the sparseml callback test needs pytorch 1.7-1.8.

Should I add wandb to requirements.txt? Also, I'm going to update the docs with the different ways to use sparseml soon

Thanks for your hard work @mathemusician hopefully tests should pass now, and we can merge :)


Repeater pagination if zero (that is no items) or one page exist

Some thought needs to be put into deciding how to display the pagination in the repeater footer.
One option is that paging should only be text if it is 0 of 0 pages or 1 of 1 pages. We may still want "combobox" padding with a border though so that the UI doesn't jump around.
Cross reference with #1349.

This has been resolved. Thanks.


Migrate SNS topic code into this module

Management of a SNS topic appears inside the techservicesillinois/terraform-aws-cloudwatch-alarm module. This should be made generic and migrated to a submodule modules/topic.

Closed by #3.


Category support

Since my company came up against the same requirement to support categories, I built an implementation using either files or properties (you can also specify the property to use the ones from gitweb, should your repositories already have them). We've had this in production for a couple of days now and it seems to be working so far.

I can see a lot of work went into this but I'm reluctant to add it as a core part of gitlist because it violates the simplicity and can't see it being that useful for the majority of users. The search feature is sufficient enough to filter repositories (we don't really want to go down the gitlab route and add support for groups, which this is technically is adding).

I agree with @garygreen.


[BugFix] Recover with empty tablet when BE is down

What type of PR is this：

[x] bug

Which issues of this PR fixes ：

Fixes #5708

[FE PR Coverage check]
:disappointed: fail : 0 / 27 (00.00%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/clone/TabletScheduler.java
0
3
00.00%

:large_blue_circle:
com/starrocks/catalog/LocalTablet.java
0
1
00.00%

:large_blue_circle:
com/starrocks/clone/TabletSchedCtx.java
0
23
00.00%

What's the purpose of getting results from an empty tablet?

What's the purpose of getting results from an empty tablet?

Just wanna the query can be executed normally even if there is data loss. @chaoyli

Config.recover_with_empty_tablet is used to recover a tablet that lost some data.
That makes the query run ok but the user should ingest the lost data again.
Your purpose is to make the query ignore the backends down when the replica has no data.
There are not the same. @mchades

That makes the query run ok but the user should ingest the lost data again.

It's almost impossible to ingest the lost data again, because it's hard to tell the lost data.
When I create a single replica table and turn on Config.recover_with_empty_tablet, that means I can accept the cost of data loss but the query(select and insert) should not report error. However, at present, the table is disavailable until BE up. @chaoyli

@mchades There is some difference between BE is down and BE lost some data. When be is down, they should clone from other BEs. When BE lost some data, and can not be cloned from other BEs. You can use it.

@mchades There is some difference between BE is down and BE lost some data. When be is down, they should clone from other BEs. When BE lost some data, and can not be cloned from other BEs. You can use it.

exactly correct! All works well with non-single replica.
This PR is only considered about tablet with single replica:

When be is down, they should clone from other BEs.

When BE is down, with single replica, there is no available source replica left, and resulte in the clone task fail. For user, the select and insert statement returns error on this tablet, it looks like Config.recover_with_empty_tablet dosen't work. It's the situation what u say as When BE lost some data, and can not be cloned from other BEs.
@chaoyli

I see it. Very glad to approve the pull request. Before it, you can add more FE unit tests to pass the test coverage. @mchades

@chaoyli Thanks for your time to discussion. Coverage check has passed.

run starrocks_fe_unittest

run starrocks_fe_unittest

run starrocks_fe_unittest

run starrocks_fe_unittest

[FE PR Coverage check]
:heart_eyes: pass : 40 / 40 (100.00%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/clone/TabletScheduler.java
3
3
100.00%

:large_blue_circle:
com/starrocks/catalog/LocalTablet.java
1
1
100.00%

:large_blue_circle:
com/starrocks/server/GlobalStateMgr.java
1
1
100.00%

:large_blue_circle:
com/starrocks/clone/TabletSchedCtx.java
35
35
100.00%


Updating fixtures

adding:

meetups
talks from pycon
speakers from pycon
sponsors from pycon

Fix #171

Current coverage is 91.71% (diff: 100%)

Merging #177 into master will not change coverage

@@             master       #177   diff @@
==========================================
  Files            34         34
  Lines           954        954
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
  Hits            875        875
  Misses           79         79
  Partials          0          0

Powered by Codecov. Last update 752c3a3...744381f

@arruda looks good. Thanks.


How to change RESET Pin?

Hello! Thank you for your work! Could you ask me, how to change D0 pin to other?
D0/GPIO16 - RST (wake-up purpose)
I cant find in sketch...

Hi,
In which sketch?

In ha_mqtt_sensor_dht22 :)

You cannot change this pin, it's hardware. It's used to wake up the board after a period of time (D0: wake, to RST)


Add Process.Close

Fixes dotnet/dotnet-api-docs#1838

I don't know what is inapplicable. But Close method call is duplicate with using statement.

Thanks, @NextTurn, for the additional changes. I'll merge your PR.


Checks that depend on the scientific library should first assert that module is installed

Rather than letting the evaluation fail with something like a ModuleNotFoundError we probably should make sure we have some logic that we can re-use for all checks that depend on the scientific library that explicitly checks whether the module is installed and throws a proper log and potentially a link to the docs on how to install the module so that users do not have to parse the ModuleNotFoundError for themselves.

SODA-550


chore: remove self from codeowners

Motivation
I can't be subscribed to notifications on my own PRs without also getting email/github notifications for every PR
Solution
Remove self from codeowners
PR Checklist

[ ] Added Tests
[ ] Added Documentation
[ ] Breaking changes

also chore for anyone:
@Evalir is in codeowners, but seems to have had repo permissions removed. He should be reinstated
I would re-add him to this repo, but my permissions were downgraded at some point


affected/package: runtime  relocation target runtime.getg not defined

What version of Go are you using (go version)?
all

$ go version

Does this issue reproduce with the latest release?
relocation target runtime.getg not defined
package main
import "unsafe"
func main() {
println(getg())
}
//go:linkname getg runtime.getg
func getg() unsafe.Pointer
What operating system and processor architecture are you using (go env)?
go env Output
$ go env

What did you do?

What did you expect to see?
What did you see instead?

//go:linkname is intended for internal low-level use. It will not work for magic runtime functions like getg.


List of values instead of list of objects?

I didn't see this anywhere in the documentation, but, by default, the model is like this:
 [{"text":"Tag1"},{"text":"Tag2"},{"text":"Tag3"}]

I understand that you can change the name of the key (in the key-value pair), but is there any way to have the model be a simple list of strings?  Eg:
 ["Tag1","Tag2","Tag3"]

FWIW, other tag input libraries allow for this and, in my case, this is the model I need to send to the server.

+1

I need the same behaviour. It would be nice to enable this by simply setting 'key-property' to null or "".

Sorry for not replying sooner.
That's not currently possible, but there is an issue for it on the backlog already. It'll probably be implemented in the next release.

Can this issue be closed?

This issue was selected to be spring-cleaned by a script. More information can be found here.
If anyone thinks this was a mistake and this issue should be reopened, please leave a message below explaining why. Before doing so, please consider reading the CONTRIBUTING file.


feature/SDK-1

Codecov Report
Attention: 340 lines in your changes are missing coverage. Please review.

Comparison is base (ba38097) 45.89% compared to head (24476bf) 32.14%.
 Consider uploading reports for the commit 5338d77 to get more accurate results

Files
Patch %
Lines

packages/oid4vci-holder/src/agent/OID4VCIHolder.ts
0.00%
112 Missing :warning:

...s/oid4vci-holder/src/agent/OID4VCIHolderService.ts
0.00%
97 Missing :warning:

...kages/oid4vci-holder/src/machine/oid4vciMachine.ts
0.00%
82 Missing :warning:

...es/oid4vci-holder/src/localization/Localization.ts
0.00%
25 Missing :warning:

...oid4vci-holder/src/agent/OIDC4VCIBrandingMapper.ts
0.00%
18 Missing :warning:

packages/ssi-sdk-core/src/utils/image.ts
84.84%
5 Missing :warning:

packages/event-logger/src/agent/EventLogger.ts
0.00%
1 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@             Coverage Diff              @@
##           develop     #163       +/-   ##
============================================
- Coverage    45.89%   32.14%   -13.75%
============================================
  Files           65      155       +90
  Lines         2412     7621     +5209
  Branches       539     1841     +1302
============================================
+ Hits          1107     2450     +1343
- Misses        1305     5170     +3865
- Partials         0        1        +1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Ensure loggers run init event before callbacks in Engine

What does this PR do?
We want loggers to be initialized before callbacks. Currently, we enforce that by ordering loggers before callbacks when we store them in State. We also have a unit test that makes sure this is true.
This PR changes the way we enforce that by not enforcing any ordering of callbacks. Instead, we have engine.run_event do the following:

process loggers first then callbacks when the event is INIT
callbacks first then loggers in all other events. This is because some logging logic is done lazily (collects all logging calls and flushes them at once). In that case we want all the callbacks to execute all their logging calls before the loggers actually log everything.

What issue(s) does this change relate to?

Can we add a test for this please?

done


--since and --until should support time ranges (from current)

Examples:
--since 4d
--until 2y4m

Can use the ISO8601 duration spec without the T and uppercasing.

https://api.rubyonrails.org/v5.2.1/classes/ActiveSupport/Duration.html#method-c-parse


pyfluent.datamodel WARNING: Currently calling the datamodel API in a generic manner. Please run python codegen/allapigen.py from the top-level pyfluent directory to generate the local datamodel API classes.

🔍 Before submitting the issue

[X] I have searched among the existing issues
[X] I am using a Python virtual environment

🐞 Description of the bug
I'm learning the official lesson of 'Getting Started with Ansys PyFluent'. There is a exercise in Lesson 3 for starting a Jupyter session of recorded PyFluent Journal. I opened the .ipynb file offered by official and runned the codes of first section, then I receieved the warning that "pyfluent.datamodel WARNING: Currently calling the datamodel API in a generic manner. Please run python codegen/allapigen.py from the top-level pyfluent directory to generate the local datamodel API classes.". Can anyone teach me how to solve this issue? Thank you so much.

📝 Steps to reproduce
Just type these codes of the picture above, and the issue will appears.
💻 Which operating system are you using?
 I have suffered the same thing when I tried to run the first example, even going through the tutorial videos it was impossible for me to run the script.  I am running the examples in almost the same conditions as you, Windows 11, Python version 11 and the same version of Ansys for students.
The solution I found was to install Git and clone the repository included in the instructions(for developers). Inside the repository in the folder named "codegen " is the file that announces the warning "allapigen.py "(this was my clue). So I clone the repository, copy my jupyter notebook script and paste it into the same path as the cloned repository. Then from the command line I run the jupyter notebook file and it finally runs.
I am not sure about the problem, I guess it is related to a path issue and working with the repository locally it is possible to run the script without problems.
I hope my answer is helpful.

@zzz-luo @VincenzoRO Sorry for the delayed answer, but the PyFluent package on PyPI does not yet include the API files for Ansys Fluent 2024 R1.
For now, if you want to use PyFluent with Ansys 2024 R1 with all the API functionalities, you need to use the development PyFluent install as described here: https://fluent.docs.pyansys.com/version/stable/getting_started/installation.html#install-the-package
The next PyFluent release (work in progress) is going to contain the 2024 R1 API files, so that doing this won't be necessary anymore.

Thank you for the information @raph-luc.
By chance, do you know if the PyPI version will be updated before the end of the month?
Thank you.

There is an updated release in the PyPi now -> v0.19.1
@schrummy14, please confirm if this issue is resolved now. Thank you.

We now have a PyPi release of 0.19.1 which should solve this issue. @schrummy14, could you please confirm: https://pypi.org/project/ansys-fluent-core/0.19.1/

Hello,
Yes, I can confirm that the error is now gone.
Thank you.


[CH] Support converting sort merge join into hash join

Description
At present,  the sort merge join in CH doesn't support  inequal conditions which involve columns from both tables. In this case, converting the sort merge join to hash join may work.

A example
select t1.n_nationkey, t2.n_nationkey from tpch_pq.nation as t1 left  join tpch_pq.nation as t2 on t1.n_nationkey = t2.n_nationkey and t1.n_regionkey >= t2.n_regionkey ;

It may related with https://github.com/apache/incubator-gluten/pull/1986

A example
select
  t1.n_nationkey, t2.n_nationkey from tpch_pq.nation as t1 left  join tpch_pq.nation as t2
on t1.n_nationkey = t2.n_nationkey
  and t1.n_regionkey >= t2.n_regionkey ;

t1.n_regionkey >= t2.n_regionkey contains columns from t1 and t2.

@lgbo-ustc
Let CHJoinValidateUtil::shouldFallback always return false. and try tpch 21 at https://github.com/apache/incubator-gluten/blob/53858ec3ded3cee2e675a1f729bee37718b57dd1/backends-clickhouse/src/test/scala/org/apache/gluten/execution/GlutenClickHouseTPCHSuite.scala#L174
TPCH21 has != in On clause
+- ^(169) RowToCHNativeColumnar
   +- *(1) BroadcastHashJoin [l_orderkey#9760L], [l_orderkey#9807L], LeftAnti, BuildRight, NOT (l_suppkey#9809L = l_suppkey#9762L), false
      :- *(1) BroadcastHashJoin [l_orderkey#9760L], [l_orderkey#9790L], LeftSemi, BuildRight, NOT (l_suppkey#9792L = l_suppkey#9762L), false


TPI debug

TPI has had 4 issues in the first few periods that we couldn't figure out.  They were:
-strange jump after first period in K and L timepaths
-the first upper triangle of the twist doughnut wouldn't work with scalar values
-consumption was negative in a couple entries
-consumption had discontinuous jumps for a couple individuals
These have all been fixed.  The first was due to grabbing the wrong capital stock for the upper triangle of TPI.  The second just needed us to finish writing a scalar version of the total_tax function.  The final was due to some poor initial guesses in TPI.

Also, this does not affect our wealth tax results at all.  Only the first few time periods of TPI were affected.  But this change has been updated in the SS_method2 folder of the wealth tax repo.


How to deal with the long task

I have a long task in onTick
void onTick(object sender, EventArgs e) {
    if (!init) {
        result=longTask();
        init=true;
    }
    // use result below
}

whenever I refresh the script,  longTask() is executed again. And the game will be stuck and not responding a while.
Is there way to prevent the game not responding?
Thanks!

what on earth do you have running in long task that causes the game to freeze for a while? anyway the solution is to use Script.Yield() throughout the task so that the game can do whatever it needs to do inbetween executing your task

Or run the task in a separate thread if it is not referencing anything of the GTA namespace.

In fact, the long task is required to run only once.
When loading into the story mode, the task will be executed.
But I only want the task to be executed only once, even though I tried to refresh the script.
the problem is that, I have to fetch the result of the long task, I tried to store the result as a class member, but the results always is destroyed whenever I refresh the script.
So I want a way to permanently store the result.

Serialize the result to a file and check if that file exists at script start. If it does, deserialize the result from the file, otherwise run the task.

Reloading a script destroys and recreates the entire .NET appdomain, so anything you store in memory is lost. There is no way around using some other media like the disk.

@crosire
I see.
thanks!

If we could get session ids, it would be more convenient, but GET_IS_LOADING_SCREEN_ACTIVE will help you.


System.ObjectDisposedException: Cannot access a disposed object. on DefaultFunctionContext

Description
When running the attached reproduction for a while (usually after a few hours) in functions using Linux (we tried it in Switzerland North) the following exception occurs
Microsoft.Azure.WebJobs.Host.FunctionInvocationException: Exception while executing function: Functions.ServiceBusMessageHandler_workday_validation_queue
 ---> Microsoft.Azure.WebJobs.Script.Workers.Rpc.RpcException: Result: Failure
Exception: System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'IServiceProvider'.
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
   at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateScope()
   at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\a\_work\1\s\src\DotNetWorker.Core\Context\DefaultFunctionContext.cs:line 48
   at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c__DisplayClass3_0`1.<UseMiddleware>b__1(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\Hosting\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 105
   at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89
   at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a\_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88
Stack:    at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
   at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateScope()
   at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\a\_work\1\s\src\DotNetWorker.Core\Context\DefaultFunctionContext.cs:line 48
   at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c__DisplayClass3_0`1.<UseMiddleware>b__1(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\Hosting\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 105
   at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89
   at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a\_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88
   at Microsoft.Azure.WebJobs.Script.Description.WorkerFunctionInvoker.InvokeCore(Object[] parameters, FunctionInvocationContext context) in /src/azure-functions-host/src/WebJobs.Script/Description/Workers/WorkerFunctionInvoker.cs:line 101
   at Microsoft.Azure.WebJobs.Script.Description.FunctionInvokerBase.Invoke(Object[] parameters) in /src/azure-functions-host/src/WebJobs.Script/Description/FunctionInvokerBase.cs:line 82
   at Microsoft.Azure.WebJobs.Host.Executors.VoidTaskMethodInvoker`2.InvokeAsync(TReflected instance, Object[] arguments) in D:\a\_work\1\s\src\Microsoft.Azure.WebJobs.Host\Executors\VoidTaskMethodInvoker.cs:line 20
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionInvoker`2.InvokeAsync(Object instance, Object[] arguments) in D:\a\_work\1\s\src\Microsoft.Azure.WebJobs.Host\Executors\FunctionInvoker.cs:line 53
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.InvokeWithTimeoutAsync(IFunctionInvoker invoker, ParameterHelper parameterHelper, CancellationTokenSource timeoutTokenSource, CancellationTokenSource functionCancellationTokenSource, Boolean throwOnTimeout, TimeSpan timerInterval, IFunctionInstance instance) in D:\a\_work\1\s\src\Microsoft.Azure.WebJobs.Host\Executors\FunctionExecutor.cs:line 581
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.ExecuteWithWatchersAsync(IFunctionInstanceEx instance, ParameterHelper parameterHelper, ILogger logger, CancellationTokenSource functionCancellationTokenSource) in D:\a\_work\1\s\src\Microsoft.Azure.WebJobs.Host\Executors\FunctionExecutor.cs:line 527
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.ExecuteWithLoggingAsync(IFunctionInstanceEx instance, FunctionStartedMessage message, FunctionInstanceLogEntry instanceLogEntry, ParameterHelper parameterHelper, ILogger logger, CancellationToken cancellationToken) in D:\a\_work\1\s\src\Microsoft.Azure.WebJobs.Host\Executors\FunctionExecutor.cs:line 306
   --- End of inner exception stack trace ---
   at Microsoft.Azure.WebJobs.ServiceBus.SessionMessageProcessor.CompleteProcessingMessageAsync(ServiceBusSessionMessageActions actions, ServiceBusReceivedMessage message, FunctionResult result, CancellationToken cancellationToken)
   at Microsoft.Azure.WebJobs.ServiceBus.Listeners.ServiceBusListener.ProcessSessionMessageAsync(ProcessSessionMessageEventArgs args)
   at Azure.Messaging.ServiceBus.ServiceBusProcessor.OnProcessSessionMessageAsync(ProcessSessionMessageEventArgs args)
   at Azure.Messaging.ServiceBus.ServiceBusSessionProcessor.OnProcessSessionMessageAsync(ProcessSessionMessageEventArgs args)
   at Azure.Messaging.ServiceBus.SessionReceiverManager.OnMessageHandler(EventArgs args)
   at Azure.Messaging.ServiceBus.ReceiverManager.ProcessOneMessage(ServiceBusReceivedMessage triggerMessage, CancellationToken cancellationToken)

At the moment we don't think it is anything particular to do with the session in ASB or the ASB integration but rather with the function context handling in the middleware.
It could also be that it is related to the other issues in regard to ObjectDisposedExceptions.
https://github.com/Azure/azure-functions-dotnet-worker/issues/1929
I have already raised two PRs surrounding my research in this area but I'm unsure if they'll help
https://github.com/Azure/azure-functions-dotnet-worker/pull/2686
https://github.com/Azure/azure-functions-dotnet-worker/pull/2685
I have also made a comment about the use of TaskCompletionSource in the synchronization logic between the middleware.
Steps to reproduce
Run the repro on Service Bus for a while Experiment.zip

We're getting the same kind of errors all over the place when using consumption plans; no behaviour so far that could help identify the faulting process. It fails about 5% of the time, randomly on our Azure Function App in consumption plan. Using App Service Plan on those function resolve the issue.
Sample exception:
Result: Failure Exception: System.ObjectDisposedException: Cannot access a disposed object. Object name: 'IServiceProvider'. at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException() at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateScope() at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\a_work\1\s\src\DotNetWorker.Core\Context\DefaultFunctionContext.cs:line 48 at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c__DisplayClass3_01.<UseMiddleware>b__1(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\Hosting\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 105 at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 91 at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a\_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88 Stack: at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException() at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateScope() at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\a\_work\1\s\src\DotNetWorker.Core\Context\DefaultFunctionContext.cs:line 48 at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c__DisplayClass3_01.b__1(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\Hosting\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 105 at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 91 at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88

@danielmarbach 's issue was originally mine and he kinda posted it for me (thanks again)
I'm still getting the same exceptions you posted @jsparent
However, I've tried publishing the function in Switzerland North and Europe West and I'm only getting the exceptions in Switzerland North, so far (running the function for two days now)
Where do you host your function, @jsparent ?

@domenichelfenstein our function apps are located in Canada Central

Are you using Windows or Linux, @jsparent ?

@domenichelfenstein We're using Linux

We are also experiencing the same issue. Our function app is running on a Linux-hosted consumption plan in the West Europe region.
For reference:
Result: Failure
Exception: System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'IServiceProvider'.
at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateScope()
at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\a\_work\1\s\src\DotNetWorker.Core\Context\DefaultFunctionContext.cs:line 46
at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c__DisplayClass3_0`1.<UseMiddleware>b__1(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\Hosting\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 105
at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context)
at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a\_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88
Stack: at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateScope()
at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\a\_work\1\s\src\DotNetWorker.Core\Context\DefaultFunctionContext.cs:line 46
at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c__DisplayClass3_0`1.<UseMiddleware>b__1(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\Hosting\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 105
at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context)
at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a\_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88

UPDATE:
We stopped having this error on September 21st 2024 from 18:00 EST. We didn't change anything, we even reverted back the original code afterwards, and we haven't had any problem since.
It happened on ~10 differents Function Apps, and it all stopped at once. While I'm glad this is no longer an issue, I'm pretty sure this is something happening in the "other" layer of the Function App Service. Hardware or routing maybe?

Same here: Problem seems to be gone. But without an acknowledgement of the problem by Microsoft and a clear message what they've changed, I don't know if these exception could reappear all of a sudden.

We received this same error with a Timer Triggered Durable Function running on an Windows Elastic Premium plan. I opened up a support ticket and will report back any findings.

We encounter the same issue.
We have Azure Functions on pricing tier "Consumption" and "Standard". Both hosted on "Windows" and "West Europe". All of them have the same issue. It seems that the problem started with the migration from ".NET6 in-process" to ".NET8 isolated".
I can visualize this with the following KQL query:
exceptions | where details contains "System.ObjectDisposedException"
 | summarize count() by week_of_year(timestamp)
 | order by Column1 asc

Fixed race condition that could lead to an ObjectDisposedException when using the ServiceBusSessionProcessor.

https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/servicebus/Azure.Messaging.ServiceBus/CHANGELOG.md#bugs-fixed-9
That's the only potentially related issue I could find in the Service Bus SDK.
It makes me sorrowful that there is no traction on this issue for such a long time.

@danielmarbach the bug fix you mentioned could be related.
However, the Microsoft.Azure.Functions.Worker.Extensions.ServiceBus version in my error-throwing sample project is 5.22.0 which uses the version 7.18.1 of Azure.Messaging.ServiceBus. The fix has been introduced in 7.16.1.
So, this fix is definitely not solving the issue many of us are encountering here.
I second the sorrowful feeling of @danielmarbach

I've been looking at a similar exception from an Orchestrator function without much luck. It has so far only been a one-off occurrence.

net8.0
isolated
dockerized (linux)
Function App running in Container Apps
microsoft.azure.functions.worker.extensions.servicebus => 5.21.0

"message": "Function 'MainOrchestrator' failed with an unhandled exception.",
"details": "Microsoft.Azure.WebJobs.Host.FunctionInvocationException: Exception while executing function: Functions.MainOrchestrator
 ---> Microsoft.Azure.WebJobs.Script.Workers.Rpc.RpcException: Result: Failure
Exception: System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'IServiceProvider'.
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
   at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateScope()
   at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\\a\\_work\\1\\s\\src\\DotNetWorker.Core\\Context\\DefaultFunctionContext.cs:line 46
   at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c__DisplayClass3_0`1.<UseMiddleware>b__1(FunctionContext context) in D:\\a\\_work\\1\\s\\src\\DotNetWorker.Core\\Hosting\\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 105
   at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context)
   at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\\a\\_work\\1\\s\\src\\DotNetWorker.Grpc\\Handlers\\InvocationHandler.cs:line 88
Stack:    at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
   at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateScope()
   at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\\a\\_work\\1\\s\\src\\DotNetWorker.Core\\Context\\DefaultFunctionContext.cs:line 46
   at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c__DisplayClass3_0`1.<UseMiddleware>b__1(FunctionContext context) in D:\\a\\_work\\1\\s\\src\\DotNetWorker.Core\\Hosting\\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 105
   at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context)
   at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\\a\\_work\\1\\s\\src\\DotNetWorker.Grpc\\Handlers\\InvocationHandler.cs:line 88
   at Microsoft.Azure.WebJobs.Script.Description.WorkerFunctionInvoker.InvokeCore(Object[] parameters, FunctionInvocationContext context) in /src/azure-functions-host/src/WebJobs.Script/Description/Workers/WorkerFunctionInvoker.cs:line 101
   at Microsoft.Azure.WebJobs.Script.Description.FunctionInvokerBase.Invoke(Object[] parameters) in /src/azure-functions-host/src/WebJobs.Script/Description/FunctionInvokerBase.cs:line 82
   at Microsoft.Azure.WebJobs.Script.Description.FunctionGenerator.Coerce[T](Task`1 src) in /src/azure-functions-host/src/WebJobs.Script/Description/FunctionGenerator.cs:line 225
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionInvoker`2.InvokeAsync(Object instance, Object[] arguments) in D:\\a\\_work\\1\\s\\src\\Microsoft.Azure.WebJobs.Host\\Executors\\FunctionInvoker.cs:line 53
   at Microsoft.Azure.WebJobs.Extensions.DurableTask.OutOfProcMiddleware.<>c__DisplayClass10_0.<<CallOrchestratorAsync>b__0>d.MoveNext() in D:\\a\\_work\\1\\s\\src\\WebJobs.Extensions.DurableTask\\OutOfProcMiddleware.cs:line 130
--- End of stack trace from previous location ---
   at Microsoft.Azure.WebJobs.Host.Executors.TriggeredFunctionExecutor`1.<>c__DisplayClass7_0.<<TryExecuteAsync>b__0>d.MoveNext() in D:\\a\\_work\\1\\s\\src\\Microsoft.Azure.WebJobs.Host\\Executors\\TriggeredFunctionExecutor.cs:line 51
--- End of stack trace from previous location ---
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.InvokeWithTimeoutAsync(IFunctionInvoker invoker, ParameterHelper parameterHelper, CancellationTokenSource timeoutTokenSource, CancellationTokenSource functionCancellationTokenSource, Boolean throwOnTimeout, TimeSpan timerInterval, IFunctionInstance instance) in D:\\a\\_work\\1\\s\\src\\Microsoft.Azure.WebJobs.Host\\Executors\\FunctionExecutor.cs:line 581
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.ExecuteWithWatchersAsync(IFunctionInstanceEx instance, ParameterHelper parameterHelper, ILogger logger, CancellationTokenSource functionCancellationTokenSource) in D:\\a\\_work\\1\\s\\src\\Microsoft.Azure.WebJobs.Host\\Executors\\FunctionExecutor.cs:line 527
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.ExecuteWithLoggingAsync(IFunctionInstanceEx instance, FunctionStartedMessage message, FunctionInstanceLogEntry instanceLogEntry, ParameterHelper parameterHelper, ILogger logger, CancellationToken cancellationToken) in D:\\a\\_work\\1\\s\\src\\Microsoft.Azure.WebJobs.Host\\Executors\\FunctionExecutor.cs:line 306
   --- End of inner exception stack trace ---
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.ExecuteWithLoggingAsync(IFunctionInstanceEx instance, FunctionStartedMessage message, FunctionInstanceLogEntry instanceLogEntry, ParameterHelper parameterHelper, ILogger logger, CancellationToken cancellationToken) in D:\\a\\_work\\1\\s\\src\\Microsoft.Azure.WebJobs.Host\\Executors\\FunctionExecutor.cs:line 352
   at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.TryExecuteAsync(IFunctionInstance functionInstance, CancellationToken cancellationToken) in D:\\a\\_work\\1\\s\\src\\Microsoft.Azure.WebJobs.Host\\Executors\\FunctionExecutor.cs:line 108"

@danielmarbach, @NoleNerd, @jbenettius and any others: can you quantify any impact you have here beyond an exception in your logs?
We have investigated and we believe this is noise from application shutdown. The call stack points to the root service provider being disposed while we are in the middle of a function invocation. Root service provider disposal only happens on application shutdown.
We are evaluating if we want to clarify this exception to indicate the invocation is aborted due to app shutdown but we have the following to consider:

No guarantee it will fully "solve" the issue. Given the line-by-line execution, the root provider can always be disposed between our shutdown check and accessing this property.
Right now it appears to be noise, so it is not a high priority. We will re-evaluate if we observe impact to customer apps.

@jviau
On the contrary: It's not just background noise. The impact is, that messages are not being processed (and in our case therefore deadlettered).
The impact is quite high!
I urge you to reconsider your priorisation on this issue.

@jviau we saw an instance of our Durable Function Orchestrator fail with this exception. We had a sub-orchestrator waiting on an External Event, it received that External Event, the sub-orchestrator re-animated and did a little bit of work and finished. The parent/main orchestrator took over and did a little bit of work, called a couple more sub-orchestrators, but then it failed with this exception.
Regarding the scaling - I can see that our Container App scaled to 1 pod around the time the requests came in (10/14 at 20:40) but I don't see it going past 1 pod. Our External Event message was received around 20:48 and the functions started doing work. I would not expect a scale in to occur here with active work. Based on the screenshot below, there should have still been an instance running at the time of exception.

@NoleNerd can you share your app name?
https://github.com/Azure/azure-functions-host/wiki/Sharing-Your-Function-App-name-privately

@jviau , here you go:
ExecutionTime: 2024-10-31T18:55:11Z
id=d2e5eb67-fed6-456f-acf4-d8cda75c1528
East US

@NoleNerd which version of durable worker extension are you using?

@jviau, we're using Microsoft.Azure.Functions.Worker.Extensions.DurableTask 1.1.5

Thanks!
Looking at @NoleNerd's apps logs and some others, all of these role instances where this occurred are indeed being terminated. This exception is just a symptom and not the root issue. As to why they shut down, I am not sure - that would be a question for the individual platform/sku teams. As for the impact this has on function triggers that is up to each trigger to handle this shutdown scenario. For durable specifically, we did make improvements to this scenario but there may be more work to do. For service bus, this may need to be discussed with the Azure SDK team as they own the service bus WebJobs extension. A workaround might be to disable auto-complete of messages and use ServiceBusMessageActions to manually complete the message. This may avoid completing the message when the worker is shutting down.
We will need to discuss internally more how we want to proceed with this, as it is part platform/sku issue, part worker contract gap, part extension responsibility to be resilient to this.
With that said, we do have a drain mode feature which avoids this in most scenarios. But there are some management actions where drain mode does not run and apps are forcibly shutdown (stopping the function app for example). Also, unsure if Functions on Azure Container Apps supports drain mode.

We are facing with the same issue ~once per week:
Exception while executing function: Functions.BackgroundEventsProcessorFunction Result: Failure
Exception: System.ObjectDisposedException: Cannot access a disposed object.
Object name: 'IServiceProvider'.
   at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
   at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\a\_work\1\s\src\DotNetWorker.Core\Context\DefaultFunctionContext.cs:line 48
   at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c.<UseFunctionExecutionMiddleware>b__1_2(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\Hosting\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 57
   at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a\_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13
   at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89
   at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a\_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88
Stack:    at Microsoft.Extensions.DependencyInjection.ServiceLookup.ThrowHelper.ThrowObjectDisposedException()
   at Microsoft.Azure.Functions.Worker.DefaultFunctionContext.get_InstanceServices() in D:\a\_work\1\s\src\DotNetWorker.Core\Context\DefaultFunctionContext.cs:line 48
   at Microsoft.Extensions.Hosting.MiddlewareWorkerApplicationBuilderExtensions.<>c.<UseFunctionExecutionMiddleware>b__1_2(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\Hosting\WorkerMiddlewareWorkerApplicationBuilderExtensions.cs:line 57
   at Microsoft.Azure.Functions.Worker.OutputBindings.OutputBindingsMiddleware.Invoke(FunctionContext context, FunctionExecutionDelegate next) in D:\a\_work\1\s\src\DotNetWorker.Core\OutputBindings\OutputBindingsMiddleware.cs:line 13
   at Microsoft.Azure.Functions.Worker.FunctionsApplication.InvokeFunctionAsync(FunctionContext context) in D:\a\_work\1\s\src\DotNetWorker.Core\FunctionsApplication.cs:line 89
   at Microsoft.Azure.Functions.Worker.Handlers.InvocationHandler.InvokeAsync(InvocationRequest request) in D:\a\_work\1\s\src\DotNetWorker.Grpc\Handlers\InvocationHandler.cs:line 88

In the AI traces, we see that the new host is started - but cannot handle any events, regardless of the trigger type. After ~10 minutes, host is down - and the next started one works fine.
The impact is quite big due to a lot of Service Bus messages are moved to the DQL after 10 retries in ~1-2 sec (messages are released after the exception).

Using this issue to track further investigation and planning a fix.
Summary
In some cases, the dotnet worker is shutdown via SIGTERM, which causes all DI containers to dispose. In-flight invocations may then encounter an ObjectDisposedException. Even though worker is shutting down, we may have enough time to propagate these failures back to the host. Listeners may then treat this as a user-code failure. This is problematic for message-based listeners which should retry in this scenario.