Addition of GradCAM visualization option for output visualization of CNNs

Please make sure that this is a feature request. As per our GitHub Policy, we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:feature_template
System information

TensorFlow version (you are using): 2.6.0
Are you willing to contribute it (Yes/No): Yes

Describe the feature and the current behavior/state.
GradCAM visualization is a great algorithm to showcase the activation part of an image from a CNN. As described in this paper(https://arxiv.org/pdf/1610.02391.pdf), it can allow users to visualize the issues their model is making in a more interactive way and fix the models.
Will this change the current api? How?
Yes, it will change the current API by the addition of a GradCAM visualization function in utils or the addition of a new visualization module itself. Depends on the admins.
Who will benefit from this feature?
It will help users who are using CNN to visualize the issue their model is making in a more interactive way by looking at the class activation map of the image and having a look at which part of the image the model gets activated to predict the class.
Any Other info.
No.

Hi @MrinalTyagi ! But There is already GradCAM visualization in Keras ? Are you indicating to include everything as single method?

@mohantym yeah. Currently, the user has to copy-paste the code from the website and modify it according to their model data and all that. I was thinking of the addition of a single function in utils or a new visualization section in which all these visualization techniques can be included in form of user handy functions. Would love to know your thoughts in the same.

@MrinalTyagi I like your proposal. There are some 3rd party implementations (tf.keras viz) but to have them on core API would be great of course. However, I think such a request is more fit on keras.

@innat Thank you for your response. Let's see what @mohantym thinks. Will it be better to add just a method or add a separate section in TensorFlow for visualization.

@mohantym like in the link @innat provided, there are multiple visualization algorithms. What I was suggesting was to like alongside utils we could add another module of visualization having all these multiple visualization algorithms.

Ok @MrinalTyagi ! Please post this issue with this clarity  on keras-team/keras repo.
To know more see;
https://discuss.tensorflow.org/t/keras-project-moved-to-new-repository-in-https-github-com-keras-team-keras/1999 . Thanks!

Sure. I have updated it under keras issues.

Ok! Could you please this issue here as It will be tracked there in Keras repo?

@mohantym As Keras team is not interested in adding this feature in their core API and wants to rely the users on third-party implementation for the same, is there any option of adding it into TensorFlow or should I scrap off the idea completely?

Hi @MrinalTyagi ! Could you please mention that Keras ticket here?

Hi @MrinalTyagi ! Could you please mention that Keras ticket here?
https://github.com/keras-team/keras/issues/15704

Closing this issue as per the comment here https://github.com/keras-team/keras/issues/15704#issuecomment-984897075


feedback

Next on my list, sorry I'm late I'm still working on catching up.

From: Ashley Blacquiere @.>
Sent: Friday, October 21, 2022 11:54 PM
To: nic-dgl-204-fall-2022/redjinator-aoc-1 @.>
Cc: Reginald McPherson @.>; Review requested @.>
Subject: Re: [nic-dgl-204-fall-2022/redjinator-aoc-1] feedback (PR #1)
This email comes from a sender outside of North Island College. Please use caution when opening attachments or clicking links.
@ash-teachhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fash-teach&data=05|01|rmcpherson%40northislandcollege.ca|3f1299eff5a4490a677808dab3fa5524|7031d246343740c3b3899df41829d339|0|0|638020185007110990|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=E6k%2BMWHnF1PL5%2BnkRyaMgGPe7c0TrOCorhd6VEr34JQ%3D&reserved=0 requested your review on: #1https://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnic-dgl-204-fall-2022%2Fredjinator-aoc-1%2Fpull%2F1&data=05|01|rmcpherson%40northislandcollege.ca|3f1299eff5a4490a677808dab3fa5524|7031d246343740c3b3899df41829d339|0|0|638020185007110990|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=W0jSr8IWOsj6%2F07LacqjZXdWEWDyJTaTk1HteZopWVU%3D&reserved=0 feedback.
—
Reply to this email directly, view it on GitHubhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnic-dgl-204-fall-2022%2Fredjinator-aoc-1%2Fpull%2F1%23event-7645164617&data=05|01|rmcpherson%40northislandcollege.ca|3f1299eff5a4490a677808dab3fa5524|7031d246343740c3b3899df41829d339|0|0|638020185007110990|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=ydXwt3%2BJnCKO7T8nFezmJYS%2BlR8h%2BYN14D3hU%2Fvcfjc%3D&reserved=0, or unsubscribehttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAQ7RJALVHSOMWLOKBT47IVDWEOFTZANCNFSM6AAAAAARLXBJQA&data=05|01|rmcpherson%40northislandcollege.ca|3f1299eff5a4490a677808dab3fa5524|7031d246343740c3b3899df41829d339|0|0|638020185007110990|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000|||&sdata=%2FxTqyOunHLXwcQKRK6P33zkLlKIuwKvVsite0fFd1gg%3D&reserved=0.
You are receiving this because your review was requested.Message ID: @.***>


DMS?

DMS creates EC2 instances that can be made public. Will this tool list such instances?
Thanks!

If they appear in the ec2 console then yes, but I haven't personally used the service.
If you're planning on using DMS and could test it that'd be great, otherwise I will try to run a test when time allows


Failed test at cloned forked repo

i'm new at this, so i'm sorry if this is not what you expected.
so, i just cloned the repo from the forked one, and after i did npm install , i straight to npm test without doing any editing at the code. and i got error result.

Anf then i repeat the test and, it succesfully pass the test.

From 5 test attempt, i got 2 success test. I didn't know if this happens because i cloned form the forked one. Because when i tested the clone from your account i got success test (even though i just doing it once).

Hey @odorifqi 😄
This is indeed a bug in the test, not the code. This test asserts that async helpers run one after the other instead of all at the same time.
The bug is: It does that using timing and values are way too low (20ms, 30ms). When the event loop is under high load (mainly because there are a lot of tests running), those timings might differ by quite a bit.
Would you like to open a PR fixing this issue? You can find the failing test here, just multiplying all those intervals by 10x (20 becomes 200, 30 becomes 300, 49 becomes 490, 59 becomes 590) would work because the tolerance would shift from 9ms to 90ms.
However, if you think of a different solution for this test, feel free to implement it instead!

yes, please. i want to open the PR. Thanks a lot for your kind and helpful response 😄

#12

#12


Bridge doesn't seem to handle action messages as initiating a private conversation.

Just trying out the bridge for the first time, and someone tried to private message me with the initial message being a /me ... command. The bridge seemed to choke on this, just reporting
<user> requested CTCP ACTION (ignored)
I then QUERY'd the user and asked what was going on, and they resent the message, which appeared fine once the room for that was already open.
I had autoquery enabled, and CTCPCFG disabled at the time, if that matters.
Ideally, this would open the room if autoquery was enabled, or at the very least, have the error message report the whole message, so I don't miss the context if I have to open the room manually.

That's indeed a bug, it should open the query if autoquery is on or show the real message if it isn't. This seems to be an edge case that isn't handled correctly.


OpenAPI extension does not work when using EF Core >= 3.0

Hi all,
Today I faced an issue when I started to use EF Core in my function app.
Error:
Could not load file or assembly 'Microsoft.Extensions.Logging.Abstractions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60'. The system cannot find the file specified.

   at System.Signature.GetSignature(Void* pCorSig, Int32 cCorSig, RuntimeFieldHandleInternal fieldHandle, IRuntimeMethodInfo methodHandle, RuntimeType declaringType)
   at System.Reflection.RuntimeMethodInfo.FetchNonReturnParameters()
   at System.Reflection.RuntimeMethodInfo.GetParameters()
   at Microsoft.Azure.WebJobs.Extensions.OpenApi.Core.DocumentHelper.<>c.<GetHttpTriggerMethods>b__3_4(MethodInfo p)
   at System.Linq.Utilities.<>c__DisplayClass1_0`1.<CombinePredicates>b__0(TSource x)
   at System.Linq.Enumerable.WhereEnumerableIterator`1.ToList()
   at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   at Microsoft.Azure.WebJobs.Extensions.OpenApi.Core.DocumentHelper.GetHttpTriggerMethods(Assembly assembly)
   at Microsoft.Azure.WebJobs.Extensions.OpenApi.Core.Document.Build(Assembly assembly, OpenApiVersionType version)
   at Microsoft.Azure.WebJobs.Extensions.OpenApi.OpenApiTriggerFunctionProvider.RenderOpenApiDocument(HttpRequest req, String version, String extension, ExecutionContext ctx, ILogger log)

Steps to reproduce:

Create brand new Function App project in VS - .NET Core 3.1 / Function App v3
Install OpenAPI Extension
Run function app
Open http://localhost:7071/api/openapi/1.0 in the web browser - it does work
Install EF Core 3.1.6
Run function app
Open http://localhost:7071/api/openapi/1.0 in the web browser - returns an error

so EF Core 3.1.16 requires Microsoft.Extensions.Logging.Abstractions >= 3.1.16
It seems that the OpenAPI extension can work only when it is < 3.0.
Do you have any insight into it?

Same issue seems to occur with other extensions such as <PackageReference Include="Microsoft.Extensions.Http" Version="3.1.15" /> that also has a dependency to Microsoft.Extensions.Logging.Abstractions.

Hi @Skovvart, thank you for your suggestion. Your workaround works well If you are not using the OpenApiSecurity attribute. If I have it in my function decoration I get this error:
`Exception has been thrown by the target of an invocation.
at System.RuntimeTypeHandle.CreateInstance(RuntimeType type, Boolean publicOnly, Boolean wrapExceptions, Boolean& canBeCached, RuntimeMethodHandleInternal& ctor, Boolean& hasNoDefaultCtor)
at System.RuntimeType.CreateInstanceDefaultCtorSlow(Boolean publicOnly, Boolean wrapExceptions, Boolean fillCache)
at System.RuntimeType.CreateInstanceDefaultCtor(Boolean publicOnly, Boolean skipCheckThis, Boolean fillCache, Boolean wrapExceptions)
at System.Activator.CreateInstance(Type type, Boolean nonPublic, Boolean wrapExceptions)
at System.Activator.CreateInstance(Type type)
at Microsoft.Azure.WebJobs.Extensions.OpenApi.Core.DocumentHelper.GetSecurityOAuthFlows(OpenApiSecurityAttribute attr)
at Microsoft.Azure.WebJobs.Extensions.OpenApi.Core.DocumentHelper.GetOpenApiSecurityRequirement(MethodInfo element, NamingStrategy namingStrategy)
at Microsoft.Azure.WebJobs.Extensions.OpenApi.Core.Document.Build(Assembly assembly, OpenApiVersionType version)
at Microsoft.Azure.WebJobs.Extensions.OpenApi.OpenApiTriggerFunctionProvider.RenderOpenApiDocument(HttpRequest req, String version, String extension, ExecutionContext ctx, ILogger log)`

I am guessing that the the above is a separate issue, where your OpenApiSecurityAttribute implementation lacks a parameterless constructor (see #168 for some more context).

I'm facing the same issues, could it be related to #281?


Propagate babelOptions.moduleIds downstream

Modules loaded in-browser are not aware of their moduleIds.
In particular, this is problematic for Angular 2 projects with relative component template paths.
Code like this throws 'module' not defined:
@Component({
  moduleId: module.id,
  selector: "my-component",
  templateUrl: "my-component.html"
})
export class MyComponent {
...

Use __moduleName in Es modules in place of module.id which is for CommonJS modules only.

Thank you!
Please disregard this PR, my conclusion was based on false positive test.


[Fix] Fix recipes to be built

Set proper branch name for ssat
Fix recipe for nnstreamer:
remove unnecessary files tvm_*.so
disable pbtxt converter
change unittest path

Signed-off-by: Yongjoo Ahn<EMAIL_ADDRESS>Self evaluation:

Build test: [X]Passed [ ]Failed [ ]Skipped
Run test: [X]Passed [ ]Failed [ ]Skipped

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #72. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://nnstreamer.mooo.com/.


oci_core_instance.app-instance

Believe in instance shape isn't valid, can you adjust or advise on a valid one?
using v1.0.2

oci_core_instance.app-instance.1: Service error:NotAuthorizedOrNotFound. shape VM.Standard.E2.1.Micro not found. http status code: 404.

FAQ include detailing the possible issues and reference to the documentation.


[Migration] Unable to find the input element. It was resolved to [object HTMLDivElement] while an HTMLInputElement was expected.

[x] The issue is present in the latest release.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯
I am getting this error:
index.js:1 MUI: Unable to find the input element. It was resolved to [object HTMLDivElement] while an HTMLInputElement was expected.
Instead, Autocomplete expects an input element.

Make sure you have customized the input component correctly.

When I use autocomplete like this:
<Autocomplete
      freeSolo
      autoHighlight
      style={{ width: 350 }}
      open={open}
      onOpen={() => setOpen(true)}
      onClose={() => setOpen(false)}
      onChange={(_event, user) =>
        router.push(`/projects/${project.id}/users/${user.id}`)
      }
      onInputChange={(_event, newValue) => setValue(newValue)}
      isOptionEqualToValue={(option, optionTwo) => option.id === optionTwo.id}
      getOptionLabel={(user) => presentUser(user, project)}
      groupBy={(user) => capitalizeFirstLetter(user.userType)}
      options={options}
      loading={loading}
      renderInput={(params) => (
        <div ref={params.InputProps.ref}>
          <Input
            {...params.inputProps}
            variant="filled"
            className={classes.searchInput}
            classes={{ underline: classes.searchInputUnderline }}
            placeholder="Search"
            startAdornment={
              <InputAdornment position="start">
                <Search />
              </InputAdornment>
            }
            endAdornment={
              <>
                {loading ? (
                  <CircularProgress color="inherit" size={20} />
                ) : null}
                {params.InputProps.endAdornment}
              </>
            }
            type="text"
          />
        </div>
      )}
    />

It worked with v4. According to the documentation it seems like I am doing it correctly.
Expected Behavior 🤔
No errors should happen.
Context 🔦
Simply trying to upgrade to v5
Your Environment 🌎
Chrome.

`npx @mui/envinfo`
  System:
    OS: macOS 11.3.1
  Binaries:
    Node: 14.17.1 - ~/.nvm/versions/node/v14.17.1/bin/node
    Yarn: 1.22.11 - /opt/homebrew/bin/yarn
    npm: 7.23.0 - /opt/homebrew/bin/npm
  Browsers:
    Chrome: 93.0.4577.82
    Edge: Not Found
    Firefox: Not Found
    Safari: 14.1
  npmPackages:
    @emotion/react: ^11.4.1 => 11.4.1
    @emotion/styled: ^11.3.0 => 11.3.0
    @mui/core:  5.0.0-alpha.49
    @mui/icons-material: ^5.0.1 => 5.0.1
    @mui/lab: ^5.0.0-alpha.49 => 5.0.0-alpha.49
    @mui/material: ^5.0.2 => 5.0.2
    @mui/private-theming:  5.0.1
    @mui/styled-engine:  5.0.1
    @mui/styles: ^5.0.1 => 5.0.1
    @mui/system:  5.0.2
    @mui/types:  7.0.0
    @mui/utils:  5.0.1
    @mui/x-data-grid: ^4.0.0 => 4.0.0
    @types/react:  17.0.22
    react: ^17.0.2 => 17.0.2
    react-dom: ^17.0.2 => 17.0.2

It doesn't look like this bug report has enough info for one of us to reproduce it.
Please provide a CodeSandbox (https://material-ui.com/r/issue-template-latest), or a link to a repository on GitHub. Also be sure to describe with which steps you saw this error.
Here are some tips for providing a minimal example: https://stackoverflow.com/help/mcve

@simplenotezy Thank you to bring up this issue.

MUI: Unable to find the input element. It was resolved to null while an HTMLInputElement was expected.
Instead, useAutocomplete expects an input element.

I got a similar error and tried to reproduce by partially copying my code.
https://codesandbox.io/s/goofy-marco-mlgqf?file=/src/Demo.tsx
In my case, the error has gone if I removed NoSsr. I forgot why I put NoSsr here but it seems to work expectedly without NoSsr with 5.0.2. so I removed it.
Hoping this helps you guys.

Thanks for the repro. The ref isn't resolved by the time useAutocomplete requires it. This is due to passing the props across component boundaries that no longer guarantee the expected timing. Here: NoSsr. You have to move useAutocomplete inside NoSsr.

@eps1lon In my case, I use a simple Create React App without SSR

I am still having this issue when running the tests
My code:
<TextField
    variant="outlined"
    size="small"
    placeholder={
      (placeholder === true || placeholder === undefined) &&
      selectedOptions?.length === 0
        ? "Search"
        : null
    }
    InputProps={{
      ...params.InputProps,
      startAdornment: (
        <>
          {showIcons === true && (
            <InputAdornment position="start">
              <SearchIcon fill={N500} />
            </InputAdornment>
          )}
          {params.InputProps.startAdornment}
        </>
      ),
    }}
    data-testid="autocomplete"
    {...params}
  />

Warning when running tests:
 MUI: Unable to find the input element. It was resolved to null while an HTMLInputElement was expected.
      Instead, Autocomplete expects an input element.

      Make sure you have customized the input component correctly.

I am still having this issue when running the tests My code:

same here, i also had this issue while running the test

Same here on test with jest/enzyme

same here.

same here

same here

This is infuriating.

same here

same here

I had this issue, solved by adding {...params.inputProps} to the input in the renderInput props as per https://mui.com/material-ui/react-autocomplete/#combo-box
Please note that it is inputProps NOT InputProps, hope it helps.
renderInput={(params) => (
        <TextField
          {...params}
          label="Choose a country"
          inputProps={{
            ...params.inputProps, // HERE
            autoComplete: 'new-password', // disable autocomplete and autofill
          }}
        />
      )}
      ```

Anyone solve this while using the custom hook useAutoComplete?

Anyone solve this while using the custom hook useAutoComplete?

I would be interested aswell.

@eps1lon Here's a minimal example of the console error showing up when using Autocomplete with react-test-renderer:
https://codesandbox.io/s/react-test-renderer-forked-lnv39f

With jest, I was able to avoid the error by mocking useAutocomplete.
jest.mock("@mui/base/node/useAutocomplete/useAutocomplete", () => () => ({
  getInputLabelProps: jest.fn(),
  getInputProps: () => ({ onMouseDown: jest.fn() }),
  getListboxProps: () => ({ ref: {} }),
  getRootProps: jest.fn(),
}));

When we updated mui from 5.14.3 to 5.14.8, the above work-around stopped working. Can this issue be reopened, or should I create a new one?

Ah, default was removed, so the mock now needs to be
jest.mock("@mui/base/node/useAutocomplete/useAutocomplete", () => ({
  useAutocomplete: () => ({
    getInputLabelProps: jest.fn(),
    getInputProps: () => ({ onMouseDown: jest.fn() }),
    getListboxProps: () => ({ ref: {} }),
    getRootProps: jest.fn(),
  }),
}));

It would still be nice to resolve this for testing.

@trainoasis You may need to mock more parts of what useAutocomplete returns (https://github.com/mui/material-ui/blob/master/packages/mui-base/src/useAutocomplete/useAutocomplete.js#L1099-L1187). I only mocked the bare minimum for our situation (getInputLabelProps, onMouseDown in getInputProps, ref in getListboxProps, and getRootProps), but there are other parts you may need.

To avoid a new TypeError: Cannot read properties of undefined (reading 'length'), I've had to add groupedOptions to the mock:
jest.mock("@mui/base/node/useAutocomplete/useAutocomplete", () => ({
  useAutocomplete: () => ({
    getInputLabelProps: jest.fn(),
    getInputProps: () => ({ onMouseDown: jest.fn() }),
    getListboxProps: () => ({ ref: {} }),
    getRootProps: jest.fn(),
    groupedOptions: [],
  }),
}));


Default to optimal compute_instance_type when using batch

Update the revamped configuration logic so that it uses a default value of optimal for the ComputeInstanceType/compute_instance_type parameter when the scheduler is awsbatch.
Modify existing tests.
Signed-off-by: Tim Lane<EMAIL_ADDRESS>By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

minor issues detected by flake8 linter. You can run the linters with tox -e code-linters

Sorry about that. I'll be sure to run all of the checks locally first on future PRs.

The failures are intermittent, so it's taking a bit to track them down.


[Question] Is there any way to freeze layers in a DNN model?

Hi Davis,
I am working on incremental learning for face recognition. Based on the error samples predicted by a trained model, I would like to retrain the model, but not the whole thing, just probably last a few layers. Is there any way to freeze the parameters of a particular layer?
Thank you!

Each layer allows you to set its learning rate multiplier.  You can set them to 0 if you want.

  I say this because DNN solvers are awful, in the grand scheme of things.  SVMs use solvers that are many orders of magnitude faster and more accurate.

@davisking Thanks a lot!
By "solver", did you refer to "classifier" to use features to make prediction? DNN solvers mean fully-connected layers after convolutional layers? A bit confused on your term of "solver".
I found the API learning_rate_multiplier in layers.h. Could you show me a quick example how to use it in the face recognition training model file: dnn_metric_learning_on_images_ex.cpp?
Thank you very much! Really appreciate your great help.

The entire API is documented, you should start with the introductory DNN example programs and then read the reference API docs if you don't find what you need.
But to summarize, just call the member function on the layer to set the learning rate.

Hi Davis, @davisking
I read the API docs and tried to figure out how to set lr multiplier:
net.subnet().layer_details().set_learning_rate_multiplier(0.1);
But net.subnet().subnet() recursively won't scale for a large network. Is there any way to iterate all computation layers of a network?
Thank you!

Read the introduction: http://dlib.net/dnn_introduction2_ex.cpp.html
Then consult the API reference where everything is documented.
You can also look at routines like visit_layer_parameters to see how to make a loop over layers if you don't know how to make C++ compile time loops.

Hi Davis, @davisking
Thank you very much for your helpful pointers. I figured it out how to access a layer.
I have the following code to look into the first conv layer of a ResNet18 network:
        cout << "\n******** Layer 79 ********\n";
        layer<79>(net).layer_details().set_learning_rate_multiplier(0.1);
        cout << layer<79>(net).layer_details() << "\n"; //con
        tensor& con_params = layer<79>(net).layer_details().get_layer_params();
        cout << "con size: " << con_params.size() << "\n";
        cout << "n: " << con_params.num_samples();
        cout << ", k: " << con_params.k();
        cout << ", nc: " << con_params.nc();
        cout << ", nr: " << con_params.nr();
        con_params.host()[5] = 0.101;
        cout << ", Sample CPU: " << con_params.host()[5] << "\n";
        //con_params.async_copy_to_device();
        //cout << ", Sample GPU: " << con_params.device()[5] << "\n";

The output is:
******** Layer 79 ********
con	 (num_filters=32, nr=7, nc=7, stride_y=2, stride_x=2, padding_y=0, padding_x=0) learning_rate_mult=0.1 weight_decay_mult=1 bias_learning_rate_mult=1 bias_weight_decay_mult=0
con size: 4736
n: 4736, k: 1, nc: 1, nr: 1, Sample CPU: 0.143296

I have a few quick questions for you. Thanks again for your great help. I really appreciate it.

Why is the tensor size is 4736, not input_channel 3 x num_filters 32 x nr 7 x nr 7 = 4704?
I thought k=32, nc=7, nc=7, but the printout gives k=1, nc=1, nr=1. Am I missing anything?
If I want to manually a parameter, is it enough to do it with con_params1.host()[5] = 0.101? Do I have to update both host and device memory (con_params1.device()[5] = 0.101)?
I tried to output GPU memory using con_params.device()[5] (the last two lines of my code, commented out), but I got segfault. Could you point out where I did wrong?

Sorry about keeping bugging you. Dlib is a great lib. I really like it. Thanks for your help!

About number 1, you are forgetting about the bias, which is the same as the number of filters.

Thanks Facundo. @facug91
Any idea if the first 32 elements of a parameter tensor are the bias or the last 32? Thank you!

The last 32 elements are that of bias


[Bug] SideMenuView.UWP - Menu not collapsing when clicking outside the menu area

Description
This issue is related to the functionality introduced in PR 187.
In the UWP sample app in the SideMenuView, the menu view is not collapsing when clicking outside of the menu area. It only collapses via the swipe gesture.
This behavior is only seen in UWP. Android and iOS version works as expected
Steps to Reproduce

Run XTC UWP sample app
Go to Views -> SideMenuView
Open one of the menus (right or left)
Try to collapse the menu, by clicking outside of the menu area.

Expected Behavior
The menu should collapse once we click outside of the menu area
Actual Behavior
The menu only collapses using the swipe gesture (only seen in UWP)
Basic Information

Version with issue: Current main branch code from 8 October 2020
Last known good version:
IDE: VS2019 (16.7.5)
Platform Target Frameworks:

UWP:  17763

Affected Devices: PC Windows Pro 10.0.19041

Workaround
Setting BackgroundColor = Color.Transparent in the overlay view that serves as click/tap/touch catcher seems to solve the problem.
This code change does not affect iOS and Android (did some testing)
Aditional Info
Once this bug is validated I can make a PR with the workaround/solution I found.

@zleao nice catch :) Yes, indeed, this is old know XF issue.
Would you like to make PR with the fix you mentioned? Or I can do it myself

I can do the PR. Just give me 5 min... :)


Cronjob trigger pods are not removed after completing

BUG REPORT
What happened:
The pods created with the scheduled functions are not being removed after completing them. We can see the pods being piled every time it hits the schedule.

What you expected to happen:
The pods to be removed or to reuse the same pod and just running again.
Environment:

Kubernetes version:

Client Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.3", GitCommit:"5e53fd6bc17c0dec8434817e69b04a25d8ae0ff0", GitTreeState:"clean", BuildDate:"2019-06-06T01:36:19Z", GoVersion:"go1.12.5", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.3", GitCommit:"5e53fd6bc17c0dec8434817e69b04a25d8ae0ff0", GitTreeState:"clean", BuildDate:"2019-06-06T01:36:19Z", GoVersion:"go1.12.5", Compiler:"gc", Platform:"linux/amd64"}

Kubeless version: 1.0.4
Cloud provider or physical cluster: physical cluster

Hi @raul-madrigal,
That's the default successfulJobsHistoryLimit: 3 set by Kubernetes for CronJobs but it's true that it's not configurable at this moment.

Hi @andresmgot,
Can you guide me somehow? , I would like to help to get this done because I currently have this issue happening and I'm fixing it running a separate script to clean up the completed pods.

Just to confirm, you are seeing 3 completed jobs per scheduled function, right?
Unfortunately, this is not something that can be implemented in the client side (so I am not sure is worth working on). If you want to implement it, you need to change it in the CronJobTrigger controller:
https://github.com/kubeless/cronjob-trigger/blob/master/pkg/apis/kubeless/v1beta1/cronjob_trigger.go#L34
Release a new version of the trigger controller and then change the client here.

Thanks, I'll take a look.


TypeError: Can't instantiate abstract class STT without an implementation for abstract method '_recognize_impl'

Hello livekit devs,
I getting this error after install all the package and plugins and tried everything but pointless.
I'm using Linux Debian and install newest plugins.
I'm using minimal_assitant.py in examples/voice-pipeline-agent
Please help.
2024-11-27 00:39:00,687 - ERROR livekit.agents - unhandled exception while running the job task Traceback (most recent call last):   File "/home/aki/Desktop/LiveKitAgent/agents/examples/voice-pipeline-agent/minimal_assistant.py", line 49, in entrypoint     stt=DeepgramSTT(model=dg_model),         ^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: Can't instantiate abstract class STT without an implementation for abstract method '_recognize_impl' {"pid": 1131695, "job_id": "AJ_vsGeMiDYdeS4"}

I also got this error, even though it was running smoothly before

@zeman21 do you remember changing anything? updated packages?

@davidzhao nothing, but suddenly like that. have you found a solution?

@zeman21 Hi, I got the same issue. Have you found any solution yet?

_recognize_impl was introduced a few weeks ago in https://github.com/livekit/agents/pull/957/files#diff-a255bcc409229bc883ab7bbf85b3a5a70c3f445b960dc4d7c0753525519ce0bbR68-R84, most likely your livekit-agent was upgraded but the plugins were in the old version. Can you check that with pip list | grep livekit?


[Gradle] Flag as a build-tool

cf:

#3955
#4156

build-tool must be added in tag, not in iconSlug

Sorrty for the bug, fixing it right now :zap:

:zap:


Add find order command

PredicateCollection is a generic class used to store all predicates from client/order
GenericStringPredicate is a generic class that replaces all client/order string predicates
FindClientCommand and respective tests have been updated to use classes above
FindOrderCommand also uses PredicateCollection and GenericString
GenericDummy class is a utility class used to test generic classes mentioned above
Things to do

[ ] Find order using deadline
[ ] Find order using recipe name

Codecov Report

Merging #79 (9c3f3fe) into master (41cd66e) will decrease coverage by 0.13%.
The diff coverage is 94.82%.

@@             Coverage Diff              @@
##             master      #79      +/-   ##
============================================
- Coverage     74.17%   74.03%   -0.14%
+ Complexity      623      614       -9
============================================
  Files            96       95       -1
  Lines          1719     1718       -1
  Branches        187      186       -1
============================================
- Hits           1275     1272       -3
  Misses          402      402
- Partials         42       44       +2

Impacted Files
Coverage Δ

...22s1_cs2103t_w16_2/btbb/commons/core/Messages.java
0.00% <ø> (ø)

..._cs2103t_w16_2/btbb/model/ingredient/Quantity.java
83.33% <ø> (ø)

...cs2103t_w16_2/btbb/model/shared/GenericString.java
81.81% <ø> (ø)

...b/logic/parser/client/FindClientCommandParser.java
90.90% <85.71%> (-9.10%)
:arrow_down:

...tbb/logic/parser/order/FindOrderCommandParser.java
90.90% <90.90%> (ø)

...t_w16_2/btbb/model/shared/PredicateCollection.java
93.33% <93.33%> (ø)

.../btbb/logic/commands/client/FindClientCommand.java
100.00% <100.00%> (ø)

..._2/btbb/logic/commands/order/FindOrderCommand.java
100.00% <100.00%> (ø)

...03t_w16_2/btbb/logic/parser/AddressBookParser.java
100.00% <100.00%> (ø)

...2103t_w16_2/btbb/logic/parser/util/ParserUtil.java
97.22% <100.00%> (+0.44%)
:arrow_up:

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 41cd66e...9c3f3fe. Read the comment docs.


Slim 3 abuses the container.

On every new route that gets registered through the $app->map() Slim 3 is fetching router and settings services every time it get's called. It is causing noticeable delays.
We can easily introduce a private lazy loaded utility to have that happen only one time.
On our APP this resolved in a consistent 5% speed-up with an applications with around 70 routes registered and running with route cache enabled.
Have you measured Slim 3 vs slim 2 performance in real life?
After update half an year ago we are measuring some degraded performance. Form about 2 ms of framework overhead currently we are around 10 ms for an equivalent application.

The Slim 3 branch is now in security mode and will not be receiving any more patches besides security fixes. Unfortunately this cannot be addressed.

I was kind of expecting that, but thanks for the response!
Will re-validate this once we are on Slim 4, hopefully we are not too late with it, like with update to 3 :smile:


docs: Add PR template

##Fixes #87
Changes

Created Pull Request template

Hello @thestarsahil
Could you please add the GSSOC 2023 label to the issue? This label is essential for my contributions to be recognized within the program and would motivate me to continue contributing.
Thank you for your support.

Hello @thestarsahil
Sorry for the disturbance. Can you please add a level to it? I think Without a level, my pull request doesn't have a point
Thank you

@andoriyaprashant  Join discord group for further discussion with collaborators, project admin and mentors.
For joining the group:

Go to the Gssoc'23 discord channel.
Go to FORUM category.
In PROJECTS-INTRO you will get the project listed.
Join the project discord channel.

Also join the Slack Channel!!


feat: add action workflow

Thx for the idea @divy-work, I've modified it a bit since we don't really need caching. ;)


Unable to filter traffic based on container ID and pod name.

Describe the bug
使用kyanos 对容器id和pod名称进行watch时，无法正常执行，提示没有该容器id和pod名称
To Reproduce
使用最新版本的即可重新
Expected behavior
正常对容器id和pod进行watch抓取流量
Screenshots

Information (please complete the following information):

OS: openEuler 22.03 LTS
内核：5.10.0-<IP_ADDRESS>.oe2203.aarch64

Are there any logs similar to kyanos_xxx under the /tmp path? If so, please provide them. @liuhaibin0528

kyanos.log content：

only exec watch container printing

Is the pod on the machine where you are running kyanos? If not, kyanos will not be able to find the container.  You must run kyanos on the host machine where the pod is located.

@liuhaibin0528
There two problems here:

You execute kubectl get pods -n devops, then  use kyanos to filter traffic by the pod name ***-agent-***, after that kyanos tell you that the pod with the name can't be found.
The reason  is that you must ensure the machine running Kyanos is on the same host as the specified pod.
This issue is that filtering by container-id is not working. Currently, Kyanos supports filtering by either the full untruncated container-id or the 12-character short id. The container-id you're using is actually a 13-character id truncated by crictl, so Kyanos fails to filter. Before we fix this, you can use the first 12 characters for filtering.


Disable configure of cloud route when allocate-node-cidrs is enabled

Fixes https://github.com/kubernetes-incubator/kube-aws/issues/1336 by adding --configure-cloud-routes=false when --allocate-node-cidrs=true
Added --cluster-name to ensure it's set correctly on controller manager.
Grouped mandatory and optional flags together.

@davidmccormick for some reason I cannot assign you for review but worth you taking a look at this.

Codecov Report

Merging #1341 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1341   +/-   ##
=======================================
  Coverage   37.49%   37.49%
=======================================
  Files          68       68
  Lines        4275     4275
=======================================
  Hits         1603     1603
  Misses       2447     2447
  Partials      225      225

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cb6766d...5a81c24. Read the comment docs.

@c-knowles Thanks for the fix! LGTM.
@ArchiFleKs has also encountered this only with self-hosting enabled. So your choice of adding the flag only for self-hosted configuration looks good.


Framework7-core: tab:hide and tab:show is forgotten in swappable/animated tabs

Framework7 version: 3.6.0
Platform and Target: All
Live Link or JSFiddle: PREFERABLY (IF YOU WANT YOUR ISSUE TO BE RESOLVED ASAP). You can start from forking the following JSFiddle template: JSFiddle

Describe the bug
tab show/hide event is not fired for animated tabs
To Reproduce
Steps to reproduce the behavior:

Make a swippable tab
add tab:show and tab:hide on it
swipe it now

Expected behavior
It fires
Actual Behavior
nothing happened
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Code here does not fired for tab show/hide events when it is an animated tab at all
https://github.com/framework7io/framework7/blob/master/src/core/components/tabs/tabs.js#L101-L114
Maybe it should be
    // Remove active class from old tabs
    const $oldTabEl = $tabsEl.children('.tab-active');
    $oldTabEl.removeClass('tab-active');
    if (!swiper || (swiper && !swiper.animating)) {
      $oldTabEl.trigger('tab:hide');
      app.emit('tabHide', $oldTabEl[0]);
    } else {
      onTabsChanged(function() {
        $oldTabEl.trigger('tab:hide');
        app.emit('tabHide', $oldTabEl[0]);
      })
    }

    // Trigger 'show' event on new tab
    $newTabEl.addClass('tab-active');
    if (!swiper || (swiper && !swiper.animating)) {
      $newTabEl.trigger('tab:show');
      app.emit('tabShow', $newTabEl[0]);
    } else {
      onTabsChanged(function() {
        $newTabEl.trigger('tab:show');
        app.emit('tabShow', $newTabEl[0]);
      })
    }

Can't see such issue. Would be good to see live example or JSFiddle

@nolimits4web I found this problem only exist when using animated tab and routable tag together.


Set up tests for components library

Motivation
Preparation for an easier fix in #164.
Checklist

[ ] Code follows coding conventions held in this repo
[ ] Automated tests have been added
[ ] Tests are passing
[ ] Docs have been updated (if applicable)
[ ] Temporary settings (e.g. variables used during development and testing) have been reverted to defaults

How to test
If manual testing is required, what are the steps?

Coverage FYI:

File
% Stmts
% Branch
% Funcs
% Lines
Uncovered Line #s

All files
97.37
86
100
97.14

src
100
100
100
100

index.ts
100
100
100
100

src/rich-text-element
97.22
86
100
96.97

index.tsx
97.22
86
100
96.97
69

Test Suites: 1 passed, 1 total
Tests:       5 passed, 5 total
Snapshots:   5 passed, 5 total
Time:        4.44s


Document sequences like 'aa'…'cc'

The sequence 'aa'…'cc' does not use a *.succ default generator  (and this is correct per Roast).
See also Can Raku range operator on strings mimic Perl's behaviour? and the links cited in the answers.

is the output right? don't see the "ba" in yours.
$ raku -e "say 'aa'...'cc'"
(aa ab ac ba bb bc ca cb cc)

fails xt/trailing-whitespace.t

Thanks, @coke, both fixed.

Thanks for the update: found a typo: "finial" should probably be "final".

Thanks for the content and quick updates, merged.


LaTeX in stream descriptions renders as invisible

Apparently, if you put LaTeX in a stream description, like $$x=1$$, it appears in "Manage streams" but not in the top-center navbar.
Note #14791 is present, so you may need to reload after editing for your changes to take effect.

Tagging as a priority since this affects the polish of a major new feature.


Overlay not working

Right clicking overlay not showing start/pause/resume

yeah same, dont think the plugin works anymore


Fix Issue#10858

Fix for Issue #10858.
Re-enabling the pointer events for the CodeMirror-foldmarker as pointer events are disabled for parent "CodeMirror-lines" to fix issue #2780.

@peterflynn Can you please review this?

Works great for triggering the code to expand, but it introduces a new problem: focus is lost from the editor after clicking one of the markers.  The click handler should either preventDefault() on mousedown (to cancel focus changing), or explicitly re-focus the host editor afterward.

(See CodeMirror.on(widget, "mousedown" in foldcode.js, I think)

Confirmed that adding preventDefault() there seems to work like a charm

@peterflynn Thanks a lot Peter. I failed to notice the focus lost. preventDefault() has fixed it. I have updated the PR.

LGTM. Merging. Thanks @peterflynn !


Remove service-key requirement from kt-server

Resolves #640
Resolves #617

PTAL

Codecov Report

Merging #644 into master will increase coverage by 0.16%.
The diff coverage is 0%.

@@            Coverage Diff            @@
##           master    #644      +/-   ##
=========================================
+ Coverage   57.24%   57.4%   +0.16%
=========================================
  Files          35      35
  Lines        2491    2484       -7
=========================================
  Hits         1426    1426
+ Misses        776     769       -7
  Partials      289     289

Impacted Files
Coverage Δ

impl/google/authentication/google.go
17.3% <0%> (+2.05%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b10ca28...c073904. Read the comment docs.


Mangadex.com added to the adware/malware list in error

mangadex.com has been added to the adware/malware base list in error as it does not contain any malware content.

Hello @oznsfw and welcome here 👍
Are you sure you are in the right repository?
I'm asking because I can't find any occurrence of mangadex.com into this repository.

@StevenBlack @oznsfw I found it in Badd-Boyz-Hosts. I'm on it. Should be removed asap.
For reference: Also mentioned into https://github.com/mitchellkrogza/Badd-Boyz-Hosts/issues/5

@StevenBlack the build/test may take some time but it's removed so an update should fix this issue 🎉

Closing!


[flutter_tools] RPCError "Unexpected DWDS error for resume: WipError -32000"

on beta 3.13.0-0.3.pre
RPCError: resume: (-32603) Unexpected DWDS error for resume: WipError -32000 Can only perform operation while paused.content_copy
at new _OutstandingRequest(vm_service.dart:1928)
at VmService._call(vm_service.dart:2493)
at VmService.resume(vm_service.dart:2368)
at IsolateManager.resumeThread(isolate_manager.dart:287)
at IsolateManager._handlePause(isolate_manager.dart:498)
at IsolateManager.handleEvent(isolate_manager.dart:177)
at <asynchronous gap>(async)
at DartDebugAdapter._configureExistingIsolates.<anonymous closure>(dart.dart:757)
at <asynchronous gap>(async)
at Future.wait.<anonymous closure>(future.dart:525)
at <asynchronous gap>(async)
at DartDebugAdapter._configureExistingIsolates(dart.dart:742)
at <asynchronous gap>(async)
at DartDebugAdapter._withErrorHandling(dart.dart:2424)
at <asynchronous gap>(async)
at DartDebugAdapter.connectDebugger(dart.dart:690)
at <asynchronous gap>(async)
at FlutterDebugAdapter._connectDebugger(flutter_adapter.dart:383)
at <asynchronous gap>(async)
at FlutterDebugAdapter._handleDebugPort(flutter_adapter.dart:464)
at <asynchronous gap>(async)

Related fix (that should already be in this flutter branch) was https://github.com/dart-lang/webdev/pull/2134/files.
@DanTup I think the action item here would be for the dart debug adapter to handle this error. Does that make sense?

cc @elliette

I think this is still a DWDS issue. The error above still includes WipError so I don't think it's going through the catch block in https://github.com/dart-lang/webdev/pull/2134/files.
@elliette is it possible the try/catch is not firing here because return captureElapsedTime( isn't being awaited inside the try, so it just returns a Future that doesn't fail until after this try/catch is off the stack? eg., could the fix be to return await captureElapsedTime(?
I don't know of an easy way to run that code locally, but one way to test could be to hard0code a throw WipError() inside the function body and see if it gets into the catch?


Unable to build for Mega 2560 with boards.txt from 1.6.0 IDE

Running ino 0.3.7 after installing the Arduino IDE 1.6, I'm able to build and install for my Uno board. But when I want to use my Mega 2560 board using
uno build -m mega

I get this error:
  File "/Library/Python/2.7/site-packages/ino-0.3.7-py2.7.egg/ino/commands/build.py", line 151, in setup_flags
    mcu = '-mmcu=' + board['build']['mcu']

This appears to be due to some difference in the structure of the 1.6 boards.txt file, which has separate sections with keys like mega.menu.cpu.atmega2560 and mega.menu.cpu.atmega1280. A comment in the file says
# default board may be overridden by the cpu menu

On a wild guess, I added the line
mega.build.mcu = atmega2560

to *boards.txt", and after an ino clean the build seems to have succeeded. Similarly, to get ino upload to work, I added
mega.upload.protocol=wiring
mega.upload.speed=115200
mega.upload.maximum_size=253952

It appears that to get ino compatible with this new boards.txt, there'll need to be some additional logic for picking up the right configuration keys.

Up this, it solved my problem on Fedora23. I had to something similar for the nano board


Integrate BERT into Hedwig

./models/bert/model.py:            shutil.rmtree(tempdir)
This clears everything in the saves directory?

Maybe not, but for whatever reason my Yelp model file is gone after the Reuters run.

@daemon Please don't merge this pull request until issue #31 is fixed.

@Ashutosh-Adhikari before we merge this into master, can you please address issue #32?

Both issues #31 and #32 have been resolved. @daemon can you please review these changes and merge them if there are no issues?


Wait for Requeue condition before push to heap.

What type of PR is this?
/kind bug

What this PR does / why we need it:
When backoff finished we have race condition on the Workload Reconcile and the Scheduler. The Scheduler using old version of the Workload (version of workload before updated Requeue condition to true) and rewriting conditions (already updated by reconciler) when admitting. So we need to wait before Requeue condition to be true.
Which issue(s) this PR fixes:

Fixes #2291
Special notes for your reviewer:
> kubectl get workload -w --output-watch-events -ocustom-columns=EVENT:.type,NAME:.object.metadata.name,ACTIVE:.object.spec.active,CONDITIONS:.object.status.conditions | ts "%Y-%m-%d %H:%M:%.S"

2024-06-04 09:06:58.564580 EVENT   NAME                   ACTIVE   CONDITIONS
# 1.1. Created:
2024-06-04 09:06:58.564735 ADDED   job-sample-job-992ea   true     <none>
# 1.2. Set PodsReady=False:
2024-06-04 09:06:58.572070 MODIFIED   job-sample-job-992ea   true     [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady]]
# 1.3. Set QuotaReserver=True and Admitted=True:
2024-06-04 09:06:58.583652 MODIFIED   job-sample-job-992ea   true     [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady] map[lastTransitionTime:2024-06-04T07:06:58Z message:Quota reserved in ClusterQueue cluster-queue observedGeneration:1 reason:QuotaReserved status:True type:QuotaReserved] map[lastTransitionTime:2024-06-04T07:06:58Z message:The workload is admitted observedGeneration:1 reason:Admitted status:True type:Admitted]]

# 2.1. Pods not ready Timeout first time (after 1 minute). Evict=true:
# https://github.com/kubernetes-sigs/kueue/blob/main/pkg/controller/core/workload_controller.go#L483-L485
2024-06-04 09:07:58.013507 MODIFIED   job-sample-job-992ea   true     [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady] map[lastTransitionTime:2024-06-04T07:06:58Z message:Quota reserved in ClusterQueue cluster-queue observedGeneration:1 reason:QuotaReserved status:True type:QuotaReserved] map[lastTransitionTime:2024-06-04T07:07:58Z message:Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:PodsReadyTimeout status:True type:Evicted] map[lastTransitionTime:2024-06-04T07:06:58Z message:The workload is admitted observedGeneration:1 reason:Admitted status:True type:Admitted]]
# 2.2. Handle eviction. Requeued=False, Admitted=False.
# https://github.com/kubernetes-sigs/kueue/blob/main/pkg/controller/jobframework/reconciler.go#L424-L447.
2024-06-04 09:07:59.042140 MODIFIED   job-sample-job-992ea   true     [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady] map[lastTransitionTime:2024-06-04T07:07:59Z message:Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:Pending status:False type:QuotaReserved] map[lastTransitionTime:2024-06-04T07:07:58Z message:Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:PodsReadyTimeout status:True type:Evicted] map[lastTransitionTime:2024-06-04T07:07:59Z message:The workload has no reservation observedGeneration:1 reason:NoReservation status:False type:Admitted] map[lastTransitionTime:2024-06-04T07:07:59Z message:Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:PodsReadyTimeout status:False type:Requeued]]

# 3.1. Readmit after backoff (after 1 minute) Requeued=True.
# https://github.com/kubernetes-sigs/kueue/blob/main/pkg/controller/core/workload_controller.go#L157-L181.
2024-06-04 09:08:58.014986 MODIFIED   job-sample-job-992ea   true     [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady] map[lastTransitionTime:2024-06-04T07:07:59Z message:Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:Pending status:False type:QuotaReserved] map[lastTransitionTime:2024-06-04T07:07:58Z message:Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:PodsReadyTimeout status:True type:Evicted] map[lastTransitionTime:2024-06-04T07:07:59Z message:The workload has no reservation observedGeneration:1 reason:NoReservation status:False type:Admitted] map[lastTransitionTime:2024-06-04T07:08:58Z message:The workload backoff was finished observedGeneration:1 reason:BackoffFinished status:True type:Requeued]]
# 3.2. (https://github.com/kubernetes-sigs/kueue/blob/main/pkg/scheduler/scheduler.go#L530). Requeued=True:
# BUG! (it should not set Requeued=False second time).
2024-06-04 09:08:58.027117 MODIFIED   job-sample-job-992ea   true     [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady] map[lastTransitionTime:2024-06-04T07:08:58Z message:Quota reserved in ClusterQueue cluster-queue observedGeneration:1 reason:QuotaReserved status:True type:QuotaReserved] map[lastTransitionTime:2024-06-04T07:08:58Z message:Previously: Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:QuotaReserved status:False type:Evicted] map[lastTransitionTime:2024-06-04T07:08:58Z message:The workload is admitted observedGeneration:1 reason:Admitted status:True type:Admitted] map[lastTransitionTime:2024-06-04T07:07:59Z message:Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:PodsReadyTimeout status:False type:Requeued]]
# 3.3. https://github.com/kubernetes-sigs/kueue/blob/main/pkg/controller/core/workload_controller.go#L157-L181). Requeued=True.
# BUG! (it should not set Requeued=True second time).
2024-06-04 09:08:58.042313 MODIFIED   job-sample-job-992ea   true     [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady] map[lastTransitionTime:2024-06-04T07:08:58Z message:Quota reserved in ClusterQueue cluster-queue observedGeneration:1 reason:QuotaReserved status:True type:QuotaReserved] map[lastTransitionTime:2024-06-04T07:08:58Z message:Previously: Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:QuotaReserved status:False type:Evicted] map[lastTransitionTime:2024-06-04T07:08:58Z message:The workload is admitted observedGeneration:1 reason:Admitted status:True type:Admitted] map[lastTransitionTime:2024-06-04T07:08:58Z message:The workload backoff was finished observedGeneration:1 reason:BackoffFinished status:True type:Requeued]]

# 4.1. Deactivation due to Timeout second time. Active=False:
https://github.com/kubernetes-sigs/kueue/blob/main/pkg/controller/core/workload_controller.go#L458-L466.
2024-06-04 09:09:58.013151 MODIFIED   job-sample-job-992ea   false    [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady] map[lastTransitionTime:2024-06-04T07:08:58Z message:Quota reserved in ClusterQueue cluster-queue observedGeneration:1 reason:QuotaReserved status:True type:QuotaReserved] map[lastTransitionTime:2024-06-04T07:08:58Z message:Previously: Exceeded the PodsReady timeout default/job-sample-job-992ea observedGeneration:1 reason:QuotaReserved status:False type:Evicted] map[lastTransitionTime:2024-06-04T07:08:58Z message:The workload is admitted observedGeneration:1 reason:Admitted status:True type:Admitted] map[lastTransitionTime:2024-06-04T07:08:58Z message:The workload backoff was finished observedGeneration:1 reason:BackoffFinished status:True type:Requeued]]
# 4.2. Handle Deactivation
# https://github.com/kubernetes-sigs/kueue/blob/main/pkg/controller/core/workload_controller.go#L183-L214:
2024-06-04 09:09:58.025217 MODIFIED   job-sample-job-992ea   false    [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady] map[lastTransitionTime:2024-06-04T07:08:58Z message:Quota reserved in ClusterQueue cluster-queue observedGeneration:1 reason:QuotaReserved status:True type:QuotaReserved] map[lastTransitionTime:2024-06-04T07:09:58Z message:The workload is deactivated due to exceeding the maximum number of re-queuing retries observedGeneration:2 reason:InactiveWorkload status:True type:Evicted] map[lastTransitionTime:2024-06-04T07:08:58Z message:The workload is admitted observedGeneration:1 reason:Admitted status:True type:Admitted] map[lastTransitionTime:2024-06-04T07:08:58Z message:The workload backoff was finished observedGeneration:1 reason:BackoffFinished status:True type:Requeued]]
# 4.3. Set Requeued=False after eviction
# https://github.com/kubernetes-sigs/kueue/blob/main/pkg/controller/jobframework/reconciler.go#L424-L447
2024-06-04 09:09:59.052521 MODIFIED   job-sample-job-992ea   false    [map[lastTransitionTime:2024-06-04T07:06:58Z message:Not all pods are ready or succeeded observedGeneration:1 reason:PodsReady status:False type:PodsReady] map[lastTransitionTime:2024-06-04T07:09:59Z message:The workload is deactivated due to exceeding the maximum number of re-queuing retries observedGeneration:2 reason:Pending status:False type:QuotaReserved] map[lastTransitionTime:2024-06-04T07:09:58Z message:The workload is deactivated due to exceeding the maximum number of re-queuing retries observedGeneration:2 reason:InactiveWorkload status:True type:Evicted] map[lastTransitionTime:2024-06-04T07:09:59Z message:The workload has no reservation observedGeneration:2 reason:NoReservation status:False type:Admitted] map[lastTransitionTime:2024-06-04T07:09:59Z message:The workload is deactivated due to exceeding the maximum number of re-queuing retries observedGeneration:2 reason:InactiveWorkload status:False type:Requeued]]

Does this PR introduce a user-facing change?

NONE

/ok-to-test

/assign @mimowo

/test pull-kueue-test-integration-main

/test pull-kueue-test-integration-main

/approve LGTM, just a nit about the unit tests. @tenzen-y anything to add?

ACK


Updated Scripts for apk-generator, dependencies for the project

@mariobehling @the-dagger Please review and merge

@the-dagger Fixed.

Looks good, merging.


http browserify broken when sending a full node url object

var url = {
    host: "localhost:8081",
    hostname: "localhost",
    href: "http://localhost:8081/api/foo?bar=baz",
    method: "GET",
    path: "/api/foo?bar=baz",
    pathname: "/api/foo",
    port: "8081",
    protocol: "http:",
    query: "bar=baz",
    search: "?bar=baz",
    slashes: true
  };
  var request = http.get(url, noop);

expected: "http://localhost:8081/api/foo?bar=baz"
actual:   "http://localhost:8081:8081/api/foo?bar=baz"

The url that is requested has the port in it 2 times.  This is because of this line.
https://github.com/substack/http-browserify/blob/master/index.js#L7
I am finishing up a pull request to fix this where it will try host first, then hostname+port.
Please let me know if you have any input.

+1


Refactor to allow users to trigger capture/playback as-needed

What problem does this solve?
Right now, both the playback plugin and the capture plugin assume that they are only used in contexts that only execute playback or capture. This is pretty limiting: it does not allow e.g. pressing an editor button to initiate capture or playback, or live playback/capture game modes such as those implemented in modern "traditional fighter" games.
I considered going ahead and writing the PR for this, to have the discussion directly on the code, but I opted not to since there are a few possible APIs to provide and I am unsure that my preferred solution is everyone's.
What solution would you like?
Systems should only run capture/playback behavior when the user requests some capture/playback action. Then, systems can be configured to run conditionally using resource_added, resource_exists, and on_event. I suggest providing an Event-based API, whereby users send events that trigger internal systems to insert the appropriate resources, but there are several reasonable variations on this.
Just to briefly recount the resources currently attached by this crate:
Common:

PlaybackFilePath
TimestampedInputs
FrameCount (but this should be replaced by Bevy's equivalent feature)

Capture:

InputModesCaptured

Playback:

PlaybackStrategy
PlaybackProgress

Notably, no sub-combination of these resources needs to be available except when capture/playback are triggered. Additionally, only PlaybackFilePath, InputModesCaptured, and PlaybackStrategy need to be defined by the user, since the rest could be managed by internal systems.
I suggest defining two user-triggered Events with properties for PlaybackFilePath and each of InputModesCaptured (and an optional total FrameCount to capture) or PlaybackStrategy. This Event could be detected to insert and manage all the relevant Resources until playback is complete. (Some CaptureEnd event will also be necessary unless a total frame count is required.)
Equivalently, the user could insert the underlying properties of this suggested Event type as Resources themselves. However, this has the downside that users must insert/mutate multiple things to achieve one action. This provides unnecessary failure modes, e.g. allowing users to insert too-few of the required resources for playback.
The above also makes something of a case for joining the "request" Resources into larger structs, which would also imply an ideal candidate for the resource_exists run condition. The downside to the suggested Event-based approach is that the choice of which Resource(s) will act as the run_condition trigger seems somewhat arbitrary. But I mildly prefer the Event-based approach.
I'd be happy to implement any variation on this, just let me know.
Related work
I've made a prototype of this in geppetto which I used for a custom editor panel, and I would later like to replicate that in a new crate on top of this if possible. That work may also want additional enhancements, such as adding filters to the input capture to only capture specific windows, so I will have future suggestions here as well.

That sounds lovely! Sorry for the delay, this got stuck in my "complex review backlog", for days where I have spare brain capacity. Given that this crate doesn't have a ton of active users currently, now is a great time to refactor it become more flexible.

Great. No problem, also; I know you have a lot of responsibilities to keep track of, and like you said, this crate has relatively low usage.
I'll be submitting a (probably draft) PR soon that should implement everything covered here; feel free to treat it like a proposal and let me know what you are/aren't interested in including.

Awesome, I look forward to seeing it.


More accurate page titles for SEO

Add "The Curated Collection of Decentralized Apps
for Ethereum" to the home page title


Missing Documentation: Prerequisites for Installing Guardian Stack on a VM

While following the instructions for deploying a new Guardian stack on a VM
https://manual.grid.tf/documentation/developers/grid_deployment/grid_deployment_full_vm.html
the documentation should include instructions for installing the following prerequisites:

Git
Rust
apt update
Subkey

while installing the subkey i face this error so i can not proceed
it worked before but may be the upgraded version of ubuntu 24 does not support it
stuck on this  to continue testing the gurdian stack
https://github.com/threefoldtech/tf_operations/issues/2754

@khaledyoussef24 seems that subkey was moved from docker-compose folder to apps folder: https://github.com/threefoldtech/grid_deployment/commit/63d455b443b929c91510b7be817393705a72ab49
Can you retry with this? I will update the docs.


Make some minor tweaks to header display

Remove extra spaces in front of copy-paste messages that were
interfere ins with padding
Fix margins for app-bar elements
Fix centering for app-bar elements
Change font-weight for app-bar title
Fixes #1151

:+1:


Any support drill-down charts?

Are there any support in chartjs for drilling down (data zooming) into charts. For example, if you have a bar chart you can double click on the first bar and it would replace the current chart with one with the next level of data, etc...? Thanks!

@cirenep you're probably going to need to implement that yourself. You probably won't have to recreate the chart because you can simply swap out the data object with a new one

This question seems to be relevant to the issue: http://stackoverflow.com/questions/33675468/chartjs-drill-down-issue-with-multiple-y-axis-bar-line-graph

Closing since I think the above solution is the recommended way to do this

There's a plugin for this as well: https://github.com/datavisyn/chartjs-scale-hierarchical

Oh, actually it looks like it moved: https://github.com/sgratzl/chartjs-plugin-hierarchical


Add a wiki: Limbus company

Link to origin wiki: https://limbuscompany.fandom.com/wiki/Limbus_Company_Wiki
Link to destination (independent) wiki: https://limbuscompany.wiki.gg/wiki/Limbus_Company_Wiki

Added in v3.9.0 (now available for Chrome, should be available in Firefox within a few days)


⚠ Adacta-fintech.com has degraded performance

In 48e8899, Adacta-fintech.com (https://www.adacta-fintech.com) experienced degraded performance:

HTTP code: 200
Response time: 1314 ms

Resolved: Adacta-fintech.com performance has improved in b131bf5.


Enable CSS rules on top level element attributes

I'd like to specify a rule within a custom element that depends on the state of a top level element, such as body or html.  So something like this:
<style>
  html[dir="rtl"] #someSubElement {
  ....
  }
</style>

However, when doing this, polymer renames the styles for my custom element to be something like
html[dir="rtl"].my-custom-element #someSubElement.my-custom-element { ... }

Which prevents the rule from ever applying.
Is there any way to scope only part of the CSS rule to the custom element?  Otherwise this requires tagging each potential element that needs RTL information with a RTL class, which is a lot less elegant.

That's what the :host-context selector is for:
:host-context(html[rtl]) {
  ...
}

That's awesome and just what I needed!
Can that be added to the basic Styling local DOM guide?  I discovered it's in Eric's post about shadow dom which i never got to reading.

Absolutely should be there. Let's just move this bug over to the docs repo.

This issue was moved to Polymer/docs#1438


This should work on both Datasette 1.0 and 0.x

I figured out how to test against both here:

https://github.com/simonw/datasette-search-all/issues/19

No reason not to use the same trick here.

I may add Playwright tests too: https://til.simonwillison.net/datasette/playwright-tests-datasette-plugin

Datasette 1.0 requires Python 3.8 or higher:

https://github.com/simonw/datasette/issues/2097

The tests may be passing but this won't actually work - I need the Playwright tests to demonstrate that.

Refs:

#41
#42

As expected, the new Playwright tests pass in 1.0 but fail in 0.64.


USGS collection 2 into WOfS for DEAfrica

Main changes:
Edits to filters.py

adding a C2 filter/mask, to do the cloud and cloud shadow masking
uses the pixel_quality layer and from that layer dilated_cloud and cloud_shadow

Edits to virtual_product.py

if C2 scaling is used, also use the woffles_c2

Edits to wofls.py

adding woffles_c2 which uses filter_c2

@fangfy @omad @alexgleith

@alexgleith I tried to clean up the commits, not sure what happened with it though! I also tidied up the parts that were commented out and updated woffles_c2 to e woffles_usgs_c2

What I suggest you do is something like:
git reset --soft fe4dd7c197d7bfe2641545959249071b9340b3d2

Then do a new commit, so:
git commit -am "a nice message goes here"

And then push the results, either to a new branch (safe) or to this branch (git push --force, which is a little dangerous).


user MetaData cannot be reflected immediately after update

When change the userMetaData, the server has to restart to load it since it is a singleton. Need a way to force refresh it both on the server side and client side

fixed by PR #1313


Could not load file or assembly 'NuGet.Versioning

Install-PSResource : Could not load file or assembly 'NuGet.Versioning, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The system cannot find the file specified.
gmo *get*

ModuleType Version Name          ExportedCommands
---------- ------- ----          ----------------
Script     3.0.0   PowerShellGet {Find-PSResource, Get-PSResource, Get-PSResourceRepository, Install-PSResource...}

$PSVersionTable

Name                           Value
----                           -----
PSVersion                      5.1.21318.1000

Install-PSResource -name posh-git
Install-PSResource : Could not load file or assembly 'NuGet.Versioning, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The system cannot
find the file specified.
At line:1 char:1
+ Install-PSResource -name posh-git
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (:) [Install-PSResource], FileNotFoundException
    + FullyQualifiedErrorId : System.IO.FileNotFoundException,Microsoft.PowerShell.PowerShellGet.Cmdlets.InstallPSResource

I saw some other references to this e.g.: https://github.com/Azure/azure-functions-host/issues/6650

Thanks @brwilkinson this is an interesting issue...are you using Azure Functions? We packaged the nuget assemblies in the latest version of PowerShellGet, so re-installing the module may help...

Closing this issue, since reinstalling PowerShellGet 3.0.0-beta10 has resolved this.
Not sure why all files weren't originally downloaded.
For some reason the Modules\PowerShellGet\3.0.0\net472 directory wasn't downloaded.

I actually tested it again and found it didn't get downloaded 1 of the 3 times that i tested.
Whatever that was is unrelated to this issue.


Incompatible Model Architecture and Saved Weights Issue

I encountered an issue while attempting to utilize the provided saved model weights for the architecture implemented in the code repository. The saved model (finetuned on NIH ChestXRay) 'vit-b_CXR_0.5M_mae.pth' weights seem to be incompatible with the architecture initialization in the codebase, resulting in errors during loading and execution.
Steps to Reproduce:

Clone the repository.
Follow the provided instructions to run main_finetune_chestxray.py with saved finetuned weights : 'vit-b_CXR_0.5M_mae.pth' and initializing the model as vit_base_patch16
Attempt to load the provided saved model weights. [line 282-306 in main_finetune_chestxray.py]
Observe errors indicating an architectural mismatch.

Expected Behavior:
The saved model weights should seamlessly load and align with the architecture defined in the code.
Actual Behavior:
The saved model weights are not compatible with the architecture initialization, leading to runtime errors.
Identified Issue:

Cls_tokens, positional_embeddings, patch_embeddings are loaded seamlessly
ViT Encoder's block 0-11 are also loaded seamlessly
The final 4 layers have a problem here
In code, model is initialized in the sequential format as:
previous_blocks -> block11 -> fc_norm.weight -> fc_norm.bias -> head.weight -> head_bias
In saved checkpoint the final layers are in the sequential format as
previous_blocks -> block11 -> head.weight -> head_bias -> fc_norm.weight -> fc_norm.bias

Additional Information:
The repository's documentation provides saved model weights.
The architecture initialization in the code is consistent with the provided guidelines.
The error message suggests a mismatch between the loaded model and the initialized architecture.
The issue prevents further utilization of the model weights for desired tasks.
This issue significantly impacts the ease of integrating and utilizing the repository's pre-trained models. A resolution or guidance on properly aligning the model weights with the code's architecture would be greatly appreciated.

The weights to the model are loaded. I've edited the code to load weights of the model more seamlessly.
`
#initialize the model
model = models_mae.dict[args.model](norm_pix_loss=args.norm_pix_loss, img_size=args.input_size,
mask_strategy=args.mask_strategy, num_features=5)
#load pre_trained weights
checkpoint = torch.load('output_dir/<<checkpoint_model's_name>>.pth', map_location='cpu')
checkpoint_model = checkpoint['model']
state_dict = model.state_dict()
for k in checkpoint_model.keys():
    if k in state_dict:
        if checkpoint_model[k].shape == state_dict[k].shape:
            state_dict[k] = checkpoint_model[k]
            print(f"Loaded Index: {k} from Saved Weights")
        else:
            print(f"Shape of {k} doesn't match with {state_dict[k]}")
    else:
        print(f"{k} not found in Initialized Model")

`


HBASE-28158 Decouple RIT list management from TRSP invocation

Only remove a region from the RIT map when assignment reaches a suitable terminal state.
Before this change we would map a RIT list entry to a running TRSP. This is problematic because the in-transition state does not always correspond to the lifetime of a TRSP. In cases of an operator bypass or bug or timeout the region will still be in transition from the user or operator perspective but not included in the RIT list.
Operators expect that regions that should be open but are not appear the master's RIT list, provided by /rits.jsp, the output of the shell's 'rit' command, and in ClusterStatus.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 35s
Docker mode activated.

So the intention here is that, when region is in abnormally closed state, we will use operator tools to bypass the TRSP, but then, we will consider the region as not in RIT and confusing the operators?
Seems reasonable. But we should be careful to not mess up the normal logic. Let me take a look at the related code carefully.
Thanks.

Based on my local tests there are three test failures to resolve.
This first one is a false positive:

TestAssignmentManagerUtil.testCreateUnassignProceduresForMergeFail

These two are timeouts, so waiters need changes:

TestAssignmentManagerMetrics.testRITAssignmentManagerMetrics
TestRegionReplicaSplit.testAssignFakeReplicaRegion

I think these are test issues but will look in detail tomorrow.

Yes I have legit test failures to resolve, doing that soon.

For me I think the fundamental issue is the time a region is in transition is not always tied to the lifetime of a TransitRegionStateProcedure, so managing the RIT list from addProcedure/removeProcedure is not correct.
A region is in transition if it is transition. This may or may not involve a  TransitRegionStateProcedure. Perhaps there is no active TransitRegionStateProcedure. If the region is not assigned, it is still in transition, and should be reported as such by the master.
I can agree to totally decouple RIT list management from addProcedure/removeProcedure. That makes sense. The assignment manager will make separate calls to RegionStates to manage the RIT map, independently from management of procedures.

For me I think the fundamental issue is the time a region is in transition is not always tied to the lifetime of a TransitRegionStateProcedure, so managing the RIT list from addProcedure/removeProcedure is not correct.

But if there is no issue, I do not think a region can be in the RIT state when there is no TRSP? I.e, only if you use HBCK to bypass a TRSP, but I do not think this is a normal operation. That why I say we'd better separate the normal logic and abnormal logic. And if a TRSP finishes, I think the region should leave the RIT state.


Add warning when no updates

This one I wasn't sure about, but when I started using it, I got confused when I saw no output when running. Adding the --help from #1 will go a long way in solving this, but I thought maybe it would be ok to have a warning/log message if no updates was found within the given cutoff.

PS: This is the last PR I have :)

That's great! Thanks for the help!

You saved me the trouble of having to make this tool myself, so the least I can do is help polish :)


Typo in the Monthomery backend mod name

Plus some minor editing of docs/comments for readability.

We don't accept typo fixes from non contributors. Thanks for reporting though.


changed variable name to avoid collision in python3

Description
This PR...

cloudstack/tools/apidocs/gen_toc.py changed variable name to avoid namecollision with reserved name.

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity
Feature/Enhancement Scale

[ ] Major
[x] Minor

Bug Severity

[ ] BLOCKER
[ ] Critical
[ ] Major
[x] Minor
[ ] Trivial

Screenshots (if appropriate):
How Has This Been Tested?

@blueorangutan package

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 379

this is going to give some conflicts with other py3 PRs but that's fine :+1:

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: centos7 :heavy_multiplication_x: centos8 :heavy_check_mark: debian. SL-JID 470

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: centos7 :heavy_check_mark: centos8 :heavy_check_mark: debian. SL-JID 474


Support setting webhook reinvocationPolicy in chart

Ⅰ. Describe what this PR does
allow setting reinvocationPolicy in the webhook configuration.
I faced an issue in testing that webhook is not injecting the fuse-sidecar even the annotation is added. This is probably due to the ordering of mutating webhook (we have 2-3 webhooks mutating the pod). After setting the reinvocationPolicy to IfNeeded, the webhook is working as expected.
This PR adds the option in the helm chart to overwrite the default value.

/lgtm
/approve


Debug and get working

Turns out I should take my own advice of RTFM:

You also need to choose a range of ports for data channels, say you want to support 10 concurrent users, pick 10 ports like 30000-30009 and pass that to docker run as --publish option as well as -p (passive port range) to pureftpd.

🤦 When it was all running in the docker network this wasn't a problem because the ports would just be there
Also had some tidying up and making the file upload method a bit easier to use when we've already got binary data (but not a file to read)

Doesn't need to be used as I think we've got something which runs on apple silicone and intel chips


Support verbatimModuleSyntax in TypeScript Generator

Reason/Context
Currently the typescript generator does not explicitly export/import interfaces as types. This is an issue when the typescript option 'verbatimModuleSyntax' is enabled and can potentially cause some other pitfalls.
Description
Add a new flag (or make this the default behaviour when using interfaces, afaik that should not cause any issues) that changes the behaviour of 'src/generators/typescript/TypeScriptDependencyManager.ts' so it imports and exports interfaces as types.
Before:
import { PublicUser } from './PublicUser'
interface NewStatePayload {
  members: PublicUser[]
}
export { NewStatePayload }

After:
import type { PublicUser } from './PublicUser'
interface NewStatePayload {
  members: PublicUser[]
}
export type { NewStatePayload }

I think it makes sense to just render it by default for interfaces (is there any other cases?) if it has no side effects of course :v:
All we need is to adapt the dependency manager: https://github.com/asyncapi/modelina/blob/master/src/generators/typescript/TypeScriptDependencyManager.ts#L48

@moritzkalwa not sure if you saw, but I unfortunately had to revert your PR because of breaking changes to the dependency functions and the bug it introduced. I am planning on fixing it at some point, but right now I have to spend time on something else.
If you got the time to help I would really appreciate it 🤙

@moritzkalwa not sure if you saw, but I unfortunately had to revert your PR because of breaking changes to the dependency functions and the bug it introduced. I am planning on fixing it at some point, but right now I have to spend time on something else.
If you got the time to help I would really appreciate it 🤙

I saw and I'm planning on taking another look at it in the future. Haven't had the time to do so yet though, and probably won't until next week. Would love to fix that issue and get this done though, if that is early enough!


[TorchBench] Performance Signal Detected

TorchBench CI has detected a performance signal.
Affected Tests:

eval-cuda-fp32:

attention_is_all_you_need_pytorch[dynamo-blade (latency)] 5.893 -> 6.611, -12.1839%
attention_is_all_you_need_pytorch[dynamo-disc (latency)] 4.955 -> 5.551, -12.0283%
BERT_pytorch[dynamo-disc (latency)] 26.208 -> 46.787, -78.5218%
BERT_pytorch[disc (compiled)] 1217 -> 0
BERT_pytorch[disc (clusters)] 1 -> 0
BERT_pytorch[dynamo-disc (clusters)] 1 -> 0
BERT_pytorch[dynamo-disc (compiled)] 1170 -> 0
DALLE2_pytorch[disc (latency)] 97.537 -> 102.507, -5.0955%
DALLE2_pytorch[disc (compiled)] 22395 -> 23087
DALLE2_pytorch[disc (clusters)] 161 -> 185
drq[dynamo-disc (latency)] 1.373 -> 1.262, +8.0845%
fambench_xlmr[dynamo-disc (compiled)] 3012 -> 2868
functorch_dp_cifar10[dynamo-disc (latency)] 2.163 -> 2.351, -8.6916%
functorch_maml_omniglot[blade (latency)] 0.56 -> 0.68, -21.4286%
hf_Bart[dynamo-blade (latency)] 9.695 -> 12.211, -25.9515%
hf_Bart[dynamo-disc (latency)] 10.227 -> 12.877, -25.9118%
hf_Bart[dynamo-disc (clusters)] 1 -> 8
hf_Bart[dynamo-disc (compiled)] 1426 -> 1414
hf_Bert[dynamo-blade (latency)] 6.888 -> 8.057, -16.9715%
hf_Bert[dynamo-disc (latency)] 7.256 -> 8.272, -14.0022%
hf_Bert_large[dynamo-blade (latency)] 18.071 -> 20.104, -11.2501%
hf_Bert_large[dynamo-disc (latency)] 19.601 -> 21.399, -9.173%
hf_Bert_mini[disc (latency)] 0.785 -> 0.826, -5.2229%
hf_Bert_mini[dynamo-blade (latency)] 0.562 -> 1.023, -82.0285%
hf_Bert_mini[dynamo-disc (latency)] 0.866 -> 1.485, -71.4781%
hf_DistilBert[dynamo-blade (latency)] 3.684 -> 4.112, -11.6178%
hf_DistilBert[dynamo-disc (latency)] 4.034 -> 4.374, -8.4284%
hf_GPT2[dynamo-blade (latency)] 21.082 -> 22.149, -5.0612%
hf_Longformer[dynamo-disc (latency)] 105.792 -> 119.527, -12.983%
maml_omniglot[blade (latency)] 0.381 -> 0.407, -6.8241%
maml_omniglot[dynamo-blade (latency)] 0.457 -> 0.49, -7.221%
mobilenet_v2[dynamo-blade (latency)] 3.222 -> 3.408, -5.7728%
mobilenet_v3_large[disc (compiled)] 580 -> 590
mobilenet_v3_large[disc (clusters)] 9 -> 10
mobilenet_v3_large[dynamo-disc (clusters)] 9 -> 10
mobilenet_v3_large[dynamo-disc (compiled)] 580 -> 590
phlippe_resnet[disc (latency)] 2.46 -> 2.21, +10.1626%
timm_vovnet[dynamo-blade (latency)] 20.534 -> 22.103, -7.641%
yolov3[disc (latency)] 41.283 -> 37.218, +9.8467%

detail data can be seen in oss://bladedisc-ci/TorchBench/full/20230406-13
created by TorchBench CI automatically

Some performance decay should be investigated.

Bert_pytorch compiling error fixed in https://github.com/alibaba/BladeDISC/pull/1109

The baseline is running with torch+2.0.0.dev20230130,  which is not avilable now, and we cannot reproduct this in both torch2.0 and torch2.1dev with previous BladeDISC commit. So this maybe introduced by torch version change.


esp32-s2 multisocket transfer errors (IDFGH-5185)

----------------------------- Delete below -----------------------------
Reminder: If your issue is a general question, starts similar to "How do I..", or is related to 3rd party development kits/libs, please discuss this on our community forum at https://esp32.com instead.
INSTRUCTIONS
Before submitting a new issue, please follow the checklist and try to find the answer.

[x] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[x] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[x] I have searched the issue tracker for a similar issue and not found a similar issue.

If the issue cannot be solved after the steps before, please follow these instructions so we can get the needed information to help you in a quick and effective fashion.

Fill in all the fields under Environment marked with [ ] by picking the correct option for you in each case and deleting the others.
Describe your problem.
Include debug logs from the "monitor" tool, or coredumps.
Providing as much information as possible under Other items if possible will help us locate and fix the problem.
Use Markdown (see formatting buttons above) and the Preview tab to check what the issue will look like.
Delete these instructions from the above to the below marker lines before submitting this issue.

IMPORTANT: If you do not follow these instructions and provide the necessary details, your issue may not be resolved.
----------------------------- Delete above -----------------------------
Environment

Development Kit:      [ESP32-Wrover-Kit|ESP32-DevKitC|ESP32-PICO-Kit|ESP32-LyraT|ESP32-LyraTD-MSC|none]
Kit version (for WroverKit/PicoKit/DevKitC): [v1|v2|v3|v4]
Module or chip used:  [ESP32-WROOM-32|ESP32-WROOM-32D|ESP32-WROOM-32U|ESP32-WROVER|ESP32-WROVER-I|ESP32-WROVER-B|ESP32-WROVER-IB|ESP32-SOLO-1|ESP32-PICO-D4|ESP32]
IDF version (run git describe --tags to find it):
// v3.2-dev-1148-g96cd3b75c
Build System:         [Make|CMake|idf.py]
Compiler version (run xtensa-esp32-elf-gcc --version to find it):
// 1.22.0-80-g6c4433a
Operating System:     [Windows|Linux|macOS]
(Windows only) environment type: [MSYS2 mingw32|ESP Command Prompt|Plain Command Prompt|PowerShell].
Using an IDE?: [No|Yes (please give details)]
Power Supply:         [USB|external 5V|external 3.3V|Battery]

Problem Description
//Detailed problem description goes here.
Expected Behavior
Actual Behavior
Steps to reproduce

step1
...

// If possible, attach a picture of your setup/wiring here.
Code to reproduce this issue
// the code should be wrapped in the ```cpp tag so that it will be displayed better.
#include "esp_log.h"

void app_main()
{

}

// If your code is longer than 30 lines, GIST is preferred.
Debug Logs
Debug log goes here, should contain the backtrace, as well as the reset source if it is a crash.
Please copy the plain text here for us to search the error log. Or attach the complete logs but leave the main part here if the log is *too* long.

Other items if possible

[ ] sdkconfig file (attach the sdkconfig file from your project folder)
[ ] elf file in the build folder (note this may contain all the code details and symbols of your project.)
[ ] coredump (This provides stacks of tasks.)

I moved a working project from ESP 32 to ESP32-S2.
Custom board
Windows 10
Stable environment ESP-IDF-v4.2.
The project uses data transfer through 4 sockets at the same time (it determines which socket is free and data is placed there). Everything works fine on ESP 32, but it doesn't work on ECP32-S2. After several blocks of data (1408 bytes each) have been sent, sendsocket returns -1 (socket write error).
When using a single socket, data is transmitted normally.
Please help me understand how to fix this?
Code of the data sending function:
[code]
uint8_t PutToSocket(uint8_t * data, uint16_t len_data, uint16_t *len_data_sent)
{
int len = 0;
fd_set fd_write_set;
struct timeval tv;
int retval;
uint8_t return_result = SOCKET_WRITE_IN_PROGRESS;
uint8_t retry_counter = 0;
uint8_t i = 0;
retry_counter = 0;
return_result = SOCKET_WRITE_IN_PROGRESS;

if (!len_data)
{
    return return_result;
}

while ( (retry_counter < 3) && (return_result != TRANSFER_OK) )
{
    *len_data_sent = 0;

    retry_counter++;

    FD_ZERO (&fd_write_set);

    for(i = 0; i < num_sockets; i++)
    {
        FD_SET (sock[i], &fd_write_set);
    }

    tv.tv_sec = 10;
    tv.tv_usec = 0;

    retval = select (FD_SETSIZE, NULL, &fd_write_set, NULL, &tv); // Block until input arrives on one or more active sockets.

    if(retval == -1)
    {
        printf("Socket error at write data\n");
        return_result = ERROR_SOCKET_WRITE_SELECT;
    }
    else if(retval == 0)
        {
            printf("Socket timeout %d sec occurred at write\n", (uint8_t)tv.tv_sec);
            return_result = ERROR_SOCKET_WRITE_SELECT_TIMEOUT_OCCURRED;
        }
        else if (retval > 0)
            {
                for(i = 0; i < num_sockets; i++)
                {
                    if(FD_ISSET(sock[i], &fd_write_set))
                    {
                        len = send(sock[i], data, len_data, 0);
                        break;
                    }
                }

                if ((len) < 0)
                {
                    printf("Error write to socket %d\n", len);
                    return_result = ERROR_SOCKET_WRITE_SEND;
                }
                else if (len == 0)
                    {
                        printf("Write ZERO to socket\n");
                        return_result = ERROR_SOCKET_WRITE_SEND_ZERO;
                    }
                    else if (len > 0)
                    {
                        if (len == len_data)
                        {
                            *len_data_sent = len;
                            return_result = TRANSFER_OK;
                        }
                        else
                        {
                            return_result = SOCKET_WRITE_IN_PROGRESS;
                        }
                    }
            }
}

return return_result;

}
[/code]

I continue to experiment with simultaneous transmission over multiple sockets.
At the moment, the results are as follows:

Errors only if sending goes through several sockets (the more sockets the faster the error occurs, with two used sockets, the error occurs, but rarely, with 4 almost immediately after sending 8-10 packets of 1410 bytes) and does not depend on the number of open sockets (only on the number of used ones, if we open 4 but send only one, there will be no errors)

Three types of error:
2.1.  WiFi just falls off (wifi:bcn_timout,ap_probe_send_start)
2.2. Selec() returns on timeout.
2.3. When Select() returns the response that the socket is ready (returns > 0) to write, then Send() returns error 11 (which
means that an unblocked socket cannot accept all the data to send without blocking - and this seemed normal, but after
this error occurs, it usually never gets released, with rare exceptions, and this is not the normal behavior of the socket).

There is an assumption that ESP32-S2 does not work correctly with several sockets at the same time, or there is not enough memory, or performance, but when working with several sockets, the wifi falls off, then inside the TCP/IP stack, it is mixed and damaged.
The main questions for the developers of espressif:

can esp32-s2 work with multiple sockets at the same time, or not?
If it can, has it been tested?
If everything is fine, then what is the difference between the transfer to ESP 32 and ECP32-s2, what am I doing wrong?

Without solving this issue, the development of the project stopped. We manufacture and sell thousands of devices on ESP32 and it is extremely important for us to understand the possibility of using ESP32-S2 in our projects.
Thanks.

Hi @andrej102
Thank you for your observations, in ESP32-S2 there are no limitations for using multiple sockets(it should work normally as in ESP32).
I have created a basic demo example for 5 sockets using ESP32-S2 and wasn't able to see any errors after running it multiple times(10 times).
I have created the demo example tcp_client according to your sample code.
Could you please try again with the code below, and see if you still getting the error?
TCP Client
https://gist.github.com/gabsuren/dc297157a4f99e96008e8ab062589a10
Board: ESP32-S2
Environment: macOS Big Sur
IDF version: ESP-IDF-v4.2.
Thanks,
Suren

@andrej102 Thanks for reporting. Would you please help share if any updates or details for this issue? Thanks.

@andrej102 Thanks for reporting. Would you please help share if any updates or details for this issue? Thanks.

@andrej102 Thanks for reporting. Would you please help share if any updates or details for this issue? Thanks.

@andrej102 Thanks for reporting. Would you please help share if any updates or details for this issue? Thanks.

Thanks for reporting, would close due to short of feedback, feel free to reopen with more updates.


try to implement "in" for union types

// A discriminated type union is where you use code flow
// analysis to reduce a set of potential objects down to one
// specific object.
//
// This pattern works really well for sets of similar
// objects with a different string or number constant
// for example: a list of named events, or versioned
// sets of objects.

type TimingEvent = { name: "start"; userStarted: boolean } | { name: "closed"; duration: number };

// When event comes into this function, it could be any
// of the two potential types.

const handleEvent = (event: TimingEvent) => {
  // By using a switch against event.name TypeScript's code
  // flow analysis can determine that an object can only
  // be represented by one type in the union.

  switch (event.name) {
    case "start":
      // This means you can safely access userStarted
      // because it's the only type inside TimingEvent
      // where name is "start"
      const initiatedByUser = event.userStarted;
      break;

    case "closed":
      const timespan = event.duration;
      break;
  }
};

// This pattern is the same with numbers which we can use
// as the discriminator.

// In this example, we have a discriminate union and an
// additional error state to handle.

type APIResponses = { version: 0; msg: string } | { version: 1; message: string; status: number } | { error: string };

const handleResponse = (response: APIResponses) => {
  // Handle the error case, and then return
  if ("error" in response) {
    print(response.error);
    return;
  }

  // TypeScript now knows that APIResponse cannot be
  // the error type. If it were the error, the function
  // would have returned. You can verify this by
  // hovering over response below.

  if (response.version === 0) {
    print(response.msg);
  } else if (response.version === 1) {
    print(response.status, response.message);
  }
};

// You're better off using a switch statement instead of
// if statements because you can make assurances that all
// parts of the union are checked. There is a good pattern
// for this using the never type in the handbook:

// https://www.typescriptlang.org/docs/handbook/advanced-types.html#discriminated-unions

function main() {
}

see if you can implement "error" in response line

postponed


Upgrade pydantic version to v2

Pydantic v2 is out since june 2023. As the setup.py restricts to pydantic<1.11, we are not able to use the inference server in projects depending of pydantic v2.

Any progress on this? We are also affected by this.

Apologies for the delayed response. I've gone ahead and created a PR for this migration but we are going to wait until after the New Year to release the changes. I have linked the PRs above.

@DannyBruno Hi, any idea when the next release will be made?


Bash resource fails when pam_mktemp is enabled

If pam_mktemp is enabled, temporary files are created under /tmp/.private/<user>, so chef puts its files there.  So, when running sudo chef-client, all of the bash scripts are placed in /tmp/.private/root.  However, if the script is to be executed as another user via the user attribute, the script fails with permission errors.
Example:
 bash 'bundle install' do
   user exec_user
   group exec_user
   cwd deploy_path
   code "bundle install --without test --path /home/#{exec_user}/.gem/"
 end

Fails with
 STDERR: bash: /tmp/.private/root/chef-script20150313-15671-ftqqan: Permission denied

For us, the short term fix was to disable pam_mktemp.

This is a dup of a similar-ish bug on Mac OSX #3563

calling this a dup of #3563


Clicking Editor Fails to Focus

Platform:
Waterfox 56.2.0 with uBlock Origin and Dark Reader extensions installed Stylo is enabled as well.
Bug:
It seems that on the C# Hello World interactive tutorial, mouse clicks fail to focus on the text entry. This problem should be reproduceable on all of the .NET try lessons.
Video:
Here is a video of it in action.

I have had the same issue, when I clicked Run the code was not editable anymore. In my case, I worked around it by refreshing the page every time I clicked Run.

This was likely another example of #17 and if so, it's now fixed. @prail Please reopen this if it's still not working for you.


I updated the librarian to not need to use the filesystem to calculate the size, so the last one might not have gone through, but the containers did (and we will likely rebuild anyway) so I'm not super worried.


Update mongoose to v5

Mongoose currently has v5 that launched fairly recently. Most of the breaking changes can be found here:
https://github.com/Automattic/mongoose/blob/master/History.md#500-rc0--2017-12-28
They don't seem to directly affect the project mostly, but I could be wrong. Might be worth looking into

Hello, we use connect-mongo for the moment : https://github.com/jdesboeufs/connect-mongo/pull/275
not ok with last mongo and mongoose


Allow using put as a source

This changes put so that it can be used to inject a static event into a pipeline.

FWIW, I can see us solving this problem with expressions instead, solving this without a dedicated operator or by finding a more general solution to the underlying problem. But feel free to continue with this in the meantime.

Closing; we'll handle this as part of the language revamp.


remap global keys easily

Is your feature request related to a problem? Please describe.
Based on https://discuss.kakoune.com/t/key-maps-as-key-locations/1414, we want to make keymaps part of a consolidated global environment state in a way that users can encode different custom key layouts easily.
Describe the solution you'd like
For best onboarding experience, we might want a nixflk global keymap wizard, so that once https://github.com/nix-community/home-manager/issues/1685 is implemented, we could tell people to run flk keymap (or a surrogate) in order to key their muscle memory aliases like so:
Press Left Pinky on home row position: ...
Press Left Pinky 1 Up from home row position: ...
Press Left Pinky 1 Down from home row position: ...

constructing:
{
  LPinky = "a";
  LRing  = "s";
  LRingUp = "d";
  LMiddleDown = "m";
  LMiddle = "h";
  RMiddle = "e";
  RMiddleDown = "l";
  RRingUp = "p";
  RRing = "o";
  RPinky = "i";
}

Describe alternatives you've considered
This should actually be a standalone implementation, I'm putting a thought anchor here so it can be conceived in the context of making nixflk even more stellar.
Additional context

https://github.com/nix-community/home-manager/issues/1685
https://discuss.kakoune.com/t/key-maps-as-key-locations/1414

Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.

If we keep this nix specific, it's a great marketing argument for the whole community as for system configuration management. That would be pretty awesome, huh?

too far off the board


Updating to work with lodash

Removed the use of "context" parameter from _.each as lodash doesn't support the third parameter.
Also changed _.all to _.every to be consistent for both lodash and underscore.

Very cool! Thanks.