Support for JSON field type in SQLite

Problem
SQLite has had support for JSON field type for a while. Sequelize supports this field type on par with Postgres and MySQL.
Lack of support for this field type by Prisma is preventing us from porting over our project.
SQLite is a great bootstrapping technology that allows developers to quickly prototype applications without introducing new dependencies such as docker or worry about running yet another service in the development flow. JSON field type gives us the option to have a nosql database colocated in a sql database.
Suggested solution
Please implement support for this feature. See JSON Extension documentation and refer to Sequelize's implementation if required.
Alternatives
Defer migration to Prisma and stick with Sequelize. Maintain status quo.
Additional context

cc: @ryands17
ref: https://github.com/prisma/prisma/discussions/3575

Would love to see this implemented in Prisma!

Any updates on this?

Wich is fixed now 😁

@matthewmueller Is this on the roadmap?

@matthewmueller Is this on the roadmap?

Do you have any update regarding this? Please tell us so those of us who need JSON field type support can decide whether to skip Prisma.

I am interested in this to make Prisma even more viable for interacting with SQLite from an electron app or CLI app.

This is the first result that comes up for Prisma JSON SQLite search. Some response on whether this is in near future plans or not would be appreciable from the maintainers, considering this issue is over an year old.

This would be a great feature, especially for prototyping and hackathons.

I'd like to also vote for this feature.
Typeorm solves it with its simple-json feature.

Any plan on this issue?

At this point the lack of response is more concerning than the lack of this feature.

We never respond to feature requests unless we concretely work on issues, need more information or similar.
That this feature request still exists (and was not closed) is our information that we consider it valid and might prioritize it in the future.

With Json datatype being available in prisma already for MySql and Postgres, and json being natively supported in SQLite for quite a while now, this would be a huge win for inter-operability. With this issue being over 1 1/2 years standing, it would be lovely to see this on the roadmap in the near future.
Until this lands, is there any workaround that can be used for simple use cases (just querying and writing w/o and fancy filtering functions)? Idea is, that we could use this datatype in schema definitions and implement something like a custom adapter/plugin for local sqlite development to handle the de-/serialization.

We want to support both Sqlite and PostgreSQL in Webstudio and while migrating from MongoDB discovered the missing support for JSON type too.
With the recent motion in favor of SQLite serverside by multiple startups and announcement of D1 from cloudflare, this should be a priority for Prisma.

Can we sponsor this feature? I'm really interested in offering a sqlite version of our DB (calcom/cal.com#3388) so it can be played with out of the box and our only limitation is the lack of JSON fields.

Relevant information that changes the situation for this issue:

The JSON functions and operators are built into SQLite by default, as of SQLite version 3.38.0 (2022-02-22).
[...]
Prior to version 3.38.0, the JSON functions were an extension that would only be included in builds if the -DSQLITE_ENABLE_JSON1 compile-time option was included. In other words, the JSON functions went from being opt-in with SQLite version 3.37.2 and earlier to opt-out with SQLite version 3.38.0 and later.
via https://www.sqlite.org/json1.html

🚀!
What could help here right now:
If someone has an application that makes use of a lot of Prisma's Json functionality, it would be awesome if you could collect the queries Prisma generates in PostgreSQL (https://pris.ly/d/logging) for your app and then would try to run these against a SQLite database where you added the Json column by hand. Do they all work out of the box?

+1

Because JSON was not enabled by default in the past, see the message above.

run these against a SQLite database where you added the Json column by hand.

What do you mean by "add the Json column by hand"? @janpio

Prisma can not handle and create JSON columns for SQLite. So to be able to test the queries we use, you would need to add a Json column manually to the SQLite database and then run the queries against that SQLite database with that column present to be able to tell us if they all work, or horribly crash.

hi janpio, appreciate the work!
I added a JSON column manually and have been using prisma.$queryRaw() method to SELECT and UPDATE that column for the past week. So far everything works out of the box for me! Hope it helps

+1
would love to use sqlite in dev and need that json type
please add support

+1 to this, now JSON is natively supported in SQLite

+1

Can we at least enable it under a preview feature flag?

If someone does a PR to add it to our codebases under a preview feature flag, sure. To be accepted it will require tests as well though. We currently are working on other things, so this is a not a priority and no one can spend time on it. As soon as this changes, we might tackle this.

@janpio Really don't get why my "+1" comment above was "marked as abuse" (I'm assuming this was done by you or someone else in the Prisma team since I can't seem to report other comments as abuse. If not, I'm sorry.) I sense a mild annoyance with this feature request in general in your comments and to a certain degree I get that, but to quote from the prisma guidelines for feature requests:

If the feature on the roadmap is linked to a GitHub issue, please make sure to leave a +1 on the issue and ideally a comment with your thoughts about the feature!

I didn't add a comment since I felt it wouldn't add much, since the feature was clear and already discussed extensively. I don't know if these reports are something that GitHub tracks about me, but I wouldn't want for this to lead to any issues with my account in the future so I would really appeciate it if you could reverse the report if that is possible.

I updated the README to avoid such a misunderstanding, and clarified that issues should get a 👍 reaction.
+1 comments are pure noise that keep us from responding to actual issues and comments. We get dozens of these per day, hundreds per week, which led to most colleagues not even reading the comments on feature requests anymore. Users that leave actual comments on issues are complaining that they get notifications and emails for updates - to then nothing useful or helpful. If we don't hide them, we will get more and more and our issues will get less and less useful to us and our users. (And no, those are not reports to GitHub but just a local way to hide comments that do not add anything to the discussion. But I deleted your comment instead so there is not "abuse" label on your comment even in this repository - the mention of this in the issue timeline is why we usually do not do that - it often leads to even more questions that are offtopic to the actual issue).
And that you "sense mild annoyance with this feature request" is you reading too much into what I wrote (or did not write). I am pretty eager to get this feature implemented - just don't have the capacity to prioritize it right now.

the basics of javscript JSON.stringfy
model Teste {
json String
}
{
data : {
json :  JSON.stringfy(OBJECT)
}
}

Maybe we can use sqld to mimic postgresql for now, and test prisma against it?
https://github.com/libsql/sqld

I wanted to add my eagerness for this to be implemented as well, as well as get notified if there is movement on this ticket!
Thanks Prisma team!

@janpio

If someone has an application that makes use of a lot of Prisma's Json functionality, it would be awesome if you could collect the queries Prisma generates in PostgreSQL (pris.ly/d/logging) for your app and then would try to run these against a SQLite database where you added the Json column by hand. Do they all work out of the box?

I'm not sure why it's taken this long for someone to pipe up here, but the answer is simply "no" here. Here are some initial findings with a small subset of the functions, but I didn't bother continuing to research as they just seem like the Prisma implementation of how it handles the JSON queries is just not compatible with SQLite.
My Prisma model is:
model User {
  id String @id @default(uuid())
  data Json
}

An INSERT using a postgres datasource looks like:
INSERT INTO "public"."User" ("id","data") VALUES ($1,$2) RETURNING "public"."User"."id", "public"."User"."data"
["918bab14-5f26-4ef5-bed9-0661156a09a7",{"foo":"bar"}]

but SQLite expects the $2 param to be text. For example {"foo":"bar"} needs to become '{"foo":"bar"}'.
Perhaps that's a logging or library manipulation mismatch issue however, so looking at one of the more complicated queries:
await prisma.user.findFirst({
  where: {
    data: {
      path: ["foo"],
      equals: "bar"
    }
  }
});

looks like:
SELECT "public"."User"."id", "public"."User"."data" FROM "public"."User" WHERE ("public"."User"."data"#>ARRAY[$1]::text[])::jsonb::jsonb = $2 LIMIT $3 OFFSET $4
["foo","bar",1,0]

SQLite errors: SQLITE_ERROR: unrecognized token: "#" which makes sense because there is no #> or #>> operator in the SQLite JSON functions, only -> and ->>. Mind you, the ::json or ::jsonb tokens would also likely choke.
A comparable call in SQLite would look like:
SELECT "User"."id", "User"."data" FROM "User" WHERE "User"."data"->>'$.foo' = '"bar"' LIMIT 1 OFFSET 0

or
SELECT "User"."id", "User"."data" FROM "User" WHERE "User"."data"->>'$.foo' = 'bar' LIMIT 1 OFFSET 0

or removing the $. in front of foo also works

SQLite’s 3.45.0 release introduces changes to JSON data handling, using JSONB as the new internal format for all JSON functions, which now generate binary JSONB under the hood.
This might be a good time to revisit the implementation of JSON field type support in Prisma for >= SQLite 3.45.0.

Is there any temporary solution for this?

@ryantando I am specifying the type of the field as String in the schema and then provide extensions to transform the string to/from JSON in the client creation:
client = new PrismaClient({
  datasourceUrl,
}).$extends({
  result: {
    playerCharacter: {
      metadata: {
        needs: { metadata: true },
        compute(obj) {
          return JSON.parse(obj.metadata as string);
        },
      },
    },
  },
  query: {
    playerCharacter: {
      create({ args, query }) {
        args.data.metadata = JSON.stringify(args.data.metadata);
        return query(args);
      },
      update({ args, query }) {
        if (args.data.metadata !== undefined) {
          args.data.metadata = JSON.stringify(args.data.metadata);
        }
        return query(args);
      },
      updateMany({ args, query }) {
        if (args.data.metadata !== undefined) {
          args.data.metadata = JSON.stringify(args.data.metadata);
        }
        return query(args);
      },
      upsert({ args, query }) {
        args.create.metadata = JSON.stringify(args.create.metadata);
        if (args.update.metadata !== undefined) {
          args.update.metadata = JSON.stringify(args.update.metadata);
        }
        return query(args);
      },
    },
  },
});

I'd be super happy if this could happen! Is there a pending PR on this?

Well isn't this a bummer. I thought I could just switch from Postgres to D1 and keep my ol trusty Prisma and not have to learn any new syntax or framework. Seems I have to reconsider my options. Maybe use another ORM possibly. Writing queries by hand just gets too tedious for me.

Well isn't this a bummer. I thought I could just switch from Postgres to D1 and keep my ol trusty Prisma and not have to learn any new syntax or framework. Seems I have to reconsider my options. Maybe use another ORM possibly. Writing queries by hand just gets too tedious for me. Maybe give that Drizzle a shot.

For now I'm treating it as a string, and then just JSON.parse when I need to use it. It's worth it to me due to the speed issues with having just Postgres sit in one region.

Out of curiosity why it's taking so long for prisma to support json1 type for sqlite when it already supports jsonb type for postgresql? (not to blame or rush anything, just purely curious)

Would like to see this as well

It's unbelievable … 4 years later and Prisma goes en par with sequelize and drizzle on this. Can't wait for 6.2 to release. :rocket:
Thanks heaps to @jacek-prisma and @jkomyno for finally making this happen. :pray:


Some 2.0 Observables can be versioned and revoked

There's an interesting allowed behaviour at the moment where observables can have the new_version() and revoke() method called on them without raising an exception. Any v20 observable which has a modified property (specifically Directory, File and WindowsRegistryKey) will quite happily return a new or revoked version to the caller.
This is a kind of unfortunate result of the collision between the datestamping properties from 2.0 observables prior to the changes made in 2.1 when they became top level objects. The misbehaviour doesn't really manifest for observables from v21 because we actually validate the properties specified during instantiation. However, the exceptions which get raised are still not particularly helpful to the confused programmer who has misunderstood the spec (yours truly ;) ).
For a v20.File:
>>> import datetime, stix2
>>> now  = datetime.datetime.now(tz=datetime.timezone.utc)
>>> now
datetime.datetime(2020, 5, 18, 1, 24, 41, 837726, tzinfo=datetime.timezone.utc)
>>> f = stix2.v20.File(name="test", modified=now)
>>> f.new_version()
File(type='file', name='test', modified='2020-05-18T01:24:53.477617Z')
>>> f.revoke()
File(type='file', name='test', modified='2020-05-18T01:24:55.72256Z', revoked=True)

For a v21.File:
>>> import datetime, stix2
>>> now  = datetime.datetime.now(tz=datetime.timezone.utc)
>>> now
datetime.datetime(2020, 5, 18, 1, 26, 11, 66181, tzinfo=datetime.timezone.utc)
>>> try:
...   stix2.v21.File(name="test", modified=now)
... except stix2.exceptions.ExtraPropertiesError as exc:
...   print(exc)
...
Unexpected properties for File: (modified).
>>> f = stix2.v21.File(name="test")
>>> try:
...   f.new_version()
... except KeyError as exc:
...   print(exc)
...
'modified'
>>> try:
...   f.new_version()
... except KeyError as exc:
...   print(repr(exc))
...
KeyError('modified')
>>> try:
...   f.revoke()
... except KeyError as exc:
...   print(repr(exc))
...
KeyError('modified')

It would be nice if we could add an overriding method implementation to stix2.base._Observable to raise a NotImplementedError when these methods are called. I have a patch to do just that on my local copy, but haven't dug into what tests should be added to verify the behaviour. I'm happy to make the changes and make a PR but would also need to sign the CLA beforehand.

Having re-read section 3.6 of the 2.1 spec, I now see why the logic is generic enough to handle any object with a modified property. For the record:

In STIX 2.1, SCOs do not explicitly have those three versioning properties. Therefore, a SCO cannot be versioned unless custom properties (discussed in section 11.1) are used. Producers who do this SHOULD use the property names created_by_ref, revoked, created, and modified.

In any case, it would still be nice if the errors were more obvious. Perhaps a check for "modified" in self.object_properties in _Observable.new_version() (and "revoked" for .revoke())?


MisconfigurationException "MultiStepLR" with torch 2.0

Bug description
Got following error after upgrading to torch 2.0:
lightning_lite.utilities.exceptions.MisconfigurationException: The provided lr scheduler MultiStepLR doesn't follow PyTorch's LRScheduler API. You should override the LightningModule.lr_scheduler_step hook with your own logic if you are using a custom LR scheduler.
How to reproduce the bug
https://colab.research.google.com/drive/1Nks7DPZlrxUDW0UGa_2-17uOMbH0aWle?usp=sharing

Error messages and logs
# Error messages and logs here please

Environment

Current environment
#- Lightning Component (e.g. Trainer, LightningModule, LightningApp, LightningWork, LightningFlow):
#- PyTorch Lightning Version (e.g., 1.5.0):
#- Lightning App Version (e.g., 0.5.2):
#- PyTorch Version (e.g., 1.10):
#- Python version (e.g., 3.9):
#- OS (e.g., Linux):
#- CUDA/cuDNN version:
#- GPU models and configuration:
#- How you installed Lightning(`conda`, `pip`, source):
#- Running environment of LightningApp (e.g. local, cloud):

More info
The error came from
https://github.com/Lightning-AI/lightning/blob/6cc493360d9dfdd132665343d6611e66e9760885/src/pytorch_lightning/core/optimizer.py#L351
LRSchedulerTypeTuple is using torch.optim.lr_scheduler._LRScheduler to identify torch schedulers
https://github.com/Lightning-AI/lightning/blob/6cc493360d9dfdd132665343d6611e66e9760885/src/pytorch_lightning/utilities/types.py#L114
However, pytorch has changed _LRScheduler to be subclass of LRScheduler (link)
And MultiStepLR is subclass of LRScheduler as well (link)
A fix could be change to use torch.optim.lr_scheduler.LRScheduler in LRSchedulerTypeTuple

Updated by @akihironitta: This issue is related to #15894.

The same issue exists for CosineAnnealingLR
lightning_lite.utilities.exceptions.MisconfigurationException: The provided lr scheduler CosineAnnealingLR doesn't follow PyTorch's LRScheduler API. You should override the LightningModule.lr_scheduler_step hook with your own logic if you are using a custom LR scheduler.

@lantiga
Hello, when I use the lr-scheduler in transformers lib, I meet the same error, do you know the reason?
from transformers import (
get_polynomial_decay_schedule_with_warmup,
get_cosine_schedule_with_warmup,
)

@mviti seeing this now
CosineAnnealingLR is working for me on Lightning 1.9 and PyTorch nightly, please let me know if this is not the case for you

@mactavish91 just to understand the context, are you using transformers with the lightning Trainer? Can you post minimal code to reproduce?
The reason these issues happen is that PyTorch 2.0 changed the hierarchy of scheduler classes. They were all deriving from _LRScheduler before, but they are deriving from LRScheduler now. Since somewhere in our code we were checking whether something was an instance of _LRScheduler, that check started to fail.

@lantiga Yes, the code is
from transformers import (
    get_polynomial_decay_schedule_with_warmup,
    get_cosine_schedule_with_warmup,
)
scheduler = get_cosine_schedule_with_warmup(
  optimizer, num_warmup_steps=warmup_steps, num_training_steps=max_steps,
   )

When I use lr_scheduler_step rather than configure the scheduler in configure_optimizers, the lr remains unchanged at 0.0 and I don't know why.
def set_schedule(pl_module):
optimizer = torch.optim.Adam(optimizer_grouped_parameters, lr=lr)
      scheduler = get_polynomial_decay_schedule_with_warmup(
            optimizer,
            num_warmup_steps=warmup_steps,
            num_training_steps=max_steps,
            lr_end=end_lr,
            power=decay_power,
        )

    # sched = {"scheduler": scheduler, "interval": "step"}
    pl_module.scheduler = scheduler
    return (
        [optimizer]
        # [sched],
    )
def configure_optimizers(self):
    return meter_utils.set_schedule(self)

def lr_scheduler_step(self):
    self.lr_scheduler.step()

I have the same issue...

@lantiga Yes, the code is
from transformers import (
    get_polynomial_decay_schedule_with_warmup,
    get_cosine_schedule_with_warmup,
)
scheduler = get_cosine_schedule_with_warmup(
  optimizer, num_warmup_steps=warmup_steps, num_training_steps=max_steps,
   )

the error message is: lightning_fabric.utilities.exceptions.MisconfigurationException: The provided lr scheduler LambdaLR doesn't follow PyTorch's LRScheduler API. You should override the LightningModule.lr_scheduler_step hook with your own logic if you are using a custom LR scheduler.

Any further update on this issue ❓ I am using torch==1.14.0a0+44dac51 using the NGC pytorch image and still facing this issue.

@mviti There is the same solution about CosineAnnealingLR.Modify file optimizer.py in Pytorch_lightning(My version is 1.8.1):
if not isinstance(scheduler, torch.optim.lr_scheduler.LRScheduler) and not is_overridden("lr_scheduler_step", model):             raise MisconfigurationException(                 f"The provided lr scheduler {scheduler.class.name}doesn't follow PyTorch's LRScheduler"                 " API. You should override theLightningModule.lr_scheduler_step hook with your own logic if"                 " you are using a custom LR scheduler."             )

@mviti  There is the same solution about CosineAnnealingLR.Modify file optimizer.py in Pytorch_lightning(My version is 1.8.1):
if not isinstance(scheduler, torch.optim.lr_scheduler.LRScheduler) and not is_overridden("lr_scheduler_step", model):
            raise MisconfigurationException(
                f"The provided lr scheduler `{scheduler.__class__.__name__}` doesn't follow PyTorch's LRScheduler"
                " API. You should override the `LightningModule.lr_scheduler_step` hook with your own logic if"
                " you are using a custom LR scheduler."
            )

I have the same problem with OneCycleLR.
This is part of my code:
ef configure_optimizers(self):         # Get Adam optimizer         optimizer = torch.optim.Adam(self.parameters(), lr=self.lr)         # Set OneCycleLR policy         lr_scheduler = {             'scheduler': torch.optim.lr_scheduler.OneCycleLR(optimizer, max_lr=self.lr,                                                              total_steps=self.total_iterations),             'interval': 'step', 'frequency': 1, 'name': 'lr_logger'         }         return [optimizer], [lr_scheduler]
And when I start with the training code block, I receive the next issue:
MisconfigurationException: The provided lr scheduler OneCycleLR doesn't follow PyTorch's LRScheduler API. You should override the LightningModule.lr_scheduler_step hook with your own logic if you are using a custom LR scheduler.
My Pytorch version can be seen here:
Name: torch
Version: 2.0.1+cu117
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email<EMAIL_ADDRESS>License: BSD-3
Location: c:\users\hodei.zia\anaconda3\lib\site-packages
Requires: networkx, typing-extensions, jinja2, sympy, filelock
Required-by: torchvision, torchaudio, torchmetrics, torch-lr-finder, pytorch-lightning, pytorch-ignite
How can I fix that issue??

I have the same problem with OneCycleLR.
This is part of my code:
def configure_optimizers(self):
    # Get Adam optimizer
    optimizer = torch.optim.Adam(self.parameters(), lr=self.lr)
    # Set OneCycleLR policy
    lr_scheduler = {
        'scheduler': torch.optim.lr_scheduler.OneCycleLR(optimizer, max_lr=self.lr, total_steps=self.total_iterations),
        'interval': 'step', 'frequency': 1, 'name': 'lr_logger' }
    return [optimizer], [lr_scheduler]

And when I start with the training code block, I receive the next issue:
MisconfigurationException: The provided lr scheduler OneCycleLR doesn't follow PyTorch's LRScheduler API. You should override the LightningModule.lr_scheduler_step hook with your own logic if you are using a custom LR scheduler.
My Pytorch version can be seen here:
Name: torch
Version: 2.0.1+cu117
Summary: Tensors and Dynamic neural networks in Python with strong GPU acceleration
Home-page: https://pytorch.org/
Author: PyTorch Team
Author-email<EMAIL_ADDRESS>License: BSD-3
Location: c:\users\hodei.zia\anaconda3\lib\site-packages
Requires: networkx, typing-extensions, jinja2, sympy, filelock
Required-by: torchvision, torchaudio, torchmetrics, torch-lr-finder, pytorch-lightning, pytorch-ignite
How can I fix that issue??


🧘Serenity | End user documentation Audit / Restructure

What
End user documentation is a scattered. Centralize and Improve end user documentation.

[x] CI should not be triggered when only changes are to docs https://github.com/input-output-hk/cardano-node/pull/4263
[ ] Audit. Identify articles to be updated and identify missing pieces. Scope:
Babbage functionality.
Stake pool operations
Native assets
[ ] New 'docs' directory structure Educational material / Dev material

Why
Better documentation reduces friction. Users should be able to find clear examples for what they are trying to achieve.
Documentation has been a weakness for long time. Keeping it under the node repo makes it harder to update since every PR must follow the same Reviews, Approvals and CI checks as code.

Regarding Plutus documentation, some work was outlined here: https://github.com/input-output-hk/plutus/issues/4476#issuecomment-1213185470 which might be useful to keep track of.


[Ubuntu] WebSocketException: Invalid WebSocket upgrade request

Is there an existing issue for this?

[X] I have searched the existing issues
[X] I have read the guide to filing a bug

Steps to reproduce

flutter create dummy
cd dummy
flutter run

Actual results
The program runs on the emulated device and seem to be working, but I get this error:
Launching lib/main.dart on sdk gphone64 x86 64 in debug mode...
Running Gradle task 'assembleDebug'...                             16.7s
✓  Built build/app/outputs/flutter-apk/app-debug.apk.
Installing build/app/outputs/flutter-apk/app-debug.apk...          649ms
E/DartVM  ( 7202): vm-service: Error: Unhandled exception:
E/DartVM  ( 7202): WebSocketException: Invalid WebSocket upgrade request
E/DartVM  ( 7202):
E/flutter ( 7202): [ERROR:flutter/runtime/dart_isolate.cc(1097)] Unhandled exception:
E/flutter ( 7202): WebSocketException: Invalid WebSocket upgrade request
Error connecting to the service protocol: failed to connect to
http://<IP_ADDRESS>:40237/FiTAxoytMuY=/

Logs

Logs
dummy.txt

Flutter Doctor output

Doctor output

[✓] Flutter (Channel stable, 3.16.2, on Ubuntu 22.04.3 LTS 6.2.0-37-generic, locale en_US.UTF-8)
    • Flutter version 3.16.2 on channel stable at /home/jlidin/.local/src/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 9e1c857886 (4 days ago), 2023-11-30 11:51:18 -0600
    • Engine revision cf7a9d0800
    • Dart version 3.2.2
    • DevTools version 2.28.3

[✓] Android toolchain - develop for Android devices (Android SDK version 34.0.0)
    • Android SDK at /home/jlidin/Android/Sdk/
    • Platform android-34, build-tools 34.0.0
    • Java binary at: /opt/android-studio-2023.1.1/android-studio/jbr/bin/java
    • Java version OpenJDK Runtime Environment (build 17.0.7+0-17.0.7b1000.6-10550314)
    • All Android licenses accepted.

[✓] Chrome - develop for the web
    • CHROME_EXECUTABLE = /usr/bin/brave-browser

[✓] Linux toolchain - develop for Linux desktop
    • Ubuntu clang version 14.0.0-1ubuntu1.1
    • cmake version 3.22.1
    • ninja version 1.10.1
    • pkg-config version 0.29.2

[✓] Android Studio (version 2023.1)
    • Android Studio at /opt/android-studio-2023.1.1/android-studio/
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • android-studio-dir = /opt/android-studio-2023.1.1/android-studio/
    • Java version OpenJDK Runtime Environment (build 17.0.7+0-17.0.7b1000.6-10550314)

[✓] Proxy Configuration
    • HTTP_PROXY is set
    • NO_PROXY is localhost,127.0.0.*,.volvocars.net,.volvocars.biz,*:<IP_ADDRESS>,::1:<IP_ADDRESS>,::1
    • NO_PROXY contains localhost
    • NO_PROXY contains <IP_ADDRESS>
    • NO_PROXY contains ::1

[✓] Connected device (3 available)
    • sdk gphone64 x86 64 (mobile) • emulator-5554 • android-x64    • Android 14 (API 34) (emulator)
    • Linux (desktop)              • linux         • linux-x64      • Ubuntu 22.04.3 LTS 6.2.0-37-generic
    • Chrome (web)                 • chrome        • web-javascript • Brave Browser <IP_ADDRESS>

[✓] Network resources
    • All expected network resources are available.

• No issues found!

Hi @joellidin, do you get this issue with all targets you run on or only on android?

Hey, sorry for a slow answer. The problem was on my side because of some work proxies. I got it to work consistently eventually. Thanks for answering.


🔧 [Refactor] Docu Tooling & Cleanup

🔧 Refactor ticket

We do not have a precise tooling for our docu which is multi language and not very well structured.
This issue is to change this.
What tooling will we use?

Github README.md & md files?
Github Wiki?
External Tool ontop of Github?
Other external tools like confluence?

Furthermore a clear structure of our docu and bringing it up to date would be partially task of this issue.
Starting points would be:

The main Readme: https://github.com/gradido/gradido/blob/master/README.md (Aimed at developers, giving project overview like idea, how to setup, tech stack, ...)
The Readme in the docu folder: https://github.com/gradido/gradido/blob/master/docu/README.md

@clauspeterhuebner Hows the status with this?


Use modern FindPython from CMake 3.12

This really helps with cross compilation and virtual environments
The minimum CMake Version is already 3.15
xref: https://github.com/conda-forge/openimageio-feedstock/pull/87

Description

Tests

Checklist:

[ ] I have read the contribution guidelines.
[ ] I have updated the documentation, if applicable.
[ ] I have ensured that the change is tested somewhere in the testsuite
(adding new test cases if necessary).
[ ] If I added or modified a C++ API call, I have also amended the
corresponding Python bindings (and if altering ImageBufAlgo functions, also
exposed the new functionality as oiiotool options).
[ ] My code follows the prevailing code style of this project. If I haven't
already run clang-format before submitting, I definitely will look at the CI
test that runs clang-format and fix anything that it highlights as being
nonconforming.

Sigh, it hasn't had the effect i wanted...

Can you explain what you're trying to do here?
The scripts already did use the modern FindPython. Our find_python() code you deleted called checked_find_package, which in turn is just a fancy wrapper around find_package (with lots of extra bells and whistles). The find_python sets some options/variables beforehand, so maybe you just wanted to alter or delete some of those?
How can we help you in Conda land?

You are correct. I've been trying to get cross compilation working and for some reason the "wrong" python is sometimes found.


Documentation?

I'm having to use this as it's pretty heavily integrated into npm, but I'm finding it a little tricky to grasp.
Many of the streams don't seem to emit data events, and instead emit entry events.  These don't work with the normal streaming logic in node.js so I'm not sure how best to handle them.  At the moment all I need is something to filter an fstream-ignore but I'm not really sure what interface I need to implement.

+1


[sdk] ethereum Typing

Fix declare const ethereum typing (should the sdk be usable in a node-only env)

It is clearly usable in node-only env, I don't think we need this.


translate: Clarify the purpose and the effect of translation traits

Attempts to solve https://github.com/gtk-rs/glib/issues/586

Note: these traits can be used not only for "ref/unref" (Shared, Object in glib-rs term> types but for "copy/free" (Boxed) too

I don't know much about Boxed, but looking at how I wrote it, it seems it still applies to full copies. Should I still add a note?

At minimum all "unreferenced on drop()" IMHO need changed to "unreferenced or freed on drop()"

What about "properly released" instead of "freed" and "unreferenced"?

What about "properly released" instead of "freed" and "unreferenced"?

👍

I think I covered all:

a link to what floating references are (no special section though)
the purpose of this is to deal with ownership, not just Rust ownership
implementor's notes in each trait hint at acquiring refs
realized that gchar* and such were not covered, added notes

realized that gchar* and such were not covered, added notes

What do you mean with them not being covered? They are covered so that string/path conversion works correctly.

They were not covered as in, the docs didn't mention them outside of the example. So I listed them explicitly.

Actually this descriptions always use term "reference" while all trait works with refcounted (ref/unref) and "normal" (copy/drop) types int same way for getting its "value" from "pointer".
Not sure how to rephrase first line, but for me old text with ownership in term of
https://developer.gnome.org/programming-guidelines/stable/memory-management.html.en was better.

this descriptions always use term "reference" while all trait works with refcounted (ref/unref) and "normal" (copy/drop) types int same way for getting its "value" from "pointer".

Yes, "reference" is the most generic term because the actual values are behind references in both cases, i.e. the actual value is not directly accessible but only via the pointer.
I'm not sure how this relates to the link you posted.

@dcz-purism You can ignore my previous nagging, I just like "transfer ownership" more.
Thanks.

The travis build errors out on some network error.

Restarted the job.

Is anything missing here?

I don't have anything to add.

I don't have anything to add.

Ok, thanks :) I went through it another time. Please just write a comment here if the previous review comments are all addressed, I missed that last time and that's why I didn't go over it again earlier.

This should be closer to the ideal now.

Thanks!

Glad I could help, and thanks for taking the time to explain and review!


Enhancing troubleshoot section with Windows Operational Readiness

Adding  Windows operational Readiness instructions for troubleshooting and Windows cluster validation
refs #45130

/sig windows

Moving it as a subsection of get help and troubleshooting.

LGTM

@geetikabatra - was your LGTM on behalf of SIG Windows?

@sftim Yep

/approve

/lgtm


Changed Temp Texture Filter Mode to Bilinear in Unity 2022.1 and up

I changed the Filter Mode of the temp textures, as RenderingUtils.ReAllocateIfNeeded(...) sometimes defaults to Point Filtering when allocating a texture.
Kawase Blur relies on Bilinear Filtering as it makes use of the hardware interpolation unit of the GPU to do the bluring.

This is a welcome change. Thank you!


Question: Why did you decide to use Salt over Ansible?

Why did you decide to use Salt over Ansible or any other configuration management tool for that matter?
Hi Salvatore, do you remember me?

Not sure which matter you are talking about. The repository exists because no saltstack master helm existed before upstream. Closing ecause there is no much else to discuss and the question is not related to the content of the repo itself and not an issue about helm.


Match tag name with certain suffix

I'm trying to find <a:publication_date> and <b:publication_date> and more. How can I do all similar tags ending with publication_date?
This does not work:
sel.Find(".*publication_date").Each(...)

Hello,
It looks like you're trying to parse XML, not HTML? goquery works with HTML, not XML (you may want to use the stdlib's xml package or a third-party library for this).
Martin

@mna Yes, I'm parsing XML. The selector b\\:publication_date works in this case but I can't match a suffix with goquery. Is that supported?

No, goquery is an html parser, not an xml. It uses the golang.org/x/net/html parser internally, which follows the html5 parsing spec.


[zksecurity 05] Caller Is Not Fixed Throughout Function Execution

Motivation
We should ensure the self.signer is the same throughout a call graph in a single Execution.
I started out with a relatively easy fix: adding a signer commitment to each transition. To save space and simplify, I can also imagine:

removing signer from Transition and instead create a single Registers.signer and a single Execution.signer_commitment
perhaps we want to include the signer commitments as part of various challenges (just like we hash the transition commitment)

TODO: How should we hide the commitment?
As far as I can tell, all the secrets which we have access to are either:

unique per transition (e.g. transition secret key tsk)
global (sk_tag, view_key)
So we'll have to create a new execution-wide secret.

Test Plan
Requires resampling.
TODO:

consider adding a failing test which uses different signers

Other notes

We could hypothetically check if all signer commitments in a transaction are the same, but our tests use random keys which breaks this. And this doesn't leave open the door for multi-execute transactions.

Posting what I sent you in Slack with some updates on the commitment:
Caller not fixed in function execution:
First, we can add to the ‘request’ object a signer view key svk. The svk is included in the request signature.
I think the appropriate fix in CallTrait::execute  https://github.com/AleoHQ/snarkVM/blob/testnet3/synthesizer/process/src/stack/call/mod.rs#L125 would be to:

Load the signer address (signer) for the caller circuit from the registers, through registers.signer()
Retrieve the signer address (signer’) for the callee circuit from this request https://github.com/AleoHQ/snarkVM/blob/testnet3/synthesizer/process/src/stack/call/mod.rs#L261
Compute scm’ := HASH(signer’, svk’), where svk’ is obtained from the callee request.
Inject scm’ as a variable into the caller circuit in mode Public.
Retrieve svk from the caller request stored in the registers.
Add a constraint to the caller circuit that the injected variable in Step 4 equal HASH(svk, signer).
The verifier will check that the injected (public) value in Step 4 is the same for the caller and callee circuit.

Regarding the caller not being fixed in function execution flow, what are your thoughts about this? This pertains to obtaining the same randomness across the entire authorization.
On the user (delegator) side:

A randomizer is generated when the root request is constructed, which would occur in Stack.authorize before this line https://github.com/AleoHQ/snarkVM/blob/testnet3/synthesizer/process/src/stack/authorize.rs#L38
Each authorization sent to the third-party prover is now a tuple:
(Authorized requests, randomizer, signature on randomizer that authenticates to pk of user)**

**I think it actually may be necessary to sign (tx id, randomizer).
On the third-party prover side:

When the prover is executing the authorization in Stack.execute_function, if we are in the context of the root request which can be checked via the is_root flag, we will add a constraint that authenticates the signature of the randomizer to the user pk.
In every transition circuit, we can expose the signer commitment, ’scm’, as a public input and constrain that scm := Commit(randomizer, signer).
The verifier will check each scm is the same across all transitions in the execution.

How does the user actually compute the randomizer?
One option is compute a ‘signer view key’. First compute ssk := HASH(sk_sig, nonce) and then ‘svk’ := (signer^ssk).to_x_coordinate().


What is the relationship between steps and image2image strength?

I see some dynamic between the 2 but Im not clear on how one affects the other. The steps I define vary in execution and I see a relationship with --init-image-strength.  Insights welcome.

this is a really good question, and one that I explained in the code review comment here: https://github.com/filipstrand/mflux/pull/77#issuecomment-2408848975
this comes down to terminology: in my implementation of img2img in mflux, the arg name I used was --init-image-strength, and the implementation is interpreted as "how strong the initial image influences the outcome", so the "init image strength" arg is named, higher value -> resembles reference image, lower value -> diverges farther from reference image. I think this is intuitive for most people to think about.
    @property
    def init_time_step(self) -> int:
        if self.config.init_image_path is None:
            # text to image, always begin at time step 0
            return 0
        else:
            # we skip to the time step as informed by the init_image_strength
            # the higher the strength number, the more time steps we skip
            strength = max(0.0, min(1.0, self.config.init_image_strength))
            # if the strength is too small to even influence the image
            # help the user round up so the init_image has influence at step 1
            t = max(1, int(self.num_inference_steps * strength))
            return t

in StableDiffusion implementation commonly found elsewhere, a common term is called "denoise" strength, and in the diffusers pipeline_flux_img2img.py implementation is this:
    def get_timesteps(self, num_inference_steps, strength, device):
        # get the original timestep using init_timestep
        init_timestep = min(num_inference_steps * strength, num_inference_steps)

        t_start = int(max(num_inference_steps - init_timestep, 0))
        timesteps = self.scheduler.timesteps[t_start * self.scheduler.order :]
        if hasattr(self.scheduler, "set_begin_index"):
            self.scheduler.set_begin_index(t_start * self.scheduler.order)

        return timesteps, num_inference_steps - t_start

where their "denoise strength" arg is described as
            strength (`float`, *optional*, defaults to 1.0):
                Indicates extent to transform the reference `image`. Must be between 0 and 1. `image` is used as a
                starting point and more noise is added the higher the `strength`. The number of denoising steps depends
                on the amount of noise initially added. When `strength` is 1, added noise is maximum and the denoising
                process runs for the full number of iterations specified in `num_inference_steps`. A value of 1
                essentially ignores `image`.

^ if you name the strength as a "denoise" value, it's interpreted opposite of --init-image-strength in mflux 0.4.0 release

@filipstrand @Xuzzo I realized that during my implementation I diverged away from @Xuzzo's attempt in https://github.com/filipstrand/mflux/pull/16/files#diff-dc9005328f1b43fe9c39cc56aba83a0927bfef1bd27a78e60707b626312588f9R54 where @Xuzzo pads additional inference steps
       self.strength = strength
         if strength <= 0.0 or strength >= 1.0:
             raise ValueError("Strength should be a float between 0 and 1.")

         self.num_total_denoising_steps = int(self.num_inference_steps / (1-strength))
         self.init_timestep = int(self.num_total_denoising_steps - self.num_inference_steps)
         self.inference_steps = list(range(self.num_total_denoising_steps))[self.init_timestep:]

Between the upstream diffusers/stablediffusion implementation and the two attempts here in mflux. I'm not sure which one is best, but maybe we can offer users various ways of specifying the values via mutually exclusive args:

--init-image-strength - keep implementation as is, let users choose steps, no additional step padding logic
--denoise-strength - implement like upstream diffusers, but I feel this arg name is unintuitive and "exposes algorithmic details" to the user to consider.

but why do steps vary from the implicitly stated number?  If OI am doing img2img, and I say for instances --step 30 and mflux only uses 8 steps, why is that?

but why do steps vary from the implicitly stated number?  If OI am doing img2img, and I say for instances --step 30 and mflux only uses 8 steps, why is that?

The strength fast forwards your generation to the proportion as calculated via (steps * strength). So if you have strength 0.5 and 30 steps you'd only see 15 gen steps, because the first 15 steps (0.5) was filled in with noisy latent of your init image.

this is a really good question, and one that I explained in the code review comment here: #77 (comment)
this comes down to terminology: in my implementation of img2img in mflux, the arg name I used was --init-image-strength, and the implementation is interpreted as "how strong the initial image influences the outcome", so the way "init image strength" arg is named, higher value -> resembles reference image, lower value -> diverges farther from reference image. I think this is intuitive for most people to think about.
    @property
    def init_time_step(self) -> int:
        if self.config.init_image_path is None:
            # text to image, always begin at time step 0
            return 0
        else:
            # we skip to the time step as informed by the init_image_strength
            # the higher the strength number, the more time steps we skip
            strength = max(0.0, min(1.0, self.config.init_image_strength))
            # if the strength is too small to even influence the image
            # help the user round up so the init_image has influence at step 1
            t = max(1, int(self.num_inference_steps * strength))
            return t

in StableDiffusion implementation commonly found elsewhere, a common term is called "denoise" strength, and in the diffusers pipeline_flux_img2img.py implementation is this:
    def get_timesteps(self, num_inference_steps, strength, device):
        # get the original timestep using init_timestep
        init_timestep = min(num_inference_steps * strength, num_inference_steps)

        t_start = int(max(num_inference_steps - init_timestep, 0))
        timesteps = self.scheduler.timesteps[t_start * self.scheduler.order :]
        if hasattr(self.scheduler, "set_begin_index"):
            self.scheduler.set_begin_index(t_start * self.scheduler.order)

        return timesteps, num_inference_steps - t_start

where their "denoise strength" arg is described as
            strength (`float`, *optional*, defaults to 1.0):
                Indicates extent to transform the reference `image`. Must be between 0 and 1. `image` is used as a
                starting point and more noise is added the higher the `strength`. The number of denoising steps depends
                on the amount of noise initially added. When `strength` is 1, added noise is maximum and the denoising
                process runs for the full number of iterations specified in `num_inference_steps`. A value of 1
                essentially ignores `image`.

^ if you name the strength as a "denoise" value, it's interpreted opposite of --init-image-strength in mflux 0.4.0 release
@filipstrand @Xuzzo I realized that during my implementation I diverged away from @Xuzzo's attempt in https://github.com/filipstrand/mflux/pull/16/files#diff-dc9005328f1b43fe9c39cc56aba83a0927bfef1bd27a78e60707b626312588f9R54 where @Xuzzo pads additional inference steps
       self.strength = strength
         if strength <= 0.0 or strength >= 1.0:
             raise ValueError("Strength should be a float between 0 and 1.")

         self.num_total_denoising_steps = int(self.num_inference_steps / (1-strength))
         self.init_timestep = int(self.num_total_denoising_steps - self.num_inference_steps)
         self.inference_steps = list(range(self.num_total_denoising_steps))[self.init_timestep:]

Between the upstream diffusers/stablediffusion implementation and the two attempts here in mflux. I'm not sure which one is best, but maybe we can offer users various ways of specifying the values via mutually exclusive args:

--init-image-strength - keep implementation as is, let users choose steps, no additional step padding logic
--denoise-strength - implement like upstream diffusers, but I feel this arg name is unintuitive and "exposes algorithmic details" to the user to consider.

I tried the current strength control using the terminal, and it looks very streamlined and efficient due to the reduced steps. There's also another possibility that denoise might better align with the habits of older users. If a dual option could be offered, that would be fantastic

@raysers that's right, if users want more steps just manually up the step count. For example: 40 steps with strength 0.25 will give you the 30 denoise iterations

My usecase is that I set up a shell script that takes my prompt as a variable and runs it through schnell 2 step and then dev with image strength of .4 and 30 additional steps.  the variables are in the shell script and not passed.  all ofther parameters I prefer are in there as well.   The result is a schnell image refined by Dev giving me the quality that I want with some of the character of schnell dictating the composition Dev uses.  The explanations above have been helpful.  TYVM


SSR buffer does not handle HDR

Currently reflections are not using full HDR range. I'm opening this issue as a reminder to look into the possibility of implementing HDR reflections.

Hello I just added HDR support into a separate branch and made a Pull Request. I'm not sure if this project is still being supported but I thought I would just add it in myself for now.

Thanks for this, reflections look a lot better in HDR mode now!
I've merged along with a minor edit to automatically use HDR if it is enabled on the camera rather than using a separate property on the SSR script.


Search tweak: Load smaller images in StoriesGrid

https://wellcome.slack.com/archives/C3TQSF63C/p1673428828984719?thread_ts=1673354994.931719&cid=C3TQSF63C
Currently loading full sized images, which is unnecessary. See what's being done elsewhere, we have different sized images available to us.

Will do as part of #9059


refactor: move MockWallet to test_utils, closes #1111

Moves MockWallet from aries_vcx_core to test_utils.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (b837fcb) 0.05% compared to head (d4ad04b) 0.05%.

:exclamation: Current head d4ad04b differs from pull request most recent head 876e40e. Consider uploading reports for the commit 876e40e to get more accurate results

Additional details and impacted files
@@          Coverage Diff          @@
##            main   #1114   +/-   ##
=====================================
  Coverage   0.05%   0.05%
=====================================
  Files        479     479
  Lines      24338   24338
  Branches    4367    4367
=====================================
  Hits          13      13
  Misses     24324   24324
  Partials       1       1

Flag
Coverage Δ

unittests-aries-vcx
0.05% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

If an PR closes an issue, no need to clutter the description, [let's link it manually instead] (if you agree).(https://docs.github.com/en/issues/tracking-your-work-with-issues/linking-a-pull-request-to-an-issue#manually-linking-a-pull-request-to-an-issue-using-the-pull-request-sidebar)


IBM Cloud Operator v0.1.6 merged but not yet in OperatorHub

We submitted PRs for updates to the IBM Cloud Operator (v0.1.6) and they were merged a few days ago (PRs 1398 and 1399). However, the OperatorHub.io catalog still shows the old version.
We have users that are waiting on the new version. Any chance to expedite the process?
TIA!

Sorry, we had some issues with the release pipeline of the website. It's now fixed and 0.1.6 is shown.

Great, thanks @dmesser !


npm install -g ionic throws "unexpected eof" on Ubuntu 14.4

Hi,
I am getting following issue on Ubuntu. Cleaning tmp file or clearing cache does not work , same result. Please help.
npm verb fstream_stack Extract.Reader.resume (/usr/lib/node_modules/npm/node_modules/fstream/lib/reader.js:249:34)
npm verb fstream_stack Entry.<anonymous> (/usr/lib/node_modules/npm/node_modules/tar/lib/parse.js:261:8)
npm verb cwd /tmp
npm ERR! Linux 3.19.0-30-generic
npm ERR! argv "/usr/bin/nodejs" "/usr/bin/npm" "install" "-g" "ionic" "--verbose"
npm ERR! node v4.1.2
npm ERR! npm  v2.14.4

npm ERR! unexpected eof
npm ERR!
npm ERR! If you need help, you may report this error at:
npm ERR!     <https://github.com/npm/npm/issues>
npm verb exit [ 1, true ]

i am seeing the same error on windows 8.1 please help someone...i have tried 32/64 bit versions of nodejs. i have tried changing registry url as well.. no luck...

Hello all!  Thanks!

Hello all! As it seems it has been a while since there was any activity on this issue i will be closing it for now. Feel free to comment if you are still running into this issue. Thanks for using Ionic!


Can not run check_compliance.py from zephyr

I started docker container with the following command:
docker run -it nordicplayground/nrfconnect-sdk:main /bin/bash
next, inside the container, I created a shell script that only runs the zephyr/scripts/ci/check_compliance.py.
I run this script with the following command
nrfutil toolchain-manager launch bash -- tests.sh
This resulted with an error
ImportError: libffi.so.7: cannot open shared object file: No such file or directory
It seems like there are missing dependencies in the latest solution

That's beyond the scope of this repo and I think this should be done using the official Zephyr images, because there is nothing NCS specific needed.
Also we do not document that in the end-user documentation in our docs, and it's not covered by any test in this repo.


Blog app - integration specs for views and fix n+1 problems

In This pull request I :

[x] Solved The n+1 problems when fetching all posts and their comments for a user.
[x] Used Capybara to write integration tests for each view.
[x] Tested the views : User index page,user show page,User post index page,Post show page.

PS : it's a pair programming activity but my partner never show up that's why i worked solo

Hi @gsmalik030,
While you made a great effort in this project, unfortunately, I cannot proceed to review your code.
Invalid Code Review Request
You have submitted a project, that is invalid because, you worked on the project alone whilst it should have been a pair programming activity. NB: You will have to wait for student success to give you the go ahead before any code reviewer can review it as solo. Also, once you are approved by student success, kindly take a screenshot of the email you receive and attach it to the PR for verification
Your Code Review Request will be marked as invalid in your Dashboard, so please submit a new one once you are ready 🙏
Cheers and Happy coding!👏👏👏
Feel free to leave any questions or comments in the PR thread if something is not 100% clear.
Please, remember to tag me in your question so I can receive the notification.
Please, do not open a new Pull Request for re-reviews. You should use the same Pull Request submitted for the first review, either valid or invalid unless it is requested otherwise.

Invalid Code Review Request does not count into the code reviews limit.


2 syntax errors

Python requires True and False to be as capitalised.
rogue space on line 153 throws an indentation error.

@target-drone
Thanks for the pull request, the rogue space was identified as the cause of issue #294 and fixed in both my 2.5.1 and 2.6.0 branches with this commit https://github.com/Romeo-Golf/adsb-receiver/commit/8e63f0ec53cb14baf09821e11ab713508eac2f32
Good spot on the true statement, im not very familiar with Python but would this also apply to the three other occurrences of the string 'true' in this file?
$ grep "true" build/portal/python/maintenance.py
while true:
    if purge_aircraft == true:
    if purge_flights == true:
    if purge_positions == true:

Regards.

Sorry for the delay.
Python's not my language either but all the examples I've seen are capitalised.
cheers


Fixed incremental eds for endpoints without pods

Please provide a description for what this PR is for.
FYI: {Services without selector](https://kubernetes.io/docs/concepts/services-networking/service/#services-without-selectors)
For services without selector, which may mean the endpoint is created by hand and has no associated pod. In this case, the incremental eds breaks.
And to help us figure out who should review this PR, please
put an X in all the areas that this PR affects.
[ ] Configuration Infrastructure
[ ] Docs
[ ] Installation
[x] Networking
[ ] Performance and Scalability
[ ] Policies and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure

@hzxuzhonghu: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

integ-new-install-k8s-presubmit-tests-master
08ba23eb7b2a5d5a97805437f9873a589b23a7af
link
/test integ-new-install-k8s-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@hzxuzhonghu: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

integ-new-install-k8s-presubmit-tests-master
08ba23eb7b2a5d5a97805437f9873a589b23a7af
link
/test integ-new-install-k8s-presubmit-tests-master

integ-mixer-k8s-presubmit-tests-master
08ba23eb7b2a5d5a97805437f9873a589b23a7af
link
/test integ-mixer-k8s-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

what is the problem? if j create a service with no pod, then later an instance comes up it is never sent?
Would this also affect scale from 0 to 1 replicas? knative for example

Later added an address in endpoint subset.  The incremental eds would not trigger.

For example, just add another address <IP_ADDRESS>, the eds will not update until other events trigger a full xds push.
apiVersion: v1
kind: Endpoints
metadata:
  name: my-service
subsets:
  - addresses:
      - ip: <IP_ADDRESS>
    ports:
      - port: 9376

/cherrypick release-1.3

@rshriram: new pull request created: #16696

In response to this:

/cherrypick release-1.3

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.


Added in a routine to pull out the directory of the file being opened…

… based on the currently selected view. This is more in line with other editors (kate, gedit, etc..); saves you time from having to type for related files.
Please reject the request if these kind of default behavioural changes aren't desired; I can probably write this in as a plugin if it shouldn't be part of the core.

Thank you for the contribution, it was a long time I wanted to this. It was also a suggestion of @budRich.
I just made a few comments about the implementation, may be we can make the code a little bit more compact.

Should be all fixed up now.

I apologize I told you something misleading, the "suggest" argument it is not what we want to use.
What about restoring you initial version that inject the name of the current file in the command view ?

OK, thank you for the pointers! I've implemented your suggestions and reverted the code back to using set_text. Let me know how that looks!

Now the code is fine, thank you for the modifications.
I tested locally and it works fine but I realized something. It currently shows only the relative filename, relative to the project directory. Now, when you want to open a file from the project you don't normally use "open file" but the command "find file" instead. The command "open file" needs to be used only when:

the file is outside of the project
the file is within the project but ignored (using config.ignore_files)

Your implementation does not cover (1) because you have only the relative filename.
I think that in our function we should not use self.doc.filename but self.doc.abs_filename to ease the opening of any file, even outside of the project.

So, this was actually my primary reason for making this; I was editing files outside the project.
On my computer, for some reason, it does work; (I get the whole path). I'm more than happy to put abs_filename, but as it stands, the code does work as expected on my machine for files outside the project, and putting abs_filename does tend to lead to longer paths inside the project.
Did you test the implementation on a file outside the project, and see the same behaviour? Or was the behaviour different than what I'm experiencing?

OK. I see what's going on here. I tend to enter absolute paths when working outside the project; so self.doc.filename is always an absolute path for me.
So what I'll do is, I'll check if it's a file inside the project, vs. outside the project. If inside, I'll use a relative path, if outside, I'll use an absolute one.

So what I'll do is, I'll check if it's a file inside the project, vs. outside the project. If inside, I'll use a relative path, if outside, I'll use an absolute one.

Good idea! I would have used an absolute path anyway but your idea make sense so I am okay with that.
Just one thing, I will check myself that if you open a file from the project but using the absolute path, the self.doc.filename has to be transformed into a relative one. In other terms, doesn't matter how do you open a project file, the self.doc.filename should always be a relative path. I will double-check this and correct if needed.

So I've just added in a check to handle the case where a relative path is used to escape the project (i.e. contains ..), and to use the absolute_path in these cases. This should cover 99.9% of cases. I can't think of how you'd reference a path outside the project, unless you do try and go up a directory. Does that work?
Regarding absolute paths to relative ones, it does not seem to be doing this on my machine; if I open a file with its absolute path inside the proejct self.doc.filename will remain the absolute path.

So I've just added in a check to handle the case where a relative path is used to escape the project (i.e. contains ..), and to use the absolute_path in these cases. This should cover 99.9% of cases. I can't think of how you'd reference a path outside the project, unless you do try and go up a directory. Does that work?

Well, you can go up a directory or give the absolute path, both will work. What I forgot and I will add is to normalize the
filename using the function "realpath".

Regarding absolute paths to relative ones, it does not seem to be doing this on my machine; if I open a file with its absolute path inside the proejct self.doc.filename will remain the absolute path.

So I need to correct this!
Thank you for the contribution, I merged the PR.


MRDesignLabs_Unity is built for Unity 5.6.1 but HoloToolkit and official support for HoloLens is only 5.5.0

The official HoloLens requirements page says to install Unity 5.5.0f1 (https://developer.microsoft.com/en-us/windows/mixed-reality/install_the_tools) but MRDesignLabs_Unity only works with Unity 5.6.1.
While it works in the editor in Unity 5.6.1, building into a UWP fails with Assets\MRDesignLab\HUX\Scripts\Buttons\ButtonIconProfileTexture.cs(8,2): error CS1032: Cannot define/undefine preprocessor symbols after first token in file
Either HoloToolkit and the official recommended Unity Editor for HoloLens should be updated to Unity 5.6.x or MRDesignLabs_Unity should be downgraded to Unity 5.5.x

That is old data on the developer site you should always reference what's on the GitHub ReadMe.md on the HoloToolkit or MRDesignLabs front page for what's recommended from the unity editor standpoint.  We will always try to maintain MRDesignLabs to be compatible with the latest Unity editor.  I'll take a look at the ifdef and resolve the bug you're seeing.
thanks,
-pat

Gotcha... I missed reading the ReadMe on the HoloToolkit page... apologies for that...
Do I need to use Unity 5.6.1 with VS2017 or should it work with VS2015?
Also, I tried building for 14393 and the 10586 SDKs and both hit that same issue.
When I look at the file, it does seem to be right before the namespace so not sure why that error gets thrown...

Should be fixed now.  I got into a local state where I had to restart to nuke my temp and library directories.  The conditional defines should just wrap the individual call but the main problem was that System.Reflection was not defined aka no "using System.Reflections". Also fixed an issue with double inheritance on an abstract protected function.  Should be all good.

Yay!
FYI, you might want to fix the same files in the DesignLabs_Unity_Examples project as well...


Add export for useResource

useResource is in the documentation but is not exported from the latest version.

Good catch, thanks!


[WFLY-19116]: Experimental - Provide a cool boot banner.

Add support for a cool ASCII art banner via a banner.txt.

Jira: https://issues.redhat.com/browse/WFLY-19116
https://issues.redhat.com/browse/WFCORE-4917
It requires https://github.com/wildfly/wildfly-core/pull/5821

@bstansberry I hope to have addressed all your concerns :)


[pulsar-function] fix worker-stats broken admin-api

Motivation
Start broker and function-worker in separate process. function-worker is not serving worker-stats resources which gives 404 http-response.
./pulsar-admin  --admin-url http://localhost:6750/ functions-worker  function-stats
HTTP 404 Not Found

Reason: HTTP 404 Not Found

run cpp tests


Unable to upload the file to S3 bucket

Unable to upload the file to S3 bucket
Expected Behavior
Need to upload the file.
stacktrace.txt
Current Behavior
Unable to upload the file
Possible Solution
should be able to upload the file
Steps to Reproduce (for bugs)
Run the attached project and click upload
Issue occurs randomly
Context
Because of this, I'm unable to upload the file
Your Environment

Xamarin
AWSSDK.Core version used:
*AWSSDK.CognitoIdentity----><IP_ADDRESS>
*AWSSDK.S3---->  <IP_ADDRESS>
Service assembly and version used:
Operating System and version: windows 10
Visual Studio version:15.9.6
Targeted .NET platform:
Run in Xamarin Forms Android

I'm closing this out due to inactivity.  If you are still having issues, please try seeing some of our documentation and samples.  If that still doesn't work, feel free to reopen.

Hi @klaytaybai
IAmazonS3 s3Client;
s3Client = new AmazonS3Client(creds, RegionEndpoint.USWest1);
s3Client.UploadObjectFromFilePathAsync(bucketName, uploadFileName, filePathName, null);
Right now I'm not getting any exception after removing the async and await but file upload is not done. Your help will get improvement for my task so please advise.
but download is working fine
s3Client.DownloadToFilePathAsync(bucketName, downloadFileName, filePathName, null);

im also having the same problem. Do you found the fix?

Hi @klaytaybai
IAmazonS3 s3Client;
s3Client = new AmazonS3Client(creds, RegionEndpoint.USWest1);
s3Client.UploadObjectFromFilePathAsync(bucketName, uploadFileName, filePathName, null);
Right now I'm not getting any exception after removing the async and await but file upload is not done. Your help will get improvement for my task so please advise.
but download is working fine
s3Client.DownloadToFilePathAsync(bucketName, downloadFileName, filePathName, null);

im also having the same problem. Do you found the fix?


Navigation entry for analysis page

This PR adds the analysis page to the navigation.

@MikeMcC399  Your're right, it should by Analysis

@FabioFuschi-SNK can you please provide an update PR?

@FabioFuschi-SNK Maybe you'd also like to take my review from here into account? 🙂


Remove Berkeley DB from Operating System Images

Berkely DB comes with a problematic open source license and must be removed prior to the image being deployed.
There are apparently several places where it is being used (more detailed needed):
pam
apt

Resolved, latest image does not contain Berkeley DB anymore

Great @marwinski :-)

kudos go to @gehoern  :-)

Current images do not contain BerkleyDB. Tested with 576.12 and 862.0.


add local env setup shell for higress

Ⅰ. Describe what this PR did
add local-env-setup.sh for quick setup for higress.
./local-env-setup.sh --help
The higress local environment setup
Usage: local-env-setup.sh <[Options]>
Options:
-h   --help   help for setup
-c   --crd    setup istio CRD
Ⅱ. Does this pull request fix one issue?

Ⅲ. Why don't you add test cases (unit test/integration test)?
Ⅳ. Describe how to verify it
Ⅴ. Special notes for reviews

As we discussed before, scripts for more OSes need to be provided


Accept custom logger object

The runtime validation of the options schema in v5 doesn't seem to like custom logger objects. I believe these are still intended to work, since they're accepted by the TypeScript interface and are invoked correctly.
This PR updates the schema to accept logger objects and adds a test case. Apologies for not opening an issue in advance! Since it was a small change I figured it was quick enough to pull this together all at once. :)

Not sure why CI failed, looks like an unrelated timeout? Tests passed on my machine. :( If there's something I can do to debug, let me know!

The e2e tests are not 100% deterministic. Sometimes it's a problem on the GitHub Actions (especially for MacOS), sometimes it's a race condition. I think we will never have deterministic e2e tests, but we should improve stability because currently, e2e tests fail very often.

Ah, that makes sense. Thanks!

:tada: This PR is included in version 5.0.7 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


delete_user returns 404 for existing users

When attempting to delete a user through the integration API (haven't tested on prod), the API returns 404 for existing users.
Here's the script I'm using:
import mx_platform_python as mx
from mx_platform_python.api import mx_platform_api

# set the config
config = mx.Configuration(
    username = '<secret>',
    password = '<secret>',
    host = 'https://int-api.mx.com'
)

# get all the users then delete the first one
with mx.ApiClient(config) as client:
    api = mx_platform_api.MxPlatformApi(client)
    users = api.list_users()
    first = users.get('users')[0].get('guid')

    # an attempt to delete the first user will return 404 Not Found
    api.delete_user(user_guid=first)

Exception:
NotFoundException: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Server': 'nginx', 'Date': 'Wed, 02 Feb 2022 16:54:14 GMT', 'Content-Type': 'text/html; charset=UTF-8', 'Content-Length': '0', 'Connection': 'keep-alive', 'X-Request-Id': '4887d0a1e573c3323e8e808318c7232e', 'X-Runtime': '0.007438'})

I'm able to list and delete the first user via the postman collection consistently, so it seems like the API is working correctly, just not the client.  Please let me know if you need any further info.  Thanks!

Hi @peter-stratton 👋
Thanks for reaching out about this issue. Our api requires an Accept header to be included on every request or else it will fail. In this case, a 404 was returned which isn't straightforward.
This OpenAPI generated library includes that Accept header on every request, except endpoints that return a 204 response. (like the delete user endpoint here)
This library requires the Accept header to be set manually as params on the ApiClient, which we had missed documenting. So a working version of your script looks like this:
import mx_platform_python as mx
from mx_platform_python.api import mx_platform_api

# set the config
config = mx.Configuration(
    username = '<secret>',
    password = '<secret>',
    host = 'https://int-api.mx.com'
)

# get all the users then delete the first one
with mx.ApiClient(config, "Accept", "application/vnd.mx.api.v1+json") as client:
    api = mx_platform_api.MxPlatformApi(client)
    users = api.list_users()
    first = users.get('users')[0].get('guid')

    # an attempt to delete the first user will return 404 Not Found
    api.delete_user(user_guid=first)

Sorry for the trouble here and thanks again for reaching out. I've got a PR here adding that to our README example and will be updating our examples on https://docs.mx.com/api shortly.
We appreciate your help in reporting this issue and helping us improve 👍


Update Ubuntu to 20.04 LTS

Changes:

updated Ubuntu to 20.04 LTS
increased DH size from 1024 to 2048 (for resolving issue OpenSSL: error:1408518A:SSL routines:ssl3_ctx_ctrl:dh key too small)

:100:  thanks!


Add quotes around namespace in yq command README

Description of changes:
For yq command to work " " are needed around namespace otherwise there will be a lexical error.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

/approve
/lgtm

/test sagemaker-kind-e2e


How to record color camera/microphone stream as MP4 file(H264/AAC encoding)?

I'm developing a WPF app that do body tracking while recording MP4. Please give me some technical hints.

I've solved it using Windows Media Foundation(MF). There's an open source .NET wrapper for MF .


[az provider list] Change: az provider list --query: add double quotes

az provider list --query "[?namespace=='Microsoft.Network'].resourceTypes[].resourceType" instead of az provider list --query [?namespace=='Microsoft.Network'].resourceTypes[].resourceType which results in [ ] results
Related command

Description

Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change
[Component Name 2] az command b: Add some customer-facing feature

This checklist is used to make sure that common guidelines for a pull request are followed.

[x] The PR title and description has followed the guideline in Submitting Pull Requests.

[x] I adhere to the Command Guidelines.

[x] I adhere to the Error Handling Guidelines.

ARM


docker-compose with prometheus & grafana

Create a docker-compose to quickly set up prometheus demo with a default grafana dashboard

Hey @MattKetmo,
I created a cosmos-watcher-stack to simplify the deployment and management of watcher instances using docker compose, along with default grafana dashboard.
Let me know what you think and if we can include a reference to it in the main repository :)
Thank you.

Hey @hexmark21 thanks very much for this contribution 👍
Sure, I can add a section in the README to mention your repo. I'll do next week.
Or we can copy the resources directly in this repo ? As you prefer.

Thanks @MattKetmo, I appreciate it.
I think it would be better to link to my repo, as it keeps things more maintainable and allows me to update the resources independently.


Nominal values in MSL Rotational examples

Reported by christian.andersson on 22 Aug 2014 09:45 UTC
A few example models in the Mechanics.Rotational library are missing nominal values making them quite difficult to simulate as the chosen states (by most tools) are very small.
I would propose to add appropriate nominal values for those variables that have fixed=true and a start value. The affected models and changes would then be:
For LossyGearDemo1 add nominals for Inertia2.phi (0.001) and Inertia2.w (0.01)
For LossyGearDemo2 add nominals for Inertia2.phi (1e-4) and Inertia2.w (0.001)
Comments?

Migrated-From: https://trac.modelica.org/Modelica/ticket/1557

Modified by beutlich on 22 Aug 2014 11:50 UTC

Comment by jmattsson on 11 Dec 2014 13:27 UTC
This is also true for the model ElasticBearing where the variable springDamper.w_rel should have the nominal 1e-4.

Comment by jmattsson on 11 Dec 2014 13:32 UTC
a79e6a1659329b64921247e1bdde9b296c0699e9
Added nominal value for problematic variable in ElasticBearing example.
(Tested in Dymola, OpenModelica and JModelica.org.)

Comment by beutlich on 11 Dec 2014 19:30 UTC
Let's set milestone to MSL 3.2.2 where a79e6a1659329b64921247e1bdde9b296c0699e9 went.
Jesper, can you fix and check LossyGearDemo1 and LossyGearDemo2, too?

Comment by otter on 12 Dec 2014 10:11 UTC
It is fine to add nominal values, but I wonder whether this is in general the right approach:
Typically, step-size control on a state variable is switched off if the variable value becomes smaller as the absolute tolerance defined for this variable. In the Modelica specification it is stated (section 4.8.7):
The attribute nominal gives the nominal value for the variable. The user need not set it even though the standard does not define a default value. [The nominal value can be used by an analysis tool to determine appropriate tolerances or epsilons, or may be used for scaling. For example, the absolute tolerance for an integrator could be computed as “absTol=abs(nominal)*relTol/100”. ...]
With the default tolerance of 1e-4 and the default nominal value of 1, the absolute tolerance is 1e-6 (according to the recommendation of the Modelica Specification). For all the examples mentioned in this ticket, this tolerance should be still sufficient for a proper step size control. If this is not the case, vendors should consider to change the default setting of the absolute tolerance according to the recommendation of the Modelica specification (or explain, why this recommendation is not sufficient or not good).
What vendors could additionally provide is a debug option to detect critical cases (a user cannot do this, because a user does not know the strategy how a tool computes the absolute tolerance): Once this debug option is set, a tool could compare all state variables of the simulation run with the used absolute tolerance. If a state variable x is permanently too small with respect to the absolute tolerance (say |x(t)| < absTol*10), then a warning message is printed.

Comment by jmattsson on 12 Dec 2014 10:40 UTC
Replying to [comment:5 otter]:

(according to the recommendation of the Modelica Specification).

I really can't agree that the non-normative text "For example, the absolute tolerance for an integrator could be computed as" constitutes a recommendation.
Replying to [comment:5 otter]:

What vendors could additionally provide is a debug option to detect critical cases

Certainly, but these are not user models, they are examples in the MSL. I think it is probably in the best interest of all of us that the MSL examples are robust models.

Comment by otter on 12 Dec 2014 13:38 UTC

Replying to [comment:5 otter]:

What vendors could additionally provide is a debug option to detect critical cases
Certainly, but these are not user models, they are examples in the MSL. I think it is probably in the best interest of all of us that the MSL examples are robust models.

I do not think it is possible to arrive at a robust solution, because from a library point of view one has to make assumptions for the tools and if these (implicit) assumptions are not fulfilled, it is highly likely that simulations will fail. Implicit assumptions on a tool: (a) appropriate numerical, variable step solvers for the differential and the algebraic equations, (b) appropriate numerical algorithms for initialization,(c) appropriate definition  of relative tolerances for the numerical solvers, (d) appropriate default values for relative tolerances, (e) appropriate absolute tolerances, and probably more.
One goal is that the MSL runs satisfactorily in all the Modelica tools, and one just has to be pragmatic. If for some examples, the simulation in some tools is not satisfactory, and it is possible to fix this with a change in the MSL, then this should be just done (such as adding nominal values).
However, this does not mean that nominal values should be excessively added (in the end this would mean that for all > 500 example models, one has to set StateSelect.always for ALL states, and set appropriate nominals values for ALL states; this is just not practical, and is also not a good template for an end-user, how he/she should use Modelica). On the other hand, tool vendors should see the MSL examples also as benchmarks to tune the default settings of their tools, in order that these examples simulate satisfactorily with not much special settings.

Comment by jmattsson on 19 Oct 2015 13:34 UTC
c785bb4146d9648f2ceec80530a97652425b58e5
Merged a79e6a1659329b64921247e1bdde9b296c0699e9 to maintenance branch for 3.2.1.

Comment by otter on 13 Dec 2015 07:57 UTC
Fixed in 92f881d88eb800ddb53615f0492950ed2fdd1855 by adding nominal values as suggested.

Changelog modified by otter on 13 Dec 2015 07:57 UTC
Added nominal values to small state variables in Rotational examples ( LossyGearDemo1/2)

Modified by beutlich on 13 Dec 2015 08:21 UTC

Changelog modified by beutlich on 13 Dec 2015 08:21 UTC
Added nominal values to small state variables in Rotational examples (LossyGearDemo1/2)


goerli-dev-0: Set ecotone activation time

Description
unix time:<PHONE_NUMBER>
Wed Jan 24 20:00:00 UTC 2024
Tests
n/a
Additional context
devnet activation tomorrow
Metadata

Fixes https://github.com/ethereum-optimism/protocol-quest/issues/104

@protolambda and @roberto-bayardo confirmed the time


mismatch Action Name of the intent "tell_latest_tip"

The Action Name Intent:tell_latest_tip is different between index.js and DialogFlow.
Beacause of this, I can't try the sample project and needed to modify Action:tell_latest_tip of DialogFlow Project to tell.latest.tip.
Please check this 🙏

index.js (https://github.com/actions-on-google/dialogflow-updates-nodejs/blob/master/functions/index.js#L28)

tell.latest.tip

DialogFlow (https://github.com/actions-on-google/dialogflow-updates-nodejs/blob/master/AoG-Tips.zip)

tell_latest_tip

tell_latest_tip.json from unziped AoG-Tips.zip
{
  "id": "90926160-1418-410b-81a8-3a2f481c9f9f",
  "name": "tell_latest_tip",
  "auto": true,
  "contexts": [],
  "responses": [
    {
      "resetContexts": false,
      "action": "tell_latest_tip",   <----- Here
      "affectedContexts": [],
      "parameters": [],
      "messages": [
        {
          "type": 0,
          "lang": "en",
          "speech": []
        }
      ],
      "defaultResponsePlatforms": {},
      "speech": []
    }
  ],
  "priority": 500000,
  "webhookUsed": true,
  "webhookForSlotFilling": false,
  "lastUpdate":<PHONE_NUMBER>,
  "fallbackIntent": false,
  "events": []
}

+1

The .zip file included in the sample has been updated with the correct action name.

Thanks！ +1


Initial markdown clean-up

No technical content was changed or added

Create LICENSE file instead of linking to external license
Mlint formatting changes
Added default READMEs for each directory
Changed image links from hard coded to relative
Removed whitespace from tutorial markdown filenames

The Sagemaker tutorial isn't complete. Do we want to remove it from this version until it's completed? I think it would cause more confusion to have a half-finished tutorial in it.

I'm okay with removing the sagemaker tutorial. We can refer to the branch history to use a starting point in the future

Would you mind making that change and then incorporating it into the PR? I'm in a meeting until 5.

I removed the sagemaker tutorial markdown file and the reference to it in the root README


Fix winmain--the-application-entry-point.md

Add calling convention to example

@mcdurdin : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off


Add SIMD support for ESP32S3

This passage was generated by chatGPT

ESP32-S3 is a high-performance, low-power microcontroller that supports SSE (SIMD) instruction set, which can complete multiple operations in one instruction, improving code efficiency and running speed.  Here is a sample code using SIMD instructions on ESP32-S3:
#include "xtensa/hal.h"
#include "esp_simd.h"
#include <stdio.h>

void simd_example(void)
{
    SIMDDATA s1 = {1.0f, 2.0f, 3.0f, 4.0f};
    SIMDDATA s2 = {5.0f, 6.0f, 7.0f, 8.0f};
    SIMDDATA s3 = {0.0f, 0.0f, 0.0f, 0.0f};

    // Add the numbers in each element of s1 and s2, and store the result in s3
    s3 = SIMD_ADD(s1, s2);

    // output each element in s3
    printf("%f, %f, %f, %f\r\n", s3.f32[0], s3.f32[1], s3.f32[2], s3.f32[3]);

    // Multiply the numbers in each element of s1 and s2, and store the result in s3
    s3 = SIMDMUL(s1, s2);

    // output each element in s3
    printf("%f, %f, %f, %f\r\n", s3.f32[0], s3.f32[1], s3.f32[2], s3.f32[3]);
}

In this sample code, the SIMD_ADD() and SIMDMUL() functions are functions that use SIMD instructions to complete addition and multiplication operations, and the SIMDDATA type is a pointer, which is used to point to a vector array containing 4 floating-point number elements.  Using these functions can greatly improve code efficiency and execution speed.
It should be noted that to use SIMD instructions on ESP32-S3, you need to include <xtensa/hal.h> header files and <esp_simd.h> header files, and use the -msimd option to enable SIMD instructions when compiling  set support.

https://github.com/espressif/idf-extra-components/issues/106

I'm quite familiar with SIMD coding and would be happy to optimize my code for the S3, but I can't find the include files you referenced above. Do you have a working Github link to them?

@bitbank2 Thank you for your reply, maybe the directory file name has been changed, causing the address he gave to be invalid
https://github.com/espressif/esp-adf-libs/tree/master/esp_codec/include/codec

I saw on twitter that they have introduced SIMD instructions in the technical reference manual
https://mobile.twitter.com/eMbeddedHome/status/1570520252123062274

I saw these references months ago, but no concrete examples. I thought you had new information. I'll keep searching for this info and when it actually becomes available, I'll implement it. For now, writing in ESP32 assembly language is not going to happen.

Many thanks!  Looking forward to your work.

@bitbank2 Contact Espressif's official staff, he said that the SIMD data does not seem to have a fully open version.
There may be some clues hidden in esp-dsp.

I would honestly like to work on this, but I have very little free time. It will need to be painless and well documented.

@bitbank2 i got some replies
https://github.com/espressif/esp-bsp/issues/154

This DSP API library has been around for several years. It MAY be optimized for SIMD, but still doesn't really help any of my work.

@bitbank2 Sorry to bother you again! I got new news that this component supports SIMD.
Officials told me that this only supports whole frame decoding and cannot be divided into blocks, and if you use this, the buffer used to decode seems to need to be 32-byte aligned.
https://github.com/espressif/esp-dev-kits/tree/master/esp32-s3-lcd-ev-board%2Fexamples%2Fusb_camera_lcd%2Fcomponents%2Fesp_jpeg

Ported from ESP_ADF

Unfortunately not helpful because they didn't release the source code.

@bitbank2 Sorry to bother you again, this may not be helpful, but I wanted to tell you the test results.
JPEG decoding with SIMD, currently the whole frame, cannot be partial, there will be more in the future

The only thing that needs attention is that the buffer must be 16-byte aligned. I tested 320240 with a box and it took an average of 42 ms to decode RGB565. The performance on Arduino is really not good. I remember that decoding 800480 under IDF took less than 50ms.

JPEGDEC seems to be 68ms

https://github.com/esp-arduino-libs/ESP32_JPEG/blob/master/examples/DecodeTest/DecodeTest.ino

I worked on this over the weekend and got some good results optimizing my JPEG decoder. I'll publish the code soon.
What I find strange is your first comment on this issue - you show instructions, include files, and things that don't actually exist in the ESP32-S3 instruction set. The SIMD instructions (according to Espressif's own documentation), only support integer operations and are somewhat limited. I'm continuing my search for more info, but so far the SIMD of the S3 is mostly disappointing.

I'm not interested in someone else's closed source code.


make conn as tx

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

Pull request type

Please check the type of change your PR introduces:

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, renaming)
[x] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] Documentation content changes
[ ] Other (please describe):

What is the current behavior?

Issue Number: N/A
What is the new behavior?

Other information

Codecov Report

Merging #339 (040e59a) into master (4b15965) will decrease coverage by 25.00%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           master     #339       +/-   ##
===========================================
- Coverage   62.54%   37.54%   -25.01%
===========================================
  Files         196      107       -89
  Lines       20939    15065     -5874
===========================================
- Hits        13097     5656     -7441
- Misses       7063     9184     +2121
+ Partials      779      225      -554

Flag
Coverage Δ

1.14.x
37.49% <ø> (-24.72%)
:arrow_down:

1.18.x
37.52% <ø> (-24.50%)
:arrow_down:

1.19.x
37.51% <ø> (-24.61%)
:arrow_down:

connection
?

database_sql
?

discovery
?

e2e
?

integration
?

macOS-latest
37.52% <ø> (+0.01%)
:arrow_up:

ratelimiter
?

scripting
?

table
?

topic
?

ubuntu-latest
37.51% <ø> (-24.99%)
:arrow_down:

unit
37.54% <ø> (-0.05%)
:arrow_down:

windows-latest
?

Flags with carried forward coverage won't be shown. Click here to find out more.

 Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Publish 7.6-20221010090952+0000

Publish 7.6-20221010090952+0000

@bot-gradle test and merge

OK, I've already triggered a build for you.


How to sort panorama_uuid(tripod placement) under a scan in proper order to run a SLAM?

Hi:
Thanks for contributing such an amazing dataset!

But I can't directly get the time order of data collection from [panorama_uuid], if I input rgb-d in the default order, obviously there is almost no overlapping area of the images collected from different tripod placements, which apparently makes it impossible to run a SLAM algorithm.
so how to sort these panorama_uuid to get a normal rgb-d data sequence?
Thanks in advance!

Sorry, Maybe I didn't express it correctly before. I hope I can make it clear this time, thank you for your patience again!
For SLAM, there are often overlapping areas between adjacent frames of the input image.
If we just randomly input all 18 images(<panorama_uuid>[1]<camera_index>[0-2]<yaw_index>[0-5]) under different [panorama_uuid], we may meet this situation:
Above figure is from the dataset paper, each green dot represent a location, which is denoted by a [panorama_uuid]. I know there are 18 images under a [panorama_uuid].
I use red number : '1','2'to name two [panorama_uuid] as example.
At first all images at <panorama_uuid>[1] are input, then maybe <panorama_uuid>[2]<camera_index>[0-2]<yaw_index>[0-5].jpg are input to SLAM.
however, there is no visual overlap between the last image in <panorama_uuid>[1]<camera_index>[0-2]<yaw_index>[0-5] and first image in <panorama_uuid>[2]<camera_index>[0-2]<yaw_index>[0-5], which will cause the algorithm to lose track...
Ideally, we should input the images to SLAM in the order of the blue arrows(there may be other orders, as long as there are reasonable overlaps).
So I would like to ask, is there a way to easily get a reasonable order of [panorama_uuids] in one scene from Matterport3d
OR get a set of rgb-d data and the corresponding GT 6dof poses from Matterport3d to train a SLAM?

Hi, have you found any possibility to train a SLAM with the Matterport3d ?

@LongruiDong
How to add coordinates automatically between keyframes in SLAM.


openEO on EDC with SentinelHub as backend

We (@clausmichele and me, both through the personal account and the master asi conae account) tried to connect to SentinelHubs openEO backend via EDC as we had discussed. Our approach doesn't work. We time out when using the authentication method relying on client secret and id.
Check the notebook here: https://github.com/EO-College/cubes-and-clouds/blob/main/exercises/edc_openeo.ipynb
FYI: Via EGI and our existing Eurac accounts it works. But that's not what we want.
thx for cheking with me @clausmichele
can you tell us how it should work? @Schpidi, @UndeadFairy, @dthiex

I put the code here as well for simplicity:
import openeo
from sentinelhub import (SHConfig, SentinelHubRequest, DataCollection, MimeType, CRS, BBox, bbox_to_dimensions, geometry)

conn = openeo.connect('https://jjdxlu8vwl.execute-api.eu-central-1.amazonaws.com/production')
config = SHConfig()
config.sh_client_id = %env SH_CLIENT_ID
config.sh_client_secret = %env SH_CLIENT_SECRET

conn.authenticate_oidc_authorization_code( client_id=config.sh_client_id, client_secret=config.sh_client_secret, )`

If I understand correctly, you want to authenticate to your Sentinel Hub account and not EGI account, by using the client_id and client_secret provided by Sentinel Hub?
We do not currently support the authenticate_oidc_authorization_code  method, but a work around to this would be using authenticate_basic for example:
conn.authenticate_basic(username=config.sh_client_id, password=config.sh_client_secret)

It works, thanks!


How to automatically save image when using Rstudio?

Maybe it's a naive question. I wanted to generate a number of images and save them automatically.

If you are using RCy3  you can use:
saveImage(cytoscape_object,
          "file_name",
          "png",
          scale)

The documentation currently says that only "jpeg" is supported, but I have used this with png and pdf.

I just updated the documentation on the devel version of RCy3. RCy3 supports saving images as 'png', 'pdf' and 'svg'. Users have also created animations/videos by writing a loop and saving the images to file.


impl. Pattern matching

Example:
match expr
when Some(x)
  p x
else
  p "none"
end

maybe make syntax Rust style? Rust match best syntax and power over another languages.
match number
  1 => puts "One!"
  2 | 3 | 5 | 7 | 11 => puts "This is a prime"
   puts "4" if 4
  _ => puts "Ain't special"
end

I'd like to stick to Ruby-like syntax for now, but maybe I'll change my mind as I write Rust every day 😄


Correct minimum expiry time in presignURL func doc

The title can also be changed to Add unit to expiry time comment in PresignURL func


USHIFT-1199: add automated tests for etcd memory limit management

/hold
These tests depend on #1734
These tests introduce instability to the overall test run by restarting microshift and not waiting long enough for it to restart.

/assign @pacevedom

/retest-required

/hold
The e2e tests are not running on this PR because only test code is being changed. See https://github.com/openshift/release/pull/39797

/retest-required

/hold cancel

/test microshift-e2e-arm


Descriptor bean properties are duplicated in certain circumstances

Because bean identity is determined by property name, type, annotations and initializers, then having a setter and getter in the descriptor causes issues if either has an annotation.
Strip the bean properties class down to just property name and type so that they correctly merge in sets or hashmap keys, and the merge the annotations elsewhere.

Bean property identity is name, type, and whether or not the "is" convention is  used for boolean property types.


javax.net.ssl.SSLHandshakeException: server certificate change is restricted during renegotiation

HttpClient v4.3.6版本貌似有个关于SSLv3的bug，能否升级一下weixin-popular的依赖呢

... update HttpClient to a more recent version than 4.3.6, then SSLv3 will be disabled by default and your code should no longer report such exception.

http://stackoverflow.com/questions/27105004/what-means-javax-net-ssl-sslhandshakeexception-server-certificate-change-is-re

目前官方没有 4.3.x 的更新版，4.4.x   4.5.x 的版本需要测试。


Test case for validating users password

Purpose
This test case sends a request to provision a user with a password that does not have proper format
Tested environment
1.ubuntu 18.04
2.java version "1.8.0_161"
3.Identity server wum updated pack wso2is-5.7.0+1543336788716.full with jdbc user store
Automation tests
Submit a request with an invalid password format and assert the response code

closing this PR as  a new PR https://github.com/wso2/product-is/pull/4154 is created


cl::Error while running kinect_bridge2 on indigo, Ubuntu 14.04

% rosrun kinect2_bridge kinect2_bridge
parameter:
        base_name: kinect2
           sensor:
        fps_limit: -1
       calib_path: /home/baxter/ros/indigo/src/iai_kinect2/kinect2_bridge/data/
          use_png: false
     jpeg_quality: 90
        png_level: 1
     depth_method: opencl
     depth_device: -1
       reg_method: opencl
       reg_devive: -1
        max_depth: 12
        min_depth: 0.1
       queue_size: 2
 bilateral_filter: true
edge_aware_filter: true
       publish_tf: false
     base_name_tf: kinect2
   worker_threads: 4

terminate called after throwing an instance of 'cl::Error'
  what():  clGetPlatformIDs
[1]    4089 abort      rosrun kinect2_bridge kinect2_bridge

I tried $ sudo ./Protonect cl, $ ./Protonect and it works.

try to install nvidia-modprobe

That works!
Thank you for your quick response. That helps me a lot.
Should I write some information about this on README?

[FIXED]
I just tried
$ sudo aptitude install nvidia-modprobe


Option to move the buttons around

Create option to move the buttons and set different location for them.
https://github.com/rebelappstudio/accessibility_tools/assets/48731731/c42bb5c1-b63d-407d-91fe-026a23b30e0c

@aednlaxer can we run the CI again, failed due to codecov rate limit

Thanks for another great pull request! I'll review it this week
CI jobs have been restarted

Thanks for another great contribution! These changes have been published and now available on pub.dev


Respringing doesn't run uicache

I've noticed that sometimes when installing tweaks I reboot and it shows up on the homescreen. But if I don't run uicache or reboot it doesn't pop up on my springboard

pretty sure this is a #162

@beanjo55 this issue doesn't occur in b3 or pangu

@CrypticGit if you look at #162 , this is not an issue directly relating to the code of this JB. the goal now it seems is to get the JB stable, and then please the people who just want tweaks and shit


Rtl support on headers not working

After setting rtlSupport to true

The outputs seem like this:

And the css of each th column contains "text-left" class wich sets "text-align: left !important"

Thank you @idanmarko  for checking handy-uplader package. I fixed this issue in new release (1.1.4). Now you can use rtl suppurt for table header


Probably the catch plugin is checking the wrong storage for the item-count (note, that Bag storage is overfilled)
Other Information
OS: OSX Yosemite
Git Commit: ae031f1

eggs count as pokemon. that is where the discrepancy is. this should be closed.

we should update pokemon count to include eggs

here is a pull request for that.
https://github.com/OpenPoGo/OpenPoGoBot/pull/249

Closed by #253