ci: Don't run unit tests on NuGet publish

We no longer want to run tests when we publish NuGet packages as the general sentiment is that these are redundant.

I believe the primary difference we've noticed is that release pipeline was still on Incrementalist which ran tests differently and those were triggered in our CI as well.
Examples (release vs latest CI from main):

After checking, all failed tests are passing in CI so should be fine with this alignment. (although I can only test on release)

DotNetty.Transport.Libuv.Tests.ConnectionAttemptTests.ConnectTimeout failed but re-running to see if it's just flaky as this is unrelated to this change.

I believe the primary difference we've noticed is that release pipeline was still on Incrementalist which ran tests differently and those were triggered in our CI as well.

The difference is that tests in Publish Nuget are running in Configuration=Release mode. I have confirmed that by running the tests locally in Release mode, and they fail all the time


Add jobName into audit log for run command

What changes are proposed in this pull request?
Add jobName into audit log for run command.
Why are the changes needed?
The audit log of the run command has no jobName record.
2022-11-02 18:20:47,690 INFO  JOB_MASTER_AUDIT_LOG (AsyncUserAccessAuditLogWriter.java:run) - succeeded=true    allowed=true    ugi=alluxio,alluxio (AUTH=RPC)  ip=null cmd=run mJobId=1666765197501    mJobName=null   perm=null       executionTimeUs=2700

alluxio-bot, merge this please!


chore: Migrate script module name to scripts

Only fixed the comment in code,
idk if something else should be done in order to support both script & scripts module name in stages
Parent PR:
https://github.com/blue-build/modules/pull/334

There's some recipes in the integration-tests dir that could be updated too.


chore(types,clerk-js,clerk-react): Drop Clerk.isReady() in favor of Clerk.loaded

Description
Drop deprecated Clerk.isReady() in favor of Clerk.loaded.
Deprecation PR: https://github.com/clerk/javascript/pull/2293
Checklist

[x] npm test runs as expected.
[x] npm run build runs as expected.
[ ] (If applicable) JSDoc comments have been added or updated for any package exports
[ ] (If applicable) Documentation has been updated

Type of change

[ ] 🐛 Bug fix
[ ] 🌟 New feature
[ ] 🔨 Breaking change
[x] 📖 Refactoring / dependency upgrade / documentation
[ ] other:

Packages affected

[ ] @clerk/backend
[ ] @clerk/chrome-extension
[x] @clerk/clerk-js
[ ] @clerk/clerk-expo
[ ] @clerk/fastify
[ ] gatsby-plugin-clerk
[ ] @clerk/localizations
[ ] @clerk/nextjs
[x] @clerk/clerk-react
[ ] @clerk/remix
[ ] @clerk/clerk-sdk-node
[ ] @clerk/shared
[ ] @clerk/themes
[x] @clerk/types
[ ] build/tooling/chore

@panteliselef done!


Losing databases upon deployment or restart to fly.io

I am deploying my Phoenix app to fly.io. On either a new deployment or even a restart, I seem to be losing all of the contents in my CubDB databases (I have several of them). I'm pretty new to fly.io, so I don't know how to provide anymore info at this point. Can you think of anything that might be causing this? I
The problem does not occur when I run my app locally.
I'll keep digging. Feel free to close the issue if you want.

Are you using a Fly Volume to store the cubdb file?

No, not unless I'm doing it by accident, since I don't know what a Fly Volume is. I just create the database with:
I just do this:
  @doc false
  def init(_init_arg) do
    {:ok, user_task_db} = CubDB.start_link(data_dir: "database/user_task_db")
    {:ok, completed_process_db} = CubDB.start_link(data_dir: "database/completed_process_db")
    {:ok, process_model_db} = CubDB.start_link(data_dir: "database/process_model_db")
    {:ok, bpm_application_db} = CubDB.start_link(data_dir: "database/bpm_application_db")
    {:ok, process_state_db} = CubDB.start_link(data_dir: "database/process_state_db")

    initial_state = %{
      active_process_groups: %{},
      active_processes: %{},
      restart_state_cache: %{},
      user_task_db: user_task_db,
      completed_process_db: completed_process_db,
      process_model_db: process_model_db,
      bpm_application_db: bpm_application_db,
      process_state_db: process_state_db
    }

    Logger.info("Process service initialized")

    {:ok, initial_state}
  end

FYI - I just now figured out how to get a shell prompt on my server.

I can see now from my fly shell prompt, that the database files are being reset to empty on each restart. Specifically, I do an "ls" and the file size of 0.cub goes back to a size of 1038 on each restart.

I just followed your link to "Fly Volume". I gather that is my problem, i.e. that I am not using Fly Volumes. Correct?

Yes.

Thanks for the tip. I've been trying to do this, but without any luck so far.
First, I created a volume like this:
fly volumes create database

Then in my fly.toml file, I added:
[mounts]
  source = "database"
  destination = '/app/database'

The directory does get created it seems:
root@7811773f270e58:/app# ls
bin  database  erts-14.2.5  lib  releases

However, I'm still losing my database contents on every restart. Hmmmm....

@CharlesIrvineKC I'm doing more or less the same with a Fly Volume + CubDB and it seems to work fine. The only obvious difference I'm seeing at first glance is I'm not mounting it inside the /app directory. Could you check if mounting to /database or something similar might help?

@optikfluffel Quick question. In your calls to CubDB.start_link/1, does your path start with a leading slash, or without, like this:
 {:ok, user_task_db} = CubDB.start_link(data_dir: "database/user_task_db")

@CharlesIrvineKC I'm doing more or less the same with a Fly Volume + CubDB and it seems to work fine. The only obvious difference I'm seeing at first glance is I'm not mounting it inside the /app directory. Could you check if mounting to /database or something similar might help?

@CharlesIrvineKC with a leading slash, yes

@optikfluffel Would you mind showing me your application.ex?

@CharlesIrvineKC sure thing:
defmodule Fluffel.Application do
  @moduledoc false

  use Application

  @impl Application
  def start(_type, _args) do
    if Application.get_env(:sentry, :environment_name) == :prod do
      {:ok, _pid} = Logger.add_backend(Sentry.LoggerBackend)
    end

    children = [
      # Start the Telemetry supervisor
      FluffelWeb.Telemetry,
      # Start the PubSub system
      {Phoenix.PubSub, name: Fluffel.PubSub},
      # Start CubDB
      {CubDB, data_dir: "/metrics_data", auto_compact: true, name: :db},
      # Start Metrics Supervisor
      Fluffel.Metrics,
      # Start the Endpoint (http/https)
      FluffelWeb.Endpoint
    ]

    # See https://hexdocs.pm/elixir/Supervisor.html
    # for other strategies and supported options
    opts = [strategy: :one_for_one, name: Fluffel.Supervisor]
    Supervisor.start_link(children, opts)
  end

  # Tell Phoenix to update the endpoint configuration
  # whenever the application is updated.
  @impl Application
  def config_change(changed, _new, removed) do
    FluffelWeb.Endpoint.config_change(changed, removed)
    :ok
  end
end

I was able to resolve this.


Question: is extension *.pack supported

It is unclear if the extension *.pack is supported when specifying packs.
I found the following inconsistency:
PS C:\Test\Demo_EW> cpackget rm AWS.FreeRTOS_LTS.2020.12.1-Beta.pack
I: Using pack root: "C:\Users\reikei01\AppData\Local\Arm\Packs"
I: Removing [AWS.FreeRTOS_LTS.2020.12.1-Beta.pack]
PS C:\Test\Demo_EW> cpackget add AWS.FreeRTOS_LTS.2020.12.1-Beta.pack
I: Using pack root: "C:\Users\reikei01\AppData\Local\Arm\Packs"
I: Adding pack "AWS.FreeRTOS_LTS.2020.12.1-Beta.pack"
E: File "AWS.FreeRTOS_LTS.2020.12.1-Beta.pack" does't exist

While the command rm seems to accept the extension *.pack, the command add seems not to handle it.

NOTE: without extension *.pack the expected result is generated.

Environment:
cpackget version 0.5.0 (C) 2022 Linaro
Running on Windows 10.

@ReinhardKeil, you should not specify the .pack extension in this case, because cpackget is assuming that you want to install that file from the current directory:
cpackget add .\AWS.FreeRTOS_LTS.2020.12.1-Beta.pack

In this case you want to download and install a public pack and you should specify the pack ID:
AWS.FreeRTOS_LTS.2020.12.1-Beta

or matching the csolution notation
<EMAIL_ADDRESS>

I improved the documentation, but when specifying the extension explicitly, it should be assumed that the pack is on the local computer. I would remove the option, that it gets downloaded via the public index in this case.  That would make the operation clearer.
See also the documentation in https://github.com/Open-CMSIS-Pack/devtools/tree/main/tools/cpackget/docs

Note that both commands assume a file on your computer in the current directory:
cpackget add .\AWS.FreeRTOS_LTS.2020.12.1-Beta.pack
cpackget add AWS.FreeRTOS_LTS.2020.12.1-Beta.pack

I just added the '.' to make it more obvious.


Duplicating source

Is it really necessary to make a copy of the ChilliSource each new project?
Why not link to the source instead?
It reminds me a traumatic experience with cocos.

Thank you for the feedback :)
The reason it's like this is so that ChilliSource can be included as a git sub-module in your project. That has two benefits. First of all it's easy to keep the project up to date with the latest version of the engine. Secondly, if you need to hop back to a previous version of your project you don't need to keep track of which version of ChilliSource was used to build it.
This isn't made clear to a first time user however and it's a common complaint, so we're currently looking into alternatives.

I see but make changes to my fork, push, update submodule and build the lib multiple times for each test project is a little tiring and each copy is more than 500 mb.
Should be great if CSProjectGenerator can take an parameter to link relative to the source and its build folder instead.

What I've done is make a config.py script which setup what path all the other scripts will take. I also configured the CS project to build on its project directory.
This way you can customize to point to any path or environment variable.
Also is easy to change it later and I think it's less work to in the CSProjectGenerator because the only thing that will change in the template is the that config.py.

Using config files like that comes with a number of issues of their own:

The config file is difficult to maintain if the project is being built on different machines, especially if they're on different operating systems. The only viable way to handle this is to leave the config file un-versioned in source control and leave it to the user to manually maintain it for their local machine.
If the config file is un-versioned, then a project no longer builds out of the box.
As mentioned earlier if a user needs to go back to a previous version of their project, they'll have to manually keep track of which version of the engine was used to build it.

Config files are still being considered, but we're currently leaning towards a different approach. This will involve having two different versions of the engine:

Installed version: An entry-level version of the engine which comes with an installer. This will set up an CS_PATH environment variable which is used by projects to locate the engine. The engine would be built to libraries and only contain the binaries for tools. This would mean it is a smaller, easier to use version of the engine intended for beginners.
Source version: This would be pretty much as is, with the engine source contained inside the project (preferably as a git sub-module). This is much more convenient when configuring and adapting the source of the engine for a project. This would be intended for advanced users.

This is all still up for debate though, so we'll just have to see how it turns out :)

You have some points.
Although the config file will not change the current behavior if the default configuration is point to the submodule folder.
I currently using an environment variable.
At the start my main issues is that the framework is setup to build in the project folder which prevents sharing the libraries and the scripts have hardcode or implicit path to the source.
The copy_windows_resources.py for example uses the project dir to link to the game source and the CS framework too.
It could take an explicit paramenter to the CS framework or use the config file shared for all the scripts.


How do I import the fa_icon helpers into my project?

Right now, the following is in my app/helpers/application_helper.rb file:
  def fa_icon(icon, klass=nil, text=nil)
    "<i class='fa fa-#{icon} #{klass}'></i> #{text}".html_safe
  end

Is there a more elegant way of importing these helpers?

I found out my error... I was entering fa_icon("remove"), not fa_icon "remove".


I want to add a Sign Up Page

There is a signup option but no page is there for signing up. I will add a signup page so please assign me this issue.

There is a signup option but no page is there for signing up. I will add a signup page so please assign me this issue.

Right now there is no need for a sign up page . home page design is what needed right now


plutus-book: fix references to bibliography and glossar

Multiple issues here:

Needed a fix for inline anchors to not be completely broken in
general. Upstream PR, I've
patched our version locally (hooray for Nix).
Dodgy stuff with special sections as top-level sections in the
particular way that the asciidoctor-epub3 gem does them. Not totally
sure what the fix is. Upstream issue.

Despite the issue not being fixed, understanding it allowed me to
add a workaround, in the form of putting the bibliography and the
glossary in a dummy section.

With these changes, references to the bibliography work, and adding
anchors in the glossary and referring to them also works.

FYI @brunjlar


64-bit binary names do not follow common idtech3 naming scheme on Windows

x64 binary names on Windows should be
cgame_mp_x86_64.dll
ui_mp_x86_64.dll
qagame_mp_x86_64.dll

but we have
cgame_mp_x64.dll
ui_mp_x64.dll
qagame_mp_x64.dll

Currently we're following naming scheme implied by the ETLegacy. So we should first see if some changes can be done on their side.

Staying with this for now.


Add GitHub action to automatically close issue if it's corresponding PR gets merged.

Feature request-
Add GitHub action to automatically close issue if it's corresponding PR gets merged. If the issue is mentioned in a PR and it gets merged then sometimes doesn't close automatically so add a GH action for that.
Note: If you want to work on an issue, you should check if it has already been assigned to anyone. If the issue is free you can comment /assign to get the issue assigned to you.
If you are raising a new issue and want to work on it then also you should comment /assign under the issue to get it auto assigned.

/assign

/assign

https://github.com/marketplace/actions/closes-issues-related-to-a-merged-pull-request

Sir are you asking about something  like this ?

Sir are you asking about something like this ?

Yes this works..

okay sir.

So we have to include both master and develop branch or only develop ?

So can you assign me this again ?


VSCode Insdier for ARM64 on M1 Macmini SOURCE CONTROL is slowly

VSCode Version:1.53.0-insider
OS Version:Darwin arm64 20.2.0

Steps to Reproduce:
1.Open Github folder
2.SOURCE CONTROL is very slow to refresh
When i use VSCode stable on M1 Macmini the SOURCE CONTROL is very fast
But it is very slow when i use VSCode Insider for ARM64

@deepak1556 any idea on this one?

@deepak1556 any idea on this one?

Can you provide the performance profile from both stable and insider following, thanks!

Execute "F1 > Toggle Developer Tools."
Select 'Performance' tab
Start the profiler and perform the actions for slowdown
Save the profile to a file and attach here.

Can you provide the performance profile from both stable and insider following, thanks!

Execute "F1 > Toggle Developer Tools."
Select 'Performance' tab
Start the profiler and perform the actions for slowdown
Save the profile to a file and attach here.

@deepak1556
Thanks for your reply.
profile.zip

@deepak1556
Thanks for your reply.
profile.zip

I have the same issue,any fix?

I have the same issue,any fix?

This is pending fix from upstream https://github.com/electron/electron/pull/27026

This is pending fix from upstream https://github.com/electron/electron/pull/27026

When i update macOS 11.2 today ,  The extension "Bracket Pair Colorizer 2" makes vscode - insiders an error "Extension host terminated unexpectedly" .
When i uninstalled it , I found "SOURCE CONTROL" has back to normal

I confirm with mac os 11.2 the performance is a lot better.

@stilleshan the extension host crash is tracked at https://github.com/microsoft/vscode/issues/115646

@stilleshan can you check if the original issue of perf regression with source control is seen with latest insiders ? Thanks!

@deepak1556
The performance has returned to normal now.

macOS 11.2 (M1 Mac mini)
VSCode insader ARM
Version: 1.54.0-insider
Commit: 52838cf6799cc448e738677ec37e86cf62a5bd89
Date: 2021-02-05T05:17:08.594Z (21 hrs ago)
Electron: 11.2.2
Chrome: 87.0.4280.141
Node.js: 12.18.3
V8: <IP_ADDRESS>-electron.0
OS: Darwin arm64 20.3.0

Thanks for confirming!


Add branch as tag when pr is closed

Hello,
I'd like to send this PR for your feedback.
Sending branch as a tag when the PR is quite useful in our use case.

Hi Allan, thanks for the PR. The main concern I have though is branch names are considered unbounded which per Datadog guidelines for defining tags are not recommended as it can impact billing.
You can however use the optional tagged-branches feature to specify a limited list of branches for which to tag the metrics accordingly.

This is a very useful feature. To reduce the metric cardinality, we can add a tag for default_branch:yes/no. Often times, you just care about if a build is for the default branch or not. Thoughts?

This is a great idea! Will look into adding it soon. Thanks for the suggestion.

@kamranf much appreciated. Can't wait.

@allanalvaro I just merged a change to tag the pull request metrics with a default-branch:true/false tag based on if the pull request is targeting the default branch as base. We won't be able to merge this specific change upstream because of metric cardinality concerns.
See: https://github.com/scribd/github-action-datadog-reporting/pull/22


Slow and lag

This app is beautiful, i want it to change my default ugly file manager without cool features as: tabs, google disk, folder size and ect. But this app is too much slow on my pc and sometimes its making lags in my pc. Please, optimise this app.
My pc specs:
OS: Windows 11
CPU: Intel Xeon E5450 3GHz 4 Cores
GPU: Nvidia GTX 750 Ti 2GB
RAM: 8GB DDR3

Thanks for your interest information Files. I suggest you try Files v.2.3 if you  don't have it already. You can get it from the Store or https://files.community/download/stable. A fresh reinstall may also help. Merging with #4180


could not validate external IP and UDP receive buffer is too small for a production set-up

./livekit-server --config ./livekit.yaml
{"level":"warn","ts":1732616973.5684533,"logger":"livekit","caller":"rtcconfig/ip.go:272","msg":"could not validate external IP","ip":"139.11*.*"error":"context canceled"}
{"level":"warn","ts":1732616973.5701373,"logger":"livekit","caller":"rtcconfig/rtc_unix.go:31","msg":"UDP receive buffer is too small for a production set-up","current":425984,"suggested":5000000}

livekit.yaml
port: 7880
bind_addresses:
    - "<IP_ADDRESS>"
logging:
  level: warn
  json: true
  pion_level: error
rtc:
  tcp_port: 7881
  udp_port: 7882
  use_external_ip: true
  enable_loopback_candidate: false
redis:
  address: <IP_ADDRESS>:6379
  db: 1
turn:
  enabled: false
  tls_port: 5349
  udp_port: 3478
  external_tls: true
keys:
  appkey: secret123456789012345678901234567890
room:
  empty_timeout: 60
  departure_timeout: 1

debian linux version
uname -a
Linux debian 6.1.0-17-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.69-1 (2023-12-30) x86_64 GNU/Linux

livekit-server version is 1.8.0

You need to check the net.core.rmem_max setting to make sure if is greather than 5000000. And the could not validate.. means the sfu's external ip&port can't be reached from public internet, do you put the server behind the NAT?

139.11*.* is router ip.
my vps use dhcp under the router.

139.11.. is an external IP address.
I installed livekit VPS using DHCP to get this extranet IP.
How do I start the livekit server in this case?


fix pre save signal in user model

closes CRJI/EIC#941

Successfully tested using the branch mentioned.


Lose network connectivity in docker container

Hello,
I'd like to report an issue. Here's the points:

I am using dsub to create a Runner VM.
I run a customer Ruby scripts inside a container on this Runner VM.
This custom scripts uses dsub to actually create an execution pipeline.
After approx. 20 hours Containers on Runner VM looses network connectivity (no ping to the internal or external IPs, no DNS Name Resolution) and whole pipeline fails because of that.

Below is the error log:
Exception ServerNotFoundError: Unable to find the server at www.googleapis.com
Traceback (most recent call last):
  File "/usr/local/bin/dsub", line 11, in <module>
    sys.exit(main())
  File "/usr/local/lib/python2.7/dist-packages/dsub/commands/dsub.py", line 820, in main
    dsub_main(prog, argv)
  File "/usr/local/lib/python2.7/dist-packages/dsub/commands/dsub.py", line 809, in dsub_main
    launched_job = run_main(args)
  File "/usr/local/lib/python2.7/dist-packages/dsub/commands/dsub.py", line 874, in run_main
    provider_base.get_provider(args, resources),
  File "/usr/local/lib/python2.7/dist-packages/dsub/providers/provider_base.py", line 41, in get_provider
    getattr(args, 'dry_run', False), args.project)
  File "/usr/local/lib/python2.7/dist-packages/dsub/providers/google.py", line 620, in __init__
    credentials)
  File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
    return Retrying(*dargs, **dkw).call(f, *args, **kw)
  File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 206, in call
    return attempt.get(self._wrap_exception)
  File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
    six.reraise(self.value[0], self.value[1], self.value[2])
  File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
    attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  File "/usr/local/lib/python2.7/dist-packages/dsub/providers/google_base.py", line 481, in setup_service
    api_name, api_version, credentials=credentials)
  File "/usr/local/lib/python2.7/dist-packages/googleapiclient/_helpers.py", line 130, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/googleapiclient/discovery.py", line 222, in build
    requested_url, discovery_http, cache_discovery, cache)
  File "/usr/local/lib/python2.7/dist-packages/googleapiclient/discovery.py", line 269, in _retrieve_discovery_doc
    resp, content = http.request(actual_url)
  File "/usr/local/lib/python2.7/dist-packages/httplib2/__init__.py", line 1694, in request
    (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey)
  File "/usr/local/lib/python2.7/dist-packages/httplib2/__init__.py", line 1434, in _request
    (response, content) = self._conn_request(conn, request_uri, method, body, headers)
  File "/usr/local/lib/python2.7/dist-packages/httplib2/__init__.py", line 1360, in _conn_request
    raise ServerNotFoundError("Unable to find the server at %s" % conn.host)
httplib2.ServerNotFoundError: Unable to find the server at www.googleapis.com
#<Thread:0x0000557635540a78@/usr/local/bundle/gems/happy_runner-0.1.0/lib/happy_runner/abstract/pipeline.rb:45 run> terminated with exception (report_on_exception is true):
/usr/local/bundle/gems/happy_runner-0.1.0/lib/happy_runner/abstract/step.rb:103:in `run': unhandled exception
	from /usr/local/bundle/gems/happy_runner-0.1.0/lib/happy_runner/abstract/pipeline.rb:45:in `block (2 levels) in run'
/usr/local/bundle/gems/happy_runner-0.1.0/lib/happy_runner/abstract/step.rb:103:in `run': unhandled exception
	from /usr/local/bundle/gems/happy_runner-0.1.0/lib/happy_runner/abstract/pipeline.rb:45:in `block (2 levels) in run'

I login Runner VM and issue the command sudo sysctl -w net.ipv4.ip_forward=1 in it, the network connection problem inside the docker container is resolved.
The value of net.ipv4.ip_forward in new created Runner VM is 1. It's strange that the value changes to zero after a long time run.

Hi Jian-Long,
The problem appears to be with Google Compute Engine or something in the way that the Pipelines API v1alpha2 Docker setup interacts with GCE.
The problem has been reported on this thread:
https://groups.google.com/forum/#!topic/google-genomics-discuss/yXnSHobOYmE
I would suggest following up there. You may have some additional information that helps debug the problem.
That said, for your own purposes to get moving, you can use the "google-v2" provider for dsub. We just recently announced it here. This is support for the Pipelines API v2alpha1 and is where future enhancements will be added.


NG: healthcheck endpoints

User stories

I'm a devops, and I want a simple way to check whether all dependent systems are operational from a registry perspective
I'm a devops, and I want pingdom to query a specific endpoint and have it fail if the registry is not actually functioning, for any reason

This shouldn't disclose/leak any sensitive information, but still give enough info about what's happening.
Also, checking backend services health (redis, storage) might be long and shouldn't let the endpoint timeout, so, these checks should be done asynchronously and they should timeout before the endpoint does.
Maybe this could be designed as an extension?
@ncdc @noxiouz @BrianBland go crazy :-) - there was a discussion started about that already at #482

Superseded by docker/distribution#133.


[BUG] HugeCTR datacollector illegal memory access when scale from 4 gpu to 8 gpu

Describe the bug
HugeCTR datacollector illegal memory access when scale from 4 gpu to 8 gpu
To Reproduce
Follow: https://github.com/mengdong/merlin-on-vertex/blob/main/src/training/hugectr/HUGHCTR_CRASH.md
Expected behavior
8 gpu should run without illegal memory access
Screenshots
09-10-21 04:53:44 - Starting model fitting
=====================================================Model Fit=====================================================
[90d40h53m44s][HUGECTR][INFO]: Use non-epoch mode with number of iterations: 5000
[90d40h53m44s][HUGECTR][INFO]: Training batchsize: 8192, evaluation batchsize: 8192
[90d40h53m44s][HUGECTR][INFO]: Evaluation interval: 500, snapshot interval: 0
[90d40h53m44s][HUGECTR][INFO]: Sparse embedding trainable: 1, dense network trainable: 1
[90d40h53m44s][HUGECTR][INFO]: Use mixed precision: 0, scaler: 1.000000, use cuda graph: 1
[90d40h53m44s][HUGECTR][INFO]: lr: 0.001000, warmup_steps: 1, decay_start: 0, decay_steps: 1, decay_power: 2.000000, end_lr: 0.000000
[90d40h53m44s][HUGECTR][INFO]: Training source file: /criteo_data/criteo_processed_parquet/train/_file_list.txt
[90d40h53m44s][HUGECTR][INFO]: Evaluation source file: /criteo_data/criteo_processed_parquet/valid/_file_list.txt
[HCDEBUG][ERROR] Runtime error: an illegal memory access was encountered /var/tmp/HugeCTR/HugeCTR/include/data_readers/data_collector.hpp:236
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/src/trainer/task.py", line 254, in
main(args)
File "/src/trainer/task.py", line 114, in main
model.fit(num_epochs=args.num_epochs,
RuntimeError: [HCDEBUG][ERROR] Runtime error: an illegal memory access was encountered /var/tmp/HugeCTR/HugeCTR/include/data_readers/data_collector.hpp:236
[HCDEBUG][ERROR] Runtime error: an illegal memory access was encountered /var/tmp/HugeCTR/HugeCTR/pybind/model.cpp:406
terminate called after throwing an instance of 'HugeCTR::internal_runtime_error'
what():  [HCDEBUG][ERROR] Runtime error: an illegal memory access was encountered /var/tmp/HugeCTR/HugeCTR/src/metrics.cu:497
[ec0eeea8e953:00309] *** Process received signal ***
[ec0eeea8e953:00309] Signal: Aborted (6)
[ec0eeea8e953:00309] Signal code:  (-6)
[ec0eeea8e953:00309] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x46210)[0x7f10e79ef210]
[ec0eeea8e953:00309] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7f10e79ef18b]
[ec0eeea8e953:00309] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7f10e79ce859]
[ec0eeea8e953:00309] [ 3] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0x9e911)[0x7f10cd823911]
[ec0eeea8e953:00309] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xaa38c)[0x7f10cd82f38c]
[ec0eeea8e953:00309] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa9369)[0x7f10cd82e369]
[ec0eeea8e953:00309] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(__gxx_personality_v0+0x2a1)[0x7f10cd82ed21]
[ec0eeea8e953:00309] [ 7] /usr/lib/x86_64-linux-gnu/libgcc_s.so.1(+0x10bef)[0x7f10cd738bef]
[ec0eeea8e953:00309] [ 8] /usr/lib/x86_64-linux-gnu/libgcc_s.so.1(_Unwind_RaiseException+0x331)[0x7f10cd739281]
[ec0eeea8e953:00309] [ 9] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(__cxa_throw+0x3c)[0x7f10cd82f69c]
[ec0eeea8e953:00309] [10] /usr/local/hugectr/lib/libhuge_ctr_shared.so(+0x20bf9a)[0x7f10e46e7f9a]
[ec0eeea8e953:00309] [11] /usr/local/hugectr/lib/libhuge_ctr_shared.so(_ZN7HugeCTR7metrics3AUCIfED1Ev+0x86)[0x7f10e4ca2cd6]
[ec0eeea8e953:00309] [12] /usr/local/hugectr/lib/libhuge_ctr_shared.so(_ZN7HugeCTR7metrics3AUCIfED0Ev+0xd)[0x7f10e4ca2dcd]
[ec0eeea8e953:00309] [13] /usr/local/hugectr/lib/libhuge_ctr_shared.so(_ZN7HugeCTR5ModelD1Ev+0x127)[0x7f10e4e2c327]
[ec0eeea8e953:00309] [14] /usr/local/hugectr/lib/hugectr.so(+0x4b956)[0x7f10e71a5956]
[ec0eeea8e953:00309] [15] /usr/local/hugectr/lib/hugectr.so(_ZNSt16_Sp_counted_baseILN9__gnu_cxx12_Lock_policyE2EE10_M_releaseEv+0x48)[0x7f10e71bb528]
[ec0eeea8e953:00309] [16] /usr/local/hugectr/lib/hugectr.so(+0x61f34)[0x7f10e71bbf34]
Environment (please complete the following information):
GCP A100 a2-high-8g, | NVIDIA-SMI 470.57.02 Driver Version: 470.57.02 CUDA Version: 11.4
nvcr.io/nvidia/merlin/merlin-training:21.09

Fixed in commit https://github.com/NVIDIA-Merlin/HugeCTR/commit/6dcbc1231fae46f31962602a030d38beb9e379d2 . Thanks!

update: @sohn21c actively working with hugeCTR team to verify


Find bridge interfaces by interface group

This allows users to give their bridges custom names.
We might make use of this as well in the future
(think $POT_BRIDGE_NAME).

@pizzamig The immediate benefit is allowing admins to pre-create the pot bridge and make it part of pf.conf rules using a a good name:
sysrc cloned_interfaces+=bridge0
sysrc ifconfig_bridge0_name=potbridge
sysrc ifconfig_potbridge="inet <IP_ADDRESS>/10"


ImportError when loading metrics

The following code throws an ImportError with libauc==1.3.1.
from libauc.metrics import auc_prc_score
ImportError: cannot import name 'ndcg_at_k' from partially initialized module 'libauc.metrics'
The same error is thrown when importing other metrics such as auc_roc_score.
However, if I import utils first, the error isn't thrown.
import libauc.utils
from libauc.metrics import auc_prc_score

It is an importing issue. We will soon fix it.


build error in production

Describe the bug
when i excute   npm run build

because i add a plugin to css-module my css/scss file, but in development environment, the project can run ~ . Now i want to know the difference between development environment and production environment I need to change(plugin)
Reproduction

System Info
Output of npx envinfo --system --npmPackages vite,@vitejs/plugin-vue --binaries --browsers:
System:
    OS: macOS Mojave 10.14.3
    CPU: (8) x64 Intel(R) Core(TM) i7-4770HQ CPU @ 2.20GHz
    Memory: 1.25 GB / 16.00 GB
    Shell: 5.3 - /bin/zsh
  Binaries:
    Node: 14.16.1 - ~/.nvm/versions/node/v14.16.1/bin/node
    Yarn: 1.13.0 - /usr/local/bin/yarn
    npm: 6.14.12 - ~/.nvm/versions/node/v14.16.1/bin/npm
  Browsers:
    Chrome: 90.0.4430.85
    Firefox: 88.0
    Safari: 12.0.3
  npmPackages:
    vite: ^2.1.5 => 2.2.1

Used package manager:
yarn

The ?.module.styl is added by vite-plugin-transform-css-modules plugin, but it not resolve it at build, you should report to it. The vite dev server should also report this error, i open a pr for make consistence for vite dev and build.

why the vite dev server should also report this error ?

The ?.module.styl is added by vite-plugin-transform-css-modules plugin, but it not resolve it at build, you should report to it. The vite dev server should also report this error, i open a pr for make consistence for vite dev and build.

why the vite dev server should also report this error ?

I think we should make consistence for dev and build, else we will face many similar issues and also break users usage.

ok ~ thanks

@underfin  I finished the new version of the code. Do you think there is a problem with this way?

https://github.com/Summer-andy/vite-react-template

Closing as it's an issue with the vite-plugin-transform-css-modules plugin. I can't reproduce the error in https://github.com/Summer-andy/vite-react-template too.


[FINE] Bug 1556814

bug 1556814: fix attach/detach disks automate methods
https://bugzilla.redhat.com/show_bug.cgi?id=1556814
Backport of Bug 1494442 to fine branch. Includes both the manageiq commit and the manageiq-providers-openstack one, since in fine the two repos aren't separated.

@sseago Do you have a link to the other PR's?  Also, is this a clean backport?  If so, we can add the appropriate labels to the other PRs and they will be backported across repos.

@bdunne It's essentially a clean backport. I cherrypicked the first commit from manageiq directly. The second commit was in the manageiq-providers-openstack repo (post-separation), so I just reproduced it here, but it's equivalent to a cherry-pick if I'd been able to pull it directly from upstream.
Here are the PRs:
https://github.com/ManageIQ/manageiq/pull/16160
https://github.com/ManageIQ/manageiq-providers-openstack/pull/112

@simaishi Can you take a look at this backport?

@sseago When it's a clean cherry-pick, we prefer to backport the original PRs. I backported the 2 PRs mentioned above to Fine branch, so I'm closing this.


feat(derive): Portable Telemetry

Description
An initial pass at injecting a TelemetryProvider trait through the Stages.
Should allow for simple downstream use, just implementing the trait for various global loggers.

Needs rebase


Project is Dead. Need a Migration Plan

I need a migration plan for switching to either djangorestframework-oauth or django-oauth-toolkit.
Basically wrapping the current API to the tools provided by one or the other of the above library seems the way to go.
Also remove this project from pip / etc or give ownership to someone that will treat the huge pile of issue in it.

I forked this project a number of years ago because I needed something that works and I still actively maintain my fork for current Django releases. I changed things enough that I'm not sure that the current issue list completely maps to my fork, but I'd be happy to take on long term maintenance if people like what I did with my fork.
https://github.com/stormsherpa/django-oauth2-provider
https://pypi.org/project/django-oauth2/


helm chart -> DO ClusterLint Error

I use the helm chart in DOKS. I get this error by their ClusterLint

In their guide it is mentioned, it's possible to get this error if FailurePolicy: Fail which is the value I see set in the chart..
Also for sometime cluster (nodes) doesn't automatically scale (down) correctly. While I'm not 100% whether this is the cause but the rough timeline matches from when I installed this controller.

FailurePolicy: Fail

This is required by our RunnerSet to function at all, as it injects runner tokens into runner pods via mutating webhook.
If that's a real issue, try deleting mutatingwebhookconfiguration from your cluster and only use RunnerDeployment.

Also for sometime cluster (nodes) doesn't automatically scale (down) correctly

If you use cluster-autoscaler, kubeclt logs output for the CA pod would help debug this kind of issue. If it doesnt' help, try increasing the verbosity level of CA.


Zsh failing to install

I'm using tecolicom/actions-use-apt-tools@v1 to install some packages on ubuntu-latest. It's working fine on the normal GHA runners (this example repo within the common-setup action), but failing here:
[Build & Publish/Backend] ⭐ Run Main sudo apt-get install -y zsh libnss3-tools
[Build & Publish/Backend]   🐳  docker exec cmd=[bash --noprofile --norc -e -o pipefail /var/run/act/workflow/1-composite-1-composite-self-install.sh] user= workdir=
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
| Package zsh is not available, but is referred to by another package.
| This may mean that the package is missing, has been obsoleted, or
| is only available from another source
|
| E: Package 'zsh' has no installation candidate
| E: Unable to locate package libnss3-tools

Any idea what is going wrong here?

I would not recommend using random actions to do simplest thing on Ubuntu, in this case indexes are outdated because https://github.com/tecolicom/actions-use-apt-tools doesn't update them.

Makes sense. Curious: is the overall goal of act + this image to be compatible with ubuntu-latest such that users can easily reproduce use either environment?

Curious: is the overall goal of act + this image to be compatible with ubuntu-latest such that users can easily reproduce use either environment?

act is supposed to be compatible with GHA design, but it does have few hacks and workarounds for docker images used with it so it works like GHA runners.
The images (this repo) are meant to be most compatible but not complete, they provide various configs and environment variables to make it work like ubuntu-latest but including all the software in a manual way is too much work and not everyone will like 40GB+ docker images.

I do reserve the right to make small changes that might be breaking or look breaking, like installing packages.
That's because GHA runners are constantly re-built every week, so what they contain changes.
In your case you don't have apt update/apt-get update so it will be missing references to dependencies as my images have all apt indexes cleaned during build.
This is to prevent issues in GHA because that problem will occur there as well but it depends heavily on the time when workflow is executed
https://github.com/actions/runner-images/issues/4660#issuecomment-985410278
https://docs.github.com/en/actions/using-github-hosted-runners/using-github-hosted-runners/customizing-github-hosted-runners#installing-software-on-ubuntu-runners


Running Docker Outside The Container

Just prepend docker run -it --rm sgratzl/slack-cleaner for each command  does not work for me.
I only get slack-cleaner to  work if I run it from inside the container shell.

hi,
thx:
docker run -it --rm sgratzl/slack-cleaner -c "slack-cleaner -h"

worked for me.


enable thematics for search query

 Include the "Thematic fields" among the fields searched by the search toolbar


[PORT] Additional Language Support for Confirm/Choice Prompts

Port this change from botbuilder-dotnet/master branch:
https://github.com/microsoft/botbuilder-dotnet/pull/3129

Recognizers-Text added support for a few additional languages that we don't currently support in our Confirm and Choice prompts:

Bulgarian
Hindi
Italian
Korean
Swedish
Turkish

This PR adds support for those, ensures they get test coverage, and also adds test coverage for PromptCultureModels.
Notes:

I skipped adding Arabic support because it is read Right to Left, which makes prompt support tricker.
Recognizers-Text JS SDK currently has only added Italian, but I don't believe there's a reason our C#/Node SDKs need to have matching language support
I'm also far from a polyglot, so most of the translations were provided by [cough]Google Translate[cough]*

Need to Decide Before Merge
English is really the only language that uses the Oxford/Serial comma. I.e, in this sentence:

Yes, no, or maybe

...the second comma is the Oxford/Serial comma. Most other languages would write it as:

Yes, no or maybe

In our SDK, this is the InlineOrMore property:
public static PromptCultureModel Spanish =>
    new PromptCultureModel
    {
        InlineOr = " o ",
        InlineOrMore = ", o ",
        Locale = Culture.Spanish,
        NoInLanguage = "No",
        Separator = ", ",
        YesInLanguage = "Sí",
    };

..without the Oxford comma, InlineOrMore would look the same as InlineOr.
The languages that I added do not have the Oxford comma (as appropriate). However, many of the current languages we have support for do use the comma in our SDK, although would likely not in real life.

[ ] Should those commas be removed in the SDK, or would that possibly create backwards-compat issues?

FYI: This is actually a pretty big PR since Python SDK isn't set up with PromptCultureModels like C#/JS


Option to not run when on battery

When I am on battery, I would rather that BlueBubbles not run. I will not need bluebubbles when on battery because in that case, I will have my mac with me. However, when my mac is at home, plugged in, not sleeping (configured that by turning on internet sharing, which prevents sleep when on AC power), I would like it to run to use bluebubbles. Will such an option be possible? Thanks in advance.

This is possible. Here is the API for it. It will likely be released with v1.5.0 (after the v1.4.0 release): https://www.electronjs.org/docs/latest/api/power-monitor

Thanks. Do you have an idea for the 1.5 release? No pressure to finish it; I'm just wondering.

Thanks. Do you have an idea for the 1.5 release? No pressure to finish it; I'm just wondering.

No, but 1.4.0 should come out shortly. Probably within the next week or so. I'm finishing up the Scheduled Messages API and UI (server). Once that's done, I'm going to release it (maybe a beta first). Then I can start work on 1.5.0 things

Ok

Sorry to bother you, but it is 1.9.0 - is the feature there?

Sorry to bother you, but it is 1.9.0 - is the feature there?

Not yet. I guess I forgot about it. Just to be clear, what is the functionality you want? When it detects it's on battery, just close the server? Do you expect it to re-open when back on power?

Yeah, just have an option for it to close/pause the server when on battery and reopen when connected to AC power. Thanks.

Yeah, just have an option for it to close/pause the server when on battery and reopen when connected to AC power. Thanks.

The problem is, there is no way to detect when the power is connected when the server has already closed itself because the power was disconnected.

Nevermind, I just realized that ControlPlane (I already use it for other
things) can both quit & reopen BB based on battery. Feel free to close this
issue.
On Mon, Nov 20, 2023, 22:03 Zach Shames @.***> wrote:

Yeah, just have an option for it to close/pause the server when on battery
and reopen when connected to AC power. Thanks.
The problem is, there is no way to detect when the power is connected when
the server has already closed itself because the power was disconnected.
—
Reply to this email directly, view it on GitHub
https://github.com/BlueBubblesApp/bluebubbles-server/issues/425#issuecomment-1819415229,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AQJYJKJGTCWLXKP5EJQWP7TYFOA4XAVCNFSM6AAAAAAQ3ZTFHSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMJZGQYTKMRSHE
.
You are receiving this because you authored the thread.Message ID:
@.***>


Homework 10 - Random Div and Mod

Implement Caesar cipher:
https://en.wikipedia.org/wiki/Caesar_cipher
It needs to support both encryption and decryption

 Here is an overview of what got changed by this pull request:

Issues
======
- Added 1

Complexity increasing per file
==============================
- Src/BootCamp.Chapter/CaesarCipher.cs  4

See the complete overview on Codacy

 Here is an overview of what got changed by this pull request:

Complexity increasing per file
==============================
- Src/BootCamp.Chapter/CaesarCipher.cs  4

See the complete overview on Codacy


Bump version requirement for nbformat

Fixes #2491 for notebook pipelines running on KFP and Airflow

What changes were proposed in this pull request?

How was this pull request tested?

Developer's Certificate of Origin 1.1
   By making a contribution to this project, I certify that:

   (a) The contribution was created in whole or in part by me and I
       have the right to submit it under the Apache License 2.0; or

   (b) The contribution is based upon previous work that, to the best
       of my knowledge, is covered under an appropriate open source
       license and I have the right under that license to submit that
       work with modifications, whether created in whole or in part
       by me, under the same open source license (unless I am
       permitted to submit under a different license), as indicated
       in the file; or

   (c) The contribution was provided directly to me by some other
       person who certified (a), (b) or (c) and I have not modified
       it.

   (d) I understand and agree that this project and the contribution
       are public and that a record of the contribution (including all
       personal information I submit with it, including my sign-off) is
       maintained indefinitely and may be redistributed consistent with
       this project or the open source license(s) involved.

Pinning nbformat to 5.1.3 results in
from traitlets.utils import filefind
ImportError: cannot import name 'filefind' from 'traitlets.utils


chore: use highest known nonce

it's possible that this already tracks a higher nonce so we should use that instead.

open for suggestions


Problem with bind

I have such query:
mQuery(mDb, "SELECT * FROM bkk WHERE id in ( :LIST )"
Everything is fine when I use:
        std::string s = "/lhcb/.rdst";
        mQuery.bind(":LIST", LIST);

and I have some output.
Problem occurs when I want to use more values in :LIST:
        std::string s = "/lhcb/.rdst, /lhcb/.rdst";
        mQuery.bind(":LIST", LIST);

mQuery.executeStep() returns me a false.
I tried different ways like:
std::string s = "'/lhcb/.rdst', '/lhcb/.rdst'";
or
std::string s = "\"/lhcb/.rdst\", \"/lhcb/.rdst\"";

But they gives a nothing.
Is it a bug?

Sorry, the SQLite3 does not support binding a list of values at once, and I did not add this to the C++ wrapper myself.
If you see some clean way to do this, through templates for instance, please contribute this back.
Cheers!

Is mDb.execAndGet(SELECT * FROM table WHERE id in ('ID1', 'ID2'))   not a solution here, because execAndGet can't return several rows?


fix(@angular-devkit/build-angular): add validation to fileReplacement values

fileReplacement is meant to replace compilation source files (JavaScript or TypeScript) with other compilation source files in the build. With this change we add validation to fail the build when the files have unsupported extensions.
Closes #11451

Added.


refactor-examples

Codecov Report

Merging #207 (90db1e1) into master (3dfd6e5) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #207   +/-   ##
=======================================
  Coverage   51.88%   51.88%
=======================================
  Files          19       19
  Lines         187      187
  Branches        3        3
=======================================
  Hits           97       97
  Misses         90       90

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3dfd6e5...90db1e1. Read the comment docs.


fix: type annotation issue with Python versions before 3.11

When running python3 -m unbelievaboat from an appropriate venv for Python 3.8 this is returned:
Traceback (most recent call last):
  File "/home/sion/anaconda3/envs/Python3-8/lib/python3.8/runpy.py", line 185, in _run_module_as_main
    mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
  File "/home/sion/anaconda3/envs/Python3-8/lib/python3.8/runpy.py", line 144, in _get_module_details
    return _get_module_details(pkg_main_name, error)
  File "/home/sion/anaconda3/envs/Python3-8/lib/python3.8/runpy.py", line 111, in _get_module_details
    __import__(pkg_name)
  File "/home/sion/Toybox/unbelievaboat/unbelievaboat/__init__.py", line 1, in <module>
    from .Client import Client
  File "/home/sion/Toybox/unbelievaboat/unbelievaboat/Client.py", line 6, in <module>
    from .structures import (
  File "/home/sion/Toybox/unbelievaboat/unbelievaboat/structures/__init__.py", line 2, in <module>
    from .Leaderboard import Leaderboard
  File "/home/sion/Toybox/unbelievaboat/unbelievaboat/structures/Leaderboard.py", line 3, in <module>
    from .UserBalance import UserBalance
  File "/home/sion/Toybox/unbelievaboat/unbelievaboat/structures/UserBalance.py", line 1, in <module>
    from typing import Any, Dict, Optional, Self
ImportError: cannot import name 'Self' from 'typing' (/home/sion/anaconda3/envs/Python3-8/lib/python3.8/typing.py)

When the expected output is:
/home/sion/anaconda3/envs/Python3-8/bin/python3: No module named unbelievaboat.__main__; 'unbelievaboat' is a package and cannot be directly executed

This is a result of the using Type annotation created in a version after the running version of Python.
Specifically typing.Self was introduced in 3.11, as this package targets 3.8+ this needs to be implemented via typing-extensions. Please see docs.python.org/3.11/library/typing.html#typing.Self for more information.

@green-leader thanks for this!
I didn't even notice this in version 2.X which is just getting ready with more fixes and enhancements 😅

v1.2.3 released: https://pypi.org/project/unbelievaboat/1.2.3/


[BULK UPDATE] DocuTune - Fix build validation issues: docs-link-absolute

[BULK UPDATE] DocuTune - Fix build validation issues: docs-link-absolute
Global effort to fix build validation errors
The Microsoft Skilling team is fixing build validation errors and specific brand inconsistencies in Microsoft technical documentation for the rest of FY23 Q1. This will help address various accessibility, security, and usability issues. This PR was generated using DocuTune. It includes only targeted fixes and minor formatting adjustments.
DocuTune PRs improve quality of technical content by finding and automatically correcting a broad set of issues only where the correction is suitable. Please review within five business days and merge or comment in the PR with any changes you'd like to see. Thank you!
CorrelationId: 0df9c2d6-63f8-4d1e-8b57-b33611a06514
InitiativeId: docutune-build-validation-issues-2022-05
PointOfContact: Alex Buck

#docutune-draft

Docs Build status updates of commit 550fcba:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

README.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

#docutune-ready

@AngryBerryMS @DhurataJ @herohua @JiayueHu @tfosmark @v-pegao @VSC-Service-Account @Xieyan
Please merge the changes in this PR. For more information, see the description at the top of this PR.
Any pre-existing build validation issues or insufficient Acrolinx scores should be addressed in a separate PR.
#docutune-request-approval

@apurvmi @brucehuy @chrisda @hrodrigues-ms @KCCross @lindalu-MSFT @NagasudhaBuragoni @Saisang @samschan-ms
Please merge the changes in this PR. For more information, see the description at the top of this PR.
Any pre-existing build validation issues or insufficient Acrolinx scores should be addressed in a separate PR.
#docutune-request-approval


Add usage examples

Proposed Changes

Add usage examples
Update README with RAG example

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
151

Relevant Lines:
151

💛  - Coveralls


Please use the Google form for reporting typing issues

We've received numerous reports regarding typing issues, and we truly appreciate your valuable feedback.
To streamline the process from issue reporting to resolution, we've created a dedicated Google Form for typing issues, replacing the previous use of GitHub issues. We believe this will simplify the reporting process for both reporters and maintainers, as well as better organize typing-related issues from other concerns.
Form for reporting typing issues:

https://forms.gle/oXgwbqzvSyVHNBSc7

The filled reports are available at:

Typing issue for Mozc (Responses)

If this new form doesn't work well, we would update the process again.
Thank you for your cooperation.

For multiple URLs, please use the Context field.
I have updated the descriptions in the form.
Thank you,

Yes, please use this form for symbols including single kanji characters too.
I added "Symbol" to the category.
Thank you,


[Question] Model converted using TensorRT is slower than native Pytorch

Hi All,
We try to run resent18 model faster than just running the torchvision version on GPU, therefore we planned to convert and quantize the model using TensorRT. However, we did not witness a performance boost after the conversion.
We tried to play with the ir mode using both torch_compile and dynamo in addition we tried varying values of optimization_level which also did not help.
Adding here code snip:
import logging
import time

import torch_tensorrt
import torchvision
import torch
from torch.utils.data import DataLoader

from src.utils.utils import set_logger

set_logger()

@torch.no_grad()
def benchmark(model, inputs):
    times = list()
    for i in range(100):
        t = time.time()
        model(inputs)
        torch.cuda.synchronize()
        times.append(time.time() - t)
    return sum(times) / len(times), times

if __name__ == '__main__':
    # dataset = torchvision.datasets.STL10(
    #     root='/tmp/data',
    #     split='train',
    #     download=True,
    #     transform=torchvision.transforms.ToTensor()
    # )
    # loader = DataLoader(dataset, batch_size=2)
    bs = 128
    dummy_input = torch.rand(bs, 3, 96, 96).cuda()
    model = torchvision.models.resnet18(pretrained=True)
    model.fc = torch.nn.Linear(512, 10)  # Change the output layer to have 10 classes
    model.cuda()
    model.eval()

    ir_mode = "dynamo"
    # ir_mode = "torch_compile"

    trt_mod = torch_tensorrt.compile(
        model,
        ir=ir_mode,
        inputs=[torch_tensorrt.Input((bs, 3, 96, 96))],
        enabled_precisions={torch.float32},
        device=torch.device('cuda:0'),
        optimization_level=5,
    )
    avg_time, times = benchmark(model, dummy_input)
    logging.info(f"Model pytorch 32fp: {avg_time}")

    avg_time, times = benchmark(trt_mod, dummy_input)
    logging.info(f"Model compiled to TensorRT 32fp: {avg_time}")

    avg_time, times = benchmark(model.half(), dummy_input.half())
    logging.info(f"Model 16fp: {avg_time}")

    trt_mod = torch_tensorrt.compile(
        model.half(),
        ir=ir_mode,
        inputs=[torch_tensorrt.Input((bs, 3, 96, 96), dtype=torch.half)],
        enabled_precisions={torch.float16},
        device=torch.device('cuda:0'),
        optimization_level=5,
    )
    avg_time, times = benchmark(trt_mod, dummy_input.half())
    logging.info(f"Model compiled to TensorRT 16fp: {avg_time}")

Adding Logs for running with dynamo:
torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead.
  _torch_pytree._register_pytree_node(
/opt/conda/envs/faster-whisper/lib/python3.9/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.
  warnings.warn(
/opt/conda/envs/faster-whisper/lib/python3.9/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=ResNet18_Weights.IMAGENET1K_V1`. You can also use `weights=ResNet18_Weights.DEFAULT` to get the most up-to-date weights.
  warnings.warn(msg)
INFO:torch_tensorrt.dynamo._compiler:Compilation Settings: CompilationSettings(precision=torch.float32, debug=False, workspace_size=0, min_block_size=5, torch_executed_ops=set(), pass_through_build_failures=False, max_aux_streams=None, version_compatible=False, optimization_level=5, use_python_runtime=False, truncate_long_and_double=False, use_fast_partitioner=True, enable_experimental_decompositions=False, device=Device(type=DeviceType.GPU, gpu_id=0), require_full_compilation=False, disable_tf32=False, sparse_weights=False, refit=False, engine_capability=<EngineCapability.DEFAULT: 0>, num_avg_timing_iters=1, dla_sram_size=1048576, dla_local_dram_size=1073741824, dla_global_dram_size=536870912, output_format='exported_program')

INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:TRT INetwork construction elapsed time: 0:00:00.304469
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:Using optimization level 5
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:Build TRT engine elapsed time: 0:00:17.935200
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:TRT Engine uses: 113246208 bytes of Memory
/opt/conda/envs/faster-whisper/lib/python3.9/site-packages/torch/_export/exported_program.py:333: UserWarning: Unable to execute the generated python source code from the graph. The graph module will no longer be directly callable, but you can still run the ExportedProgram, and if needed, you can run the graph module eagerly using torch.fx.Interpreter.
  warnings.warn(
INFO:root:Model pytorch 32fp: 0.021189916133880615
INFO:root:Model compiled to TensorRT 32fp: 0.02402569055557251
INFO:root:Model 16fp: 0.01123286247253418
INFO:torch_tensorrt.dynamo._compiler:Compilation Settings: CompilationSettings(precision=torch.float16, debug=False, workspace_size=0, min_block_size=5, torch_executed_ops=set(), pass_through_build_failures=False, max_aux_streams=None, version_compatible=False, optimization_level=5, use_python_runtime=False, truncate_long_and_double=False, use_fast_partitioner=True, enable_experimental_decompositions=False, device=Device(type=DeviceType.GPU, gpu_id=0), require_full_compilation=False, disable_tf32=False, sparse_weights=False, refit=False, engine_capability=<EngineCapability.DEFAULT: 0>, num_avg_timing_iters=1, dla_sram_size=1048576, dla_local_dram_size=1073741824, dla_global_dram_size=536870912, output_format='exported_program')

INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:TRT INetwork construction elapsed time: 0:00:00.251508
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:Using optimization level 5
[04/03/2024-18:24:49] [TRT] [W] TensorRT encountered issues when converting weights between types and that could affect accuracy.
[04/03/2024-18:24:49] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
[04/03/2024-18:24:49] [TRT] [W] Check verbose logs for the list of affected weights.
[04/03/2024-18:24:49] [TRT] [W] - 1 weights are affected by this issue: Detected subnormal FP16 values.
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:Build TRT engine elapsed time: 0:00:40.797937
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:TRT Engine uses: 56623104 bytes of Memory
/opt/conda/envs/faster-whisper/lib/python3.9/site-packages/torch/_export/exported_program.py:333: UserWarning: Unable to execute the generated python source code from the graph. The graph module will no longer be directly callable, but you can still run the ExportedProgram, and if needed, you can run the graph module eagerly using torch.fx.Interpreter.
  warnings.warn(
INFO:root:Model compiled to TensorRT 16fp: 0.0108557391166687

Most of the time, this test yields on/sub par results compared with the native pytorch model without a significant boost as expected.
Environment
We are using g4dn aws machine with the following env:

PyTorch Version: 2.2.0
CPU Architecture: x86_64
OS (e.g., Linux): Linux
How you installed PyTorch: pip
Python version: 3.9.16
CUDA version: 11.8
GPU models and configuration: Tesla T4

What are we missing here? How can we make resnet18 model run faster (and in general for any pytorch model)?
@avivnavon

Hello - here are a few things to try:

For the timing, consider using time.time_ns(), then divide by 1e9 instead of time.time(), for timing precision
In the benchmarks (especially when using ir="torch_compile", run the model a few times before benchmarking for warmup, as in:

    # Warmup model
    for _ in range(10):
        model(inputs)
    torch.cuda.synchronize()

    ...

    # Benchmark

Try ir="torch_compile"
Try omitting optimization_level=5 to see the performance with the default optimization level

Potentially related: #2720

Hi @gs-olive
Thanks for the tips!
Here are the logs after using torch_compile and omitting optimization_level:
/opt/conda/envs/faster-whisper/lib/python3.9/site-packages/transformers/utils/generic.py:441: UserWarning: torch.utils._pytree._register_pytree_node is deprecated. Please use torch.utils._pytree.register_pytree_node instead.
  _torch_pytree._register_pytree_node(
/opt/conda/envs/faster-whisper/lib/python3.9/site-packages/torchvision/models/_utils.py:208: UserWarning: The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.
  warnings.warn(
/opt/conda/envs/faster-whisper/lib/python3.9/site-packages/torchvision/models/_utils.py:223: UserWarning: Arguments other than a weight enum or `None` for 'weights' are deprecated since 0.13 and may be removed in the future. The current behavior is equivalent to passing `weights=ResNet18_Weights.IMAGENET1K_V1`. You can also use `weights=ResNet18_Weights.DEFAULT` to get the most up-to-date weights.
  warnings.warn(msg)
INFO:root:Model pytorch 32fp: 0.019387660026550294
INFO:torch_tensorrt.dynamo.utils:Using Default Torch-TRT Runtime (as requested by user)
INFO:torch_tensorrt.dynamo.utils:Compilation Settings: CompilationSettings(precision=torch.float32, debug=False, workspace_size=0, min_block_size=5, torch_executed_ops=set(), pass_through_build_failures=False, max_aux_streams=None, version_compatible=False, optimization_level=None, use_python_runtime=False, truncate_long_and_double=False, use_fast_partitioner=True, enable_experimental_decompositions=False, device=Device(type=DeviceType.GPU, gpu_id=0), require_full_compilation=False, disable_tf32=False, sparse_weights=False, refit=False, engine_capability=<EngineCapability.DEFAULT: 0>, num_avg_timing_iters=1, dla_sram_size=1048576, dla_local_dram_size=1073741824, dla_global_dram_size=536870912, output_format='exported_program')

INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:TRT INetwork construction elapsed time: 0:00:00.412299
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:Build TRT engine elapsed time: 0:00:05.120540
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:TRT Engine uses: 35389440 bytes of Memory
INFO:root:Model compiled to TensorRT 32fp: 0.0071489191055297855
INFO:root:Model 16fp: 0.0037212777137756348
INFO:torch_tensorrt.dynamo.utils:Using Default Torch-TRT Runtime (as requested by user)
INFO:torch_tensorrt.dynamo.utils:Compilation Settings: CompilationSettings(precision=torch.float16, debug=False, workspace_size=0, min_block_size=5, torch_executed_ops=set(), pass_through_build_failures=False, max_aux_streams=None, version_compatible=False, optimization_level=None, use_python_runtime=False, truncate_long_and_double=False, use_fast_partitioner=True, enable_experimental_decompositions=False, device=Device(type=DeviceType.GPU, gpu_id=0), require_full_compilation=False, disable_tf32=False, sparse_weights=False, refit=False, engine_capability=<EngineCapability.DEFAULT: 0>, num_avg_timing_iters=1, dla_sram_size=1048576, dla_local_dram_size=1073741824, dla_global_dram_size=536870912, output_format='exported_program')

INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:TRT INetwork construction elapsed time: 0:00:00.263242
[04/07/2024-09:10:35] [TRT] [W] TensorRT encountered issues when converting weights between types and that could affect accuracy.
[04/07/2024-09:10:35] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
[04/07/2024-09:10:35] [TRT] [W] Check verbose logs for the list of affected weights.
[04/07/2024-09:10:35] [TRT] [W] - 1 weights are affected by this issue: Detected subnormal FP16 values.
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:Build TRT engine elapsed time: 0:00:15.061290
INFO:torch_tensorrt.dynamo.conversion._TRTInterpreter:TRT Engine uses: 17694720 bytes of Memory
INFO:root:Model compiled to TensorRT 16fp: 0.0017661261558532715

This specific run is with batch_size=40 I tried other sizes as well, and in all of them the compiled model was faster by ~2X.
@gs-olive do you have more tips to make the model even faster? I want to squeeze as make as possible.

Hello - some other things to try are to modify the workspace_size parameter and to use Nsight Systems to profile runs, to identify which layers/components in the model are taking the longest. This can help with further identifying performance gaps and opportunities

Generally, the default selection for workspace is a good choice. In this case, some values to try might be the total GPU memory, and different percentages of the total to see if the runtimes vary.
workspace corresponds to the amount of space allowed to TensorRT to build and run inference with the particular model. Varying the workspace can enable selection of different performance tactics, so this might yield some change in perf.
One other thing to try is wrapping the compilation and inference in with torch.no_grad(), to ensure any parts running in Torch are not tracking gradient information.


Why is this repo empty?

I was thinking about creating bindings from Rust to cronet myself but didn't want to reinvent the wheel so I checked GitHub search, where I noticed this repository in the results. But why is it empty? Do you plan to actually put any source code here in the future?

XVI — Yesterday at 4:59 AM
I never pushed them
[4:59 AM]
I also don't have access to the computer they are on lmao

If anyone is reading this, I've built my own solution here: https://github.com/sleeyax/cronet-rs.


[usb/knob] 'Get permissions' error

Running on Win7 64 bit, Chrome version 38.0.2125.101
The version from the App doesn't work with a Griffen puck (just shows a blank window, nothing turns). Debugging the code from the repo shows I'm getting a thrown error on line 87 of knob.js when the ask permission button is pushed
"Uncaught TypeError: Cannot read property 'addEventListener' of null
I'm learning how to control USB devices via Chrome JavaScript so unfortunately can't offer any further help as to what the problem is.

Hello @DanMcLaughlin,
Do you still see the error?

Yeah, but I've moved on to other projects, go ahead and close it, thanks.


[Enhancement] Compatible with msql use 'truncate' to delete partitions

What type of PR is this：

[ ] bug
[ ] feature
[x] enhancement
[ ] refactor
[ ] others

Which issues of this PR fixes ：

Fixes #9528
Problem Summary(Required) ：

// ALTER TABLE test TRUNCATE PARTITION p1;
The current behavior of mysql with the above statement is to clear the partition data and keep the partition structure, StarRocks does not implement this statement
This PR will enable StarRocks to perform the same functions as mysql
Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] I have added user document for my new feature or new function

[FE PR Coverage Check]
:disappointed: fail : 3 / 22 (13.64%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
0
4
00.00%
[884, 885, 886, 888]

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[562]

:large_blue_circle:
com/starrocks/sql/analyzer/AlterTableStatementAnalyzer.java
0
1
00.00%
[198]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
0
8
00.00%
[13, 14, 17, 18, 19, 22, 27, 33]

:large_blue_circle:
com/starrocks/alter/Alter.java
1
6
16.67%
[382, 383, 384, 385, 386]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

[FE PR Coverage Check]
:disappointed: fail : 3 / 22 (13.64%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
0
4
00.00%
[884, 885, 886, 888]

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[562]

:large_blue_circle:
com/starrocks/sql/analyzer/AlterTableStatementAnalyzer.java
0
1
00.00%
[198]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
0
8
00.00%
[12, 13, 16, 17, 18, 21, 26, 31]

:large_blue_circle:
com/starrocks/alter/Alter.java
1
6
16.67%
[384, 385, 386, 387, 388]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

[FE PR Coverage Check]
:disappointed: fail : 3 / 22 (13.64%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
0
4
00.00%
[884, 885, 886, 888]

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[562]

:large_blue_circle:
com/starrocks/sql/analyzer/AlterTableStatementAnalyzer.java
0
1
00.00%
[198]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
0
8
00.00%
[12, 13, 16, 17, 18, 21, 26, 31]

:large_blue_circle:
com/starrocks/alter/Alter.java
1
6
16.67%
[384, 385, 386, 387, 388]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

[FE PR Coverage Check]
:disappointed: fail : 10 / 21 (47.62%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
0
4
00.00%
[884, 885, 886, 888]

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[562]

:large_blue_circle:
com/starrocks/alter/Alter.java
1
6
16.67%
[384, 385, 386, 387, 388]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
7
8
87.50%
[26]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

[FE PR Coverage Check]
:disappointed: fail : 17 / 22 (77.27%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[562]

:large_blue_circle:
com/starrocks/system/SystemInfoService.java
0
1
00.00%
[1099]

:large_blue_circle:
com/starrocks/alter/Alter.java
4
6
66.67%
[387, 388]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
7
8
87.50%
[26]

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
4
4
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

[FE PR Coverage Check]
:heart_eyes: pass : 17 / 21 (80.95%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[562]

:large_blue_circle:
com/starrocks/alter/Alter.java
4
6
66.67%
[387, 388]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
7
8
87.50%
[26]

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
4
4
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

run starrocks_admit_test

run starrocks_admit_test

run starrocks_admit_test

[FE PR Coverage Check]
:heart_eyes: pass : 17 / 21 (80.95%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[562]

:large_blue_circle:
com/starrocks/alter/Alter.java
4
6
66.67%
[387, 388]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
7
8
87.50%
[26]

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
4
4
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

run starrocks_admit_test

run starrocks_admit_test

run starrocks_admit_test

run starrocks_fe_unittest

[FE PR Coverage Check]
:heart_eyes: pass : 20 / 24 (83.33%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[562]

:large_blue_circle:
com/starrocks/alter/Alter.java
7
9
77.78%
[443, 444]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
7
8
87.50%
[26]

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
4
4
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

run starrocks_admit_test

run starrocks_fe_unittest

[FE PR Coverage Check]
:heart_eyes: pass : 20 / 24 (83.33%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[568]

:large_blue_circle:
com/starrocks/alter/Alter.java
7
9
77.78%
[450, 451]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
7
8
87.50%
[26]

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
4
4
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

run starrocks_admit_test

run starrocks_fe_unittest

[FE PR Coverage Check]
:heart_eyes: pass : 19 / 22 (86.36%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/sql/ast/AstVisitor.java
0
1
00.00%
[568]

:large_blue_circle:
com/starrocks/alter/Alter.java
6
7
85.71%
[473]

:large_blue_circle:
com/starrocks/analysis/TruncatePartitionClause.java
7
8
87.50%
[26]

:large_blue_circle:
com/starrocks/sql/parser/AstBuilder.java
4
4
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOpType.java
1
1
100.00%
[]

:large_blue_circle:
com/starrocks/alter/AlterOperations.java
1
1
100.00%
[]

https://github.com/Mergifyio backport branch-2.4


Discrepant results

Hello, Thanks for your great work.
I tried to reproduce some results in your paper, but got some discrepant results.
For example, I will Human Pose with exactly the same prompt "Michael Jackson's concert". Yet, it seems that the generated pictures are unrelated to the original one. Could you shed some lights on what the reason might be? Thanks!

if using webui plugin, you need to enable controlnet so that controlnet will take effects.

Thanks. I use https://huggingface.co/spaces/hysts/ControlNet to do this task. Where can I enable the controlNet?


Lookup activity in Azure Data Factory and Azure Synapse Analytics

It's really good article. Activities are explained well too. Well, if there is one line of explanation for each of these properties (like timeout, retry etc.,) it would be more helpful.
Thanks :)

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ede89f3f-055a-b123-c081-8622a9035171
Version Independent ID: c4fe312f-71a6-fe9b-e301-6e69c14ca46d
Content: Lookup activity - Azure Data Factory & Azure Synapse
Content Source: articles/data-factory/control-flow-lookup-activity.md
Service: data-factory
Sub-service: orchestration
GitHub Login: @jianleishen
Microsoft Alias: jianleishen

Thank you for reaching out and bringing this to our notice. At this time we are reviewing the feedback and will provide an update as appropriate.

We have assigned the issue to the content author to further review this and update the document as appropriate.

Hi @NaganandiniS. Thanks for your dedication to our documentation. Unfortunately, at this time we have been unable to review your issue in a timely manner and we sincerely apologize for the delayed response. We are closing this issue for now, but if you feel that it's still a concern, please respond and let us know. If you determine another possible update to our documentation, please don't hesitate to reach out again. #please-close


Fixes ResolvedRefs HTTPRoute Status Condition Calculation

Updates ProcessHTTPRoutes() to check the availability of all route backends, e.g. Services, and sets the RouteConditionResolvedRefs condition accodingly.
Requires #495
Fixes #415

@danehans a similar status calculation needs to be done for all other status conditions as well and not just RouteConditionResolvedRefs . The core issue here is that the translator only appends conditions and never clears them.
suggest considering an approach outlined in https://github.com/envoyproxy/gateway/issues/415#issuecomment-1267379573

@arkodg from my understanding of https://github.com/envoyproxy/gateway/pull/516, this PR is still required.

Closed in favor of https://github.com/envoyproxy/gateway/pull/516.


Install without Windows Store???

Hello everybody,
is there a way to install the Windows Terminal without the Windows Store.
I would love to use this on my works developer maschine, but I dont have access to the windows store and I dont have administrator rights to install anything.
I would love to have a portable terminal, so that I can store into a folder and start it from there.
Is there a way to do this?
Thanks in advance for your help.

Portable version of Windows Terminal would be dope.

You can definitely install without the store: on the home page of the project there are several ways of installing terminal without store, including download of binaries from GitHub.
BUT :blush: I believe that, despite the title of the ticket, what you are mostly asking is whether there is a portable mode. I am not sure there is an official one, but I've seen few workarounds - please address the discussion in https://github.com/microsoft/terminal/issues/1386

I have found a workaround myself.
I just had to unzip the package and I could start it with the exe in the files.
Yes, I would love to get a portable version and that should be the title anyway.
Thank you for your help.

This is going to be covered by /dup #1386. Thanks!

How can microsoft not figure out how to release using it's own installer technology after 3 years of that issue being opened.  jfc, #1386 shows this is just clown school.


Erik o Eriks datetime.datetime

The code is easy to follow and understand.
Some test names like “testCreateArgs()” could be changed, it might be better to name it “testCreateDateTime”.
You could have a test where you have another input type than int.

Some test names like “testCreateArgs()” could be changed, it might be better to name it “testCreateDateTime”.
As it is not simply a test for create DateTime we think we will keep it as it is. Since we want separate tests for args and kwargs. Perhaps testCreateDateTimeArgs would be more descriptive, or maybe too much?

You could have a test where you have another input type than int.
Nice catch! Added a test for floats as well!

Thanks for the input!


Mobile - Follower Pop Up

created and designed pop up menu, also created user model and controller for following and followers


Events API: Fix 500-error when filtering

This fixes #1351. The error was cryptic and well-hidden, but I narrowed
it to ill-made filter for tags.
Probably the idea was to allow people put in exact tag names, but now
it's easy to do with Django Filter options.

@anenadic @fmichonneau @symulation @maneesha hello everyone, I'm tagging you here because you seem to be using AMY API and I'm going to change this API endpoint:
https://amy.software-carpentry.org/api/v1/events/
(this is not https://amy.software-carpentry.org/api/v1/events/published/)
Instead of allowing ?tag=xxx&tag=yyy in URL, we're switching to ?tags=xxx&tags=yyy. Please check if your scripts are using this endpoint and update if necessary. The change is in filter syntax - now it's tags instead of tag - and in behavior (tags are conjoined, so events have to have all supplied tags to appear in the results).


Google Documents integration

Any chance to get this to work with Google Documents (aka Google Drive)?
I love this extension and I would really like to use it with my google docs: this would allow to easily adapt the appearance of the document elements without being constrained by google docs own styles/structure elements.
For example: there is no "code" style in google docs so the best you can do is manually select the font each time etc which is very unsatisfying.
An option would be to exploit the Google App Script framework but it does not seem to support injection of HTML+CSS into the document.
Any idea on how to do that?

Any update on this?

I support that this feature would be amazing. I have grown to like markdown so much that it's my first option for writing, always. But whenever I'm sharing documents with people (as in Drive) I still need to make the format understandable for everyone.
It would be great to listen from @adam-p or any other experienced contributor if this enhancement could be simpler now with Google docs add-ons.

up -- is this still something that's being considered? The add-on is great for emails, but the Google Drive feature would take it a big step up

I'm not sure if this is an obvious solution, and i'm just slow, but I was searching for a way to use "Markdown here" in Google Docs and it didnt seem to work just by clicking the extension icon.
But if I copied all of my markdown formatted text (say, from ChatGPT) , then right clicked In Google Docs, there's an option for "Paste from Markdown" which pasted the text with properly styled format.


Tornado Plot

Hi @iqis, @kaz462,
Please find a PR for the second article - Tornado plot. It's a straight forward addition. The lock file has been updated to include all deps for the {ggh4x} package. You can do a diff or I've pasted it below:
RSPM

cli         [3.3.0 -> 3.6.0]
ggplot2     [3.3.6 -> 3.4.0]
lifecycle   [repo: CRAN -> RSPM; ver: 1.0.1 -> 1.0.3]
rlang       [repo: CRAN -> RSPM; ver: 1.0.2 -> 1.0.6]
vctrs       [repo: CRAN -> RSPM; ver: 0.4.1 -> 0.5.2]
ggh4x       [* -> 0.2.3]

This covers issue #18

I rendered the book and took a brief look at. It seems alright. But we may need some sort of regression testing when we change package versions in the future?

I rendered the book and took a brief look at. It seems alright. But we may need some sort of regression testing when we change package versions in the future?

Hi @iqis
Thanks for reviewing.  I also did a sweep of previous content and agree we should consider a path forward for regression testing. It was a bit laborious, and unless there are automatic frameworks or streamlined ways (I'm unfamiliar), I like the idea of reviewing with the cadence of every few months or so. The nice thing is with this round, we have the latest version of ggplot (3.4.0), which should keep us afloat.
If all else is well, please merge this and let's discuss RT in a separate issue.


Use case in README error in EmailStr

Use case in README is following.
`
import datetime
from typing import Optional
from pydantic import EmailStr, ValidationError
from redis_om import HashModel
class Customer(HashModel):
first_name: str
last_name: str
email: EmailStr
join_date: datetime.date
age: int
bio: Optional[str]
andrew = Customer(
first_name="Andrew",
last_name="Brookins",
<EMAIL_ADDRESS>join_date=datetime.date.today(),
age=38,
bio="Python developer, works at Redis, Inc."
)
`
It'll response error
ValidationError: 1 validation error for Customer email   instance of EmailStr expected (type=type_error.arbitrary_type; expected_arbitrary_type=EmailStr)

So the issue here is that when we, added Pydantic 2.0 support, we really only allowed users to allow Redis OM Python to co-exist with pydantic 2.0 rather than actually supporting it properly, consequentially, if you are using the old examples, you need to import things like EmailStr from pydantic.v1 rather than pydantic. I've updated the README to reflect this reality.


Adapt CI to match version generation between build and qemu-bundles-tests steps

Signed-off-by: Mauro Morales<EMAIL_ADDRESS>
What this PR does / why we need it:
The test with kubo was failing because there's a version check done by systemd-sysext and it didn't match. The issue comes from the new way of fetching the version from git, which in the build step we use the full history and tags so it will look something like v1.2.3-sha-dirty while in the qemu-bundles-tests we fetch only the last commit without tags or history so it looks just like sha.
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Let's make master green again!

Codecov Report

Merging #675 (af0e825) into master (3883f0e) will increase coverage by 0.05%.
The diff coverage is 50.00%.

@@            Coverage Diff             @@
##           master     #675      +/-   ##
==========================================
+ Coverage   19.88%   19.94%   +0.05%
==========================================
  Files          18       18
  Lines        1413     1419       +6
==========================================
+ Hits          281      283       +2
- Misses       1085     1088       +3
- Partials       47       48       +1

Impacted Files
Coverage Δ

pkg/config/config.go
56.44% <50.00%> (-0.64%)
:arrow_down:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

awesome, good catch!


CSS from style tag is extracted as text

I've encountered a situation where go-domdistiller extracts CSS from a


python3Packages.testfixtures: 6.14.2 -> 6.15.0

Signed-off-by: Sirio Balmelli<EMAIL_ADDRESS>
Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[x] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[x] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

This update is already part of #105368. If there are no other relevant changes this PR is not needed and the update will land soon in master. Thanks for your PR nevertheless.

ok, thanks :)
I'll check against python-staging in the future, not just master


fix: do not bundle .md files in cocoapods deployments

Fixes: https://linear.app/customerio/issue/MBL-180/[bug]-resolve-md-file-causing-compilation-issues-for-ios-customers
Customers experience compilation errors in their iOS/RN/Flutter/Expo apps due to customer's apps trying to parse .md files that are bundled with our SDK in production releases.
The issue is resolved by an update to the native iOS SDK cocoapods files. This change points to the latest cocoapods release to use these changes.

Failed CI status checks being fixed in another PR pointing to main


Can't use -z with test name starting with exclude

I have a test called exclude_nested_map_with_scalar_from_flattening. When trying to run it with -z in ScalaTest 2.2.4, I get
> testOnly scalan.FlatteningTests -- -z exclude_nested_map_with_scalar_from_flattening
WARNING: Argument 'exclude' has been deprecated and will be removed in a future version of ScalaTest.  Please use -l instead.
[trace] Stack trace suppressed: run last enterprise-edition/test:testOnly for the full output.
[error] (enterprise-edition/test:testOnly) java.lang.IllegalArgumentException: Invalid configuration, example valid configuration: exclude(a, b, c)
[error] Total time: 0 s, completed Apr 17, 2015 3:51:22 PM

Sorry, that's a good one! I believe we removed those deprecation warnings entirely from 2.3.x, but we'll double check.


Wayland users, how does your window manager identify itself?

Wayland currently has no central place where we can fetch the name of the window manager that you use.
My question is, how does your window manager identify itself?
In the case of Sway, it sets an environment variable SWAYSOCK that points to a socket on the filesystem, which we can quickly and easily check. Qtile does the same too, but a little differently.
I don't know about the others, but maybe you can tell us.

Default GNOME on Fedora 36 fails with Unknown window manager.

Do XDG_CURRENT_DESKTOP or DESKTOP_SESSION say anything?

GNOME and gnome, respectively. I got the window manager by the fact that it was using a socket (shell command: ps -p $(lsof -t "$XDG_RUNTIME_DIR/$WAYLAND_DISPLAY") -ho comm). I get gnome-shell, which is a Mutter plugin.

Yeah, we don't currently look for mutter, as can be seen in this file.
Because there's no centralized place to query for this information, we sort of have to resort to detection in the most naive way possible, which currently doesn't support nested wayland compositors.

wayland-info reports lots of data, but none of it mentions the name of my compositor, which leads me to believe that there's currently no way, perhaps in the future though.

i would try and copy fastfetch
they get the DE from $XDG_CURRENT_DESKTOP
the WM is a little more complicated
fastfetch seems to be following this stackoverflow answer https://stackoverflow.com/a/72755046
it gets a file descriptor using wl_display_get_fd
then gets the pid of the process connected to the socket
and then gets the name

i actually just wrote an implementation for my fetch that uses libmacchina
pub fn window_manager() -> Error<String> {
    if !is_lib_available() {
        return Err(ReadoutError::MetricNotAvailable);
    }

    let display_ptr = unsafe {
        ffi_dispatch!(
            wayland_client_handle(),
            wl_display_connect,
            ::std::ptr::null()
        )
    };

    if display_ptr.is_null() {
        return Err(ReadoutError::MetricNotAvailable);
    }

    let display_fd =
        unsafe { ffi_dispatch!(wayland_client_handle(), wl_display_get_fd, display_ptr) }
            .as_raw_fd();

    let pid = getsockopt(display_fd, sockopt::PeerCredentials)
        .map_err(|_| ReadoutError::MetricNotAvailable)?
        .pid();

    Ok(std::fs::read_to_string(format!("/proc/{}/comm", pid))?)
}

would be my first contribution to an open source project
always happy to learn
yea, i can try

i made the pull request


Update customformats.js

Good job in making a pull req. But you gotta fix those errors.
 Update customformats.js does not tell me anything useful.

There are few syntax errors, due to which the server will definitely crash.
Also, too many style errors.

fixed in d53569e9f2648150df9aa41ac054dee6c875cb1c
Next time, do it properly.


Rectify two fermyon.dev URLs in Spin documentation.

The following page https://developer.fermyon.com/spin/deploying-to-fermyon.md (GitHub URL: https://github.com/fermyon/developer/blob/main/content/spin/deploying-to-fermyon.md) links to two URLs that are on the fermyon.dev domain:

https://www.fermyon.dev/quickstart-aws
https://www.fermyon.dev/quickstart-local

A few thoughts/ideas on how to proceed:

If the content from quickstart-aws and quickstart-local is redundant, can we please link to the newer versions of this content (replace the URLs on the deploying-to-fermyon page)?
If the content is not redundant and is required as part of the developer documentation, can we please create a new page for each on the developer.fermyon.com domain instead (adding appropriate in-page and sidebar menu linking at the same time)?

Additional notes: A search of the developer repository showed only this single page as having any fermyon.dev URLs:
grep -rl "https://www.fermyon.dev/" content
content/spin/deploying-to-fermyon.md

Thankfully it seems, give the above, that this is a stand-alone case that can be rectified fairly quickly.

Is that source page reachable from anywhere?  It's not showing a TOC location.
Those pages are not redundant, but apply to Platform, not to Spin or Cloud.  So it sounds like we need to make a decision about the status of Platform documentation (which may mean a decision about the status of Platform).  Like Platform is not covered by the post-1.3 cloud plugin; there is an experimental platform plugin, but it's not blessed like cloud is.  Should there be a Platform project like there is for Cloud?  Is it in a state where we can present it that way?  These are probably broader questions...


don't dereference a possibly null pointer

AHardwareBuffer_lock can succeed and yet not provide a data pointer

CI gfxreconstruct build queued with queue ID 9269.

CI gfxreconstruct build queued with queue ID 9271.

CI gfxreconstruct build # 2028 running.

CI gfxreconstruct build # 2028 passed.

It still triggered this assertion.
vulkan_state_writer.cpp:1065: void gfxrecon::encode::VulkanStateWriter::ProcessHardwareBuffer(format::HandleId, AHardwareBuffer *, VkDeviceSize): assertion "data != nullptr" failed

Yes, I only changed the other assert.  I figured this would be applied
after your PR is merged.
On Fri, Oct 7, 2022 at 9:58 PM Locke Lin @.***> wrote:

It still triggered this assertion.
vulkan_state_writer.cpp:1065: void gfxrecon::encode::VulkanStateWriter::ProcessHardwareBuffer(format::HandleId, AHardwareBuffer *, VkDeviceSize): assertion "data != nullptr" failed
—
Reply to this email directly, view it on GitHub
https://github.com/LunarG/gfxreconstruct/pull/839#issuecomment-1272227853,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMCLT74R6ZYBOMN2QL3B7PTWCD5PRANCNFSM6AAAAAAQ76CK7Y
.
You are receiving this because you authored the thread.Message ID:
@.***>

--
Brad Grantham
Senior Graphics Software Engineer
LunarG, Inc. - 3D Graphics Software Solutions
@.***


Unknown provider

JS-Error in current master if you open motion list view:
Unknown provider: PdfImageConverterProvider <- PdfImageConverter <- MotionPartialContentProvider <- MotionPdfExport
Introduced with lsat pull request #3239.

@FinnStutzenstein Can you give me a hint how to fix it?

The provider has been renamed:
Just change 'PdfImageConverter' to 'ImageConverter'
Strange; i did a grep to check, that I didn't forget anything...

Thanks!


[Release] Internal Memo - Added funds

Context

What's being released?

Is this change being released incrementally as a beta? What's the schedule?

Is this release optional or mandatory?

Who does this release impact?

When will the project be ready for release?

Product Process

Overview

Related releases

Release post(s)

Social Media

@shannondwray : This is released already, not sure if we need to do anything here?


Fixing Pumped Hydro formulation

Fixes #28

LGTM. Wondering how we did not found this type before. We should probably revisit the test.

I opened a PR on PowerSystemTestData  the update to the testing system. I think once that is live the testing should pass.

https://github.com/NREL-Sienna/PowerSystemsTestData/pull/51


Zooming render empty zones

Hi,
I'm using facette with the rrd provider.
When displaying the overall graph (ie, not zoomed) I can see some value (400 or more).
But when zooming, parts of the chart is not rendered. See sceenshots below. (screenshots were cropped to only show relevant data: result and axis)

I looked at the api response. I have some null values in the response that match the corresponding timestamp.

Hi @francois2metz,
Thanks for your feedback.
It seems that there is some issue in our series normalization process resulting in NaN values. We will take a closer look at it.

Normalization has been reworked in 0.4-alpha.