feat(tools-workspaces): slimmer workspaces package

Description

@rnx-kit/dep-check w/
workspace-tools
@rnx-kit/tools-workspaces

Bundle size (unminified)
1 531 380
1 063 232

Find ~1000 packages
~367 ms
~120 ms

Package footprint
368 KB
100 KB

Test plan
CI should pass.

If size is a concern, npm says fast-glob is 88k. Wondering if you really need it for that one line of things to ignore, or if there is another way to get the same result using a regex (or a few regexes)?

Is this a subset / fork of workspace-tools, or is it all new? If it's from workspace-tools, it's had a lot of bake time. Can probably go with a closer-to-1.0 version.
Also, can you add an entry in the docsite for this? You need a stub readme file and a sidebar entry. Look at the other packages for reference.

If size is a concern, npm says fast-glob is 88k. Wondering if you really need it for that one line of things to ignore, or if there is another way to get the same result using a regex (or a few regexes)?

All the strings under workspaces.packages are glob patterns. I'd rather not reimplement it. glob is about 58k smaller and could be a good alternative if it's not slower. But overall, I'm pretty happy with shaving off ~0.5 MB.

Is this a subset / fork of workspace-tools, or is it all new? If it's from workspace-tools, it's had a lot of bake time. Can probably go with a closer-to-1.0 version.

This is mostly new code/copy-pasta. I started out using the official libs, i.e. @npmcli/map-workspaces and @pnpm/find-workspace-packages, but they do a lot more than they advertise so I ended up implementing it myself.

Also, can you add an entry in the docsite for this? You need a stub readme file and a sidebar entry. Look at the other packages for reference.

Will do.


Some playlist appear empty

but they are not on Spotify.

Can you please describe more, I'm sorry but I don't understand what you mean.

I am not sure if this related to the web UI - but it shows some of my Spotify playlist as empty.

Right, I see, that is strange. Can you try them in an mpd client i.e.
mpc playlist '<name of your playlist here>'

OK. Tried. Other mpd clients work just fine.

Spoke to soon. Some work other mpd clients.


Update Composer dependencies (2022-04-03-00-07)

Visual regression test passed!
View the visual regression test report


Page 96: Add file for host2.

If the example from the previous page is to be translated into separate yaml files, then for completeness sake, a yaml file for host2 should also be listed..

I'm assuming this is in reference to the Automatically-loaded \group_vars` and `host_vars`` section in Chapter 5? (It's hard to get a reference by page number since there have been 16 revisions to the print book already (it's on version 1.16 now)).
If so, not having a vars file for host2 is quasi-intentional, because that shows that you don't need a host_vars file for each host, you can just put one in for any individual host which needs to have an overridden value.


Custom Bot performance in Microsoft Teams after a periods of inactivity

Bot Info

SDK Platform:  .NET
SDK Version: 3.15.0
Active Channels:  MS Teams, Web Chat
Deployment Environment: Azure App Service

Issue Description
Our Bot that is running in MS Teams 1:1 and Web Chat is often slow to respond, times out, or never responds after a period inactivity
Code Example
N/A - there isn't specific code to show here, it is throughout the entire bot
Reproduction Steps

Engage in a MS Teams 1:1 conversation with a custom bot
Allow for a period of time to expire in the chat
Pose a question to the custom bot in the conversation
Following steps 1-3 in a Web Chat

Expected Behavior
A bot running in the MS Teams channel will have a similar level of performance / responsiveness as other Channels
Actual Results
The bot will often be slow to respond, time out, or never respond to the question in MS Teams.  Web Chat does not exhibit this behavior

Please provide your Microsoft App Id and Bot Handle so we can investigate further.

We started seeing this 2 days ago as well and it consistently repros in all of our environments.
cora_rbsa - 32347725-bed3-49b5-a5d0-17f7afcfa817
preview_cora_advisor - 9468b07c-dea1-4c21-8133-9910b44caeb8
dev_cora_advisor - 094e061b-7682-4bdd-8524-d35359dfcf67

@mitch726 Thanks, we are investigating.

@EricDahlvang Leader-Bot - 5a793aab-c3d3-46a4-824b-650730d2a6b2

@prejeanb  is this still an issue for you after upgrading the packages? @mitch726 did you try upgrading and did that help you?  If not, what version are you on?

The issue for me was resolved after upgrading the packages.  Everything has been smooth since then.
From: Jason Sowers<EMAIL_ADDRESS>Sent: Friday, June 8, 2018 4:13 PM
To: Microsoft/BotBuilder<EMAIL_ADDRESS>Cc: Ben<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [Microsoft/BotBuilder] Custom Bot performance in Microsoft Teams after a periods of inactivity (#4622)
@prejeanbhttps://github.com/prejeanb is this still an issue for you after upgrading the packages? @mitch726https://github.com/mitch726 did you try upgrading and did that help you? If not, what version are you on?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/Microsoft/BotBuilder/issues/4622#issuecomment-395877087, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AeH_UqDQiG_xGgwRlVmkziDax7qP4VLZks5t6trggaJpZM4UB2OY.


push origin branchname sometimes pushes to parent instead

First things first, I do my push from an alias, and am going to try a period where I switch to being explicit to see if that changes anything Confirmed it happens when spelling it out explicitly. That out of the way, here is the issue I am seeing in the event there are any logs I could get, etc.
I've recently moved to github desktop on windows from msysgit. I use a git flow where I go master (or sometimes longer-lived feature branch) -> feature-issuenum -> origin + pull request back into master/LLfeature-branch. In this case it was feature-windows10
I was on a branch created by git checkout -b feature-4762 origin/feature-windows10.
I popped down to posh git to do a more complex operation (last time it was a rebase -i, this time it was a add -p) and then after my commit I did a git push origin feature-4762.
Counting objects: 40, done.
Delta compression using up to 2 threads.
Compressing objects: 100% (6/6), done.
Writing objects: 100% (6/6), 762 bytes | 0 bytes/s, done.
Total 6 (delta 5), reused 0 (delta 0)
To https://github.com/DyKnow/dyknow5.git
   68f64af..123686d  feature-4762 -> feature-windows10

I then popped over to the compare operation to make my PR, but feature-4762 DNE. Then I look at feature-windows10 and my commit's sitting on top without as if I'd just YOLO merged it. Note, this is not happening everytime as this is my normal workflow.

It does indeed reproduce when not using an alias.

I completely overlooked this issue, sorry! As far as I can tell, nothing here would be specific to posh-git (just prompt + tab expansion). If you're still having an issue, I'd suggest asking your Git question on StackOverflow.

I'm not sure I understand how this is prompt/tab expansion. Let me lay out specific steps as this is very different behavior than I get for other git clients, even msysgit.
Here is what I get with git on macos or msysgit
git fetch
git checkout -b feature-xyz origin/master
#make changes
git add .
git commit -am "bla bla"
git push origin feature-xyz
#github now has a branch feature-xyz

here is what I get sometimes with posh-git (and just got again just now)
git fetch
git checkout -b feature-xyz origin/master
#make changes
git add .
git commit -am "bla bla"
git push origin feature-xyz
#github does not have a branch feature-xyz
#master now has a new commit "bla bla" which is unexpected and in my opinion a bug

What I was trying to say is that posh-git just provides prompt and tab expansion. It shouldn't have any impact on Git's actual behavior.
A few questions, based on what you've shared:

Can you take a screenshot of what you're seeing?
What git --version?
What does git config push.default return, if anything?
After git checkout -b feature-xyz origin/master are you seeing the prompt show you're on feature-xyz?
After your git commit, are you able to confirm the new commit is in your local feature-xyz branch but not local master? (Try git log master feature-xyz --oneline --graph --decorate)
What's the output of git push origin feature-xyz?

The only thing I can of that might be causing something resembling what you describe is if your feature-xyz branch is somehow set up to track origin/master (check git config branch.feature-xyz.merge), but an explicit git push origin feature-xyz should ignore branch tracking information anyway.

ahh, so posh-git isn't the git implementation, it's the hooks into powershell to make the experience better. ha, I exclusively hear "posh-git" when people talk about github desktop on windows and made a couple wrong conclusions. Yes, I can see the commits locally in the log for feature-xyz but not master, the version is git version 2.10.2.windows.1 but none of this is your problem anymore. Thanks for your patience

No worries, it's a common misconception. I just don't want to take credit (or responsibility!) for more than we're trying to do. If you do end up asking on StackOverflow, or finding an answer, please let me know - now I'm curious. :wink:


alpine, virtiofs: /etc/fstab contains timezone: Asia/Tokyo

$ limactl -v
limactl version 0.20.1

$ limactl start --vm-type=vz --mount-type=virtiofs template://alpine

$ limactl shell alpine cat /etc/fstab
# /etc/fstab
#LIMA-START
mount0	/Users/suda	virtiofs	ro,nofail	0	0
mount1	/tmp/lima	virtiofs	rw,nofail	0	0
timezone: Asia/Tokyo
#LIMA-END

Seems specific to alpine + virtiofs

This is truly bizarre:
$ limactl shell alpine cat /etc/fstab
# /etc/fstab
#LIMA-START
mount0	/Users/suda	virtiofs	ro,nofail	0	0
mount1	/tmp/lima	virtiofs	rw,nofail	0	0
timezone: Asia/Tokyo
#LIMA-END

The only place we use the #LIMA-START marker is in /etc/environment.
There is no code in lima-init that writes to /etc/fstab, and the only place in the boot scripts is 05-lima-mounts, but it is only executed for selinux, and doesn't add these markers.
And as far as I can tell the only place timezone: Asia/Tokyo would be in user-data, and I don't see where that would be copied to /etc/fstab either.
I'll try to repro later.

I'll try to repro later.

Happens to me too:
$ limactl shell alpine cat /etc/fstab
# /etc/fstab
#LIMA-START
mount0	/Users/jan	virtiofs	ro,nofail	0	0
mount1	/tmp/lima	virtiofs	rw,nofail	0	0
timezone: America/Vancouver
#LIMA-END

Still don't understand how this is even possible.

I figured it out. My confusion comes from the fact that the Rancher Desktop fork of alpine-lima has a PR Create a mount script instead of editing /etc/fstab #15 that is not in the upstream repo.
This PR replaced the code that edited /etc/fstab and added the #LIMA-* markers with a separate mount script (to support mounting filenames with spaces in them).
I see the responsible code in upstream at https://github.com/lima-vm/alpine-lima/blob/main/lima-init.sh#L48-L68.
And it explains the timezone: line because there was supposed to be a newline after the mounts block, but timezome: appears directly behind it:
mounts:
- [mount0, /Users/jan, virtiofs, "ro,nofail", "0", "0"]
- [mount1, /tmp/lima, virtiofs, "rw,nofail", "0", "0"]
timezone: America/Vancouver

Since the mounts are modified via regular expressions, that just don't match on the timezone: line, it is copied verbatim.
Now the question is if the Rancher Desktop PR is appropriate for the Lima repo, or if we should fix the lima-init.sh script to break the block as soon as a line doesn't start with a -.

The same thing happens with QEMU and 9p:
lima-alpine:~# cat /etc/fstab
# /etc/fstab
#LIMA-START
mount0	/Users/jan	9p	ro,trans=virtio,version=9p2000.L,msize=131072,cache=fscache,nofail	0	0
mount1	/tmp/lima	9p	rw,trans=virtio,version=9p2000.L,msize=131072,cache=mmap,nofail	0	0
timezone: America/Vancouver
#LIMA-END

It doesn't happen for reverse-sshfs because the user-data template omits the mounts: section:
{{- if or (eq .MountType "9p") (eq .MountType "virtiofs") }}
{{- if .Mounts }}
mounts:
  {{- range $m := $.Mounts}}
- [{{$m.Tag}}, {{$m.MountPoint}}, {{$m.Type}}, "{{$m.Options}}", "0", "0"]
  {{- end }}
{{- end }}
{{- end }}

The simplest fix would be to insert a blank line before the timezone (because the {{- … } part eats the newline before the template block):
--- pkg/cidata/cidata.TEMPLATE.d/user-data
+++ pkg/cidata/cidata.TEMPLATE.d/user-data
@@ -21,6 +21,7 @@ mounts:
 {{- end }}

 {{- if .TimeZone }}
+
 timezone: {{.TimeZone}}
 {{- end }}

the question is if the Rancher Desktop PR is appropriate for the Lima repo

Yes, it is needed to successfully mount directories whose names contain spaces. I'll create a PR.

I believe this is fixed:
$ limactl shell alpine cat /etc/fstab
# /etc/fstab
$ limactl shell alpine cat /etc/timezone
America/Vancouver


Add bucket verification in TableWriter Fuzzer

@kewang1024, @xiaoxmeng : Ke, Meng : I guess we should do extend Fuzzer in a similar manner for bucketed but not partitioned files. I can take that on after this is merged.


Remove unfinished OAuth flows and create related issues.

This issue relates to OAuth flows that are not fully implemented. These either need to be completely implemented for the flows that are close to finished or removed and a related issue created if there is not one already. The two flows that are finished are the OneDrive v1.0 token and code flows so these do not need to be changed. The remaining others will need to be further investigated.

Fixed.


TypeError: make_credential() takes 2 positional arguments but 4 were given

$ solo key verify
Please press the button on your Solo key
Traceback (most recent call last):
  File "/usr/local/bin/solo", line 8, in <module>
    sys.exit(solo_cli())
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/solo/cli/key.py", line 322, in verify
    cert = solo.client.find(serial, udp=udp).make_credential(pin=pin)
  File "/usr/local/lib/python3.7/dist-packages/solo/client.py", line 233, in make_credential
    rp, user, challenge, exclude_list=[], pin=pin
TypeError: make_credential() takes 2 positional arguments but 4 were given

$ solo key make-credential
Touch your authenticator to generate a credential...
Traceback (most recent call last):
  File "/usr/local/bin/solo", line 8, in <module>
    sys.exit(solo_cli())
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.7/dist-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.7/dist-packages/solo/cli/key.py", line 135, in make_credential
    host=host, user_id=user, serial=serial, output=True, prompt=prompt, udp=udp
  File "/usr/local/lib/python3.7/dist-packages/solo/hmac_secret.py", line 44, in make_credential
    rp, user, challenge, extensions=hmac_ext.create_dict(), pin=pin
TypeError: make_credential() takes 2 positional arguments but 4 were given

I'll fix this.

I can't reproduce. What versions of solo-python and Yubico/python-fido2 do you have installed?


Bug: Readme.md will not close or save preventing VSCode from exiting

VSCode metadata:
Version: 1.73.1 (Universal)
Commit:<PHONE_NUMBER>f055b99068d3688932416f2346dd3b
Date: 2022-11-09T02:08:38.961Z
Electron: 19.0.17
Chromium: 102.0.5005.167
Node.js: 16.14.2
V8: <IP_ADDRESS>-electron.0
OS: Darwin x64 20.6.0
Sandboxed: No
Screenshot of errors:

Example Git Repo with Readme.md file: TODO
Detailed Description: TODO
Expected Behaviour:

Readme.md closes with click on file with X
Readme.md closes with close file keyboard shortcut ( Option + W on Mac )
VSCode closes and restarts ( several scenarios )

Thanks for the bug report @mdstaff! Any chance you could share the README.md either here or (if sensitive content is involved) out of band via email sebastian(at)stateful.com?

The resolution of this issue is blocked by shipping "notebook editing" which is currently in the works (highest priority). Will verify and resolve this issue once editing landed.

👋 Hi @sourishkrout I think opening this issue was premature.  I later learned this issue happened due to the extension being in "read-only" mode and I had accidentally modified the file.  Happy to close this if that is expected behaviour due to the lack of edit permissions.

👋 Hi @sourishkrout I think opening this issue was premature. I later learned this issue happened due to the extension being in "read-only" mode and I had accidentally modified the file. Happy to close this if that is expected behaviour due to the lack of edit permissions.
I was able to "discard changes" and then close the file with the GUI (the little x next to the tab) or the keyboard shortcut.

All good, @mdstaff! While the read-only mode is a known limitation, we might add a footnote to people know about this scenario. However, we're actually really close and very excited to make writing (full editing) available and move past read-only. Hopefully as early as next week!
Let's keep the ticket open as we are working through this. Really appreciate you taking the time to file the ticket, @mdstaff.

Hi @mdstaff, starting with v0.4 (current stable) this issue should be fixed. Please note that you will still receive a warning if the underlying README.md/markdown file is not version-tracked in git. Let us know if you have questions!


Installing for Python3

The instructions are for python2, when trying to install for python3 and importing gist, I got an error:
import gist
Traceback (most recent call last):
File "", line 1, in
gist.so: Symbol not found: _Py_InitModule
Expected in: flat namespace
in gist.so
Is there a way to install for python3 ?

Hi @amaliapotruch. @Pastafarianist fixed this bug and made it possible to install for python 3.
I merged his pull request #4 .
Thank you all!


Cannot find matching pattern

@trombonekenny I'm splitting your report out to a new issue. This has been moved from #133.

I'm seeing the same 999 to 0 bug on Firefox for MacOS as of this morning. Was working ok yesterday.
https://turnipprophet.io?prices=<IP_ADDRESS>.<IP_ADDRESS>.....

Looking at other issues, I wonder if my bug might be data entry rather than something in the code (and maybe coincidental that this morning I had enough data points for it to start graphing and narrowing down the patterns). If I trust my buy price, and sell prices after Tuesday PM I can get the data to graph: https://turnipprophet.io/?prices=93....<IP_ADDRESS>.....

I can't reproduce this and am OK closing it out as data entry error. Sorry!

No worries! Thank you for following up!


Add signature validation checks to decryption extensions

If we signature validation was disabled, run signature validation before sharing keys
I don't feel like we can safely turn off signature checks otherwise

sorry this pr is still in progress


update url

1、conduit has been merged into linkerd
see https://conduit.io/
2、servicecomb has move to apache's project

the bookinfo-sample's url in istio-architecture.md is unavailable, fix it


Auth errors

i need to use westus.api.cognitive.microsoft.com for the auth uri
but the constructor on the BingSpeechApiClient is creating the auth client before my property value is set.

#20 PR added

Good call, I clearly never tested changing the endpoint since I didn't have another url to use :)  That said, I may refactor it to either rebuild the auth client when set or just use the constructor similar to what you did.  Leaving it as a public property when it won't actually work correctly is probably not great...

Used your PR as a basis and resolved this in d8eaa9d46186a2523a47541eedffcd3e8095fdd5
Released an updated nuget, v2.1.3


Fn cli "fn update app config" doesn't work

Updating an apps config with: fn update app --config KEY=VALUE <app-name> does not work. You can update the config with: fn config app <app-name> KEY VALUE.

@JadeRedworth  The same issue applies to syslog-url as well i.e. if there is an existing value fn update app --syslog-url=newvalue myapp will not work. I guess the fix is as simple as if len(c.String("syslog-url")) > 0

Filed an issue - https://github.com/fnproject/cli/issues/464

@abhirockzz ok I will include a fix in the same PR then!


[Audit][FEA][SPARK-36831] Support ANSI interval types from CSV source

Make sure the plugin can read ANSI interval types from CSV source

@revans2  Please help review the solution:
Interval types can be found in https://spark.apache.org/docs/latest/sql-ref-datatypes.html
Currently plugin do not support write for csv, so let's talk about reading interval type from CSV.
Spark read interval code is in:
IntervalUtils.fromDayTimeString
There are legacy form and normal form switched by SQLConf.LEGACY_FROM_DAYTIME_STRING.
legacy form
By default, legacy from daytime string is disable, so we may not support this.
SQLConf.LEGACY_FROM_DAYTIME_STRING See: https://github.com/apache/spark/blob/v3.2.1/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala#L3042
parseDayTimeLegacy see:
https://github.com/apache/spark/blob/v3.2.1/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala#L463toL475
normal form
By default, Spark use this form,  some examples see below table, we will support this form only.

type
example
valid
comment

INTERVAL DAY
INTERVAL '100' DAY
true

INTERVAL DAY
100 DAY
true

INTERVAL DAY TO HOUR
INTERVAL '100 10' DAY TO HOUR
true

INTERVAL DAY TO HOUR
100 10
true

INTERVAL DAY TO SECOND
INTERVAL '100 10:30:40.999999' DAY TO SECOND
true

INTERVAL DAY TO SECOND
100 10:30:40.999999
true

INTERVAL DAY TO SECOND
INTERVAL '100 10:30:40.     999999' DAY TO SECOND
false
has extra spaces

INTERVAL DAY TO SECOND
INTERVAL '100       10:30:40.999999' DAY TO SECOND
false
has extra spaces

INTERVAL DAY TO SECOND
100        10:30:40.999999
false
has extra spaces

INTERVAL DAY TO SECOND
100 10:30:      40.999999
false
has extra spaces

INTERVAL DAY TO SECOND
INTERVAL '-100 10:30:40.999999' DAY TO SECOND
true

INTERVAL DAY TO SECOND
INTERVAL -'-100 10:30:40.999999' DAY TO SECOND
true
two negative signs is positive

INTERVAL DAY TO SECOND
-100 10:30:40.999999
true

INTERVAL DAY TO SECOND
INTERVAL '100 26:30:40.999999' DAY TO SECOND
false
hour is 26 > 23

The invalid value will be null when reading csv.
proposed solution for the normal form
Use Cudf ColumnView.extractRe to extract the day, hour, ... , second fields by specifing the groups in regexp, and then calculate the micros.
Gpu code is like:
    val intervalCV = builder.buildAndPutOnDevice()
    val start = System.nanoTime()
    val p = "^INTERVAL\\s+([+|-])?'([+|-])?(\\d{1,9}) (\\d{1,2}):(\\d{1,2}):" +
        "(\\d{1,2})(\\.\\d{1,9})?'\\s+DAY\\s+TO\\s+SECOND$"

    // e.g.: INTERVAL -'-100 10:30:40.999999' DAY TO SECOND
    // group 0: sign is -
    // group 1: sign is -
    // group 2: day is 100
    // group 3: hour 10
    // group 4: minute 30
    // group 5: second 40
    // group 6: micro seconds 999999

    withResource(intervalCV.extractRe(p)) {
      table => {
        println("row count: " + table.getRowCount)

        val micros = table.getColumn(2).castTo(DType.INT64).mul(Scalar.fromLong(86400L * 1000000L))   // day to micros
            .add(table.getColumn(3).castTo(DType.INT64).mul(Scalar.fromLong(3600 * 1000000L))) // hour to micros
            .add(table.getColumn(4).castTo(DType.INT64).mul(Scalar.fromLong(60 * 1000000L))) // minute
            .add(table.getColumn(5).castTo(DType.INT64).mul(Scalar.fromLong(1000000L)))
            .add(table.getColumn(6).castTo(DType.INT64))
      }
    }
    val timeS =(System.nanoTime() - start).toDouble / TimeUnit.SECONDS.toNanos(1)
    println(s"GPU used time $timeS S")

Cpu code is like
    while (i < rowCount) {
      IntervalUtils.fromDayTimeString(intervals(i))
      i += 1
    }

row count: 10,000,000
GPU used time 0.86659265 S
CPU used time 16.818680952 S
GPU speedups about 19x
Is this acceptable or have more effient approach?

I really dislike regular expression use in casts, but it is a good first step.  It would be nice to file a follow on issue to write a custom kernel to do this for us.
Also I assume you know that your code to do the conversion is leaking a lot of column views. I assume you did that just for readability of the code.
Second have you tested this with CSV?  The patch that added in support for writing/reading CSV https://issues.apache.org/jira/browse/SPARK-36831 did not add in anything that calls fromDayTimeString or similar. The Parquet code just stored these as an int or a long.  Please check to see if CSV is doing the same, because I suspect that they are, and then we don't need to do as much special processing.

Filed an issue: https://github.com/rapidsai/cudf/issues/10356
CSV is text file, the day-time interval is stored in string form, e.g:
INTERVAL '100 10:30:40.999999' DAY TO SECOND

Spark used a similar method to parse interval string to day-time interval:  IntervalUtils.castStringToDTInterval
The IntervalUtils.fromDayTimeString in the example code also invoked IntervalUtils.castStringToDTInterval.
I know the leaking in the example code.

Spark Accelerator already supported  reading day-time interval from CSV temporarily.
But is still waiting cuDF kernel to support.

The cuDF issue is closed but without a fix.
For details see https://github.com/rapidsai/cudf/issues/10356#issuecomment-1168208942.


FingerprintUSBHost implementation to detect OS

Added FingerprintUSBHost library.
New command "GetOS:"
When you execute the command "GetOS:" in the textarea or in a payload, the file OS.txt will appear in the Exfiltrate section.
Inside that file you will find the operating system of the computer where the ESPloitV2 device is connected.
Tested with WHID Injector on Linux and Windows.

This is a local fork of ESPloitV2 since there are some PR unapproved on exploitagency/ESPloitV2 that I would like to see merged.
If you have PRs and don't get approved on Corey's repo, do make them here: https://github.com/whid-injector/WHID/tree/master/ESPloitV2_whid
Thanks.


We also might want to consider moving some of the functions from measure_errors into the mdtk package.

from #154
I agree, since there are useful functions contained within.

Will include this in my work on the params branch.


Fix Python 3.12 syntax warnings

Use raw strings where needed to fix the following:
Setting up wafw00f (2.2.0-1) ...
/usr/lib/python3/dist-packages/wafw00f/lib/asciiarts.py:35: SyntaxWarning: invalid escape sequence '\ '
  '''+Y+'''/ ('        '''+G+'''/|\                  '''+R+'''(  '''+Y+'''|__|
/usr/lib/python3/dist-packages/wafw00f/lib/asciiarts.py:36: SyntaxWarning: invalid escape sequence '\ '
  '''+Y+'''(  /  )       '''+G+''' / | \                  '''+R+'''. '''+Y+'''|__|
/usr/lib/python3/dist-packages/wafw00f/lib/asciiarts.py:37: SyntaxWarning: invalid escape sequence '\ '
  '''+Y+r'''\(_)_))      '''+G+'''/  |  \                   '''+Y+'''|__|'''+E+'''
/usr/lib/python3/dist-packages/wafw00f/lib/asciiarts.py:47: SyntaxWarning: invalid escape sequence '\ '
  '''+W+'''\  ____/
/usr/lib/python3/dist-packages/wafw00f/lib/asciiarts.py:50: SyntaxWarning: invalid escape sequence '\ '
  '''+C+'''/"  _/  '''+G+'''/_/                       '''+R+'''\ \   / /
/usr/lib/python3/dist-packages/wafw00f/lib/asciiarts.py:51: SyntaxWarning: invalid escape sequence '\ '
  '''+B+'''*===*    '''+G+'''/                          '''+R+'''\ \_/ /  '''+Y+'''405 Not Allowed
/usr/lib/python3/dist-packages/wafw00f/lib/asciiarts.py:52: SyntaxWarning: invalid escape sequence '\ '
  '''+C+'''/     )__//                           '''+R+'''\   /
/usr/lib/python3/dist-packages/wafw00f/lib/asciiarts.py:55: SyntaxWarning: invalid escape sequence '\ '
  '''+C+r'''`\    /_\\_              '''+Y+'''502 Bad Gateway  '''+R+'''/ / \ \  '''+Y+'''500 Internal Error
/usr/lib/python3/dist-packages/wafw00f/lib/asciiarts.py:56: SyntaxWarning: invalid escape sequence '\_'
  '''+C+'''`_____``-`                             '''+R+'''/_/   \_\\

Which category is this pull request?

[ ] A new feature/enhancement.
[ ] Fix an issue/feature-request.
[ ] An improvement to existing modules.
[ ] Other (Please mention below).

Where has this been tested?

Python Version

[ ] v3.x
[ ] v2.x

Operating System:

[ ] Linux (Please specify distro)
[ ] Windows
[ ] MacOS

Does this close any currently open issues?
[Mention any issue which this PR closes]
Does this add any new dependency?
[Mention if this PR includes any new library]
Does this add any new command line switch/argument?
[Mention if the changes add any new arguments like --arg]
Any other comments you would like to make?
[Anything more you'd want the reviewer to know]

thanks for the PR @elboulangero! this should be addressed in the upcoming v2.3.0 release. <3


Add a setting for date translations

By default, dates are not translated in Grav, which is a concern for internationalization.
Translating dates is a challenge, but jenssegers/date does it very well. Otherwise, we can hack around with regex, like I did here.
The thing is once the site admin has changed the default dateformat to match their language, we don't have so much to translate.
The [date] page in the PHP manual lists the following things to translate:

days

D: Mon → Sun
l: Sunday → Saturday
S: st/rd/th

months

F: January → December
M: Jan → Dec

Please note that a and A (am/pm) don't need translation as it's mostly an English-speaking concern.
S would be the most difficult parameter to translate due
The question is, can we have a core setting to enable/disable date translations, so each subproject doesn't need its own setting for this?
If we can get a core setting for date translations, I'll be glad to write a Twig function to handle this and PR translated dates support in Antimatter and archives plugin.

We might want to use the same solution in Gantry/Grav, we just need to figure out what it would be:
https://github.com/gantry/gantry5/issues/221

I just experimented with jenssegers/date and came up with grav-plugin-datetranslations.
I setup a test site with a date template:
{% extends 'partials/base.html.twig' %}

{% block content %}
    First day of next month: {{ date_translate('first day of next month', 'd F Y') }}
    <br>
    Last day of next month: {{ date_translate('last day of next month', 'l') }}
	{{ page.content }}
{% endblock %}

And a 02.date/date.en.md page:
---
title: Date test
---

# TEST

This is just a test. According to the twig template, date translated in the current active language should be displayed above this.

This page only exists as `date.en.md`, there is no French translation for the Markdown.

Please note that I did not provide a page translation to be sure the wrong language wouldn't be picked up.
You can see it here and here.
The code is here.
Could some people try it out as well?

I'm not sure if this is enough; to translate time you also need to consider different format from country to country, like 01/31/2016 vs 31.01.2016.

Well, this is true.
But first, that's already a lot better than what we have now in Grav... which is nothing.
Second, what you say is actually implementable. There's been a discussion about it, and we could probably implement this solution.
That would mean having translation strings for the date formats in every language, and then using these translation strings as format to translate the dates with.
It actually makes a lot of sense.
The question is just, can we find localized dateFormat strings to work with, or do we have to write our own? See this pull request for some strings.

One way I have been thinking of, is to have a map of formats like
['d F Y' => 'd.m.Y']

That would be just a simple translate of the format into another one based on locale. If there's no mapping found, it could just use the one specified.

Okay I've updated the repo.
Now I'm using a languages.yaml for date format translations.
You can use the function dt as a Twig function and/or filter, like  'now'|dt('short')
Could somebody try messing around with it to see if it behaves as expected?

Hi,
another way to get dates localized would be to use the Intl extension for Twig.
https://twig-extensions.readthedocs.io/en/latest/intl.html
Example:
{{ page.date|localizeddate('long', 'none', 'fr') }}
outputs
16 décembre 2016
This filter is less flexible though. PHP format characters aren't supported.
It only has a limited number of predefined types.

@indigoxela not sure if you are aware, the Intl twig extension can be added using https://github.com/Perlkonig/grav-plugin-twig-extensions

@flaviocopes I am aware of the plugin.
Thanks for adding a link to the plugin repo (which I forgot).

@indigoxela I added your approach to the Learn site https://github.com/getgrav/grav-learn/commit/cd11517dfc6d7c63e1806632a4cb8225f5fb65f5

pardon my stupid question, but why not rely on the Intl functions of php  ? They handle these details pretty well, and could be used based on the active language IntlDateFormatter

Sorry for another stupid question but does this mean current version of Grav (1.5) does not handle date translations from scratch?
And does this also mean that if I want to use only core features for example to create a blog, then displaying date to blog items, these dates won't be localised?

Why only "core" Grav? There are Twig extensions that will localize dates.


remove email button

The email button did not work so I am proposing to remove the button entirely. This would make a great addition to the website as it protects people from false hope. When people see the button they have an expectation that the button will send an email about the trianglify website but they get greeted by nothing. Sorrow then comes into play and the person who tried to press the email button is now depressed.

yes

no

A new user left a comment. This user must be approved by a Netlify team owner before comments can be displayed.
Approve this user


VapSynching test fails for 0.1.8

vapjs-format
Before opening a new issue, please take a moment to review our community guidelines to make the contribution process easy and effective for everyone involved.
Before opening a new issue, you may find an answer in already closed issues:
https://github.com/vapjs/vapjs-format/issues?q=is%3Aissue+is%3Aclosed
Issue Type

[ ] Bug (https://github.com/vapjs/vapjs-format/blob/master/.github/CONTRIBUTING.md#bug-reports)
[ ] Feature (https://github.com/vapjs/vapjs-format/blob/master/.github/CONTRIBUTING.md#feature-requests)

Description
(Add images if possible)
Steps to reproduce
(Add link to a demo on https://jsfiddle.net or similar if possible)
Versions

Node/NPM: 10+
Browser:

resolved schema issues with<EMAIL_ADDRESS>

resolved schema issues with<EMAIL_ADDRESS>


Retry mounting wrong UFS blocks other mount/ls operations

Alluxio Version:
2.2-RC1
Describe the bug
When mounting a remote HDFS with wrong IP:
alluxio fs mount --option alluxio.underfs.hdfs.remote=true /mnt/hdfs hdfs://<wrong_ip>:8020/tmp/alluxio
The master log shows:
2020-03-02 18:29:49,531 INFO  Client - Retrying connect to server: ip-172-16-11-230/<IP_ADDRESS>:8020. Already tried 0 time(s); maxRetries=45
.....
2020-03-02 18:44:30,203 INFO  Client - Retrying connect to server: ip-172-16-11-230/<IP_ADDRESS>:8020. Already tried 44 time(s); maxRetries=45
2020-03-02 18:44:50,223 WARN  FileSystemMasterClientServiceHandler - Exit (Error): Mount: request=alluxioPath: "/mnt/hdfs"
ufsPath: "hdfs://ip-172-16-11-230:8020/tmp/alluxio"
options {
  readOnly: false
  properties {
    key: "alluxio.underfs.hdfs.remote"
    value: "true"
  }
  shared: false
  commonOptions {
    syncIntervalMs: -1
    ttl: -1
    ttlAction: DELETE
  }
}
, Error=org.apache.hadoop.net.ConnectTimeoutException: Call From alluxio_ip to <wrong_ip>:8020 failed on socket timeout exception: org.apache.hadoop.net.ConnectTimeoutException: 20000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending remote=<wrong_ip>:8020]; For more details see:  http://wiki.apache.org/hadoop/SocketTimeout

This operation blocks the following mount and ls / operations.
mount and ls / operations hangs without response. I manually kill those commands. The error logs only shown when the retry connecting to wrong hdfs ip finished.
2020-03-02 18:44:51,875 ERROR FileSystemMasterClientServiceHandler - Exit (Error): ListStatus: request: path: "/"
java.lang.RuntimeException: Call cancelled by the client.

To Reproduce
Steps to reproduce the behavior (as minimally and precisely as possible)
Expected behavior
the retry connecting to any UFS should not block other operation.
One mount command should not block other mount and ls commands
Urgency
Describe the impact and urgency of the bug.
Additional context
Add any other context about the problem here.

@LuQQiu  is this bug still relevant? If not, let's close it

TODO(lu) see if this problem still exist


Cannot read property 'length' of undefined at Function.glob.hasMagic

Any idea why this could be happening?
22 08 2016 13:17:07.239:ERROR [karma]: TypeError: Cannot read property 'length' of undefined
  at Function.glob.hasMagic (/Users/user/frontend/node_modules/glob/glob.js:106:29)
  at rimraf (/Users/user/frontend/node_modules/rimraf/rimraf.js:61:36)
  at Object.module.exports.remove (/Users/user/frontend/node_modules/karma/lib/temp_dir.js:28:5)
  at Object._clearTempDirAndReportDone (/Users/user/frontend/node_modules/karma/lib/launchers/process.js:106:13)
  at Object._onProcessExit (/Users/user/frontend/node_modules/karma/lib/launchers/process.js:102:10)
  at ChildProcess.<anonymous> (/Users/user/frontend/node_modules/karma/lib/launchers/process.js:68:12)
  at emitTwo (events.js:106:13)
  at ChildProcess.emit (events.js:191:7)
  at Process.ChildProcess._handle.onexit (internal/child_process.js:204:12)

@aristidesfl just debugging the same issue.  Only started happening today in CI.

patern is /var/folders/b_/0n4t_6s17rj85tsxyncd3q6r0000gp/T/karma-69206038
object_ is undefined

var set = g.minimatch.set is the line that breaks.
set ends up being []

@robzolkos @aristidesfl  Seems to be a problem in minimatch itself since this package hasn't been updated in a year

We're also getting this error in our code.  Stack track is slight different.
As @robzolkos mentions the set array is empty.
/my-code/node_modules/rimraf/node_modules/glob/glob.js:110
    for (var j = 0; j < set[0].length; j++) {
                              ^

TypeError: Cannot read property 'length' of undefined
    at Function.glob.hasMagic (/my-code/node_modules/rimraf/node_modules/glob/glob.js:110:31)
    at rimraf (/my-code/node_modules/rimraf/rimraf.js:64:36)
    at ExecBuffer.cleanup (/my-code/node_modules/exec-buffer/index.js:126:2)
    at ExecBuffer.<anonymous> (/my-code/node_modules/exec-buffer/index.js:103:10)
    at FSReqWrap.readFileAfterClose [as oncomplete] (fs.js:380:3)

@robzolkos Is it Travis CI you're struggling with? I've been trying to figure out a similar bug for a few hours on there, and it just started passing now, without any changes.

@jeppeolesen mine was Codeship.   So weird.

We're not running in CI at all and the error is occurring in the local dev environment.  Issue seems limited to *nix though as it is not happening in Windows.

Yes, mine is failing local dev env too.  I first noticed it failing in CI.

@robzolkos Are you using webpack or imagemin?

@vbence86 webpack

Seem to have narrowed it down to a concurrency issue between webpack and imagemin.  When I run them separately they both work but when I try run them in parallel with gulp I get the error.

Builds are passing in CI now.  Didn't change anything.  God bless computers.  Will try locally.

Also stated seeing this as of today, in an inhouse Jenkins setup. Also using webpack, no imagemin involved tho as mentioned above.

The issue magically disappeared after we'd run npm install again (for the umpteen times).

Builds still fail for me. Anyone with any findings ? what about minimatch being updated 12 days ago ?

Builds still fail for me. Anyone with any findings ? what about minimatch being updated 12 days ago ?

Still failing here as well. Tried to force using the previous minimatch version (3.0.2) by using a shrinkwrap, still fails :(

I'm getting this too in Travis but unable to recreate locally, although my colleague can. Which is pretty weird, frankly.
[13:14:59] Using gulpfile ~/my_code/gulpfile.babel.js
[13:14:59] Starting 'clean:dist'...
[13:14:59] 'clean:dist' errored after 4.77 ms
[13:14:59] TypeError: Cannot read property 'length' of undefined
   at Function.glob.hasMagic (my_code/node_modules/rimraf/node_modules/glob/glob.js:106:29)
   at Function.rimrafSync [as sync] (my_code/node_modules/rimraf/rimraf.js:272:36)
   at my_code/node_modules/del/index.js:74:10
   at Array.forEach (native)
   at Function.module.exports.sync (my_code/node_modules/del/index.js:67:30)
   at Gulp.<anonymous> (gulpfile.babel.js:40:7)
   at module.exports (my_code/node_modules/orchestrator/lib/runTask.js:34:7)
   at Gulp.Orchestrator._runTask (my_code/node_modules/orchestrator/index.js:273:3)
   at Gulp.Orchestrator._runStep (my_code/node_modules/orchestrator/index.js:214:10)
   at Gulp.Orchestrator.start (my_code/node_modules/orchestrator/index.js:134:8)
   at /usr/local/lib/node_modules/gulp-cli/lib/versioned/^3.7.0/index.js:46:20
   at nextTickCallbackWith0Args (node.js:452:9)
   at process._tickCallback (node.js:381:13)
   at Function.Module.runMain (module.js:449:11)
   at startup (node.js:139:18)
   at node.js:999:3```

Can you try to devalidate your local npm cache and then run npm install again?

Since this commit
`-    "minimatch": "2 || 3",

"minimatch": "^3.0.2",`
maybe version 2.0.10 is working?

rm -rf node_modules/ npm cache clean
worked for me
didn't changed anything else

npm cache clean and reinstall worked.
still someone changed something somewhere... pretty terrifying no one is able to find out what.

Had the same issue, resolved itself after the third time running my deployscript in Envoyer. Still clueless why this happened...
Commands run in Envoyer:
cd {{ release }}
npm install
npm run production
Error Message:
/releases/20160822100143/node_modules/glob/glob.js:106
for (var j = 0; j < set[0].length; j++) {
^
TypeError: Cannot read property 'length' of undefined

As mentioned in https://github.com/sindresorhus/del/issues/58#issuecomment-241606403 it seemed the issue was in math-expression-evaluator, and fixed in https://github.com/redhivesoftware/math-expression-evaluator/pull/2.
In my setup, math-expression-evaluator got installed as a nested dependency of the webpack css-loader. Ensuring v1.2.13 of math-expression-evaluator got installed fixed my builds :fireworks:

This is a result of passing an empty string to hasMagic.
It's fixed in the latest release.

Note: You should probably investigate why you're calling rimraf('') though.  That seems like a bug that will result in attempting to recursively delete the current working directory.  Are you sure that's what you want to do?


perf: make validation of foreign keys a lookup instead of iterating over all of them

This is a small change to improve _validateForeignKeyExistsInDatabase performance.
_validateForeignKeyExistsInDatabase is called for each foreign key attribute when creating any model.
baseline:

this change:

(Both trees are on https://github.com/miragejs/server/pull/151 in one of our tests)
Couple thinks that could be discussed:

should updating of the fk -> association tables be extracted into methods?

Hey @makepanic this looks great! Looks like it needs to be rebased.

rebased on latest master


fix: dynamodb2 conditions

Add support for dynamodb2 Expected conditions.

Coverage increased (+0.002%) to 94.325% when pulling 6b74487b317fe5f2ab6090775da57e6e912b92c1 on skygeo:fix_dynamodb2_conditions into 79fe9df6cc58eb1192ae7ceb83ff956e59aa5537 on spulec:master.

Thank you!


[Migration] Add using PKCS12 keystores as default primary keystore and truststore

With https://github.com/wso2/product-is/issues/18466, we have update the default keystore and truststore types to the PKCS12 from JKS.
Need to educate the user that the default keystore and trustore type for super tenant and for newly creating tenants have been changed. Therefore they have to one of following options.

[Recommended] Convert existing JKS keystores (not required for existing tenants other than super tenant) to PKCS12 format and change usage according.

Additional context
To convert an existing JKS keystore to PKCS12, following command can be used
keytool -importkeystore -srckeystore wso2carbon.jks -destkeystore wso2carbon.p12 -srcstoretype JKS -deststoretype PKCS12 -deststorepass wso2carbon

Use the following config in deployement.toml to use JKS keystores:

For super tenant:
[keystore.primary]
file_name = "wso2carbon.jks"
password = "wso2carbon"
type="JKS"

[truststore]
file_name="client-truststore.jks"
password="wso2carbon"
type="JKS"

Please refer https://docs.google.com/document/d/1N7N6VoZk4N2_m-ZUWAz3Zp5YYBANSFgiLVBFH1orWuM/edit#heading=h.71gqxxef48q7

Wi

With #19517, default keystore is changed to JKS format. Hence this migration is not required now.

This happended due to https://github.com/wso2/product-is/issues/19506

Re opening for IS 7.1 release

Migration docs has been updated with the above details. Please verify and close it

Only the default keystore type of primary keystore and trustrore has been changed, the keystore type of other tenants is still JKS.


Avoid to emit annoying error log for app live state

What this PR does / why we need it:
Live state often doesn't exist in Filestore. It is annoying to emit logs for that.
Which issue(s) this PR fixes:
Fixes #
Does this PR introduce a user-facing change?:

NONE

Nice catch!
/lgtm

Here you go 👍
/approve


Missing support for newer pokemon added in Legends Arceus

I was hoping to use this to show the most recently caught shiny in Pokemon Legends Arceus but it doesn't seem to work with the newer pokemon. For example Sneasler's dex number is 903 but it doesn't let me enter anything above 898 in the team editor

Unfortunately, Showdown (and the place where I get the HOME icons from) hasn't added any of the Hisuian forms or mons in, so I can't add them to this script.
Once they do, and I notice, then I can add them in.

Ah okay. Thank you for letting me know

they have added them but I am unable to code it on the mapping files, plz help


fixes

took vanesa and felix's feedback suggestions and softened the changed/git colors and brightened the terminal's.

Terminal looks great, but the scm decorations are barely visible now:

Addressed your feedback, should be less muted now.


Detect class duplication in classpath

After reading the thread: https://groups.google.com/forum/#!topic/sbt-dev/LKICLjcVXlA
I'm motivated to open this feature request.
Sometimes, a transitive dependency brings the same artifact with a different naming, and it gets duplicated.  If the versions are incompatible, it can cause serious bugs, that don't always happen.  It is random which version will be used.
It would be interesting to be able to detect this.
Related Stackoverflow question:
http://stackoverflow.com/questions/27635346/how-can-i-find-duplicate-classes-amongst-dependencies-with-sbt

Much like Maven, I think this is a feature that could probably be implemented as a community plugin.

I think so also.

If I have time, I'll try to write one.

There is an implementation for this issue here : https://github.com/sbt/sbt-duplicates-finder

Nice one. It works wonderfully. The issue could be closed.
I already detected collisions like
[warn] Detected classes conflicts:
[warn]
[warn] - javax/xml/stream/XMLOutputFactory.class: content differ
[warn]   - C:\Users\costin\.ivy2\cache\xml-apis\xml-apis\jars\xml-apis-1.4.01.jar
[warn]   - C:\Users\costin\.ivy2\cache\stax\stax-api\jars\stax-api-1.0.1.jar

and
[warn] Detected resources conflicts:
[warn]
[warn] - reference.conf: content differ
[warn]   - C:\Users\costin\.ivy2\cache\io.spray\spray-can\bundles\spray-can-1.2.2.jar
[warn]   - C:\Users\costin\.ivy2\cache\com.typesafe.akka\akka-actor_2.10\jars\akka-actor_2.10-2.3.4.jar

Closing this since there's a plugin for it.


Added instructions for getting astropy-helpers auto-updates

Fixes #105

I'm going to go ahead and merge this as I'd like to move ahead with the astropy-helpers README. We can always open up follow-up PRs to improve the README here.


Try empty resolved file

We only added the resolved file as a workaround, we may not need any concrete pins for that.

@swift-ci please test

ideally we delete the file instead

ideally we delete the file instead

Agreed in principle, we needed to add it recently in https://github.com/apple/swift-tools-support-core/pull/404, presumably because of an issue in the installed Xcode.


[Bug/Question] Experiment.obs.count has long wall clock time - is this normal?

Describe the bug
Getting the count of obs from an experiment takes a while for large datasets (~17 seconds here). Is this normal?
I ran the profiling script reported here https://github.com/single-cell-data/TileDB-SOMA/issues/1181 on a test script (attached below).
with soma.Experiment.open(<URI>) as exp:
    res = exp.obs.count

Output of profiler:
{
  "command": "python test_obs_count.py",
  "timestamp":<PHONE_NUMBER>.266067,
  "stdout": "",
  "stderr": "Command being timed: \"python test_obs_count.py\"\nUser time (seconds): 22.08\nSystem time (seconds): 1.94\nPercent of CPU this job got: 141%\nElapsed (wall clock) time (seconds): 16.96\nAverage shared text size (kbytes): 0\nAverage unshared data size (kbytes): 0\nAverage stack size (kbytes): 0\nAverage total size (kbytes): 0\nMaximum resident set size (kbytes): 1906388\nAverage resident set size (kbytes): 0\nMajor (requiring I/O) page faults: 0\nMinor (reclaiming a frame) page faults: 489891\nVoluntary context switches: 3020\nInvoluntary context switches: 164481\nSwaps: 0\nFile system inputs: 0\nFile system outputs: 0\nSocket messages sent: 0\nSocket messages received: 0\nSignals delivered: 0\nPage size (bytes): 4096\nExit status: 0\n",
  "tiledb_stats": {},
  "somacore_version": "1.0.10",
  "tiledbsoma_version": "1.10.1",
  "host_context": {
    "uname": [
      "Linux",
      "ip-172-31-24-57",
      "6.5.0-1018-aws",
      "#18~22.04.1-Ubuntu SMP Fri Apr  5 17:44:33 UTC 2024",
      "x86_64"
    ],
    "total_virtual_mem_bytes":<PHONE_NUMBER>2,
    "total_physical_mem_bytes":<PHONE_NUMBER>2,
    "swap_mem_total_bytes": 0,
    "swap_mem_used_bytes": 0,
    "swap_mem_free_bytes": 0,
    "swap_mem_pct_bytes": 0,
    "swap_mem_sin_bytes": 0,
    "swap_mem_sout_bytes": 0,
    "cpu_count": 8,
    "python_version": [
      3,
      10,
      12,
      "final",
      0
    ],
    "get_git_revision_hash": "e52092ec96eeaf1b7633476da925f89e1b74cadb"
  },
  "user_time_sec": "22.08",
  "system_time_sec": "1.94",
  "pct_of_cpu": 141,
  "elapsed_time_sec": "16.96",
  "avg_shared_text_sz_kb": 0,
  "avg_unshared_text_sz_kb": 0,
  "avg_stack_sz_kb": 0,
  "avg_total_sz_kb": 0,
  "max_res_set_sz_kb": 1906388,
  "avg_res_set_sz_kb": 0,
  "major_page_faults": 0,
  "minor_page_faults": 489891,
  "voluntary_context_switches": 3020,
  "involuntary_context_switches": 164481,
  "swaps": 0,
  "file_system_inputs": 0,
  "file_system_outputs": 0,
  "socket_messages_sent": 0,
  "socket_messages_received": 0,
  "signals_delivered": 0,
  "page_size_bytes": 4096,
  "exit_status": 0,
  "custom_out": [
    null,
    null
  ],
  "command_key": "4e379762d2a949439b7ed5b3da01dd05"
}

Hi @mdylan2 !
Can you please share:

Your URI
The output from the count query
If this is a local-disk query or remote (S3, TileDB Cloud)
If non-local:

What & where is the client -- laptop, EC2 instance & if so in what region
What region is the data stored in?

Also: are you using a soma.init_buffer_bytes setting in your config, and if so, what is it set to?

This is a local disk query.
The output is 24,448,693

ls -l backend/corpora/human_v6.0.4/obs/__fragments/
total 8
drwxrwxr-x 2 ubuntu ubuntu 4096 May  2 16:50 __1702890011299_1702890011299_a24b5abc82294634aecf6f89989193e0_20
drwxrwxr-x 2 ubuntu ubuntu 4096 May  2 16:50 __1706552148934_1706552148934_fec8c761647b4a4989b26afa2b092c3d_20

total 8
drwxrwxr-x 2 ubuntu ubuntu 4096 May  2 16:50 __1702890011299_1702890011299_a24b5abc82294634aecf6f89989193e0_20
drwxrwxr-x 2 ubuntu ubuntu 4096 May  2 16:50 __1706552148934_1706552148934_fec8c761647b4a4989b26afa2b092c3d_20

https://gist.github.com/mdylan2/0b320ab9ca1fc4a4d7ea61b009397d84

@mdylan2 one more thing please --
with tiledb.open(<URI>) as A:
    print(A.schema)

Included in the gist

[sc-46760]

@mdylan2 are the dataset_idx, cell_type_idx, and sample_idx permutations of the unique integers 0.. 24,448,692? Or lower cardinality? BTW, happy to hop on a call to look into this with you. :)

@mdylan2 one more ask, can you please also gist the output of
tiledbsoma.pytiledbsoma.config_logging('debug')

with soma.Experiment.open(<URI>) as exp:
    res = exp.obs.count

?

(Info is updated on the ☝ gist)

@mdylan2:
Thanks for the detailed gist Using this, I've found:

Your extra index dims (cell_type_id et al.) are not at issue here -- I was able to get a repro with and without having extra index dims
We are indeed falling into the nnz_slow case here:

https://github.com/single-cell-data/TileDB-SOMA/blob/1.10.1/libtiledbsoma/src/soma/soma_array.cc#L391
https://github.com/single-cell-data/TileDB-SOMA/blob/1.10.1/libtiledbsoma/src/soma/soma_array.cc#L405
https://github.com/single-cell-data/TileDB-SOMA/blob/1.10.1/libtiledbsoma/src/soma/soma_array.cc#L417

I had thought that perhaps we were overfetching column attributes but the third of three code links above suggests otherwise

For the moment, two workarounds:

Consolidating your two fragments of obs into one will resolve this
A workaround: 1+exp.obs.non_empty_domain()[0][1]. Rationale:

SOMA does not assume all soma_joinid values are contiguous starting from zero
But in practice they usually are -- the above will be correct, and quicker.

We'll brainstorm a couple ideas to get to doing the right thing more often here.

Hi @mdylan2 -- as we discussed off GitHub:

This will be resolved by #2407
Workaround meanwhile is 1 + exp.obs.non_empty_domain()[0][1]


Python version when installing Mujoco

As the installation instructions suggest to have either 2.7 or 3.5, the Mujoco installation fails as Mujoco 2.0 is supposed for python >=3.6 . Therefore, we need to mention this when installing Mujoco as an alternative simulator. Another solution would be to force the pip install  with 3.6 version.

Yes, they changed that on Aug 15: see following commit https://github.com/openai/mujoco-py/commit/0711ab58777a28aff847adbf05ba246a337908a0
On my computer, I have the repo set to a previous commit https://github.com/openai/mujoco-py/commit/9ca102f0a3cd744014273191d7f79d0e9fff24ee
Currently, it is not clear to me why they changed to Python 3.6 (I assume there is a code where they use a specific syntax or library); I will have to look more carefully at each commit after the one that I am using. However, if you want you can try to modify their setup.py by replacing python_requires='>=3.6' to python_requires='>=3.5'.


revert connection name (#35578)

Release cherry pick of the connection name revert PR

API change check
APIView has identified API level changes in this PR and created following API reviews.
azure-ai-ml


Apply "Commercial Rounding" to treat positive and negative values symmetrically

Found that rounding was not working as expected.  -0.95 was rounding to 0 when I used 1 significant digit, when I was expecting -1.0.  Updated to treat +/- numbers symmetrically

@milindalvares, any updates on this?


Corpses will despawn if they are on salvage.

1: Die on a salvage grid.
2: Wait until it despawns.
3: Poof. You are gone.

new traitor metagame unlocked

also pretty sure it happens if you are alive and inside something or sitting on something

this is intended


Switch back to raising bad bath errors

Issue #, if available:
fix #3827
Description of changes:

Switch back to raising bad bath errors
in pr #3603 we stopped failing if a template file was not found. This brings back that functionality but additionally allows a person to use the parameter ignore_bad_templates that will ignore if the path is bad.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

FYI - Typo in PR name (bath vs path)


Add ability to pull template from local directory instead of respository

Resolves #7
I currently assume ~/.raftconfig exists and this is never auto populated. When should we create this, at the time of installing Raft or maybe whenever Raft is run and it doesn't exist?

I currently assume ~/.raftconfig exists and this is never auto populated. When should we create this, at the time of installing Raft or maybe whenever Raft is run and it doesn't exist?


Adding fix to ensure removeAll() from std lib does not clash with

EZSwiftExtensions. Also adding test cases to ensure that never
happens again.
Checklist

[ ] New Extension
[x] New Test
[ ] Changed more than one extension, but all changes are related
[x] Trivial change (doesn't require changelog)

          3 Messages

:book:
Executed 200 tests, with 0 failures (0 unexpected) in 6.066 (6.379) seconds

:book:
Executed 185 tests, with 0 failures (0 unexpected) in 6.165 (6.343) seconds

:book:
Executed 122 tests, with 0 failures (0 unexpected) in 4.453 (4.545) seconds

  Generated by :no_entry_sign: Danger

Codecov Report

Merging #436 into master will increase coverage by 0.18%.
The diff coverage is 100%.

@@            Coverage Diff            @@
##           master    #436      +/-   ##
=========================================
+ Coverage   41.91%   42.1%   +0.18%
=========================================
  Files          50      50
  Lines        2240    2247       +7
=========================================
+ Hits          939     946       +7
  Misses       1301    1301

Impacted Files
Coverage Δ

Sources/ArrayExtensions.swift
83.33% <100%> (+0.93%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0a412f3...19df3d5. Read the comment docs.


refactor canopy to work in new world order

Codecov Report

Merging #73 (a9faee7) into main (ff11c84) will increase coverage by 2.09%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main      #73      +/-   ##
==========================================
+ Coverage   80.44%   82.53%   +2.09%
==========================================
  Files          30       30
  Lines        2127     2061      -66
==========================================
- Hits         1711     1701      -10
+ Misses        416      360      -56

Impacted Files
Coverage Δ

pynhm/hydrology/PRMSCanopy.py
80.95% <100.00%> (+18.55%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ff11c84...a9faee7. Read the comment docs.


tutorial: use a simpler tutorial

I would change the tutorial for a very simple one, (for example, the one who kaggle uses for their intro to machine learning https://www.kaggle.com/learn/intro-to-machine-learning -- easy to follow, two scripts (featurization / training) and then branching to try another model, then compare metrics of both models. (training take seconds instead of minutes).

From discord, @shcheklein :

it takes ~1 minute to train it
data is very small
memory footprint is 4GB as far as I remember
so, I do agree that we can come with a simpler scenario, def no a top priority right now

To clarify, that message above is about get started, not tutorial :)

The message from Ivan on this was:

...no need to change tutorial, there is a room for multiple tutorials.

@mroutis here is a link for tutorial created by me.

@ryokugyu can you find some time and finish the repo with your tutorial? It's hard to understand what's going on - I mean even what problem do we exactly solve? There are some leftovers (like pyc), etc. Then we can create a blog post out of it and put a link to the documentation.

Is this issue basically the same as #546 ** build interactive lessons with katacoda** now?

no, I think this issue comes from the fact that even get started requires some substantial amount of memory to run. I think, to some extent since we already have Tutorial_s_ now users have way more options, including Katacoda. May be we can specify in the NLP tutorials that they require more memory and there other options available?

I have noticed that the MNIST tutorial runs well even on low memory (1.5G RAM). Also it has only 3 stages (featurize, train, evaluate). It also describes experimentation by branches, using methods SVM, PCA and CNN.
Maybe this tutorial should be promoted more.

We don't have the deep tutorial anymore. Only get started. We'll rely on external tutorials for other cases. It's very hard to support and keep updated too many tutorials.


how can custom http request

Core Library
MSAL.js v2 (@azure/msal-browser)
Core Library Version
2.23.0
Wrapper Library
Not Applicable
Wrapper Library Version
Vue3,  just same js normal javascript
Description
Hi, My app is SPA, there are 3 redirect urls (1、http://validdomain.com, 2、http://localhost:8888/auth,3、http://localhost:8888/fc/auth,) in SPA config in AAD. I got an error when did aad auth, detail is:
{"error":"invalid_request","error_description":"AADSTS9002326: Cross-origin token redemption is permitted only for the 'Single-Page Application' client-type.\r\nTrace ID: 5fe3ee86-e746-4790-9464-f5fcc5b56200\r\nCorrelation ID: f645b0b7-f79e-48cd-9829-5f142994b79b\r\nTimestamp: 2022-04-21 07:11:08Z","error_codes":[9002326],"timestamp":"2022-04-21 07:11:08Z","trace_id":"5fe3ee86-e746-4790-9464-f5fcc5b56200","correlation_id":"f645b0b7-f79e-48cd-9829-5f142994b79b","error_uri":"https://login.partner.microsoftonline.cn/error?code=9002326"}

It looks like, it should only have one redirect uri for local development, or just exclude Origin header from http request
I have no privilege to config in AAD, so I want to custom http request of msal, can I?
MSAL Configuration
No response
Relevant Code Snippets
Request URL: https://login.partner.microsoftonline.cn/03258f72-ee37-4bbb-b38d-6efdfc96cde6/oauth2/v2.0/token

Payload:

client_id: xx
redirect_uri: http://localhost:8888/fc/auth
scope: user.read openid profile offline_access
code: 0.AAAAco8lAzfuu0uzjW79_JbN5u_w18SVsTxEmysh074TjuMBAEE.AQABAAIAAADF8uhbdqMKTqrrFtoyDhmYK77oU0qKE_XhC5XU6dcHZcMvAunh8i-Kqe7r9h6psnWRg7DnHxHh-zsb-hbvJ-YrXtZY5aqUXHXyocBNr09av0YQudv90GVNDJt17C2Jr9fuK8zV-mo7SMJedjJxbqyB6kD7mxNLL6Fk9i8ZPqFfIgUpYnVxMvr5SzCfls_yIOpPrqxV140SDLWjzLTdypa7u6ect0hW9l27tC20PEEH6KPwU5F9rmvGIcweW2pxbJHs8G0GWRzxC7z5VVl8jW_J4ByoHiLTonX7Uz6bTs-_KCrTYBJSzQ7P50eND0HxRmmMvzUb5VHSyMWziXIGgMcdJogQzoFmxHGWH42t3cS7xgU0zu8ju0uHc0tOpVLgFPaact4MUK8IauUHL7V5Mem1Tumrt3QsCjz1KMzGMd_Ro6enVQ4jJYVMh4dXVLcHbUPmPcZD10u6uKr6vRrhalY13dMtTRxghe6E7rHwKM3ff84hM9FMAHOy8CjuhEINlrAuUNitnqnsU2NyUZAkSdIBCFpV6V2IGny0ZRhyAlsiwKGmKXhyFE-xEEqt7qHufj0Gpuf7VH2hsGf9ebzho5wfWo3prhAWKrqxYsI2puKq4_zBjLgHFaPd-Vwp0v36H4eJEMRAqbnInsyJeyHU-f1561xQa2ir4kSVjIiIvF11SF_zvvE248OcjZBra9J8NQ93wuxW9JLGMz1HPJMgCQ0m8qhs1rmKFiY_l1u2xssfnABj7iv8shSp-jR6PPdVo1tyN_83Tgm8fB9mqK7tZTAjIAA
x-client-SKU: msal.js.browser
x-client-VER: 2.23.0
x-ms-lib-capability: retry-after, h429
x-client-current-telemetry: 5|865,0,,,|,
x-client-last-telemetry: 5|0|||0,0
code_verifier: -0ti4f5u0Px6QMxzLeBsdqIuR6xD7KW2OecVCRpqxG8
grant_type: authorization_code
client_info: 1
client-request-id: xx
X-AnchorMailbox: Oid:xx

If change redirect_uri to http://localhost:8888/auth from http://localhost:8888/fc/auth, then it does work properly, but I must add context path '/fc' for some reasonable reason...
Identity Provider
Azure AD / MSA
Source
External (Customer)

It is impossible to change Origin in Browser after tried, browser always set Origin is current href without path. so I have to request support from azure clound support.


Improve test coverage

Every rule is covered by at least two tests (one valid and invalid value), but there need to be more tests for various edge cases, and UI tests using trybuild for the error messages produced by the derive macro. Bad error messages are the worst part of using proc macros, so this crate should be hardened against that.

Tests should also run on every PR and commit to main.

Tests run on multiple versions of Rust on every PR and commit to main. The test coverage is also pretty good now. I'm not 100% satisfied, but I think it's fine to close this now.


Add Entity system base

Add an basic entity system to the game.

Will need to move EntityHandler into game state


Create maven-ci.yml

All this workflow does is run a test build* any time:

We push to master
Someone opens a PR that targets master

This workflow is handy because it'll catch build failures immediately--completely independent from our single current workflow (which can instead be triggered only as-needed for deployments).
* AFAIK the build doesn't go anywhere, doesn't do anything else, but by having Actions do it saves the extra steps of committing and forgetting when we've half-finished code.

Lmao, it just ran the action on itself

Fixed some missing build steps and tweaked the poms; cut down the jar by about 200kb


Version Packages

This PR was opened by the Changesets release GitHub action. When you're ready to do a release, you can merge this and the packages will be published to npm automatically. If you're not ready to do a release yet, that's fine, whenever you add more changesets to main, this PR will be updated.
Releases
<EMAIL_ADDRESS>Patch Changes

#739 297cfb1 Thanks @threepointone! - y-partykit/partysocket: default host to window.location.host

<EMAIL_ADDRESS>Patch Changes

#739 297cfb1 Thanks @threepointone! - y-partykit/partysocket: default host to window.location.host

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


[Backport release-21.11] nncp: 7.7.0 -> 8.0.2

This update introduces an encrypted packet format that is
incompatible with releases older than 8.0.0.
Backport of commit 2d4524eb8cfc0d554d281fd932ff264d2c114f9e

This update introduces an encrypted packet format that is incompatible with releases older than 8.0.0.

I am not sure if this is a good candidate to backport them.

This update introduces an encrypted packet format that is incompatible with releases older than 8.0.0.

I am not sure if this is a good candidate to backport them.

Usually if there are updates to a network protocol I backport them.


對齊狀態顯示在修改頁

naphing的需求：
希望在修改頁面上也能看見對齊狀態，方便修正

Coverage increased (+0.2%) to 70.996% when pulling<PHONE_NUMBER>faf72d2140fa47ef6aee787fc59bdd on 對齊狀態顯示在修改頁 into fb0c567000addc0df6628f4700e6d941f8fd9b5e on master.

Coverage increased (+0.2%) to 70.933% when pulling f11b535e98a569dafbd942715da1c76ec63f927d on 對齊狀態顯示在修改頁 into fb0c567000addc0df6628f4700e6d941f8fd9b5e on master.

Coverage increased (+0.2%) to 70.933% when pulling f11b535e98a569dafbd942715da1c76ec63f927d on 對齊狀態顯示在修改頁 into fb0c567000addc0df6628f4700e6d941f8fd9b5e on master.

Coverage increased (+0.2%) to 70.933% when pulling f11b535e98a569dafbd942715da1c76ec63f927d on 對齊狀態顯示在修改頁 into fb0c567000addc0df6628f4700e6d941f8fd9b5e on master.

Coverage increased (+0.2%) to 70.933% when pulling f11b535e98a569dafbd942715da1c76ec63f927d on 對齊狀態顯示在修改頁 into fb0c567000addc0df6628f4700e6d941f8fd9b5e on master.


S3 API support  TTL ?

The Filer API supports TTL.So does the S3 API support  TTL? How to do

use path-specific configurations https://github.com/chrislusf/seaweedfs/wiki/Path-Specific-Configuration
configure for /buckets/<bucket_name>

thanks

thanks

Hello! Have you realized it? How to implement docker deployment?


Consider adding a CITATION.cff file

Since a few months ago, GitHub generates a Cite this repository button (see example here). You can enable it by creating a CITATION.cff file (like this one).
More context:

About the cff format.
Helper for creating your own.

CITATION.cff added to repository


How can I add ON DUPLICATE KEY UPDATE to my query?

I'm currently adding it via regex, but there's got to be a way with SqlKata, right?

@TeamGameRevolution could you please post the full query, and how you are handling it right now ?

Had to switch away from regex because of some reasons.
datensaetze is a Dictionary<string, dynamic>
                    var query = new Query(quelle.Tabelle).AsInsert(datensaetze);
                    var compiler = new MySqlCompiler();
                    var qStr = compiler.Compile(query).Sql + " ON DUPLICATE KEY UPDATE " + string.Join(",", datensaetze.Select(d => $"{d.Key} = {(d.Value is string ? $"'{MySqlHelper.EscapeString(d.Value)}'" : d.Value)}"));

closing, you can follow this feature on #93


HBASE-25424 Find a way to config OpenTelemetry tracing without direct…

…ly depending on opentelemetry-sdk

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 30s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+0 :ok:
shelldocs
0m  0s
Shelldocs was not available.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ HBASE-22120 Compile Tests _

+0 :ok:
mvndep
0m 30s
Maven dependency ordering for branch

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 14s
Maven dependency ordering for patch

-0 :warning:
shellcheck
0m  2s
The patch generated 3 new + 34 unchanged - 0 fixed = 37 total (was 34)

-0 :warning:
whitespace
0m  0s
The patch has 2 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply

+1 :green_heart:
xml
0m  4s
The patch has no ill-formed XML file.

+1 :green_heart:
hadoopcheck
17m 32s
Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0.

_ Other Tests _

+1 :green_heart:
asflicense
0m 29s
The patch does not generate ASF License warnings.

27m 18s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/1/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2808

Optional Tests
dupname asflicense shellcheck shelldocs hadoopcheck xml

uname
Linux 58b822d742a9 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
HBASE-22120 / bd745da477

shellcheck
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/1/artifact/yetus-general-check/output/diff-patch-shellcheck.txt

whitespace
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/1/artifact/yetus-general-check/output/whitespace-eol.txt

Max. process+thread count
76 (vs. ulimit of 30000)

modules
C: . hbase-assembly U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/1/console

versions
git=2.17.1 maven=3.6.3 shellcheck=0.4.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 28s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ HBASE-22120 Compile Tests _

+0 :ok:
mvndep
0m 31s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
4m 12s
HBASE-22120 passed

+1 :green_heart:
compile
2m 48s
HBASE-22120 passed

+1 :green_heart:
shadedjars
7m  9s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
3m  1s
HBASE-22120 passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 22s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
4m  2s
the patch passed

+1 :green_heart:
compile
2m 56s
the patch passed

+1 :green_heart:
javac
2m 56s
the patch passed

+1 :green_heart:
shadedjars
7m  0s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
2m 58s
the patch passed

_ Other Tests _

-1 :x:
unit
144m  1s
root in the patch failed.

182m  6s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2808

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 4a0a4da538ad 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
HBASE-22120 / bd745da477

Default Java
AdoptOpenJDK-11.0.6+10

unit
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-root.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/1/testReport/

Max. process+thread count
4147 (vs. ulimit of 30000)

modules
C: hbase-assembly . U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/1/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
9m 22s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+0 :ok:
shelldocs
0m  1s
Shelldocs was not available.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ HBASE-22120 Compile Tests _

+0 :ok:
mvndep
0m 30s
Maven dependency ordering for branch

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 15s
Maven dependency ordering for patch

+1 :green_heart:
shellcheck
0m  2s
There were no new shellcheck issues.

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  5s
The patch has no ill-formed XML file.

+1 :green_heart:
hadoopcheck
20m 36s
Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0.

_ Other Tests _

+1 :green_heart:
asflicense
0m 28s
The patch does not generate ASF License warnings.

39m 12s

Subsystem
Report/Notes

Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/2/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2808

Optional Tests
dupname asflicense shellcheck shelldocs hadoopcheck xml

uname
Linux 997d5111a4ed 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
HBASE-22120 / bd745da477

Max. process+thread count
63 (vs. ulimit of 30000)

modules
C: . hbase-assembly U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/2/console

versions
git=2.17.1 maven=3.6.3 shellcheck=0.4.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 14s
Docker mode activated.

-0 :warning:
yetus
0m  4s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ HBASE-22120 Compile Tests _

+0 :ok:
mvndep
0m 34s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
4m 19s
HBASE-22120 passed

+1 :green_heart:
compile
2m 50s
HBASE-22120 passed

+1 :green_heart:
shadedjars
7m  3s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
2m 57s
HBASE-22120 passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 22s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
3m 59s
the patch passed

+1 :green_heart:
compile
2m 51s
the patch passed

+1 :green_heart:
javac
2m 51s
the patch passed

+1 :green_heart:
shadedjars
6m 58s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
2m 56s
the patch passed

_ Other Tests _

-1 :x:
unit
149m 47s
root in the patch failed.

188m 28s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2808

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux<PHONE_NUMBER>e8 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
HBASE-22120 / bd745da477

Default Java
AdoptOpenJDK-11.0.6+10

unit
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/2/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-root.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/2/testReport/

Max. process+thread count
3857 (vs. ulimit of 30000)

modules
C: hbase-assembly . U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/2/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 28s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+0 :ok:
shelldocs
0m  0s
Shelldocs was not available.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ HBASE-22120 Compile Tests _

+0 :ok:
mvndep
0m 35s
Maven dependency ordering for branch

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 13s
Maven dependency ordering for patch

+1 :green_heart:
shellcheck
0m  2s
There were no new shellcheck issues.

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  3s
The patch has no ill-formed XML file.

+1 :green_heart:
hadoopcheck
17m 48s
Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0.

_ Other Tests _

+1 :green_heart:
asflicense
0m 30s
The patch does not generate ASF License warnings.

26m 30s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/3/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2808

Optional Tests
dupname asflicense shellcheck shelldocs hadoopcheck xml

uname
Linux 0023de2a58ee 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
HBASE-22120 / bd745da477

Max. process+thread count
76 (vs. ulimit of 30000)

modules
C: . hbase-assembly U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/3/console

versions
git=2.17.1 maven=3.6.3 shellcheck=0.4.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 29s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+0 :ok:
shelldocs
0m  0s
Shelldocs was not available.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ HBASE-22120 Compile Tests _

+0 :ok:
mvndep
0m 19s
Maven dependency ordering for branch

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 19s
Maven dependency ordering for patch

+1 :green_heart:
shellcheck
0m  1s
There were no new shellcheck issues.

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
xml
0m  4s
The patch has no ill-formed XML file.

+1 :green_heart:
hadoopcheck
17m  8s
Patch does not cause any errors with Hadoop 3.1.2 3.2.1 3.3.0.

_ Other Tests _

+1 :green_heart:
asflicense
0m 27s
The patch does not generate ASF License warnings.

25m 40s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2808

Optional Tests
dupname asflicense shellcheck shelldocs hadoopcheck xml

uname
Linux def44d78dba3 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
HBASE-22120 / bd745da477

Max. process+thread count
76 (vs. ulimit of 30000)

modules
C: hbase-assembly . U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/console

versions
git=2.17.1 maven=3.6.3 shellcheck=0.4.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m  1s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ HBASE-22120 Compile Tests _

+0 :ok:
mvndep
0m 19s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
4m  0s
HBASE-22120 passed

+1 :green_heart:
compile
2m 51s
HBASE-22120 passed

+1 :green_heart:
shadedjars
7m  0s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
2m 57s
HBASE-22120 passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 19s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
4m  3s
the patch passed

+1 :green_heart:
compile
2m 50s
the patch passed

+1 :green_heart:
javac
2m 50s
the patch passed

+1 :green_heart:
shadedjars
7m  0s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
2m 53s
the patch passed

_ Other Tests _

-1 :x:
unit
150m 59s
root in the patch failed.

188m 24s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2808

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 552a83048cbd 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
HBASE-22120 / bd745da477

Default Java
AdoptOpenJDK-11.0.6+10

unit
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-root.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/testReport/

Max. process+thread count
3890 (vs. ulimit of 30000)

modules
C: hbase-assembly . U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 13s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ HBASE-22120 Compile Tests _

+0 :ok:
mvndep
0m 17s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
3m 25s
HBASE-22120 passed

+1 :green_heart:
compile
2m 26s
HBASE-22120 passed

+1 :green_heart:
shadedjars
6m 58s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
2m 21s
HBASE-22120 passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 19s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
3m 26s
the patch passed

+1 :green_heart:
compile
2m 19s
the patch passed

+1 :green_heart:
javac
2m 19s
the patch passed

+1 :green_heart:
shadedjars
6m 50s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
2m 19s
the patch passed

_ Other Tests _

-1 :x:
unit
317m 32s
root in the patch failed.

351m 56s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/2808

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 5f20a1483d07 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
HBASE-22120 / bd745da477

Default Java
AdoptOpenJDK-1.8.0_232-b09

unit
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-root.txt

Test Results
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/testReport/

Max. process+thread count
4278 (vs. ulimit of 30000)

modules
C: hbase-assembly . U: .

Console output
https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2808/4/console

versions
git=2.17.1 maven=3.6.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.


chore(build): fix gpg import

This PR fixes the gpg import step for the "bionic" travis image.   This is needed due to the fact that "bionic" uses a more recent version of the "gpg" command.

:tada: This PR is included in version 9.13.2 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


How to get post ID of the currently edited page in visual builder when using shortcode in the text/code divi module

Problem Description
I've created a shortcode (am a 3rd party divi developer) that uses post ID as one of the attributes. If no post ID is supplied, the post ID of the current page is used.
When adding the shortcode (without the post ID attribute) to the divi text/code module in visual builder, I am unable to get the post ID of the page being edited currently.
It's due to a iframe request that divi visual builder makes http://mywebsitedomain.com/?et_pb_preview=true&et_pb_preview_nonce=0f1a73accf&iframe_id=et-fb-preview-1594791272692-634 . It triggers a new page request in WordPress and we loose the context of the page.
Ideally this request should include the post ID and also provide some hooks for developers to listen into (via javascript) before the iframe request is made.
Steps To Reproduce

Open a page in divi visual builder.
Add a text module
Add shortcode in the textarea.
This will make a doc type request (chrome inspector) originating from a programmatically created iframe.

Screenshot and/or gif

@wpt00ls sorry I'm not able to reproduce this. Can you please confirm if you still experience this on the latest version of CDE?

Did you figure out how to get the post ID? I have the same problem.

@grex22 @cseevinck @wpt00ls can you pls try ETBuilderBackendDynamic.postId & let me know if it works for you?

Any development on this?
I would also like Divi Visual Builder to send the current Post ID through the iframe request.
Otherwise, shortcodes that rely on the current post data cannot be previewed on Divi Builder. This looks like an easy change to be made.

Anyone figure this out?


[BUG] Enable the code to run both on google colab as well as local system

Has this bug been raised before?

[X] I have checked "open" AND "closed" issues and this is not a duplicate

Description
I found that the code displays an error if not executed on google colab hence I want to modify it so that it runs both on google colab as well as local environment

Steps to Reproduce
Include any relevant details like:

I found the error on Stock_Price_Prediction.ipyng
I was executing the code when I found the error
It displayed an error saying No module named google.colab

Screenshots
No response
Do you want to work on this issue?
Yes
If "yes" to the above, please explain how you would technically implement this.
I will check if the code is being executed on google colab or on the local system and then the path of the file will be provided accordingly

Hi @shristirwt,
I have reviewed the code, and it is functioning as expected on my end.
Could you please verify if you are using the correct path?

Let me know if you encounter any issues or need further assistance.

Hello @jvedsaqib ,
I am running the code locally that's why it is resulting in an error . I was thinking of implementing the code in a way that it runs on both

Ok!
If you are running locally then there's no need to import colab. You can just load the DS directly.
As for changing it to be flexible for both ways, it would be great.
@rohitinu6 can assign you to this.

Thank you
Do I need to reach out to him or will he assign it to me from the issues raised


I like it, but it does not open all ...

Hello friend, your code (transfer of coordinates by cookie is what I needed), Even so, I have a problem, and is that any url that I enter that has a javascript does not work. Example:
Http://<IP_ADDRESS>/smarttrash/index.php?au=58263EE891CCBB4F7428C994EBA47CDB
The idea of this show the location on the map, but unfortunately the JS hangs, what can it be?
Thank you very much.

Check your ASWP_OFFLINE variable, whether it's true or false.

awsp_offline is true

Then you should try changing it to false. Or try some little more tweaks,
if still doesn't, feel free to ask.

This issue seems to be resolved as no update has been provided by now. I'm closing this.
Feel free to open this issues again if unresolved.


Use Field name of struct when db tag not avilable

Hi
When using NamedQuery with structs if the struct filed not annotated with db tag the response is
"could not find name"
my opinion is to use filed name in this case of db tag not avilable

I was bitten by this today


FIX: Unify BrainVision reading

Ready for review @teonlamont

that's it for me

merge when you're happy. No time to look.

Will do, should be today sometime

Thanks for the quick review @teonlamont

thanks @Eric89GXL!


test-branch/execute-job/wrong-commit-sha-on-pr/24938bc0-0c1c-4794-a3b5-d89b8cd161f4

PR for testing 51f7d0e2ed63f6a42bf1b66d238e78f9ffb8d8dd

/canonical/self-hosted-runners/run-workflows 931ad21dd9ace68aaa0a7d341e94de96ad93fa6b


Add in DB lazy load support

Adds in required DB access that is configurable via application.properties.
Lazily loads the value from the DB if not present. It will cache null values. This change does not include expiration, which will be required for lazy cache only mode (eager does not require this).
Includes basis for weighed eviction where can estimate size based on JVM on heap. Still need to inspect JOL (Java Object Layout) to get these numbers more precise.

Updated


Issue with k8s.io/docs/tutorials/kubernetes-basics/create-cluster/cluster-interactive/

katacoda.com refused to connect

/kind support

/remove-lifecycle rotten

/remove-lifecycle stale

/remove-lifecycle rotten

/remove-lifecycle stale

There was indeed a known issue on katacoda, see issue 33936.
Hey @RA489, please don't fight the lifecycle triage robot, this support issue had already time to answer, or could reopen the issue then.
This issue sounds more like a request for support and less like an issue specifically for docs. I encourage you to bring your question to the #kubernetes-users channel in Kubernetes slack. You can also search resources like Stack Overflow for answers to similar questions.
You can also open issues for Kubernetes functionality in https://github.com/kubernetes/kubernetes.
If this is a documentation issue, please re-open this issue.
/close