How do I export plots that show up in one pager output individually in separate files?

For e.g. how do I get just the "Response Decomposition Waterfall" chart exported?
Idea is to format different charts to be bigger so that I can read the charts in case of many variables in the model.

Hi @laresbernardo ! Thanks, but I ran the exact code you gave above with just my model's ID and when I run the myplots%patches$plots line I get NULL. I think I am missing something. Where will get plots separated out for the chosen model? Will it be in the same folder where all the one_pagers and CSVs were generated or they will be available locally in R studio?

Just added to the demo.R file as a reference:
# Pick any available model ID
select_model <- "1_2_3"

# To plot model's one-pager:
myOnePager <- robyn_onepagers(InputCollect, OutputCollect, select_model, export = FALSE)

# To check each of the one-pager's plots
myOnePager[[select_model]]$patches$plots[[1]]
myOnePager[[select_model]]$patches$plots[[2]]
myOnePager[[select_model]]$patches$plots[[3]]
# ...

@laresbernardo . Thanks, but I just ran this on R console -

It seemed to have run, but I don't see any plot anywhere.. neither in R studio nor in the folder where I am getting CSVs etc. exported. Sorry, but I am confused as to where it's going.

This is a basic R / RStudio question unrelated to Robyn. But, usually when you run a plot function you'll be able to visualize the plot in the Files/Plots panel. Note that the parameter export is set to FALSE. That means you're only creating the R object (list) without creating the PNG file. You can change that and the file will be create where you set to files be created; to check where that is, print OutputCollect$plot_folder.

Hey @laresbernardo, Thanks for all the help and I was able to figure out the last bit of plotting code.
For anyone, who doesn't use RStudio frequently and has trouble figuring out this last bit of getting individual plots out of the one_pagers, please follow the below code -
Pick any available model ID
select_model <- "1_101_4"
To plot model's one-pager:
mymodel <- robyn_onepagers(InputCollect, OutputCollect, select_model, export = TRUE)
To check each of the one-pager's plots
setwd("wherever/you/want/the/plots/to/go")
jpeg("plotname.jpeg")
mymodel$1_101_4$patches$plots[[4]]
dev.off()

I see what you mean. You can actually use ggplot2 directly to export the plot as well:
myplot <- mymodel$`1_101_4`$patches$plots[[4]]
ggplot2::ggsave(myplot, "plotname.png")

And, as you mention, you can use setwd() to set a working directory to export plots to and getwd() to see where you're currently standing (and plots will be exported to).


HDDS-4126. Freon key generator should support >2GB files.

What changes were proposed in this pull request?
fileSize parameter in HadoopFsGenerator is an int which limits it to max 2GB. But works well with long.
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-4126
How was this patch tested?
Na

@ArafatCloudera I have just noticed that there are a few other cases where the same limit applies:
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/StreamingGenerator.java
66:  private int fileSize;

hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/S3KeyGenerator.java
73:  private int fileSize;

hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/HadoopDirTreeGenerator.java
73:  private int fileSizeInBytes;

hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/containergenerator/BaseGenerator.java
44:  private int keySize;

Would you mind changing these as well to long?

Sure will get it done !!

@adoroszlai I could only make changes for StreamingGenerator.java & HadoopDirTreeGenerator.java
I could not make changes to S3KeyGenerator.java  because the RandomStringUtils.randomAscii(fileSize) function on line:122 takes only Integer as an argument.
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/S3KeyGenerator.java
73:  private int fileSize;

I could not make changes to BaseGenerator.java because a lot of the code would have to be rewritten in other files.
hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/freon/containergenerator/BaseGenerator.java
44:  private int keySize;

I could only make changes for StreamingGenerator.java & HadoopDirTreeGenerator.java

That's fine.  Thanks for checking.

Thanks @ArafatCloudera for the patch, @jojochuang for the review.


No Action tile

i there, in my hoobs, the accessories appears with an chip image whitout actions.

Report to the HOOBS Community


Matrix Mismatch Error During DuoModalZeroShotModel Initialization in GATE Framework

Describe the bug
An execution error occurs when running a multi-modal learning model within the GATE framework, resulting in a shape mismatch between matrices during a linear operation. The specific error message is: RuntimeError: mat1 and mat2 shapes cannot be multiplied (2x768 and 512x2). This indicates that the tensor dimensions expected by the forward operation are incompatible.
To Reproduce

Initialize the environment with certain project configurations, as enumerated by the error trace.
Run the script gate/run.py while applying the given overrides related to the model and training configuration.
Observe that at some point when the DuoModalZeroShotModel is being instantiated, a forward pass is attempted with a dummy batch.
The process fails during this step, resulting in a RuntimeError, due to a shape mismatch between the tensors intended for matrix multiplication.

/disk/scratch_fast1/aantoni2/mambaforge/envs/gate/bin/python gate/run.py exp_name=alpha-flickr30k-SIGLIP-P16-224-7 encoder=timm encoder.image_size=224 encoder.pretrained=True encoder.timm_model_name=vit_base_patch16_siglip_224 encoder.clip_model_name=openai/clip-vit-base-patch16 adapter=duo-modal-zero-shot-classifier dataset=flickr30k optimizer.lr=1e-05 optimizer.weight_decay=0.01 trainer=image_to_text_zero_shot_classification evaluator=image_to_text_zero_shot_classification num_workers=32 seed=7 train_batch_size=64 eval_batch_size=64 train_iters=10000 learner.evaluate_every_n_steps=500

Expected behavior
The model should instantiate correctly, and tensor shapes should align appropriately to perform matrix multiplications during the linear algebra operations within the forward pass. The model's construction should not lead to this kind of shape mismatch error.
Error Logs
/disk/scratch_fast1/aantoni2/mambaforge/envs/gate/lib/python3.10/site-packages/transformers/models/bart/modeling_bart.py:755: FutureWarning: The class `PretrainedBartModel` has been depreciated, please use `BartPreTrainedModel` instead.
  warnings.warn(
...
RuntimeError: mat1 and mat2 shapes cannot be multiplied (2x768 and 512x2)
...

Desktop (please complete the following information):

OS: The specific operating system on which the error occurred is not provided in the trace, but it appears to be a Unix-like system given the directory structure.
Python Version: 3.10
Framework Version: GATE environment specifics are not provided in the trace.

Additional context

The warning about the deprecated PretrainedBartModel could be unrelated to the core runtime error but should be addressed as part of the code maintenance.
The root of the error seems to be related to input dimensionality assumptions within the gate.models.task_adapters.duo_modal_zero_shot_classification.DuoModalZeroShotModel during model initialization.
Further investigation is needed to ensure that all input feature dimensions are processed and projected correctly to match expected sizes for linear operations.

This was solved in #7fbb1dd


modules/alertmanager: add clusterAdvertiseAddress option

This is https://github.com/NixOS/nixpkgs/pull/45191 which I closed accidentally by rebasing my fork's master onto nixos-unstable, sorry about that.  I don't know why it says it was merged, because there should have been nothing to merge.
Alertmanager fails to start when the memberlist library cannot find any private IP addresses on the system.  This is a safeguard to avoid exposing cluster ports over the internet unintentionally.  The workaround is to pass the --cluster.advertise-address argument to AlertManager.
See also:
https://github.com/prometheus/alertmanager/pull/1437
https://github.com/prometheus/alertmanager/issues/1434
Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Fits CONTRIBUTING.md.

This is not needed anymore since https://github.com/NixOS/nixpkgs/pull/46068 was merged, if necessary just pass the --cluster.advertise-address flag.


Proposal: support multiple fs instance

I proposal to change the configure signature to return FileSystem (PS. not Promise<FileSystem>) instance. So there can be multiple fs instance same time.

@hackwaly,
configure does not return Promise<FileSystem>. It returns Promise<void>. It is also designed to support multiple file systems at different mount points.


Add Swedish and Uzi syntax translations

I also added and improved some Estonian translations

I took adding Uzi syntax translations as a good way for me to learn the language.
Some notes that could be helpful in finding good "language independent" lookup keys for the translation messages (job being done in #12):

The sonar block's Uzi code uses distance_mm, distance_cm and distance_m, this could be in the directions of a good label for the translation. Although I could prefer a more laconic label such as distance unit meter. I made the change to resolve collision with lookup keys m (for meter) and m (for minute).
something that could add more contex to the translations and lookup keys would be to use labels for the inputFields, e.g. to use %distance_unit instead of %1. This change in the initBlock code would be pretty straightforward and only require changing inputFields to an Object instead of Array and changing the regular expression.

What do you think?

I added a language independent lookup label in 33f7a47. It is based on the English translations (and some Uzi syntax until I find better more English-looking labels.
I already feel this independence of any of the shown/translated languages allows greater flexibility. For example in 37bb10f it enabled me to define the delay block without conflicting with the translation string of the wait block. But I ran into some further problems with adding the Uzi syntax translation for the delay block.
As it is set up now, some strings (e.g. time units for milliseconds, seconds and 'minutes) are translated independently of the blocks they are used in. I see a clear rationale behind this, and I sympathize with it, but as much as the Uzi syntax is concerned, the dropdown selection for the time unit actually specifies the Uzi function ('delayMs, delayS etc). One way to tackle adding the Uzi syntax translation would be to add several translation strings that are block-specific, like delay_milliseconds, wait_milliseconds. How many that are needed would depend on the Uzi syntax and if there still is a translation string that is "shared" between many blocks, we could name it something more general, like time_unit_milliseconds (or why not with whitespace instead time unit milliseconds). I feel this drifts a bit away from focus of the Physical BITS into a translation thingy, but probably there is not too much work from the translation side of simply copying "milisegundos" into each of the block specific translation? How do you feel?

Yes, I see the problem. I think your idea of using block specific strings should work fine. And I have no problem with copying "milisegundos" as many times as needed.

Great work, by the way. Let me know when you want me to merge this pull request.

Thanks for encouraging me. The last commit successfully demonstrates that it works to translate the delayMs() and related functions into Uzi syntax. This is a great way to learn Uzi for me :-)

I noticed the block name toggle_variable maybe should be name toggle_pinstate, but don't really know how much it matters and how to keep track of these small things...

I can't really figure out why this sometimes happens and sometimes doesn't happen: currently the block number_divisibility is shown as split into two rows in all translations. But in the for block it happens only for Estonian language. I will investigate the initBlock function during the weekend.

I noticed the block name toggle_variable maybe should be name toggle_pinstate, but don't really know how much it matters and how to keep track of these small things...

Yes, naming is hard. In my first attempt at defining the blocks I didn't understood blockly so I ended up making duplicates for each block that had a pin as argument: one with a dropdown and another with a value (these ones had the _variable suffix). Later I added the pin block and learned about shadow blocks so I removed all the dropdown duplicates. Unfortunately I was too lazy to rename the remaining blocks.
You can rename any block if you want. You just have to be careful to also rename it in the toolbox.xml and blocks2ast.js files. The toolbox is easy, it just follows the blockly rules. The blocks2ast.js is a little more complicated because it contains all the rules to generate code from blocks. But you shouldn't have any problem. There is an object called dispatchTable which uses the block names as keys, it's not pretty but it works :)
https://github.com/GIRA/UziScript/blob/a70dea48045c0163040077578755b01d2a51055c/web/ide/blocks2ast.js#L242-L1110
If you want to rename the blocks it would be great but I suggest we merge these changes first. I'm starting to worry about conflicts.


Maximum and Minimum number of test cases for code snippet question

What is the maximum and minimum number of test cases that a test conductor can add or remove? Is the coding question without test cases a valid question? I am assuming that there should be at-least one test case for the question to be valid.

There is not limit to add test cases. It's upon user how many test cases he wants to add


Makefile: Fix --yaml arg for microk8s

Newer microk8s requires the yaml arg to be specified as --yaml, not
-o yaml. This breakage was backported to all microk8s release series.
Fix the target.
Related: https://github.com/ubuntu/microk8s/pull/1042

Validated manually on my machine, so no need to run CI. Ci doesn't trigger this target anyway.

Coverage decreased (-0.005%) to 45.447% when pulling 88e14f856b900aa3b9c3781b7c4e175253944f9f on joestringer:submit/fix-make-microk8s into ad9ccefabc940c9cd5616a4e157c92f18bd9151f on cilium:master.


type Add a document of ninedata sql window

Proposed changes

ADD a document of ninedata sql window.  This document describes the feature and usage of ninedata sql window. The developer can connect and query doris with sql window.

The sidebar transformation has been completed, and a new SQL window has been added.


fix the prom query to look for job node

While the rest of the dashboard uses job="node" selector to query metrics, this panel is still configured to use the job="node-exporter" selector, which break the panel.
Updated the panel query to keep the consensus over all the dashboard.

There's still some more references to job="node-exporter". Can you search and replace them too?
assets/kubernetes/rules.yaml
648:        node_cpu_seconds_total{mode="idle",job="node-exporter"}
655:        node_memory_MemAvailable_bytes{job="node-exporter"} or
657:          node_memory_Buffers_bytes{job="node-exporter"} +
658:          node_memory_Cached_bytes{job="node-exporter"} +
659:          node_memory_MemFree_bytes{job="node-exporter"} +
660:          node_memory_Slab_bytes{job="node-exporter"}
667:          rate(node_cpu_seconds_total{mode!="idle",mode!="iowait",mode!="steal",job="node-exporter"}[5m])

site/content/kubernetes/_index.md
2122:    node_cpu_seconds_total{mode="idle",job="node-exporter"}
2134:    node_memory_MemAvailable_bytes{job="node-exporter"} or
2136:      node_memory_Buffers_bytes{job="node-exporter"} +
2137:      node_memory_Cached_bytes{job="node-exporter"} +
2138:      node_memory_MemFree_bytes{job="node-exporter"} +
2139:      node_memory_Slab_bytes{job="node-exporter"}
2151:      rate(node_cpu_seconds_total{mode!="idle",mode!="iowait",mode!="steal",job="node-exporter"}[5m])

AFAIK, those files are generated

Closing, as those files should be edited on the source repo side.


Feature Request: watch spec file and reload on changes

Thanks for contributing!  I've been on a break for the past few weeks but am getting back in the swing of things; I'm hoping to tackle this and possibly #6 tomorrow.

This issue is fixed at version 1.5.0


chore: Add view mode to the analytics events

Description

Add view mode to the analytics events.

Fixes #15690
Type of change

Bug fix (non-breaking change which fixes an issue)

Checklist:

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes

/ok-to-test sha=f1826a2

/ok-to-test sha=24510f0

@AnaghHegde Keep an eye out on the merge of https://github.com/appsmithorg/appsmith/pull/15684 as it changes FieldName.AUDIT_DATA to FieldName.EVENT_DATA

@AnaghHegde there are merge conflicts as well.

/ok-to-test sha=ede804b

/ok-to-test sha=f39b295

/ok-to-test sha=d66b1f8

/ok-to-test sha=9b211b9

/ok-to-test sha=01307c6

/ok-to-test sha=8d1a98a

/ok-to-test sha=3b08b43

/ok-to-test sha=db5f915

/ok-to-test sha=db5f915

/ok-to-test sha=a0c92fd

/ok-to-test sha=976b260

/ok-to-test sha=408c396

/ok-to-test sha=f4763c3

/ok-to-test sha=f4763c3

/ok-to-test sha=759d699

/ok-to-test sha=a96d66e

/ok-to-test sha=328034f

/ok-to-test sha=92d3c60

/ok-to-test sha=22ab402

/ok-to-test sha=4e129c6


Impossible to delete/drop series when tag value includes dash character

Bug report
I am trying to delete all series from and old host not anymore in use.
System info:
# influxd version
InfluxDB v1.4.3 (git: 1.4 60d27e6995558f38a39e90b35a92cbac080310a3)
# influx --version
InfluxDB shell version: 1.4.3

Steps to reproduce:

USE telegraf
DROP SERIES WHERE "host" = 'thisisokhost'
SHOW SERIES WHERE "host" = 'thisisokhost' >> does not list results(CORRECT)
DROP SERIES WHERE "host" = 'this-is-not-ok-host'
SHOW SERIES WHERE "host" = 'this-is-not-ok-host' >> lists results (ERROR)
DELETE FROM <measurement> WHERE "host" = 'this-is-not-ok-host'
SHOW SERIES WHERE "host" = 'this-is-not-ok-host'  >> lists results (ERROR)

Expected behavior:
4 and 6 should delete all series from tag value 'this-is-not-ok-host'.
Actual behavior:
Deleting series at point 4 and 6 does not work as expected. There's still contents after running 5 and 7.
I suspect the problem is from the hostname (tag value) using "-" (dash).

@carlessanagustin can you upgrade to 1.5.3 and see if you can reproduce? We made some changes to drops and deletes in 1.5.

@e-dard

upgraded to 1.5 and now DROP works fine :)
but hosts keep appearing in chronograf 1.5 /sources/0/hosts dashboard until I restart influx service :(

any flush option available?

@carlessanagustin that seems like a Chronograf issue? Maybe you could file a ticket over at Chronograf? I'm going to close this as this particular issue seems to be resolved.

Reopening this. Chronograf doesn't "cache" any host list data, so it must be coming from the database somehow. Here are the queries Chronograf runs on the host list page. Try running them in the DB and see if the host is returned.
      SELECT mean("usage_user") FROM "telegraf"."autogen"."cpu" WHERE "cpu" = 'cpu-total' AND time > now() - 10m GROUP BY host;
      SELECT mean("load1") FROM "telegraf"."autogen"."system" WHERE time > now() - 10m GROUP BY host;
      SELECT non_negative_derivative(mean(uptime)) AS deltaUptime FROM "telegraf"."autogen"."system" WHERE time > now() - 1m0s * 10 GROUP BY host, time(1m0s) fill(0);
      SELECT mean("Percent_Processor_Time") FROM "telegraf"."autogen"."win_cpu" WHERE time > now() - 10m GROUP BY host;
      SELECT mean("Processor_Queue_Length") FROM "telegraf"."autogen"."win_system" WHERE time > now() - 10s GROUP BY host;
      SELECT non_negative_derivative(mean("System_Up_Time")) AS winDeltaUptime FROM "telegraf"."autogen"."win_system" WHERE time > now() - 1m0s * 10 GROUP BY host, time(1m0s) fill(0);
      SHOW TAG VALUES WITH KEY = "host";

show series from /^apache$|^consul_health_checks$|^consul_consul_fsm_register$|^consul_memberlist_msg_alive$|^consul_raft_state_candidate$|^consul_consul_http_GET_v1_health_state__$|^consul_raft_state_leader$|^consul_serf_events$|^cpu$|^disk$|^diskio$|^docker$|^docker_container_blkio$|^docker_container_net$|^elasticsearch_indices$|^haproxy$|^influxdb_database$|^influxdb_httpd$|^influxdb_queryExecutor$|^influxdb_write$|^kubernetes_node$|^kubernetes_pod_container$|^kubernetes_pod_network$|^kubernetes_system_container$|^system$|^mem$|^memcached$|^mesos$|^mongodb$|^mysql$|^net$|^netstat$|^nginx$|^nsq_channel$|^nsq_server$|^nsq_topic$|^phpfpm$|^ping$|^postgresql$|^processes$|^procstat$|^rabbitmq_node$|^redis$|^riak$|^varnish$|^win_cpu$|^win_mem$|^win_net$|^win_system$|^win_websvc$/

It looks like upgrading telegraf solves the issue :|
and chronograf does not display the host anymore.
root@ws-test-ito-mon-001:~# telegraf version
Telegraf v1.5.3 (git: release-1.5 1e519698)
root@ws-test-ito-mon-001:~# apt-get install --only-upgrade telegraf
root@ws-test-ito-mon-001:~# telegraf version
Telegraf v1.7.0 (git: release-1.7 f4d22dd4)

Full screencast with version  v1.5 then  v1.7:
https://gist.github.com/carlessanagustin/1e185b2b497966c9fd4f55e90b43ea62


possible bad dependency - rest-assured-common 3.1.1 ?

rest-assured:jar:4.0.0 has transitive dependency on rest-assured-common:jar:3.1.1 which is odd ?
[INFO] +- io.rest-assured:rest-assured:jar:4.0.0:test
[INFO] |  - io.rest-assured:json-path:jar:3.1.1:test
[INFO] |     - io.rest-assured:rest-assured-common:jar:3.1.1:test

Hi is it crashing for you?
I have a similar problem but with: "io.rest-assured:spring-mock-mvc:4.0.0"
It depends on the old 3.1.1 versions of json-path, xml-path and rest-assured-common which makes it get ClassNotFound errors at runtime, only way I found to fix it is by adding all dependencies correct versions:
testImplementation("io.rest-assured:rest-assured:4.0.0") testImplementation("io.rest-assured:spring-mock-mvc:4.0.0") testImplementation("io.rest-assured:rest-assured-common:4.0.0") testImplementation("io.rest-assured:json-path:4.0.0") testImplementation("io.rest-assured:xml-path:4.0.0")

My specific problem was the same as in: https://github.com/rest-assured/rest-assured/issues/1168
Seems to be Spring boot specific problem which is fixed by adding:
ext["rest-assured.version"] = "4.0.0"
then I can just use:
testImplementation("io.rest-assured:spring-mock-mvc:4.0.0")
And everything works


Container literal initialization

When initializing dict and list literals, we should probably at least warn when there is a duplicate entry in the initializer.  Right now, they just get squashed.

In some testing, no real language seems to bother w/ this one, so won't fix.


Crash in the right place if the ClusterNetwork record can't be read

This reverts #247 as it turns out that it wasn't actually "IP" that was nil there, it was registry.serviceNetwork.
This new version requires origin changes too, because when creating the plugin, we now need to know whether we're the master or a node.
Not tested yet, so don't merge it. Waiting to hear from Jeremy on https://bugzilla.redhat.com/show_bug.cgi?id=1298942

LGTM


[TwigComponent] Configuration with PHP ConfigBuilders fails

I use configuration with PHP ConfigBuilders and tried to add configuration for symfony/ux. That failed, TwigComponentConfig could not be loaded.
So I was digging around (not knowing anything about it), comparing how others do it and finally found a working solution:
I created
ux/src/TwigComponent/src/DependencyInjection/Configuration.php
with content like this
class Configuration implements ConfigurationInterface
{
}

and then moved the getConfigTreeBuilder() method from
ux/src/TwigComponent/src/DependencyInjection/TwigComponentExtension.php
into that class.
I don’t know if this the correct way, if that would break anything else, but at least now TwigComponentConfig gets built and configuration works.

Normally, the TwigComponentConfig class is generated in your var/cache/dev/Symfony/Config directory... is that not the case ?

@smnandre It is. But clearing the cache crashes.
Just to be safe that not something else in my app is wrong, I just set up a clean v6.3 skeleton+webapp project and added ux-twig-component.
Then I replaced twig_component.yaml with twig_component.php
<?php

use Symfony\Config\TwigComponentConfig;

return static function (TwigComponentConfig $cnf): void {
};

Then I ran php bin/console cache:clear and ended up with:

[critical] Uncaught Error: Symfony\Component\Config\Builder\ConfigBuilderGenerator::build(): Argument #1 ($configuration) must be of type Symfony\Component\Config\Definition\ConfigurationInterface, null given, called in /foo/bar/vendor/symfony/dependency-injection/Loader/PhpFileLoader.php on line 195

Ok i see the problem and reproduced, thanks for the details :)
I'd like to have @weaverryan and @kbond inputs..  because we could either add a Configuration class as you suggested, or keep a single Extension class and move things a bit to implement ConfigurableExtension, but i'm not sure what is the best way forward ?
(i personnaly like the separated Configuration classes)

In the Extension, we just have to add this method and everything seems to work
// src/DependencyInjection/TwigComponentExtension.php

final class TwigComponentExtension extends Extension implements ConfigurationInterface
{

// ...

public function getConfiguration(array $config, ContainerBuilder $container): ConfigurationInterface
    {
        return $this;
    }

Can you confirm it works for you @rarila ?

@smnandre   Works! 👍
Looks like I’m the only one using ConfigBuilders 😄


(At least) Non-interactive commands should write errors to STDERR

Right now commands like migrate write errors to STDOUT. This is wrong. Errors, especially from commands that are commonly used non-interactively, need to be written to STDERR so that scripts executing Phinx can easily distinguish between information (STDOUT) and errors (STDERR), possibly redirecting either of them to different locations.
Here's how:
https://symfony.com/doc/current/console/style.html#writing-to-the-error-output

+1 to this. We are using AWS CodeDeploy and have phinx migrations running via a bash script. Because the errors aren't going to stderr the script just happily continues on its way when phinx errors out without triggering any of our error handlers.

Maybe someone wants to make a PR. I am sure it can be fast tracked.

I would if I had the slightest clue how any of this works. We don't use Symfony otherwise, so it's a bit of a learning curve to figure out where to even make this happen...
would it be in the various commands at this point (using Migrate as an example):
https://github.com/cakephp/phinx/blob/31d837c17d6dc294d44f0b17331066548ac8c032/src/Phinx/Console/Command/Migrate.php#L96 where instead of writeln one would use the SymfonyStyle error style per the link in the issue description?

I'll try to work on this within the next two days. Originally I thought it was so easy and straightforward that I only created the issue with pointers at the solution path, but then lost track of it.
Basically it's merely adding this at the beginning of all command execute methods and then replacing $ouput by $errorStyle whereever output shall be written to STDERR (if available):
$io = new SymfonyStyle($input, $ouput);
$errorStyle = $io->getErrorStyle();

(of course SymfonyStyle needs to be imported).


how to run neo-cli as long live backend server?

Running neo-cli as repl and listening http RPC is great. Could it be run as backend server even though I close ssh session?
I want build a RPC server for ourself client program.

Duplicate of #48

screen -S neo ./neo-cli --rpc


🐛 [firestore-translate-text] can not translate array field

What feature would you like to see?
There has a problem that the extention[firestore-translate-text] can not translate an array object like under "second":
input field:
    {
        first: "who are you?",
        second: [
            {
                title: "about us",
                summary: "We are top 100 web developer.",
            },
            {
                title: "contact us",
                summary: "You can contact us from email.",
            },
        ],
    }

+1 !!


Support multiples URLs in one cell

To Reproduce
Steps to reproduce the behavior:

Edit a cell and add 2 or more URLs separated by space, comma, newline…For example:https://www.openstreetmap.orghttps://commons.wikimedia.org
Click on one link

Current Results
Open a new tab in the web browser and display an error.
The link is the concatenation of the 2 URLs : https://www.openstreetmap.orghttps//commons.wikimedia.org
Expected Behavior
Open a new tab and display one of the 2 web pages:

https://www.openstreetmap.org
https://commons.wikimedia.org

Versions

OpenRefine: Version 3.4.1 [437dc4d]

Additional context
Seem that this bug or feature is in the javascript code that add a link for all the cell.

https://github.com/OpenRefine/OpenRefine/blob/9f7d5b878628c40d68a445b751fd50140d922e7d/main/webapp/modules/core/scripts/util/url.js#L92
https://github.com/OpenRefine/OpenRefine/blob/6095c44cb714f7b1ea6a1eac961b0394ac138a8b/main/webapp/modules/core/scripts/views/data-table/cell-ui.js#L99
https://github.com/OpenRefine/OpenRefine/blob/9f7d5b878628c40d68a445b751fd50140d922e7d/main/webapp/modules/core/scripts/index/parser-interfaces/preview-table.js#L100
https://github.com/OpenRefine/OpenRefine/blob/6095c44cb714f7b1ea6a1eac961b0394ac138a8b/main/webapp/modules/core/scripts/index/parser-interfaces/fixed-width-parser-ui.js#L338

@pyrog Can you fix the version info you reported? I think you meant 3.4.1

Per the discussion here https://github.com/OpenRefine/OpenRefine/pull/2540#pullrequestreview-391997062 our intent is to switch to just using Javascript's built-in URL() constructor which would presumably fail on this text and not link the cell.

OK, I misread the need as described by @pyrog and I don't think I agree with their need.
Instead, I think the need to have clickable links is still attainable by storing URLs in Record rows, where 1 URL per cell is encountered.
But @pyrog wants to just hand edit cells?  That's not really what OpenRefine is designed for.  I don't think that kind of suggested handling is needed at all.  If there is a cell that has multiple values of URLs, then it can be easily split into Record rows by using GREL smartSplit() or the menu option Edit Cells -> Split multi-value cells.
So, I would suggest closing this.

As a convenience, OpenRefine links cells who's contents consist of a well-formed URL. It shouldn't link cells where the text is not a well formed URL (e.g. multiple URLs concatenated together). If we fix the looksLikeUrl function, this problem will go away.

@tfmorris Are you suggesting that there is a better way and that a "clickable" URL link could be exposed on the Javascript side?  This would work even with URLs that are within very long strings or sentence paragraphs in a cell?  If you think that is possible, then that sounds like agreeable.  I just didn't think it was possible, but I guess anything can be made "clickable" in Javascript if you parse it correctly and dynamically create hrefs?

No, I'm not proposing that we parse megabytes of XML looking for dozens of URLs to highlight. I'm proposing that only cells who's entire content consists of a single well-formed URL get linked. That would address this case of a malformed link being created (ie the cell would not be linked).

But @pyrog wants to just hand edit cells? That's not really what OpenRefine is designed for. I don't think that kind of suggested handling is needed at all.

Of course not. It was an example to reproduce the bug 😉
I work on a file of 55113 contacts.

If there is a cell that has multiple values of URLs, then it can be easily split into Record rows by using GREL smartSplit() or the menu option Edit Cells -> Split multi-value cells. And then they would get nice single URLs in each cell and would be clickable within OpenRefine.

Yes.
The issue is if OpenRefine build a link, it must be valid 😃
To solve this issue, I see two solutions:

check  if the URL contain all the cell, or just a part in URL.looksLikeUrl()
add the … tags inside the looksLikeUrl() so it will work for one or more URLs inside a cell.In this case you just have to parse 50 X Columns, not "megabytes of " data.

@wetneb @thadguidry @tfmorris  after the PR #2519  ,i guess this issue must have been automatically resolved?

i guess after the PR for the issue #2519 this issue must have automatically been resolved?

Thank you, indeed!


Font icons support for arrows

It would be nice to be able to set the images with icon fonts instead of having to use images. Would this be a hard thing to implement?
Thanks.

Currently I don't have time to maintain new feature requests, I only implement fixes to the core logic. It would not be a hard thing to implement however. I think branching off would be your easiest bet.


Release/0.6.0

Description

Release Navigator module and Login page plus security fixes
Checklist:

[x] I am familiar with the Contributing Guidelines.
[x] I agree with the terms of the Contributor Agreement.
[x] The changes introduced by this pull request are covered by existing or newly introduced tests.
[x] The package documentation and framework documentation in signac-docs are up to date with these changes.
[x] I have updated the changelog and added any related issue and pull request numbers for future reference.

The run of the Publish to TestPyPI check after the pre-commit bot failed, but I think the publication worked because the URL is live: https://test.pypi.org/project/signac-dashboard/0.6.0/

It looks like it uploaded right, but it may still be worth looking the failure report. Is that action failing something that typically happens on release?

I should have pasted the error, but yes it was that the file was uploaded already:
WARNING  Error during upload. Retry with the --verbose option for more details.
ERROR    HTTPError: 400 Bad Request from https://test.pypi.org/legacy/
         File already exists. See https://test.pypi.org/help/#file-name-reuse
         for more information.

It looks like it uploaded right, but it may still be worth looking the failure report. Is that action failing something that typically happens on release?

I should have pasted the error, but yes it was that the file was uploaded already:
WARNING  Error during upload. Retry with the --verbose option for more details.
ERROR    HTTPError: 400 Bad Request from https://test.pypi.org/legacy/
         File already exists. See https://test.pypi.org/help/#file-name-reuse
         for more information.

I recall something like this happening on an earlier release where there were extra steps (and one time where I made the version tag wrong) but I think any Slack chat history about it is deleted bc it's been more than 90 days.

I use the skip_existing option to silence this type of error:
https://github.com/glotzerlab/gsd/blob/de226fed1862ae2a3a76ac9ef06ce6df4eb970f5/.github/workflows/build_wheels.yml#L99C2-L107
The alternative is to add a suffix to the generated wheel so that each upload succeeds. However, you may then accumulate MANY wheels in the testpypi project.

Historically this has always failed if multiple commits are pushed to a release branch — and “skip existing” sounds like the right way to fix this problem. I wasn’t aware of that option when I set up the deployment workflow but would support adding that flag.


Error message.

I got this error message when I try to use your gem. Is it because my ruby version is too old (1.9.1)? gem install worked fine.
$ruby random_reddit_oath.rb
WARN: Unresolved specs during Gem::Specification.reset:
domain_name (~> 0.5)
netrc (~> 0.7)
WARN: Clearing out unresolved specs.
Please report a bug if this causes problems.
/opt/chef/embedded/lib/ruby/site_ruby/1.9.1/rubygems/core_ext/kernel_require.rb:69:in require': /opt/chef/embedded/lib/ruby/gems/1.9.1/gems/reddit-api-0.1.2/lib/reddit/internal/connection.rb:25: syntax error, unexpected tLABEL (SyntaxError) ..._agent_title, request_throttle: nil, max_retries: nil) ...                               ^ /opt/chef/embedded/lib/ruby/gems/1.9.1/gems/reddit-api-0.1.2/lib/reddit/internal/connection.rb:25: Can't assign to nil ...t_title, request_throttle: nil, max_retries: nil) ...                               ^ /opt/chef/embedded/lib/ruby/gems/1.9.1/gems/reddit-api-0.1.2/lib/reddit/internal/connection.rb:143: syntax error, unexpected keyword_end, expecting $end         from /opt/chef/embedded/lib/ruby/site_ruby/1.9.1/rubygems/core_ext/kernel_require.rb:69:in require'
from /opt/chef/embedded/lib/ruby/gems/1.9.1/gems/reddit-api-0.1.2/lib/reddit/api.rb:11:in <top (required)>'         from /opt/chef/embedded/lib/ruby/site_ruby/1.9.1/rubygems/core_ext/kernel_require.rb:128:in require'
from /opt/chef/embedded/lib/ruby/site_ruby/1.9.1/rubygems/core_ext/kernel_require.rb:128:in rescue in require'         from /opt/chef/embedded/lib/ruby/site_ruby/1.9.1/rubygems/core_ext/kernel_require.rb:39:in require'
from random_reddit_oath.rb:1:in `'

Hello,
tl;dr: Ruby version 2.0+ is required.
Im surprised the gem install worked! I just tried to reproduce it really quick and its failing to resolve dependencies for me (fails to find rest-client > 1.0).
Even if I did get around those though the api has been programed using design patterns only available to ruby in version 2.0+.
The exception shown we have:
"connection.rb:25: syntax error, unexpected tLABEL (SyntaxError)"
The code on line 25:
def initialize(username, password, client_id, secret, user_agent_title, request_throttle: nil, max_retries: nil)
It is using defaults for named parameters, which was not a feature in 1.9.*.
http://stackoverflow.com/questions/16322706/optional-arguments-with-default-value-in-ruby
So the short answer is ruby version 1.9 is not supported, It is a quite old version of ruby released about 7 years ago. If there is a specific use case or demand I can take a look at it.
The simplest option though would be moving to a newer version!

Thanks! I tried two other reddit wrappers, but they refused to install. ;-)


Version info

I have installed npm -g install<EMAIL_ADDRESS>But mjml -V display 2.0.0
Is it OK?

Ah yes, mjml -V show version of mjml-core (https://github.com/mjmlio/mjml/blob/master/packages/mjml-core/src/index.js#L10) not just mjml, we fix that on next release.

Is it fixed with todays release?
npm install -g mjml and mjml --version display 2.0.2 for me.

We still have some surprising behaviour due to the fact that there are different packages (mjml, mjml-core and mjml-cli). We'll keep the discussion here: https://github.com/mjmlio/mjml/issues/371
Sorry for the issue!


Soccer msgs containing covariance

Hey!
With this issue, I want to start a discussion about some sort of msgs containing a covariance of an object.
How do we implement this?

Do we extend the existing 3D msgs? Semantically not great...
Do we create a new package? Something like soccer_world_model_msgs?
Covariance (and other world model information) is relevant for which objects? Can we abstract this?
Which additional information is also relevant?

What are your thoughts? @ijnek @Flova @SammyRamone

Thanks for bringing this up! I had some thoughts about this before, but failed to decide on something due to the reasons you've raised.
Before we discuss the options, I think we should be on the same page about whch covariane we're talking about. Is the covariance you're talking about measurement errors (ie. mixture of imu error, tf error, etc.), or are they covariance of objects after being filtered through a filter (ie. kalman filter or an approximation of particle spread from a particle filter)?

I was originally thinking about the covariance of objects after being filtered through a filter, as I was working on a Kalman filter.
Presumably, both variants are important, but I'm no expert and don't know how/why to separate these.

This is how I currently imagine the flow of msgs.

covariance of object after being filtered through a filter, corresponds to the soccer_model_msgs, which isn't a package written up yet.
The reason why soccer_vision_3d_msgs and soccer_model_msgs is separated, is because the model can contain more information than what was detected from vision. For example, if you're using a kalman filter, you could get a velocity estimate of the ball.
I have a draft PR in my fork where I was writing up an example soccer_model_msgs package. There, I have
soccer_model_msgs/msg/Ball.msg:
std_msgs/Header header
geometry_msgs/PoseWithCovariance pose
geometry_msgs/TwistWithCovariance twist

# The assumed radius of the ball (in mm)
float32 radius

which stores the pose and twist (velocity) of the ball with covariance, does this seem to fit your needs?

After a small peek into your fork, it looks promising. Where would we include a covariance to quantify measurement errors?

E.g. uncertain vision measurements should lead to a less accurate world state which is represented by the covariance matrix

Adding to this, the "uncertain vision measurements" aren't related to the "confidence" of the vision detections, they are positional uncertainty (covariance) that come mainly from IMU/ipm errors. I remember I was confused about the two when I was working on localization.

Where would we include a covariance to quantify measurement errors?

I'm feeling that the best option would be to change soccer_vision_3d_msgs/msg/Ball.msg to:
# Describes a detected ball from vision modules, in 3d coordinates.

# Center point of the ball (in meters)
- geometry_msgs/Point center
+ soccer_vision_attribute_msgs/PointWithCovariance center

# Confidence that the detected object is a ball
soccer_vision_attribute_msgs/Confidence confidence

where soccer_vision_attribute_msgs/msg/PointWithCovariance:
# This represents a point in free space with uncertainty.
geometry_msgs/Point point

# Row-major representation of the 3x3 covariance matrix
# The orientation parameters use a fixed-axis representation.
# In order, the parameters are:
# (x, y, z)
float64[9] covariance

and ensure the covariance is estimated and not left empty.
I can proceed with a PR if we agree.

I've raised a Draft PR for soccer_model_msgs: https://github.com/ros-sports/soccer_interfaces/pull/43

@jaagut
Assuming you're working on localization or ball tracking currently, I'd be interested in discussing what topics you planning on subscribing and publishing to. I think having the topics not bit-bots specific, would help other teams replace the localization component easily with their own node if they want. What's your plans?

I was working with others on the ball filter.
The ball filter uses a Kalman filter and then publishes one filtered ball using a humanoid_league_msgs/PoseWithCertaintyStamped and a velocity using a geometry_msgs/TwistWithCovarianceStamped.
The humanoid_league_msgs/PoseWithCertaintyStamped msg will be replaced, once #43 gets merged. We will then use the soccer_model_msgs/Ball msg.

Got it, that seems like something easily replacable by other teams. Sounds good to me.

Resolved by #43


App Service Mount storage documentation lacks guidance for the Docker-Compose Container Type

App service documentation doesn't describe the process of mounting storage using the Path mappings and the Docker-Compose container type that is currently in preview.
I found this tutorial on the Azure youtube channel which helped a bit, I also had to check this page from the Azure docs to realise that the app service tier required to actually connect to VNets is Standard, Premium, Premium v2, Premium v3, or Elastic Premium App Service pricing tier as the youtube video described this as required. Finally, I found this page in the azure documentation that suggests that ${WEBAPP_STORAGE_HOME} should work fine but also that VNET integration is not supported for Docker Compose scenarios under Preview Limitations; this is relevant as again the Youtube video suggested that VNET integration is required to reach storage.
On the same page of this documentation, the Azure CLI command duplicates its recommendation for checking your storage config by running:
az webapp config storage-account list --resource-group <resource-group> --name <app-name>
Finally the quick check that is recommended for checking that your storage has successfully mounted is to use the SSH development window and run df. The portal SSH does not work with the following error for Docker-Compose containers: SSH CONNECTION CLOSE - Error: connect ECONNREFUSED x.x.x.5:2222. I next tried az webapp ssh -n $name -g $resourcegroup and got a different error:
This command is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus
Verifying if app is running....
SSH is not enabled for this app. To enable SSH follow this instructions: https://go.microsoft.com/fwlink/?linkid=2132395

I believe this is because I am not serving SSH on this 2222/tcp that was suggested above. I then added the following to my docker compose to attempt to serve SSH:
services:
  sshservice:
    image: linuxserver/openssh-server:latest
    ports:
      - "2222:2222"
    volumes:
      - ${WEBAPP_STORAGE_HOME}/configs:/configs:ro
...

I attempted following this page but haven't had any luck stopping when I realised I was going in the wrong direction as I'm trying to mount azure storage volumes.

Document details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 3cd70fac-5d7c-7637-8385-f3f4af3ba0ad
Version Independent ID: 15d95fc5-f08e-a26c-ce06-8ead78474661
Content: Mount Azure Storage as a local share (container) - Azure App Service
Content Source: articles/app-service/configure-connect-to-azure-storage.md
Service: app-service
GitHub Login: @msangapu-msft
Microsoft Alias: msangapu

@yeroc-sebrof Thanks for the feedback! I have assigned the issue to the content author to investigate further and update the document as appropriate.

Just thought I'd give this thread an update; this is no longer an issue that effects my usage of Azure as I've moved to AKS to get the required access to Azure Storage in a multi-container environment. However, I still believe that this Docker-Compose preview for Azure Apps could have let me avoid that additional Ops responsibility in applications thats comprised of 2-3 linux containers.
Looking back on my original Issue I actually raised multiple issues that I believe should not have been dumped all at once. The main blocker that I experienced was access to the mounting storage using the Path mappings and the Docker-Compose container type. My expectations were that my application could take media from a user and maintain state of this content using an Azure Storage Account. Documentation or potentially the preview feature itself needs improvement when clarifying if or how a user can mount Blob storage, File Shares and Azure tables to Application without leaving the Azure network as I wanted to ensure low latency. Even if documentation has to simply expand to say that I just needed to pay more to do this I would appreciate this case be presented.
The second problem I presented was my inability to use the az webapp ssh which I understand as the specialised container that typically deploys alongside a single container application is not being used. Perhaps there is a warning that could be added to the Docs/Az CLI or perhaps a guide could be made that shows what containers are actually used to deploy these apps that would have allowed me to ensure that at least one of the containers would be access?

Hi @yeroc-sebrof Thanks for the feedback.
@btardif any thoughts here?

Updated docs to reflect this scenario is unsupported.
#please-close


Improved hsm view

This does two things:

It loads the slk module rather then using a fixed and outdated path to the slk binary
It creates an (empty) xarray dataset only form the tags found in netcdf and netcdf_header metadata. Then at least some rudimentary overview of the meta-data can be displayed.

The output of a dataset that hasn't been tagged with the special string that is a json representation of the whole data set would look like this:
<Dataset>
Dimensions:  ()
Data variables:
    *empty*
Attributes: (12/50)
    Var_Long_Name:         time,Longitude,Latitude,pressure,Eastward Wind
    License:               CMIP6 model data produced by CSIRO is licensed und...
    Title:                 ACCESS-CM2 output prepared for CMIP6
    Var_Name:              time,time_bnds,lon,lon_bnds,lat,lat_bnds,plev,plev...
    Pid:                   hdl:21.14100/215c74d3-0509-4aca-8338-958b6c502eab
    Experiment_Id:         amip
    ...                    ...
    Parent_Experiment_Id:  no parent
    Activity_Id:           CMIP
    Frequency:             mon
    Sub_Experiment:        none
    Further_Info_Url:      https://furtherinfo.es-doc.org/CMIP6.CSIRO-ARCCSS....
    Variant_Label:         r1i1p1f1

I think I can't do really much more at the moment because essential information, like the dimensionality of the variables, are missing.

I've slightly updated the displayed information by overriding the string representation for empty datasets. The cli output looks like this:
<Dataset (byte-size: unkown)>
Dimensions:  ()
Data variables:
    *not enough information for display*
Attributes:
    Var_Long_Name:         time,Longitude,Latitude,pressure,Eastward Wind
    License:               CMIP6 model data produced by CSIRO is licensed und...
    Title:                 ACCESS-CM2 output prepared for CMIP6
    Var_Name:              time,time_bnds,lon,lon_bnds,lat,lat_bnds,plev,plev...
    Pid:                   hdl:21.14100/215c74d3-0509-4aca-8338-958b6c502eab
    Experiment_Id:         amip
    Institution:           CSIRO (Commonwealth Scientific and Industrial Rese...
    Time_Min:<PHONE_NUMBER>00
    Source:                ACCESS-CM2 (2019):aerosol: UKCA-GLOMAP-modeatmos: ...
    Project:               CMIP6
    Institution_Id:        CSIRO-ARCCSS
    Var_Std_Name:          time,longitude,latitude,air_pressure,eastward_wind
    Creation_Date:         2019-11-08T09:29:03Z
    External_Description:  https://furtherinfo.es-doc.org/CMIP6.CSIRO-ARCCS
    Realm:                 atmos
    Time_Max:<PHONE_NUMBER>00
    Physics_Index:         1
    Tracking_Id:           hdl:21.14100/215c74d3-0509-4aca-8338-958b6c502eab
    Nominal_Resolution:    250 km
    Grid:                  native atmosphere N96 grid (144x192 latxlon)
    Product:               model-output
    Source_Id:             ACCESS-CM2
    Parent_Time_Units:     no parent
    Data_Specs_Version:    01.00.30
    Initialization_Index:  1
    Lon_Max:               180.0
    Parent_Variant_Label:  no parent
    Parent_Source_Id:      no parent
    Source_Type:           AGCM
    Table_Id:              Amon
    Level_Max:<PHONE_NUMBER>0001001
    Parent_Activity_Id:    no parent
    Forcing_Index:         1
    Parent_Mip_Era:        no parent
    Lat_Min:               0.0
    Sub_Experiment_Id:     none
    Grid_Label:            gn
    Lon_Min:               101.25
    Experiment:            AMIP
    Level_Min:<PHONE_NUMBER>1000001
    Lat_Max:               50.0
    Mip_Era:               CMIP6
    Variable_Id:           ua
    Realization_Index:     1
    Parent_Experiment_Id:  no parent
    Activity_Id:           CMIP
    Frequency:             mon
    Sub_Experiment:        none
    Further_Info_Url:      https://furtherinfo.es-doc.org/CMIP6.CSIRO-ARCCSS
    Variant_Label:         r1i1p1f1

But the HTML representation is not changed.

The unkown byte-size botheres me, @Karinon how can I retrieve the file size from the metadata?

You can either call slk_helpers size <path> which returns the size in bytes and nothing more, or you can call the resources-API-Endpoint which has a size-field in the output.  Don't use slk list for that as the output is truncated and you have to do much more parsing

Output looks nice!
Just out of curiosity, what is your policy regarding the SLK authentication? Do you intend to refresh your token manually all 30 days or is there something more sophisticated in the background?

You can either call slk_helpers size <path> which returns the size in bytes and nothing more, or you can call the resources-API-Endpoint which has a size-field in the output. Don't use slk list for that as the output is truncated and you have to do much more parsing

Great, thanks for clarification

Output looks nice! Just out of curiosity, what is your policy regarding SLK authentication? Do you intend to refresh your token manually all 30 days or is there something more sophisticated in the background?

Indeed, there is something going on in the background. The code evaluates an environment variable, that can be passed by paramiko and holds a base64 encoded version of the user's password. If this variable is set then it will log on to the system by itself. The trick is that the freva web automatically base encodes the password and sets it as the magic paramiko env variable on ssh connections.

lgtm


SHOW LOCALITY statement

New SHOW LOCALITY page
New SHOW LOCALITY entry in SQL Statements Overview
New SHOW LOCALITY diagram

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/0093be17bd0636e740656d59166c46f38b369e6c/
Edited pages:

v19.2/show-locality.md
v19.2/sql-statements.md

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/5c47cc42b801e0cec31bc890dd0626ef87a192ca/
Edited pages:

v19.2/show-locality.md
v19.2/sql-statements.md

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/edb6e6886ba18c63aa05259aab5075faa77924e6/
Edited pages:

v19.2/show-locality.md
v19.2/sql-statements.md


[grpc/protobuf] Update grpc to 1.65.5 and update protobuf to 5.26.1

Fixes
https://github.com/microsoft/vcpkg/issues/37440
https://github.com/microsoft/vcpkg/issues/29697
https://github.com/microsoft/vcpkg/issues/38316
https://github.com/microsoft/vcpkg/issues/37729
https://github.com/microsoft/vcpkg/issues/30583
https://github.com/microsoft/vcpkg/issues/40803
Upstream issues:
https://github.com/Ultimaker/libArcus/issues/156
https://github.com/apache/brpc/issues/2757
https://github.com/sogou/srpc/issues/406
Update to latest protobuf isn't possible because gRPC latest does not support it and it is difficult to patch (unstable upb API being the primary reason).
Some ports had to be patched to support protobuf v5.
upb now has (hopefully) proper stage0 build to generate descriptor.upb.h/c files. Seeing that the supposedly tested-for-staleness files here: https://github.com/protocolbuffers/protobuf/tree/v25.1/upb/cmake/google/protobuf are actually stale.

[x] Changes comply with the maintainer guide.
[x] SHA512s are updated for each updated download.
[x] The "supports" clause reflects platforms that may be fixed by this new version.
[x] Any fixed CI baseline entries are removed from that file.
[x] Any patches that are no longer applied are deleted from the port's directory.
[x] The version database is fixed by rerunning ./vcpkg x-add-version --all and committing the result.
[x] Only one version is added to each modified port's versions file.

@MonicaLiu0311 ready for review.

grpc & protobuf & upb
All features are tested successfully in the following triplet:
x86-windows
x64-windows
x64-windows-static

openvino
Features onnx,paddle are tested successfully in the following triplet:
x64-windows
x64-windows-static

@Tradias Please resolve the conflict.

@JavierMatosD Thank you for looking into this pr (again). The story is very similar to the previous one https://github.com/microsoft/vcpkg/pull/35781. We are trying to force a protobuf version onto libraries that don't support it (yet) or are unmaintained. I haven't created any reports upstream and honestly don't feel like doing it, so feel free to do so.
protobuf, utf8-range and upb all come from the same repository. I think it would be best to avoid updating one without the others. That also means that we cannot update to latest protobuf (which is support by gRPC) because the latest upb is not.

Thank you for your work on upgrading gRPC!
Is there anything the community can do to help this PR move forward?

Upstream "support protobuf v5" issues:
https://github.com/Ultimaker/libArcus/issues/156
https://github.com/apache/brpc/issues/2757
https://github.com/sogou/srpc/issues/406

When will this change be accepted? I need uds in windws (grpc>=1.63)

I have started to experiment with this branch to prepare my project for this upgrade.
It seems that I have hit a known problem with protobuf.
P:\dev\keys-native\build\vcpkg_installed\x64-windows-static-md\include\google\protobuf\map_field.h(682,66): error C2370
: 'google::protobuf::internal::MapField<Derived,Key,T,kKeyFieldType_,kValueFieldType_>::kVTable': redefinition; differe
nt storage class [P:\dev\keys-native\build\protobuf\keys-protobuf.vcxproj]
P:\dev\keys-native\build\vcpkg_installed\x64-windows-static-md\include\google\protobuf\map_field.h(682,66): error C2370
: 'google::protobuf::internal::MapField<Derived,Key,T,kKeyFieldType_,kValueFieldType_>::kVTable': redefinition; differe
nt storage class [P:\dev\keys-native\build\protobuf\keys-protobuf.vcxproj]
  (compiling source file 'src/main/proto/keys.pb.cc')
      P:\dev\keys-native\build\vcpkg_installed\x64-windows-static-md\include\google\protobuf\map_field.h(671,37):
      see declaration of 'google::protobuf::internal::MapField<Derived,Key,T,kKeyFieldType_,kValueFieldType_>::kVTable'

  (compiling source file 'src/main/proto/keys.grpc.pb.cc')
      P:\dev\keys-native\build\vcpkg_installed\x64-windows-static-md\include\google\protobuf\map_field.h(671,37):
      see declaration of 'google::protobuf::internal::MapField<Derived,Key,T,kKeyFieldType_,kValueFieldType_>::kVTable'

This seems the same symptom as https://github.com/microsoft/vcpkg/issues/39459

@pedrolamarao You describe an issue that exists in the protobuf version on master. In the linked vcpkg issue you will find the protobuf commit that fixed it and if you check it out you can see that the fix made it into the protobuf version that this pull request introduces https://github.com/protocolbuffers/protobuf/commit/f78f9c51fa2470070e5d4b49649800971c789224. I also just compiled a small program with vcpkg master branch (failed as expected) and then with this branch, succeeded.
In other words, it looks like you did something wrong when trying to test this branch and instead used current master branch. Possible causes:

Forgot to remove builtin-baseline from your vcpkg.json file
VCPKG_ROOT env value is pointing at a different clone of vcpkg instead of the one where you checked out this branch

@Tradias thanks, that sounds likely, sorry for the noise.

What needs to be done to move this forward? @JavierMatosD are you able to do a second pass?

@BillyONeal Please take a look at this PR.

hey, buddies when will it be merge?

@BillyONeal, @vicroms, @data-queue discussed this today.
@BillyONeal - "protobuf and upb are owned by the same people, we should be picking versions that are intrinsically compatible with each other. If that means we can't update grpc, so be it. We are not upb, grpc, or protobuf maintainers and we are not qualified to review that. We have to pick some form of versioning/packaging story that preserves that and if it means we can't update that then we can't update that. We would need to file issues with upstream and get them to implement the fix."
@ras0219-msft - "It is a reimplementation of protobuf that is small, so it has independent implementation from protobuf but it is c, small, and unstable. It sounds like upb is not suitable for consumption. We should declare that upb only exists as a dependency of grpc and treated as such. Maybe the path forward is protobuf and upb become decoupled and upb and grpc become coupled."
@BillyONeal - "Maybe upb should be delisted"
@ras0219-msft - "Why was upb added in the first place?"
https://github.com/microsoft/vcpkg/issues/8460#issue-502997609 -> implies it is needed for grpc
@ras0219-msft - "grpc has their own vendor copies of all these dependencies. So presumably, they have a set of dependencies that works for them. We could just say that grpc owns this whole ecosystem and we use whatever versions grpc needs."
@BillyONeal  - "That seems to be the thing that people want."
@BillyONeal - "We should delist upb. https://github.com/protocolbuffers/protobuf/tree/main/upb ->  "For this reason, upb is not generally offered as a C library for direct consumption, and there are no releases."
Actions:

Delist upb and instruct grpc to use its vendored copy
Use the actual change that srpc accepted or even better update srpc instead of patching.

Questions:

Is there a newer version of grpc that still uses the 4.x series of protobuf? See, https://protobuf.dev/support/version-support/. If so, we could do an update to that while we wait for other ports to catch up.

Since upstream has been notified approx 3 ago, we will give them another 3 weeks to respond before we start delisting ports.

@JavierMatosD Great conversation. This matches my knowledge of grpc, protobuf, upb ecosystem exactly. I would throw utf8-range into the mix too but I think it is OK to keep it as is for now. I have been advocating for removing upb for a while now. Seeing that I have been doing the latest gRPC updates, I know how painful it is to patch CMake support into upb and patch gRPC to use it; two things that upstream never intended for.
GRPC v1.62.3 seems to be the last version to use protobuf 4.x: Look at the commit message on protobuf submodule between https://github.com/grpc/grpc/tree/v1.62.3/third_party with https://github.com/grpc/grpc/tree/v1.63.2/third_party

Hi, it is great job, but the question is: when could it be merged? @JavierMatosD are all your requested changes already done?

@Tradias, please mark this PR "ready for review" when you want me to review this again.

@JavierMatosD what is the verdict regarding upb now? Are we merging this pr first and then delist it?

Perhaps mark the PR as ready for review, otherwise it may not get the attention.

@Tradias, sorry for the late response. I believe the action items requested by the team last we spoke were:

Delist upb and instruct grpc to use its vendored copy
Use the accepted change in srpc or update it to include the desired changes.

We also agreed to give upstream 3 weeks to respond before we begin delisting ports. I believe it's been 3 weeks since libarcus, brpc, and srpc were notified.

GRPC now uses built-in upb, tested successfully on x64-windows-static. Note that some patching is still needed to make it use the vcpkg utf8-range port.
SRPC now uses official patch, build successfully on x64-windows-static.
BRPC is also working on protobuf v5 support but I am waiting for it to be merged: https://github.com/apache/brpc/pull/2782

Doesn't build for me on Microsoft (R) C/C++ Optimizing Compiler Version 19.38.33141 for x64
C:\develop\vcpkg\buildtrees\grpc\src\v1.65.5-3afb8dd835.clean\third_party\upb\upb\message\internal\message.c(22): error C2099: initializer is not a constant

GRPC now uses built-in upb, tested successfully on x64-windows-static. Note that some patching is still needed to make it use the vcpkg utf8-range port.
SRPC now uses official patch, build successfully on x64-windows-static.
BRPC is also working on protobuf v5 support but I am waiting for it to be merged: apache/brpc#2782

It looks like https://github.com/apache/brpc/pull/2782 was merged. I'm assuming the brpc port should be updated to reflect?

There is another issue that I'm seeing after updating, I didn't have it with previous snapshot (1.65.4?)
debug check failure at:
vcpkg\buildtrees\grpc\src\v1.65.5-5d18b9dc1c.clean\src\core\lib\event_engine\windows\grpc_polled_fd_windows.cc:227
CHECK(*from_len <= recv_from_source_addr_len_); // 128 <= 16
in 1.65.5 from_len is coming from
vcpkg\buildtrees\c-ares\src\v1.34.1-8a13123db5.clean\src\lib\ares_conn.c:53
where it's defined as
struct sockaddr_storage sa_storage;
ares_socklen_t          salen = sizeof(sa_storage); // 128

while in 1.65.4 it's coming from
vcpkg\buildtrees\c-ares\src\v1.33.0-7b5315fac5.clean\src\lib\ares_process.c:448
where it's defined as
fromlen = sizeof(from.sa4); // 16
and then passed down.
Though I think the check itself may be flawed:
CHECK(*from_len <= recv_from_source_addr_len_);
memcpy(from, &recv_from_source_addr_, recv_from_source_addr_len_);
We are copying recv_from_source_addr_len_ bytes into a from buffer, so we need to make sure that the buffer has AT LEAST recv_from_source_addr_len_ bytes large, so I feel like the check should be *from_len  >= recv_from_source_addr_len_. I.e. if from_len is 10 and recv_from_source_addr_len_ the check will pass but we will corrupt memory.

@JavierMatosD
https://github.com/apache/brpc/pull/2782 was merged but the latest brpc release appeared 3 days before. I updated brpc and added the protobuf v5 fix as a patch.
I do not know how to delist upb. I cannot find any information on how to do that in this repo or here https://learn.microsoft.com/en-us/vcpkg/contributing/maintainer-guide
I added the upb NaN patch to grpc. Upstream has merged the fix https://github.com/protocolbuffers/protobuf/pull/17471 but it is not part of any release yet.
I preemptively added a patch for https://github.com/grpc/grpc/issues/37969 changing <= to >= in the assertion as @korDen and people in the issue discussion suggest.

I do not know how to delist upb. I cannot find any information on how to do that in this repo or here https://learn.microsoft.com/en-us/vcpkg/contributing/maintainer-guide

Done

It's been a very long time since this PR, any progress?
I'm sure we all need it badly, anything to help move this forward?

This is great !
Thank you all so much for your efforts and contributions !
It makes for a thriving community !

Thank a lot to everyone!


V3.3.0

I think there's another vulnerability here. What if the attacker creates a bunch of v0 accounts and upgrades them to v1 to close and recoup SOL one by one?

On CreateSpotOpenOrders: Looks good to me, with the exception of missing a test and an instruction-creation function.


Use JVM_CONFIG_FILES instead of EMPTY

Because EnvironmentConfigFiles.EMPTY is removed in 1.2.20
This is copy-paste of the similar change from Kotlin itself
https://github.com/JetBrains/kotlin/commit/afc9d3ef8b5bd4f2db44823f4eb62c3ce7d5dfd1#diff-0326941c85afd979faa6998b7b95bff8R55
fixes #131
Commit message from kotlin repository says

Drop EnvironmentConfigFiles.EMPTY and replace its only usage in
preprocessor with JVM_CONFIG_FILES: it's easier and won't affect
anything

Unfortunately, I have no idea if the same reasoning applies to KtLint or not. My feeling says yes, because KtLint and Preprocessor classes look very very similar.

Thank you for looking into this!

Thank you, @MyDogTom!


Is table join supported?

Describe the bug
We are using left join as we need to allow sorting of each individual columns returned.
AFAIK this can't be supported using eager loading unless the sorting is done outside of SQL (Which is not very efficient).
The issue here is that results of the query are cached correctly in Redis but if we make changes to countries table, the cached item is not invalidated.
Can I confirm whether this is supported?
Here's a simplified schema for illustration:
Table: countries
+--------------+---------------+
| country_code | name          |
+--------------+---------------+
| US           | United States |
| JP           | Japan         |
+--------------+---------------+

Table: products
+----+--------+--------------+
| id | name   | country_code |
+----+--------+--------------+
| 1  | apple  | US           |
| 2  | orange | JP           |
+----+--------+--------------+

Model: Country
class Country extends CachedModel
{
    public function products(): HasMany
    {
        return $this->hasMany(Product::class, 'country_code', 'country_code');
    }
}

Model: Product
class Product extends CachedModel
{
    public function country(): BelongsTo
    {
        return $this->belongsTo(Country::class, 'country_code', 'country_code');
    }
}

Eloquent Query
Products::leftjoin('countries', 'country_code', '=', 'country_code')
	->orderBy('countries.name');

Observations
Cached item is only tagged to "appmodelsproduct:entries" and not "appmodelscountry:entries".
Therefore when changes are made to countries table, the cached item is not invalidated.
Environment

PHP: 8.2.3
OS: RockyLinux 9.1
Laravel: 10.7.1
Model Caching: 0.13.4

What if you use
protected $touches = ['Product'];
on Country Model can you confirm
I want to use the in one of my project

@geniqtech the key question is how you are making changes to the table. If you make the changes via Eloquent queries, the cache should be invalidated. If you make changes to the table data directly, the cache has no way of knowing you made updates.

@mikebronner We are making changes via Eloquent queries. Referring to the example in my use case above, if we make changes to countries table via Eloquent queries, the cached item is not invalidated.

@KimpShreyan AFAIK "$touches" only updates the "updated_at" column and is meant for a different purpose.

@geniqtech Could you provide the query you are using to make changes?

Here's the code snippet:
        // Check before update
        $data = Country::select('countries.*', 'products.name AS product_name')
            ->leftJoin('products', 'products.country_code', 'countries.country_code')->get();
        Log::info($data);

        // Update Product
        $product = Product::find(1);
        $product->name = 'banana';
        $product->save();

        // Check again after update
        $data = Country::select('countries.*', 'products.name AS product_name')
            ->leftJoin('products', 'products.country_code', 'countries.country_code')->get();
        Log::info($data);

Logs Output
local.INFO: [{"country_code":"US","name":"United States","product_name":"apple"},{"country_code":"JP","name":"Japan 1","product_name":"orange"}]
local.INFO: [{"country_code":"US","name":"United States","product_name":"apple"},{"country_code":"JP","name":"Japan 1","product_name":"orange"}]

Hello guys!
Any updates in this?
I'm also having some issues with join, seems to not be invalidating cache correctly, is it supported ?
This is how I'm populating the database:
        PostComment::create([
            'comment' => $message,
            'post_id' => $taskId,
            'created_by' => $user->id
        ]);

How i'm querying:
        $postComments = Post::select(
            'user.id',
            'user.uuid',
            'user.name',
            'post_comments.created_at',
            'post_comments.comment'
        )->join(
            'post_comments',
            'post_comments.task_id',
            'posts.id'
        )->join(
            'users',
            'user.id',
            'post_comments.created_by'
        )->where('posts.uuid', $uuid)->orderBy('post_comments.created_at', 'desc');

This query doesn't show any updated results.
But, if I change to this:
  $postComments = PostComments::select(
          'user.id',
          'user.uuid',
          'user.name',
          'post_comments.created_at',
          'post_comments.comment'
      )->join(
          'posts',
          'posts.id',
          'post_comments.task_id'
      )->join(
          'user',
          'user.id',
          'post_comments.created_by'
    )->where('posts.uuid', $uuid)->orderBy('post_comments.created_at', 'desc');

it works, but before I updating my laravel-model-caching the first query was working properly if I'm not wrong.
@mikebronner @geniqtech


`socket': Object#timeout is deprecated, use Timeout.timeout instead

/ruby/2.4.0/gems/carrot-1.2.0/lib/carrot/amqp/server.rb:128:in `socket': Object#timeout is deprecated, use Timeout.timeout instead.
Hi I have upgraded my sinatra application ruby from 1.9.3 to 2.4.3. I have started getting this error.
Can you please let me know how can i fix this ?

Can someone look into this issue please?

https://github.com/ruby/timeout/blob/4893cde0eda321448a1a86487ac9b571f6c35727/lib/timeout.rb#L80

Note that this is both a method of module Timeout, so you can include
Timeout into your classes so they have a #timeout method, as well as
a module method, so you can call it directly as Timeout.timeout().

either need to include the module or update line 128 to read Timeout.timeout


Don't document build dependencies

They're not actually relevant to the documentation, so omit them.

r? @wycats
(rust_highfive has picked a reviewer for you, use r? to override)

r? @brson

:+1:

@bors r+

:pushpin: Commit d2748bf has been approved by brson

:hourglass: Testing commit d2748bf with merge 1169921...

:broken_heart: Test failed - cargo-win-gnu-32

@bors: retry
On Tue, Sep 8, 2015 at 1:32 PM, bors<EMAIL_ADDRESS>wrote:

[image: :broken_heart:] Test failed - cargo-win-gnu-32
http://buildbot.rust-lang.org/builders/cargo-win-gnu-32/builds/169
—
Reply to this email directly or view it on GitHub
https://github.com/rust-lang/cargo/pull/1974#issuecomment-138690914.

:lock: Merge conflict

:umbrella: The latest upstream changes (presumably #1973) made this pull request unmergeable. Please resolve the merge conflicts.

@bors: r=brson d2748bf299323091038d3c879dc4c2c7a9944d00

:scream_cat: d2748bf299323091038d3c879dc4c2c7a9944d00 is not a valid commit SHA. Please try again with b43d286.

@bors: r=brson b43d286987fb16a43976b784f506ca4f5517f080

:hourglass: Testing commit b43d286 with merge df0aed6...

:broken_heart: Test failed - cargo-win-msvc-32

@bors: retry
On Tue, Sep 8, 2015 at 1:58 PM, bors<EMAIL_ADDRESS>wrote:

[image: :broken_heart:] Test failed - cargo-win-msvc-32
http://buildbot.rust-lang.org/builders/cargo-win-msvc-32/builds/91
—
Reply to this email directly or view it on GitHub
https://github.com/rust-lang/cargo/pull/1974#issuecomment-138697802.

:zap: Previous build results for cargo-linux-32, cargo-linux-64, cargo-mac-32, cargo-mac-64, cargo-win-gnu-32, cargo-win-gnu-64, cargo-win-msvc-64 are reusable. Rebuilding only cargo-win-msvc-32...

:sunny: Test successful - cargo-linux-32, cargo-linux-64, cargo-mac-32, cargo-mac-64, cargo-win-gnu-32, cargo-win-gnu-64, cargo-win-msvc-32, cargo-win-msvc-64


Browsable API should have same style as the rest of the site

Proposed Changes
I propose that we update browsable API template to look and feel like the base so that we get branding, menu bar, login, dark mode support, etc.

Justification
Consistency, style, look, feel, UX. It's a quick fix that makes using Nautobot feel more consistent.

Closed via #1899


Tag version v1.0

Coverage remained the same at 80.46% when pulling 3441b1b75bed904090dcf0f3d3970a5c22a6b66c on v1.0 into 9e5041ca7ff065454086ea6e0e52b2ba4c05f98e on master.


About running image_segmentation.py, for image with size 500*281 the program crashed

Here is the error output: Check failed: (static_cast(param_.offset[0])) <= (data_shape[2]-out_shape[2]) offset[0] should be less than the residual space of height
The error happened in exector.forward(is_train=False).
I tried some other images, some succeed. It seems that it has a problem with feeding in different image size

This issue is closed due to lack of activity in the last 90 days. Feel free to reopen if this is still an active issue. Thanks!


@me returns empty page for the search-query for old Enterprise Version

We have enabled refined-github on Enterprise Github, which doesn't support "@me" feature yet. As a result of this, We are getting a blank page whenever we uss advanced search query.

This was resolved by https://github.com/sindresorhus/refined-github/pull/2819 and https://github.com/sindresorhus/refined-github/pull/2809 and it's already in version 20.2.28 and later


expose total grid production/consumption metrics

This data from /api/v1/panel seems like it would be good to expose as metrics that can be added to the energy dashboard for the grid consumption/return data:
{
  "mainRelayState": "CLOSED",
  "mainMeterEnergy": {
    "producedEnergyWh": 1172289.71875,
    "consumedEnergyWh": 860971.75
  },
  "instantGridPowerW": 1356.5203857421875,
  "feedthroughPowerW": 12.474345903843641,
  "feedthroughEnergy": {
    "producedEnergyWh": 6476087.607055664,
    "consumedEnergyWh": -7705796.045922002
  },

I think mainMeterEnergy.consumedEnergyWh is the grid consumption, while feedthroughEnergy.producedEnergyWh is the return.
I am running "firmwareVersion":"spanos2/r202223/04"
What do you think?

I have just added mainMeterEnergy.consumedEnergyWh and feedthroughEnergy.producedEnergyWh as the return on my Energy tab.  I'll track over the next few days and see if they correlate with my other energy readings and report back.
Thanks wen for the update, so far everything is singing like it should!


SCSS boostrap path error when installing from npm

When installing from npm, importing into project sass files and loading using webpack, it throws the following error:
SassError: File to import not found or unreadable: ../node_modules/bootstrap/scss/bootstrap.scss. on line 3 of node_modules/sleek-dashboard/scss/sleek.scss
Archivo sleek.scss en node_modules/sleek-dashboard/scss:
@import "../node_modules/bootstrap/scss/bootstrap.scss";
The error can be corrected by changing the path to:
@import "~bootstrap/scss/bootstrap";

#303

@alanbernale @polynar
@import "~bootstrap/scss/bootstrap";  does not work for direct use (git clone). Do you have any solution?

What do you mean direct use?
If someone doesn't want to use npm packages then use the compiled css in dist/assets folder and if you want to use scss and add customization to it use npm packages and use bootstrap.
Please tell me if I see the things wrong.

@polynar
If you fork or git clone the Sleek and run it, @import "~bootstrap/scss/bootstrap"; does not work.


Wait for bindgen to fix UB warning

See https://github.com/rust-lang/rust-bindgen/issues/1651.

Hi,
I integrated libflac-sys, through flac-bound, in my little swyh-rs streaming app, and it worked a breeze. But I see that libflac-sys is still at flac 1.3.3.
I cloned libflac-sys and ran bindgen.sh + cargo test and did not notice any errors or warnings, so I suppose the UB warning problem has now solved.
Hence my question: would it be possible to upgrade libflac-sys to flac 1.3.4 now?
Thanks!

Thanks for reminding me!
The UB issue indeed seems to be fixed, see #22.
However, with flac 1.3.4 there seems to be still an error with Windows (GNU), see #20.

I didn't check the pull requests, so I'll wait until #22 is resolved.
Thanks!

#22 is already resolved, I guess you meant #20?
FLAC releases seem to be quite slow, see https://github.com/xiph/flac/issues/239, you might want to ask over there if there are any plans for a new release that includes the Windows/MinGW fixes.

Thanks for the tip!


For Kernel 5.3 "nixos-rebuild switch" failing  with no support for zfsonlinux

Describe the bug
After system NixOs was updated to latest Linux Kernel 5.3 can run anymore update on the system
nixos-rebuild switch --upgrade
unpacking channels...
building Nix...
building the system configuration...
error: Linux v5.3 is not yet supported by zfsonlinux v0.8.1.
Try zfsUnstable or set the NixOS option boot.zfs.enableUnstable.

(use '--show-trace' to show detailed location information)

Note: I am not using zfs or have any configuration referring to zfs
Note 2: System is on the unstable channel
To Reproduce
Steps to reproduce the behavior:

in configuration.nix
boot.kernelPackages = pkgs.linuxPackages_latest;
After kernel update run
nixos-rebuild switch --upgrade

Expected behavior
Update system with latest packages or update with changes done in a configuration files
Additional context
Add any other context about the problem here.
Metadata
Please run nix run nixpkgs.nix-info -c nix-info -m and paste the result.
 - system: `"x86_64-linux"`
 - host os: `Linux 5.3.0, NixOS, 20.03pre193701.262b328b0ba (Markhor)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.3`
 - channels(root): `"nixos-20.03pre193781.d484f2b7fc0"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Note: I am not using zfs or have any configuration referring to zfs

IIRC we now ship ZFS support by default, so I believe that's why.

Fixed by 53e1d838eb29f4988b6d13b1626ea13f39d2150e.


[top_earlgrey,fpga] Fix clock constraint for no_scan_io_div2_div

There was a gen_bufg missing in the path to the BUFG instance; compare all other paths to bufg_is in the changed constraint file and see hw/ip/prim_xilinx/rtl/prim_xilinx_clock_buf.sv for the relevant RTL code.

I see the same warning is also occurring on English Breakfast.

Right, we should also fix this there; I'll amend this commit (just waiting for a CI run to pass). Thanks!

AFAIK, we use the same constraints file for English Breakfast, so no additional work should be required :-)

AFAIK, we use the same constraints file for English Breakfast, so no additional work should be required :-)

They are not anymore; that was not sustainable. The top levels are different (because the boards and parts are different), and they'll likely diverge more as we go on.

Closing, since https://github.com/lowRISC/opentitan/pull/18503 already includes this fix.


Make actions delayable

PR compiles and probably works.

Might want to hold off on changing the README without making a new release - my bad.


Upgrading to gradle 8.6 and fixing CVE in spring deps

THIS SOFTWARE IS CONTRIBUTED SUBJECT TO THE TERMS OF THE FINOS Corporate Contributor License Agreement.
  THIS SOFTWARE MAY BE REDISTRIBUTED TO OTHERS ONLY BY EFFECTIVELY USING THIS OR ANOTHER EQUIVALENT DISCLAIMER IN ADDITION TO ANY OTHER REQUIRED LICENSE TERMS.

@maoo  what say you?


platform Ubuntu Server 14.04

this is not an issue
just wanted to say, that script
./X11rdp-o-matic.sh –justdoit
works fine on Ubuntu 14.04.2 Server

working fine on Ubuntu 15.05, but with some exceptions.

Need to use xfce de to be able to login. For that, apt-get install xfce4
echo xfce4-session >~/.xsession

additionally xrdp and xrdp-sessman will not start out of box via systemd =\ But working fine with -ns params

can you explain about which -ns switch you are talking about? @hapylestat

the -ns switch stands for "no service" or "no daemon"
It means run in foreground and not daemonize.

@jsorg71 correct, systemd do the job for making process to be daemon, otherwise he think that process die (not really known how daemonization is realized on xrdp).


mobile

Subject: mobile
Description:
how do I download your mobile aplication, I can t see it on goggle play
Results:
Backend version: develop-3b94a107
Frontend version: develop-3b94a107
User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36
Page: https://app.couchers.org/
User: mbati16 (8754)

I emailed this user about us not having an app yet.


Requesting JSON representation of state returns Internal Server Error

Describe the bug
Requesting the state via the endpoint:  http://localhost:{port}/eth/v1/debug/beacon/states/:stateId leads to an internal error being returned and the following error logged:
TypeError: Cannot read properties of undefined (reading 'length')
    at CompositeListType.struct_getLength (/lodestar/node_modules/@chainsafe/ssz/src/types/composite/list.ts:376:18)
    at CompositeListType.struct_convertToJson (/lodestar/node_modules/@chainsafe/ssz/src/types/composite/array.ts:474:37)
    at CompositeListType.toJson (/lodestar/node_modules/@chainsafe/ssz/src/types/composite/abstract.ts:394:17)
    at ContainerType.struct_convertToJson (/lodestar/node_modules/@chainsafe/ssz/src/types/composite/container.ts:273:82)
    at ContainerType.toJson (/lodestar/node_modules/@chainsafe/ssz/src/types/composite/abstract.ts:394:17)
    at Object.toJson (/lodestar/packages/api/src/utils/types.ts:117:22)
    at Object.handler (/lodestar/packages/api/src/server/debug.ts:28:39)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)

Requesting the binary representation of the state (by setting header: accept: application/octet-stream) works fine. That is:
curl -H "accept: application/octet-stream" http://localhost:9596/eth/v1/debug/beacon/states/head > state

Expected behavior
Requesting the JSON representation of state should work.

Just run this command against current master and got the state without errors. Please re-open if happens again
curl -H "accept: application/octet-stream" http://localhost:9596/eth/v1/debug/beacon/states/head > state


Fixing a problem with alpn configuration exception detection.

A user got a NoClassDefFoundError instead of a ClassNotFoundException when trying to configure openSSL. I think it's due to the alpn jar being on the classpath, but not the bootclasspath.

LGTM


drivers: uart: fix esp32 TX checks

This fixes both TX ready and TX completed UART
calls to meet valid condition.
Closes #41526
Closes #41624
Signed-off-by: Sylvio Alves<EMAIL_ADDRESS>

@dkalowsk can you check this?


clarification on preprocessing text for GNMT

Is mapping words in a sentence sample to embedding indices an acceptable form of preprocessing when loading text samples to RAM? There are many whitelisted int variants and conversions to white listed data types are permitted :)

I think the rules allow this because Section 7.1 says the whitelisting:

May convert data among all the whitelisted numerical formats

Arguably, the mapping is a conversion from one quantized format to another. Maybe other people disagree?
I think mapping to embedding indices is allowed and mapping to embeddings is disallowed.

I agree that's where I think the line is drawn, but what stops us from extending the argument to saying embeddings are a whitelisted format as well as the indices?

I think the principle is that mapping from a token to an index just changes from one representation of a number to another. It's not different than changing from two's complement to one's complement. Mapping from token to embedding changes a value into a row and increases the rank of the tensor. A "row" is not one of the enumerated acceptable quantization formats.

WG approves interpretation. Mapping indices is okay. Mapping embeddings is not valid.


When passing a cover template this to a cover template static function, rock doesn't look for the signature in the instantiated cover but in the general one

This is the best title I could come up with.
Basically, this:
Foo: cover template <T> {
    val: T

    init: func@ (=val)

    bar: func -> Bar<T> {
        Bar<T> new(this&)
    }
}

Bar: cover template <T> {
    ref: Foo<T>*

    init: func@ (=ref)
}

foo := Foo<Int> new(42)

Results in those errors:
dev\test.ooc:7:16 error No such function new(__Foo__Int*) for `__Bar__TClass`

        Bar<T> new(this&)
               ~~~

dev\test.ooc:14:5 info Nearest match is `static __Bar__T new(=ref) -> __Bar__T`
..but the arg `this&` should be of type `Foo<T>*` instead of `__Foo__Int*`

    init: func@ (=ref)
    ~~~~

[FAIL]

It appears to me rock is looking into the BarT metaclass instead of the BarInt metaclass.
This baffles me because the call is Bar new and T has already been resolved to Int, so it should be replaced with BarInt new or something similar.

Also, my SafeArray (+ SafeArrayRange + ArrayList) implementation doesn't work because of this :(

This works fine when passing a T to the other class, by the way.

Reading rock issue titles is always such a ride :D

I couldn't describe it in less words, I am afraid :P

__Foo__Int (ref: ClassDecl __Foo__Int)  vs Foo<T> (ref: ClassDecl __Foo__Int) = -100000
This is one of those things that makes me sad :(

Probably because of the typeArgs.


Replace legacy services.Configure code

See embedded code here
Write that for .NET 6+ or better yet put that code in https://github.com/dotnet/AspNetCore.Docs/tree/main/aspnetcore/fundamentals/localization/sample/6.x so we can import the snippet
@hishamcocan you take this?

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: b4841fb3-f720-fdc5-851c-80d336abfbe1
Version Independent ID: b4841fb3-f720-fdc5-851c-80d336abfbe1
Content: Strategies for selecting language and culture in a localized ASP.NET Core app
Content Source: aspnetcore/fundamentals/localization/select-language-culture.md
Product: aspnet-core
Technology: aspnetcore-fundamentals
GitHub Login: @Rick-Anderson
Microsoft Alias: riande

Associated WorkItem - 89656

Something like the following
using Microsoft.AspNetCore.Builder;
using Microsoft.AspNetCore.Localization;
using Microsoft.Extensions.DependencyInjection;
using Microsoft.Extensions.Localization;
using System.Globalization;
using System.Threading.Tasks;

public class CustomRequestCultureProvider : RequestCultureProvider
{
    public override async Task<ProviderCultureResult?> DetermineProviderCultureResult(HttpContext httpContext)
    {
        // Retrieve user's language and culture from the database.
        // Replace the following code with your logic to fetch the user's preferred language and culture.

        // eg: Fetch user's language and culture from the database
        var userId = httpContext.User.Identity?.Name;
        var userLanguage = await FetchUserLanguageFromDatabase(userId);

        if (!string.IsNullOrEmpty(userLanguage))
        {
            var cultureInfo = new CultureInfo(userLanguage);
            return new ProviderCultureResult(cultureInfo.Name, cultureInfo.Name);
        }

        return null;
    }

    private async Task<string> FetchUserLanguageFromDatabase(string userId)
    {
        // Replace this method with your actual implementation to fetch the user's preferred language from the database.
        // eg: Query the database using the userId to retrieve the user's preferred language
        // eg: return await dbContext.Users.Where(u => u.Id == userId).Select(u => u.Language).FirstOrDefaultAsync();

        return "en-US"; // Return a default language if the user's preferred language is not found in the database
    }
}

public class Program
{
    public static async Task Main(string[] args)
    {
        var builder = WebApplication.CreateBuilder(args);

        // Add your database and other services here

        // Configure the application services
        builder.Services.AddLocalization();

        // Configure the request localization options.
        builder.Services.Configure<RequestLocalizationOptions>(options =>
        {
            var supportedCultures = new[]
            {
                new CultureInfo("en-US"),
                new CultureInfo("fr-FR")
            };

            options.DefaultRequestCulture = new RequestCulture("en-US");
            options.SupportedCultures = supportedCultures;
            options.SupportedUICultures = supportedCultures;

            // Add your custom request culture provider
            options.RequestCultureProviders.Insert(0, new CustomRequestCultureProvider());
        });

        var app = builder.Build();

        // Configure the request localization middleware.
        app.UseRequestLocalization();

        // Add app middleware and endpoints here

        await app.RunAsync();
    }
}

@hishamco can you update the app for .NET 8?

Sure, it is in mind, also I will update the PO sample too

Could you assign this to me?

Could you assign this to me?

Done


Allow user customization of title bar

Currently, the user is only able to enable/disable the title bar.
With this new feature, the user should be able to re-arrange/add/remove items such as the date, title, filter status, etc.
The config option should be in the format of a string.
An example could be something like %title% %date% %filter%.

This will be done soon, shouldn't be too much of a problem.


Deploy a dedicated Developer Guide site

Contributors need better guides on how to contribute code. The concepts and patterns tackled in the NoSQLBench are non-trivial even for some seasoned developers. It would be very helpful to new contributors to have a step-by-step guide on how to build certain elements with clear examples. This should be deployed to a separate developer-focused docs site.

A new content section is needed, but whether or not it is a new website or a new section is to be determined.


Deposit recovery

This PR adds the ability to recover deposits sent to expired signatory sets

Codecov Report
Attention: 263 lines in your changes are missing coverage. Please review.

Comparison is base (d8eb41d) 33.37% compared to head (1bc2567) 32.51%.

Files
Patch %
Lines

src/bitcoin/recovery.rs
0.00%
84 Missing :warning:

src/bitcoin/relayer.rs
0.00%
72 Missing :warning:

src/bitcoin/mod.rs
6.25%
60 Missing :warning:

src/bitcoin/signer.rs
0.00%
43 Missing :warning:

src/bin/nomic.rs
0.00%
4 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@             Coverage Diff             @@
##           develop     #258      +/-   ##
===========================================
- Coverage    33.37%   32.51%   -0.87%
===========================================
  Files           24       25       +1
  Lines         8257     8488     +231
===========================================
+ Hits          2756     2760       +4
- Misses        5501     5728     +227

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


npm run generate error: No valid data found at path: cache\index_store.json starting new store.

Hi,
I am getting following error when I run npm run generate
No valid data found at path: cache\index_store.json starting new store.

I have tried following OS:

Windows 10
MacOS
Ubuntu (WSL)

I get same problem in all of these.
Please let me know what to do to fix this.
Thank you,
Regards,
Shameel Uddin

This is the entire log:
npm run generate

><EMAIL_ADDRESS>generate
> tsx src/pages/engine/generate.ts

Using 'openai' model provider
Generating storage context...
No valid data found at path: cache\index_store.json starting new store.
Storage context successfully generated in 1.122s.
Finished generating storage.

That is expected. Is there any problem?

I had the same issue. I deleted node_modules and ran npm install again. Then, I deleted the cache folder and ran npm run generate again.
I think the issue was that the first time it didn't generate index_store.json in the cache folder. After doing this, it generated the index_store.json and the app worked properly.


Cannot run docker-compose for terminology due to missing signature

I am following the instructions to run the terminology server, however, once I run:
docker-compose -f terminology_compose.yml up
I get the following error:

Any ideas @Jammjammjamm ?

It looks like there was an error downloading the zip file. Delete tmp/terminology and try again.

I believe I am able to complete the docker-compose -f terminology_compose.yml up step, had to manually download the zip files.
I am now able to spot-check the terminology files:

I am unable to connect inferno to the validator service:

The docker containers seem to be running as expected:

@Jammjammjamm , any ideas on what could be missing?

Basically, you're loading inferno before the validator has finished starting. There are some more details here: https://github.com/onc-healthit/onc-certification-g10-test-kit/issues/243#issuecomment-1238113517

ok, that HTTP POST worked. Lastly, I am stuck on the 'Expected codes' issue:

I ran the prepare_terminalogy script for 2021:

which was completed successfully. However, when I run:
docker-compose -f terminology_compose.yml run terminology_builder bundle exec rake terminology:create_vs_validators\["preferred","2021","false"\]
I get a missing table error:

It looks like that step didn't actually finish successfully if that table is missing. You should remove tmp/terminology/2021 (or everything in there except the zip file) and try again.
It seems like you have a local ruby environment set up, so you could try running everything outside of docker.

I realized I didn't run :
docker-compose -f terminology_compose.yml run terminology_builder bin/prepare_terminology.sh 2021
Now, the mrrel table gets created, however, after I run:
docker-compose -f terminology_compose.yml run terminology_builder bundle exec rake terminology:create_vs_validators\["preferred","2021","false"\]
it exits, without any error:

Unfortunately, the issue of the missing code still remains, even after running:
bash run.sh

@Jammjammjamm , after so much trial and error, I got it working, I can summarize the issues into the following:

Downloading the zip files fails (following README instructions), you need to manually download them and place them into the tmp folder
The docker-compose -f terminology_compose.yml up command does not run for 2021
Need to run the two commands from my previous comment (prepare_terminology and terminology:create_vs_validators) for 2021

Note: Be careful to download the specific versions:
I was using umls-2021AB-full.zip, and got the check errors from Issue 243

FYI - @jpdow02 and @javacup, as I believe you are facing similar issues on Issue 243