TSC base template refactor

I've started refactoring the time series classification base template according to #993.
This is just a start, but I would like to:

move what is now "capabilities" to a joint "tags" systems across all estimator scitypes
add functionality to handle multiple input types along the lines of #980, especially since some estimators assume nested df and some assume numpy
refactor TSC similar to #955

@TonyBagnall, we will be discussing tags today  in the core dev sprint hours, with @mloning, @aiwalterand @thayeylolu - would be great if you could join.

@TonyBagnall, any good ideas about the error?

@TonyBagnall, any good ideas about the error?

it seems to be failing on an azure test, I cant even find which one it is failing, all I can see when I click on the above is "TypeError: object of type 'float' has no len()" in test_stat. I have no working knowledge of azure, sorry. I'll take a look if you like

The really odd thing about the failing test is that it's coming from the orchestration/benchmarking module, while all time series classifier related tests pass as it would be expected.
@ViktorKaz, do you have an idea what is going on here?
@TonyBagnall, @mloning, any comments?

it seems to be failing on an azure test, I cant even find which one it is failing

The name of the test is test_stat in test_orchestration.py - I believe it's failing locally too, not just on Azure, @TonyBagnall?

@fkiraly I cloned your PR and ran the failing test locally. I get the following error:
ModuleNotFoundError: No module named 'sktime.distances.elastic_cython'

@fkiraly I cloned your PR and ran the failing test locally. I get the following error:

The likely cause of this is your C compilers not being up to date? If you are using windows, make sure you have VS build tools installed.
Check the tests if you want to see which one failes - e.g., to on build-and-test and "details"

@fkiraly I am using Linux and generally don't have issues with Cython or the C compilers with other PR. I tried to clone your PR in order to be able to debug it and got the error in question.
Just by interpreting the tests output and code in GitHub, len is used in sktime.benchmarking.orchestration only to check whether the length of the lists with the strategies, tasks and datasets is the same. It is possible that one of these variables was defined as a float rather than a list. However, it is hard to say where the error is coming from without cloning the PR and running the test locally.
I can try to have a closer look if you want.

I can try to have a closer look if you want.

That's really strange - I assume you can access the test logs and see that this doesn't get the same error you describe?
I can't explain it.
Thanks for offering to have a look, that would be great - TSC refactor would unlock a number of interesting items to work on.

the problem I envisage with handling conversion in the base class comes when we adapt to handle unequal length series. Suppose the classifier always wants to pull the data from pandas into a numpy array when it is given equal length problems, due to the gross inefficiency of not doing so. However, if the data is not equal length, it cannot do this and must dictate how to convert the data into a compatible data structure. This data structure could be completely different for different classifiers, and may differ if, for example, dimensions are different lengths in addition to series. This would not be a problem if we separate out the checking (done in fit) from the conversion (done in _fit and possibly bespoke).

This would not be a problem if we separate out the checking (done in fit) from the conversion (done in _fit and possibly bespoke).

Well, currently there is no conversion in this PR.
My opinion on the "next bit", i.e., conversion and different input handling:

have default conversion machinery in fit, similar to #980
allow "bypass" of the conversion machinery by having multiple "internally supported types", i.e., if the type of input is on a passlist, the input goes unchanged to _fit
_fit aims to implement functionality for "core input types" like numpy etc, similar to @mloning's suggestion in #1074. Bespoke conversions can happen in there for the types that are fed through the "bypass".

what would be your proposed change?
Moving the coerce_to_numpy arg to a tag?

or define a bespoke time series data structure ..... https://github.com/uea-machine-learning/tsml/tree/master/src/main/java/tsml/data_containers

or define a bespoke time series data structure

No, I am against that - users expect numpy or pandas or sth very similar.

I would delegate all conversions to the classifiers in _fit, which could call standard converters or do bespoke operations

I am against the first part, that would result in a lot of boilerplate code, which is precisely what the fit/_fit refactor tried to reduce.
I agree with the second part, have standard converters and a simple interface to access these.
To align: why not have some "default conversion" in fit which avoids boilerplate but you can turn off, and you can use the standard converters in _fit too if you like?

I would like to move all of the data conversion out of check_X and check_X_y.

Agreed, it is an unexpected location, and a textbook violation of the single responsibility principle.

I would delegate all conversions to the classifiers in _fit, which could call standard converters or do bespoke operations

I am against the first part, that would result in a lot of boilerplate code, which is precisely what the fit/_fit refactor tried to reduce.

I think its inevitable that classifiers will handle the same data structures (so called panel data, aka 3D arrays) in different ways dependent on the contents.  Without a bespoke data structure it is inevitable you have to delegate to the classifiers. If the data is in a panda and is equal length, most classifiers will pull it out into a 3D numpy. If it is unequal length, it is classifier dependent. It may leave it in the panda, extract it to a list of arrays, pad it with a transformer into equal length or indeed use some ragged array solution such as awkward arrays. The same classifier could have an option to do any one of these things, dependent on the algorithm selected. None of this is defined, but will be considered soon. I think until these use cases are sorted out, we should not perform any data structure conversions in the base class.

@TonyBagnall, I think the thought that moving to a silver bullet format/standard to solve problems with multiple appropriate but divergent formats/standards is very seductive but notoriously misleading...

The same classifier could have an option to do any one of these things, dependent on the algorithm selected. None of this is defined, but will be considered soon. I think until these use cases are sorted out, we should not perform any data structure conversions in the base class.

What do you mean with use cases here?

Thanks for offering to have a look, that would be great - TSC refactor would unlock a number of interesting items to work on.

@fkiraly I managed to run the tests locally, there was an issue with my virtual environment. However, I see 44 tests that are failing. Therefore, it seems to me that the problem is more general and not necessarily linked to the orchestration module. Most of the failing tests (41 in total) are in sktime/forecasting/tests/test_all_forecasters.py. You can find the output at this link: https://ufile.io/3s9c60b0. Do you see the same on your side?

@TonyBagnall, more thoughts about the data structure, and I agree more with you than I did above.
I think we get something very nice if we combine your idea with @ninamiolane's geomstats architecture (which is similar to @ablaom's for data tables).
With the fit/_fit architecture, it would be easy to wrap data objects inside a "scitype" class with a unified interface. This architecture could be similar to that in @ninamiolane's interface geomstats package, and may also allow work with lazy data loading or tensor processing back-ends. We could even 1:1 reuse @ninamiolane's back-end in many parts.
Unlike in geomstats, though, the user wouldn't even necessarily see it, because fit could wrap it if the object passed is not already wrapped.
I now even think this may be the "end state" architecture we should be aiming for.
What do you think of this architecture, @ninamiolane?
(let me know if you need more context, happy to write up an extension proposal which explains it in detail)
With #980, we wouldn't even need to implement it for all estimators at the same time, but could introduce support for the data wrapper step-by-step. This is because all types would be supported at all times as long as all conversions have been implemented at the start, so no change in the user-sided interface would occur between updates and releases.

So, as a sketch, in the vanilla version of the idea, the fit would look like:

def fit(self, X, y):

    X = some_check(X)
    y = some_check(y)

    X = NinaDataWrapper(X)
    y = NinaDataWrapper(y)

    self._fit(X, y)

Combined with #980, we would have:

def fit(self, X, y):

    X = some_check(X)
    y = some_check(y)

    X = convert(X, self.get_tag("inner_type_X"))
    y = convert(y, self.get_tag("inner_type_y"))

    self._fit(X, y)

where for the classifiers that have been "upgraded", the "inner_type" would be NinaDataWrapper, and convert would do the conversion. For the classifiers that have not been upgraded, convert outputs whichever type the inner _fit can deal with, e.g., 3D numpy data frame. Since we can switch the inner_type over one-by-one, the user wouldn't notice anything (except an increas in efficiency).

Do you see the same on your side?

@ViktorKaz, no - this looks like a problem with your fbprophet installation? You may try the fixes in the installation guidelines; an updated version (not merged yet) is in #1103, this may even be more helpful to you, it lists 3 workarounds for the prophet issue.

@TonyBagnall, it looks like the problem is coming from ProximityForest, not from the orchestration suite.
Switching out ProximityForest for KNearestNeighbor seems to solve it, so it's definitely something with the proximity forest.
I haven't tracked it down to debug it, but the earlier commit should give you code to reproduce it.

I'm a bit confused, there are long engineering conversations with some bug talk embedded in it
"@TonyBagnall, it looks like the problem is coming from ProximityForest, not from the orchestration suite.
Switching out ProximityForest for KNearestNeighbor seems to solve it, so it's definitely something with the proximity forest.
I haven't tracked it down to debug it, but the earlier commit should give you code to reproduce it."
could you raise an issue describing the bug please?

could you raise an issue describing the bug please?

as said, I have not isolated the issue, but it's in the interaction of the orchestration framework and the ProximityForest.
There is a ProximityForest used in the current orchestration test, which fails after the refactor. If it is switched out for basically any other time series classifier, the orchestration test passes. A medium-depth look at the tracebeek seems to suggest that it is some unexpected behaviour of ProximityForest rather than of the orchestration framework.
Happy to raise a bug report.

Do you see the same on your side?

@ViktorKaz, I noticed that my earlier comment was incorrect.
The 44 tests failing were probably due to one of the tags not being correctly registered in the new registry. The registry was created after this PR, so merging from main caused those tests to fail, while before there was just one.
To reproduce the bug that was earlier here, look at my description to reproduce in #1114.
Sorry for the confusion.

Thank, I have not been involved with this code at all, so will try find someone to look into it

@fkiraly no problem, I see that you sorted out the failing test.

@fkiraly no problem, I see that you sorted out the failing test.

Well, I sorted it by switching the estimator causing the problem to one of the others, but it didn't really "solve" the problem.
What it did, I think, it removed the problem from causing a secondary problem in the test.

@TonyBagnall, would you mind re-reviewing this? The test bug is a separate thing, I'll add details in #1114.
The aim of this is to prepare a refactor similar to #955.

@TonyBagnall, would you mind re-reviewing this? The test bug is a separate thing, I'll add details in #1114.
The aim of this is to prepare a refactor similar to #955.

np, I'll look this afternoon


fix(snap): update to use kong deb from bintray

PR Checklist
Please check if your PR fulfills the following requirements:

[NA] Tests for the changes have been added (for bug fixes / features)
[NA] Docs have been added / updated (for bug fixes / features)

If your build fails due to your commit message not passing the build checks, please review the guidelines here: https://github.com/edgexfoundry/edgex-go/blob/master/.github/Contributing.md.
What is the current behavior?

NA
Issue Number:
NA
What is the new behavior?
NA
Does this PR introduce a breaking change?

[ ] Yes
[X] No

New Imports

[ ] Yes
[X] No

Specific Instructions
Are there any specific instructions or things that should be known prior to reviewing? No
Other information
This PR updates the edgexfoundry snap to use the kong debian packages published on bintray vs. building lua, luarocks, kong, and openresty as individual parts (some from source, some downloaded tarballs).
Two other minor changes are included in the PR:

filter out man pages included in the snap from the postgresql part
strip the date+commit suffix from the snap version

We've verified that kong comes up by default on both amd64 and arm64, and also run the blackbox-tests with security enabled, and found no regressions.

At Tony, failing Semantic bot due to missing : after scope. Should be fix(snap): update to use kong deb from bintray

@anonymouse64 @lenny-intel changes addressed, and re-pushed.

Codecov Report

Merging #2848 into master will decrease coverage by 0.71%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #2848      +/-   ##
==========================================
- Coverage   40.39%   39.68%   -0.72%
==========================================
  Files         172      166       -6
  Lines       13802    13459     -343
==========================================
- Hits         5576     5341     -235
+ Misses       7870     7799      -71
+ Partials      356      319      -37

Impacted Files
Coverage Δ

...al/security/config/command/proxy/oauth2/command.go

...ernal/security/config/command/proxy/jwt/command.go

...ernal/security/config/command/proxy/tls/command.go

...l/security/config/command/proxy/adduser/command.go

...l/security/config/command/proxy/deluser/command.go

internal/security/config/command/help/command.go

internal/core/data/v2/application/event.go
75.94% <0.00%> (+5.06%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0c62d3a...cc52047. Read the comment docs.

Well I built and tested this PR on amd64 on my focal desktop and everything is groovy :wink: but I haven't been able to build it on arm64 yet to see if it's all good on the pi, I will have to do that on Monday, but I think that is a necessary check that should be done before merging since this is supposed to fix arm64.

@anonymouse64 just a heads-up that @siggiskulason ran the blackbox tests with security enabled against this PR on his RPi4, and although there were a couple of assertion errors thought to be timing related, we're confident that this change works fine on arm64.

I don't have a lot of knowledge about snaps but this seems sensible and who am I to complain about a ~200 line reduction 😆

recheck


Python 3 compatibility

The dakotathon package is not presently compatible with python 3. This is reasonable given the original intentions of what python versions dakotathon would support. There are only a few changes to be made that would provide compatibility.
See forthcoming PR.
This Issue supersedes #50 (which deals only with install issues).

Fixed with #59.

thanks @mdpiper


[Bug]: Update --help of dataconverter in that no longer existent names of readers should be removed

Contact Details
No response
What happened?
A bug happened!
see #322 which suggests a fix
Relevant log output
No response

Will be covered in this new pynxtools issue

I think it works just fine, maybe you have some leftover empty folders from the old readers?


fix: update molecule config

Have you read the Contributing Guidelines?
Issue #
Changes description
Clearly and concisely describe what's in this pull request. Include screenshots, if necessary.

Task linked: CU-862j847m2 Add RedHat support for Posit/RStudio Ansible roles


[TRACKER] XWayland-related issues

Godot version
Various, mostly 4.x
System information
Linux/BSD - Wayland
Issue description
Lately lots of Linux distributions (such as Fedora 34, Debian 10 "buster" and Ubuntu 21.04) have been switching to Wayland compositors as their default windowing solution and many people don't even know that they're actually running one.
Godot doesn't have a Wayland backend merged in yet, with a WIP branch available at #57025.
Luckily, people can still use Godot through a compatibility mechanism that most compositors have, called XWayland, which allows them to run X11 unmodified applications seamlessly.
It works fine most of the time but sadly it looks like that Godot, for whatever reason, doesn't work that well with it, manifesting issues that can't be replicated on common X11 window managers.
The above and the fact that most people aren't seemingly aware of XWayland are causing confusion in multiple bug reports lately.
The purpose of this tracker is to have all the currently known XWayland issues in one place to aid future bug reports.
4.x issues
- [ ] #57288
- [ ] #74168
- [ ] #75140
- [ ] #75752
- [ ] #77333
- [ ] #78487
- [ ] #75515
- [ ] #74723
- [ ] #78818
- [ ] #79102
- [ ] #79677
- [ ] #79820
- [ ] #80008
- [ ] #81732
- [ ] #82205
- [ ] https://github.com/godotengine/godot/issues/85342

(for #77333, unsure, some people report it also with native X11)
3.x issues
- [ ] #44741

Workaround
Most of those are windowing related (4.x) and can be worked around by running Godot with single window mode. To enable it, either go in the editor settings or run Godot with the --single-window CLI argument.
Steps to reproduce
Run Godot on a Wayland compositor through XWayland.
Minimal reproduction project
N/A
Production team edit: to make the lists use the [tasklist] format

An additional workaround that actually worked for me, is enabling the "Update continuously" option under Editor settings -> Interface -> Editor.
Have to do that only for my Nvidia+Wayland desktop PC. On my laptop with Intel+Wayland, everything is fine.


Add https://bayanguru.org/ to the archives section

Hi,
Could you, please, add the bayanguru web site to the free music scores section?
Web site: https://bayanguru.org/
GitHub: https://github.com/volodymyrprokopyuk/bayanguru
The author of the bayanguru site.
Thank you!

Thanks! Added in b249781037af9c4d1128d5c7c5890fa331b823fd


[Feature] Add available verbose mode message at the end of the CLI output

If any of the rules reported a verbose message, the CLI should show at the bottom a message with something like "Check the verbose mode for more details --verbose"

Closed in #45


PP-3191 - Wrote a lil module that looks for data attributes and builds a virtual pageview for us

We want to be able to track signups as a goal to see if people are dropping off through the journey, but to do this we need a definitive end, so I have set a virtual pageview when a user submits their service name.
Usage
Currently this is meant for use on a form element you want to create a virtual pageview for
The JS looks for a data attribute called data-virtual-pageview you need to also give this a value of the pageview you want to generate:
<form data-virtual-pageview="/service/registration-complete">

You can optionally add another data attribute which contains a list of custom dimensions you want to send. For example:
<form data-virtual-pageview="/service/registration-complete" data-dimensions="dimension1:service-name">

It’s important that the dimensions are formatted with a colon separating the dimension name and value and no spaces. Spaces are used to split if you want more than one dimension. The dimension value should correspond to the name of the form element from which you want to capture the value.

seriously, no tests @jonheslop ?

@kakumara Awww busted ☹


iOS11.4   Although the VPN is connected, all webs cannot be open .

In iOS11.4,
Although the VPN is connected, all webs cannot be open .
No such problem on iOS10，happened in iOS11.4 only.
did everyone got this problem?

Make sure you grant network visit permission to the app.

On Jul 10, 2018, at 10:51, weqeo<EMAIL_ADDRESS>wrote:
In iOS11.4,
Although the VPN is connected, all webs cannot be open .
No such problem on iOS10?
did everyone had this problem also?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/zhuhaow/NEKit/issues/178, or mute the thread https://github.com/notifications/unsubscribe-auth/ABOmLPf9TitAJwYeQ7_9Q95ImkXRnwF8ks5uFBaegaJpZM4VIrcj.

Make sure you grant network visit permission to the app.
Thanks for your quick feedback.
could u tell some ditails about how to "grant network visit permission"  ,thanks~

Settings -> WLAN -> Apps Using WALN & Mobile Data

On Jul 10, 2018, at 10:57, weqeo<EMAIL_ADDRESS>wrote:
Make sure you grant network visit permission to the app.
Thanks for your quick feedback.
could u tell some ditails about how to "grant network visit permission" ,thanks~
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub https://github.com/zhuhaow/NEKit/issues/178#issuecomment-403683728, or mute the thread https://github.com/notifications/unsubscribe-auth/ABOmLA9URMPWgmdeJz2J1WCtJ4E2PEHXks5uFBf-gaJpZM4VIrcj.


introduce MAX_VALUE_LENGTH flag

Codecov Report

Merging #33 (fcaabb4) into master (7d2470e) will decrease coverage by 1.11%.
The diff coverage is 53.84%.

@@            Coverage Diff             @@
##           master      #33      +/-   ##
==========================================
- Coverage   68.77%   67.65%   -1.12%
==========================================
  Files           4        4
  Lines         253      269      +16
==========================================
+ Hits          174      182       +8
- Misses         63       70       +7
- Partials       16       17       +1

Impacted Files
Coverage Δ

cmd/root.go
24.61% <25.00%> (-2.18%)
:arrow_down:

pkg/printer/printer.go
90.24% <100.00%> (+0.91%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7d2470e...fcaabb4. Read the comment docs.


@Tag annotation not work as expected on the Controller class.

It seems you decided to replace the old annotation @Api by @Tag, So after I read the docs of the @Tag class, I noticed that you described that "The annotation may be applied at class or method level, ..., for all operations of a class (when applied at class level)".
But when I tried to put this annotation on the Controller class like this:
@Tag(name = "test", description = "test")
public class IndexController

It would not work as expected, the operations of the IndexController class would not apply the tag info which I applied on class.
I have to put @Tag annotation on all operations with same tag info one by one to achieve the goal of 'for all operations'. Otherwise, I will get two tag separately, which called 'index-controller' and 'test'. The 'test' tag will only contain the operations which putted on the same name @Tag annotation, the 'index-controller' tag will have the remains like this:

Demo:
https://github.com/scruel/demo

"This is a springfox based project, not using spring-core for operation resolving, but its own mechanism. Please open a ticket there"
https://github.com/swagger-api/swagger-core/issues/3826

Seems like problem in next: in plugin, that set tags for operation from @Api annotation (SwaggerOperationTagsReader) there is a method:

It calls context.findControllerAnnotation(Api.class); that returns class annotation. But in plugin, that set tags for operation from @Tag annotation (OpenApiOperationTagsReader) there is method with same name, but it searches for @Tags / @Tag annotation only over a method neither a class

Oh, already fixed in #3402 c:


File tabs no longer visible after switching project without opening new window

Hello,
whenever I use shift-enter to open a project in the current window of atom, the file tabs and the "Project"-heading in the tree view go missing.
So the steps to reproduce should be:

Open atom
Switch to a project without opening a new window

Expected:
I can see the "Project"-heading in the tree view and the file tabs as soon as I open a file.
Actually:
I can't see the "Project"-heading in the tree view nor the file tabs as soon as I open a file.
Atom: 1.19.6
Electron: 1.6.9
OS: Windows 10 64-bit
Project-Manager: 3.3.5
Images:
Project view after switching to project in new window of atom:

Project view after switching project with shift-enter (no new window):

I'm experiencing the same issue on

Linux Mint 18
Atom 1.12.6
Project Manager 3.3.5

I have this issue too. While it would be great if it could be fixed, I have found a quite simple workaround. ( that works on my machine anyway). When I open a project and this happens (seems to happen if I haven't opened the project yet since booting up atom) I move back to the project I was in, which does have tabs, then back to the project which didn't show tabs and now it does.
So basically, it seems tabs are hidden the first time a project is opened (after a boot of atom) and switching out and back into the project will show the tabs as normal.
Atom: 1.20.0
project-manager: 3.3.5
OS: Ubuntu Gnome 17.04 64bit

#348

@balderclaassen i don't seems able to make your fix works.

open atom
switch to other project
tabbar & treeview header gone
switch back to previous project
tabbar & treeview still missing (?)

am i doing it wrong?

Well for me this happened when I was in a saved project, with proper tab bar. Then I went to an automatically detected git project(any project with a .git folder that you didn't add specifically), the tabbar was missing. I went back to my saved project, with the tab bar, and from now on, going to that particular git project worked too.
Maybe you are in a different situation though ?
A restart of Atom and Ctrl+Shift+P Projects manager "reload projects list" ( or something similar) might help as well.


ipsec,mtu: Modularize pkg/datapath/linux/ipsec

This PR modularizes the IPSec package. It does so by introducing a new type ipsec.Manager and moving the global variables into this type as fields. All package level functions that access or modify the fields are not methods on this manager struct.
The two IPSec related goroutines that watch the filesystem for updates to the key and cleaning up stale keys are now part of the Managers lifecycle. And all initialization work that happened in the daemon before now happens during Manager construction or its lifecycle hooks.
pkg/mtu is dependant on the ipsec package since the auth key size is part of the MTU calculation. Since this size can theoretically change after a key change, the MTU package will now always query the current auth key size from the IPSec manager.
Fixes: #23901
Modularized `pkg/datapath/linux/ipsec`

Unbeknownst to be there are some ongoing fixes for IPSec which need to be back ported, holding off this PR until that work is merged (1-2 weeks) after which I will rebase this PR on that work and re-undraft again. Sorry for the notifications folks.


join user's cards and sort users, by card's count.

hello
i have a usecase with this details:
a query on "User"s wich every users have many cards wich used by user.
question is here:
how can i sort user by his card's count.
and this is my current query...
final cardQuery = Query<Company>(context)
      ..where((x) => x.id).equalTo(companyId)
      ..join(set: (u) => u.user)
          .join(set: (c) => c.card);

You can not do that using the ORM at the moment and it would be a big undertaking for it to be implemented.
Also your query will be better described like that:
final cardQuery = Query<User>(context)
      ..where((u) => u.company).identifiedBy(companyId)
      //..join(object: (u) => u.company) uncomment this row only if you want the company to be returned by the query
      ..join(set: (u) => u.card);

You can not do that using the ORM at the moment and it would be a big undertaking for it to be implemented.
Also your query will be better described like that:
final cardQuery = Query<User>(context)
      ..where((u) => u.company).identifiedBy(companyId)
      //..join(object: (u) => u.company) uncomment this row only if you want the company to be returned by the query
      ..join(set: (u) => u.card);

thanks for fast answer.
i ask you for another help...
this is my current sorting progress:
final groupScores =
        groupBy(companyScores.user, (obj) => obj['card'].length);

    final List<UserScore> users = [];
    UserRank userRank;
    int companyRank = 1;
    groupScores.entries.map((entry) {
      entry.value.map((e) async {
        bool isOwner;
        if (userId == null)
          isOwner = false;
        else {
          isOwner = true;
        }
        users.add(UserScore(
            userId: e.id,
            username: e.username,
            score: e.card.length,
            productId: productId,
            isOwner: isOwner,
            companyRank: companyRank,));
        companyRank++;
      }).toList();
    }).toList();

    return users;

can you help me please for optimize that ?

thanks for fast answer.
i ask you for another help...
this is my current sorting progress:
final groupScores =
        groupBy(companyScores.user, (obj) => obj['card'].length);

    final List<UserScore> users = [];
    UserRank userRank;
    int companyRank = 1;
    groupScores.entries.map((entry) {
      entry.value.map((e) async {
        bool isOwner;
        if (userId == null)
          isOwner = false;
        else {
          isOwner = true;
        }
        users.add(UserScore(
            userId: e.id,
            username: e.username,
            score: e.card.length,
            productId: productId,
            isOwner: isOwner,
            companyRank: companyRank,));
        companyRank++;
      }).toList();
    }).toList();

    return users;

can you help me please for optimize that ?

This is if you don't want to include the company rank:
bool isOwner = userId != null;
companyScores.user.sort((u1, u2) => u1.card.length - u2.card.length);
return companyScores.user.map((user) => UserScore(
    userId: user.id,
    username: user.username,
    score: user.card.length,
    productId: productId,
    isOwner: isOwner,
    //company rank will be the the index in the newly create array
)).toList();

This is if you don't want to include the company rank:
bool isOwner = userId != null;
companyScores.user.sort((u1, u2) => u1.card.length - u2.card.length);
return companyScores.user.map((user) => UserScore(
    userId: user.id,
    username: user.username,
    score: user.card.length,
    productId: productId,
    isOwner: isOwner,
    //company rank will be the the index in the newly create array
)).toList();

This is if you want score:
bool isOwner = userId != null;
companyScores.user.sort((u1, u2) => u1.card.length - u2.card.length);
final userRank = <UserScore>[];
for(var i = 0; i < companyScores.user.length; ++i) {
  userRank.add(UserScore(
      userId: user.id,
      username: user.username,
      score: user.card.length,
      productId: productId,
      isOwner: isOwner,
      companyRank: i,
  ))
}
return userRank;

This is if you want score:
bool isOwner = userId != null;
companyScores.user.sort((u1, u2) => u1.card.length - u2.card.length);
final userRank = <UserScore>[];
for(var i = 0; i < companyScores.user.length; ++i) {
  userRank.add(UserScore(
      userId: user.id,
      username: user.username,
      score: user.card.length,
      productId: productId,
      isOwner: isOwner,
      companyRank: i,
  ))
}
return userRank;


Genome Comparison: need genome names in legends

As discussed before, we need to add genomes names as legend for the circular viewer in the genome comparison tool. Right now, there is no way for user to tell which track represents which genome!

It's fixed. The fix won't work for the old results. Please try again with a new comparison job.

It's fixed. The fix won't work for the old results. Please try again with a new comparison job.
From: "mshukla1"<EMAIL_ADDRESS>To: "PATRIC3/patric3_website"<EMAIL_ADDRESS>Cc: "Chunhong Mao"<EMAIL_ADDRESS>Sent: Wednesday, June 10, 2015 5:03:50 PM
Subject: Re: [patric3_website] Genome Comparison: need genome names in legends (#269)
Assigned #269 to @maovt .
—
Reply to this email directly or view it on GitHub .
--
Chunhong Mao, Ph. D.
Senior Project Associate
Virginia Bioinformatics Institute
Virginia Tech (0477)
1015 Life Science Circle
Blacksburg, VA 24061
Tel:<PHONE_NUMBER>
Fax:<PHONE_NUMBER>

Thanks, Chunhong. Suggestion for layout, two possible options:

If we have the genomes names listed on the left, like you have now, keep then left of the circle view side-by-side. So that, it doesn't push the circle all the way down, specially if I am comparing 8 genomes.

Or, print the genome names in paragraph mode, similar to the way we are displaying tracks in the genome circular viewer tab.

The layout suggestion is not critical, rather enhancement!


Allow for custom order of assays

Assays are currently ordered alphabetically which is sometimes not the best order. Worth thinking about if assay ordering should reflect the order defined in the ISA-tab i_Investigation.txt.

Agreeable idea, but which one would are you looking for? Customizable order or order based on the investigation file? Or default being the latter but with the ability to customize? :)

Pipe dream: Default as defined in the investigation file, customisable in SODAR. New order is then stored in the investigation file.


[CELEBORN-83][FOLLOWUP] Fix various bugs when using HDFS as storage.

[CELEBORN-83][FOLLOWUP] Fix various bugs when using HDFS as storage.
What changes were proposed in this pull request?
1.Fix class cast exception.
2.Fix clean hdfs expired app dir.
3.Fix npe when destroy file writers.
4.Adjust disk not usable log level.
5.Close hdfs output streams.
6.Change hdfs log level to reduce log size.
7.Add instructions for buffer size using HDFS.
8.Fix data loss when reading from HDFS.
Why are the changes needed?

What are the items that need reviewer attention?
Related issues.
Related pull requests.
How was this patch tested?
/cc @related-reviewer
/assign @main-reviewer

Ping @pan3793. How about now?


Behaviour of create/updade and overwrite flag

Add to the readme some note about how create/updade and overwrite flag work. (I keep forgetting, sorry)

Resolved w 39268fc


GridEditorBase without MasterDetails Relation

How to use GridEditorBase without masterdetail relation of foreign key
eg, if i want to hardcode the key it extension of GridEditorBase (to show list of entitities inline in other form)

Hi @djabeeryusuf ,
it is a bit difficult to understand what you want to achieve. Can you provide a quick mockup how the result should look like and what you want to filter how?
With kind regards,
John

Hi @djabeeryusuf ,
it is a bit difficult to understand what you want to achieve. Can you provide a quick mockup how the result should look like and what you want to filter how?
With kind regards,
John

Basically when we have Foreign key & Master-Details relation and when we use that with Grid editor base, it loads all records (eg data from events table based on that key), i don't want to define foreign key relation, rather want to load the records on grid-like this.
public getGriditems(){
items = "select * from events where departmentid=this.form.departmentid"
}


API for adding a VM to the plugin.

Is there a way to add a machine to the plug through the rest api?

nope, currently, you can only do this via UI


provide endpoints for service and admin interface upon successful package installation

As a way to simplify the package installation/usage workflow, it would be very useful to finish the installation process by providing endpoints for accessing the service itself (and the admin interface where applicable) to the end user. This way, end users wouldn't have to navigate inside DCOS or Marathon to look for port numbers or IP addresses of the nodes where executors are running.
Currently the output provided is:
$ dcos package install chronos
We recommend a minimum of one node with at least 1 CPU and 2GB of RAM available for the Chronos Service.
Continue installing? [yes/no] yes
Installing Marathon app for package [chronos] version [2.4.0]
Chronos DCOS Service has been successfully installed!

	Documentation: http://mesos.github.io/chronos
	Issues: https://github.com/mesos/chronos/issues

This request is to add to this output information along the lines of:
Chronos DCOS Service is listening for requests at http://node_x_address:8080
Chronos DCOS Admin interface is available at http://master_node/service/chronos

Right now if the package maintainer adds a postInstallNotes field to their package definition, those will be printed after installation.

@fernandosanchezmunoz anything more than postInstallNotes you'd like to see?

Talked with @fernandosanchezmunoz, closing.


Redirect HTTP to HTTPS

Currently HTTP is not automatically redirected to HTPS

Closed by #54 and #55


After verifying seed-phrase, user should not be redirected, instead "Go home" button should appear

LGTM


[CCXDEV-10204] pr_check.sh: enable ui tests

Description
Enable OCP Advisor UI tests for pull requests.
Type of change

Configuration update

Codecov Report
Base: 73.46% // Head: 73.46% // No change to project coverage :thumbsup:

Coverage data is based on head (e6c5f1a) compared to base (40f59aa).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##           master     #448   +/-   ##
=======================================
  Coverage   73.46%   73.46%
=======================================
  Files          11       11
  Lines         603      603
=======================================
  Hits          443      443
  Misses        135      135
  Partials       25       25

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

Random Travis failures, reported in CCXDEV-10215 - most of the time restart fxes CI.


Don't find package unofficial-nana

Severity	Code	Description	Project	File	Line	Suppression State
Error		CMake Error at src/CMakeLists.txt:9 (find_package):
Could not find a package configuration file provided by "unofficial-nana"
with any of the following names:
unofficial-nanaConfig.cmake
unofficial-nana-config.cmake

Add the installation prefix of "unofficial-nana" to CMAKE_PREFIX_PATH or
set "unofficial-nana_DIR" to a directory containing one of the above files.
If "unofficial-nana" provides a separate development package or SDK, be
sure it has been installed.

Try this
cmake_minimum_required(VERSION 3.10)
project(main)
add_executable(main main.cpp)
find_package(unofficial-nana CONFIG REQUIRED)
target_link_libraries(main PRIVATE unofficial::nana::nana)

This work only on windows, but on ubuntu 18.04 don't.

What is your error on Linux?

On Linux, you have to build nana as dynamic library (see #10078), then when you use it in your CMakeLists.txt, add
set(VCPKG_TARGET_TRIPLET "x64-linux-dynamic")

On Linux, you have to build nana as dynamic library (see #10078), then when you use it in your cmake project, run
cmake -DVCPKG_TARGET_TRIPLET=x64-linux-dynamic

I use Ubuntu 18.04 + gcc 7

CMake Warning at /home/test/vcpkg/scripts/buildsystems/vcpkg.cmake:126 (message):
There are no libraries installed for the Vcpkg triplet x64-linux-dynamic.
Call Stack (most recent call first):
/usr/share/cmake-3.10/Modules/CMakeDetermineSystem.cmake:94 (include)
CMakeLists.txt:11 (project)
-- The C compiler identification is GNU 7.4.0
-- The CXX compiler identification is GNU 7.4.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
CMake Error at /home/test/vcpkg/scripts/buildsystems/vcpkg.cmake:288 (_find_package):
Could not find a package configuration file provided by "unofficial-nana"
with any of the following names:
unofficial-nanaConfig.cmake
unofficial-nana-config.cmake

Add the installation prefix of "unofficial-nana" to CMAKE_PREFIX_PATH or
set "unofficial-nana_DIR" to a directory containing one of the above files.
If "unofficial-nana" provides a separate development package or SDK, be
sure it has been installed.
Call Stack (most recent call first):
CMakeLists.txt:18 (find_package)

test@lubuntu:~/vcpkg$ ./vcpkg list
bzip2:x64-linux                                    1.0.6-5          High-quality data compressor.
dirent:x64-linux                                   1.23.2           Dirent is a C/C++ programming interface that all...
expat:x64-linux                                    2.2.7            XML parser library written in C
fontconfig:x64-linux                               2.12.4-10        Library for configuring and customizing font acc...
freetype:x64-linux                                 2.10.1-5         A library to render fonts.
freetype[bzip2]:x64-linux                                           Support bzip2 compressed fonts.
freetype[png]:x64-linux                                             Support PNG compressed OpenType embedded bitmaps.
libiconv:x64-linux                                 1.16-1           GNU Unicode text conversion
libjpeg-turbo:x64-linux                            2.0.4            libjpeg-turbo is a JPEG image codec that uses SI...
libpng:x64-linux                                   1.6.37-6         libpng is a library implementing an interface fo...
zlib:x64-linux                                     1.2.11-6         A compression library

I use Ubuntu 18.04 + gcc 7

Lubuntu 18.04

cmake -DCMAKE_TOOLCHAIN_FILE=/home/test/vcpkg/scripts/buildsystems/vcpkg.cmake ..
-- The C compiler identification is GNU 7.4.0
-- The CXX compiler identification is GNU 7.4.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found Freetype: /home/test/vcpkg/installed/x64-linux/lib/libfreetype.a (found version "2.10.1")
-- Found ZLIB: /home/test/vcpkg/installed/x64-linux/debug/lib/libz.a (found version "1.2.11")
-- Found BZip2: /home/test/vcpkg/installed/x64-linux/lib/libbz2.a (found version "1.0.6")
-- Looking for BZ2_bzCompressInit
-- Looking for BZ2_bzCompressInit - found
-- Found PNG: /home/test/vcpkg/installed/x64-linux/debug/lib/libpng.a (found version "1.6.37")
-- Looking for XOpenDisplay in /usr/lib/x86_64-linux-gnu/libX11.so;/usr/lib/x86_64-linux-gnu/libXext.so
-- Looking for XOpenDisplay in /usr/lib/x86_64-linux-gnu/libX11.so;/usr/lib/x86_64-linux-gnu/libXext.so - found
-- Looking for gethostbyname
-- Looking for gethostbyname - found
-- Looking for connect
-- Looking for connect - found
-- Looking for remove
-- Looking for remove - found
-- Looking for shmat
-- Looking for shmat - found
-- Looking for IceConnectionNumber in ICE
-- Looking for IceConnectionNumber in ICE - found
-- Found X11: /usr/lib/x86_64-linux-gnu/libX11.so
-- Found JPEG: /home/test/vcpkg/installed/x64-linux/debug/lib/libjpeg.a
CMake Error at /home/test/vcpkg/installed/x64-linux/share/unofficial-nana/unofficial-nana-config.cmake:45 (target_link_libraries):
Cannot specify link libraries for target "unofficial::nana::nana" which is
not built by this project.
Call Stack (most recent call first):
/home/test/vcpkg/scripts/buildsystems/vcpkg.cmake:288 (_find_package)
CMakeLists.txt:18 (find_package)
-- Configuring incomplete, errors occurred!
See also "/home/test/Desktop/724942d43cd11c6ee5b3461ac067c846-e6e86199bd2e7151cd9608dd0719a69daa303243/build/CMakeFiles/CMakeOutput.log".
See also "/home/test/Desktop/724942d43cd11c6ee5b3461ac067c846-e6e86199bd2e7151cd9608dd0719a69daa303243/build/CMakeFiles/CMakeError.log".

https://mega.nz/#!G88iiQxS!f5DgGc44RV4yrlHZnrGwZlkuQ7Z3_RJjAEOAx1kjdKU
https://mega.nz/#!vps0jIBZ!d_6jaKA_KtfTbtycMfZwoDLmF0jLexF-6KCVkx7f_IM

@Darkcacok Did you install nana successfully on your Linux machine?

@Darkcacok Did you install nana successfully on your Linux machine?

Yes. I tried this on my machine and in clear virtual machine.

@Darkcacok Thanks for posting this issue. The version of cmake which is installed by Linux is low, you can use cmake which is installed by VCPKG. The command is:
VCPKG_PATH/downloads/tools/cmake-3.14.0-linux/cmake-3.14.0-Linux-x86_64/bin/cmake -DCMAKE_TOOLCHAIN_FILE=VCPKG_PATH/scripts/buildsystems/vcpkg.cmake CMakeLists.txt

@Darkcacok Thanks for posting this issue. The version of cmake which is installed by Linux is low, you can use cmake which is installed by VCPKG. The command is:
VCPKG_PATH/downloads/tools/cmake-3.14.0-linux/cmake-3.14.0-Linux-x86_64/bin/cmake -DCMAKE_TOOLCHAIN_FILE=VCPKG_PATH/scripts/buildsystems/vcpkg.cmake CMakeLists.txt
Thank you for your time. This is resolved using the new version of cmake.

But now I have another issue.
/home/maxim/Projects/vcpkg/scripts/buildsystems/vcpkg.cmake:186: error: Target "gui" links to target "PNG::PNG" but the target was not found. Perhaps a find_package() call is missing for an IMPORTED target, or an ALIAS target is missing? src/application/CMakeLists.txt:13 (add_executable)

Could you please provide the repro code?

https://gist.github.com/caiorss/724942d43cd11c6ee5b3461ac067c846
I replaced the cmake version with my own and the path to the toolchane.
This error occurs when this cmake file depends from another cmake file. For some reason cmake does not use libpng, which is downloaded using vcpkg.
When I compile this project separately, another error occurs. I think it is connected with the same.
/usr/bin/ld: /home/maxim/Projects/vcpkg/installed/x64-linux/lib/libfontconfig.a(fcfreetype.c.o): undefined reference to symbol 'FT_Get_Postscript_Name'
//usr/lib/x86_64-linux-gnu/libfreetype.so.6: error adding symbols: DSO missing from command line
collect2: error: ld returned 1 exit status
CMakeFiles/gui1.dir/build.make:103: recipe for target 'gui1' failed
make[2]: *** [gui1] Error 1
CMakeFiles/Makefile2:72: recipe for target 'CMakeFiles/gui1.dir/all' failed
make[1]: *** [CMakeFiles/gui1.dir/all] Error 2
Makefile:83: recipe for target 'all' failed
make: *** [all] Error 2

Please help me https://github.com/Darkcacok/vcpkg/pull/1

Sorry for the long delay.
It seems that the original issue has been solved.
Please open a new issue if you have other concerns @Darkcacok.


Add custom buckets to native histogram model

https://github.com/prometheus/prometheus/issues/13486

Aside from what you mentioned:

Used a new function clearIfNotNil to handle the conditional resize to 0, not sure if that's efficient enough
Previously we didn't check fields that are supposed to be unused in Equals. That doesn't matter for exponential schemas because customBounds are completely ignored even if defined, but for custom buckets schema, defining the fields that are not supposed to be used will cause issues by changing the returned buckets from the iterators. So tentatively I added a new commit check fields which are supposed to be unused but may affect results in equals to fix this, but I'm not sure if it's needed because those wrongly defined histograms will not pass validation. WDYT?
Expanded tests for equals and iterators
Fix maxSchemaAppender to ignore new custom buckets schema
Rename some things for consistency


Docker image loads and checks in but continuously restarts dump1090

LSUSB from host (raspiberrypi4 Ubuntu 19.10.01 arm64) Bus 001 Device 005: ID 0bda:2838 Realtek Semiconductor Corp. RTL2838 DVB-T
LSUSB from container: Bus 001 Device 005: ID 0bda:2838
[dump1090-fa] Wed Apr 22 10:15:16 2020 EDT dump1090-fa starting up.
[dump1090-fa] rtlsdr: using device #0: Generic RTL2832U OEM (Realtek, RTL2838UHIDIR, SN 00000001)
[dump1090-fa] Found Rafael Micro R820T tuner
[dump1090-fa] rtlsdr: enabling tuner AGC
[dump1090-fa] Allocating 4 zero-copy buffers
./run: line 48: 6369 Killed exec "${DUMP1090_BIN}" "${DUMP1090_CMD[@]}" 2>&1
6370 Done | awk '{print "[dump1090-fa] " $0}'
[dump1090-fa] Wed Apr 22 10:15:17 2020 EDT dump1090-fa starting up.
[dump1090-fa] rtlsdr: using device #0: Generic RTL2832U OEM (Realtek, RTL2838UHIDIR, SN 00000001)
[dump1090-fa] Found Rafael Micro R820T tuner
[dump1090-fa] rtlsdr: enabling tuner AGC
[dump1090-fa] Allocating 4 zero-copy buffers
./run: line 48: 6386 Killed exec "${DUMP1090_BIN}" "${DUMP1090_CMD[@]}" 2>&1
6387 Done | awk '{print "[dump1090-fa] " $0}'
[dump1090-fa] Wed Apr 22 10:15:18 2020 EDT dump1090-fa starting up.
[dump1090-fa] rtlsdr: using device #0: Generic RTL2832U OEM (Realtek, RTL2838UHIDIR, SN 00000001)
[dump1090-fa] Found Rafael Micro R820T tuner
[dump1090-fa] rtlsdr: enabling tuner AGC
[dump1090-fa] Allocating 4 zero-copy buffers
./run: line 48: 6403 Killed exec "${DUMP1090_BIN}" "${DUMP1090_CMD[@]}" 2>&1
6404 Done | awk '{print "[dump1090-fa] " $0}'
[dump1090-fa] Wed Apr 22 10:15:19 2020 EDT dump1090-fa starting up.
[dump1090-fa] rtlsdr: using device #0: Generic RTL2832U OEM (Realtek, RTL2838UHIDIR, SN 00000001)
[dump1090-fa] Found Rafael Micro R820T tuner
[dump1090-fa] rtlsdr: enabling tuner AGC
[dump1090-fa] Allocating 4 zero-copy buffers
./run: line 48: 6420 Killed exec "${DUMP1090_BIN}" "${DUMP1090_CMD[@]}" 2>&1
6421 Done | awk '{print "[dump1090-fa] " $0}'
[dump1090-fa] Wed Apr 22 10:15:20 2020 EDT dump1090-fa starting up.
[dump1090-fa] rtlsdr: using device #0: Generic RTL2832U OEM (Realtek, RTL2838UHIDIR, SN 00000001)
As you can see it restarts every second, i'm just not sure why
Here is the log from the start if it helps
[piaware] Connecting to FlightAware adept server at piaware.flightaware.com/1200
[piaware] Connection with adept server at piaware.flightaware.com/1200 established
[dump1090-fa] rtlsdr: enabling tuner AGC
[dump1090-fa] Allocating 4 zero-copy buffers
./run: line 48: 286 Killed exec "${DUMP1090_BIN}" "${DUMP1090_CMD[@]}" 2>&1
287 Done | awk '{print "[dump1090-fa] " $0}'
[piaware] TLS handshake with adept server at piaware.flightaware.com/1200 completed
[piaware] FlightAware server certificate validated
[piaware] encrypted session established with FlightAware
[dump1090-fa] Wed Apr 22 10:25:16 2020 EDT dump1090-fa starting up.
[dump1090-fa] rtlsdr: using device #0: Generic RTL2832U OEM (Realtek, RTL2838UHIDIR, SN 00000001)
[piaware] adept reported location: 44.06796, -69.52292, 103ft AMSL
[piaware] logged in to FlightAware as user tmonfiletto
[piaware] my feeder ID is Redacted
[piaware] site statistics URL: https://flightaware.com/adsb/stats/user/tmonfiletto#stats-71046
[piaware] multilateration data requested
[piaware] no ADS-B data program is serving on port 30005, not starting multilateration client yet
[dump1090-fa] Found Rafael Micro R820T tuner
[dump1090-fa] rtlsdr: enabling tuner AGC
[dump1090-fa] Allocating 4 zero-copy buffers
[piaware] ADS-B data program 'dump1090' is listening on port 30005, so far so good
[piaware] Starting faup1090: /usr/lib/piaware/helpers/faup1090 --net-bo-ipaddr localhost --net-bo-port 30005 --stdout --lat 44.068 --lon -69.523
[piaware] Started faup1090 (pid 317) to connect to dump1090
[piaware] UAT support disabled by local configuration setting: uat-receiver-type
./run: line 48: 308 Killed exec "${DUMP1090_BIN}" "${DUMP1090_CMD[@]}" 2>&1
309 Done | awk '{print "[dump1090-fa] " $0}'
[piaware] lost connection to dump1090 via faup1090
[piaware] faup1090 exited normally
[piaware] will reconnect to dump1090 in 30 seconds
[dump1090-fa] Wed Apr 22 10:25:17 2020 EDT dump1090-fa starting up.
[dump1090-fa] rtlsdr: using device #0: Generic RTL2832U OEM (Realtek, RTL2838UHIDIR, SN 00000001)
[dump1090-fa] Found Rafael Micro R820T tuner
[dump1090-fa] rtlsdr: enabling tuner AGC
[dump1090-fa] Allocating 4 zero-copy buffers
./run: line 48: 328 Killed exec "${DUMP1090_BIN}" "${DUMP1090_CMD[@]}" 2>&1
329 Done | awk '{print "[dump1090-fa] " $0}'
[dump1090-fa] Wed Apr 22 10:25:18 2020 EDT dump1090-fa starting up.
[dump1090-fa] rtlsdr: using device #0: Generic RTL2832U OEM (Realtek, RTL2838UHIDIR, SN 00000001)
[dump1090-fa] Found Rafael Micro R820T tuner
[dump1090-fa] rtlsdr: enabling tuner AGC
[dump1090-fa] Allocating 4 zero-copy buffers
./run: line 48: 345 Killed exec "${DUMP1090_BIN}" "${DUMP1090_CMD[@]}" 2>&1
346 Done | awk '{print "[dump1090-fa] " $0}'
[dump1090-fa] Wed Apr 22 10:25:19 2020 EDT dump1090-fa starting up.
[dump1090-fa] rtlsdr: using device #0: Generic RTL2832U OEM (Realtek, RTL2838UHIDIR, SN 00000001)

Here is the output from my usb-devices, is it blacklisted properly?
T:  Bus=01 Lev=03 Prnt=03 Port=03 Cnt=02 Dev#=  5 Spd=480 MxCh= 0
D:  Ver= 2.00 Cls=00(>ifc ) Sub=00 Prot=00 MxPS=64 #Cfgs=  1
P:  Vendor=0bda ProdID=2838 Rev=01.00
S:  Manufacturer=Realtek
S:  Product=RTL2838UHIDIR
S:  SerialNumber=00000001
C:  #Ifs= 2 Cfg#= 1 Atr=80 MxPwr=500mA
I:  If#=0x0 Alt= 0 #EPs= 1 Cls=ff(vend.) Sub=ff Prot=ff Driver=usbfs
I:  If#=0x1 Alt= 0 #EPs= 0 Cls=ff(vend.) Sub=ff Prot=ff Driver=(none)

I pulled your other image
mikenye/piaware:latest-rtlsdr-v0.5.3
That seems better, its not just rebooting anymore
[piaware] mlat-client(279): Reconnecting in 30.0 seconds
[piaware] mlat-client(279): Beast-format results connection with <IP_ADDRESS>:30104: connection established
[piaware] mlat-client(279): Input connected to localhost:30005
[piaware] mlat-client(279): Input format changed to BEAST, 12MHz clock
[piaware] 0 msgs recv'd from dump1090; 0 msgs sent to FlightAware
[piaware] ADS-B data program 'dump1090' is listening on port 30005, so far so good
[piaware] Starting faup1090: /usr/lib/piaware/helpers/faup1090 --net-bo-ipaddr localhost --net-bo-port 30005 --stdout --lat 44.068 --lon -69.523
[piaware] Started faup1090 (pid 302) to connect to dump1090
[piaware] piaware received a message from dump1090!
[piaware] piaware has successfully sent several msgs to FlightAware!

You can mark this as resolved once you take a look at it, i'll pull any further information you need but as of now its working great with the updated image

Hi @tmonfiletto, sorry for the delay in responding to you - my day job has been quite busy.
This looks like it may be related to issue #15. There seems to be an incompatibility between rtlsdr version 0.6.0 and the RTL2838UHIDIR. For now, the fix is to use the image you found (tagged with -rtlsdr-v0.5.3).
I will find the time to open an issue with the maintainers of rtlsdr to see if they're able to fix this.
Thanks for getting in touch!


cr: fix infinite loop when a previous resolution didn't include all rmOps

resolutionOps may delete entire directory trees but only include the top-most rmOp.  This means that another resolution may encounter a node that has been deleted, without its parent having any listed ops in the merged chain.  In that case, avoid an infinite loop since we don't actually need to remove the corresponding rmOps from the merged chain (since there are none).
Will track separate issues for the other issues this exposes:

the previous resolution should probably contain all rmOps (KBFS-1424)
rmOps shouldn't cause the parent directories to be recreated (KBFS-1423)

Issue: KBFS-1357

Bleh, need to fix osxfuse test for some reason.  I think it's still worth reviewing though.

Cool, the osxfuse tests are now fixed.  Review with abandon,

lgtm


adding @sap-ux/cf-deploy-config-inquirer

https://github.com/SAP/open-ux-tools/issues/2450
Added cf-deploy-config-inquirer, which will be used CF deployment flows to support the following prompts;

A prompt will request the destination name.
If enabled, a prompt will ask whether to add a managed application router.
If enabled, a prompt will confirm if the user wants to overwrite any existing configuration.

check whether an entry in the codeowners also needs to be added


Running subjects in parallel with --write-graph flag can lead to a conflict

Hi,
I was running fmriprep via singularity on an HTConder cluster 21 subjects in parallel with this command:
# SUB is a placeholder that was filled at runtime
PYTHONPATH="" singularity run -H /home/data/foraging
/home/data/foraging/code/poldracklab_fmriprep_1.0.8-2018-02-23-e5a227027e57.img
/home/data/foraging/ /home/data/foraging/scratch/fmriPrep participant
 --participant-label SUB
-w /home/data/foraging/scratch/tmp_work
--output-space T1w fsaverage5 template
--use-syn-sdc --low-mem --nthreads 1 --ignore slicetiming fieldmaps
--write-graph
--fs-license-file /home/data/foraging/license.txt

It worked fine for all but 2 participants. For those two, fmriprep crashed with this error message:
Traceback (most recent call last):
  File "/usr/local/miniconda/bin/fmriprep", line 11, in <module>
    load_entry_point('fmriprep==1.0.8', 'console_scripts', 'fmriprep')()
  File "/usr/local/miniconda/lib/python3.6/site-packages/fmriprep/cli/run.py", line 259, in main
    fmriprep_wf.write_graph(graph2use="colored", format='svg', simple_form=True)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/pipeline/engine/workflows.py", line 438, in write_graph
    outfname = format_dot(dotfilename, format=format)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/pipeline/engine/utils.py", line 1313, in format_dot
    formatted_dot, _ = _run_dot(dotfilename, format_ext=format)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/pipeline/engine/utils.py", line 1330, in _run_dot
    resource_monitor=False).run()
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/interfaces/base/core.py", line 516, in run
    runtime = self._run_interface(runtime)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/interfaces/base/core.py", line 1023, in _run_interface
    self.raise_exception(runtime)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/interfaces/base/core.py", line 960, in raise_exception
    ).format(**runtime.dictcopy()))
RuntimeError: Command:
dot -Tsvg -o"/home/data/foraging/scratch/tmp_work/fmriprep_wf/graph.svg" "/home/data/foraging/scratch/tmp_work/fmriprep_wf/graph.dot"
Standard output:

Standard error:
Error: /home/data/foraging/scratch/tmp_work/fmriprep_wf/graph.dot: syntax error in line 5639 near 'led'
Return code: 1

When re-running both subjects again (in parallel), one worked fine, the other one crashed. And when re-running the last one once again, it worked also fine for this subject.
Not sure what the problem was, but could it be some sort of conflict when two different runs are trying to access. graph.dot at the same time?

Yes, writing the graph will occur in the common work directory. I see three options:

Run each subject with a separate work/scratch directory. This will cause little issue, as there is very little common computation.
Write graphs only for one subject. These graphs can be very large, so graphing multiple subjects' workflows will probably add more clutter than clarity.
Run all of your subjects with the same work directory and no --write-graph, and then run a final fmriprep for all subjects with --write-graph. This should re-use all of your data, so you won't be recomputing, but it may take some time, as large workflows require time to verify inputs/outputs of each node.


Apply all record list filters on export all records option

Currently only the prefilter and query are applied on record export in record list.

We should apply all filters that are active on record list when exporting.
Make sure that selecting records on all pages works as expected
Adjust date range filter to use same logic as record list filters to ensure consistency
UI/UX improvements

CL added


SSIS job with Connected Service SalesForce failes to build

Reproduction:
Environment: VS2015 with SSDT 2015.
steps:

Existing SSIS project.
Create Script component by dragging from toolbox onto Data flow.
Edit the Script component to open VSTA.  Leave script component empty to confirm project builds correctly.
Edit Script component again, and from solution explorer right click references, add connected service, select Salesforce Data Services and use gui to complete configuration.

Output window shows:
[8/11/2017 9:58:17.075 AM] Adding Salesforce Data Services to the project.
[8/11/2017 9:58:17.122 AM] Creating the connected app within Salesforce.
[8/11/2017 9:58:19.657 AM] Adding settings to the project's config file.
[8/11/2017 9:58:20.029 AM] Installing NuGet package 'Newtonsoft.Json' version 6.0.5.
[8/11/2017 9:58:20.044 AM] Installing NuGet package 'Microsoft.Net.Http' version 2.2.29.
[8/11/2017 9:58:20.057 AM] Installing NuGet package 'Microsoft.Bcl.Build' version 1.0.21.
[8/11/2017 9:58:20.077 AM] Installing NuGet package 'Microsoft.Bcl.Async' version 1.0.168.
[8/11/2017 9:58:20.086 AM] Installing NuGet package 'Microsoft.Bcl' version 1.1.10.
[8/11/2017 9:58:20.117 AM] Installing NuGet package 'DeveloperForce.Force' version 1.0.1.
[8/11/2017 9:58:25.943 AM] Adding assembly references to the project.
[8/11/2017 9:58:25.982 AM] Adding reference to System.Configuration.
[8/11/2017 9:58:26.175 AM] Adding reference to System.Web.
[8/11/2017 9:58:26.383 AM] Adding reference to System.ComponentModel.DataAnnotations.
[8/11/2017 9:58:26.631 AM] Adding scaffold code files to the project.
[8/11/2017 9:58:27.096 AM] Building the object model for the Salesforce objects.
[8/11/2017 9:58:27.632 AM] Adding scaffold model files for Salesforce objects (2).
[8/11/2017 9:58:28.527 AM] Successfully added Salesforce Data Services to the project.
Now build project and it will fail with following message:
This project references NuGet package(s) that are missing on this computer. Use NuGet Package Restore to download them.  For more information, see http://go.microsoft.com/fwlink/?LinkID=322105. The missing file is ..\packages\Microsoft.Bcl.Build.1.0.21\build\Microsoft.Bcl.Build.targets.	SC_0f2d9e9f1b4640abadb80f707dabca73	C:\Users\mnorma001\AppData\Local\Temp\Vsta\SSIS_SC130\VstaX0fcWUINrE__XlaR35dDGPg\VstajyZUR2A6REWwiTJ__r48PNA\SC_0f2d9e9f1b4640abadb80f707dabca73.csproj	140

If this is still an issue (see latest updates to code) please re-open with more specifics.


Use new PHP 7.1 features

Coverage remained the same at 84.783% when pulling 427d238d29748e310b0258d8cbe9105c96ce3d94 on feature/php71 into 6ab249577c5d0bcaad75259cd11dee8a73aa8db7 on develop.


San Juan Basin unable to access Download Site

Describe the bug
San Juan Basin is unable to access the download site.
From Sender "Hello, When I log into this link (https://reportstream.cdc.gov/ ), and click on “daily data” I keep getting this error message"
Additional context

Solved by https://app.zenhub.com/workspaces/experience-607d9d5e68b95200150fec37/issues/cdcgov/prime-reportstream/5509

5/20: Notified STLT of the fix and asked for their review.

User confirmed they have access now.


Refresh Docker image

Use node-red-contrib-model-asset-exchange @0.2.8
Fix version numbers for other dependencies
Upgrade Node-Red

Changes delivered in #9.
Docker image published on https://hub.docker.com/r/codait/max-node-red-demo


Annual x-series markers misrepresent start of the annum

Bug report
Codepen
CodePen.

Annual x-series markers (e.g. 2013, 2014, 2015, ...) should demarcate the start of that year.

What is happening instead?
The annum marker appears in October, 10 months after the start of the year.

This bug was fixed in this commit while #1478  was fixed.
Let's keep the issue open until the next patch version is released and close it after testing.

@junedchhipa Good idea. I'll test it as soon as it's released!

Confirmed this is fixed in 3.19.2.


Request of a dependency is an expression

Hey there!
There's some funky code in lib/main.js:
  sodium_mod = "sod" + "ium";

  try {
    nacl_c = require(sodium_mod).api;
  } catch (_error) {
    e = _error;
  }

This causes webpack to throw a warning, which some users of kbpgp are experiencing (https://github.com/keybase/kbpgp/issues/157).
Could this be updated to just require "sodium"?  It will make the lib more webpack friendly.

I think we needed this hack to get around browserify including the module.

Should be fixed, reopen if not.

@maxtaco Thanks for taking a look!  Unfortunately since sodium is saved as a devDependency, npm / yarn will not install it, leading webpack to still throw errors 😞 .
This dependency was not found:

* sodium in ./node_modules/keybase-nacl/lib/main.js

To install it, you can run: npm install --save sodium

Should I open a new issue, or can this one be re-opened?

I'm not a webpack user, so what is the right approach?  The idea is that we should fallback to tweetnacl if we don't have sodium installed. And in fact, you can only run sodium on desktop node, it won't work in the browser.

@maxtaco Sorry for the delay in the response!
I do not think there is a straightforward solution here, as the following three are incompatible (according to my understanding of Webpack):

The goal of this package is to use node's sodium if it is installed, and tweet-nacl otherwise.
Webpack throws a warning if a package is required that is not in dependencies
Installing sodium as a dependency breaks browsers

Unfortunately this warning makes the kbpgp library unusable with Webpack unless the user is OK with the warnings.  It may be worth adding a note to the README's.

What a conundrum!  Well, we're willing to accept PRs, however you think we should go.

http://npm.github.io/using-pkgs-docs/package-json/types/optionaldependencies.html
I think this is the best bet - mark it as optional and try catch.  Will PR if this seems reasonable!

yes, great!
On Fri, Mar 1, 2019 at 11:23 AM Josh Stabback<EMAIL_ADDRESS>wrote:

http://npm.github.io/using-pkgs-docs/package-json/types/optionaldependencies.html
I think this is the best bet - mark it as optional and try catch. Will PR
if this seems reasonable!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/keybase/node-nacl/issues/5#issuecomment-468722181,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA05_7d9y2HQV_gDbp-lybkJIvDH6Z2nks5vSVP9gaJpZM4a09o7
.


[FEATURE] Provide specific classLoader for Partition operation

Describe the feature
There is no specific catalog classLoader for partition operation, if there is a partition operation need to use Thread.currentThread().getContextClassLoader() to get classLoader, it will get WebAppClassLoader, and this will cause ClassNotFoundException

Motivation
No response
Describe the solution
Provide specific classLoader for Partition operation
Additional context
No response

Can you provide more details and additional stacks?

Like iceberg partition operation, it will get current thread classLoader to operate

Iceberg catalog related class are loaded by IsolatedClassloader, so it seems that the class loader can't be WebAppClassLoader.

@mchades also agree that the partition operation need to be separate, you can ask him for details, if community decide to do it, please assign it for me

@TEOTEO520 ,  thanks for reportings this bug, does hive work well for partition operations?

@TEOTEO520 , thanks for reporting this issue, does hive work well for partition operations?

Yes, but when hive do the operation of partition, it also use WebAppClassLoader, I'm confused it does work well


Adding a flag whether to save checkpoint or not after the training in…

… run_lora_clm.py
What does this PR do?

Fixes # (issue)
Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you make sure to update the documentation with your changes?
[ ] Did you write any new necessary tests?

https://github.com/huggingface/optimum-habana/pull/711


Train homography module

Hi,
I'm confused about the homography regression module.
In the net, there are 2 modules which are feature extraction and homography regression modules.
In the train_dhe.py file, the training model part, only do the feature extraction operation, so as I understanding,
the homography regression module are not trained, right?
If so, how to use the homography regression module to predict the homography matrix?
Thanks for your time.

Sorry, I missed to read some codes.


The right way to submit job on Yarn

I can't find any yarn example so try myself.  I submit a job of image-classification in example via this command.
../dmlc-core/tracker/dmlc-submit \
     --cluster yarn \
     --queue root.default \
     --num-workers 1 \
     --num-servers 1 \
     --worker-cores 1 \
     --worker-memory 1g \
     --server-cores 4 \
     --server-memory 1g \
     --ship-libcxx /lib64/ \
     --hdfs-tempdir /tmp \
     --jobname img-classification \
     --archives mxnet.tar \
     --archives python27.tar \
     --archives image-classification.tar \
     ./run.sh

mxnet.tar contains
mxnet/python/mxnet
libmxnet.so [copyed to the directory before]

image-classification.tar contains
mxnet/example/image-classification

run.sh is
#!/usr/bin/env bash
export PATH=./python27/bin:${PATH}
cd ./image-classification && python2.7 train_mnist.py --network lenet --kv-store dist_sync

But I encounter a problem
tar: You must specify one of the `-Acdtrux' or `--test-label'  options
Try `tar --help' or `tar --usage' for more information.
tar: You must specify one of the `-Acdtrux' or `--test-label'  options
Try `tar --help' or `tar --usage' for more information.
tar: You must specify one of the `-Acdtrux' or `--test-label'  options
Try `tar --help' or `tar --usage' for more information.
./run.sh: line 3: cd: ./image-classification: No such file or directory

tar -xf  is executed in dmlc-core/tracker/dmlc_tracker/launcher.py.
So my question is:

Is this the right way to submit a yarn job?
What's the problem of tar -xf?

Thanks.
@tqchen @piiswrong

fixed


Government Design Systems

TODO

[x] Identify scope
[x] Identify research questions
[ ] Conduct research
[ ] Synthesize findings
[ ] Share findings with team
[ ] Share with Platform management

Outcomes

Understanding how other governments have managed and implemented their design systems

Deliverables

A 1-pager comparing different government design system models

Estimated Effort

[ ] XS: 1 to 2 hours
[ ] S: half a day
[ ] M: 1-2 day
[x] L: 1 week
[ ] XL: Move to an epic

Out of scope

Examining other government design systems from a design or development perspective
Policy recommendations

Comparative Analysis

Working Document


Logs are been sent as a batch once in 10 minutes

I couldn't find the way to set the time interval definition.
In grafana I can see the logs arriving each 10 minutes. Their 'parsed timestamp' is almost identical because of that,
is there any way to set to the time interval value?

@isabr85 The Loki SeriLog sink sits on top of the Http Sink so you'll need to configure how often logs are shipped in there.

@JosephWoodward I briefly looked at LokiSinkExtensions and it doesn't seem like you're exposing any way of configuring the settings that the Http Sink supports such as batchPostingLimit, period, etc.

Default HttpSink period is 2 seconds, it gets bigger if more than the last request has failed.

First of all thank you for this @JosephWoodward. However even we are running into exact same problem raised by @augustoproiete, where in initially I could see the logs in Grafana Loki almost real time (for initial couple of minutes) but after that it is taking ~10mins to  get updated with later timestamp. Also I checked the code and given LokiHttp implements IHttpClient (and not derive from HttpSink/PeriodicBatchingSink) I am not sure how we can configure batchPostingLimit/period using  LoggerSinkConfigurationExtensions

First of all thank you for this @JosephWoodward. However even we are running into exact same problem raised by @augustoproiete, where in initially I could see the logs in Grafana Loki almost real time (for initial couple of minutes) but after that it is taking ~10mins to get updated with later timestamp. Also couldn't find any option to configure batchPostingLimit, period, etc.

Use https://github.com/adeotek/Serilog.Sinks.GrafanaLoki
https://www.nuget.org/packages/Serilog.Sinks.GrafanaLoki/


update RGUI bitmap font

I modified the Korean alphabet to make it look clearer.
The English text was revised to a wider width of 2 pixels.

@jdgleaver
The font was manually modified by using the pixel font editor.
I modified about 2,000 Korean characters. and
The width of English characters is increased to match the Korean letters.

@jdgleaver
The font was manually modified by using the pixel font editor.
I modified about 2,000 Korean characters. and
The width of English characters is increased to match the Korean letters.

@trngaje Oh wow! These new fonts look fantastic. This must have taken many hours. Thank you for this excellent work!
@twinaphex This is a huge improvement - please merge :)

@trngaje Oh wow! These new fonts look fantastic. This must have taken many hours. Thank you for this excellent work!
@twinaphex This is a huge improvement - please merge :)

@jdgleaver
i made russian 10x10 bitmap font.
bitmap10x10_rus.zip
the range of letters : 0x400~0x45f
However, "Видео "sentences are always displayed on the right side of the retroarch menu.
I think I need to modify some of the retroarch codes, but I don't know where to correct them.

@jdgleaver
i made russian 10x10 bitmap font.
bitmap10x10_rus.zip
the range of letters : 0x400~0x45f
However, "Видео "sentences are always displayed on the right side of the retroarch menu.
I think I need to modify some of the retroarch codes, but I don't know where to correct them.

@trngaje This is incredible! Your Russian font is superb!
Yes, that Видео text is wrong. I looked at the code, and it seems that intl/msg_hash_ru.c is unfinished. With the following changes, it works correctly:
diff --git a/intl/msg_hash_ru.c b/intl/msg_hash_ru.c
index 8ceb3cf9c1..9ba66acba5 100644
--- a/intl/msg_hash_ru.c
+++ b/intl/msg_hash_ru.c
@@ -12,10 +12,15 @@
  *  You should have received a copy of the GNU General Public License along with RetroArch.
  *  If not, see <http://www.gnu.org/licenses/>.
  */
+#include <stdio.h>
 #include <stdint.h>
-#include <string.h>
+#include <stddef.h>
+
+#include <compat/strl.h>
+#include <string/stdstring.h>

 #include "../msg_hash.h"
+#include "../verbosity.h"

 #if defined(_MSC_VER) && !defined(_XBOX) && (_MSC_VER >= 1500 && _MSC_VER < 1900)
 #if (_MSC_VER >= 1700)
@@ -40,12 +45,51 @@ int msg_hash_get_help_ru_enum(enum msg_hash_enums msg, char *s, size_t len)
    return ret;
 }

+#ifdef HAVE_MENU
+static const char *menu_hash_to_str_ru_label_enum(enum msg_hash_enums msg)
+{
+   if (msg <= MENU_ENUM_LABEL_INPUT_HOTKEY_BIND_END &&
+         msg >= MENU_ENUM_LABEL_INPUT_HOTKEY_BIND_BEGIN)
+   {
+      static char hotkey_lbl[128] = {0};
+      unsigned idx = msg - MENU_ENUM_LABEL_INPUT_HOTKEY_BIND_BEGIN;
+      snprintf(hotkey_lbl, sizeof(hotkey_lbl), "input_hotkey_binds_%d", idx);
+      return hotkey_lbl;
+   }
+
+   switch (msg)
+   {
+#include "msg_hash_lbl.h"
+      default:
+#if 0
+         RARCH_LOG("Unimplemented: [%d]\n", msg);
+#endif
+         break;
+   }
+
+   return "null";
+}
+#endif
+
 const char *msg_hash_to_str_ru(enum msg_hash_enums msg)
 {
+#ifdef HAVE_MENU
+   const char *ret = menu_hash_to_str_ru_label_enum(msg);
+
+   if (ret && !string_is_equal(ret, "null"))
+      return ret;
+#endif
+
    switch (msg)
    {
 #include "msg_hash_ru.h"
       default:
+#if 0
+         RARCH_LOG("Unimplemented: [%d]\n", msg);
+         {
+            RARCH_LOG("[%d] : %s\n", msg - 1, msg_hash_to_str(((enum msg_hash_enums)(msg - 1))));
+         }
+#endif
          break;
    }

@trngaje This is incredible! Your Russian font is superb!
Yes, that Видео text is wrong. I looked at the code, and it seems that intl/msg_hash_ru.c is unfinished. With the following changes, it works correctly:
diff --git a/intl/msg_hash_ru.c b/intl/msg_hash_ru.c
index 8ceb3cf9c1..9ba66acba5 100644
--- a/intl/msg_hash_ru.c
+++ b/intl/msg_hash_ru.c
@@ -12,10 +12,15 @@
  *  You should have received a copy of the GNU General Public License along with RetroArch.
  *  If not, see <http://www.gnu.org/licenses/>.
  */
+#include <stdio.h>
 #include <stdint.h>
-#include <string.h>
+#include <stddef.h>
+
+#include <compat/strl.h>
+#include <string/stdstring.h>

 #include "../msg_hash.h"
+#include "../verbosity.h"

 #if defined(_MSC_VER) && !defined(_XBOX) && (_MSC_VER >= 1500 && _MSC_VER < 1900)
 #if (_MSC_VER >= 1700)
@@ -40,12 +45,51 @@ int msg_hash_get_help_ru_enum(enum msg_hash_enums msg, char *s, size_t len)
    return ret;
 }

+#ifdef HAVE_MENU
+static const char *menu_hash_to_str_ru_label_enum(enum msg_hash_enums msg)
+{
+   if (msg <= MENU_ENUM_LABEL_INPUT_HOTKEY_BIND_END &&
+         msg >= MENU_ENUM_LABEL_INPUT_HOTKEY_BIND_BEGIN)
+   {
+      static char hotkey_lbl[128] = {0};
+      unsigned idx = msg - MENU_ENUM_LABEL_INPUT_HOTKEY_BIND_BEGIN;
+      snprintf(hotkey_lbl, sizeof(hotkey_lbl), "input_hotkey_binds_%d", idx);
+      return hotkey_lbl;
+   }
+
+   switch (msg)
+   {
+#include "msg_hash_lbl.h"
+      default:
+#if 0
+         RARCH_LOG("Unimplemented: [%d]\n", msg);
+#endif
+         break;
+   }
+
+   return "null";
+}
+#endif
+
 const char *msg_hash_to_str_ru(enum msg_hash_enums msg)
 {
+#ifdef HAVE_MENU
+   const char *ret = menu_hash_to_str_ru_label_enum(msg);
+
+   if (ret && !string_is_equal(ret, "null"))
+      return ret;
+#endif
+
    switch (msg)
    {
 #include "msg_hash_ru.h"
       default:
+#if 0
+         RARCH_LOG("Unimplemented: [%d]\n", msg);
+         {
+            RARCH_LOG("[%d] : %s\n", msg - 1, msg_hash_to_str(((enum msg_hash_enums)(msg - 1))));
+         }
+#endif
          break;
    }

@jdgleaver
I checked that the code you sent works well.
Please apply it directly to RetroArch when you have time.
I don't like some of the Cyrillic fonts which I created, so I'm going to googling and correct them appropriately.
Some of the Cyrillic letters are used in Russian, some in Ukrainian, and I'm only familiar with some Russian, so it's not easy to modify all of them.

@jdgleaver
I checked that the code you sent works well.
Please apply it directly to RetroArch when you have time.
I don't like some of the Cyrillic fonts which I created, so I'm going to googling and correct them appropriately.
Some of the Cyrillic letters are used in Russian, some in Ukrainian, and I'm only familiar with some Russian, so it's not easy to modify all of them.

Yes, certainly - I should be able to PR the code changes later today.

I don't like some of the Cyrillic fonts which I created, so I'm going to googling and correct them appropriately.

Thank you for your dedication - I look forward to any improvements :)
If you think it might take a while to update the font, would you be willing to add your current version to this PR? Just so we can have something in place for when the code gets merged? You could then submit your final version of the font in a follow-up PR.

Yes, certainly - I should be able to PR the code changes later today.

I don't like some of the Cyrillic fonts which I created, so I'm going to googling and correct them appropriately.

Thank you for your dedication - I look forward to any improvements :)
If you think it might take a while to update the font, would you be willing to add your current version to this PR? Just so we can have something in place for when the code gets merged? You could then submit your final version of the font in a follow-up PR.

@jdgleaver

If you think it might take a while to update the font, would you be willing to add your current version to this PR?
Currently, there is no problem with Russian, so I added a file to the PR. It was only identified that the letter was being used in other countries. If I need another modification, I'll create a new PR.

@jdgleaver

If you think it might take a while to update the font, would you be willing to add your current version to this PR?
Currently, there is no problem with Russian, so I added a file to the PR. It was only identified that the letter was being used in other countries. If I need another modification, I'll create a new PR.

Ah, I understand!
Okay - thank you very much for adding the file.

Ah, I understand!
Okay - thank you very much for adding the file.

@trngaje The RetroArch changes have been merged: https://github.com/libretro/RetroArch/pull/11870
Thank you again for your continued work on this!

@trngaje The RetroArch changes have been merged: https://github.com/libretro/RetroArch/pull/11870
Thank you again for your continued work on this!

I'm the one who made the Korean font "Galmuri" used here. However, the Korean font applied to the RetroArch RGUI looks distorted as if "Galmuri11" font was forcibly reduced in size. Galmuri also supports 9x9 size (excluding margins), so it will look good if you apply it...

한국분이 시군요..
멋진 폰트 제작해 주셔서 감사합니다.
호기심으로 적용해 봤는데, 이렇게 폰트제작 하신 분에게 연락이 와서 감동이네요.. 최대한 폰트 원저작 표기는 해놓았습니다만..
처음 8x8 폰트를 적용했었고.. CJK 폰트를 모두 적용하기에는 부족함이 느껴져서 10x10 으로 올렸습니다 물론 갈무리 폰트의
9x9, 11x11 이겠네요..
폰트 초보자의 느낌으로 깨진 픽셀은 수정을 했지만.. retroarch rgui 구조상 영어와 한글 글자 폭을 다르게 가져갈 수 없어서..
적절한 수준으로 영어 폭을 옆으로 늘렸습니다..
아래는 초기  8x8 사이즈로 구현했던 화면 입니다.
rgui 메뉴에 한글 표시를 하기 위한 첫 도전이었으며 아직도 만족하지 못하는 상태입니다. 폰트 제작자의 의견을 받아 들여 개선을 해보도록 노력하겠습니다.
truetype 폰트를 그대로 사용할 수 없는 구조라 bitmap 으로 변경하는 과정에서 초보적인 오류가 발생합니다.
가변 폭 폰트를 사용할 수 있게 한다면 좀더 자유롭게 9x9, 11x11 폰트를 있는 그대로 적용을 할 수 있을 듯 합니다.
다시한번 관심을 갖어 주어 감사드립니다. 저에겐 힘이되니까요.
You're Korean.
Thank you for making a great font.
I applied it out of curiosity, but I'm touched to hear from the font maker. I tried to mark the original font as much as possible.
I applied 8x8 font for the first time. I thought it wasn't enough to apply all CJK fonts, so I raised it to 10x10. Of course,
It's probably 9x9, 11x11 of your galmuri fonts.
I fixed the broken pixels like a beginner in font... Due to the retroarchrgui structure, the width of English and Korean characters cannot be taken differently.
I extended the width of the English to the same size of korean font.
Below is the screen implemented in the initial 8x8 size.
-----Original Message-----
From: "Lee @.>
To: @.>;
Cc: @.>; @.>;
Sent: 2021-12-25 (토) 03:07:36 (GMT+09:00)
Subject: Re: [libretro/retroarch-assets] update RGUI bitmap font (#400)
I'm the one who made the Korean font "Galmuri" used here. However, the Korean font applied to the RetroArch RGUI looks distorted as if "Galmuri11" font was forcibly reduced in size. Galmuri also supports 9x9 size (excluding margins), so it will look good if you apply it...
—
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.
You are receiving this because you were mentioned.Message ID: @.***>

@trngaje 그러셨군요 ㄷㄷ
갈무리의 리포지토리를 확인하시면 트루타입이 아닌 BDF 폰트도 올려져 있는데 이것도 필요하시면 참고하실 수 있을 것 같습니다.
여담이지만 갈무리9,11의 숫자는 여백을 제외한 크기의 픽셀 수를 뜻하는 거라서 보통 갈무리9는 10, 갈무리11은 12픽셀이라고 이해하시면 됩니다.
If you check the repository, BDF fonts are uploaded, so you can refer to it if necessary.
And since the numbers Galmuri9 and 11 refer to the number of pixels of the size excluding the margin, you can usually take Galmuri9 as 10 and Galmuri11 as 12 pixels size.

Greetings, @trngaje . @DisasterMo in the main RA repo is getting ready to add Ukrainian to the localizations available for RetroArch (here: https://github.com/libretro/RetroArch/pull/13490 ), and we were wondering if the Russian Cyrillic table is both complete and includes the two extra characteres required for Ukrainian. Can you confirm us this data?
Also, some of the other existing languages would be in need of a Latin-2 extended set as well. Would you be available for these sort of edits?


opt support all syntax to avoid fallback in multi-statement query

run buildall

run buildall

run buildall

run feut


Fix counter leak

I'm not sure about the names of the stats now that we have a new state.
Other than that, looks good.


Scheduling of a seperate SD meeting

To avoid a lengthy written discussion on Discord, the software developers agree on a one-time additional meeting to reach some fundamental decisions regarding the tech stack.

@AnnaH3003 I think this is the wrong repository.

@AnnaH3003 I think this is the wrong repository.

Thanks, I didn't realize!


⚠ Bofrost.be has degraded performance

In 6de447a, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 2130 ms

Resolved: Bofrost.be performance has improved in 0575d32.


Add ENV.cxx14 and option :cxx14

Needed for the new glibmm update, which makes every dependent formula c++14 as well...

We may want to do something like this
diff --git a/Library/Homebrew/shims/super/cc b/Library/Homebrew/shims/super/cc
index 14dc058..e50fab8 100755
--- a/Library/Homebrew/shims/super/cc
+++ b/Library/Homebrew/shims/super/cc
@@ -204,6 +204,8 @@ class Cmd
       val  = chuzzle($1) || enum.next
       path = canonical_path(val)
       args << "-L#{val}" if keep?(path) && @lset.add?(path)
+    when /^-std=c\+\+11/
+      args << arg unless cxx14?
     else
       args << arg
     end

and the converse. But it won't help unless args are being refurbished.

Which versions of Clang support this? I looked and couldn't see it scoped for them. I wonder if there's a way to make this implicit/automatic instead; the CXX11 approach has been a bit messy.

Well, in order for this to happen automatically, one would need to analyze the code and look for features from C++11, C++14 etc, which seems undesirable to me.
clang supports C++14 fully since 3.4

Well, in order for this to happen automatically, one would need to analyze the code and look for features from C++11, C++14 etc, which seems undesirable to me.

I guess my question would be: what if this flag was passed unconditionally on supported compilers?

I am not entirely sure there is guaranteed ABI compatibility between libraries compiled with c++11 and pre-c++11 standards. I am seeing posts on stackoverflow.com where people strongly recommend that all libraries within a project should be compiled with the same standard to avoid trouble. But this will be troublesome when dealing with third party closed-source libraries.
I wonder why was option :cxx11 ever added to Homebrew? At the very least it suggests that not everybody likes there software to be C++11...
Your suggestion also implies that every package containing C++ code needs to get recompiled and rebottled. This would keep Jenkins busy for a really long time...
@fxcoudert Would you mind chiming in here? I am confident your opinion is more valuable than mine 😄

I guess my question would be: what if this flag was passed unconditionally on supported compilers?

We'd almost certainly need an opt-out in that case since not all formulae are actually able to use ENV.cxx11 for setting c++11 (I'm looking at you boost), and the same will be true for c++14.

And ENV.no_cxx14 is about as clear as mud.

For GCC, there is ABI compatibility between pre-C++11, C++11 and C++14 modes. Any ABI incompatibility — there were some in the past — reported will be treated as a bug and fixed.
Regarding clang, I cannot find any statement that this is true nor untrue. However, nothing in the C++11 or C++14 standard actually requires any ABI change, and I guess they would shoot themselves in the foot if they had done so: people frequently compile libraries with different levels of C++ coding. But we could ask for explicit clarification of their position on the matter.

ABI compatibility will likely be much less an issue than behind the scenes magic that causes build failures.

I guess my question would be: what if this flag was passed unconditionally on supported compilers?

There are some backward compatible changes in both C++11 (e.g., auto as a storage class specifier) and C++14 (e.g., constexpr), so passing the flag unconditionally could break programs.

One approach would be to not have a DSL for ENV.cxx14, and do -std=c++14 where needed manually, until we figure out exactly how/if we want to unwind the ENV.cxx11 stuff first.
Are we going to have a ENV.no_cxx11 to aid the transition to new c+11-default-everywhere magic? If not, how are we going to deal with the inevitable compile failures?

I guess my question would be: what if this flag was passed unconditionally on supported compilers?

To clarify here on what I actually meant (apologies for 👶 ⛔ 💤): let's not ever have a CXX14 option but instead enable it automatically when needed.

That will cause build failures without an opt out.

By the way, the need for a C++14 flag is gone for now as an update for glibmm was released yesterday, removing the C++14 specific code.

@ilovezfs I agree. Basically I'm 👍 to ENV.cxx14 and 👎 to option cxx14.

Yeah given #2482 option :cxx14 is kind of pointless.


Add locale Address format support

...in Address toString method and add two new methods getAddressLine1() + getAddressLine2() that gives the address formated according to the locale.
English
println address.toString()
11 Ford Street APT 313
San Francisco 28664

println address.addressLine1()
52 Stillwell Avenue

println address.addressLine1()
Washington 23519

Polish
println address.toString()
Szulborska 11
91-528 Cedzyna

println address.addressLine1()
Patriotów 37

println address.addressLine1()
51-977 Srem

Swedish
println address.toString()
Götgatan 73
528 66 Kristianstad

println address.addressLine1()
Norra Agnegatan 120

println address.addressLine1()
235 19 Örnsköldsvik

Spanish
println address.toString()
Vieja, 39 327
33.915 Cáceres

println address.addressLine1()
Doctor Esquerdo, 96 278

println address.addressLine1()
86.125 Orense

Coverage decreased (-2.1%) to 88.781% when pulling e70f91b882f23b8aad569edcadc803013892e976 on andidev:add-locale-address-support into 338c5c7f9c93735a9acb7b0b4aab1c118668c752 on Codearte:master.

Coverage increased (+0.7%) to 91.602% when pulling 33ab52ff50d28a7add6cbe509b57911df7257496 on andidev:add-locale-address-support into 338c5c7f9c93735a9acb7b0b4aab1c118668c752 on Codearte:master.

Closing issue #11

@andidev Thanks for this PR. Looks good :)
Please fix the test method names - some tests for Address Providers other than SV contain "SV" in their method names instead of the appropriate country tags.

@OlgaMaciaszek
Remarks should be fixed now

Coverage increased (+0.7%) to 91.602% when pulling 5b41670bb54218a7488cbb1ba21fa023535d70f3 on andidev:add-locale-address-support into 688d087945c9b027abe8612f93a41629be0b4323 on Codearte:master.

Looks good @andidev :).
Merging.


Storage Write API functionality doesn't work - UNKNOWN: failed to find stream

What happened?
I'm trying to implement a very simple PoC using Storage Write API and test it using the emulator (v0.6.3), but I keep getting this error:
com.google.api.gax.rpc.UnknownException: io.grpc.StatusRuntimeException: UNKNOWN: failed to find stream from projects/test-project/datasets/local-bigquery/tables/local-table/_default
Enabling the debug level doesn't help to find the root cause, container logs have nothing suspicious.
Actual code that uses Storage Write API:
        JSONArray rowContentArray = new JSONArray();
        JSONObject rowContent;
        rowContent = new JSONObject();

        rowContent.put("timestamp", DateTimeFormatter.ISO_INSTANT.format(Instant.ofEpochMilli(timestamp).atOffset(ZoneOffset.UTC)));
        rowContent.put("id", deviceIdentifier);
        rowContent.put("json", objectMapper.writeValueAsString(json));
        rowContent.put("partition", partition);

        rowContentArray.put(rowContent);

        TableSchema tableSchema = TableSchema.newBuilder()
                .addFields(TableFieldSchema.newBuilder()
                        .setName("id")
                        .setType(TableFieldSchema.Type.STRING)
                        .setMode(TableFieldSchema.Mode.NULLABLE)
                        .build())
                .addFields(TableFieldSchema.newBuilder()
                        .setName("timestamp")
                        .setType(TableFieldSchema.Type.TIMESTAMP)
                        .setMode(TableFieldSchema.Mode.NULLABLE)
                        .build())
                .addFields(TableFieldSchema.newBuilder()
                        .setName("json")
                        .setType(TableFieldSchema.Type.JSON)
                        .setMode(TableFieldSchema.Mode.NULLABLE)
                        .build())
                .addFields(TableFieldSchema.newBuilder()
                        .setName("partition")
                        .setType(TableFieldSchema.Type.INT64)
                        .setMode(TableFieldSchema.Mode.NULLABLE)
                        .build())
                .build();

                        BigQueryWriteSettings settings = BigQueryWriteSettings.newBuilder()
                .setEndpoint(properties.getGrpcHost())
                .setCredentialsProvider(NoCredentialsProvider.create())
                .setTransportChannelProvider(
                        EnhancedBigQueryReadStubSettings.defaultGrpcTransportProviderBuilder()
                                .setChannelConfigurator(ManagedChannelBuilder::usePlaintext)
                                .build()
                )
                .build();

        bigQueryWriteClient = BigQueryWriteClient.create(settings);
        writer = JsonStreamWriter.newBuilder(parentTable.toString(), tableSchema, bigQueryWriteClient)
                .setExecutorProvider(FixedExecutorProvider.create(Executors.newScheduledThreadPool(100)))
                .setChannelProvider(BigQueryWriteSettings.defaultGrpcTransportProviderBuilder()
                        .setKeepAliveTime(org.threeten.bp.Duration.ofMinutes(1))
                        .setKeepAliveTimeout(org.threeten.bp.Duration.ofMinutes(1))
                        .setKeepAliveWithoutCalls(true)
                        .setChannelsPerCpu(2)
                        .build())
                .setEnableConnectionPool(true)
                .setRetrySettings(retrySettings)
                .build()

        ApiFuture<AppendRowsResponse> future = writer.append(rowContentArray);

BTW the emulator works fine when using older insertAll API.
I would appreciate any help in understanding the root cause and how I can troubleshoot the problem.
What did you expect to happen?
The integration test should run successfully
How can we reproduce it (as minimally and precisely as possible)?
This is a sample project demonstrating the issue:
https://github.com/tarasrng/big-query-emulator-write
Test run command (requires Java 21 installed):
./mvnw clean install
Anything else we need to know?
Actual code:
https://github.com/tarasrng/big-query-emulator-write/blob/main/src/main/java/org/example/bigqueryemulatorwrite/repository/BigQueryRepository.java
Table schema creation:
https://github.com/tarasrng/big-query-emulator-write/blob/main/src/main/java/org/example/bigqueryemulatorwrite/repository/migration/SchemaCreator.java
Emulator config:
https://github.com/tarasrng/big-query-emulator-write/blob/main/src/main/java/org/example/bigqueryemulatorwrite/config/BigQueryEmulatorConfig.java
Test:
https://github.com/tarasrng/big-query-emulator-write/blob/main/src/test/java/org/example/bigqueryemulatorwrite/BigQueryEmulatorWriteApplicationTests.java

We are having the same issue. We would very much appreciate this functionlity.

having same error. is this means we need to explicitly create the stream first?


Wrong flag for Swedish

Shold be 🇸🇪

Hi @jackbillstrom, this issue was fixed in the recent version v1.0.3 (https://github.com/sanjevirau/gsubs/releases/tag/v1.0.3). Please download and install it, thanks.


Heroku deployment instructions out of date

Description
Currently, the instructions state to set heroku config:set NPM_CONFIG_PRODUCTION=false in order to allow the installation of devDependencies. This is no longer needed (see https://devcenter.heroku.com/changelog-items/1376), and allows for the app to run in development mode, serving a huge bundle & consuming a lot of memory.
Instead, the documentation should just advise changing the npm start script to point to the production run command, or adding a procfile that runs npm run start:production
Steps to reproduce
Steps to reproduce the behavior:
Follow the current deploment guide. It should occur with the sample starter app.
Expected behavior
Heroku serves a production build
Screenshots
N/A
Versions

React-Boilerplate: 3.7.0
Node/NPM: Any version
Browser: Any browser

Closing because fixed in #2520


"extensions" property not documented

I am currently trying to build a devcontainer to test a GitHub feature (fingers crossed), and want to specifically install extensions. Unfortunately, it does not seem like the extensions property - which is even used in this org - is documented in the specification.
Is this expected, since devcontainers are theoretically agnostic of the editor? Or is this documentation just missing?

This is covered under "tool specific properties."  The original extensions property was recently moved under customizations(see #1) but the old location is still there for backwards compatibility.
https://containers.dev/supporting#visual-studio-code

Yeah, it's a bit strange but it works well enough.