Todist integration issue - markdown text included in TE description

OS version: Windows 10
Browser version: Chrome <IP_ADDRESS>
Extension version: 3.0.0

Relevant integration (if any):
Todist
🐛 Describe the bug
When tracking is initiated on a task that is comprised of a markdown link, the tracking entry contains the full markdown text. The preferred behavior would be only the title. See attached image.

Expected behaviour
Markdown text shouldn't be in the description
Other details or context
Slack thread 🔗

intercom case


range returns numbers in descending order if from is greater than to

R.range(5, 1);    //=> [5, 4, 3, 2]

Clojure's range works similar.

@scott-christopher Done

This looks good to me. :mushroom:

http://fr.umio.us/ranging-near-and-far

Nice read :+1:

To create [5, 4, 3, 2], I'd prefer to require R.reverse(R.range(2, 6)) than allow R.range(5, 1). Assuming one knows that R.range(0, 3) evaluates to [0, 1, 2], one knows the value to which R.range(2, 6) will evaluate and the reverse of that value.
There are three values to which R.range(5, 1) could evaluate: [5, 4, 3, 2], [4, 3, 2, 1], and [].
I don't think R.range(0, n) should create an incrementing range in some cases and a decrementing range in others. Reversing a range as a separate step seems fine to me, but if this is unacceptable for some reason I'd prefer to define R.rangeDec for creating decrementing ranges.

I don't have such an issue with supporting both incrementing and decrementing sequences in range, however it seems like I'm in the minority.
Perhaps we could look at including something similar to Haskells enumFromThenTo to support this instead; something like:
//:: Int -- from: Inclusive start of sequence
//-> Int -- then: Next step in sequence
//-> Int -- to:   Inclusive end of sequence
//-> [Int]
fromThenTo = (from, then, to) => {
  const step = then - from;
  const inBounds = step > 0 ? R.lte : R.gte;
  const result = [from];
  if (from === then) {
    return result;
  }
  if ((from < then && to < from) || (from > then && to > from)) {
    return [];
  }
  for (let next = then; inBounds(next, to); next = next + step) {
    result.push(next);
  }
  return result;
};

fromThenTo(1, 2, 10); // [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]
fromThenTo(2, 4, 10); // [2, 4, 6, 8, 10]
fromThenTo(1, 3, 10); // [1, 3, 5, 7, 9]
fromThenTo(2, 2, 10); // [2]
fromThenTo(2, 1, 10); // []

That would leave range to operate as a simple incrementing function to use where the extra complexity isn't needed.

I like the idea of defining R.fromThenTo and leaving R.range as is. :)

@niloy: I would not have a big concern with having reversed ranges as well as forward ranges.  It does not seem to a great deal of significant conceptual complexity to the function.  This concerns me less than adding steps.  But I would only want to do it if there is a real need, as it clearly does add some.
So if you want to argue for it, please feel free.  I might argue back.  Or I might not.  :smile:
@scott-christopher:  I do use range, but almost exclusively as range(0, n) or range(1, n+ 1).  Of course my example was easy to hard-code, but the point should be clear too for the equivalent of R.map(n => 2400 - 3 * n, R.range(0, 687)), which you we probably wouldn't want to hard-code.  But let's not worry about enumFromThenTo unless there's a real demand for it.

@CrossEye: But let's not worry about enumFromThenTo unless there's a real demand for it.

I've added a rangeStep function to the cookbook for anyone who may be interested in the future.

I've added a rangeStep function to the cookbook for anyone who may be interested in the future.

Perfect.  Perhaps @raine can tell us how to update the TOC.

I use a script where the critical part is:
doctoc --title '## Recipes' Cookbook.md

Do you think we could add it to package.json/scripts?

I added it to the ramda.wiki.git repo. Only owners have push access to wiki repos though.

oh, ok.  Didn't even know we had that repo.  :blush:

Yeah, every wiki on Github has its own repo which basically consists of markdown files.

Yeah, every wiki on Github has its own repo which basically consists of markdown files.

TIL

@CrossEye Yeh, reversed ranges are required every once in a while, since its implementation is trivial, it would be cool if Ramda supported it out-of-the box :smiley: .

We discussed this on Gitter.
Although I'm happy to hear an updated PR, I'm still not convinced that the increased complexity of the API is worth it, when compose(reverse, range) serves perfectly well.  I'd still like to hear the arguments for the other side of it.  Mine are mostly made at http://fr.umio.us/ranging-near-and-far.

Just a note: if range allowed descending sequences, I'd expect the law range(a, b) == reverse(range(b, a)) to hold. Or more accurately, I'd assume it holds knowing that's a mistake and trip myself up somewhere.

@jackfirth:
That's a good point.  While that would be a useful law, it's also likely that we'd want to assert that range is inclusive in the first parameter and exclusive in the second.  Obviously these conflict.

i still prefer keeping range as is and composing with reverse when desired. Current range implementation is simple; let's keep it that way.

i still prefer keeping range as is and composing with reverse when desired. Current range implementation is simple; let's keep it that way.

:+1:

:+1:


.html remains at end of reference note card links (in NextJS) and breaks links

Please select the area your Bug applys to. (Multiple selections are Possible)

[ ] Onboard. Initial vault setup and import/export pods
[ ] Create. Note creation, lookup, snippets and templates
[ ] Retrieve. Backlinks, references, graph view
[ ] Structure. Refactoring, multi-vault and schemas
[ x] Publish. Sharing your repo with the world
[ ] Misc (Choose this if your not sure)

Describe the bug

the ![] type reference links, on the published cards, the "Go to text ->" link retains .html at the end, breaking the link
this is happening on https://wiki-next.dendron.so/ also

To Reproduce
Steps to reproduce the behavior:

go to a ![] type reference card link (in NextJS)
click the "go to text" link
see that it has .html at the end of it

Expected behavior

no .html at the end of the link

Screenshots
Desktop (please complete the following information)
Additional context
Dendron Log file
Please attach the output of >Dev:Dendron: Open Logs here

this has been fixed in 0.60.2-alpha.0. run the following to get the latest CLI
$ npm install @dendronhq/dendron-cli@latest

$ npx dendron --version
0.60.2-alpha.0


How to debug a remote C# Service?

Is there any way to debug a remote c# service? I use installutil.exe to install it. Thanks.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4a2fd746-82f7-1bac-9932-27c14cdfe0ca
Version Independent ID: 46b43a94-b750-2073-5e28-82183af092a9
Content
Content Source
Service: unspecified

@HuAaron Did you have the source code, or do you have the debugging symbols (.pdb files) generated when the service was built? You would need those, and they would need to match the .exe (i.e, they'd need to be from the same build). If you have those, you should be able to attach to the process using the debugger (Debug > Attach to Process) while the service is running.

Closing - product support issue

test


refactor: remove cancel method as it no longer exists

:tada: This PR is included in version 4.0.0-alpha.7 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 4.0.0-beta.1 :tada:
The release is available on:

npm package (@beta dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Template error messages can be unintuitive

Template errors become confusing very quickly. Example:
let render =

%   [1; 2; 3] |> List.map (fun n -> (

<%i n %>

%   ))

As a beginner, I expect this to work, because the OCaml code is 'returning' the generated HTML. But I get an error:
Error: This expression has type unit but an expression was expected of type
         int list

Okay, so I begin to understand that these control flow statement need to be unit (I'm not sure if this is in the documentation, but it probably should be). So I try
let render =

%   ([1; 2; 3] |> List.map (fun n -> (

<%i n %>

%   )));

But still an error:
Error: This expression has type unit list
       but an expression was expected of type unit
       because it is in the left-hand side of a sequence

(forgive me if I'm wrong about this) but I don't intuitively see how this is a unit list and not unit. Finally, this works:
let render =

%   ([1; 2; 3] |> List.map (fun n -> (

<%i n %>

%   ))) |> ignore;

I think this templating system is very powerful, but that comes at a certain cost -- it takes some messing with to get right. I think that the more that Dream can help point the developer in the right direction here, the better.

I'll add to the documentation to try to make some of this clearer.
The core issue in this particular case is:

(forgive me if I'm wrong about this) but I don't intuitively see how this is a unit list and not unit.

You should use List.iter and not List.map. You would have had the same error message
Error: This expression has type unit list
       but an expression was expected of type unit
       because it is in the left-hand side of a sequence

anywhere in OCaml outside the templating system, in any context that expected unit, and you used List.map instead of List.iter. By using List.map, you are "converting" each integer to (), and making a list [(); (); ()], so it is a unit list. If you used List.iter, you would just have the program iterate over the list, returning no new list and just () after the iteration.
This is shown in some examples
https://github.com/aantron/dream/blob/ae3b5d24d35a77c79d718228b1c415ba7db4c6af/example/h-sql/sql.eml.ml#L25-L26
but, indeed, the documentation should both make it clearer that things should end with ; and return unit, and show an example with List.iter very early on to "guide" readers in that direction. #87 is related.


docs: update accent color

Pull Request Checklist

[x] New code has 100% test coverage
[x] (If applicable) The prose documentation has been updated to reflect the changes introduced by this PR
[x] (If applicable) The reference documentation has been updated to reflect the changes introduced by this PR
[x] Pre-Commit Checks were ran and passed
[x] Tests were ran and passed

Description
Change documentation purple color to red color according to https://shibuya.lepture.com/customisation/colors/

Thanks for the PR!
I haven't had time to update to the new format, so I think it should be pinned to shibuya==2023.10.26 to keep the branding of https://github.com/jolt-org/advanced-alchemy/blob/c318394c157790016a645eceee9b7a8cc2207096/docs/conf.py#L117-L171.
Or I could merge this and bite the bullet and update 😅 I'm a bit behind on it

We arent yet ready to move to the new version until we can figure out how to update from the latest breaking changes to radix based colors
It would be nice to use branding colors to maintain the current look of https://docs.advanced-alchemy.jolt.rs

Thanks @lepture im actually going to close this.
All the repos in this org are moving into the @litestar-org](https://github.com/litestar-org/). I'd like your advise though on the work in https://github.com/litestar-org/litestar-sphinx-theme/pull/15 to use it as our global theme for v3 if you wouldn't mind checking? A bunch of the issues /question made in shibuya repo are related to that move


Calling a C++ method from qml and passing an enum value as argument

Hi, thanks for the tutorial. Unfortunately I can't make it work.
I try to call a C++ method from qml like this
appSettings.setBool(SettingsBool.Notifications, checked)

SettingsBool is the enum, similar to your example. It gives the following error:
Error: Unknown method parameter type: SettingsBool::Value

setBool looks like this:
void setBool(SettingsBool::Value key, bool value);

I didn't do the typedef because I didn't mind making it slightly more verbose.
Is it possible to do what I'm trying to do?

It seems like the typedef does the trick... So it's not just for nicer syntax but it is actually required.


Wrong function name in URLs in "Test the function" section

Most of the URLs have the wrong function name as part of the URL in the code examples in "Test the function". The function was named "HttpTrigger" when created earlier, but it is now referred to as "MyHttpTrigger" in the curl command given, for example. Copy&pasting that line to bash and changing only the app name does not produce the expected result. Furthermore, the screen capture of the browser window shows a third function name "myfunction".

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4a509bdc-f8b8-8488-7ab4-2c03cae6bfb5
Version Independent ID: 3174a893-394c-c622-6c96-0b89955edfb5
Content: Create your first Python function in Azure
Content Source: articles/azure-functions/functions-create-first-function-python.md
Service: functions
GitHub Login: @ggailey777
Microsoft Alias: glenga

Hi @bitpilot Thank you for reporting this issue! We will review and make any necessary changes.

@mike-urnun-msft can you please change the service label to azure-functions/svc? Thanks!

@mike-urnun-msft I wonder why the functions/svc label got added back?

@ggailey777 Merger bot keeps adding it back on. if there aren't dependencies on it, I'll look for ways to remove it since we track based on azure-functions/svc.


Added conditional for initial_lifecycle_hook parameter

This PR is a followup for #38
Kudos to @robh007 and @ALLFIVE

v2.9.0 has been released


Error when building on Buildower virtual machine

Using the latest Buildozer virtual machin (20), when building app using:
$ buildozer android_new debug deploy run logcat
I got an error. After setting log_level on 2 in buildozer.spec, found out it was:
<myfloder>/tmp-src/org/kivy/android/PythonService.java:108: error: multi-catch statement is not supported in -source 1.5
    [javac]             } catch (NoSuchMethodException | IllegalAccessException |

https://github.com/kivy/buildozer/issues/625
https://github.com/kivy/python-for-android/issues/1200
https://github.com/kivy/python-for-android/issues/1212


ListenerContainerWithDlqAndRetryCustomizer template points to localhost:9092

@sidsamant commented on Tue Mar 29 2022
Hi,
I am using following dependencies
spring-cloud-stream: 3.21
spring-cloud-stream-binder-kafka: 3.21
spring-kafka: 2.8.2

To forward deserialization errors to DLQ, I added the following bean:
	@Bean
	ListenerContainerWithDlqAndRetryCustomizer cust(KafkaTemplate<?, ?> template) {
		return new ListenerContainerWithDlqAndRetryCustomizer() {
			@Override
			public void configure(AbstractMessageListenerContainer<?, ?> container, String destinationName,
					String group,
					BiFunction<ConsumerRecord<?, ?>, Exception, org.apache.kafka.common.TopicPartition> dlqDestinationResolver,
					BackOff backOff) {
				ConsumerRecordRecoverer dlpr = new DeadLetterPublishingRecoverer(template, dlqDestinationResolver);
				container.setCommonErrorHandler(new DefaultErrorHandler(dlpr, backOff==null? new FixedBackOff(0L, 1L):backOff));
			}
                        ......
		};
	}

I have the following configuration in application.yml
spring.cloud:
    schemaRegistryClient:
      endpoint: .....
    stream:
      default:
        consumer:
          maxAttempts: 1
      function:
        definition: myDataConsumer
      bindings:
        myDataConsumer-in-0:
          destination: input-topic
          ....
        myDataConsumer-output:
          destination: output-topic
          ...
      kafka:
        default:
          consumer:
            useNativeDecoding: true
            enableDlq: true
            dlqName: dlq-topic
        bindings:
          myDataConsumer-in-0:
            consumer:
                ...
        binder:
          brokers: "broker1Url,broker2Url"
          producer-properties:
               ...

When the application runs and if there are Deserialization errors, it tries to produce to non-existent  localhost:9092 instead of the brokers in the config.
What am I missing?
Thanks in advance

@garyrussell commented on Tue Mar 29 2022
You are wiring in Boot's auto-configured KafkaTemplate. Boot knows nothing about binders or binder configuration; it uses the normal Boot spring.kafka.... properties when configuring that template.
https://docs.spring.io/spring-boot/docs/current/reference/html/application-properties.html#application-properties.integration.spring.kafka.bootstrap-servers

@sidsamant commented on Tue Mar 29 2022
Thanks @garyrussell .
It worked on configuring the spring.kafka properties as you mentioned.
I assumed it would pick the server settings from the binder configuration based on
https://github.com/spring-cloud/spring-cloud-stream-binder-kafka/blob/main/docs/src/main/asciidoc/overview.adoc#retry-and-dead-letter-processing

@garyrussell commented on Tue Mar 29 2022
Reopening; we should improve that documentation.

This issue is addressed via https://github.com/spring-cloud/spring-cloud-stream/pull/2344.


Color opacity field and hex value disappear if opacity is set to 0%

Bug Description
Color opacity field and hex value disappear if opacity is set to 0%
Expected Behaviour

Add a shape
Change the opacity under Style in the design panel to 0%
Expect the opacity to change to 0%

Steps to Reproduce

Add a shape
Change the opacity under Style in the design panel to 0%
Observe that the hex value has disappeared along with the opacity textfield.

Same result if you change opacity to zero inside the color picker.
Screenshots

Additional Context

Plugin Version:
Operating System:
Browser:

Do not alter or remove anything below. The following sections will be managed by moderators only.
Acceptance Criteria

Implementation Brief

@barklund I think you‘ve filed this already?

Yes, duplicate of https://github.com/google/web-stories-wp/issues/5369


GeoJSON layer features not receiving dblclick event

Features added via GeoJSON layer are not receiving dblclick events.
I have tried binding the listener both via onEachFeature and pointToLayer (for point feature markers.)
In neither case do I get the dblclick event.  All other events (at least click, mouseover, contextmenu, etc) work as expected.
The map receives dblclick events, as do markers added directly to the map.
using 1.0.0 rc1
tested with
Chrome Version 46.0.2490.71 (64-bit)
Safari Version 9.1.1 (11601.6.17)
Firefox Version 47.0.1
on
Mac OSX 10.11.5

Can you publish a fiddle/codepen/playground that displays this behaviour?

The simple case playground seems to work for all versions.
http://playground-leaflet.rhcloud.com/lit/1/edit?html,console,output
However, running my page from my local machine, and trying 1.0-Beta-2, 1.0-rc.1 from the cdn, and the latest snapshot from amazonws, only the latest snapshot works properly.  Below is console log output.  For the rc and beta versions, the dblclick event goes through to the map.
Not sure what to make of it, other than if it's working in the latest snapshot, I presume that will be in the final release.  I guess I'd close this unless you would like to investigate further.

Navigated to http://localhost:8188/tcast/tws/pages/event/o46s80
1.0.0-rc.1+26df85e
retrieved IFs
mouseover:Ponce
leaflet.js:5 'webkitMovementX' is deprecated. Please use 'movementX' instead.
leaflet.js:5 'webkitMovementY' is deprecated. Please use 'movementY' instead.
1 click
2 click
marker dblclick Ponce
onFeature dblclick:Ponce
Navigated to http://localhost:8188/tcast/tws/pages/event/o46s80
1.0.0-rc.1
retrieved IFs
mouseover:Ponce
leaflet.js:5 'webkitMovementX' is deprecated. Please use 'movementX' instead.
leaflet.js:5 'webkitMovementY' is deprecated. Please use 'movementY' instead.
1 click
map dblclick
Navigated to http://localhost:8188/tcast/tws/pages/event/o46s80
1.0.0-beta.2
retrieved IFs
mouseover:Ponce
leaflet.js:5 'webkitMovementX' is deprecated. Please use 'movementX' instead.
leaflet.js:5 'webkitMovementY' is deprecated. Please use 'movementY' instead.
1 click
map dblclick

Unless we can reproduce it, I'll be tempted to think that something on your code is responsible for the issue you have.
I'm keeping the issue open for a while so you can investigate more and try to find a way to reproduce it in the playground.
But keep in mind we need that to start investigating ourselves.

Closing this for now, since I don't see that we have any information we can take action on.
Happy to re-open if we get information on how to reproduce this!


Rename to esp-idf-template

Depends on #3 and #4.
The rename is necessary so as:

The name becomes shorter
The name becomes aligned with all esp-idf-* crates in esp-rs
The "STD" part is dropped, as we'll support no_std against ESP-IDF even if a bit questionable benefit
Gains "-idf" to distinguish from a potential new esp32-template that might be out bare-metal story

@mabezdev ^^^

Done. Once #3 is fixed, I'll ask around how folks feel about moving this into the esp-rs org.


metrics: implement Sketch aggregator

Spec: https://github.com/jmacd/opentelemetry-specification/blob/jmacd/draft_metric_sdk_spec/specification/sdk-metric.md#L242
Go impl: https://github.com/open-telemetry/opentelemetry-go/blob/master/sdk/metric/aggregator/ddsketch/ddsketch.go
The go implementation use https://github.com/DataDog/sketches-go to do the actual math, sadly no implementation exists currently in JS or TS so we'll need to write one

The spec has been updated to list different algorithm that we can use for this:

Example algorithms that could be used to implement this aggregator are include: GK-Sketch, DDSketch, Q-Digest, T-Digest, and HDR-Histogram

Fortunaly, HDR-Histogram have a pure typescript implementation available there https://github.com/HdrHistogram/HdrHistogramJS so we can use that

I don't have much time to work on this so i prefer to de-assign myself. However from the initial work i've done, extracting the code from the library i've mentionned above is quite complex so i would in favor to add it as a dependency. Another solution is to re-write any of the above algorithms

Closing as the feature has been removed in the spec.


Singular API Bug on 2.1.3

Describe the bug
Utilizing 2.1.3 I am unable to add Singular as an Connection/Instance.
I am receiving this line "TypeError: Cannot read property 'fields' of undefined"
However, I am able to add my Singular API URL on 2.1.2
To Reproduce
Attempt to add a Singular connection/instance and then enter the Singular API URL into the text field using Companion 2.1.3. Companion will return "TypeError: Cannot read property 'fields' of undefined"
Expected behavior
I expect to see an "OK" when adding Singular API on 2.1.3
Screenshots
N.A
Desktop (please complete the following information):

OS: [Windows]
Browser [Chrome]
Companion Version [e.g. 2.1.3]

Additional context
N.A

Hey @fredrikmediaa Just a heads up, I am currently using Singular for a show, and I noticed that this bug still exist in v2.1.4.


Skip pattern check for merge commits

Commits with message "Merge branch xxxx" should be considered as ok.

done


Postgres: schema name ignored during prisma init

Bug Report
Current behavior
Prisma init only introspects the public schema, even though I specified the schema name. The datamodel.graphql contains only a dup table from the public schema. After taking a look at the query log of postgres, I found something interesting:
2018-05-11 04:57:30.570 UTC [9155] LOG:  statement: select schema_name from information_schema.schemata WHERE schema_name NOT LIKE 'pg_%' AND schema_name NOT LIKE 'information_schema';
2018-05-11 04:57:30.599 UTC [9155] LOG:  execute <unnamed>: SELECT
            tc.table_schema, tc.constraint_name, tc.table_name, kcu.column_name,
            ccu.table_schema AS foreign_table_schema,
            ccu.table_name AS foreign_table_name,
            ccu.column_name AS foreign_column_name
        FROM
            information_schema.table_constraints AS tc
            JOIN information_schema.key_column_usage AS kcu
              ON tc.constraint_name = kcu.constraint_name
            JOIN information_schema.constraint_column_usage AS ccu
              ON ccu.constraint_name = tc.constraint_name
        WHERE constraint_type = 'FOREIGN KEY' AND tc.table_schema = $1::text;
2018-05-11 04:57:30.599 UTC [9155] DETAIL:  parameters: $1 = 'public'

Reproduction
:/
Expected behavior?
The table_schema should not be 'public', but the schema name users entered in prisma init. BTW, setting search_path to the schema name other than public does no help.

@Congee : Thanks for sharing this.
Can you please share your docker-compose.yml file and prisma.yml file?

FYI
prisma.yml
endpoint: http://localhost:4466
datamodel: datamodel.graphql

docker-compose.yml
version: '3'
services:
  prisma:
    image: prismagraphql/prisma:1.10
    restart: always
    ports:
    - "4466:4466"
    environment:
      PRISMA_CONFIG: |
        port: 4466
        # uncomment the next line and provide the env var PRISMA_MANAGEMENT_API_SECRET=my-secret to activate cluster security
        # managementApiSecret: my-secret
        databases:
          default:
            connector: postgres
            host: localhost
            port: '5432'
            database: scraped
            schema: scraped
            user: congee
            password: here_be_the_password
            migrations: false

These files are generated merely by prisma init without any further changes. In case you need some context, here's how I use prisma init
? Set up a new Prisma server or deploy to an existing server? Use existing database
? What kind of database do you want to deploy to? PostgreSQL
? Does your database contain existing data? Yes
? Enter database host localhost
? Enter database port 5432
? Enter database user congee
? Enter database password here_be_the_password
? Enter name of existing database scraped
? Use SSL? No
? Enter name of existing schema scraped

Fixed in alpha via https://github.com/prismagraphql/prisma/pull/2559

This is now released.

Any news about this issue? As @jahudka explained, the issue is still present and it's actually blocking us from using Prisma with a Managed Database from DO.


MatDialog: New CanBeClosed property

New property that will set the escapeKeyAction and scrimClickAction in MDC Dialog.
If set to false the user is not able to close the dialog by pressing ESC or clicking on the scrim.
You can now use MatDialog as just a modal for ex. a modal loading screen.

Hey @tespheakdeyesoftix
For me it seems to work https://blazorfiddle.com/s/uv7meodg
Did you update to 1.7.4? Try clear your cache or press Strg+F5. Sounds like you are not getting the latest JS.

Hi @dga711
I did update to 1.7.4. Now I fix it by clear cache by your suggestion.
Thank you very much.


[ENH] Implemented MockCluster in testing module

Reference Issues/PRs
Fixes #1529

What does this implement/fix? Explain your changes.
Implements MockCluster class inline with classification and regression, along with test cases.

Does your contribution introduce a new dependency? If yes, which one?
No

Any other comments?
No

PR checklist

For all contributions

[ ] I've added myself to the list of contributors. Alternatively, you can use the @all-contributors bot to do this for you. --> Will do this after this PR is reviewed
[x] The PR title starts with either [ENH], [MNT], [DOC], [BUG], [REF], [DEP] or [GOV] indicating whether the PR topic is related to enhancement, maintenance, documentation, bugs, refactoring, deprecation or governance.

LGTM! Thanks for the addition!


Issue with react-bootstrap

Hi!
I'm struggling to get scalajs-react going with react-bootstrap from https://github.com/chandu0101/scalajs-react-components
Using Chrome I'm getting this error on the console:
Uncaught TypeError: Cannot read property '__reactAutoBindMap' of undefined
Did anybody encounter the same issue? I've set up a repo @ https://github.com/landlockedsurfer/scalajs-react-bootstrap to help reproduce the error.

Hi ,
reactbootstrap doesn't work :( , thats why its not included in demos . I'll remove it when i release first version of scalajs-react-components . If you want scalajs-react-bootstrap then use this library
https://github.com/weiyinteo/scalajs-react-bootstrap

Thanks for the quick reply and the link!
Is your repository the place to put facades to existing React components? I.e. if one has followed the steps you describe in
https://github.com/chandu0101/scalajs-react/blob/master/InteropWithThirdPartyComponents.md
can one send you a pull request to add it to your repo @ https://github.com/chandu0101/scalajs-react-components ?

absolutely dude , please keep em coming , one thing i am wondering is how about having a common prefix/suffix for thirdparty comp ?
Example : ReactJSTableComponent
JSTableComponent
or .. ?

Unfortunately I'm not quite there yet thinking about a good naming schema for the React facades. :-) I'm still stuck with creating a facade on this component https://github.com/olahol/react-tagsinput.
I've created another repo @ https://github.com/landlockedsurfer/scalajs-react-facade-test to reproduce the problem. Again, got the Uncaught TypeError: Cannot read property '__reactAutoBindMap' of undefined error.
Did you ever have a similar issue?
Thanks.

you're using react 0.13 , it requires createFactory gaurd for js components
 // we should update scalajs-react for over load method of createFactory to accept js.Dynamic/object , till then cast it to js.Dynamic and then call createFactory
    val f =  React.asInstanceOf[js.Dynamic].createFactory(js.Dynamic.global.ReactTagsInput) // access real js component

Thanks a ton... working nicely now!
Have seen your pull request to the japgolly/scalajs-react repo. Your page on third party component interoperability really belongs there.
I wonder how a painless management of ScalaJS React facades and the underlying Javascript versions could look like.

I wonder how a painless management of ScalaJS React facades and the underlying Javascript versions could look like.

sorry for delay(intentional though) , it looks like its super easy if we use js-world tools. currently i am using webpack in demo module its freaking awesome.

Congrats on the release of 0.1.0!
Thanks for the pointer on webpack. Indeed webpack seems the to be the best choice to deal with the Javascript bindings, also considering npm and webpack seems to b the most popular choice in Javascript React land.


[BUSINESS PROCESS]: Setup and maintain service resources

Contact details
<EMAIL_ADDRESS>Organization type
Microsoft employee
End-to-end business process
Service to cash
Which business process area is this article related to?
Manage service resources
Enter the name of the business process you are starting work on
Setup and maintain service resources
Enter any additional comments or information you want us to know.
Comments go here
Specify the date you expect the article to be completed and ready for review.
01/24/2024
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Duplicate


[JENKINS-31544] Added Build failure analyzer plugin support

Added Build Failure Analyzer plugin support

https://issues.jenkins-ci.org/browse/JENKINS-31544

Thank you for a pull request! Please check this document for how the Jenkins project handles pull requests


Block release if version in cargo.toml mismatches

The community has complained about this. We need to make sure our release process doesn't continue if we use the incorrect version in the cargo.toml file. I think we should just add a commit in the pipeline that updates this.

That would be nice, looks like the version in Cargo.toml is already outdated :(

related to https://github.com/axelarnetwork/tofnd/issues/227

https://github.com/axelarnetwork/playground/blob/main/.github/workflows/release.yaml


absences

Hi,
sorry for posting on this matter again. I was in contact with Untis about the API and they sent me the documentation.
It turns out, that there is the method getTimetableWithAbsences() which is exactly what I need.
Unfortunately this method seems not to be implemented in your library. Is there a chance that you make that passible?
Greetings Mathias

This method isn't in my docs, i think it's pretty new. Can you send me this documentation?

Is there a way to contact you in private since I don't want to share the documentation publicly. i'm sure whether Untis would approve that.

<EMAIL_ADDRESS>is my Email adress


[Bug] Application crash when attempting to configure env variables after setting a digit

Create an environment variable, can be secret or non secret.
In the scripting tab, set the value to a non string digit and run the request.
bru.setEnvVar("secret_variable", 10)
Click on the environment configuration button and the app will crash to a white screen with the below error.

Didn't see this already exists:
https://github.com/usebruno/bruno/issues/847

Closing this issue as the PR fixing the bug has already been merged and released in v1.6.0


code formatters

How do people feel about automatic code formatters?
Some of them have gotten quite good (i.e. prettier, go fmt, etc)

We have a small precedent in that we have an auto-indent keybinding.
I think it would be generally appreciated, as long as it was an opt-in sort of thing — hit a keybinding and the selection (or whole file) gets auto-formatted.
https://github.com/pivotal/vim-config/blob/1fecad0a3bf3b6d743988fcae68fc24d8133c222/init/keybindings.vim#L47

Cool, I will put together a pull request to set up neoformat to bind to -- which should give us a good spread of autoformatting.

I'm trying to look at tpope/vim-abolish for inspiration, but this voodoo may take longer than I planned.


1.7: blessings uses nose

Looks like blessings is one of the last few modules which is still using nose which should not be used with python 3.x https://nose.readthedocs.io/en/latest/
Any plans to migrate to pytest or even unittest? (better would be pytest)
[tkloczko@ss-desktop blessings-1.7]$ grep -r nose
blessings/tests.py:from nose import SkipTest
blessings/tests.py:from nose.tools import eq_
blessings/__init__.py:            # work even when -s is passed to nosetests. Lean toward sending
blessings/__init__.py:            # running simply `nosetests` (without progressive) on nose-
.travis.yml:  - pip install -q nose
.travis.yml:  - nosetests -w /tmp blessings.tests
setup.py:    tests_require=['nose'],
setup.py:    test_suite='nose.collector',
tox.ini:commands = nosetests blessings
tox.ini:    nose
README.rst:  * Extracted Blessings from nose-progressive, my `progress-bar-having,
README.rst:.. _`progress-bar-having, traceback-shortcutting, rootin', tootin' testrunner`: http://pypi.python.org/pypi/nose-progressive/

Here's a PR for this, doesn't quite work yet, help welcome:
https://github.com/erikrose/blessings/pull/165


[DO NOT MERGE] Cross-compile pickling for scala 2.12

Changing default to 2.12 and cross-compiling for 2.11. FastTypeTagMacros.scala is just copied from the 2.11 file.

Still getting this error https://gist.github.com/MasterDDT/fa24b1a345722b515f115bf5d1970003
[error] /Users/mitesh/pickling/benchmark/SparkLR.scala:33: Cannot generate a pickler for scala.collection.mutable.ArrayBuffer[DataPoint]. Recompile with -Xlog-implicits for details
[error]     val pickle = data.pickle
[error]

Going to close this, I dont think anybody will figure this out in a shorter amount of time than just swapping the pickling library with another (which long term is what we want)
https://actioniq.slack.com/archives/C0GE3TK1V/p1631650423003600


Google Tag Manager

Please add the Google tag manager script in the head of all pages -
`

--
  |
  |
`
Also add this after the opening body tag:

--
  | <iframe src="https://www.googletagmanager.com/ns.html?id=GTM-WZ7D96C"
  | height="0" width="0" style="display:none;visibility:hidden">
  |
`

I will take this.

The noscript tag is only to track users when their browser disables javascript. I have never not included it so I can't say its fine without it, but we can test it without it to see if all is good.

This should be on the preview/live site now. Please confirm and re-open if there are issues. (not the no-script tag though).


Update Navbar and Footer Colors for Consistency and Better Visual Appeal

Is there an existing issue for this?

[X] I have searched the existing issues

Feature Description
The current colors of the navbar and footer are inconsistent and visually unappealing. The navbar and footer colors clash with each other, impacting the overall look of the website. We need to update the color scheme for both to create a more cohesive and aesthetically pleasing design.
@Trisha-tech I would like to work on it.
Please assign it to me under gssoc-ext and hacktoberfest.
Use Case

Benefits
Increases user interactivity and enhances the visual appearance of the website.
Add ScreenShots
No response
Priority
High
Record

[X] I have read the Contributing Guidelines
[X] I'm a GSSOC'24 contributor
[X] I have starred the repository

Thanks @T-Fathima , But it's a Duplicate Issue of #489.

@officeneerajsaini OK Will try to find other issues and work on it.
Would like to contribute to #489 if it's not done.
I have a bit idea about react


Please add Racket to project topic

This facilitates search and promotes Racket. Thanks.

I never noticed the topic entry field before. Thanks. I added racket and racket-lang.


fix(admin) bind the kong admin api port to 127

https://deploy-preview-1869--kongdocs.netlify.com/install/docker/

@hutchic Can you update the DB-less section as well?

@hutchic Should the same be done for the enterprise installation?
https://docs.konghq.com/enterprise/1.3-x/deployment/installation/docker/

@lena-larionova first thought: yes
second thought: why do we still have separate docs for CE / EE
third thought: the enterprise install docs are versioned
I did 1.3 but the enterprise team should probably audit all their installation methods to ensure the admin api port is secure by default

@hutchic

second thought: why do we still have separate docs for CE / EE

That's a big can of worms you don't want to open right this minute... But it's on the radar, and there are vague plans in the works.

I did 1.3 but the enterprise team should probably audit all their installation methods to ensure the admin api port is secure by default

I'll find someone to do it.


Reduced motion query and accessibility

Please respect and add support for the reduced motion query by adding an image fallback. Add a pause button. Respect motion sickness – please add a pause button

@djmtype thanks for the heads up! How would that look interface wise? Any ideas?

@djmtype alright, I believe I came up with a good solution in v1.0.3, please take a look.


[BUG] Copy to clipboard in the Share to social media icons is not working

Description
The following button is not working in the share to social media

copy to clip board

I tried clicking the button few times and it does not seem to copy the contents of the link. Instead it selects the contents of the description in the profile.
I am using BRAVE BROWSER.
At the time of this issue the linkfree is at the v0.58.3
Screenshots

Additional information
No response

Hey Nirbhay , I want to work on this issue would you please assign me.

thanks for catching this issue. I just checked and a similar thing is happening in Chrome and it's throwing a console error.

@emmalearnscode  can you help me in this all things working fine in development server.

https://user-images.githubusercontent.com/68468264/148693853-b6a684f3-a212-4d94-a5ab-6a7f9ef5470c.mp4

This is going to be hard to test as it's working in development but the copy to clipboard function is async and returns a promise so I wonder if the toast should be chained inside a .then block (see the examples here: https://developer.mozilla.org/en-US/docs/Web/API/Clipboard/writeText )

Hmm, I also found some information that this web API only works on https and we are currently using http so that may also be causing an issue

@emmalearnscode  Thanks for sharing it and helping.

@eddiejaoude we have a bug in the copy to clipboard on production being caused because the site is hosted on http instead of https and the api doesn't work on http. Is upgrading to https something you are planning to do with the project?
Maybe we should comment out the copy to clipboard icon/functionality if this is not something that can be resolved at this time? Or do you have another suggestion?

@eddiejaoude we have a bug in the copy to clipboard on production being caused because the site is hosted on http instead of https and the api doesn't work on http. Is upgrading to https something you are planning to do with the project?
Maybe we should comment out the copy to clipboard icon/functionality if this is not something that can be resolved at this time? Or do you have another suggestion?

Upgrading to https sounds like a good idea to me. If that were to happen, every link in the code (if there is any). Should be with https instead of http.

Thanks @emmalearnscode 👍 yes we plan to move to https, but i need some help with the Kubernetes config/setup - let me reach out to some people as i would like to do this on a live stream

Description
When the copy to clipboard button is clicked it throws the error navigator.clipboard is undefined. I am using Firefox v95.0.2 browser. I did some research, I found that navigator.clipboard is only available when the site you're browsing has a secure origin (HTTPS). http://linkfree.eddiehub.org/ is using (HTTP). I think because of that copy to clipboard is not working.
Screenshots

Additional information
My suggestion is to use old-school copy to clipboard using the out of viewport hidden textarea trick.
const CopyLink = () => {
  if (typeof(navigator.clipboard) == 'undefined') {
    // Do the out of viewport hidden textarea trick.
  }
  navigator.clipboard.writeText(`http://linkfree.eddiehub.org/${username}`)
  toast.current.show({
    severity: 'success',
    summary: 'Link copied to clipboard.',
  })
}

My suggestion is to use old-school copy to clipboard using the out of viewport hidden textarea trick.

I think for the time being this could be a helpful solution. Since it prevents the broken site.
Further this bug can be removed as mentioned by @eddiejaoude
What are others views?
@emmalearnscode

My concern with adding the workaround is that it's not acutally possible to test it in development as the copy to clipboard is working on localhost. Therefore, we won't know if it works until pushing to production. Then when we finally do upgrade to https, there will be unnecessary code which we might forget to remove. My feeling would be to comment out the sharing link and just leave the three working social sharing links visible for now until Eddie has time to upgrade. Curious to see what others think.

Therefore, we won't know if it works until pushing to production. Then when we finally do upgrade to https, there will be unnecessary code which we might forget to remove

Yeah I did not thought of this. This might turn out to be an overhead later. I agree that it should be commented.

For now, till this issue gets resolved, maybe remove the copy to clipboard icon?

https has now been added to the LinkFree project and I just tested the copy link and it works 🎉
Thank you all for the great collaboration 🔥


Added DigitalOcean Resources

As a developer who uses DigitalOcean to host their infrastructure, I found these assets useful for my Ilograph documents and when I found your lib for AWS, I thought I'd share :)

Hey, thanks for this. Can you tell me the source of these icons? Who created them, how they're licensed, etc.

I thought I got the icons from icons8, but I'm having trouble finding them... Give me a while to figure out where exactly I sourced these icons and I'll report back.

Actually, I got these from the DigitalOcean brand guidelines. The page I retrieved them from is returning a 404 though, and I can only pull up their press guidelines: https://www.digitalocean.com/press


Unable to connect to the API: Connection refused for URI https://oauth2.googleapis.com/token

I am getting this error. previously it's working fine. I am using a firebase realtime database
Kreait\Firebase\Exception\Database\ApiConnectionFailed Unable to connect to the API: Connection refused for URI https://oauth2.googleapis.com/token
what is the possible problem?

If it worked at one time but not the other, it's probably not an issue within the SDK.
Please check the stacktrace of the exception to find out the original cause.
As this doesn't seem to be a more specific exception (e.g. an authentication/authorization error), I can only guess without the error details, but it could be that the connection is blocked by some kind of Firewall.

Here is the sequence of trace but the problem is I have multiple firebase applications on the same server if its blocked IP/firewall it will have a problem with all other applications but it's only occurring on one application.

I was just guessing. You asked "what's the possible problem?", and I gave you a possibility.
If you look into the stack trace, you'll see that it starts with a ConnectException, which hints at a networking error, that's why my guess was sons kind of Firewall.
http://docs.guzzlephp.org/en/stable/quickstart.html?highlight=connectexception#exceptions
I'll not continue to guess, but if you say that you haven't got any problem with other Firebase applications on the same server, than it's probably something in the application/application environment.

I am also facing same issues after updating to v5.8.0. I have downgraded back to v5.7.0 and it working fine!

https://github.com/kreait/firebase-php/compare/5.7.0...5.8.0#diff-8fdb27e6c8e003f42f34ec30433098f2R53

Now, this is interesting! Thank you for the additional information, I'll have a closer look as soon as I can!

I am using laravel 6.0. Today I have host to another droplet it works its quite weird. Needs to find out the actual issue.

@vegadvarsha30 Is it working in your project as well on one host, but not the other?
@vegadvarsha30 @shouvick Concerning the changes between 5.7.0 and 5.8.0 - I had to change the exception handling to address a problem with Guzzle 7, and the handling of networking errors should not have changed, but if you find a breaking difference, please let me know.
But in the end, the exception has been thrown from Guzzle and been handled by the SDK, so I do believe that this actually is a "real" connection issue.

@jeromegamez It is working fine on localhost (with docker image).
But I am facing issue with AWS ec2 machines. I verified on multiple machines from multiple AWS regions, I can reproduce the issue on all the machines with php 7.2 and php 7.4.
Then I used official node.js https://firebase.google.com/docs/auth/admin/verify-id-tokens on same machines and its working fine.
After downgrading to 5.7.0, its working fine on all ec2 machines and as well on localhost.
PS: https://stackoverflow.com/questions/31141956/google-oauth2-api-connection-refused

Could you please add/replace the dependency to the SDK in your composer.json with
"kreait/firebase-php": "dev-http-client-options as 5.8.1"

and see if that helps?

@jeromegamez yes it works :D

@vegadvarsha30 yes it does fixed the issue. thanks!

@jeromegamez I'm only recently getting these errors and notifications are failing. Some of the exception responses are:

cURL error 55: getpeername() failed with errno 107: Transport endpoint is not connected (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://oauth2.googleapis.com/token

Unable to connect to the API: cURL error 52: Empty reply from server (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://oauth2.googleapis.com/token

It does work sometimes, so not an implementation error.  I've got me sending setup as a Laravel Job with multiple retries, so it may fail 4-5 times and then it works. Sometimes it works first try.
I understand that is most likely not and SDK issue, but not sure where to look next.  Has anyone else had a similar issue?

Whew, this looks like a faulty network connection or proxy to me 😕.
To be sure it's not the SDK or PHP and one of its dependencies (e.g. cURL), I would suggest updating all of them (I don't support 5.x releases anymore) and see if the problem persists.
If it does, it might be something on the proxy/server side - that's where I like and hate to suggest a "Have you tried turning it off and on again?" 🙈


After setting up the plugin, tsserver keeps initializing then crashes

Description
I am in a Turbo monorepo configuration with three NextJS apps and two packages, is not a very large project.
After I setup the plugin, I can see the errors for the entire workspace, but two things happens, the first one is the I feel Neovim going slowly than before, and the second one is the tsserver initialise and crash for some reason, and keeps doing it in a loop until definitively crashes.
Steps to reproduce
I just followed the steps in the README. Here are some screenshots with what is happening.
I cannot share my repo because is a client's one.

Expected behavior
It have to work as expected
Environment

Neovim version: [0.10.0]
workspace-diagnostics version: [latest]
Plugin clash: [tsserver]

Yeah it's hard to say... One thing to check possibly is the list of project files? If for whatever reason it includes node_modules then maybe even a small project can get prohibitively large. The default file is the output of git ls-files.


Data items indicating missing data

Description of the issue
In some data sets, so special data items are used to indicate that data is not available. Sometimes such data items even transport information about why data is not available.
Examples are:

In data sets about greenhouse data (e.g. GHG inventories or GHG modelling results) such data items are called notation keys and UNFCCC defines a set of them: NO, NE, NA, IE, C and FX.
In Eurostat statistics such data items are calles flags. For example a flag Z is used to indicated "logically non-feasible combinations of energy balance and also combinations that are not covered by the reporting templates (countries do not report these data points)", see meta data of the data set nrg_bal.

Ideas of solution
Add classes:

An X is a data item that is used to indicate that data is not available. I do not have yet an idea for a good label.

notation key: A notation key is an X defined by the UNFCCC to indicate why data is missing.

We could potentially add individuals for the specific notation keys.
Workflow checklist

[ ] I discussed the issue with someone else than me before working on a solution
[ ] I already read the latest version of the workflow for this repository
[ ] The goal of this ontology is clear to me

I am aware that

[ ] every entry in the ontology should have a definition
[ ] classes should arise from concepts rather than from words

A quick search across OLS.

Not a number: Measurement not available: Not a number (per IEEE 754).
Not available: The desired information is not available.
And there is a set of subclasses of "missing value reason" in NCIT: A specific reason explaining why a meaningful value is not available. A meaningful value answers the question posed by a Data Element Concept. In contrast, a Missing Value Reason answers the implicit question "Why is there no 'meaningful' value?", when there is none.

Can we reuse something here?
I also checked IAO but didnt find anything. Maybe I used the wrong search vocabulary...

I think we have an agreement to add the following two classes:

missing value reason: A missing value reason is a data item that is used to indicate that data is not available and to provide a specific reason explaining why a meaningful value is not available.
Alternative labels: missing data and absent data
notation key: A notation key is a missing value reason defined by the UNFCCC to indicate why data is missing.

I will add those two to oeo-model, further subclasses of missing value reason can be added at a later stage.


[General] idf.py size, idf.py size-components failed when using amazon-freertos as external project.

I m using the amazon-freetos as an external repository. When I m using the idf.py menuconfig, idf.py clean all this command is working, but idf.py size, size-components, and size-files are not working.
System information

Hardware board: [ esp-devkit ]
IDE used: [  esp-idf v4.2.1 ]
Operating System: [ Linux ]
Code version: amazon-freertos 202107

Here is the link of repo link .
Thanks!

Hi @Raghav3107. This was answered in a previous issue:
https://github.com/aws/amazon-freertos/issues/3339#issuecomment-886339547
To quote, you can use the following script instead:
./vendors/espressif/esp-idf/tools/idf_size.py

I'm not entirely sure if size-components and size-files are supported yet, but maybe @shubhamkulkarni97 will be able to assist you more.

Hi @Raghav3107 @yourslab,

For size-components, you can use ./vendors/espressif/esp-idf/tools/idf_size.py --archives <map-file>
For size-files, you can use ./vendors/espressif/esp-idf/tools/idf_size.py --files <map-file>

Thanks,
Shubham


Expose Ruff's public API as a Python library

See: #593

This would mean that we could do something like the following, right?
import ruff
errors = ruff.check_files(list_of_paths)
...

Thanks!

Yup, that's right!

@messense - I wasn't certain on this last time -- if we bundle a Python API with Ruff, will we need to build separate wheels for every Python version?

If you can use abi3 features, one wheel per platform, otherwise you need to build separate wheels for every Python version.

Awesome thank you. I think we should be able to do that, so maybe this will be really straightforward.

Hello there, do you happen to have a rough timeline for when (if?) this is going to happen? I'm looking to integrate ruff into a tool I'm developing, which would require an API of some sort. It would be very helpful to know if this is something I can wait on, or look for another solution / workaround!

@provinzkraut - It's definitely going to happen! I could probably ship it within the next week or so. I'd just been punting on it until I had more people asking for it.
Could I hear a bit more about your use-case, if you don't mind sharing?

@charliermarsh That's good to hear!

Could I hear a bit more about your use-case, if you don't mind sharing?

Sure. I'm working on a markdown extension to automatically generate pymdown tabs for different Python versions from a source version, i.e. generate 3.7, 3.8, 3.10 tabs from a 3.7 source (repo).
Currently I'm using pyupgrade to generate the versions and autoflake to clean imports that have become superfluous. Especially autoflake is quite slow, making up a majority of the extensions runtime. Since ruff is way faster at this, I'd like to use it (also one less dependency). I fiddled around with using the CLI version, but that's messy and a performance degradation.

@provinzkraut - Ok, cool. Let me see what I can do. I don't know if you're comfortable reading Rust, but would the current Rust public API suit your use-case, were it callable from Python with Python objects etc.?

In short: it takes a file path (to find the pyproject.toml), the raw Python source code, and an autofix setting, and returns a list of checks (which themselves include the raw fixes / patches).
I'm guessing that for your use-case, what you actually want is a function that takes source code (plus settings, to enable a list of checks) and returns fixed source code?

but would the current Rust public API suit your use-case, were it callable from Python with Python objects etc.?

I looked at this yesterday because I though that maybe it could be as simple as adding a tiny wrapper around the rust lib myself, but it seems to be a bit more involved. The current API doesn't really lend itself that well to my usecase.

I'm guessing that for your use-case, what you actually want is a function that takes source code (plus settings, to enable a list of checks) and returns fixed source code?

That would be ideal, yes. Dealing with a list of checks and extracting what I need from it also wouldn't be that big of an issue, but passing in configuration directly and omitting the config file is crucial, both for the needed configurability (I need to run the fixers with varying configuration for every invocation) and performance (I'm running the fixers many times on small snippets, which means the overhead of looking for and parsing a pyproject.toml every time adds up).

I'm working on this now.

I had a need to execute Rust as an Alembic post write hook. I came up with a very hamfisted approach that I found from the distributed __main__.py

alembic.ini:
[post_write_hooks]
# post_write_hooks defines scripts or Python functions that are run
# on newly generated revision scripts.  See the documentation for further
# detail and examples

# format using "black" - use the console_scripts runner, against the "black" entrypoint
hooks = ruff, black

ruff.type = ruff

black.type = console_scripts
black.entrypoint = black

and then Alembic's env.py:
import os
import sysconfig
from alembic.script import write_hooks

@write_hooks.register("ruff")
def run_ruff(filename, options):
    ruff = os.path.join(sysconfig.get_path("scripts"), "ruff")
    os.spawnv(os.P_WAIT, ruff, [ruff, filename, "--autoformat", "--exit-zero"])

👍 Yup that should be safe to do! (The downside being that you have to go through the CLI rather than calling a function directly. Hoping to enable that soon but not working on it right now.)

Is the plan here to make a Python library that links to ruff directly? I want something that I can use in an interactive Python REPL to check for errors as the user types stuff, and shelling out to a subprocess on each character typed doesn't sound like a good idea (especially if I also have to write out the code to a tempfile or heredoc).
If you're curious, here's what I'm currently using with pyflakes https://github.com/asmeurer/mypython/blob/a836d0956a6443f7a85a032dc625ff3da1479a91/mypython/processors.py#L196. The code is complicated in part because pyflakes doesn't handle syntax errors very well, so I have to parse them separately. I haven't checked if ruff handles them better. There's lot of opportunities to improve over pyflakes' barebones Python API.
The main thing I would want from a Ruff Python API is a function that takes a string of Python code and returns a list of errors with line number, start and stop column numbers (where relevant), and the error message. Being able to get corresponding fixes would be nice too, I guess. The best API I can think of for a "fix" would be to return the whole block of code with the specific warning fixed, along with a new line and column number corresponding to the line and column of the original warning (so that I can interactively keep the cursor in the "same" location).
I'm happy to discuss API ideas more in depth or test out any prototypes if you're interested.

That sounds cool!

If you're curious, here's what I'm currently using with pyflakes<EMAIL_ADDRESS>The code is complicated in part because pyflakes doesn't handle syntax errors very well, so I have to parse them separately. I haven't checked if ruff handles them better. There's lot of opportunities to improve over pyflakes' barebones Python API.

Ruff creates a diagnostic for files with syntax errors. Adopting a more error-resilient parser is something that we consider doing.

The main thing I would want from a Ruff Python API is a function that takes a string of Python code and returns a list of errors with line number, start and stop column numbers (where relevant), and the error message.

That sounds reasonable, but we aren't there yet (your best shot is to call into the CLI). One of the biggest problems of exposing a linter API right now is that Ruff writes one-off warnings to stdout and relies on the global state to track whether to write the warning. Cleaning this up probably requires a larger refactoring around the diagnostic system... so that may take a while.

For what it's worth, we power ruff-lsp and the VS Code extension over subprocess, and the CLI actually supports enough behavior to power the operations needed there. For example, you can use --format json to get a structured list of violations and their fixes. Similarly, if you pass input via stdin, and run with --fix, we print the "fixed" output to stdout.

For what it's worth, we power ruff-lsp and the VS Code extension over subprocess, and the CLI actually supports enough behavior to power the operations needed there

How do you feel about adding a Python module that wraps this up in a convenient API?
I've been using the solution you suggested in a few of my tools now, and not having to implement that boilerplate every time would certainly be nice.
If that sounds good to you, I'd be happy to contribute.

I'm keen to replace autoflake+isort with ruff in my shed all-in-one autoformatter - the subprocess trick works pretty well, except that if there's any way to change the isort settings in ruff without a config file I can't see it - and running isolated from any config is pretty important in this use-case.  Any suggestions, or do I just need to wait for the library interface in this issue?

Adding a data point: in mkdocstrings-python we format function signatures with Black if it is installed. We would like to support Ruff to, but spawning a subprocess for each signature is very costly, so we would greatly appreciate a Python binding that doesn't use subprocesses :slightly_smiling_face: A wrapper that hides the subprocess calls sounds nice, but won't be enough for our use-case.

@pawamoy that sounds neat. We plan to integrate our LSP into ruff (implemented in Rust). I know, it's not as convenient as a Python API but it would allow you to format files without spawning a process for every signature (although it might still be very costly because it requires multiple LSP calls to format a single code snipped)

By calls do you mean network calls? Or could we somehow spawn the LSP server locally (like a daemon)?

Ah, interesting. Then yeah, that's already much better than subprocesses :slightly_smiling_face: Thanks for the info!

Amazing, thanks for sharing! I'll check it out :)

@charliermarsh just checking in - is there any way to configure the isort settings in --isolated mode, or do I just have to wait?  No worries if so, I'm just looking forward to replacing black too...

@charliermarsh just checking in - is there any way to configure the isort settings in --isolated mode, or do I just have to wait? No worries if so, I'm just looking forward to replacing black too...

@Zac-HD, yes, there is! We recently extended the --config flag so that arbitrary configuration options can be overridden via the command line using "inline TOML": https://docs.astral.sh/ruff/configuration/#the-config-cli-flag. So to override the isort extra-standard-library setting in --isolated mode (for example), you'd do something like ruff check --config "lint.isort.extra-standard-library = ['path']".

Adding another data point:
In edvart, we are currently using isort to sort imports in Python code which is being dynamically.
With a Python API, we could fully switch to ruff. For now, we are using ruff to format the source code, but keeping isort to format the generated code.

Another data point: it would make it easier to replace programmatic calls to black, like in mdsformat-black: https://github.com/hukkin/mdformat-black/blob/master/mdformat_black/init.py

def format_python(unformatted: str, _info_str: str) -> str:
    return black.format_str(unformatted, mode=black.Mode())

I’d want to use an API like black.format_str over in blacken-docs, where Ruff support is tracked in this issue: https://github.com/adamchainz/blacken-docs/issues/352

Not the most elegant solution and I haven't tried it myself, but it should soon be possible to call the ruff WASM API from Python:

https://github.com/astral-sh/ruff/pull/12317
https://github.com/wasmerio/wasmer-python

I would be open to expose a Ruff Pyo3 API:

Shipped as a separate python package (ruff-api?)
Has the same or a very similar API as ruff_wasm
The API itself isn't under semver. Breaking API changes are possible, even in patch releases (we don't feel comfortable committing to that yet). Otherwise, the same versioning policy as for Ruff applies
The package should be released automatically as part of our release workflow.

I'm happy to support if anyone's interested in contributing the API to ruff.

Same here -- would love to replace black.format_str in automatically formatting jupyter cells with https://github.com/n8henrie/jupyter-black/ !

@maxschulz-COL @n8henrie @adamchainz I would like to remind folks that https://github.com/amyreese/ruff-api has a working, simple API wrapping both the formatter and import sorter from Ruff, just a pip install ruff-api away. We have been using it to successfully migrate from Black in our monorepo while still maintaining our existing integrations/tooling written in Python. :)

That looks great, but it is also documented as "highly experimental", so people maybe reluctant to add that to their tool chains. Why don't you contribute that to the ruff project?

Agreed -- it would be great to have this under ruff's umbrella!


asset: introduce new asset version v1 for segwit-like encoding

In this commit, we add a new asset version to introduce segwit-like asset encoding where we don't encode the witness vector of an asset's inputs. This applies on the asset version level, so all v1 asset won't have that vector encoded. Note that this is only for the MS-SMT tree, any other TLV encoding such as the asset proof or state transitions remain the same.
Fixes https://github.com/lightninglabs/taproot-assets/issues/464
TODO

[x] Update RPC calls to allow minting for the new asset type, and creating addrs with the new asset type.
[x] Update unit tests to also test for the new asset type
[x] Add version field to vPSBT output
[x] Add ability to create addrs for v1 outputs
[x] Add ability to mint v2 assets
[ ] Update TransferOutputs (?) on disk to support v0 -> v1 mapping
[ ] Create itests with a nested set of transactions to set new asset type correctness.
[ ] Update test vectors

Ah, so we wouldn't completely move the witness to the proof file? We'd still encode it within the asset in the proof file, but wouldn't commit to the witness in the tree to allow for more flexible constructions? Makes sense, I guess and allows for a very compact diff.

Ah, so we wouldn't completely move the witness to the proof file?

Yep, going for a minimal approach here. It would still always be encoded, but when we go to map it to a leaf in the tree, we don't include the witness information.
Universe trees (which sort of stamp the final transition/issuance proof) will still commit to the witness data, as they include the proof file state transition as a leaf. So that'll end up being the sort of canonical version. By using the tapscript VM, we gain all the extra protections for witness malleability as well. We might want to double check that we're using all the strictest flags there.

Updated with relevant commits threading the new state through the entire codebase. Removed from draft as well.
Two main things still remaining:

Update the TransferOutput to also update the asset version. This'll allow us to test things like updating passive assets from v0 to v1, etc.
Add itests for minting/sending/receiving with the new asset version.

Addressed initial round of comments!
Test vector check seems to be failing still, I modified the random asset gen to also generate random asset versions, but maybe this is tripping it up?

Addressed initial round of comments!
Test vector check seems to be failing still, I modified the random asset gen to also generate random asset versions, but maybe this is tripping it up?

As mentioned here you need to use test.RandIntn() instead of rand.Intn() for test vectors, otherwise the output won't be deterministic.

@ffranr @guggero PTAL!
Final issues I had to hunt down:

Heterogenous sends not possible, needed the asset version in the split locator
Upsert and Delete in tap/asset commitments not accounting for heterogeneous versions
Change vOut needs to account for version updates. Rn uses the max, but I think we want to re-work the control flow here eventually. Since when you need to set the version for the change output, you don't yet know what the asset will actually be.

Some of the changes here might also be useful to update your mental model of the relevant sites @jharveyb.


Refactor to reduce nesting in Mnist UI demo

Minor refactoring to the Mnist training UI demo to reduce nesting.
I'm having issues at the moment running the UI with or without these changes so let's hold off on reviewing this until I check in with another comment explaining what was wrong and how I resolved it.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

We are planning drop this module in favor of: https://github.com/aws-samples/djl-demo/pull/152


Refactor: add more comment of change_membership function turn_to_learner param

Refactor: add more comment of change_membership function turn_to_learner param.

Mind updating the doc in guide/ as well? :DDD


MQTT disconnection on every single receive

Hi Mr. Tilen,
I am using and testing this library for real product and almost everything fine.
But for example, when I use exactly same code with: GSM_AT_Lib_res/docs/examples/_example_mqtt_client.c mqtt
MQTT works fine except I publish something to topic which this library subscribed. It takes the message but after that it disconnects. At every single received message, it disconnects and reconnects. (retriess++ in the code)
Actually this may be acceptable because of the latency is a few seconds to reconnect. But if the message's retain flag was set which sent to the device, it takes message, then disconnects, then reconnects, and again takes the message.. The same loop. This case makes the device unable to publish any message.
Do you have any suggestion to solve this problem?
Thanks in advance,
Oguz.

Best would be if you couod send AT log.

You are absolutely right. I was using HiveMQ public server then I changed it to my custom mosquitto server then problem solved.
Appreciate again for your help.


'printf': Mismatch between the type expected by the conversion specifier %x and the type of the argument.

CFE_EVS_DisablePortsCmd calls EVS_SendEvent with a format string for printf that contains the %x specifier (cfe_evs_task.c:1002:9).  EVS_SendEvent is also a varargs function and is called in this case with a variadic argument of type unsigned char. This gets promoted via the default argument promotions to a value of type int (which is a signed type). However, EVS_SendEvent calls vsnprintf with the variadic argument list and the format specifier, which triggers undefined behavior because the %x specifier is expecting a value of type unsigned int.
The fix is to add a cast to "unsigned int" in the call to EVS_SendEvent

Imported from trac issue 180.  Created by sstrege on 2017-02-20T13:37:46, last modified: 2019-03-05T14:58:28

Trac comment by sstrege on 2017-08-07 18:38:51:
Did a search on all calls to EVS_SendEvent and added all missing type casts.
Commit [changeset:5567bb4] is ready for CCB review.

Trac comment by glimes on 2017-08-08 12:18:40:
I recommend Accepting this change set.

Trac comment by jhageman on 2019-03-05 14:58:28:
Milestone renamed


Consider adding Xwt to the main references of the addins

New UI should be done with Xwt, not gtk-sharp. Consider adding it to the main addin references.

Isn't it already referenced? The build targets already pull in transitive references for referenced addins.

I need to recheck this, don't know why I couldn't see Xwt back then.

Reopen if it's still an issue please 😄

I was trying to use Xwt.Mac and that's not referenced in MD.Ide. Yes, the issue can stay closed.


bug in https://arcprize.org/play?task=045e512c

Puzzle 045e512c in the (easy) public set appears to be in error.
The test problem is not supported by the provided examples - the yellow indicator for the diagonal projection should have three instead of two dots - took two humans half an hour before giving up and looking at the json file to determine the expected outcome.

The way I understand the input is:

For the horizontally repeated patterns, show the 3x1 column closest to the center shape
For the vertically repeated patterns, show the 1x3 row closest to the center shape
For the diagonally repeated patterns, show the 3-square L-shape nearest the center shape
All these can be summarized as "show the 3 squares nearest the center shape". The test input follows this pattern, so I wouldn't consider this to be a bug.


#159 Fix title select

Increase the size of the select to take the whole line and avoid problems selecting the title.

LGTM


Name (alias) for garden configuration

What would you like to be added:
Currently, when targeting a garden without using the patterns feature, you have to specify the garden cluster identity, which could be a lengthy name or even a guid. It should be possible, to specify a name for the garden that can be used as alternative when targeting the garden cluster. E.g. the configuration could look like
gardens:
- identity: my-landscape-dev
  name: dev
  kubeconfig: ~/relative/path/to/kubeconfig.yaml

You should then be able to run gardenctl target --garden dev and of course also gardenctl target --garden my-landscape-dev
Why is this needed:
Users should be able to name and target the garden to their convenience, especially when the garden cluster identity is meaningless (e.g. a GUID) or rather lengthy.

If the user initially has a configuration with name but without identity the identity could be determined on the fly by calling ```
k get cm cluster-identity -n kube-system -o jsonpath='{.data.cluster-identity}'
and updating the config in the background.


bendo issue #15 r.Checksum()

#15

You did it!
In general, run go fmt ./... before you check in code. (If you are using vim, there is a plugin which will automatically run it for you on save). I have some other line comments.


Updated doc for the new scheduler keyword

This part of the doc was missed on the update from the get to the scheduler keyword.

[x] Tests added / passed
[x] Passes flake8 dask

Thanks for catching this @milesial !  I've added a small suggestion, but otherwise this looks good to me.


bigquery: Job.getQueryResults returns QueryResult

This is the first step in removing QueryResponse.
This PR first creates QueryResult then retrieves the Response.
Eventually, we'll directly create Result from tabledata.list RPC.

This LGTM, although I don't have complete context so others should also approve

Forgot to edit samples :) I'll look into this tomorrow


Kaspersky identifies TabNine.exe as Trojan-Dropper.Win32.Agent.testhz

It deletes this file and it's occuring only since today. 03/12/2020
Path: '.vscode\extensions\tabnine.tabnine-vscode-2.2.3\binaries\2.4.1\x86_64-pc-windows-gnu\TabNine.exe'

dup https://github.com/codota/TabNine/issues/232

This has been a false identification by Kaspersky. If you update Kaspersky to the latest definitions file TabNine.exe should not be flagged anymore.
We will really appreciate if you can verify that it is indeed solved.
We are working with Kaspersky to make sure that this does not repeat in future versions.

It is fine now, thanks.


Out of scope variable captured

  eResult <-
    Retry.retrying limitedJitterBackoff isUniqueViolation
      (\retryStatus -> do
        breakpointIO
        ...
      )

eResult is being captured erroneously.

The presence of this in a where block causes strange errors
    isUniqueViolation _ eResult =
      case eResult of
        Left (EME.UnexpectedError err) ->
          case fromException err of
            Just HDBC.SqlError { HDBC.seState = errCode } ->
              pure $ errCode == HDBC.uniqueViolation
            _ -> pure False
        _ -> pure False


feat: added accessibility label to navigator back button

Summary of Changes
Fixed screen reader text on header back button. Previously it would say "Tabstack Back Button" now it just says back button
Related Issues
N/A
Pull Request Checklist
Tick all boxes below to demonstrate that you have completed the respective task. If the item does not apply to your this PR check it anyway to make it apparent that there's nothing to do.

[x] All commits contain a DCO Signed-off-by line (we use the DCO GitHub app to enforce this);
[x] Updated LICENSE-3RD-PARTY.md for any added dependencies or vendored components;
[x] Updated documentation as needed for changed code and new or modified features;
[x] Added sufficient tests so that overall code coverage is not reduced.

If you have any questions to any of the points above, just submit and ask! This checklist is here to help you, not to deter you from contributing!
Pro Tip 🤓

Read our contribution guide at least once; it will save you a few review cycles!
Your PR will likely not be reviewed until all the above boxes are checked and all automated tests have passed.

PR template adapted from the Python attrs project.

Does translation work when you get the t straight from the i18n package and not from the useTranslation hook?

seems to work, but I should probably do useTranslations, it was one of those automatic import things


Choropleth

Color legend appears to be rounding off scale values to 1 decimal.

It seems related to browser settings.  The legend scale is displayed properly on Tao's and my laptops.  Closing it now.


Use half of the available cores when in watchAll mode

Summary
Fixes #9116
Test plan
Added a new condition in the Returns based on the number of cpus test of the packages/jest-config/src/__tests__/getMaxWorkers.test.ts file

Done @SimenB :smile:

Codecov Report

Merging #9117 into master will increase coverage by <.01%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master    #9117      +/-   ##
==========================================
+ Coverage   64.73%   64.73%   +<.01%
==========================================
  Files         277      277
  Lines       11707    11709       +2
  Branches     2875     2875
==========================================
+ Hits         7578     7580       +2
  Misses       3512     3512
  Partials      617      617

Impacted Files
Coverage Δ

packages/jest-config/src/getMaxWorkers.ts
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ed07de2...7daffce. Read the comment docs.


DB connection pooling for API

I researched this for SQLite a while back, and if I remember correctly it doesn't apply for a file based DB when compared to server based RDBMS... but there might be some solutions that "emulate" this.

See https://github.com/CounterpartyXCP/counterparty-core/issues/1817


ValidateOperationChain field needs to be required

The operation chain field in the ValidateOperationChain needs to be required. Otherwise the handler will throw a null pointer when the store attempts to retrieve the operations

Merged into develop.


[bug] Start storybook when using the test-runner

Describe the bug
It's annoying to have to configure scripts to run storybook, wait for storybook to be loaded, run the tests. Storybook has a server and all the infrastructure to put these pieces together for me. Please add an option to start storybook server with the test runner.
To Reproduce
Create a test-runner test and you will have to configure your scripts to run, wait and then test.
Expected behavior
I expect the test runner for storybook to start a storybook server or have a flag to be able to do this.

Luckily Playwright provides the Web server option to provide exactly this functionality.

Yep. I am all for using the playwright web server to solve this. I have set this up on other projects and it is shocking to me this is locked away.


Where can I find how interaction gains are calculated?

Where can I find how interaction gains are calculated?
Thanks,

Found this except useful from the XGBoost docs:

To build a tree, the dataset is divided recursively several times. At the end of the process, you get groups of observations. Each division operation is called a split.
Not all splits are equally important. Basically the first split of a tree will have more impact on the purity that, for instance, the deepest split. Intuitively, we understand that the first split makes most of the work, and the following splits focus on smaller parts of the dataset which have been misclassified by the first tree.
The improvement brought by each split can be measured, it is the gain.
XGBoost offers a better representation: feature importance. Feature importance is about averaging the gain of each feature for all splits and all trees.

Found this except useful from the XGBoost docs:

To build a tree, the dataset is divided recursively several times. At the end of the process, you get groups of observations. Each division operation is called a split.
Not all splits are equally important. Basically the first split of a tree will have more impact on the purity that, for instance, the deepest split. Intuitively, we understand that the first split makes most of the work, and the following splits focus on smaller parts of the dataset which have been misclassified by the first tree.
The improvement brought by each split can be measured, it is the gain.
XGBoost offers a better representation: feature importance. Feature importance is about averaging the gain of each feature for all splits and all trees.

this is talking about how to select important features, but not the important feature interactions.
I am curious of the question, too. Hope someone can give an answer.


Unable to add Observer or Target points LLOS or RLOS in Pro Add-In with elevation image service

I added the "Terrain" image service from "the living atlas", zoomed in close and tried to add LLOS target and observer points, got error message "Error  Point does not fall within the input extent."  Same thing happens with RLOS observer points (using Military Tools Add-in, Visibility tools).
This error message is not helpful.  Are image services supported? If not, disallow them as the Input surface in the Add-In. Is the coordinate system wrong (Web Mercator)? Let me know.

Data from:

Map coordinate system is WGS 1984 Web Mercator Auxiliary Sphere
ArcGIS Pro 1.4.1
Military Tools Add-In 03-01-2017_1228

Tried running one RLOS on the same elevation data - clicked to add one point in the same extent used above, accepted the Add-In defaults.
ArcGIS Pro began processing...
an hour later, it is still not finished.
Pro using 38% of CPU and nearly 4GB of RAM.

Pro eventually crashed, when I was switching back to the Pro window. 25MB crash dump file resulted, FWIW.

This is good holistic testing and there is a lot going on here so just trying to unpack (and make sure I have correct):

Surface Extent is not determined correctly when using the Living Atlas Terrain worldwide mosaic elevation service: http://www.arcgis.com/home/item.html?id=58a541efc59545e6b7137f961d7de883
Adding LLOS Observer/Target points (and the analysis) is slow when using NED30m elevation service from elevation.arcgis.com (https://elevation.arcgis.com/arcgis/services/NED30m/ImageServer)
Running RLOS on NED30m elevation service is incredibly slow and never finishes

And additional observations deriving from these:

It is not possible to cancel the slow LLOS and RLOS operations in Pro (have to kill Pro)
The addin does not warn you when you are about to do some potentially incredibly slow analysis (that might take minutes or even hours)

I'm not experienced at doing these kinds of analysis using remote services, is there is a realistic expectation to be able to run these kinds of analysis using these continent or worldwide (or even state-wide) remote services?
I would think the expected workflow is to define an Area of Interest & then extract the terrain from this area to create a local dataset for full analysis. If this is the expected/recommended usage then the solution might be to develop some strategies/warnings for documenting this expectation, and alerting the addin user to prevent this condition.
@mfunk @topowright @nfeuerstein @dfoll @kgonzago   might also have a recommendation here - on using remote terrain services with the addin's local analysis tools.

Analysis should not be done on an AOI that large. @csmoore you brought up a good enhancement to the add-in: inform the user before executing analysis on a large AOI. User should cull the AOI to an appropriate size before execution. The add-in should not do that for them. The key now is to define what is an acceptable size for an AOI.

@kgonzago - True. Analysis should not be done on a huge AOI with image services >>but<< as far as the user is concerned, if they've input a point or three in the currently visible extent, especially for RLOS where the default is a relatively small radius around the input points, why is their analysis AOI any larger than the buffer area around those points?  At maximum, their AOI should be the bounding box of the buffer zone around those points. We should be smarter about this. No need to pull down the whole extent.
@csmoore - your workflow of "define an Area of Interest & then extract the terrain from this area to create a local dataset for full analysis" is what someone might currently need to do because of the clunky way we handle it now, but is it really the best way for the user to get their work done?

Just catching up on this now.
The original problem ""Error Point does not fall within the input extent" is almost always a mis-match between coordinate systems which is why the tools should always pick a spatial reference and project the "lightest" inputs to that spatial reference (in this case the observers/minimum bounding extent/buffer boundary).
As for AOI, how large is too large? A problem we've discussed a lot. Just keep in mind that this is a VISIBILITY analysis and is based on what you can SEE. Trying to do analysis across a continent is not well defined for this tool and not realistic based on sight.
Next, make sure we are setting the environment up w.r.t. arcpy.env.mask, arcpy.env.cellSize, and arcpy.env.outputCoordinateSystem BEFORE we do much of the analysis. If we define the areas well and consider coordinate system we shouldn't have to clip the surfaces unless the surface SR is not suitable.
Then, unsuitable surface spatial references (geographic and non-equidistant projections) might force us to clip, but again try to do this in_memory for small resolution areas, in %scratchGDB% for large areas, and tell the user its going to take time.
We tried to do this in the RLOS gp tool, but its still not perfect because of the number of types of rasters (dataset, layer, mosaic, image service), and coordinate system issues (everything goes to local Az Ed based on observers), and need for tighter control (earth curvature, viz control modifiers, etc.).
Too much at once and somehow I'm feeling it's not helping a whole lot.

@mfunk - re "Just keep in mind that this is a VISIBILITY analysis and is based on what you can SEE. Trying to do analysis across a continent is not well defined for this tool and not realistic based on sight." - absolutely. But if I'm zoomed to a mountainous area (say 1:10,00 scale) and I've added points to to use for my analysis, I've implicitly defined an AOI - there is no reason to be pulling down the whole continent.

So, at 1:11,000 scale, on my monitor, this area is only ~2,700m across.

Pro can load all the cells to display them, reasonably quickly.
If I zoom to the raster resolution:

then the area is 35 km across. Big, but not terribly big. Again, all of the pixels loaded reasonably fast. They're all "there" aleady...

If I add a point at this zoom level (where one pixel on my monitor is equal to one pixel in the raster, if Pro is telling me the truth) and use the default inputs for a RLOS (1000m), why should the area examined for visibility be any larger than a square 2,000 m on a side. Since these pixels are 30m square, that AOI is only 66 x 66 pixels.

I added a temporary workaround to this problem in #193 until we can fully resolve.
The problem that occurs in Pro (not ArcMap) is that when a new point is added, it is checked against the extent of the surface and this call to ImageServiceLayer.QueryExtent() is taking several minutes to return - during which Pro is unresponsive.
To fully fix we should:

submit a bug against Pro SDK ImageServiceLayer.QueryExtent() taking several minutes to return with some image services (ex. the one above: http://www.arcgis.com/home/item.html?id=58a541efc59545e6b7137f961d7de883)
get guidance on an alternate method for getting the extent of ImageServiceLayer (like Pro is able to do on properties page, screenshot below)

This issue has been resolved with the fix for the image service warning.  Closing issue.


how to place the dataset and train the model, i have many errors

i have the same question

i have the same question

Have you solved it? I met the same problem

Turn the shuffle(in dataloader) to False


Remove non-ISO US subdivisions

Remove US subdivisions AA, AE, AP.
Armed forces subdivisions are USPS codes, but not ISO subdivisions

Hi! Stumbled over this PR/commit when some "AE" addresses in our system stopped working after a "countries" update.
Do you have any thoughts on what a suitable migration path is for pre-existing such addresses? A quick Google gives me https://kb.blackbaud.com/knowledgebase/Article/66988 which suggests picking California and adding "AE" to the city. I'll do a bit more research but thought I'd ask here as well.

@henrik You can add custom data for subdivisions. It's not documented, but something like this in an initializer should let you add the non-ISO subdivisions:
c = ISO3166::Country.new('US')
c.subdivisions['AA'] = ISO3166::Subdivision.new(name: 'Armed Forces Americas', code: 'AA')
c.subdivisions['AE'] = ISO3166::Subdivision.new(name: 'Armed Forces Europe', code: 'AE')
c.subdivisions['AP'] = ISO3166::Subdivision.new(name: 'Armed Forces Pacific', code: 'AP')

Thank you! Yeah, that was one of the alternatives I considered. Perhaps that's a better idea in our case than migrating addresses to something ISO-valid. Not aware of us seeing any issues from non-ISO US subdivisions.

Don't forget to add translations,
country.subdivisions['AE'] = ISO3166::Subdivision.new(
  name: 'Armed Forces Europe',
  code: 'AE',
  translations: {
    'en' => 'Armed Forces Europe'
  }
)

Methods like subdivision_names_with_codes will raise an error if translations are undefined.

@jaredbeck Thanks for that, I hadn't noticed, and that sounds like a bug. Will look into it


tf.shape output is wrong when net input shape is changed during import

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 7
TensorFlow installed from (source or binary): pip
TensorFlow version (use command below): 1.8.0 (still present in 2.6.0, updating the code accordingly)
Python version: 3.6.6
CUDA/cuDNN version: N/A
GPU model and memory: N/A
Bazel version: N/A
Mobile device: N/A
Exact command to reproduce: see below

Describe the problem
tf.shape returns an inconsistent result when a network is imported from file and its input is changed during the import. Let me create a simple net with a batch_size of 128, and save it to disk
import tensorflow.compat.v1 as tf
tf.disable_v2_behavior()

batch_size = 128
x = tf.placeholder(tf.float32, shape=(batch_size, 10), name='x')
b = tf.Variable(tf.zeros((10)))
y = tf.add(x, b, name='y')

saver = tf.train.Saver()
with tf.Session() as sess:
  tf.global_variables_initializer().run()
  saver.save(sess, './foo')

Later, I reload this model, and replace the input placeholder with a more flexible one, with an undefined batch_size.
import numpy as np
import tensorflow.compat.v1 as tf
tf.disable_v2_behavior()

x = tf.placeholder(tf.float32, shape=(None, 10))
restorer = tf.train.import_meta_graph('./foo.meta', input_map={'x:0': x})
y = tf.get_default_graph().get_tensor_by_name('y:0')
y_shape = tf.shape(y)
sess = tf.Session()
restorer.restore(sess, './foo')
[y_, y_shape_] = sess.run(['y:0', y_shape], {x: np.zeros((1, 10), np.float32)})
assert np.all(y_.shape == y_shape_), 'inconsistent sizes'

This results in an AssertionError: inconsistent sizes, because y_shape_ still returns the old batch size of 128, despite the output y being computed as expected with a batch size of 1.

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Bazel version
Mobile device

Done

Nagging Assignee @allenlavoie: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @allenlavoie: It has been 45 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @allenlavoie: It has been 60 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @allenlavoie: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @allenlavoie: It has been 31 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

I am also affected by this -- is there an official way to save a model after training while keeping it independent of the batch size?

Nagging Assignee @allenlavoie: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Is there any progress ? I also troubled by this when I want to put images with different size into the frozen model.

Rerunning shape inference does seem like a good thing to do with an input_map. I'm not going to get to this (if it wasn't obvious from the months where I haven't gotten to it). Happy to advise if someone wants to try a fix.

I think the following script should remove the _output_shapes attributes from the saved model:
import sys

import tensorflow as tf

metagraph_file = sys.argv[1]
metagraph = tf.MetaGraphDef()

with open(metagraph_file) as f:
  metagraph.ParseFromString(f.read())

for node in metagraph.graph_def.node:
  if "_output_shapes" in node.attr:
    del node.attr["_output_shapes"]

with open(metagraph_file, "w") as f:
  f.write(metagraph.SerializeToString())

In your example above, you should pass ./foo.meta as the argument (this is the serialized MetaGraphDef proto).

Our GraphDef Editor library (a version of contrib.graph_editor that operates over serialized graphs) has facilities for importing a serialized graph, modifying the shape/dtype of an input placeholder, then propagating the resulting shape/dtype changes forward through the graph. See https://github.com/CODAIT/graph_def_editor/blob/master/examples/batch_size_example.py for an example that modifies batch size. The rewrite code invoked that example is here.

Hi @tazr ,
We see that you are using old version of Tensorflow which is officially considered as end of life, We recommend that you upgrade to 2.6 version and let us know if the issue still persists in newer versions .Please open a new issue in case you face any errors, we will get you the right help .Thanks!

@tazr ,I was getting invalid arguement  error though in above code ,  Could you attach your collab gist here for others reference ?Attaching my GIST in TF 2.6 for reference.

@mohantym It is because you are running both programs sequentially, rather than from two different processes, as expected. In a single collab you could perhaps simulate that by using different graphs:
from glob import glob
import sys
print('sys:', sys.version)
import tensorflow.compat.v1 as tf
print('tf:', tf.version.VERSION)
tf.disable_v2_behavior()

with tf.Graph().as_default():
  batch_size = 128
  x = tf.placeholder(tf.float32, shape=(batch_size, 10), name='x')
  b = tf.Variable(tf.zeros((10)))
  y = tf.add(x, b, name='y')

  saver = tf.train.Saver()
  with tf.Session() as sess:
    tf.global_variables_initializer().run()
    assert not glob('./foo')
    saver.save(sess, './foo')

import numpy as np
import tensorflow.compat.v1 as tf
tf.disable_v2_behavior()

with tf.Graph().as_default():
  x = tf.placeholder(tf.float32, shape=(None, 10))
  restorer = tf.train.import_meta_graph('./foo.meta', input_map={'x:0': x})
  y = tf.get_default_graph().get_tensor_by_name('y:0')
  y_shape = tf.shape(y)
  sess = tf.Session()
  restorer.restore(sess, './foo')
  [y_, y_shape_] = sess.run(['y:0', y_shape], {x: np.zeros((1, 10), np.float32)})
  assert np.all(y_.shape == y_shape_), f'inconsistent sizes: {y_.shape}'

It is replicating in 2.8 version with above code.

Hi,
Thank you for opening this issue. Since this issue has been open for a long time, the code/debug information for this issue may not be relevant with the current state of the code base.
The Tensorflow team is constantly improving the framework by fixing bugs and adding new features. We suggest you try the latest TensorFlow version with the latest compatible hardware configuration which could potentially resolve the issue. If you are still facing the issue, please create a new GitHub issue with your latest findings, with all the debugging information which could help us investigate.
Please follow the release notes to stay up to date with the latest developments which are happening in the Tensorflow space.


Integration test with Kubernetes e2e framework

Do you want to request a feature or report a bug?
Feature
What did you expect to see?

Currently, we don't have an end-to-end test with Kubernetes provider. But fortunately, Kubernetes has already provided a complete e2e framework and it might save a lot of work if we build our integration test system above it. 😸
@timoreimann

Related: #1889

@yue9944882 this sounds very interesting -- what would it take to leverage the upstream e2e framework? I suppose some VMs running somewhere?
Do you know if it would be possible to run the tests locally as well?

Another question: how can we access the framework? is it part of client-go?

@timoreimann tricked. sadly, we can't use that framework unless we vendor the entire kubernetes repo. making use of e2e seems impossible.


Fix: Added URL for local server to README

Had trouble finding where the local development server was running, may be helpful to include in readme somewhere.

@Kcorb95 this PR includes commits from your other PR. Can you separate the commits, so that I can merge this one - while the other PR is in review?

@loopDelicious
Fixed 👍