[Feature] Public API for getting list of rulesets

Describe the new feature:
A public api for getting the list of rulesets, and information about rulesets.
For my use case, I'm building a simple ruleset manager, and I think it'll be better to use this existing collection of rulesets instead of creating another one.
Proposal design of the feature:
A rest api that returns a json, something like
https://api.rulesets.info/v1/rulesets => {"rulesets": [{"name": "tau", "repository": "https://github.com/naoei/tau/releases/latest/download/osu.Game.Rulesets.Tau.dll", "download": "https://github.com/naoei/tau/releases/latest/download/osu.Game.Rulesets.Tau.dll"}, ...], "status": "200"}
I found this in the code but it doesn't look like it's actually being used anywhere..

That's a good idea! Actually that code is worked now (https://rulesets.info/api/rulesets) but I currently focus on other feature that the rulesets creator requested. I will implemented on it. Thanks for the request!

Thanks for your patient! Now the first part of the API is available now! You can read the documentation in https://docs.rulesets.info/ and start trying it now! You can make a new issues if you have any suggestion on API or some feature suggection.


[winpr,crt] fix ICU string convert

use ucnv_convert to make conversion endian safe
(cherry picked from commit d47058011e7c5e628e47be0d968d0bb2ded63f99)
backport of #9629

@lligurio looks like the fuzzer is no longer compiling? could you have a look?


Data fetch for more than 200 videos

Summary
Currently in a single go data can be fetched for 200 videos. However if there are more than 200 videos then indexing needs to be done, which is okay to do. However, there is no way to find max number of videos present in the channel so that indexing can be done.
Why?
If a channel has more than 200 videos it is difficult to fetch the data.
Ideal implementation
No response
Additional information
No response
Contribution

[ ] I wish to contribute this feature.

Checklist

[X] I have searched the issue tracker for duplicate issues and couldn't find any. If this is a follow-up issue, I have specified as such.

Can you share what you're doing at the moment to get around this, i.e. with the indexing stuff? I think I understand what you mean, but just want to confirm.
As for the total video count, there's no way to get that information out of the Analytics API afaik. You'd need to query the Data API using a different library first to get that info.

This is what I am doing. If further required then, I can merge the CSV files. Till now this is not a requirement. But once the channel has more than 200 videos the code will not work as expected.
from analytix import Client  # or AsyncClient
from datetime import date, datetime, timedelta

def get_report(start_index):
    client = Client("secret.json")
    report = client.retrieve_report(
        dimensions=("video",),
        max_results=20,
        sort_options=("-views",),
        end_date= date.today(),
        currency="EUR",
        start_index=start_index,
        start_date=(date.today() - timedelta(days=365))
    )
    file_name = "analytics"+ str(start_index) +".csv"
    report.to_csv(file_name)
    return file_name

for i in range(2):
    get_report(i+1)

Now I understand that, it is not achievable to get max number of videos using Analytics API. But as you said there are other ways to do so. Thanks for that.

Yeah that's pretty much how you'd have to do it. You could probably simplify it a little by using merging Pandas DataFrames together using report.to_pandas and pd.concat then exporting it all as one CSV. I might have a think about whether I can reasonly make a utility function/method that does it behind the scenes, though I'm not 100% sure atm where it could go.

I am not sure if this should be done as I am new to this but there can be a flow like this.

User enables a flag to go for a index looping
The loop will run till it gets this exception/error analytix.errors.InvalidRequest: the start index is too high
At the end as you said it will merge all the data.

If this is something not doable or shouldn't be done then I think that's it. We can close the issue.

So I've had a bit of a look into this, and API constraints on YouTube's end actually make this impossible. You can't get the 201st result of the query, even if you program the start index to take you there; it just returns a BadRequest (once analytix's verification systems are turned off).


Handle more than 100 zones in route 53

Description
Changed the calls to list_hosted_zones to handle route 53 setups with more than 100 zones.
GitHub Issues
#1661

Coverage decreased (-61.2%) to 11.515% when pulling 0aa7b1d0cb9af5d3c6175f7d89737ea461dd6aa0 on feature/handle-more-than-100-zones into d60273b92af0ab8dd62eee2bcc3ffb914e212aca on master.

Certifying now works on an account with > 100 zones.


GLTFAsset extensions support

I'd like to include some support for the VRM extensions in our app. However, although .extensionsUsed is set by GLTFAsset.load, .extensions is always null even for GLTF files that I verify have the extension data. I've tried tracing through the code, but so far have not figured out how this could be added.

This occurs because although we parse extensions and extras on everything that derives from GLTFObject (including GLTFAsset), we don't currently parse extensions contained by the document root object. cgltf parses these as the data_extensions property on the cgltf_gltf object, but we don't have a natural spot to map that to, since we consider the asset to be the root object.
I think the best way forward would be to add a new dictionary property to GLTFAsset to hold document root extensions. Perhaps rootExtensions would be a reasonable name?

As of 8f2e65d, new rootExtensions and rootExtras properties are now implemented on GLTFAsset. Obviously to make use of the data they contain you'll need to convert them to objects according to the VRM (or other) extension specifications, but at least they're available now.
If these additions prove satisfactory they can be rolled into a release soon.

The addition of rootExtensions and rootExtras solves my need for VRM support. Thanks VERY much and especially for the quick response!

Excellent, thanks for confirming. This change has now been incorporated into release 0.5.12.


interventions: add a tag describing annotation from a set list

As an intervention data editor looking to add a tag describing a particular intervention, I would like to be able to choose from an auto-complete (or similar) menu of previously established tags: underlining; circling; arrow; bracket(s); line; correction; marginal mark; punctuation mark; verbal annotation; insertion; flyleaf note.

Can use annotation code from https://github.com/Princeton-CDH/winthrop-django/issues/43 (use case looks entirely similar), except for annotation vs insertion (which will need to be categorical and chosen up front per conversation with @rlskoeser).

@rlskoeser @bwhicks This works, but it's a little wonky. I find that when I try to select a highlighted tag (either from the dropdown menu or after typing it), it usually takes a few tries to get it to actually select.  This might just be my browser (Safari), but it's happening consistently.

@bwhicks can you take a look at this, maybe test in a few different browsers and see if the behavior is any different?

@rlskoeser I can confirm this on Firefox 55.0b8 and Chrome 60.0.3087.0 (Canary). Actually on Chrome, I can't get it to select period.

Drat.  I see from the console that I broke something in the javascript.  I'll kick it back for us to fix.


Fixed Footer

Hi,
I'm trying to make a fixed footer -  I looked this up and saw that I needed to provide the "fixed" attribute to the nb-layout-footer directive. Turns out this is already added in in the sample layout - therefore I presume that the footer should also be fixed in the demo?
I checked the console and tried to analyse what was going on - the styles applied to the header contain a ".fixed" selector in which there is a "position: fixed" property, however the footer does not, despite it being fixed (screen capture attached).
Am I doing something wrong, or is the fixed class not added to the footer layout? I am trying without success to use npm link to modify the theme module locally..
Thanks,
Luke

Is this still an issue, I seem to be having same problem!

Here is the workaround worked for me... We have to place this in our layout scss file
::ng-deep {
nb-layout-footer {
  &.fixed {
    position: fixed;
    bottom: 0;
    z-index: 1040;
    width: 100%;

    @at-root {
      ::ng-deep {
        .layout-container .content .columns {
          nb-layout-column {
            padding-bottom: 3.25rem !important;
          }
        }
      }
    }
  }
}

}

I handle this problem with this piece of code in the styles.scss, hope it help you
::ng-deep {
  @media only screen and (max-width: 575px) {
    body {
      overflow-y: auto !important;
    }
    .scrollable-container {
      height: unset !important;
    }
  }
}


This portion of code must not be reached in getDelta get reached

I'm trying to see exactly when it's occuring.

You can reproduce it by deleting orld!↵So from the initial example.

done


Add listen from svelte/internals

Implementing the suggestion in #1: Copying over listen from svelte/internals to support svelte 5
Thanks!

Thank you. Released 1.0.2 with this change.


Code Outline jump to line in focused editor, not the correct file editor.

Two-column layout, different files opened.
Have focus in right editor.
Code Outline shows correct outline for left editor.
Click on anything in the outline while focused on right editor.
Right editor jump to correct line for the clicked item, just in the wrong editor.

Closing this since we are going to deprecate our implementation of CodeOutline as it's now built-in feature of VSCode


Line 110 syntax error in Python 3.7.3

C:\Users\Tony Stafford\Documents\PBASEMAPS\Planet-Mosaic-Quads-Download-CLI-master\pbasemap>python pbasemap.py -h
File "pbasemap.py", line 110
usage: pbasemap.py [-h] {rbox,mosaic_list,download,mpdownload,shp2geojson} ...
^
SyntaxError: invalid syntax

Could not replicate this issue, closing for now


CUBaseMiniDiagnosticsView doesn't update unless redrawn by usercontrol parent [BUG] [FEATURE]

Describe the bug
CUBaseMiniDiagnosticsView is only shown when UI elements are redrawn. ie exiting then reentering the view otherwise it remains static showing outdated data or not showing relevant data.
To Reproduce
Steps to reproduce the behavior:

Go to any cu that will produce diagnostic messages in its context.
Wait for messages to show up.
After messages fail to appear exit to operator view and reenter cu view.
Diagnostic messages appear, but do not dissapear or change.

Expected behavior
Messages sould appear and dissappear as they do in the model or at least poll changes at set intervals if it would be too much of a performance hit or would cause issues viewing the results.
Screenshots

Additional remark
It would be neat if the number of messages could be limited to only a handful.

cleses #131


Possibly incorrect test assertions for min_likes and min_retweets

Hi there! I was working on a PR to address Issue 49.
However, I noticed some confusing discrepancies between the README and the test assertions, and wanted to clarify first before submitting PRs.
min_likes expectations:
https://github.com/koenrh/delete-tweets/blob/d4d9161addc25e953abef39507e522f912d370fa/test_deletetweets.py#L86
Shouldn't the expected value be [{"id_str": "21"}] ?
According to the docs, it seems like the TweetReader should exclude any tweets with at least one or more retweet.
If you take a look at the actual TweetReader list in that test case by dropping in a breakpoint.
actual = list(TweetReader(FakeReader(tweets), min_likes=1).read())
(Pdb) actual
=> [{'id_str': '21', 'favorite_count': 0}]

min_retweets expectations:
Should this line
https://github.com/koenrh/delete-tweets/blob/d4d9161addc25e953abef39507e522f912d370fa/test_deletetweets.py#L97
be expected = [{'id_str': '21', 'retweet_count': 0}]?
Just like the above example, inspecting the actual list in the test returns: => [{'id_str': '21', 'retweet_count': 0}]

Since the expected lists don't match the actual lists, both of those tests are false positives. Might want to add
self.assertEqual(len(expected), len(actual))

to avoid false positives.

Hi @lorainekv,
Apologies for the delayed response.
I think you are right! Feel free to submit the pull request.


Add jck22 config files

Close #5158

@llxia  https://github.com/adoptium/aqa-tests/pull/4882#issuecomment-1822733151 mentioned grinder testing with jck22 has been done Could you check if those two files are good?

FYI, Other vendors use alternate config files, so only Grinders needed are for temurin-compliance server.

Eclipse grinder /Grinder/4108

Cannot write: No space left on device


[📑 Docs]: suggestions on 'coming-from-openapi.md' file

What Dev Docs changes are you proposing?
I have some questions and suggestions to discuss that may improve this doc:

In this line, I propose we change We wanted to have as much compatibility as possible between the two so users could reuse parts in both. to We wanted to have as much compatibility as possible between the two so that the users could reuse parts in both.

Can this be written like this Event-Driven Architectures? Because I've seen it being used like this.

Can we add a redirection link to Avro schema. documentation here? If someone wants to understand what is Avro schema, they can read the docs. I'm guessing there is a documentation on this from AsyncAPI as I recall I've read the word Avro somewhere in docs before.

cc: @thulieblack @alequetzalli @Mayaleeeee
Code of Conduct

[X] I agree to follow this project's Code of Conduct

@Mayaleeeee @alequetzalli @thulieblack wanna have a look? :eyes:

sorry @AnimeshKumar923, please keep in mind that @Mayaleeeee contributes to design tasks, not docs. Similarly, @thulieblack doesn't really work on docs, she is focused on community management tasks.

Great idea, thanks for bringing this one up, @AnimeshKumar923 ✌🏽

sorry @AnimeshKumar923, please keep in mind that @Mayaleeeee contributes to design tasks, not docs. Similarly, @thulieblack doesn't really work on docs, she is focused on community management tasks.

Thanks for letting me know. Will keep this in mind next time.👍🏻

Great idea, thanks for bringing this one up, @AnimeshKumar923 ✌🏽

Glad to be of help! 😁


Nested markup and orphan characters

Describe the bug
With the latest changes to in-line markup, I have noticed a bug related with nested markup and orphan characters.
Take the following expression:
zoo =and *boo and= bar* and *goo zar*

We end up with verbatim highlight on =and *boo and= and bold on * and * which is wrong since bar* does not start a bold markup.
This problem is particularly frequent with links like the following:
This is [[https://foobar/foo]] foo/

Which highlights as italic /foobar/foo]] foo/.
Steps to reproduce

Open a new org file.
Add the following:

foo =and *foo and= bar* and *foo bar*

Expected behavior
The correct behavior is to have verbatim highlight on =and *foo and= and bold on *foo bar*.
Emacs functionality
N/A
Minimal init.lua
N/A
Screenshots and recordings
No response
OS / Distro
Ubuntu 22.04
Neovim version/commit
0.8
Additional context
No response

Emacs itself doesn't really know how to handle some of these when link has some spaces:

But I guess spaces are just not a valid char in a link.

I think I managed to fix this issue with PR #431.

These issues should be fixed on latest master.


Android resource linking failed

I have an AAR file contain calendar library and I try to merge with other app I am getting following error
Android resource linking failed
/home/user/.gradle/caches/transforms-2/files-2.1/3da12e3a6db28dd47aae1bc1999548f9/res/layout/fragment_calendar.xml:15: error: attribute mcv_selectionColor (aka com.user.myapplication:mcv_selectionColor) not found.
/home/user/.gradle/caches/transforms-2/files-2.1/3da12e3a6db28dd47aae1bc1999548f9/res/layout/fragment_calendar.xml:15: error: attribute mcv_showOtherDates (aka com.user.myapplication:mcv_showOtherDates) not found.
error: failed linking file resources.

The same here. (Version: 2.0.1)


Coinbase Pro REST plugin input exception

Hi. I'm just getting started with Dali-RP2. I'm trying to use the Coinbase Pro plugin, but I'm getting the following exception. Any guidance on how to resolve? Thanks!

2022-09-09 12:49:38,159/dali/INFO: Country: us
2022-09-09 12:49:38,171/dali/INFO: Initialized input plugin 'dali.plugin.input.rest.coinbase_pro '
2022-09-09 12:49:38,173/dali/INFO: No pair converter plugins found in configuration file: using default pair converters.
2022-09-09 12:49:38,178/dali/INFO: Reading crypto data using plugin 'dali.plugin.input.rest.coinbase_pro '
2022-09-09 12:50:01,429/dali/ERROR: Fatal exception occurred:
Traceback (most recent call last):
File "/home/mint21/.local/lib/python3.10/site-packages/dali/dali_main.py", line 163, in _dali_main_internal
result_list = pool.map(_input_plugin_helper, input_plugin_args_list)
File "/usr/lib/python3.10/multiprocessing/pool.py", line 364, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/usr/lib/python3.10/multiprocessing/pool.py", line 771, in get
raise self._value
File "/usr/lib/python3.10/multiprocessing/pool.py", line 125, in worker
result = (True, func(*args, **kwds))
File "/usr/lib/python3.10/multiprocessing/pool.py", line 48, in mapstar
return list(map(*args))
File "/home/mint21/.local/lib/python3.10/site-packages/dali/dali_main.py", line 199, in _input_plugin_helper
plugin_transactions = input_plugin.load()
File "/home/mint21/.local/lib/python3.10/site-packages/dali/plugin/input/rest/coinbase_pro.py", line 157, in load
process_account_result_list = pool.map(self._process_account, accounts)
File "/usr/lib/python3.10/multiprocessing/pool.py", line 364, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/usr/lib/python3.10/multiprocessing/pool.py", line 771, in get
raise self._value
File "/usr/lib/python3.10/multiprocessing/pool.py", line 125, in worker
result = (True, func(*args, **kwds))
File "/usr/lib/python3.10/multiprocessing/pool.py", line 48, in mapstar
return list(map(*args))
File "/home/mint21/.local/lib/python3.10/site-packages/dali/plugin/input/rest/coinbase_pro.py", line 185, in _process_account
self._process_transfer(transaction, currency, intra_transaction_list)
File "/home/mint21/.local/lib/python3.10/site-packages/dali/plugin/input/rest/coinbase_pro.py", line 224, in _process_transfer
transfer_id: str = transaction_details[_TRANSFER_ID]
KeyError: 'transfer_id'
2022-09-09 12:50:01,434/dali/INFO: Log file: ./log/rp2_2022_09_09_12_49_37_655412.log
2022-09-09 12:50:01,434/dali/INFO: Generated output directory: output
2022-09-09 12:50:01,434/dali/INFO: Done

Thanks for reporting a bug! To resolve it I'll need the debug log line of the problematic transaction. Here's what to do:

first read https://github.com/eprbell/dali-rp2/blob/main/CONTRIBUTING.md. What we need here is one single line from your debug log, but this line may contain personal information: make sure you're OK with sharing it, or anonymize it before sharing it;
in your configuration.ini file delete any data loader plugin section except the Coinbase Pro one: we want to run only the CBPro data loader;
in the CBPro section of the configuration.ini file, make sure to pass thread_count=1 (if you need the reference manual: https://github.com/eprbell/dali-rp2/blob/main/docs/configuration_file.md#coinbase-pro-section-rest);
delete the log dir;
run rp2 with debug log level: LOG_LEVEL=DEBUG bin/dali_us -t 1 -s -o output/ my_config.ini;
the log directory contains the new debug-enabled log file: look inside the log file for the last entry that was read from Coinbase Pro. That line should be the one we need. The error is saying it's a transfer transaction without a transfer id: both strange and interesting. Hopefully this log line will shed some light on this.

Thanks for the reply and the info! I'm including the last few lines of the log (prior to the traceback), as they seem possibly related (and therefore relevant).
2022-09-09 15:13:11,863/Coinbase Pro/Greg/DEBUG: Transfer: {"id": "58a11155-fe96-4f7b-a915-10fd151212ae", "type": "withdraw", "created_at": "2021-10-09 15:15:13.121313+00", "completed_at": "2021-10-09 15:15:47.587375+00", "account_id": "6c7f97c7-4deb-497f-9f02-99d5b91038db", "user_id": "60d8c47a1c22150e7ccc6df4", "amount": "12.82100000", "details": {"fee": "0.000005", "subtotal": "12.820995", "sent_to_address": "4AJisbFMLuxaEstFqLBiF1PM2MBWzyzzUKPjsp6FK1mb", "coinbase_account_id": "eeec9642-925f-5611-b485-40c5e3165087", "coinbase_withdrawal_id": "6161b2030b25fc02cbb337b9", "coinbase_transaction_id": "6161b20140f4bf00015b0702", "crypto_transaction_hash": "3hZGYkHoYFNYYPCL1eXbsa3sgrAPYzcmUZbuva4Bm43ZQ7rzhkPo7233KYwqAYnJ8H4P23nNUuVHST6s4Rx2cvd7", "coinbase_payment_method_id": ""}, "canceled_at": null, "processed_at": "2021-10-09 15:15:47.596282+00", "user_nonce": "1633792455923", "idem": null}
2022-09-09 15:13:11,863/Coinbase Pro/Greg/DEBUG: Transfer is a Coinbase transaction already captured by Coinbase plugin: ignoring.
2022-09-09 15:13:11,864/Coinbase Pro/Greg/DEBUG: Transaction: {"id": "11275304484", "amount": "12.8210000000000000", "balance": "12.8210000000000000", "created_at": "2021-10-09T15:11:55.187005Z", "type": "transfer", "details": {"from": "ccbef35f-d0c3-4a80-8ec5-f7e701f58ea1", "profile_transfer_id": "19d52363-3563-4398-8e6f-66c039b1bcff", "to": "6c7f97c7-4deb-497f-9f02-99d5b91038db"}}
2022-09-09 15:13:11,867/dali/ERROR: Fatal exception occurred:

Yes, the last line fits the bill:
*"type": "transfer"

no "transfer_id" in the "details" section

I haven't seen this type of transaction before: could you look for it on Coinbase Pro and share more about the nature of this transaction. What kind of momevent is it capturing?
Some notes:

while there is no "transfer_id", there is a "profile_transfer_id"
there are two "from" and "to" fields that seem to have Coinbase ids: is this a transfer from / to Coinbase?

I suspect this is a transfer to/from Coinbase, which is denoted by a different keyword: profile_transfer_id rather than transfer_id.
Could you check the following:

does this transaction appear in the coinbase debug log as well? To find out: use a .ini file containing only the coinbase data loader and run dali with debug log level as described above. If you find a transaction in the log that matches the amounts and other details of this one, then this is another occurrence of this: https://github.com/eprbell/dali-rp2/blob/main/src/dali/plugin/input/rest/coinbase_pro.py#L232
log on the websites (both Coinbase and Coinbase Pro), look for this transaction and describe here what it is and what it does.

I did some digging. It's not a transfer to/from Coinbase and Coinbase Pro, but it is between two portfolios within Coinbase Pro. What seems to have happened is I transferred SOL from my Secondary Portfolio to my Primary Portfolio. The Secondary Portfolio shows a single withdrawal transaction, and the Primary shows a deposit and a withdrawal. Here's the info:
Primary Portfolio
Withdraw
11:15:47 am - Oct 09, 2021 EDT
-12.821000000
0.000000000
Transfer ID:
58a11155-fe96-4f7b-a915-10fd151212ae
Deposit
11:11:55 am - Oct 09, 2021 EDT
12.821000000
12.821000000
$445.27
from:
ccbef35f-d0c3-4a80-8ec5-f7e701f58ea1
profileTransferId:
19d52363-3563-4398-8e6f-66c039b1bcff
to:
6c7f97c7-4deb-497f-9f02-99d5b91038db
Secondary Portfolio
Withdraw
11:11:55 am - Oct 09, 2021 EDT
-12.821000000
0.000000000
from:
ccbef35f-d0c3-4a80-8ec5-f7e701f58ea1
profileTransferId:
19d52363-3563-4398-8e6f-66c039b1bcff
to:
6c7f97c7-4deb-497f-9f02-99d5b91038db

Interesting. Can you also clarify what is a primary vs secondary cbpro account? I'm not familiar with that. How many cbpro sections do you have in your .ini file? Does the secondary account have a different secret/passphrase or the same as the primary one?

I probably misled you a bit by saying Primary and Secondary. For me they are "primary" and "secondary", but you can have as many "portfolios" in Coinbase Pro as you like (as far as I am aware). It's basically a way of segregating a single account/login into separate "sub-accounts", where you can trade independently in each, and do transfers between portfolios. My "primary" I used for regular trading, and my "secondary" I used for bot trading with 3Commas. And in this particular case I transferred a SOL position from the secondary/3Commas/bot portfolio to the primary portfolio. Hopefully that makes sense.
As for the .ini file: That's a good point. At the moment I only have a data loader for the "primary". (Each portfolio does require separate keys for API access.)

Thanks for the clarification. I think we need to run a few experiments since the multiple porfolio scenario is something I don't have and can't test directly.
Some more questions first:

the run you did is for your secondary portfolio, correct?
the withdrawal information is repeated both in your primary and secondary (but the deposit is only in the primary), right?

Here are the experiments to run.
Experiment 1:

run DaLI again but this time with your primary account. Does it work or do you get any errors?
if it works then look for the withdrawal and deposit lines and paste them here

Experiment 2:

apply this diff:

diff --git a/src/dali/plugin/input/rest/coinbase_pro.py b/src/dali/plugin/input/rest/coinbase_pro.py
index a39b517..e541c13 100644
--- a/src/dali/plugin/input/rest/coinbase_pro.py
+++ b/src/dali/plugin/input/rest/coinbase_pro.py
@@ -59,6 +59,7 @@ _MATCH: str = "match"
 _ORDER_ID: str = "order_id"
 _PRICE: str = "price"
 _PRODUCT_ID: str = "product_id"
+_PROFILE_TRANSFER_ID: str = "profile_transfer_id"
 _SELL: str = "sell"
 _SIDE: str = "side"
 _SIZE: str = "size"
@@ -221,7 +222,11 @@ class InputPlugin(AbstractInputPlugin):
         if amount < ZERO:
             amount = -amount  # type: ignore
         transaction_details: Any = transaction[_DETAILS]
-        transfer_id: str = transaction_details[_TRANSFER_ID]
+        transfer_id: str
+        if _TRANSFER_ID in transaction_details:
+            transfer_id = transaction_details[_TRANSFER_ID]
+        elif _PROFILE_TRANSFER_ID in transaction_details:
+            transfer_id = transaction_details[_PROFILE_TRANSFER_ID]
         transfer: Any = self.__get_transfer(transfer_id)
         transfer_details: Any = transfer[_DETAILS]
         crypto_hash: str = Keyword.UNKNOWN.value

run DaLI again on the secondary portfolio. Does it go further? If it doesn't crash look for the line in the log immediately after the culplrit one (it should be a line starting with "Transfer:").

Actually, the run I did initially was for my primary portfolio. Below is the info for my secondary ("bot") portfolio.
As you can see, there is an error for the secondary, also; and it is for the same SOL transaction as in the primary.
"the withdrawal information is repeated both in your primary and secondary (but the deposit is only in the primary), right?"
Right!
Regarding the Experiment 2, I'll probably need some guidance on how to do that. I'm currently using the installed software. I can clone the repo locally and can apply the diff, but can you tell me how to run it from the source? (I have no Python experience.)

2022-09-10 09:30:51,389/Coinbase Pro/Greg/DEBUG: Transaction: {"id": "11275304483", "amount": "-12.8210000000000000", "balance": "0.0000000000000000", "created_at": "2021-10-09T15:11:55.187005Z", "type": "transfer", "details": {"from": "ccbef35f-d0c3-4a80-8ec5-f7e701f58ea1", "profile_transfer_id": "19d52363-3563-4398-8e6f-66c039b1bcff", "to": "6c7f97c7-4deb-497f-9f02-99d5b91038db"}}
2022-09-10 09:30:51,392/dali/ERROR: Fatal exception occurred:
Traceback (most recent call last):
File "/home/mint21/.local/lib/python3.10/site-packages/dali/dali_main.py", line 163, in _dali_main_internal
result_list = pool.map(_input_plugin_helper, input_plugin_args_list)
File "/usr/lib/python3.10/multiprocessing/pool.py", line 364, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/usr/lib/python3.10/multiprocessing/pool.py", line 771, in get
raise self._value
File "/usr/lib/python3.10/multiprocessing/pool.py", line 125, in worker
result = (True, func(*args, **kwds))
File "/usr/lib/python3.10/multiprocessing/pool.py", line 48, in mapstar
return list(map(*args))
File "/home/mint21/.local/lib/python3.10/site-packages/dali/dali_main.py", line 199, in _input_plugin_helper
plugin_transactions = input_plugin.load()
File "/home/mint21/.local/lib/python3.10/site-packages/dali/plugin/input/rest/coinbase_pro.py", line 157, in load
process_account_result_list = pool.map(self._process_account, accounts)
File "/usr/lib/python3.10/multiprocessing/pool.py", line 364, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/usr/lib/python3.10/multiprocessing/pool.py", line 771, in get
raise self._value
File "/usr/lib/python3.10/multiprocessing/pool.py", line 125, in worker
result = (True, func(*args, **kwds))
File "/usr/lib/python3.10/multiprocessing/pool.py", line 48, in mapstar
return list(map(*args))
File "/home/mint21/.local/lib/python3.10/site-packages/dali/plugin/input/rest/coinbase_pro.py", line 185, in _process_account
self._process_transfer(transaction, currency, intra_transaction_list)
File "/home/mint21/.local/lib/python3.10/site-packages/dali/plugin/input/rest/coinbase_pro.py", line 224, in _process_transfer
transfer_id: str = transaction_details[_TRANSFER_ID]
KeyError: 'transfer_id'

Thanks for the additional details. The other porfolio crashing makes sense (it's the same issue): clearly we are looking at a missing feature, more than a bug (transfers between CBPro "portfolios" are not supported yet). We may have to iterate a few times until we get all details right.
Which brings us to experiment 2. To run it:

clone the DaLI source: git clone https://github.com/eprbell/dali-rp2
setup the environment for development by following these instructions: https://github.com/eprbell/dali-rp2/blob/main/README.dev.md#setup
save the diff from my previous message to a file, say /tmp/patch.diff
cd to the newly cloned DaLI source directory and apply the diff: git apply /tmp/patch.diff
run experiment 2

The goal of experiment 2 is to try to get past the key error and log the transfer data structure (see https://github.com/eprbell/dali-rp2/blob/main/src/dali/plugin/input/rest/coinbase_pro.py#L230).

Ran into some problems with the environment setup.
First of all, I needed to modify these two lines since the "bin" folder for me is in ".venv/local"
. .venv/local/bin/activate
.venv/local/bin/pip3 install -e '.[dev]'
Then, when running this line, it seemed to be working, and then I eventually got the logs below.
.venv/local/bin/pip3 install -e '.[dev]'
Not sure what's going on. BTW, I'm running within a Linux Mint VirtualBox guest (on a Linux Mint host). Unfortunately, my host OS is a few years old, and I was having all sorts of Python related problems (as it requires that both 2.7 and 3.x be installed). That's why I switched to using VirtualBox -- so I could install the latest Mint and not have to deal with out of date Python issues. I'm not sure if the issue below is caused by VirtualBox, but it could be. (I'm working in a "local" folder in the guest, not a shared one on the host.)
I'm happy to keep trying to get this resolved so I can help with the testing, but just so you know, I've decided I won't be able to use RP2 for this filing season. I literally have 11 exchanges/wallets, and RP2 only supports one of them (CoinbasePro). I must have been mad to think I could somehow get it to work for all the others before needing to file in mid-October. I've decided to use CoinLedger.io for now. Hoping it will meet my needs. RP2 is a great project, and I hope I can maybe use it in future, but reality dictates I just won't be able to this time.

  Attempting uninstall: dali-rp2
    Found existing installation: dali-rp2 0.5.2
    Uninstalling dali-rp2-0.5.2:
      Successfully uninstalled dali-rp2-0.5.2
  Running setup.py develop for dali-rp2
    error: subprocess-exited-with-error

    × python setup.py develop did not run successfully.
    │ exit code: 1
    ╰─> [32 lines of output]
        running develop
        /usr/lib/python3/dist-packages/setuptools/command/easy_install.py:158: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
          warnings.warn(
        WARNING: The user site-packages directory is disabled.
        /usr/lib/python3/dist-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
          warnings.warn(
        error: can't create or remove files in install directory

        The following error occurred while trying to add or remove files in the
        installation directory:

            [Errno 13] Permission denied: '/usr/local/lib/python3.10/dist-packages/test-easy-install-9093.write-test'

        The installation directory you specified (via --install-dir, --prefix, or
        the distutils default setting) was:

            /usr/local/lib/python3.10/dist-packages/

        Perhaps your account does not have write access to this directory?  If the
        installation directory is a system-owned directory, you may need to sign in
        as the administrator or "root" account.  If you do not have administrative
        access to this machine, you may wish to choose a different installation
        directory, preferably one that is listed in your PYTHONPATH environment
        variable.

        For information on other options, you may wish to consult the
        documentation at:

          https://setuptools.pypa.io/en/latest/deprecated/easy_install.html

        Please make the appropriate changes for your system and try again.

        [end of output]

    note: This error originates from a subprocess, and is likely not a problem with pip.
  WARNING: No metadata found in /home/mint21/.local/lib/python3.10/site-packages
  Rolling back uninstall of dali-rp2
  Moving to /home/mint21/.local/bin/dali_us
   from /tmp/pip-uninstall-fb46acjc/dali_us
  Moving to /home/mint21/.local/lib/python3.10/site-packages/dali/
   from /home/mint21/.local/lib/python3.10/site-packages/~ali
  Moving to /home/mint21/.local/lib/python3.10/site-packages/dali_rp2-0.5.2.dist-info/
   from /home/mint21/.local/lib/python3.10/site-packages/~ali_rp2-0.5.2.dist-info
error: subprocess-exited-with-error

× python setup.py develop did not run successfully.
│ exit code: 1
╰─> [32 lines of output]
    running develop
    /usr/lib/python3/dist-packages/setuptools/command/easy_install.py:158: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
      warnings.warn(
    WARNING: The user site-packages directory is disabled.
    /usr/lib/python3/dist-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
      warnings.warn(
    error: can't create or remove files in install directory

    The following error occurred while trying to add or remove files in the
    installation directory:

        [Errno 13] Permission denied: '/usr/local/lib/python3.10/dist-packages/test-easy-install-9093.write-test'

    The installation directory you specified (via --install-dir, --prefix, or
    the distutils default setting) was:

        /usr/local/lib/python3.10/dist-packages/

    Perhaps your account does not have write access to this directory?  If the
    installation directory is a system-owned directory, you may need to sign in
    as the administrator or "root" account.  If you do not have administrative
    access to this machine, you may wish to choose a different installation
    directory, preferably one that is listed in your PYTHONPATH environment
    variable.

    For information on other options, you may wish to consult the
    documentation at:

      https://setuptools.pypa.io/en/latest/deprecated/easy_install.html

    Please make the appropriate changes for your system and try again.

    [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.

Looks like some peculiar behavior in Linux Mint: it's trying to write to /usr/local/lib for some reason, which fails (I assume you're not logged in as root). Did the activate step work OK? What happens if you type: which python?
As for you using a different software this time around, I completely understand: RP2 is a work in progress and it's meant to be a community effort (as new plugins or bits of logic are needed, people can fill them in with PRs), so it'll get more and more complete over time. However you have a deadline that's fast approaching and you need to do your taxes ASAP: that's totally reasonable.
In any case, thanks for bringing up this missing bit of implementation in CBPro (I wasn't aware of it before). If you are able to solve the Linux Mint setup issues and want to continue helping on this issue that's great, but if you need to move on to other things, no worries!

Thank you for the reply, and sorry for the delay getting back to you. Life has been kind of crazy and stressful lately. As much as I'd like to try and get my Linux Mint issues resolved and help with testing for the feature implementation, I don't think I'm able to right now. (Maybe at some point.) Sorry.
Thank you for creating this product and for working with me to analyze this particular issue. I hope RP2 and Dali-RP2 continue to grow and thrive in the years ahead. Cheers!

I was able to replicate the same error using Coinbase Pro's sandbox environment. The transaction is basically a transfer between two different portfolios within a Coinbase Pro account.
Steps to replicate (costs no money btw as we are using sandbox).

Go to https://public.sandbox.pro.coinbase.com and login.
Add any asset (BTC, USD, USDC, etc) to the default portfolio
Create another portfolio (by clicking the create button right next to All Portfolios) and move assets from the default portfolio to the newly created portfolio.
Change __API_URL: str = "https://api.pro.coinbase.com/" to  __API_URL: str = "https://api-public.sandbox.pro.coinbase.com/" within coinbase_pro.py  and run

Thanks for the repro! That's quite useful. I have very few cycles for this at the moment. If anybody would like to work on this I'll review PRs.


Point the extension at a subdirectory in the vscode folder

In working on a GitHub repo I often have jekyll build the documentation in a subdirectory.  Currently jekyll-run
executes bundle exec jekyll serve in the vscode directory so I can't just call jekyll-run -- it doesn't find the jekyll info.
It would be great if you could add a configuration option so that you can specify the directory in which bundle exec jekyll serve
gets run.

@jeremy9959 A simple way to solve is by moving your _config.yml, Gemfile, and Gemfile.lock to the root of your vscode directory. Then, add source : ./subdir in the config.yml.


IAM policy document validation

I implemented the basic validation of IAM policy documents. The implementation is not complete, for example, I only validate a few conditions (those starting with Date) thoroughly, but all the basic cases are covered.
I added a lot of test cases for both valid and invalid policy documents. I also verified the results (responses returned by AWS) for every test case.
Fixes #1435.

Coverage decreased (-0.2%) to 92.798% when pulling e9dfa890f4dc989152d7898fb709205598fdc3a2 on acsbendi:policy-validation into 1d890099c32ba63f58e09413ba853af76ca29e9a on spulec:master.

Coverage decreased (-0.2%) to 92.798% when pulling e9dfa890f4dc989152d7898fb709205598fdc3a2 on acsbendi:policy-validation into 1d890099c32ba63f58e09413ba853af76ca29e9a on spulec:master.

This is amazing; thanks!


Explore emit function token

Emit the function token for functions being called.
Demo (dark theme):

Limitations: Does not highlight functions b and f.
The second case can be done through static analysis. The first requires type information.


Idle animations not looping besides Daddy Dearest and Pico

I was making a mod using Kade Engine 1.4.2, however I have noticed 90% of the characters' idle animations don't loop.
Is there a fix for this or can this be fixed soon?
Thanks!

they dont loop because them looping would make them not bop to the beat

Duplicate of #319 probably?


LH processFromRoot errors on 503

Describe the bug
LH processFromRoot errors on 503 for optimism RPC calls
To Reproduce
Steps to reproduce the behavior:

DD Logs:

49 stuck transfers

Sent message to Alchemy team, waiting for response.

fixed

The public endpoint we switched to earlier (https://endpoints.omniatech.io/v1/op/mainnet/public) has the same issue as Alchemy's.
Infura works fine, so switching to that in https://github.com/connext/monorepo/pull/3166


Stuck Login

Hi, I'm stuck at login for a long time, what should I do?

Seems like something has changed in auth flow. Use cookie authorization for now

Should be fixed now


Support search by path/row

Need to look at documentation of the USGS inventory service to see if this search criteria is supported.
/cc @jreiberkyle

@jreiberkyle looks like the usgs api does support additional search criteria. First i need to implement a test query to make sure the results are reasonable, then I'll incorporate a path/row search in this library.

@jreiberkyle - search requests now allow for additional criteria to be specified.
Each dataset (e.g. LANDSAT_8, EO1_HYP_PUB) has a list of fields that are supported by additional criteria requests. A dataset_fields request must be made to see supported fields. This can be done on the command-line:
$ usgs dataset-fields EO1_HYP_PUB --node EE

or using the API:
fields = api.dataset_fields(dataset, node)

To search EO1_HYP_PUB by path/row on the command-line:
usgs search EO1_HYP_PUB --node EE --where target-row 43 --where target-path 184

whereas to search LANDSAT_8 by path/row:
usgs search LANDSAT_8 --node EE --where wrs-row 43 --where wrs-path 184


Laravel 10 Installing error

Error when installing
System info:
Macbook Pro (intel)
MacOS: 12.7.2
PHP=> 8.1
Laravel => 10
Screenshot:

Work like a charm
This did the trick
composer require jodeveloper/msegat:dev-master


zh-trans: add missing trans from 1.12 branch

add trans from 1.12 branch,origin pr https://github.com/kubernetes/website/pull/13878 https://github.com/kubernetes/website/pull/13798 https://github.com/kubernetes/website/pull/13918

/cc @markthink

thanks!
/lgtm
/approve


Missing new Chat Completion Seed

OpenAI added an optional parameter "seed". Are we going to see this one soon?
Would be really great!

Hi @Dustinhoefer
I m not sure if anyone is updating it anymore, you can check this https://github.com/namankhurpia/Easy-open-ai
I m regularly maintaining and adding new features, feel free to raise issues at my repository.
Thanks

Hey @namankhurpia
Thank you for that info! Unfortunately, not all features I need are added yet, will probably switch, once Voice Generation has been added :)
Thanks!

Hi @Dustinhoefer
Voice feature added :)


update hot module query that outputs the json

when the hot module runs for more than a month, the dates on the graph get all sorts of funky

[this query]
(https://github.com/DoSomething/phoenix/blob/dev/lib/modules/dosomething/dosomething_campaign/dosomething_campaign.theme.inc#L295-L298) needs to be updated to grab only the current months so it doesn't look so ~WILD~

This is appears to be happening when a campaign has a hot module running on it for a month, and then the hot module timing gets extended another month. However, I am not sure that should cause any issues with the graph.
From an array of data (from the query above) over all time, the JS creates a separate array of dates and quantities between the start and end date specified in the CMS. To create the four hightlighted dates, it divides the number of days between the start and end date into 4.
So, it shouldn't matter that the hot module runs more than a month or gets extended and we shouldn't have to worry about what that query specifically is bringing back, as it doesn't really determine the data that gets displayed.
I am not sure what the culprit is of the behavior being illustrated in the image above. 1) Considering there is more than 4 highlighted dates being displayed, it seems something more funky is going on than that query returning data from other months, since that doesn't affect what gets displayed on the graph. 2) I remember seeing similar display issues when we were having issues with the timing logic a couple of weeks ago, so it could have been from that.
As for now, the issue has seems to resolved itself with the new year. If this is in fact tied to hot module dates being extended to the next month, then we should check back in February to make sure everything looks ok.
/cc @angaither


autoresize missing from package.js

I've been trying to use the autoresize plugin but I just noticed that it's not listed in package.js. Can it be easily added in or is it more complex?

@danielflippance Thanks for your comment. All available plugins are added to the package.js.

Awesome, thanks for the quick turnaround!


Unable to build the project using Conan.

Hi there,
I am trying to build the Luna project by following the instructions on https://github.com/DEGoodmanWilson/luna/blob/stable/5.0.4/docs/using.md
I am not able to build the project but rather I am running into the error

when I try to build using the command :
sudo conan install . -o build_luna_examples=True -s compiler.libcxx=libstdc++11
Please let me know how do I fix this?
Thanks!

At the moment, Conan appears to be down… 🤦♂  Not your fault!

Hi @DEGoodmanWilson  Is there a place where we can see the current functional status of Conan?
Also, can we build the code without using conan? I am interested in learning about the project and would love to have a running build up.

Conan seems to be working now. The poster in #67 is reporting success, so I am going to close this issue as resolved. Please do feel free to continue commenting on this issue to stay in touch, or reopen it if you encounter further difficulties!


Add an option to tag spans with SQL query args

Hi @XSAM,
This is a follow-up to https://github.com/XSAM/otelsql/pull/115, though were you not interested in merging it, I'll be happy to untangle the git history from those other changes.
This introduces an additional configuration option that enables to tag the SQL queries with their values, so anyone looking at the traces can also see the values.
Here is a screenshot of what it looks like: (see db.args.$1)

If that's good for you, I'll also update the README 🙏

Requires #115 to be merged first, albeit the changes are not really related, but as we did it this way, I'd rather check with you before reworking the PR if that's really needed.

Hi @jhchabran, thanks for this PR.
Could I know more about the specific use case of this feature?

@XSAM when we're looking at traces in prod to debug stuff, some queries can be really hairy and the added ability to look at what are the values for the query args is really useful. Basically everything needed to debug is at the same place, which is very convenient.

@XSAM absolutely!
When we're looking at traces in prod to debug stuff, some queries can be really hairy and the added ability to look at what are the values for the query args is really useful. Basically everything needed to debug is at the same place, which is very convenient.

This sounds useful! But db.args.%1 is not a standard semantic on Semantic conventions for database client calls. I would prefer to create a new function or interface as an option for end-users so that they can generate extra attributes by their preference.
Like
CustomAttributes(ctx context.Context, cfg config, query string, args []driver.NamedValue) []attribute.KeyValue

@jhchabran I can create a PR to provide a such option if you like this proposal.


Update LongParameterList rule to match documentation

The documentation for the LongParameterList rule (in https://github.com/arturbosch/detekt/blob/master/docs/pages/documentation/complexity.md) states:
"Reports functions which have more parameters than a certain threshold (default: 6)."
But it currently also reports functions which have exactly that amount of parameters.
This PR modifies the LongParameterList rule so that it follows the description in the documentation (obviously an alternative is to change the documentation to match the implementation but this seems more natural considering the description of the parameter).

Actually - the way the threshold parameter is used here is consistent with the other rules, so it's obviously a documentation confusion. Will close this PR and raise a doc fix when I get chance.

@anthonykeenan we'd love to merge this doc improvement. Thank you very much.


Update GitHub verison-skew workflow to use 1.12 setup components

Updates version skew workflow to use 1.12 setup components targets.
This unblocks running version skew tests on master which is currently broken because we are using setup components for 1.11.
Demo of PR working on my fork: https://github.com/JoshVanL/dapr/actions/runs/6526229680
Looks like we have a failing backwards compat with Dapr in master

/test-version-skew

Demo of PR working on my fork: https://github.com/JoshVanL/dapr/actions/runs/6526229680
Looks like we have a failing backwards compat with Dapr in master

/test-version-skew


Adapting partial code(file name start with M #2) to the sonar cloud rule

Codecov Report

:exclamation: No coverage uploaded for pull request base (dev@61ebbf2). Click here to learn what that means.
The diff coverage is 26.08%.

@@          Coverage Diff           @@
##             dev    #2179   +/-   ##
======================================
  Coverage       ?   29.86%
  Complexity     ?     1631
======================================
  Files          ?      336
  Lines          ?    17797
  Branches       ?     2238
======================================
  Hits           ?     5315
  Misses         ?    11919
  Partials       ?      563

Impacted Files
Coverage Δ
Complexity Δ

.../dolphinscheduler/dao/upgrade/MysqlUpgradeDao.java
0% <0%> (ø)
0 <0> (?)

...e/dolphinscheduler/server/master/MasterServer.java
0% <0%> (ø)
0 <0> (?)

...e/dolphinscheduler/dao/utils/MysqlPerformance.java
0% <0%> (ø)
0 <0> (?)

...dolphinscheduler/server/monitor/MonitorServer.java
0% <0%> (ø)
0 <0> (?)

.../org/apache/dolphinscheduler/dao/MonitorDBDao.java
8.69% <0%> (ø)
2 <0> (?)

...ler/server/master/runner/MasterTaskExecThread.java
0% <0%> (ø)
0 <0> (?)

...lphinscheduler/dao/datasource/MySQLDataSource.java
0% <0%> (ø)
0 <0> (?)

.../sqoop/generator/sources/MysqlSourceGenerator.java
58.82% <42.85%> (ø)
5 <0> (?)

.../sqoop/generator/targets/MysqlTargetGenerator.java
76.47% <60%> (ø)
4 <0> (?)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 61ebbf2...74b978b. Read the comment docs.

Please re-merge the code and submit


Module name in leafref path

Hi Karthik,
Should the path use the class's module name? Take the line 116-122 in TapiTopology.yang for example. The path uses "Tapi" before "uuid", but this uuid is an attribute of Topology defiled in TapiTopology module. Should the Tapi:uuid be TapiTopology.uuid instead?

        leaf _encapTopology {

            type leafref {
                path '/Tapi:Context/Tapi:_topology/Tapi:uuid';
            }
            config false;
            description "none";
        }

Regards
Hui

I have assigned Ricard as he has tested this with the RI. But I believe the uuid/ID should be prefixed with the module where the list attribute appears. - in this case, the _topology is defined in the Tapi module under the Context.

Hi Hui
In a leafref, the XPath shall reflect the resulting path, i.e. what will be the final position inside the resulting yang tree. The namespace will then be the one related to the module where the definitions are actually used to define the instantiable tree.
So, if you are using the attribute "uuid" as a child node of an instantiable tree belonging to the Tapi: namespace, it will assume that namespace, regardless where it was originally defined.

Thanks Germano. In this case, although Topology is defined in TapiTopology, but it is instantiated in Tapi:Context, so it should be Tapi:uuid.

Agreed.


Signature extraction failed.

[ ] I'm reporting a broken site support issue
[ ] I've verified that I'm running youtube-dl version 2019.11.05
[ ] I've checked that all provided URLs are alive and playable in a browser
[ ] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[ ] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read bugs section in FAQ

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.youtube.com/watch?v=ktvTqknDobU', '--verbose']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.01.17
[debug] Python version 3.7.3 (CPython) - Linux-5.0.0-32-generic-x86_64-with-Ubuntu-19.04-disco
[debug] exe versions: ffmpeg 4.1.3, ffprobe 4.1.3, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] ktvTqknDobU: Downloading webpage
[youtube] ktvTqknDobU: Downloading video info webpage
WARNING: Unable to extract video title
[youtube] {18} signature length 107, html5 player vflu-qpOO
[youtube] ktvTqknDobU: Downloading player https://www.youtube.com/yts/jsbin/player_ias-vflu-qpOO/en_US/base.js
ERROR: Signature extraction failed: Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1232, in _decrypt_signature
    video_id, player_url, s
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1140, in _extract_signature_function
    res = self._parse_sig_js(code)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1204, in _parse_sig_js
    jscode, 'Initial JS player signature function name', group='sig')
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line 983, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract Initial JS player signature function name; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
 (caused by RegexNotFoundError('Unable to extract \x1b[0;34mInitial JS player signature function name\x1b[0m; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1232, in _decrypt_signature
    video_id, player_url, s
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1140, in _extract_signature_function
    res = self._parse_sig_js(code)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1204, in _parse_sig_js
    jscode, 'Initial JS player signature function name', group='sig')
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line 983, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract Initial JS player signature function name; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1232, in _decrypt_signature
    video_id, player_url, s
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1140, in _extract_signature_function
    res = self._parse_sig_js(code)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1204, in _parse_sig_js
    jscode, 'Initial JS player signature function name', group='sig')
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line 983, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract Initial JS player signature function name; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/youtube_dl/YoutubeDL.py", line 793, in extract_info
    ie_result = ie.extract(url)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line 508, in extract
    ie_result = self._real_extract(url)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1891, in _real_extract
    encrypted_sig, video_id, player_url, age_gate)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1242, in _decrypt_signature
    'Signature extraction failed: ' + tb, cause=e)
youtube_dl.utils.ExtractorError: Signature extraction failed: Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1232, in _decrypt_signature
    video_id, player_url, s
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1140, in _extract_signature_function
    res = self._parse_sig_js(code)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/youtube.py", line 1204, in _parse_sig_js
    jscode, 'Initial JS player signature function name', group='sig')
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line 983, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract Initial JS player signature function name; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
 (caused by RegexNotFoundError('Unable to extract \x1b[0;34mInitial JS player signature function name\x1b[0m; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

I've also tried to reinstall youtube-dl, not working...
Right now I'm using youtube-dl-gui and it's worked for me.

GUI is working but CLI version.

[debug] youtube-dl version 2019.01.17

Outdated version according to your log.

Then why do you have .deb version which installs via
apt install youtube-dl

Outdated packages provided via the distribution.
Contact the people responsible for the distro and ask them.


Public snapshot builds

We need to have our snapshots available as binaries, preferably in a public snapshot repo.
This is very useful to test fixed issues before we do a release.

I am playing around with integrating Nima into another OSS project (Jooby) so having snapshots build would help greatly.
I imagine with Nima being one of the first to utilize Loom first class that others might be interested in easily trying it out.

With #7569 we have the ability to do public snapshot builds on demand.  In practice we have not had much demand for this so for now I think that is sufficient.

We are now publishing SNAPSHOT builds to https://oss.sonatype.org/content/repositories/snapshots/io/helidon/helidon-bom/4.1.0-SNAPSHOT/ every time a PR is merged into Helidon 4 (main).


#0: update LN in SD to run with sharded tensor

I chatted offline with @AleksKnezevic and decided to merge the change together with changes in another branch. closing it for now.


Correctly handle reconnection to the previously connected broker

Scenario:

Connect to broker A
Start long-running calculations
Connect to broker B
Connect to broker A

Actual Result is unpredictable, new instance of RHost won't be able to handle response for the request that was created by another instance of RHost
Expected Interactive Window prints output from the calculation, all evaluation requests

This is generally same as a network disconnect in a middle of calculations

Folding into #2176


Catch the expected exception, not everything

As discussed in #57
Line: https://github.com/DataDog/dogapi/pull/57/files#L4R44

Closing and reopening on  datadogpy repo.


git container for testing

First push

@kevinmessiaen , this is a small POC we did with Thomas to check how we could use internal git server. In the future we could use git's http server instead of a third party one


precip bars when multiple met_sites selected

validate functionality.

Multiple sites does not make sense for this plot structure (temporal axis is interrupted with clustered  bars.


Headless Rendering for ImageWidget

Let's say I want to run a script to process a batch of data. If I were interactively processing any one of these datasets, I'd use ImageWidget in a notebook and visualize things.
In this setting, though, I want to generate results from the script, and then use the script to programmatically "create" an ImageWidget, scroll through some number of frames, record everything and save the results to an .mp4 file.
@kushalkolar @clewis7 any ideas on how possible this might be with fastplotlib?

This is how we generate the docs, something like this should work:
import os

# set this before importing fpl
os.environ["WGPU_FORCE_OFFSCREEN"] = "1"

import fastplotlib as fpl

# make your iw or figure

for i in range(10):
    iw.current_index = {"t": i}
    frame = iw.figure.canvas.draw()
    # use a video writer like opencv to write frame to disk


Command failed: [repo]/polkadot-launch/bin/adder-collator-mac export-genesis-state

When running the script on master on a mac with unzipped binaries from mac.zip:

Remove adder-collator-genesis or remove export-genesis-state?

Remove the compiled binaries from the repo.

But then how would I test it?

Test what? polkadot-launch is a tool that allows you to quickly spin up a testnet locally with given relay-chain and collator nodes. I think it's reasonable to assume that the user of polkadot-launch wants to test either the relay chain node or the collator. Since those move way to fast, and incompatibilities and improvements are added almost each day, there is little sense to keep those binaries in the repo.
The reason why it may be useful is to test polkadot-launch itself out of the box. Not in the sense to verify the correctness, but just play with polkadot-launch. I must say that I don't see value in this use-case to cover the headaches of maintaining those binaries.
Also, keeping these binaries in the repo leads to real inconveniences, see https://github.com/paritytech/polkadot-launch/issues/15

I am currently working on this issue (https://github.com/paritytech/polkadot-launch/issues/43).
I could test it with a moonbeam config but then there would be no test for a simple collator.

Ah, ok. You can use the adder-collator from polkadot. To build it, you can issue
cargo build --release -p test-parachain-adder-collator --features=real-overseer
then find the binary under target/release/adder-collator

Ok thanks :)
Feel free to remove the binary, as long as you leave some instructions on how to build it in the README.
Oh and btw if you could assign me to issue 43 it would be nice.


Advantages?

What would I gain by using flatfile? I could just do JSON.parse() on a file myself.
The reason why I don't, and look around github instead, is that I'm concerned about scalability and performance when loading all the data every time.
If flatfile really brings something, compared to native JSON.parse(), then I think you should mention it in the readme.

@rolfen thanks for opening an issue. You definitely could do JSON.parse() on the file yourself. Right now, this library won't bring anything new to the table in regards to scalability or performance, it's more just providing an abstraction for it. It means that it'll be unit tested and maintained independently, but that's really up to your mindset with regards to small modules about whether or not you should use it.


Add Genesis accessibility features

See http://genesis-accessible.org/2015/07/genesis-2-2-accessibility-changes-and-features/
Ultimately, this is the code we want to add to lib/genesis-setup.php
add_theme_support(
    'genesis-accessibility',
    array(
        'headings',
        'drop-down-menu',
        'search-form',
        'skip-links',
        'rems'
    )
);

though currently some of these features conflict with our existing styles or markup.

Since we're using Bootstrap Nav (rather than Genesis built-in nav) we don't need drop-down-menu.

Since we're using Bootstrap Nav (rather than Genesis built-in nav) we don't need drop-down-menu.

the bs navwalker uses aria-haspopup accessibility features already so I'm pretty sure we could just edit it here with this this if we want to support the drop-down-menu  feature:
if ( genesis_a11y( 'drop-down-menu' ) ) {
$atts['aria-haspopup']	= 'true';
}
also, not sure we can support rems until bs4 and 404 is also one of the features available


Some picture's thumbnails are shown as a square in the gallery

Describe the bug
When displaying pictures in the gallery, some of them appear compressed horizontally or vertically, as a square, despite being landscape/portrait. When clicking over that picture, the full picture loads with the correct proportions. Inspecting the metadata, you can see how the resolution appears as 1 x 1 and 0.00MP.
Photo/video (optional) that causes the bug
It seems to be the case with pictures taken with a Moto G (5) Plus. Possible other camera models as well.
(I can share a few examples in private).
Screenshots (optional)

Environment (please complete the following information):

OS: OpenMediaVault 5.6 (based on Debian Buster)
Browser Google Chrome

Used app version:

Docker:latest (2022-07-02)

Hello,
I get the same issue since the last update of my phone.
I don't find the root cause neither the fix yet...
I can provide some samples of those photos if it can help

I also have the same issue using the latest version of the container at this time writing running on my Raspberry Pi 4b (Raspberry Pi OS 64bit).
At the moment, I have only put pictures taken with my Google Pixel 6 phone. Most of the portrait pictures thumbnails appear squared, which makes them look weird. Despite that, when clicking on the thumbnail picture, this is shown in the correct proportions when it is in "full screen" mode.
Please let me know if I can help with more testing to solve such issue.

Can you provide sample photos for testing? also can you test it on the nightly versions?

IMG_20210820_1.zip
Here, I attached 3 pictures that have this issue. I have only tried with version 1.9.3, which I believe was the latest (I'm using this docker container https://hub.docker.com/r/bpatrik/pigallery2). I have not tried with nightly versions.

In my pigallery2 the image shown but there is some log that pretty concerning
The pics on pigpallery

The logs
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:21 AM[SILLY][DiskManager] scanning directory: zip
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:21 AM[DEBUG][MetadataLoader] Error parsing exif /images/zip/IMG_20210820_171223182_HDR.jpg TypeError: Corrupt JPG, exceeded buffer limits
pigallery2d_app.1.car76vhj32a6@homelab    |     at validateBuffer (/home/debian/pigallery2/node_modules/image-size/dist/types/jpg.js:77:15)
pigallery2d_app.1.car76vhj32a6@homelab    |     at Object.calculate (/home/debian/pigallery2/node_modules/image-size/dist/types/jpg.js:101:13)
pigallery2d_app.1.car76vhj32a6@homelab    |     at lookup (/home/debian/pigallery2/node_modules/image-size/dist/index.js:34:53)
pigallery2d_app.1.car76vhj32a6@homelab    |     at imageSize (/home/debian/pigallery2/node_modules/image-size/dist/index.js:113:16)
pigallery2d_app.1.car76vhj32a6@homelab    |     at /home/debian/pigallery2/src/backend/model/threading/MetadataLoader.js:179:69
pigallery2d_app.1.car76vhj32a6@homelab    |     at FSReqCallback.wrapper [as oncomplete] (node:fs:681:5)
pigallery2d_app.1.car76vhj32a6@homelab    | Warning: DOMParser is not available. It is needed to be able to parse XMP tags.
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:21 AM[DEBUG][MetadataLoader] Error parsing exif /images/zip/IMG_20210820_182614410_HDR.jpg TypeError: Corrupt JPG, exceeded buffer limits
pigallery2d_app.1.car76vhj32a6@homelab    |     at validateBuffer (/home/debian/pigallery2/node_modules/image-size/dist/types/jpg.js:77:15)
pigallery2d_app.1.car76vhj32a6@homelab    |     at Object.calculate (/home/debian/pigallery2/node_modules/image-size/dist/types/jpg.js:101:13)
pigallery2d_app.1.car76vhj32a6@homelab    |     at lookup (/home/debian/pigallery2/node_modules/image-size/dist/index.js:34:53)
pigallery2d_app.1.car76vhj32a6@homelab    |     at imageSize (/home/debian/pigallery2/node_modules/image-size/dist/index.js:113:16)
pigallery2d_app.1.car76vhj32a6@homelab    |     at /home/debian/pigallery2/src/backend/model/threading/MetadataLoader.js:179:69
pigallery2d_app.1.car76vhj32a6@homelab    |     at FSReqCallback.wrapper [as oncomplete] (node:fs:681:5)
pigallery2d_app.1.car76vhj32a6@homelab    | Warning: DOMParser is not available. It is needed to be able to parse XMP tags.
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:21 AM[DEBUG][MetadataLoader] Error parsing exif /images/zip/IMG_20210820_183137520_HDR.jpg TypeError: Corrupt JPG, exceeded buffer limits
pigallery2d_app.1.car76vhj32a6@homelab    |     at validateBuffer (/home/debian/pigallery2/node_modules/image-size/dist/types/jpg.js:77:15)
pigallery2d_app.1.car76vhj32a6@homelab    |     at Object.calculate (/home/debian/pigallery2/node_modules/image-size/dist/types/jpg.js:101:13)
pigallery2d_app.1.car76vhj32a6@homelab    |     at lookup (/home/debian/pigallery2/node_modules/image-size/dist/index.js:34:53)
pigallery2d_app.1.car76vhj32a6@homelab    |     at imageSize (/home/debian/pigallery2/node_modules/image-size/dist/index.js:113:16)
pigallery2d_app.1.car76vhj32a6@homelab    |     at /home/debian/pigallery2/src/backend/model/threading/MetadataLoader.js:179:69
pigallery2d_app.1.car76vhj32a6@homelab    |     at FSReqCallback.wrapper [as oncomplete] (node:fs:681:5)
pigallery2d_app.1.car76vhj32a6@homelab    | Warning: DOMParser is not available. It is needed to be able to parse XMP tags.
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:21 AM[VERBS] GET /pgapi/gallery/content/zip 200 483ms
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:22 AM[SILLY] [SharpRenderer] rendering photo:/images/zip/IMG_20210820_183137520_HDR.jpg, size:480
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:22 AM[SILLY] [SharpRenderer] rendering photo:/images/zip/IMG_20210820_182614410_HDR.jpg, size:480
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:22 AM[SILLY] [SharpRenderer] rendering photo:/images/zip/IMG_20210820_171223182_HDR.jpg, size:480
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:22 AM[VERBS] GET /pgapi/gallery/content/zip/IMG_20210820_183137520_HDR.jpg/thumbnail/480 200 267ms
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:22 AM[VERBS] GET /pgapi/gallery/content/zip/IMG_20210820_171223182_HDR.jpg/thumbnail/480 200 211ms
pigallery2d_app.1.car76vhj32a6@homelab    | 12/16/2022, 10:32:22 AM[VERBS] GET /pgapi/gallery/content/zip/IMG_20210820_182614410_HDR.jpg/thumbnail/480 200 282ms

Try increasing the photoMetadataSize in the config.json
duplicate of #398

I have increased that value to "photoMetadataSize": 1524288
However, I don't know how to make pigallery rescan these pictures to update the metadata. (Indexing only adds new pictures).

Click on reset database or delete the database manually.
-- Sorry for being brief, sent from my phone.
On Mon, 19 Dec 2022, 19:05 wonx, @.***> wrote:

I have increased that value to "photoMetadataSize": 1524288
However, I don't know how to make pigallery rescan these pictures to
update the metadata. (Indexing only adds new pictures).
—
Reply to this email directly, view it on GitHub
https://github.com/bpatrik/pigallery2/issues/516#issuecomment-1358040549,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABZKA5WAJ3MXOGFUVXFM533WOCPWRANCNFSM52WWMLFQ
.
You are receiving this because you commented.Message ID:
@.***>

Isn't there a way to reset or rescan a specific folder? My library is fairly large and it would take hours to repopulate the database.

I have increased that value to "photoMetadataSize": 1524288
However, I don't know how to make pigallery rescan these pictures to update the metadata. (Indexing only adds new pictures).

So is this the solution for this issue? Didn't understood the conclusion... 🙃

The app does not ready the whole image when it searches for the metadata
for better performance. Some images have a huge metadata part that is
bigger than the default size that app reads. With that flag you can
increase this buffer size.
It's a shortcomings of the app to not detected the buffersize automatically.
-- Sorry for being brief, sent from my phone.
On Tue, 20 Dec 2022, 06:33 garret, @.***> wrote:

I have increased that value to "photoMetadataSize": 1524288
However, I don't know how to make pigallery rescan these pictures to
update the metadata. (Indexing only adds new pictures).
So is this the solution for this issue? Didn't understood the
conclusion... 🙃
—
Reply to this email directly, view it on GitHub
https://github.com/bpatrik/pigallery2/issues/516#issuecomment-1358862401,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABZKA5UG2L3MRONJPZI5D5DWOFAKTANCNFSM52WWMLFQ
.
You are receiving this because you commented.Message ID:
@.***>

Ok thanks and what about the solution to this issue? Has not been found yet? Cannot really understand from reading all the past messages :)

It's not a bug. It's a misconfiguration issue. You need to change the value
of photoMetadataSize
-- Sorry for being brief, sent from my phone.
On Tue, 20 Dec 2022, 11:30 garret, @.***> wrote:

Ok thanks and what about the solution to this issue? Has not been found
yet? Cannot really understand from reading all the past messages :)
—
Reply to this email directly, view it on GitHub
https://github.com/bpatrik/pigallery2/issues/516#issuecomment-1359148039,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABZKA5QIJBF3ULCZUPOTL53WOGDEBANCNFSM52WWMLFQ
.
You are receiving this because you commented.Message ID:
@.***>

Ok and how do I know to which value should I change? Is there a suggested value?

Yes, for me changing that value in config.json solved the issue. However, I don't know if that means that the default value should be higher, in order to prevent this issue in other users.

I have changed the "photoMetadataSize" to 1524288, restarted the container, regenerated all the thumbnails but I still have the issue present with the same pictures.

@garret
There is no recommended value. You need to set higher than your biggest metadata(if you really want to be nitpicking you can use some 3rd party tool to extract the exif/iptc, etc.. data from your photos, measure the size of that and find the max among all your photos. ). No need to regenerate thumbnails, these should have the correct aspect ration. The issue is with the metadata loader, so you need to reindex your gallery. (you can trigger reindex in one folder if you change a file there. Given that your file system supports that)
If reindex does not help, can you try setting that number even higher? If I remember correctly, you cannot set it too high to break the app. If that does not help can you send me a photo with the issue?
@wonx
I dont want to increase the default value as it is usually not a problem, but would rather slow down everyone's indexing speed. Also a long term solution to this problem is #277

hello,
I performed the process described above (photoMetadataSize) and the thumbnails remains squared.
So, I compared 2 photos: one with good ratio and one as square.
For both, the metadata size is the same, 1.3 kB.
After editing the metadata, the only difference I found is on the Orientation parameter (Except the values for ExposureTime and so on which are specific to the photo...):
Bad ratio => Orientation = Unknown (0)
Good ratio => Orientation = Horizontal (Normal)
Is this value unknown can play a role to the thumbnails ratio ?
You can find the files attached to help to understand this behavior.
Thank you in advance for your support

Hello,
Following my previous post, I edited the metadata of a photo to change the Orientation parameter and set it to Horizontal (Normal).
This action fixed the issue and the thumbnail is now properly displayed.
Before :

After :

So I think this parameter not filled is the root cause of the bad ratio of thumbnails. Is it possible to propose a patch to fix this ?

Last information from my investigations:
Here is the log after new image addition:

Hope it can help to solve the problem.
Thank you

Thanks. That looks odd. I will take a look once I get back to my comp.
Tos26 @.***> ezt írta (időpont: 2023. febr. 4., Szo
1:44):

Last information from my investigations:
Here is the log after new image addition:
[image: image]
https://user-images.githubusercontent.com/23366980/216681988-38b60215-4348-47e2-978a-6bd75180613e.png
Hope it can help to solve the problem.
Thank you
—
Reply to this email directly, view it on GitHub
https://github.com/bpatrik/pigallery2/issues/516#issuecomment-1416259953,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABZKA5QGGEFOAQFW44CJFVTWVVGXJANCNFSM52WWMLFQ
.
You are receiving this because you commented.Message ID:
@.***>

@bpatrick
Hello, have you been able to take a look on this issue ?

Looked into the photo. It says
213263882-4b67488c-aaf1-451e-a0a3-ab0392af847e.jpg  for
TypeError: Invalid JPG, marker table corrupted
    at validateBuffer (<...>\node_modules\image-size\dist\types\jpg.js:81:15)
    at Object.calculate (<...>\node_modules\image-size\dist\types\jpg.js:101:13)
    at lookup (<...>\node_modules\image-size\dist\index.js:34:53)
    at imageSize (<...>\node_modules\image-size\dist\index.js:113:16)
    at <...>\src\backend\model\threading\MetadataLoader.js:180:69
    at FSReqCallback.wrapper [as oncomplete] (node:fs:681:5)

that leads to the following in the image-size lib:
function validateBuffer(buffer, index) {
    // index should be within buffer limits
    if (index > buffer.length) {
        throw new TypeError('Corrupt JPG, exceeded buffer limits');
    }
    // Every JPEG block must begin with a 0xFF
    if (buffer[index] !== 0xFF) {
        throw new TypeError('Invalid JPG, marker table corrupted');
    }
}

The other photo looks fine.
Do you edited these photos in any form or were they created with an old camera?

Hello,
Following my previous post, I edited the metadata of a photo to change the Orientation parameter and set it to Horizontal (Normal). This action fixed the issue and the thumbnail is now properly displayed.
Before :
After :
So I think this parameter not filled is the root cause of the bad ratio of thumbnails. Is it possible to propose a patch to fix this ?

How did you edit the metadata? Opening it with a text /hexa editor and only changing 1 byte or did you use an external tool that potentionally rewrite the whole exif/iptc data of the photo (and fixed the bad exif block)

Adding more data:
This is what the app's exif reader sees:
good photo, 213262712-cf5051a7-d376-48ec-8bf8-9bf67805481f.jpg:
ExifData {
  startMarker: { openWithOffset: [Function: openWithOffset], offset: 0 },
  tags: {
    ImageWidth: 4608,
    ImageHeight: 2128,
    Make: 'realme',
    Model: 'realme 3 Pro',
    Orientation: 1,
    XResolution: 72,
    YResolution: 72,
    ResolutionUnit: 2,
    ModifyDate:<PHONE_NUMBER>,
    YCbCrPositioning: 1,
    InteropIndex: '',
    ExposureTime: 0.000348,
    FNumber: 1.7,
    ExposureProgram: 0,
    ISO: 250,
    DateTimeOriginal:<PHONE_NUMBER>,
    CreateDate:<PHONE_NUMBER>,
    ShutterSpeedValue: NaN,
    ApertureValue: 1.16,
    BrightnessValue: NaN,
    ExposureCompensation: 0,
    MaxApertureValue: NaN,
    MeteringMode: 0,
    Flash: 16,
    FocalLength: 4.28,
    SubSecTime: '492000',
    SubSecTimeOriginal: '492000',
    SubSecTimeDigitized: '492000',
    ColorSpace: 65535,
    ExifImageWidth: 0,
    ExifImageHeight: 0,
    SensingMethod: 0,
    SceneType: 0,
    ExposureMode: 0,
    WhiteBalance: 0,
    FocalLengthIn35mmFormat: 0
  },
  imageSize: { height: 2128, width: 4608 },
  thumbnailOffset: undefined,
  thumbnailLength: undefined,
  thumbnailType: undefined,
  app1Offset: 24
}

bad photo, 213263882-4b67488c-aaf1-451e-a0a3-ab0392af847e.jpg:
ExifData {
  startMarker: { openWithOffset: [Function: openWithOffset], offset: 0 },
  tags: {
    ImageWidth: 4608,
    ImageHeight: 2128,
    Make: 'Realme',
    Model: 'realme 3 Pro',
    Orientation: 0,
    XResolution: 72,
    YResolution: 72,
    ResolutionUnit: 2,
    ModifyDate:<PHONE_NUMBER>,
    YCbCrPositioning: 1,
    InteropIndex: '',
    ExposureTime: 0.000536702,
    FNumber: 1.7,
    ExposureProgram: 0,
    ISO: 160,
    DateTimeOriginal:<PHONE_NUMBER>,
    CreateDate:<PHONE_NUMBER>,
    ShutterSpeedValue: NaN,
    ApertureValue: 1.16,
    BrightnessValue: NaN,
    ExposureCompensation: 0,
    MaxApertureValue: NaN,
    MeteringMode: 0,
    Flash: 16,
    FocalLength: 4.28,
    SubSecTime: '868000',
    SubSecTimeOriginal: '868000',
    SubSecTimeDigitized: '868000',
    ColorSpace: 65535,
    ExifImageWidth: 0,
    ExifImageHeight: 0,
    SensingMethod: 0,
    SceneType: 0,
    ExposureMode: 0,
    WhiteBalance: 0,
    FocalLengthIn35mmFormat: 0
  },
  imageSize: undefined,
  thumbnailOffset: undefined,
  thumbnailLength: undefined,
  thumbnailType: undefined,
  app1Offset: 590
}

This is how the app extracts photo size:
https://github.com/bpatrik/pigallery2/blob/45e3a8fd5251e994100a50b3b2dc51040f33c62c/src/backend/model/threading/MetadataLoader.ts#L184-L220
You can see, that the fields it tries to recover the original size are missing from the bad photo. I will try to add     ImageWidth ,    ImageHeight  and hope that it always contains the right value and does not break the app for others.  Reading this forum its not always the case: https://exiftool.org/forum/index.php?topic=10818.0
This fix will work for this particular photo. If you see similar issues with other photos, please use a 3rd party tool to fix the exif data in your photos.

@bpatrick
Thank you for this analysis.

How did you edit the metadata? Opening it with a text /hexa editor and only changing 1 byte or did you use an external tool that potentionally rewrite the whole exif/iptc data of the photo (and fixed the bad exif block)

I used an external tool to read and set the horizontal parameter, so I guess it rewrote the whole metadata.

Do you edited these photos in any form or were they created with an old camera?

My phone is a Realme 3 pro, running Android 11, not so old. All photos from this phone have the same issue in Pigallery2 since an update of the firmware of my phone.

@BPatrick
Thank you for this analysis and I agree with the conclusions. I think your modification can fix the issue.
Some answers to your questions:

How did you edit the metadata? Opening it with a text /hexa editor and only changing 1 byte or did you use an external tool that potentionally rewrite the whole exif/iptc data of the photo (and fixed the bad exif block)

I used an external tool to read and set the horizontal parameter, so I guess it rewrote the whole metadata.

That can be a problem.

Do you edited these photos in any form or were they created with an old camera?

My phone is a Realme 3 pro, running Android 11, not so old. All photos from this phone have the same issue in Pigallery2 since an update of the firmware of my phone.

I would consider it 'new' and I would expect it to 'just work'.
Is the problem still there on the latest nightly build?

Hello,
I didn't find the nightly build, where can I find it ?

Hello,
I installed the version 2.0.0 et I can confirm now that this issue is solved: All the thumbnails have the good ratio.
I think this ticket can be closed.
One comment: It could be helpful to update the readme.md and change the excepted version number of node.js for the 2.0.0 version (>=18; <20) for those don't use Docker, like me.


Resource request error "Connection closed" in SUSE Linux

When open url using SSL in Phantomjs( v 1.9.8 ), I face the problem: Resource request error "Connection closed".
OS info: SUSE Linux Enterprise Server 12
The command line like this:
phantomjs --ignore-ssl-errors=true --ssl-protocol=any --debug=true rasterize.js https://<IP_ADDRESS>:8072/upgrade.html test.png
The detail logs:
2015-03-10T17:59:45 [DEBUG] CookieJar - Created but will not store cookies (use option '--cookies-file=' to enable persisten cookie storage)
2015-03-10T17:59:45 [DEBUG] Phantom - execute: Configuration
2015-03-10T17:59:45 [DEBUG]      0 objectName : ""
2015-03-10T17:59:45 [DEBUG]      1 cookiesFile : ""
2015-03-10T17:59:45 [DEBUG]      2 diskCacheEnabled : "false"
2015-03-10T17:59:45 [DEBUG]      3 maxDiskCacheSize : "-1"
2015-03-10T17:59:45 [DEBUG]      4 ignoreSslErrors : "true"
2015-03-10T17:59:45 [DEBUG]      5 localToRemoteUrlAccessEnabled : "false"
2015-03-10T17:59:45 [DEBUG]      6 outputEncoding : "UTF-8"
2015-03-10T17:59:45 [DEBUG]      7 proxyType : "http"
2015-03-10T17:59:45 [DEBUG]      8 proxy : ":1080"
2015-03-10T17:59:45 [DEBUG]      9 proxyAuth : ":"
2015-03-10T17:59:45 [DEBUG]      10 scriptEncoding : "UTF-8"
2015-03-10T17:59:45 [DEBUG]      11 webSecurityEnabled : "true"
2015-03-10T17:59:45 [DEBUG]      12 offlineStoragePath : ""
2015-03-10T17:59:45 [DEBUG]      13 offlineStorageDefaultQuota : "-1"
2015-03-10T17:59:45 [DEBUG]      14 printDebugMessages : "true"
2015-03-10T17:59:45 [DEBUG]      15 javascriptCanOpenWindows : "true"
2015-03-10T17:59:45 [DEBUG]      16 javascriptCanCloseWindows : "true"
2015-03-10T17:59:45 [DEBUG]      17 sslProtocol : "any"
2015-03-10T17:59:45 [DEBUG]      18 sslCertificatesPath : ""
2015-03-10T17:59:45 [DEBUG]      19 webdriver : ":"
2015-03-10T17:59:45 [DEBUG]      20 webdriverLogFile : ""
2015-03-10T17:59:45 [DEBUG]      21 webdriverLogLevel : "INFO"
2015-03-10T17:59:45 [DEBUG]      22 webdriverSeleniumGridHub : ""
2015-03-10T17:59:45 [DEBUG] Phantom - execute: Script & Arguments
2015-03-10T17:59:45 [DEBUG]      script: "rasterize.js"
2015-03-10T17:59:45 [DEBUG]      0 arg: "https://<IP_ADDRESS>:8072/upgrade.html"
2015-03-10T17:59:45 [DEBUG]      1 arg: "chick.png"
2015-03-10T17:59:45 [DEBUG] Phantom - execute: Starting normal mode
2015-03-10T17:59:45 [DEBUG] WebPage - setupFrame ""
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/fs.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/system.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/_coffee-script.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/package.json" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/coffee-script.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/./lexer.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/././rewriter.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/././helpers.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/./parser.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/./helpers.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/./nodes.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/././scope.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/./././helpers.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/././lexer.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/../coffee-script/./lib/coffee-script/./././rewriter.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/webpage.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] WebPage - updateLoadingProgress: 10
2015-03-10T17:59:45 [DEBUG] Network - Resource request error: 2 ( "Connection closed" ) URL: "https://<IP_ADDRESS>:8072/upgrade.html"
2015-03-10T17:59:45 [DEBUG] WebPage - updateLoadingProgress: 100
Unable to load the address!
2015-03-10T17:59:45 [DEBUG] WebPage - setupFrame ""
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/fs.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/system.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/_coffee-script.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/webpage.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] WebPage - updateLoadingProgress: 10
2015-03-10T17:59:45 [DEBUG] WebPage - setupFrame ""
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/fs.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/system.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/_coffee-script.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] FileSystem - _open: ":/modules/webpage.js" QMap(("mode", QVariant(QString, "r") ) )
2015-03-10T17:59:45 [DEBUG] WebPage - updateLoadingProgress: 100
2015-03-10T17:59:45 [DEBUG] WebPage - updateLoadingProgress: 10
2015-03-10T17:59:45 [DEBUG] WebPage - updateLoadingProgress: 100
2015-03-10T17:59:45 [DEBUG] WebPage - setupFrame ""
2015-03-10T17:59:45 [DEBUG] WebPage - setupFrame ""
Please help me solve this urgent proplem! Thanks so much.

Thank you for submitting this ticket!
This issue tracker primarily serves as the tool to report and track bugs, defects, and development tasks.
For general question, code review request, or other related discussion, please post it to either:

the official PhantomJS users mailing-list
Stack Overflow (with phantomjs tag)

If you have not read it yet, please check also a few tips on Effective Q&A.

Thanks @ariya. I 've already posted this ticket in Stack Overflow with phantomjs tag.


chore: Add safeguard to prevent closing a channel with an open dlc.

I guess the most sensible way to deal with #543 is to prevent collaboratively closing a ln channel with an open dlc. Eventually we might want to collaboratively settle the position automatically, but yet again this is already possible by simply closing the position so I guess this is not as critical for now to have this in one action.
TODO:

[ ] #591.

resolves #543

bors r+


Python3.4, pip3 install fmcapi -U, f string causing errors

Hello,
I love the project. I had a flawless working version from 2019 but recently upgraded to the latest. I found errors when doing a check of the package. The issue is related to the f string 3.6 feature you are now using for message formating. https://docs.python.org/3/whatsnew/3.6.html#pep-498-formatted-string-literals
Simple solution is to go to 3.6 but this server I am on I am not allowed to upgrade it.
I ran checks using: sudo python3 -m py_compile /usr/lib/python3.4/site-packages/fmcapi/fmc.py
I get errors back like:
File "/usr/lib/python3.4/site-packages/fmcapi/api_objects/policy_services/accesspolicies.py", line 35
f"action, {action}, is not a valid option.  Choose from {self.DEFAULT_ACTION_OPTIONS}."
Solution: If I go through all the package files and remove the f" or f' then I no longer have issues. I might be able to append .format() to each line.
It might be good to have a check/warning about python version.

Fair point.  I'll make a note about being more specific with the versioning.  That said, f-strings started around Python 3.6, which is "old" enough I felt it was okay to migrate to the new formatting method as all OSes (that I know of) are at 3.6+.
A possible alternative for you is to use Docker.  We have a docker image that will run systems that have older versions of Python... that is, if you can run Docker.  :-)


How does the Image display webp animation?

I tried to use an animated webp in Compose for Desktop and it simply shows the static image, without an animation.
As for Jetpack Compose (android), it seems animated webps are not supported out of a box either. But some suggest to try  Coil lib https://coil-kt.github.io/coil/compose/ (it's not available in Compose Multiplatform though, so andorid only)

Please check the following ticket on YouTrack for follow-ups to this issue. GitHub issues will be closed in the coming weeks.


Limited Access System Group

I'm wondering what is a "Limited Access System Group"? One of my users can't access the site and I came across this term.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c264ede0-8da5-b812-c36b-f1c3c03ac590
Version Independent ID: 27b51f79-ce96-99c4-d1e8-10288e71ff6c
Content: Default SharePoint groups
Content Source: SharePoint/SharePointOnline/default-sharepoint-groups.md
Service: sharepoint-online
GitHub Login: @MikePlumleyMSFT
Microsoft Alias: mikeplum

@officedocsbot assign @scanum

You can Company Administrator as an admin to any site, but you can't add it as a primary admin. If you remove it as the primary admin for your root site, you can't add it back.
This note is incorrect. You can add 'Company administrator' as a primary admin to any site and you can also add back 'Company administrator' as primary admin to your root site.

@kathyfurtado you can find more information about the permission levels within Sharepoint here - https://docs.microsoft.com/en-us/sharepoint/understanding-permission-levels
Limited Access - Enables a user or group to browse to a site page or library to access a specific content item when they do not have permissions to open or edit any other items in the site or library. This level is automatically assigned by SharePoint when you provide access to one specific item. You cannot assign Limited Access permissions directly to a user or group yourself. Instead, when you assign edit or open permissions to the single item, SharePoint automatically assigns Limited Access to other required locations, such as the site or library in which the single item is located.
Hope this helps.

@kathyfurtado  Thank you for submitting this feedback.
From our understanding the issue has been resolved. If you feel it hasn't been resolved please re-open this issue.

@officedocsbot close


WIP - Use case: Different types of episodes on the same feed

This is not exactly a proposal, but a description for use case(s) related to having different types of episodes on the same feed.
Some times, these types of episodes are so different that they could be considered different podcasts, other times they are like "sub-series" of a same podcast.
Namespace support for this sue case could enable features of filtering for this "sub-series" (in or out).

Maybe replicating and then expanding the <itunes:type> tag? That currently supports “full” (default), “bonus,” and “trailer.” The latter two are intended to be attached to something. So a “bonus episode” would be a bonus to another episode, season, or the whole show. But I think another type to indicate a special standalone episode/miniseries would be good. It could be “miniseries,” “special,” “feeddrop,” “promo,” or more.