Issue with "Expecting property name enclosed in double quotes" Error

Hi - I hope this post finds you well!
I'm writing to seek assistance with a challenging error that I've encountered while working on my AnimateDiffusion ComfyUI project. Any help or guidance would be greatly appreciated.
Error occurred when executing BatchPromptSchedule: Expecting property name enclosed in double quotes: line 1 column 2 (char 1)

File "C:\Users\home\ComfyUI\ComfyUI\execution.py", line 153, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "C:\Users\home\ComfyUI\ComfyUI\execution.py", line 83, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "C:\Users\home\ComfyUI\ComfyUI\execution.py", line 76, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "C:\Users\home\ComfyUI\ComfyUI\custom_nodes\ComfyUI_FizzNodes\ScheduledNodes.py", line 122, in animate
animation_prompts = json.loads(inputText.strip())
File "json\__init__.py", line 346, in loads
File "json\decoder.py", line 337, in decode
File "json\decoder.py", line 353, in raw_decode

Thanks so much!!

Also I have a prompt with a structure like this:
"0": "prompt"
Which has worked in the past...
I'm beginning to wonder if there could be any limitations on the length of the prompt itself?
Currently, my prompt contains approximately 20,000 frames of data. Could such a long prompt length potentially contribute to the error I've been encountering?

I have a feeling there might have been a missed comma or quote somewhere in the prompt. Try using ctrl + f with either to be absolutely sure. You can always pist the prompt here or in DMs if you would like to keep the prompt private and I can help debug

i am getting the same problem too.I tried to write in other ways but i keep getting the same problem.
error:
Error occurred when executing BatchPromptSchedule:
Expression 0 0.50
1 0.51
2 0.53
3 0.54
4 0.55
...
59 1.30
60 1.30
61 1.30
62 1.30
63 1.30
Length: 64, dtype: float64 has forbidden control characters.
File "G:\ComfyUI\execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "G:\ComfyUI\execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "G:\ComfyUI\execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "G:\ComfyUI\custom_nodes\ComfyUI_FizzNodes\ScheduledNodes.py", line 125, in animate
pos_cur_prompt, pos_nxt_prompt, weight = interpolate_prompt_series(pos, max_frames, start_frame, pre_text, app_text, pw_a, pw_b, pw_c, pw_d, print_output)
File "G:\ComfyUI\custom_nodes\ComfyUI_FizzNodes\BatchFuncs.py", line 153, in interpolate_prompt_series
cur_prompt_series[i] = prepare_batch_prompt(cur_prompt_series[i], max_frames, i, prompt_weight_1,
File "G:\ComfyUI\custom_nodes\ComfyUI_FizzNodes\BatchFuncs.py", line 25, in prepare_batch_prompt
parsed_value = numexpr.evaluate(parsed_string)
File "G:\ComfyUI\venv\lib\site-packages\numexpr\necompiler.py", line 977, in evaluate
raise e
File "G:\ComfyUI\venv\lib\site-packages\numexpr\necompiler.py", line 874, in validate
_names_cache[expr_key] = getExprNames(ex, context, sanitize=sanitize)
File "G:\ComfyUI\venv\lib\site-packages\numexpr\necompiler.py", line 723, in getExprNames
ex = stringToExpression(text, {}, context, sanitize)
File "G:\ComfyUI\venv\lib\site-packages\numexpr\necompiler.py", line 283, in stringToExpression
raise ValueError(f'Expression {s} has forbidden control characters.')
My texts:
Batch Value Schedule:
0: (0.50), 1: (0.51), 2: (0.53), 3: (0.54), 4: (0.55), 5: (0.56), 6: (0.57), 7: (0.59), 8: (0.60), 9: (0.61), 10: (0.63), 11: (0.64), 12: (0.65), 13: (0.66), 14: (0.67), 15: (0.69), 16: (0.70), 17: (0.71), 18: (0.73), 19: (0.74), 20: (0.75), 21: (0.76), 22: (0.77), 23: (0.79), 24: (0.80), 25: (0.85), 26: (0.90), 27: (0.95), 28: (1.00), 29: (1.05), 30: (1.10), 31: (1.15), 32: (1.20), 33: (1.21), 34: (1.21), 35: (1.22), 36: (1.22), 37: (1.23), 38: (1.24), 39: (1.24), 40: (1.25), 41: (1.26), 42: (1.26), 43: (1.27), 44: (1.28), 45: (1.28), 46: (1.29), 47: (1.29), 48: (1.30)
Batch Prompt Schedule:
text:
"0": "(smile:pw_a)",
"24": "(sad:pw_a)",
"48": "(angry:pw_a)"
max frame:48

I doubt you're still trying to figure this out but for anyone in the future, my issue was the types of quotation marks being used. On the Mac keyboard the quotation marks are slanted “0” but in BatchPromptSchedule it looks like it only likes straight quotation marks like this "0"


base_api_controller/base_api_controllers config not work

I have a requirement to specify a subclass of ActionController::Base eg MyAPIController, so I add a config base_api_controller: MyAPIController, but it not work. I have read the source code, just replace the base_api_controller method's default value to MyAPIController, it works as expected.
I'm wondering how to use this config, can anyone give me a example?
And I find a hidden config controller_base_path, I use it to specify the controller path which I want to generate docs, it works, but this solution seems not official :(

+1 I am also experiencing this issue. I was able to just delete the base_api_controller/s config line and it started working again.

From docs, you can config like this:
class Swagger::Docs::Config
  def self.base_api_controller
    ActionController::API
  end
end

Swagger::Docs::Config.register_apis({
  "1.0" => {
    :controller_base_path => "",
    :api_file_path => "public"
  }
})

And then test by printing to console:
p Swagger::Docs::Config.base_api_controller

Or you can see on issue #75
Swagger::Docs::Config.base_api_controller = ActionController::API

Then run rake swagger:docs to see what happen.

Closing - please re-open if still an issue.


p4wq: add optional group_id priority

Example set of changes to support SOF_SCHEDULE_COMM scheduler:
https://github.com/thesofproject/sof/issues/7238
The main changes is group_id in work item which allows work items to be sorted by groups within the same priority.

@peter-mitsis  sorry, almost forgot about this :) added group_id initialization to previous tests

But this feature doesn't work like that. If you add a work item at priority 0 to a queue, and there is a work item of priority 1 that is already running, the old work item will be preempted by the scheduler and the new item will run immediately. That feature won't work with "groups", because the OS scheduler doesn't understand what a group is.

This is exactly the point we are trying to achieve here.
The intent is to use this P4WQ using a single worker thread so items currently executed will not be preempted when new item of lower priority arrives to the queue. We need this for the new scheduler, have a look at RFC https://github.com/thesofproject/sof/issues/7238 .

@andyross so you suggest that we should implement a completely new queue to Zephyr to fulfill those requirements?

I'm saying that the design needs some rethought if the idea of "preemption" and "priority" in the SOF scheduler doesn't match the one in the Zephyr scheduler.  That just sounds like a mistake.  If you're trying to prevent the Zephyr kernel from preempting a thread, you should be using a zephyr priority to do that.

OK, having read through the RFC, it looks like you just want to have your "groups" be in-order things.  You want all of the first group to complete before the second group runs, etc...  The reason this collides with p4wq is that the p4wq metaphor is that all the tasks should be runnable immediately.  It doesn't understand the idea of ordering, its tasks are like threads.  You use them like threads.  Threads don't do in-order processing either.
This sounds like a job for a compound data structure.  Use something like a regular work queue (with a manager thread running at high priority of course) as your "group manager".  Each group runs in order, and the callback:

Adds all the parallel p4wq items for the group to the queue
Takes a semaphore N times, once for each item

And each p4wq "group item" callback then does its normal work, and finishes by giving the semaphore.
This should be no more than a few dozen lines of code.  And it doesn't really have to be a work queue, a manager thread of your own would be fine too.

@abonislawski Close? Looks like we need to add completely new abstraction to Zephyr.

yes we can close this one


Github: restart tests by comment

It would be great if the checks of a pull requests can be restarted by adding a comment with the content "restart tests "

Instead of cluttering the comments with bot-speak, it seems more reasonable to use the retry buttons in the CIs (or add them were missing). I don't think github has comment-commands like gitlab yet.
Even better would be some fancier flaky-test detection with auto-retries.
Investing in the CIs seems more worthwhile to me than programming workarounds in dlang-bot. Also this task is more complex than it might seem as we'd have to find the right build/CI to retry for the PR, likely have to check user authentication somehow, and possibly avoid abuse.


Quick-Start Failed: Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database /usr/local/Cellar/apache-spark/1.6.1/libexec/metastore_db.

I followed the Quick-Start
1. Started Spark-Shell Sucessfully
INFO  06-06 14:06:43,855 - Created local directory: /var/folders/pd/hnjlg_y92518jzjr85fkv7q80000gn/T/eason/33c4549a-70f7-445a-83ea-a08388bfb899
INFO  06-06 14:06:43,860 - Created HDFS directory: /tmp/hive/eason/33c4549a-70f7-445a-83ea-a08388bfb899/_tmp_space.db
INFO  06-06 14:06:43,869 - Created sql context (with Hive support)..
SQL context available as sqlContext.

2. Imported Classes Successfully
import org.apache.spark.sql.CarbonContext
import java.io.File
import org.apache.hadoop.hive.conf.HiveConf

3. Failed to Create CarbonContext
val cc = new CarbonContext(sc, "./carbondata/store")

	... 125 more
Caused by: java.sql.SQLException: Another instance of Derby may have already booted the database /usr/local/Cellar/apache-spark/1.6.1/libexec/metastore_db.
	at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
	at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
	at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
	at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source)
	... 122 more
Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database /usr/local/Cellar/apache-spark/1.6.1/libexec/metastore_db.
	at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
	at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown Source)
	at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown Source)
	at java.security.AccessController.doPrivileged(Native Method)
	at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown Source)

How to Resolve it?
Spark-shell created HiveContext automatically:
scala> sqlContext
res0: org.apache.spark.sql.SQLContext = org.apache.spark.sql.hive.HiveContext@1828eff

1.please use spark 1.5
2.Hive's Derby.db only support one connection, so please refer to the below method to set:
http://www.cloudera.com/documentation/archive/cdh/4-x/4-2-0/CDH4-Installation-Guide/cdh4ig_topic_18_4.html


feat(TableView): Multi-column sorting

🙋 Feature Request
TableView (and the corresponding hooks in react-aria), support a sortDescriptor prop, which accepts a single sort descriptor. A more advanced use case would be an array of sort descriptors, to support multi-column sorting.
Is that something you would be willing to implement or accept contribution on?
🤔 Expected Behavior
Couldn't find the wai-aria spec even for single column sorting, but here is an example reference for the expected behaviour:
https://mui.com/x/react-data-grid/sorting/
😯 Current Behavior
A single SortDescriptor is supported.
💁 Possible Solution
TableState can be changed to support an array of sortDescriptors. The sort function should also be updated to accept extra information about if sort is being replaced or amended. Then useTableColumnHeader should also be updated to pass that information, when calling .sort().
🔦 Context

In some use cases of table, where many columns have enum values, multi-column sorting helps a lot in finding the right information based on a couple of fields.
💻 Examples

https://mui.com/x/react-data-grid/sorting/
🧢 Your Company/Team
Danske Bank

That UI where it shows numbers above each column is super confusing IMO. I wonder if it's better to do this outside the column headers themselves, in a separate UI where the sorting criteria could be in a reorderable list for example.
That said, I think if you're using react-aria, you could do this fairly easily. Actually sorting the data is up to the application anyway, so it would just be rendering some custom UI in the column headers.
I'm not sure ARIA has a way to indicate that multiple columns are sorted either. The spec says that aria-sort should only be applied to one header at a time.

Yes, the actual sorting is of course out of scope here, but the behaviour and state management of multi-column sorting could be relevant to react-aria/react-stately. For example how a sort column should be appended by cmd+click (if multi-column sorting is enabled), and how the state can hold an array of sortDescriptors.
If the UX is not considered a good pattern or is against the ARIA specs, that's a different discussion of course.
I searched for a few other examples of multi-column sorting in the wild, to see how it's done, and all of them seem to follow the same pattern of showing numbers to indicate the order:
https://js.devexpress.com/Demos/WidgetsGallery/Demo/DataGrid/MultipleSorting/React/Light/
https://www.ag-grid.com/react-data-grid/row-sorting/#multi-column-sorting
https://www.syncfusion.com/react-components/react-data-grid/sorting
https://www.telerik.com/kendo-react-ui/components/grid/sorting/#toc-customize-sorting
I tend to agree a separate reorderable list of columns is nicer, but I think it's kind of a downside too to have two inconsistent UX pattern based on the number of sort columns being 1 or more than 1.

I still think you could implement that on top of our hooks without requiring it to be built in. You could apply your own click handler to the column header element, and store the state yourself. Doesn't seem like it should be too hard. Not saying we would never support multi-column sorting, but I think we'd need to do some research. If you want it in the short term, implementing it on top of our hooks seems like a reasonable approach.

Makes sense. Thanks :)

I'm closing this issue for now, we will reopen in the future after doing more research and if more people want this specific feature.


Minification DI error

.state('products.product', {   url: '/',   views: {     content: {       templateUrl: 'product.html',       controller: 'ProductCtrl'     }   },   resolve: {       product: function (ProductsService) {       var productURL = ProductsService.getProductsUrl()       return ProductsService.fetchProduct(productURL)     }   },   tfMetaTags: {     properties: {       'og:type': 'product',       'og:title': function(product) {         return(product.name);       },       'og:description': function(product){         return(product.description);       },       'og:image': function(product) {         return(product.asset);       },       'og:url': function(product) {         return(product.public_url);       }     }   } })

app-fc98562963.js:8 Error: [$injector:strictdi] og:site_name is not using explicit annotation and cannot be invoked in strict mode

This is sample gist which helps to understand the issue
https://gist.github.com/shirazz/7dd05b3f0f9315cde7d5046ff6f4974c

@shirazz that is weird.
I checked the released code, and it has all injectors (tested and it didn't complained with a ng-strict-di.
Which file are you including? make sure you are using the release/tf-metatags.js or release/tf-metatags-min.js. If you are using the src/tf-metatags.js that might be the problem, because the src folder is the source folder, it didn't ran the grunt-ng-annotate.
Reading your gist, you have some /* @ngInject */ but you didn't apply the ng-annotate on them. I guess that is the problem. I just forked and made a small change to remove the @ngInject and used a "regular injection", just to make sure those are not the problems.
https://gist.github.com/thiagofesta/7a1678d388b4ac4e89a73cbf413b7c89

@thiagofesta i am using the release/tf-metatags.js and i have tried the below code.
https://gist.github.com/shirazz/23f6f2664adba3cb0e8491777035d41c
but the result is

@shirazz at least the problem is not the one that you reported. It seems like the problem was in your code and not on the lib itself.
Can you please send me your bower and package json files? I want to replicate it with all the exact same versions that you have.

@thiagofesta
Bower : https://gist.github.com/shirazz/160531755492b3faad13679bab6c52e9
pkg : https://gist.github.com/shirazz/4170a5910b7eed381180eb651cf6d4fc
hope this helps.


Error with reports with focused or disabled tests

Protractor is failing with the following when a test is disabled or focused:
[2018-01-25 13:07:34.138] [ERROR] - TypeError: First argument must be a string, Buffer, ArrayBuffer, Array, or array-like object.
    at Function.Buffer.from (buffer.js:183:11)
    at new Buffer (buffer.js:158:17)
    at Reporter.writeImage (/Users/xxx/projects/yy-static/protractor/node_modules/protractor-pretty-html-reporter/reporter.js:169:22)
    at Reporter.specDone (/Users/xxx/projects/yy-static/protractor/node_modules/protractor-pretty-html-reporter/reporter.js:117:18)
    at dispatch (/Users/xxx/projects/yy-static/protractor/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:4522:28)
    at ReportDispatcher.specDone (/Users/xxx/projects/yy-static/protractor/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:4493:11)
    at Spec.specResultCallback [as resultCallback] (/Users/xxx/projects/yy-static/protractor/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:1220:18)
    at complete (/Users/xxx/projects/yy-static/protractor/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:565:12)
    at QueueRunner.runnerConfig.onComplete (/Users/xxx/projects/yy-static/protractor/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:558:46)
    at Immediate._onImmediate (/Users/xxx/projects/yy-static/protractor/node_modules/jasmine-core/lib/jasmine-core/jasmine.js:4382:12)
    at runCallback (timers.js:789:20)
    at tryOnImmediate (timers.js:751:5)
    at processImmediate [as _immediateCallback] (timers.js:722:5)

I'm using jasmine 2.9 with protractor 5.2.2.

did we figure out a resolution to this?

@ldeveber Would possibly remember the fix, but we did end up fixing it on our end.  It was a long time ago so I forgot the specific fix unfortunately 😞

I unfortunately do not remember what I did without looking at the code, which I no longer have access to :(


Shadows Stop after previewing the 07.Lensflares-Light example

In Winforms if you click on the 07.Lensflares-Light demo, then click on 01.Ambient-Light shadows wont render.
They will still work in the Lensflares demo but they stop in the other Light examples

I'm looking for the cause
Thank you

I added Dispose method on GLRenderer


Better Logo

Description
This project is currently using "Facebook messenger logo" and having name just "messenger" .
Suggestions Open for new name and logo

Hello. I would like to suggest a name for this app. I think its a great project and i would like to contribute. Please guide me through the steps to make my first contribution. Thank you

@Karan-29 Hello 😄

Go Ahead Think of a name for the app and if that name seems to be good then I will definitely take that in consideration.

Secondly, to get you started with the code base you must fork the repo and find an issue if you can solve it. Otherwise, you can tell me about your tech stack so that we can get you started.

Happy Learning 🙌🔥

I would like to suggest some name:

Abstract
RogerThat
DogeChat :)
Okiedoke
ReConvo

look at this logo just tried 😅.

@abhijeet007rocks8 What do you say about this logo ?

Is the name also changing ??
The idea is quite nice, just the width of arrows are different.

I would suggest you to first decide the name and then work on logo accordingly :)

The name of the project is very generic and It can't be changed as per the GSSoC guidelines. but we can always think of a better logo 🔥

The project name remains same just need to change the title in header and then we can proceed for logo which reflects the name.
what you say @DhairyaBahl

@abhijeet007rocks8 If a good name comes up, then only we will change that.

Please check this.

@DhairyaBahl Please review this logo.


[search][filter] Do not use comma as a delimiter to specify multiple criteria

Current behavior of search/filter method in ESSearchDAO is to support multiple values a key can take using comma as a delimiter. This restricts the ability to specify values that have comma itself as a character.
Additional context
Some references to the code that splits the value provided in Criterion model by commas include
https://github.com/linkedin/datahub-gma/blob/ca6b79cc5782b129d31fa8499916e4724f968830/dao-impl/elasticsearch-dao/src/main/java/com/linkedin/metadata/dao/utils/SearchUtils.java#L57
https://github.com/linkedin/datahub-gma/blob/ca6b79cc5782b129d31fa8499916e4724f968830/dao-impl/elasticsearch-dao/src/main/java/com/linkedin/metadata/dao/utils/ESUtils.java#L66

I believe the above PR fixed this


Deprecate HfApi.list_files_info

This PR deprecates the HfApi.list_files_info method, as suggested in https://github.com/huggingface/huggingface_hub/pull/1809#pullrequestreview-1721928314,. The usage of this method is still low (based on the GitHub/Hub code search), so this shouldn't cause any problems for the users.

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@Wauplin Maybe expect_deprecation (and xfail_on_windows, etc.) should be defined as a pytest marker to support "decorating" test classes, but it's probably better to address this in a separate PR.

Thanks for making the changes @mariosasko! I'm merging it now :)


Update: Soccer Tables

Description
Added National Women's Soccer League (NWSL)
Copilot

🤖 Generated by Copilot at db493d2
Summary
🚺⚽🆕

Added NWSL support to soccer_tables app. Updated app version, schema, and getLeagueName function in apps/soccertables/soccer_tables.star.

We're the crew of the soccer tables app
We work hard to keep it up to date
We've added the NWSL to the schema
So pull on the rope and getLeagueName

Walkthrough

Add support for NWSL in soccer tables app (link, link, link)

Update version number and comment in soccer_tables.star (link)
Add NWSL option in app schema with corresponding API endpoint (link)
Return "NWSL" as league name in getLeagueName function (link)

⚽
I'm mildly offended that this emoji is :soccer: and not :football:.


Can't change FontFamily or change no work

<TextBlock
    FontFamily="{Binding Font}"
    FontSize="{Binding Size}"
    Foreground="{Binding FontColor}"
    Text="{Binding Content}"
    TextElement.FontFamily="{Binding Font}" />

public FontFamily Font
{
    get
    {
        return ElementInfo.Font ?? FontFamily.DefaultFontFamilyName;
    }
    set
    {
        ElementInfo.Font = value.Name;
        OnPropertyChanged(nameof(Font));
        GetNewMargin();
    }
}

Use may type is same.

Originally posted by @Coloryr in https://github.com/AvaloniaUI/Avalonia/discussions/13584
work in 11.0.5
no work in 11.1.999-cibuild0041277-beta
https://github.com/AvaloniaUI/Avalonia/commit/8da81002881485cea9b74086f128698033333505
this start no work

@Coloryr do you have a sample to reproduce for us? I have no idea what ElementInfo is and where it comes from.

ElementInfo.Font is string

In this cast, like 黑体, 宋体, Microsoft YaHei and some system font

yep, new FontFamily(ElementInfo.Font) still no change.

but is change in 11.0.5

public string? FontFamilyName
{
    get => _FontFamilyName;
    set => SetProperty(ref _FontFamilyName, value, true);
}

public FontFamily FontFamily => new FontFamily(FontFamilyName ?? "Webdings");

this is what works for me.

maybe use SetProperty work

11.0.5

11.1.999-cibuild0041866-beta

AvaloniaApplication1.zip

I found

font name not the name

I can't reproduce but I guess it is due to Chinese name.
/cc @Gillibald

could be the same as https://github.com/AvaloniaUI/Avalonia/issues/13462 ?

is work now

could be the same as #13462 ?

I think yes, the font name not eq

For now use this code is work


Request to add License File

Hi Maintainers,
This project is missing a license file, which is blocking its usage, as well as dependent projects (like dtype-next, tablecloth, etc).
Can you please add an appropriate license file?
Thank you

Welcome in, does the referenced change solve your issue?
Fun to get interactions from so far, hope you're well - what are you using this library for?

Thank you @harold. This change solves my issue. I am using tavlecloth for some data interpretation which brought this in as a transitive dependency.

Very cool! Welcome in. Glad to help.


Can't copy a file name from Project Find Results

On a find results screen I can select a file name, but If I try to copy it with ctrl + c or ctrl + insert nothing gets copied into a clip buffer.
Screenshots and GIFs

Atom version: 1.4.0
OS and version: Windows 10

This issue was moved to atom/find-and-replace#652


Container focused build pipeline

Adds scripts for container focused build pipeline.
https://issues.redhat.com/browse/COST-2350

Codecov Report

Merging #2416 (4c5fe7b) into main (ec9734a) will not change coverage.
The diff coverage is n/a.

:exclamation: Current head 4c5fe7b differs from pull request most recent head 80376ef. Consider uploading reports for the commit 80376ef to get more accurate results

@@           Coverage Diff            @@
##             main    #2416    +/-   ##
========================================
  Coverage   70.40%   70.40%
========================================
  Files         432      432
  Lines        8077     8077
  Branches     1894     1759   -135
========================================
  Hits         5687     5687
  Misses       2387     2387
  Partials        3        3

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ec9734a...80376ef. Read the comment docs.


HTTPS maven

The current maven server given by the readme is on unsecured http, and attempts to connect to it via https fail.
It's 2020, any publicly accessible http endpoint should probably have https on it to prevent malicious code from being mitm-ed onto any consumers of the library, it's free with Let's Encrypt.

Boundary's maven server should support https per ClientCommands which is on her maven (https://github.com/CottonMC/ClientCommands)?

The readme says to use 'http://server.bbkr.space:8081/artifactory/libs-release', so it should be updated if that's no the right link


Ability to ignore Video Roles and Audio Roles

In the next or subsequent build, the tool should have a the function to ignore Video Roles and Audio Roles.
This option could be used: --ignore-video-roles
This option could be used: --ignore-audio-roles

Just to be clear, if you were to specify--ignore-video-roles as a CLI flag, all video roles should be ignored (omitted from the CSV output)?
Or is the intent to allow a parameter to ignore a specific role, and can be specified more than once?
ie: --ignore-video-role Title --ignore-video-role VFX

Just to be clear, if you were to specify--ignore-video-roles as a CLI flag, all video roles should be ignored (omitted from the CSV output) and only audio roles would be output?

That is what I had in mind.
If a users have makers all over their timeline be it on Video or Audio, I believe on most occasions, users might want to ignore all ignore ALL audio role.
If a user have sound or music focused timeline or notes that needs to be send to sound/music person, they would want to ignore all ignore ALL video role.
I believe having options for specific role will complicate things. Furthermore the GUI in CommandPost may or may not able to detect the specific roles.
If users want to the thumbnails of specific role, they would always require to uncheck the other roles before exporting the rendered video. Users can always filter out specific roles in the Database (Notion or Airtable).

This is easy to implement then.

For consistency let's name the CLI option --exclude-roles <role> where <role> can be audio or video. (exclude mirrors the include nomenclature we implemented with the --include-outside-clip-boundaries flag)
Now that I'm shoulders-deep in implementing this option's functionality, the actual intended result is not clear.
ie: If we exclude audio roles, does that mean

we exclude all markers that have an audio role (regardless whether they have a video role or not), or
we ignore all markers that only have an audio role?

This also ties into how #33 works. If roles that have no intuitive default are empty and use use "Not Assigned" in the CSV output, that would be staged after this --exclude-roles CLI option.

 That would make more sense in practise.
A clip with video and audio combined will produce markers that are guaranteed to have both a video and audio role. (marker can only be attached to the combined clip, not to only the video or audio portion)
However if you were to split that clip into independent video and audio clips where markers can be specifically attached to each, then a feature like --exclude-roles makes more sense and would likely be renamed to --exclude-clips <audio, video>.

ie: If we exclude audio roles, does that mean
we exclude all markers that have an audio role (regardless whether they have a video role or not), or
we ignore all markers that only have an audio role?

I think the best approach would be, we ignore all markers that only have an audio role.

A clip with video and audio combined will produce markers that are guaranteed to have both a video and audio role. (marker can only be attached to the combined clip, not to only the video or audio portion)

Yes. you can detach audio from the clips.

However if you were to split that clip into independent video and audio clips where markers can be specifically attached to each, then a feature like --exclude-roles makes more sense and would likely be renamed to --exclude-clips <audio, video>.

From time to time, users might import a video clip (has both audio and video), but in his/her timeline, he only drag the audio part of the clip for usage. And he might also tag the clip to Music or Effects or even custom role.
Hence --exclude-roles makes more sense than --exclude-clips?

I think the best approach would be, we ignore all markers that only have an audio role.

I have this implemented but not pushed yet. It works but I only question our intent because it feels unintuitive. For example, a clip with video+audio roles will still be output to the CSV and both roles will be intact.

From time to time, users might import a video clip (has both audio and video), but in his/her timeline, he only drag the audio part of the clip for usage.

That's exactly the same as Detach Audio as I described where it splits video and audio into 2 clips. Whether you keep/use both is irrelevant (in your cited example).
Perhaps it makes more sense for this to be called --exclude-exclusive-roles. Since the behavior is such that exclusion only happens if the opposite role is empty without a default.

I have this implemented but not pushed yet. It works but I only question our intent because it feels unintuitive. For example, a clip with video+audio roles will still be output to the CSV and both roles will be intact.

So you feel, the approach is we exclude all markers that have an audio role (regardless whether they have a video role or not)?

Perhaps it makes more sense for this to be called --exclude-exclusive-roles. Since the behaviour is such that exclusion only happens if the opposite role is empty without a default.

Some confusion. Haha. With the (regardless whether they have a video role or not) behaviour, we can circle back to
--exclude-roles <video, audio>  instead of --exclude-exclusive-roles <video, audio>?

So you feel, the approach is we exclude all markers that have an audio role

Not really saying this would be better, just bringing light to it. I do worry that this alternate approach (cited) is too aggressive, and would exclude too many markers.

Try the new alpha and see what you think:
https://github.com/TheAcharya/MarkersExtractor/releases/tag/0.2.0-alpha-20230103.0

Try the new alpha and see what you think:
https://github.com/TheAcharya/MarkersExtractor/releases/tag/0.2.0-alpha-20230103.0

Let me try out and report back! Thank you.

Not sure if I am using it correctly.
When I use --exclude-exclusive-roles video. I was expecting only 1 entry. Since I had a marker on my audio clip. But only video roles were extracted with 21 entries.

and when I use when I use --exclude-exclusive-roles audio The same video roles are extracted with 21 entries.

If I test without the --exclude-exclusive-roles again the tool extracts the same 21 entries. Again the marker on my audio clip was not included.

Test 2 - Another video file wiith XML (It has number of markers on Audio Clips)
When I use --exclude-exclusive-roles video, non of the audio roles where extracted.

And when I use --exclude-exclusive-roles audio, the same result happens. It ignores most of my markers on video.

Is this with 0.2.0-alpha-20230103.0?

Is this with 0.2.0-alpha-20230103.0?

Yes.

This may be resolved now. Will be in next alpha build.

@orchetect I have been testing with various conditions. I believe we need to improve the logic further.

I have tested with 2 scenarios for --exclude-exclusive-roles video

Scenario 1 - Where the default Dialogue is attached with the default Video Role.

Result - Extracted with 21 entries

In Scenario 1, I understand that since Dialogue is attached with the default Video Role, the markers on the Video Role is treated as markers on the Dialogue role as well.
Scenario 2 - Where the default Dialogue is detached and deleted. Hence, there is no Dialogue** role.

Result - Extracted with 21 entries. But I was expecting only 8 entries.

But in Scenario 2, since there is no Dialogue role. I was expecting only 8 entries. The CSV should not include the ghost Dialogue role which are printed as Not Assigned.

Can we support disabled clips? If a clip is turned off, the CLI will ignore the markers for the clip. In the XML, clips that are disabled are tagged with enabled="0".

 <asset-clip ref="r2" offset="0s" name="Nature Makes You Happy" duration="355100/2500s" enabled="0" tcFormat="NDF" audioRole="dialogue">
                            <adjust-volume amount="-96dB"/>
                            <asset-clip ref="r3" lane="-1" offset="0s" name="Interstellar Soundtrack - No Time for Caution" duration="177315755/720000s" format="r4" audioRole="dialogue">
                                <marker start="3736707/40000s" duration="1/48000s" value="Marker on Audio" note="Audio Fix"/>
                                <marker start="149s" duration="1/48000s" value="It is necessary" completed="0"/>
                                <marker start="125233067/720000s" duration="1/48000s" value="Cooper!" completed="1"/>
                                <chapter-marker start="5308/25s" duration="1/48000s" value="Chapter 7" posterOffset="11/60s"/>
                                <audio-channel-source srcCh="1, 2" role="music.music-1"/>
                            </asset-clip>

Further test for --exclude-exclusive-roles audio

The default Video role is not included in the CSV.

Can we support disabled clips?

We already have an issue open for that: #4

This seems like a confusing feature and I'd rather scrap it entirely unless we can come up with a detailed spec of exactly what expected outcomes are in every possible scenario.

This seems like a confusing feature and I'd rather scrap it entirely unless we can come up with a detailed spec of exactly what expected outcomes are in every possible scenario.

Let me try to detail out the specs and report back.

Possible logic and conditions for
--exclude-exclusive-roles video [Meaning only Marker on Audio Clips and Audio Roles will be extracted]

All Video Roles will be ignored and omitted.
Default Video Role is Special as it as a Default Dialogue Role. Markers on the default Video Role will still be extracted if the audio is attached to the video. It will be printed as Dialogue in the Audio Role Column.
If Audio is detached from the Video and if it is tagged with Dialogue Role, and if there are no markers on the detached Audio Clip, the CLI will not use the Markers of the Video Clip. Hence, they will be ignored and omitted.
If Audio is detached from the Default Video and if the audio clip it is deleted, the CLI will not use the “Ghost” Markers of the Video Clip. Hence, they will be ignored and omitted.

--exclude-exclusive-roles audio [Meaning only Marker on Video Clips and Video Roles will be extracted]

All Audio Roles will be ignored and omitted.
Default Video Role is Special as it as a Default Dialogue Role. Markers on the default Video Role will still be extracted.
If Audio is detached from the Video and if it is tagged with Dialogue Role, and if there are markers on the detached Audio Clip, the CLI will not use the Markers of the Dialogue Role. Hence, they will be ignored and omitted.

I will circle back to this soon, but we need to test that correct roles are being parsed and output to the manifest file for all clip types first.

Using Sam's Project on 0.2.5.

So some reason, the names are not printed.

Using Sam's Project on 0.2.5.

This is a separate issue. Let's open a new role parsing issue for this.

This would be a lot easier if it were just a clip type filter instead of based on roles.
Consider this:

When a clip only contains video, FCP does not allow you to assign it an audio role.
When a clip only contains audio, FCP does not allow you to assign it a video role.
When a clip contains both video and audio, it will have both role types.

I don't think we should have a bunch of complicated logic for default roles. It would be more straight-forward to just take all roles as FCP presents them. If they have a default "Video" or "Dialogue" role, then that's what they have.
Which is why this should be a clip type filter, and not a role filter.

we can remove our existing --exclude-exclusive-roles?

Yes probably for the better, since as it exists now, it is unclear how it should function and may have undesirable results.

we still parse the roles

Yes 100% and they are still included on the manifest. I have some questions about changes/improvements to those in a separate issue (#66).

Yes probably for the better, since as it exists now, it is unclear how it should function and may have undesirable results.

Okay! Let's remove --exclude-exclusive-roles.


PyCharm Support

It would be awesome to support PyCharm or other Jetbrains IDEs such as IntelliJ with a plugin.  aider could add all or selected projects in the Projects tab to its context.

Absolutely. I prefer PyCharm to any VSCode-based IDE

This would be awesome

Semi-related:

#68

+1 for PyCharm. Thanks

another +1 for pycharm as well

+1

Jetbrains IDE and VSCode are two must have platforms for developers, just like iOS & Android for mobile app

I would love IntelliJ Ultimate, but I don't think that's that much of a difference :-)

there is one existing for jetbrains: https://plugins.jetbrains.com/plugin/25249-coding-aider

It is new, thank you.  Will try it out.


Improve API / documentation for site root paths

Having done a lot of work with page URLs recently, I've found the concept of 'Site root paths' a bit tricky to get my head around. I feel like a lot of this has to do with their 'private-ish' nature, and the single route to those values: Site.get_site_root_paths(); which is documented in the model reference, but not really mentioned elsewhere.
This PR is an attempt to make the API a little more accessible, by bringing the logic onto Site instances using regular instance methods. I believe these changes:

Make the code easier to explain, read and understand: Helping to bridge a gap in clarity between Site and SiteRoutePath
Allow us to more clearly test the logic against certain conditions
In places where we already know the Site we're interested in (e.g. Page.get_url_parts(), automatic redirect creation), accessing the values is much simpler... allowing for cleaner code in both the core app, and in tests

Another thing I've done here is establish a 'guaranteed order' for site root paths when there are roots for multiple locales. Without this, it would be quite easy to break Page.get_url_parts() with a bit of harmless reordering. It's only really by chance that the SiteRootPath for Site.root_path usually comes first in Site.get_site_root_paths() - its path value is not guaranteed to come before the others alphabetically.

Closing due to lack of interest.


General improvements and fixes

Merged mainstream changes;
Improved Makefile;
Fixed code based on new static analysis reports.

Please check the /target/report/structcheck.txt report for further improvements.

@quipo The Datasift changes have been already merged mainstream.


Using admin to create dojos, however new users could  not  see the dojos?

Using admin to create dojos, however new users could  not  see the dojos?
I think the dojos have permissions to set, new users don't need to create new dojo again.
Any admin setting or sql command could solve this problem ?

By default dojos are private so you have to join them to be able to see them. If you want your dojo to be available to all users, you have to make it official. There's no UI for this yet, but you can do it with the following command:
docker exec -it dojo dojo db -sNe 'UPDATE dojos SET official = 1 WHERE repository = "pwncollege/example-dojo";'

Thank you @Scoder12


Tables do not display correctly if .md document is not in navbar (develop branch)

After merging #42, tables are missing their separators and the spacing is wrong.
Example in https://csc-user-guide-dev.rahtiapp.fi/#apps/syntax-example/
commit:  ce22400502e1f6660a04a6e7920d8abcef783b40

If we make the following change to mkdocs.yml
- Applications:
     - By discipline: apps/index.md
     - In alphabetic order: apps/alpha.md

to
- Applications:
     - By discipline: apps/index.md
     - In alphabetic order: apps/alpha.md
     - Syntax: apps/syntax-example.md

the table renders correctly

Last working in commit: 5750f2446a821d763fab0d41fc04eeccea4b3762
This issue will need to be fixed before we merge the new theme to the master branch.

Fixed by 7c90ebb50e536faae7e6c80bf1b2b72b778c7548


Unable to import datasources with encrypted_extra params via REST

Bug description
At present it is possible to create a bigquery datasource which uses an explicit key by creating an import_datasources.yaml file that contains something similar to the block below:
databases:
  -
    database_name: mydatabase
    sqlalchemy_uri: bigquery://gcp-project-id/
    cache_timeout: 0
    expose_in_sqllab: true
    allow_run_async: false
    allow_ctas: false
    allow_cvas: false
    allow_dml: false
    allow_file_upload: false
    encrypted_extra: |
      {"credentials_info": {  "type": "service_account",  "project_id": "gcp-project-id",  "private_key_id": "aca359ef9828567aa1f031f367ba547fe26bf54c",  "private_key": "-----BEGIN PRIVATE KEY-----VERY_BIG_PRIVATE_KEY_STRING\n-----END PRIVATE KEY-----\n",  "client_email"<EMAIL_ADDRESS> "client_id": "1149993100000000000",  "auth_uri": "https://accounts.google.com/o/oauth2/auth",  "token_uri": "https://oauth2.googleapis.com/token",  "auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",  "client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/service-account%40gcp-project-id.iam.gserviceaccount.com",  "universe_domain": "googleapis.com"} }
    extra: |
      { "allows_virtual_table_explore": true }
    uuid: 00000000-0000-0000-0000-123456789001

This can be imported using superset import_datasources -p filename.yaml from a running instance.
However, if I wish to import the same data structure using the REST API /api/v1/database/import it will fail.
It seems that the REST version applies additional schema checks on the bundled zipfile and fails because encrypted_extra is not part of ImportV1DatabaseSchema
Screenshots/recordings
No response
Superset version
master / latest-dev
Python version
3.11
Node version
16
Browser
Chrome
Additional context
No response
Checklist

[X] I have searched Superset docs and Slack and didn't find a solution to my problem.
[X] I have searched the GitHub issue tracker and didn't find a similar bug report.
[X] I have checked Superset's logs for errors and if I found a relevant Python stacktrace, I included it here as text in the "additional context" section.

To comment on the bot notes above. I've seen the masked_encypted_extra section and also tried that. This is another entry that isn't present in ImportV1DatabaseSchema

@fisjac @betodealmeida wondering if you might have some ideas about this

Ah, looks like we need to update the schema.
I think the reasoning is that when we export the database we strip passwords and encrypted extra, so the import doesn't expect it. But people can add it manually, and the import should accept it and use it if present.
I'll fix it, it should be quick.

Does it make sense to ensure the same validations take place on the CLI and REST invocations? It seems strange that an object with encrypted_extra can sneak through the schema validation on the CLI version.


Update modelchain.rst

modelchain.rst should be updated to describe use of ModelChain with the following new features:

ModelChain.with_xxxx methods
ModelChain.run_model_from_poa and ModelChain.run_model_from_effective_irradiance
Collection of model output into ModelChain.results when #1076 is merged
Use of ModelChain with a PVSystem with multiple Arrays (again when #1076 is merged)
Use of air, module and/or cell temperature with a ModelChain

ModelChain Examples would be valuable.

Recommended text to include in a PR for this issue.

Recommended text to include in a PR for this issue.


[Feature Request] NPU Support

🚀 Feature
NPU support, particularly on smartphones featuring the Google Tensor (Google Pixel) and newer Snapdragon chips; as well as the newer iPhone chips.
 The Pixel lineup has featured it for a while, Snapdragon's more recent chips feature them, and so are Apple's chips (both in their iPhone and Mac). They're becoming more prevalent and look to be here to stay, making a trifecta of CPU, GPU, and TPU. I'd suspect that on many platforms NPUs will increase the speed and efficiency of LLMs over their GPU counterparts. I think this will be an important step to get mobile local LLMs mainstream. The hardware is there, we just need the software to use it.
I'm sure you're working on it already but I thought I'd post an official feature request for it.

The NNAPI can use NPUs/TPUs. For example, TensorFlow Lite allows you to select delagates, one of which is the NPU.


space required before colon in type restriction false positive

https://github.com/crystal-lang/crystal/pull/12740 introduced a false positive that causes a warning to be produced on untyped yielding methods with &:
def test(&)
end

test do
  puts "hi"
end

$ ccrystal tool format --check test.cr
Using compiled compiler at .build/crystal
In ./test.cr:1:11

 1 | def test(&)
               ^
Warning: space required before colon in type restriction (run `crystal tool format` to fix this)

A total of 1 warnings were found.

No changes are made to the file when running the formatter either.
Discovered in Athena nightly CI within pretty much every component: https://github.com/athena-framework/athena/actions/runs/3769289873/jobs/6408388844

Oh, that's odd. This variant should be covered by specs. : thinking:


Hamiltonian Cycle problem

Objective: WAP to solve Hamiltonian Cycle Problem in your preferred language with the best possible Time and Space complexity.
Add it to the existing "Backtracking" directory otherwise create it.

can you please assign me this issue?
thank you.

@LakshaySK106  I have an effective approach to it can you please assign me this issue

Assigned @suprity04 @AdiTyaa-Raj


Generated local package csproj does not get updated

Describe the bug
When adding a UPM package locally, and then generating a csproj for it through unity, de generated project for the upm package does not get updated when generating.
To Reproduce
Steps to reproduce the behavior:

Clone https://github.com/KuraiAndras/CCFUBugSample
Open Unity
In Preferences -> External Tools -> External Script Editor select Visual Studio 2019
In the same settings enable Local packages generation
Regenerate project files
Open the project in Visual Studio

Unity does not report any compile errors(correctly), while Visual Studio shows an error in CCFUBugSample.SampleService.TestSwitch. This is because in the unity generated CCFUBugSample.csproj the LangVersion property is set to 7.3 instead of 8.
Expected behavior
Any generated csproj gets the desired LangVersion property value
Environment (please complete the following information):

Version 1.1.0
Platform: Editor Windows
Unity version: 2020.1.8

Additional context
If this would cause problems for some users, maybe consider making this behavior optional through settings

@KuraiAndras
Thank you for the reporting!

@KuraiAndras
Fixed in 1.1.1-preview.3.
Please try it!

Yupp this works now! Thank you


driver cannot connect to cluster port

Setting the port number in the connection URL to 8091 (the cluster admin port) instead of 8093 (the direct query port) should work. It doesn't.
05:23:36.144 [main] INFO  com.couchbase.CBDriver - Constructor called
05:23:36.148 [main] INFO  com.couchbase.CBDriver - Constructor called
05:23:36.433 [main] ERROR com.couchbase.jdbc.core.ProtocolImpl - Error opening connection Not found: Check the URL: 404
05:23:36.434 [main] ERROR com.couchbase.CBConnection - Error opening connection for jdbc:couchbase://localhost:8091 exception Error getting cluster response
Exception in thread "main" java.sql.SQLException: Error opening connection
at com.couchbase.CBConnection.(CBConnection.java:79)
at com.couchbase.CBDriver.connect(CBDriver.java:95)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:270)
at com.couchbase.query.jdbc.SimpleExec.main(SimpleExec.java:12)
Caused by: org.apache.http.client.ClientProtocolException: Not found: Check the URL: 404
at com.couchbase.jdbc.core.ProtocolImpl.handleClusterResponse(ProtocolImpl.java:286)
at com.couchbase.jdbc.core.ProtocolImpl.pollCluster(ProtocolImpl.java:944)
at com.couchbase.jdbc.core.ProtocolImpl.connect(ProtocolImpl.java:235)
at com.couchbase.CBConnection.(CBConnection.java:73)
... 4 more
Repro using this:
package com.couchbase.query.jdbc;
import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.ResultSet;
import java.sql.Statement;
public class SimpleExec {
static String ConnectionURL = "jdbc:couchbase://localhost:8091";
public static void main(String[] args) throws Exception {
    Connection con = DriverManager.getConnection(ConnectionURL);
    Statement stmt = con.createStatement();
    ResultSet rs = stmt.executeQuery("select code,* from `beer-sample` where city = 'San Francisco' and type = 'brewery'");
    while (rs.next()) {
        String val = rs.getString(1);
        String code = rs.getString(2);
        System.out.println("> " + val);
        System.out.println(">> " + code);
    }
}

}

Basically, pointing the driver to the 8091 general administration port, is the wrong thing to do. The driver should be pointed to the 8093 query port. It then uses a special REST API to get the list of query nodes, and thereafter round-robins its requests across them.


File automatically removed after uploading

Give an expressive description of what is went wrong
A file, which is uploaded successfully can't be found when examining the destination folder. In one case I could even see it quickly appearing before it went away again.
Version of Meteor-Files you're experiencing this issue
My versions file tells me that I'm using<EMAIL_ADDRESS>Version of Meteor you're experiencing this issue
Haven't checked any other - I'm currently on<EMAIL_ADDRESS>Where this issue appears? OS (Mac/Win/Linux)? Browser name and its version?
I'm effectively running on a mix of Mac and Linux for this example. I have a host system, which is Mac, holding the folder where the files should be stored. This folder is mounted into some virtual box machines, all running Ubuntu, which have a docker container holding the app. I'm using meteor up to deploy them. I sat this up to come closer to my staging environment, where I was seeing this issue before, which has multiple docker containers, running the app, on a single server, holding the folder.
Is it Client or Server issue?
Looks like a server issue to me.
Post Client and/or Server logs with enabled debug option, you can enable "debug" mode in Constructor
[<IP_ADDRESS>]2019-02-05T12:03:17.702178628Z [FilesCollection] [File Start Method] Minimal.xlsx - wf9H2R63JSXNrhYGR
[<IP_ADDRESS>]2019-02-05T12:03:17.703847806Z [FilesCollection] [Upload] [DDP Start Method] Got #-1/1 chunks, dst: Minimal.xlsx
[<IP_ADDRESS>]2019-02-05T12:03:17.770289643Z [FilesCollection] [Upload] [DDP] Got #1/1 chunks, dst: Minimal.xlsx
[<IP_ADDRESS>]2019-02-05T12:03:17.819228020Z [FilesCollection] [Upload] [DDP] Got #-1/1 chunks, dst: Minimal.xlsx
[<IP_ADDRESS>]2019-02-05T12:03:17.852270100Z [FilesCollection] [Upload] [finish(ing)Upload] -> /data/imports/wf9H2R63JSXNrhYGR.xlsx
[<IP_ADDRESS>]2019-02-05T12:03:17.924674024Z [FilesCollection] [Upload] [finish(ed)Upload] -> /data/imports/wf9H2R63JSXNrhYGR.xlsx
[<IP_ADDRESS>]2019-02-05T12:03:17.600118615Z [FilesCollection] [_preCollectionCursor.observe] [changed]: wf9H2R63JSXNrhYGR
[<IP_ADDRESS>]2019-02-05T12:03:17.635168287Z [FilesCollection] [_preCollectionCursor.observe] [removed]: wf9H2R63JSXNrhYGR
[<IP_ADDRESS>]2019-02-05T12:03:18.036400123Z [FilesCollection] [_preCollectionCursor.observe] [removed]: wf9H2R63JSXNrhYGR
[<IP_ADDRESS>]2019-02-05T12:03:18.037418058Z [FilesCollection] [_preCollectionCursor.observe] [removeUnfinishedUpload]: wf9H2R63JSXNrhYGR

And I have to admit, it looks a lot similar to the problem, described in #324, but unfortunately I can't go back as far as to version 1.7.5 of this plugin.
Could also be related to #666 even though the author of this issue claims the file would exist and he doesn't show a trigger of removeUnfinishedUpload.
My problem is that I can't reproduce this on a regular basis, but only when running at least 3 of the instances - and even then it's only occasionally this happens. I guess I'm on a race condition here.
Occasionally it produces this log and leaves the file in place:
[<IP_ADDRESS>]2019-02-05T12:38:36.180408137Z [FilesCollection] [File Start Method] Minimal.xlsx - deAzpMh8QbhKpgeJe
[<IP_ADDRESS>]2019-02-05T12:38:36.182031228Z [FilesCollection] [Upload] [DDP Start Method] Got #-1/1 chunks, dst: Minimal.xlsx
[<IP_ADDRESS>]2019-02-05T12:38:36.229334437Z [FilesCollection] [Upload] [DDP] Got #1/1 chunks, dst: Minimal.xlsx
[<IP_ADDRESS>]2019-02-05T12:38:36.238273219Z [FilesCollection] [Upload] [DDP] Got #-1/1 chunks, dst: Minimal.xlsx
[<IP_ADDRESS>]2019-02-05T12:38:36.246799668Z [FilesCollection] [Upload] [finish(ing)Upload] -> /data/imports/deAzpMh8QbhKpgeJe.xlsx
[<IP_ADDRESS>]2019-02-05T12:38:36.286452749Z [FilesCollection] [Upload] [finish(ed)Upload] -> /data/imports/deAzpMh8QbhKpgeJe.xlsx
[<IP_ADDRESS>]2019-02-05T12:38:36.304769136Z [FilesCollection] [_preCollectionCursor.observe] [changed]: deAzpMh8QbhKpgeJe
[<IP_ADDRESS>]2019-02-05T12:38:36.314845185Z [FilesCollection] [_preCollectionCursor.observe] [changed]: deAzpMh8QbhKpgeJe
[<IP_ADDRESS>]2019-02-05T12:38:36.332151635Z [FilesCollection] [_preCollectionCursor.observe] [removed]: deAzpMh8QbhKpgeJe
[<IP_ADDRESS>]2019-02-05T12:38:36.346839057Z [FilesCollection] [_preCollectionCursor.observe] [removed]: deAzpMh8QbhKpgeJe

To nail it down, I've also tried to couple a version of the application, running on my mac in dev-mode, to the same database these 3 instances are running on, and I got it failing there as well - just much less times than in it's docker instances - all pointing to a race condition ...

Maybe worth noting that this happens specially when using redis-oplog, which replaces the MongoDB oplog.

Here's the result from the client ... seems to be relevant nonetheless
  core.js:108 [FilesCollection] [insert()]
  core.js:108 [FilesCollection] [FileUpload] [constructor]
  core.js:108 [FilesCollection] [insert] using WebWorkers
  core.js:108 [FilesCollection] [UploadInstance] [createStreams]
  upload.js:349 loadFile Minimal.xlsx:<PHONE_NUMBER>25ms
  core.js:108 [FilesCollection] [UploadInstance] [sendEOF] false
  core.js:108 [FilesCollection] [link(qYRnHAFpbF33bWqDp, original)]
2 core.js:108 [FilesCollection] [link(qYRnHAFpbF33bWqDp, original)]
  core.js:108 [FilesCollection] [link(qYRnHAFpbF33bWqDp, original)]
2 core.js:108 [FilesCollection] [link(qYRnHAFpbF33bWqDp, original)]
  core.js:108 [FilesCollection] [UploadInstance] [end] Minimal.xlsx
  upload.js:301 insert Minimal.xlsx:<PHONE_NUMBER>625ms
2 core.js:108 [FilesCollection] [link(qYRnHAFpbF33bWqDp, original)]
7 core.js:108 [FilesCollection] [link(qYRnHAFpbF33bWqDp, original)]

Ok, I've digged into it and I think I'm now aware of what the problem is and how a solution could look like, which would not require a change on either the Meteor core or the redis-oplog extension. In both cases this remains a valid problem, in both cases it remains a problem of each of the implementations.
Let's take the case where we have two servers, where one of them (let's call him the first) is closer to the database than the other (let's call him the second).
Also take a look at the hook, described here https://github.com/VeliovGroup/Meteor-Files/blob/a5149baff36dde6d9a415f4ef261fc27402fe4af/server.js#L313-L336
In this example, the first will trigger the update. He will also be the one picking it up first, triggering the delete and running the delete hook.
Now finally the second one receives the information that the document has changed, but is (due to https://github.com/meteor/meteor/issues/10443 or https://github.com/cult-of-coders/redis-oplog/issues/311 - depending on if you use redis-oplog or not) unable to receive the document, because the first server already deleted it. He therefore skips the update hook - alright, that's fine. Now he receives the delete-hook, which he wants to execute. He will, neither here, be able to receive the document, which means, that the property isFinished will not exist, which in turn will result in that he starts removing the file.
My suggestion: Set isFinished to false and to a strict check for false, which will be negative in case the document already is deleted. In this case another server already should have taken the right choice at this condition.

doesn't work -_-

I mean i have the same issue. No way to fix it

@JonathanLehner Are you saying that neither applying the change #673 has helped you? If so, please create a minimal environment where you can reproduce the problem and I'll have a look into it.

It works now. Thanks a lot! It seems the "stream" setting for the upload caused problems.

@JonathanLehner May I know where to change the stream setting? I have the same problem.

@FrancoisYu If you want to use my approach just follow one of the approaches described in https://guide.meteor.com/writing-atmosphere-packages.html#overriding-atmosphere-packages. The first option is fairly easy - just clone my branch (https://github.com/SimonSimCity/Meteor-Files/tree/fix-auto-file-removal) into the packages/ folder of your meteor installation.
@JonathanLehner if you resolved it using a different way, please let us know.

I changed the stream setting in
let uploadInstance = Images.insert({ file: file, transport: 'http', //faster meta: { //locator: self.props.fileLocator, userId: 0 //needs to have accounts-base installed.. userId: Meteor.userId() // Optional, used to check on server for file tampering }, streams: 1, chunkSize: 1000, allowWebWorkers: true // If you see issues with uploads, change this to false }, false)
with that it worked
On Tue, Apr 23, 2019 at 11:21 AM Simon Schick<EMAIL_ADDRESS>wrote:

@FrancoisYu https://github.com/FrancoisYu If you want to use my
approach just follow one of the approaches described in
https://guide.meteor.com/writing-atmosphere-packages.html#overriding-atmosphere-packages.
The first option is fairly easy - just clone my branch (
https://github.com/SimonSimCity/Meteor-Files/tree/fix-auto-file-removal)
into the packages/ folder of your meteor installation.
@JonathanLehner https://github.com/JonathanLehner if you resolved it
using a different way, please let us know.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/VeliovGroup/Meteor-Files/issues/672#issuecomment-485722427,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFQOPHEJG4SY77MDH2AFIO3PR3IHRANCNFSM4GUMRRXQ
.

Rather a work-around than an actual fix of the problem because you have to add it on every command, right?
Have you also tried using the code I proposed?

I couldn't find the "packages" folder, so I haven't been able to add it. Do I need to create the folder?

If you don't already have gone through patching an atmosphere package locally you might have to create this folder ... yes ... Please see the docs I've referenced previously for further details.

Cannot replicate anymore. Now I got "Something went wrong! [sendEOF] method doesn't returned JSON! Looks like you're on Cordova app or behind proxy, switching to DDP transport is recommended." And nothing works anymore -_-

@JonathanLehner please check out the version before my change. Does this also happen there as well? If yes, does it also happen with the master-branch of this repository here?

Everything works now. Thanks a lot! One of my less experienced colleagues
apparently named another collection "Accounts" globally, which broke a lot
in the files package. It might be good to mention this somewhere, or to
check inside the package.
On Tue, Apr 23, 2019 at 9:00 PM Simon Schick<EMAIL_ADDRESS>wrote:

@JonathanLehner https://github.com/JonathanLehner please check out the
version before my change. Does this also happen there as well? If yes, does
it also happen with the master-branch of this repository here?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/VeliovGroup/Meteor-Files/issues/672#issuecomment-485932074,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFQOPHGE5Q27I2TIC46DNXLPR5L75ANCNFSM4GUMRRXQ
.

@SimonSimCity while you describe this problem as kind of a race condition, where the "fatser one wins",  I experience the error for both servers, no matter if one is "closer" to the database. Can you confirm this for your setup, too?

@jankapunkt yes - very rarely though. It happens far more often (almost predictable) if one of the servers has a noticeably longer latency to the database.

Fix merged via #673 feel free to reopen if the issue reappears or new issues have been introduced as a consequence of #673 that are related to this.


"File Too Large" error when creating files

This occurred while creating an empty text file, and happens every time. The file is still created on the source filesystem, as if nothing is wrong. Copying files and directories back and forth between the host and the guest doesn't appear to have any issues besides this.

Thanks for the bug report. I think this issue was resolved in #506 .

Will try building master, was using latest release when I got this.

Okay, this is resolved since #506.


"Fix langchain version typo (#280)"

📥 Pull Request
📘 Description
Changed langchain version from ~=1.19 to ==0.1.19.
🔄 Related Issue (if applicable)
#280
🎯 Goal
To address the installation issue with agentops[langchain].

I was surprised we hadn't caught this, but it's only used for a couple langchain examples in our docs.
Can you change this to 0.2.14? Then I can merge it

Thanks @roshanr11 !


No errors or tracebacks in the new version 0.22.3

Eh, well the thing is simple, there is not an error message or traceback when you make a mistake like write wrong a direction in the include sentence of twig. Instead you get a 500 in the browser, and this is serious.
I need to turn something on or of?

@nanotime I don't recall disabling any debug output. Are you saying that now when you include a file that doesn't exist, it fails silently? (Whereas, before you would get a 500 error?)

You need to active WP_DEBUG like => define('WP_DEBUG', true);

@jarednova when i make any mistake, it fails silently. I don't touched any, just make a clean instalation, put timber, debug-bar and debug-bar timber (as allways) and well, this is it, any error throws me a 500 page on my browsers.
@prisis ehm, i have no idea where is WP_DEBUG D:

@nanotime
When you install WordPress it's always set to define('WP_DEBUG', false);
You can visit https://codex.wordpress.org/Editing_wp-config.php for more


refactor(context-selector): aria refinements

Fixes https://github.com/patternfly/patternfly-next/issues/1531.
Added ids to .pf-c-context-selector__toggle and .pf-c-button pf-m-tertiary, updated the aria-label on .pf-c-button pf-m-tertiary, and added aria-labelledby to .pf-c-context-selector__toggle and .pf-c-form-control.

Deploy preview for pf-next ready!
Built with commit 1eb3891d014420aa35d8f13f1b7f7f6514c82972
https://deploy-preview-1601--pf-next.netlify.com

I added the unique ids.

Thanks for making these updates! There is just one minor update needed, which I noted inline.

:tada: This PR is included in version 2.0.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Custom Styles UI

Implemented

generate improvements to UI architecture
Add styles listing & ability to apply style
Closes: https://github.com/ingalls/Hecate/issues/46 (GET styles list should return user name)

TODO

Create new style
Update an existing style
Delete a style
Set as public/private

Closes: https://github.com/ingalls/Hecate/issues/45


Add support for analyzing webp images

Overview
The Analyze Images tool currently supports analyzing png and jpeg images. We want to add support for webp as well.
Motivation

The Generate Images tool will produce webp images once #936 is implemented, so the Analyze Images tool must be able to analyze webp images to continue support for "round-tripping" (i.e. analyzing generated images)
webp is a ubiquitous image format and supporting it will

Design
OpenAI's Chat Completion API already supports webp, so the required changes should be trivial.

Able to analyze webp images when testing with latest tools.


Broken functionality (from_flatfile) in get_manta_sv

I haven't investigated the cause of this issue. I wonder if this ever worked properly in the first place.  We definitely need all functions to work with the from_flatfile option and TRUE should become the new default once it does
unannotated_sv = get_manta_sv(from_flatfile = TRUE)
Error in read_tsv(sv_file, col_types = "cnncnncnccccnnnnccc", col_names = cnames) :
  object 'cnames' not found

I figured out how to fix this. It'll be fixed in my next PR. I just had to make the cnames variable global


RM-25125 Fix non aligned read

@tomdeering-wf Reading size is ok on 64 bit archs, but this code might be running on 32 bit archs where this read would not be atomic.  While is is going to incur some performance overhead, it ensures that reads on any arch is atomic.
@tomdeering-wf @matthinrichsen-wf @travissanderson-wf

Raven

Number of Findings: 0

+1


Current master broken?

npm start -->
Error: The (relay-query) Babel 5 plugin is being run with Babel 6.

npm list -g --depth=0
/Users/steve/.nvm/versions/node/v5.8.0/lib
├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>└──<EMAIL_ADDRESS>

The issue was https://github.com/facebook/relay/issues/887 I've updated babel-relay-plugin to v0.7.3, so now the example should work.


Error propagation from entry actions execution using interpreter

Description
Same as #463 but specifically for automatic entry (and presumably exit) actions which are invoked automatically by the state machine / scheduler, so cannot be caught by calling code. Is the alternative to convert all actions to explicit states with internal service calls (which can fail/be rejected, and handled via state machine definition)? That seems a bit cumbersome.
Expected Result
Interpreter should have a mechanism for errors to be caught / propagate outside.
Actual Result
Error is thrown from within interpreter and cannot be handled by state machine definition.
Reproduction
Slight variant of @davydof's example on #463, but executing an automatic entry action:
https://xstate.js.org/viz/?gist=cb72b4656ce8f440b2f1704b4e33a99b
Error is thrown from within interpreter/scheduler:
https://github.com/statelyai/xstate/blob/2c094d33dd8d5f5644e60c6054f1987f298f3d87/packages/core/src/interpreter.ts#L250
https://github.com/statelyai/xstate/blob/2c094d33dd8d5f5644e60c6054f1987f298f3d87/packages/core/src/scheduler.ts#L72

At the moment how errors are handled in the runtime is a little bit under-specified. We are aware of the issue and we plan to address it. I've created an RFC going into more details - I would appreciate it if you could take a look at it and give feedback about those proposed changes: https://github.com/statelyai/rfcs/pull/4/files

I believe that https://github.com/statelyai/xstate/pull/4145 & https://github.com/statelyai/xstate/pull/4492 addressed this issue.


fix(dynamic_filter): let executor write correct data upon scaling change

I hereby agree to the terms of the Singularity Data, Inc. Contributor License Agreement.
What's changed and what's your intention?

Summarize your change (mandatory)
let executor write correct data upon change in dynamic filter
How does this PR work? Need a brief introduction for the changed logic (optional)
maintain last_comitted_row

Checklist

[x] All checks passed in ./risedev check (or alias, ./risedev c)

Documentation
If your pull request contains user-facing changes, please specify the types of the changes, and create a release note. Otherwise, please feel free to remove this section.
Types of user-facing changes
Please keep the types that apply to your changes, and remove those that do not apply.

Installation and deployment
Connector (sources & sinks)
SQL commands, functions, and operators
RisingWave cluster configuration changes
Other (please specify in the release note below)

Release note
Please create a release note for your changes. In the release note, focus on the impact on users, and mention the environment or conditions where the impact may occur.
Refer to a related PR or issue link (optional)
#6470

Hmm, this is unnecessary. The last_commited_epoch_row is only necessary for when vnode 0 is set. See e.g. https://github.com/risingwavelabs/risingwave/pull/3783

Hmm, this is unnecessary. The last_commited_epoch_row is only necessary for when vnode 0 is set. See e.g. #3783

Is it possible if an executor starts to take charge of vnode 0 after scaling? 🤔

Yes, indeed. Actually, we also need to properly handle the pause and update barriers correctly. I will make the corrections in a new PR.

Yes, indeed. Actually, we also need to properly handle the pause and update barriers correctly.
~I will make the corrections in a new PR. I will also add some regression unit tests.~ No regression test as its hard to test scaling in unit tests for now... Anw, I've added some changes and comments. (actually no drastic changes needed as the code block handling the barrier is actually idempotent just like in hash agg).

Your changes are perfect! Thank you very much!


Unhandled exception: Unauthorized Access

So I've installed this app and selected a path to steam logs (changed it because I have installed steam elsewhere), however it is giving me access denied exception as I input command into console. I run it as admin and turned windows defender off to no avail. How do I grant access to that folder?

Full error message app gives me is
UnauthorizedAccessException: Access to the path "G:\SteamGames\logs" is denied.
at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost)
at System.IO.FileStream.ctor(String path, FileMode mode, FileAccess access, FileShare share)
at SteamP2PInfo.SteamPeerManager.d__8.MoveNext()
--- end of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
at System.Windows.Threading.ExceptionWrapper.TryCatchWhen(Object source, Delegate callback, Object args, Int32 numArgs, Delegate catchHandler)

and ipc_SteamClient.log is empty

So, did you try manually changing the permissions as I said?

Looks like both steamp2p and logs folder are in full access

Changing app location to the same drive as steam seemed to solve the issue

Then I guess we should check why it uses the wrong drive when the path explicitly defines the correct one.


fix: Updating the School Timetabling quickstarts documentation

This pull request contains updates related to the School Timetabling quickstart. Here are some important points:

The field id was not included in the problem facts to keep them simple.
The OpenAPI dependencies were not included to keep things simple.
The justification models were not included to keep things simple.
The initial Maven and Gradle files were modified to remove test dependencies and then add them in the test Section.

Issue #98

This is a weird formulation, suggests that nothing happens for 5 seconds.
It was in the original text, so not your doing, but maybe we change it anyway? "The main()... and, after just over five seconds, prints the solution:"


Search Google Photos: Add "Choose and Update" button

Add to the results page a "Choose and Update" button under the photo on Edit Candidate page:
http://localhost:8001/c/wv01cand5748/edit/

When this button is clicked, we should cache the photo to We Vote's AWS photo store, and then add the photo to the candidate record.

Hi @jainanisha90, I tried the "Choose and Update" button on "Anthony Beckford" (New York), as well as a couple of other candidates, on the Google Search result from Twitter. It showed the green check mark, but did not save the Twitter handle. It did not seem to save the photo either. Save Twitter Link didn't work either.

I clicked "Choose and Update" for the Facebook search results for "Alan H. Reed":
https://api.wevoteusa.org/c/27715/edit/?show_all_google_search_users=1
...but it didn't store the photo.


src/db/filename.rs test_generate_filename functions supports windows

I add some code to test_generate_filename supports windows, cargo test output is Ok

Thank you for testing out the support of wickdb on windows. And it will be also very helpful if you could add windows version for test_parse_filename.

@Fullstop000  HI，I deleted repeate code in filename/test_generate_filename and supported test_parse_filename function  in windows

@Fullstop000  I'm sorry,I forget using cargo fmt


State issues when deleting documents

This might not be specific to deleting documents, but it's the workflow I was using when I encountered them:

After deleting a bunch of documents via bulk actions…

…the selected items count does not update.
…the documents remaining in the pane do not refresh.
…pagination numbers do not update (instead show stale values)

When proceeding to a subsequent page after deleting items, adding additional items to the selection increases the “items selected” indicator beyond the number possible (i.e. it's never removing the deleted documents from the count)
It's possible to paginate to a page greater than the number of remaining pages when the above occurs, resulting in empty panes

Also, minor visual issue: when entering into the editor view the status label winds up wrapping each letter individually, causing the rows of the pane (list items) to be excessively tall.
By the way, thank you for putting in the time to get this thing this far. It's already super useful and I can't wait to be able to ship it as the default pane for all views in the Studio! If I were better at TypeScript I'd contribute (would love to add fuzzy search filtering, sorting columns, and inline edits to name a few). Maybe later this year!

Thanks for the bug report and testing out the alpha!
This is all great feedback and I think I can fix most of them just by refreshing and clearing after a delete. I was struggling to figure out what should be the correct behavior for the selection after a bulk action and it's clear to me now that the current logic needs some work 😅.

Also, minor visual issue: when entering into the editor view the status label winds up wrapping each letter individually, causing the rows of the pane (list items) to be excessively tall.

I'm having some trouble reproducing this. What browser are you using? Can you provide a screenshot as well?

By the way, thank you for putting in the time to get this thing this far. It's already super useful and I can't wait to be able to ship it as the default pane for all views in the Studio! If I were better at TypeScript I'd contribute (would love to add fuzzy search filtering, sorting columns, and inline edits to name a few). Maybe later this year!

I'm glad you're interested! I'm a fan of your projects in the sanity world as well.
I'm hoping this thing can take on a good amount of community contributions and solve a bunch of collective problems we all have. If you'd like to contribute in javascript, I can add the types later.

https://github.com/ricokahler/sanity-super-pane/pull/4#issuecomment-808834471


ProgressBar crashes with large max_value

On the most recent version from pip (3.9.3), ProgressBar crashes when a large max_value is supplied.
The following snippet produces the error:
import progressbar

with progressbar.ProgressBar(max_value=2.4e8) as bar:
    for i in range(int(2.4e8)):
        bar.update(i)

The stacktrace is:
  0% (   419170 of 240000000) |                                                                                | Elapsed Time: 0:00:03 ETA:  0:00:00Traceback (most recent call last):
  File "test.py", line 5, in <module>
    bar.update(i)
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/bar.py", line 364, in __exit__
    self.finish()
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/bar.py", line 526, in finish
    self.update(self.max_value)
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/bar.py", line 475, in update
    StdRedirectMixin.update(self, value=value)
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/bar.py", line 110, in update
    DefaultFdMixin.update(self, value=value)
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/bar.py", line 42, in update
    self.fd.write('\r' + self._format_line())
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/bar.py", line 412, in _format_line
    widgets = ''.join(self._format_widgets())
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/bar.py", line 392, in _format_widgets
    widget_output = widget(self, data)
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/widgets.py", line 345, in __call__
    return ETA.__call__(self, progress, data, value=value, elapsed=elapsed)
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/widgets.py", line 282, in __call__
    data['eta'] = utils.format_time(data['eta_seconds'])
  File "/home/sander/.virtualenvs/test2/local/lib/python2.7/site-packages/progressbar/utils.py", line 228, in format_time
    time = datetime.timedelta(seconds=int(time))
OverflowError: normalized days too large to fit in a C int

This was tested on Ubuntu 14.04, using a fresh virtualenvironment. If I install version 3.6.2, the code in the snippet runs fine.

Perhaps it's an issue with a 32 bit Python install? I can't reproduce it locally but I've created a theoretical fix, can you try that?

This is also happening for us, with ubuntu 16.04 amd64, python3.5.

Is that also the case for the current development release?

Hi @WoLpH and others,
Several users of tetherback have been running into this issue as well: tetherback #20, #21.
I can generate it reliably under Ubuntu 15.10 amd64, python 3.5, by running the following script which generates random max_value from a log-normal distribution, and then updates the progress bar at random intervals:
from progressbar import ProgressBar, Percentage, FileTransferSpeed, ETA, DataSize
from time import sleep
from random import lognormvariate, normalvariate
from math import log

for ii in range(100):
    max_value = lognormvariate(log(1000000), log(500000))
    print('{}: max_value={}'.format(ii, max_value))

    pbwidgets = ['  test %d: ' % ii, Percentage(), ' ', FileTransferSpeed(), ' ', ETA(), ' ', DataSize() ]
    pbar = ProgressBar(max_value=max_value, widgets=pbwidgets).start()

    cur_value = 0
    while cur_value < max_value:
        pbar.update(cur_value)
        sleep(normalvariate(.2, .05))
        cur_value += max_value/100 * lognormvariate(0, 1)
    pbar.finish()

Using v3.9.3 installed via pip3:
$ pip3 list|grep progress
progressbar2 (3.9.3)

ps- progressbar is awesome. Many, many thanks for this easy-to-use and well-designed library.

I just tested using the same test script under progressbar2 v3.6.1 and this problem does not occur.
Even when v3.9.3 works, it appears to be displaying the wrong output:
With v3.6.1:
$ python3 test_progressbar.py
0: max_value=20561045808.596012
  test 0: 100%   1.7 GiB/s    Time: 0:00:11     19.1 GiB
1: max_value=59023171565202.23
  test 1:  52%   4.6 TiB/s    ETA:  0:00:01     28.4 TiB

With v3.9.3, it's displaying "elapsed time" rather than ETA:
$ python3 test_progressbar.py
0: max_value=229639.24744805894
  test 0:  46%  15.7 KiB/s    Elapsed Time: 0:00:06    104.1 KiB

This appears to be because the Timer.__init__ overwrites the intended format
    def __init__(
            self,
            format_not_started='ETA:  --:--:--',
            format_finished='Time: %(elapsed)s',
            format='ETA: %(eta)s',
            format_zero='ETA:  0:00:00',
            **kwargs):
        self.format_not_started = format_not_started
        self.format_finished = format_finished
        self.format = format
        self.format_zero = format_zero
        Timer.__init__(self, **kwargs)

Aha.
It appears that this bug was fixed in cf19031a, which is included in the latest develop head, but has not yet been part of a release.

I've uploaded the new release to PyPI. Please let me know if you experience any more errors :)
And if anyone has an idea how I can properly test this... please let me know. All tests on Travis succeeded without any issues which makes it a bit harder for me to test...

@WoLpH, I think the reason all the tests pass is that none of them include the combination of the ETA() widget with a very large max_value.
This is just a dumb kludge, but adding widgets=[ETA()] to the new test in large_values.py results in a failed test for v3.9.3 but a pass for v3.9.4:
diff --git a/tests/large_values.py b/tests/large_values.py
index 0786f8c..ee8b231 100644
--- a/tests/large_values.py
+++ b/tests/large_values.py
@@ -3,7 +3,7 @@ import progressbar

 def test_large_max_value():
-    with progressbar.ProgressBar(max_value=1e10) as bar:
+    with progressbar.ProgressBar(widgets=[progressbar.ETA()], max_value=1e10) as bar:
         for i in range(10):
             bar.update(i)
             time.sleep(0.1)

However, the issue is not fully resolved in v3.9.4. Trying even larger max_value still raises an OverflowError:
diff --git a/tests/large_values.py b/tests/large_values.py
index 0786f8c..e427acb 100644
--- a/tests/large_values.py
+++ b/tests/large_values.py
@@ -3,7 +3,9 @@ import progressbar

 def test_large_max_value():
-    with progressbar.ProgressBar(max_value=1e10) as bar:
-        for i in range(10):
-            bar.update(i)
-            time.sleep(0.1)
+    for large_max_value in (1e9, 1e10, 1e11, 1e15):
+        with progressbar.ProgressBar(widgets=[progressbar.ETA()],
+                                     max_value=large_max_value) as bar:
+            for i in range(10):
+                bar.update(i)
+                time.sleep(0.1)

@dlenski the problem is that none of the examples error on either my system or the automated travis tests. Not even with your new tests.
To illustrate, the results of the tests: https://travis-ci.org/WoLpH/python-progressbar/builds/142172199
Which is running these tests: https://github.com/WoLpH/python-progressbar/blob/b58bb8e4288a5d1717565b3700f0af3784c7e161/tests/large_values.py

Sorry, my previous post was inaccurate, because I had not correctly applied 19168aeeb77716103aed01168df139496e8f9796. After applying that, no errors.
So, at least for me, the combination of fixing the bugs in ETA() and catching OverflowError in format_time is doing the trick. :+1:

Ah, perfect


Query is not a function

When using @keyv/sqlite and command to the module results in an error 'TypeError: Query is not a function. Thrown from /node_modules/@keyv/sql/src/index.js:39:19.
Unable to narrow down the issue. Keyv itself works, however when moving to sqlite this error presents itself.

Can you provide a code example?

i have too this issue with the same config
const db = new Keyv(config.mysql);

db.set("something", "value", 1000)

Can you produce a runnable example (ideal with @keyv/sqlite so it's completely self contained).

As far as I can see, everything is working as expected in CI: https://travis-ci.org/github/lukechilds/keyv/jobs/652767076#L544-L570

This seems to be a very small edge case, after adjusting the configuration the error did not throw. Possible that the path was not complete, will do some testing to find this error again.


Fix Turn animation in Devise layout

I really like the new turn animation (awesome job @jorbs :tada:), but I noticed the scrollbar will appear and disappear during the animation when working on a smaller screen, causing the content to jump sideways. The videos here are a little laggy, but you can see how the content jumps when the animation finishes.
I figured we shouldn't hide the scrollbar for the entire application (as you can see in the second video), but I personally would rather go with this aesthetic trade-off for the devise views if it means the contents won't skip. We'd have to consider another fix if we want to allow developers to use turn anywhere else where the content shifting might be an issue.
If anyone has a better way of handling this, I'm open to ideas.
Before
https://user-images.githubusercontent.com/10546292/175485597-d6c045e8-93e4-4470-9978-5cfa4d6ac1f0.mp4
After
https://user-images.githubusercontent.com/10546292/175485543-91e25caf-8ddd-4415-abde-55b60c7ee98c.mp4

@gazayas Not sure why, but I can't see these videos on my Mac. Want to try again?

@andrewculver I tried to do this on my mac, but the turn animation isn't happening in either chrome or firefox there, so I resorted to using my phone 😅
Before
https://user-images.githubusercontent.com/10546292/180952212-26cfd308-409a-4836-9169-d72ff732fcc5.MOV
After
https://user-images.githubusercontent.com/10546292/180952300-7dea2053-57fc-47ce-b8c5-c4b2d6fdcb8a.MOV


[Outlook] (event-based) Link to event JSON objects

Link to branch preview site - links to Add-ins reference docs should also work

Docs Build status updates of commit 9b0e26b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/outlook/autolaunch.md
:bulb:Suggestion
View
Details

docs/outlook/autolaunch.md

Line 26, Column 93: [Suggestion-preserve-view-not-set] Did you mean to link to a specific version? It's usually better not to specify a version, so the link always goes to the canonical version. If you really need to link to a specific version, add &preserve-view=true to the URL: /javascript/api/outlook/office.attachmentschangedeventargs?view=outlook-js-preview. Otherwise, remove the view parameter.
Line 27, Column 102: [Suggestion-preserve-view-not-set] Did you mean to link to a specific version? It's usually better not to specify a version, so the link always goes to the canonical version. If you really need to link to a specific version, add &preserve-view=true to the URL: /javascript/api/outlook/office.attachmentschangedeventargs?view=outlook-js-preview. Otherwise, remove the view parameter.
Line 28, Column 91: [Suggestion-preserve-view-not-set] Did you mean to link to a specific version? It's usually better not to specify a version, so the link always goes to the canonical version. If you really need to link to a specific version, add &preserve-view=true to the URL: /javascript/api/outlook/office.recipientschangedeventargs?view=outlook-js-preview. Otherwise, remove the view parameter.
Line 29, Column 98: [Suggestion-preserve-view-not-set] Did you mean to link to a specific version? It's usually better not to specify a version, so the link always goes to the canonical version. If you really need to link to a specific version, add &preserve-view=true to the URL: /javascript/api/outlook/office.recipientschangedeventargs?view=outlook-js-preview. Otherwise, remove the view parameter.
Line 30, Column 83: [Suggestion-preserve-view-not-set] Did you mean to link to a specific version? It's usually better not to specify a version, so the link always goes to the canonical version. If you really need to link to a specific version, add &preserve-view=true to the URL: /javascript/api/outlook/office.appointmenttimechangedeventargs?view=outlook-js-preview. Otherwise, remove the view parameter.
Line 31, Column 209: [Suggestion-preserve-view-not-set] Did you mean to link to a specific version? It's usually better not to specify a version, so the link always goes to the canonical version. If you really need to link to a specific version, add &preserve-view=true to the URL: /javascript/api/outlook/office.recurrencechangedeventargs?view=outlook-js-preview. Otherwise, remove the view parameter.
Line 32, Column 166: [Suggestion-preserve-view-not-set] Did you mean to link to a specific version? It's usually better not to specify a version, so the link always goes to the canonical version. If you really need to link to a specific version, add &preserve-view=true to the URL: /javascript/api/outlook/office.infobarclickedeventargs?view=outlook-js-preview. Otherwise, remove the view parameter.

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit cd564ef:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/outlook/autolaunch.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit 9d30e53:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/outlook/autolaunch.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Fix NuGet package descriptions

https://github.com/aspnet/BasicMiddleware/blob/dev/src/Microsoft.AspNetCore.Rewrite/project.json

Was: ASP.NET Core basic middleware for:\r\nRewrite Url module.
Change to: ASP.NET Core basic middleware for rewriting URLs. Includes:\r\n* Support for custom URL rewrite rules\r\m* Support for running IIS URL Rewrite module rules\r\n* Support for running Apache mod_rewrite rules. (feel free to massage this a bit if it's not exactly right)

https://github.com/aspnet/BasicMiddleware/blob/dev/src/Microsoft.AspNetCore.Buffering/project.json

Was: ASP.NET Core middleware for buffering response bodies.
No change.

https://github.com/aspnet/BasicMiddleware/blob/dev/src/Microsoft.AspNetCore.HttpOverrides/project.json

Was: ASP.NET Core basic middleware for:\r\nX-Forwarded-* headers to forward headers from a proxy.\r\nHTTP method override header.
Change to: ASP.NET Core basic middleware for supporting HTTP method overrides. Includes:\r\nX-Forwarded-* headers to forward headers from a proxy.\r\nHTTP method override header.

https://github.com/aspnet/BasicMiddleware/blob/dev/src/Microsoft.AspNetCore.ResponseCompression/project.json

Was: ASP.NET Core middleware for HTTP Response compression.
No change.

@muratg make sure you triage this as well to set milestone/labels.

@mikaelm12 let's get these in right after branching for 1.1.0-preview1


How to use the trained model?

I have followed your steps for training, but how should I get test data and use the trained model for testing? Looking forward to your recovery

Thanks for your question @S3668.
Actually, we have integrated the evaluation module into the WandB. The evaluation is launched on the environment during training, thus no test data should be used. The evaluation results can be found in both WandB and the local log directory (exp_local/#task_name/#algo_name/#d100/#seed/eval.csv).
You may follow the office guidance of WandB to register your WandB account for result visualization.
Please let me know if there are any further questions.


Please surface the whole list of ./Vendor/MSFT/WorkProfile/ configuration CSP options for AfW (Android for work) Work Profile configuration

Please surface the whole list of ./Vendor/MSFT/WorkProfile/ configuration CSP options for AfW (Android for work) Work Profile configuration, as Intune SDK integration with Intune Managed Browser does not work with Kiosk devices enrolled, as they have no user context, only a device context.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 1c7dc362-5227-b8bf-cbbd-762bde22ec43
Version Independent ID: 7d838c1c-fcd7-f126-2d22-93312f0e3d65
Content: How to create configuration items for Android for Work devices managed with Intune - Configuration Manager
Content Source: sccm/mdm/deploy-use/create-configuration-items-for-android-for-work-devices-managed-without-the-client.md
Product: configuration-manager
GitHub Login: @aczechowski
Microsoft Alias: aaroncz

Thanks @peterjlay for the feedback. I checked with the engineering team, there are no settings available with custom policies that aren't available in the Intune console as first-class policy settings.
If you have further feedback on this, it would be as product feedback. Note, hybrid MDM is deprecated. You can submit feedback on Microsoft Intune on UserVoice.
I'm closing this issue as there's nothing actionable for this article at this time.


add support for Droidsound

as a listener of chiptunes It would be nice if droidsound scrobbled

Could you please share a link of exactly which droidsound application you are referring to?
I have found
https://play.google.com/store/apps/details?id=com.ssb.droidsound
and
https://play.google.com/store/apps/details?id=com.droidmjt.droidsounde

Droidsound-E is a derivative / continuation of the original Droidsound.
so in short https://play.google.com/store/apps/details?id=com.ssb.droidsound is the app i use from time to time to listen to chiptunes that said given that https://play.google.com/store/apps/details?id=com.droidmjt.droidsounde seems to be by the same creators I might be switching to that some time down the road as it seems they have stopped updating the old version.

I have sent an email to<EMAIL_ADDRESS>requesting they broadcast song information so SLS can scrobble music played in Droidsound.

I have sent an email to<EMAIL_ADDRESS>requesting they broadcast song information so SLS can scrobble music played in Droidsound-E.

Droidsound-E is maintained by me. Anyway, I can include this scrobble thingy if it doesn't require tons of changes here and there :)

Hi @droidmjt thanks for such a quick response!

Vanilla Music has a builtin scrobbler, open source shown here.

Scrobble Droid API for SLS

This feature has been added to Droidsound-E and will be availabe in next version (1.664). I will soon release unofficial build for those who can't wait :)

It seems to work.