training on images fails

I'm trying to do a simple image classification using ludwig running on windows 10.
However when starting the ludwig experiment I'm getting the following output:

╒══════════╕
│ TRAINING │
╘══════════╛
2019-04-02 18:03:45.110161: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX AVX2
2019-04-02 18:03:45.282447: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1433] Found device 0 with properties:
name: GeForce RTX 2080 Ti major: 7 minor: 5 memoryClockRate(GHz): 1.635
pciBusID: 0000:01:00.0
totalMemory: 11.00GiB freeMemory: 9.03GiB
2019-04-02 18:03:45.287903: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1512] Adding visible gpu devices: 0
2019-04-02 18:03:45.687938: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] Device interconnect StreamExecutor with strength 1 edge matrix:
2019-04-02 18:03:45.691258: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990]      0
2019-04-02 18:03:45.693117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1003] 0:   N
2019-04-02 18:03:45.695118: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1115] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8698 MB memory) -> physical GPU (device: 0, name: GeForce RTX 2080 Ti, pci bus id: 0000:01:00.0, compute capability: 7.5)
Epoch   1
Training:   0%|                                                                                | 0/1 [00:00<?, ?it/s]2019-04-02 18:03:47.229482: I tensorflow/stream_executor/dso_loader.cc:152] successfully opened CUDA library cublas64_100.dll locally
2019-04-02 18:03:47.476850: E tensorflow/stream_executor/cuda/cuda_blas.cc:510] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
2019-04-02 18:03:47.479920: E tensorflow/stream_executor/cuda/cuda_blas.cc:510] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
2019-04-02 18:03:47.483445: E tensorflow/stream_executor/cuda/cuda_blas.cc:510] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
2019-04-02 18:03:47.489994: E tensorflow/stream_executor/cuda/cuda_blas.cc:510] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
2019-04-02 18:03:47.492981: E tensorflow/stream_executor/cuda/cuda_blas.cc:510] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
2019-04-02 18:03:47.495837: E tensorflow/stream_executor/cuda/cuda_blas.cc:510] failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED
2019-04-02 18:03:48.578870: E tensorflow/stream_executor/cuda/cuda_dnn.cc:334] Could not create cudnn handle: CUDNN_STATUS_ALLOC_FAILED
2019-04-02 18:03:48.582129: E tensorflow/stream_executor/cuda/cuda_dnn.cc:334] Could not create cudnn handle: CUDNN_STATUS_ALLOC_FAILED
Traceback (most recent call last):
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1334, in _do_call
return fn(*args)
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1319, in _run_fn
options, feed_dict, fetch_list, target_list, run_metadata)
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1407, in _call_tf_sessionrun
run_metadata)
tensorflow.python.framework.errors_impl.UnknownError: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
[[{{node image_path/conv_0/Conv2D}}]]
[[{{node class/loss_class/train_mean_loss_class}}]]
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "c:\development\anaconda3\lib\runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "c:\development\anaconda3\lib\runpy.py", line 85, in run_code
exec(code, run_globals)
File "C:\Development\Anaconda3\Scripts\ludwig.exe_main.py", line 9, in
File "c:\development\anaconda3\lib\site-packages\ludwig\cli.py", line 86, in main
CLI()
File "c:\development\anaconda3\lib\site-packages\ludwig\cli.py", line 64, in init
getattr(self, args.command)()
File "c:\development\anaconda3\lib\site-packages\ludwig\cli.py", line 67, in experiment
experiment.cli(sys.argv[2:])
File "c:\development\anaconda3\lib\site-packages\ludwig\experiment.py", line 548, in cli
experiment(**vars(args))
File "c:\development\anaconda3\lib\site-packages\ludwig\experiment.py", line 258, in experiment
debug=debug
File "c:\development\anaconda3\lib\site-packages\ludwig\train.py", line 383, in train
**model_definition['training']
File "c:\development\anaconda3\lib\site-packages\ludwig\models\model.py", line 488, in train
is_training=True
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 929, in run
run_metadata_ptr)
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1152, in _run
feed_dict_tensor, options, run_metadata)
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1328, in _do_run
run_metadata)
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1348, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.UnknownError: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
[[node image_path/conv_0/Conv2D (defined at c:\development\anaconda3\lib\site-packages\ludwig\models\modules\convolutional_modules.py:54) ]]
[[node class/loss_class/train_mean_loss_class (defined at c:\development\anaconda3\lib\site-packages\ludwig\features\category_feature.py:371) ]]
Caused by op 'image_path/conv_0/Conv2D', defined at:
File "c:\development\anaconda3\lib\runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "c:\development\anaconda3\lib\runpy.py", line 85, in run_code
exec(code, run_globals)
File "C:\Development\Anaconda3\Scripts\ludwig.exe_main.py", line 9, in
sys.exit(main())
File "c:\development\anaconda3\lib\site-packages\ludwig\cli.py", line 86, in main
CLI()
File "c:\development\anaconda3\lib\site-packages\ludwig\cli.py", line 64, in init
getattr(self, args.command)()
File "c:\development\anaconda3\lib\site-packages\ludwig\cli.py", line 67, in experiment
experiment.cli(sys.argv[2:])
File "c:\development\anaconda3\lib\site-packages\ludwig\experiment.py", line 548, in cli
experiment(**vars(args))
File "c:\development\anaconda3\lib\site-packages\ludwig\experiment.py", line 258, in experiment
debug=debug
File "c:\development\anaconda3\lib\site-packages\ludwig\train.py", line 368, in train
debug=debug
File "c:\development\anaconda3\lib\site-packages\ludwig\models\model.py", line 110, in init
**kwargs
File "c:\development\anaconda3\lib\site-packages\ludwig\models\model.py", line 160, in __build
is_training=self.is_training
File "c:\development\anaconda3\lib\site-packages\ludwig\models\inputs.py", line 39, in build_inputs
**kwargs)
File "c:\development\anaconda3\lib\site-packages\ludwig\models\inputs.py", line 66, in build_single_input
**kwargs)
File "c:\development\anaconda3\lib\site-packages\ludwig\features\image_feature.py", line 180, in build_input
is_training,
File "c:\development\anaconda3\lib\site-packages\ludwig\models\modules\image_encoders.py", line 79, in call
is_training=is_training
File "c:\development\anaconda3\lib\site-packages\ludwig\models\modules\convolutional_modules.py", line 565, in call
is_training=is_training)
File "c:\development\anaconda3\lib\site-packages\ludwig\models\modules\convolutional_modules.py", line 147, in conv_2d_layer
dimensions=2, is_training=is_training)
File "c:\development\anaconda3\lib\site-packages\ludwig\models\modules\convolutional_modules.py", line 121, in conv_layer
is_training=is_training)
File "c:\development\anaconda3\lib\site-packages\ludwig\models\modules\convolutional_modules.py", line 54, in conv_2d
padding=padding) + biases
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\ops\gen_nn_ops.py", line 1026, in conv2d
data_format=data_format, dilations=dilations, name=name)
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 788, in _apply_op_helper
op_def=op_def)
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\util\deprecation.py", line 507, in new_func
return func(*args, **kwargs)
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\framework\ops.py", line 3300, in create_op
op_def=op_def)
File "c:\development\anaconda3\lib\site-packages\tensorflow\python\framework\ops.py", line 1801, in init
self._traceback = tf_stack.extract_stack()
UnknownError (see above for traceback): Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
[[node image_path/conv_0/Conv2D (defined at c:\development\anaconda3\lib\site-packages\ludwig\models\modules\convolutional_modules.py:54) ]]
[[node class/loss_class/train_mean_loss_class (defined at c:\development\anaconda3\lib\site-packages\ludwig\features\category_feature.py:371) ]]

cuDNN seems to be installed if i can trust this:

conda list cudnn
packages in environment at C:\Development\Anaconda3:
Name                    Version                   Build  Channel
cudnn                     7.3.1                cuda10.0_0

any clue whats wrong?

@Felix-N Can you please provide some more details about your environment? Tensorflow's version and CUDA version etc.

sure.
Windows 10
Tensorflow version 1.13.1
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Fri_Feb__8_19:08:26_Pacific_Standard_Time_2019
Cuda compilation tools, release 10.1, V10.1.105

Please provide a fully reproducible example for us to look into (sample of the csv, yaml file, command).
Anyway, it's likely that you have really big images and you are not resizing them through Ludwig's preprocessing, and that makes cuda go out of memory. Try to add:
preprocessing:
    height: 28
    width: 28

to your image feature. This will make the images 28x28 which should be small enough. Then you can try to increase the size up until you fill your ram. Also consider that the default batch size in ludwig is 128, for bigger images you may want to decrease it.

i've limited the test dataset to 90 images, and using this as the model yaml:
(changed size from 128 to 28 and tested again - same result)
changing in_memory to false yields in the same error too.

input_features:
-
name: image_path
type: image
in_memory: true
encoder: stacked_cnn
resize_method: crop_or_pad
width: 28
height: 28
output_features:
-
name: class
type: category

csv looks like this:

image_path,class
trainingData\colony_1\62f954b0-3b5f-11e9-9f34-f383edf2bd95\62f954b0-3b5f-11e9-9f34-f383edf2bd95_stitched.bmp_patches\patch102.jpg,colony_1
trainingData\colony_1\62f954b0-3b5f-11e9-9f34-f383edf2bd95\62f954b0-3b5f-11e9-9f34-f383edf2bd95_stitched.bmp_patches\patch117.jpg,colony_1

generally i'm just trying to get a small example to work to get started.
p.s.:
thanks so much for help

You are welcome!
You should put the preprocessing parameters (resize_method, width, height) within a preprocessing sub name. Also be sure to use the latest code on master isntead ofthe pypi package, finally make sure yo udelete the hdf5 and json cache files before retrying. Let me know if those things help.

thanks.
i've installed ludwig from master.
that indeed got it running twice.
third time resulted in a similar error as above (different line numbers though.
rebooting got it running again. I'll let you know if the problem persists.
do you recommend against increasing the image size? my guess was to use somewhat between 72x72 to 256x256 as size.
one more follow up on that: does ludwig handle image distortion to increase the image set? like rotation, flipping, or should i handle that myself before ?

yep same thing happend again.
error occurs. restarting helps to get it started again.
feels a bit like something is not closing correctly.

Quick update:
I've found the reason for the error.
I did not realyse that Adobe Lightroom uses the GPU.
Whenever Lightroom was running the error occurs. Disabling GPU usage in lightroom solved the issue.
Again huge thanks to @w4nderlust

Oh wow, that's interesting, maybe we should add somewhere in the docs a sentence that suggests being sure about the memory usage of the GPU. Glad you solved your issue anyway!


Add ascii-value.c

Why:
Closes #236
Closes #330
Check off the following:

[x] I have reviewed my changes in staging (look for "Automatically generated comment" and click Modified to view your latest changes).
[x] For content changes, I have completed the self-review checklist.

Hey @RuiL1904
Thanks for contributing to this open source project 😃
This PR will be reviewed and merged shortly

Preview : https://codinasion--pr36-dev-igku8tg2.web.app/programme/ascii-value/
Preview : https://codinasion--pr36-dev-igku8tg2.web.app/programme/check-leap-year/
(expires Tue, 22 Mar 2022 15:21:50 GMT)

LIVE : https://codinasion.web.app/programme/ascii-value/
LIVE : https://codinasion.web.app/programme/check-leap-year/


chore: bump fulcio, trillian and ct

Use the latest versions of these dependencies to eliminate failures in snyk.
Closes: https://github.com/securesign/secure-sign-operator/pull/254

/lgtm


set_random_seed() got an unexpected keyword argument 'gpus' for train_ppo_ale.py

python train_ppo_ale.py Adventure
chainer rl: 0.3.0

This should be the same issue as #76. Install from source fixed it.


Importing shapefile using fiona

Hi all,
I am using geopandas to import shapefile, but it seems the problem is due to fiona according to this post
It is strange that, fiona works for some certain shapefiles, but does not work for others. And actually I think are shapefiles I use are well -maintained. For they can all be opened using QGIS.
Below are my scripts and errors I get.
import fiona
with fiona.open('taz.shp') as src:
    for feature in src:
        print feature

---------------------------------------------------------------------------
IndexError                                Traceback (most recent call last)
<ipython-input-9-b70513efc12b> in <module>()
      1 import fiona
      2 with fiona.open('taz.shp') as src:
----> 3     for feature in src:
      4         print feature

fiona/ogrext.pyx in fiona.ogrext.Iterator.__next__ (fiona/ogrext.c:17244)()

fiona/ogrext.pyx in fiona.ogrext.FeatureBuilder.build (fiona/ogrext.c:3254)()

IndexError: list index out of range

@DanqingZ Looks like this might be a GDAL 1.0 vs. 2.0 issue.  What version of GDAL and Fiona are you running?

They are listed as below, I am using anaconda and pip~
fiona                     1.6.0               np110py27_0
gdal                      1.11.0               np19py27_0

@DanqingZ Could you please paste the results of:
import fiona.ogrext
print(fiona.ogrext.get_gdal_release_name())

@geowurster  2.0.0

@DanqingZ So you have two versions of GDAL installed and Fiona is using 2.0.  @sgillies I think you know more about the conda vs. pip install process than I do.

Oh yes, I used pip install to install both the Fiona and GDAL packages @geowurster @sgillies

@DanqingZ once you get GDAL 2.0 (which Fiona doesn't yet support, but soon...) off your conda environment's library path, Fiona will import and run just fine.

@sgillies ...That is exactly my problem..How to get the GDAL 2.0 off my conda environment's library path? I type "conda list" in the terminal, and it shows the version of GDAL is 1.11

@DanqingZ sorry, but that's a conda issue that you'll need to take up with ContinuumIO or the conda community.

@DanqingZ did you figure out a solution? I've exactly the same problem.

Hi,
I have not found a way to save the output from Fiona into a list and to read it back with shapely.  I figure i need to use gdal and output to WKT. Don't know how to make shapely understand the Fiona dictionary output:(
For now, I just use a different file obj for every time I need to do a loop inside a loop.  Same file but different handle I guess...  Still hoping to get some help on this. It should be simple.  I must be missing a small thing.
Cheers.
Nicolas
On Nov 13, 2015 23:12, patrick-dd<EMAIL_ADDRESS>wrote:
@DanqingZ did you figure out a solution? I've exactly the same problem.

Reply to this email directly or view it on GitHub:
https://github.com/Toblerity/Fiona/issues/290#issuecomment-156623997

http://gis.stackexchange.com/questions/139905/how-to-call-shapely-coords-on-a-fiona-filtered-list
On Nov 13, 2015 23:12, patrick-dd<EMAIL_ADDRESS>wrote:@DanqingZ did you figure out a solution? I've exactly the same problem.
—Reply to this email directly or view it on GitHub.

Hi,
I don't know what I was doing wrong... but it works..
import fiona
from shapely.geometry import shape
import time
ptList = []
classpolyList =[]
with fiona.open("c:/pytemp/fiona/planning_neighborhoods.shp", "r") as classPoly:
classpolyList = list(classPoly)
with fiona.open("c:/pytemp/fiona/Schools_Private_Pt.shp", "r") as inputLidarPt:
x = time.time()
print x
ptList = list(inputLidarPt)
x = time.time()
print x
for polyg in classpolyList:
for pts in ptList:
if shape(polyg['geometry']).contains(shape(pts['geometry'])):
pass
else:
pass
y = time.time()
z = y-x
print z
print 'done'
Date: Fri, 13 Nov 2015 20:12:13 -0800
From<EMAIL_ADDRESS>To<EMAIL_ADDRESS>Subject: Re: [Fiona] Importing shapefile using fiona (#290)
@DanqingZ did you figure out a solution? I've exactly the same problem.
—
Reply to this email directly or view it on GitHub.

@DanqingZ the following commands fixed this issue for me (I had installed gdal and fiona with conda and was at version 2.0.0 and 1.6.0 respectively):
conda install gdal=1.11.2
conda install fiona=1.5.1

This may not be an issue for others, but when i filtered my geodataframe to exclude null cells in the geometry column, I could successfully write geojson or shapefiles. I ws receiving the same error as the OP before.


refactor(wallet-mobile): Revamped create/restore funnel

packages/banxa/lib needs to be removed. This package doesn't exist anymore


Merge option should read description to check for alt-title

Why/User Benefit/User Problem
Some mangas have the translated title as main title on ML, and this cause "No results found"
What/Requirements
The app should search with alt name too or search the title in the description of ML
Example: Zannen Jokanbu Black General-san (No results found), but the alt-title is written on ML description (Precarious Woman Executive Miss Black General is on ML)

I don't think an automated way of doing this makes sense.
Take for example
https://api.mangadex.org/manga/e78a489b-6632-4d61-b00b-5206f5b8b22b
Even when the data is corrected there are 4+ alt titles for en
Showing the alt titles makes the most sense, allowing the user to copy and search with those


[move-prover] Re-enables invariant disabling analysis-(81)

For some reason, before #8946 public functions which have invariants indirectly disabled have not been reported, and that PR disabled the logic for this to not block landing.
This PR re-enables the error reporting with better error messages for why invariants are disabled. With the help of this it then  fixes various instances in the framework where invariant disabling requires to introduce friend functions.
This also fixes visibility problems in move-lang/functional-tests and e2e-testsuite. Friend functions introduced in this PR are not visible to those tests. To mitigate, we introduce wrappers foo_for_test for each friend function foo, and call those from tests instead. Those functions should have a test_only attribute, however, this currently does not work because legacy unit tests and e2e tests do not see test-only functions. So we added the attribute but commented it out with a TODO.
Motivation
Bug fix and better error reporting
Have you read the Contributing Guidelines on pull requests?
Yes
Test Plan
Existing and new tests
Related PRs
#8946

/canary

:sunny: Canary successful

/land

:lock: Merge Conflict


Eh

Please stop using 4.0.0 builds. They are not released and will break your plugins. Provided the plugin actually loads, I would also like to remind you that BlockSniper does not provide support for third party modified versions of PocketMine.


Clear separation of API schemas (request and respponse DTOs) and data models, lower case comparison of image type name for case insensitive fetch/search, refactoring and fixes (Jira: BDP-4381)).

Jira: BDP-4381
Included changes

Clear separation of API schemas (request and response DTOs) and data models. Even though, there are one to one correspondence between two in most of the cases, the change would enable more extensibility in future such as independently adding/removing different fields API DTOs and backend models etc.
Lowercase comparison of image type name for case insensitive fetch/search.
Code refactoring and cleanup.
Renaming changes.
Fixed bugs found during testing.

Pull Request Test Coverage Report for Build 5728

228 of 500 (45.6%)  changed or added relevant lines in 25 files are covered.
216 unchanged lines in 16 files lost coverage.
Overall coverage decreased (-0.6%) to 43.001%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

azkaban-common/src/main/java/azkaban/imagemgmt/models/ImageRampupPlan.java
5
6
83.33%

azkaban-web-server/src/main/java/azkaban/webapp/AzkabanWebServer.java
2
3
66.67%

azkaban-common/src/main/java/azkaban/imagemgmt/dto/ImageOwnershipDTO.java
8
10
80.0%

azkaban-web-server/src/main/java/azkaban/imagemgmt/services/ImageVersionServiceImpl.java
9
12
75.0%

azkaban-common/src/main/java/azkaban/imagemgmt/dto/BaseDTO.java
12
16
75.0%

azkaban-web-server/src/main/java/azkaban/imagemgmt/services/ImageRampupServiceImpl.java
12
18
66.67%

azkaban-web-server/src/main/java/azkaban/imagemgmt/servlets/ImageTypeServlet.java
0
6
0.0%

azkaban-common/src/main/java/azkaban/imagemgmt/utils/ConverterUtils.java
5
16
31.25%

azkaban-common/src/main/java/azkaban/imagemgmt/daos/ImageTypeDaoImpl.java
0
14
0.0%

azkaban-common/src/main/java/azkaban/imagemgmt/converters/ImageVersionConverter.java
17
33
51.52%

Files with Coverage Reduction
New Missed Lines
%

azkaban-common/src/main/java/azkaban/imagemgmt/models/ImageRampup.java
1
84.62%

azkaban-web-server/src/main/java/azkaban/imagemgmt/services/ImageVersionServiceImpl.java
1
80.95%

azkaban-web-server/src/main/java/azkaban/imagemgmt/servlets/ImageRampupServlet.java
1
0%

azkaban-web-server/src/main/java/azkaban/imagemgmt/servlets/ImageTypeServlet.java
1
0%

azkaban-web-server/src/main/java/azkaban/imagemgmt/servlets/ImageVersionServlet.java
1
0%

azkaban-common/src/main/java/azkaban/imagemgmt/models/BaseModel.java
2
87.5%

azkaban-common/src/main/java/azkaban/imagemgmt/models/ImageType.java
2
88.46%

azkaban-common/src/main/java/azkaban/imagemgmt/models/ImageVersion.java
2
93.75%

azkaban-common/src/main/java/azkaban/jobExecutor/AbstractProcessJob.java
2
52.58%

azkaban-common/src/main/java/azkaban/project/AzkabanProjectLoader.java
2
87.82%

Totals

Change from base Build 5723:
-0.6%

Covered Lines:
15578

Relevant Lines:
36227

💛  - Coveralls

Thanks @arvindpruthi for reviewing. Will take care of the nit comment separately and merging this PR.


Not available in Greece for purchase

Hi, great little app,
I want to buy it but it is not available to the Windows Store from Greece. If i go through the web link to the store, I can see the app but no option to purchase is or download it and if i search for it in my store no results are returned.
Will be good if you can make it available to Greece or provide alternative channels to purchase it.
Thanks

It's a temporary situation in all the countries. It may take a few days to get available again. Please be patient 🙂


AFN setReachabilityStatusChangeBlock is slow than Reachability notification

I test it on iOS8 5s,some time it slow 1-2 seconds when i turn to to flight mode from WIFI,I think it should return ReachabilityStatusNotReachable immediately,not delay 1-2s. can any one explain it?

This is not a support forum. For usage questions, please try Stack Overflow.


feat(debug): add the props factory to the debug route

:tada: This PR is included in version 0.15.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


java.lang.IllegalArgumentException: one of either dataSource or dataSourceClassName must be specified

java.lang.IllegalArgumentException: one of either dataSource or dataSourceClassName must be specified
	at com.zaxxer.hikari.AbstractHikariConfig.validate(AbstractHikariConfig.java:779)
	at com.zaxxer.hikari.HikariDataSource.<init>(HikariDataSource.java:75)

So was getting this recently, and took me a while to figure out. I had dataSourceClassName set correctly in my config file. But what it was actually expecting to be there was dataSourceClass.
Updating the error message to match expected behaviour would be useful.

@alias1 This must be on a very old version of HikariCP.  The messages and validation have changed significantly.

This was using the latest version of slick-hikaricp (3.1.1), which seems to be pulling in 2.3.7.
For reference, the relevant bits of the dependency tree:
[info]   +-com.typesafe.slick:slick-hikaricp_2.11:3.1.1 [S]
[info]   | +-com.typesafe.slick:slick_2.11:3.1.1 [S]
..snip..
[info]   | +-com.zaxxer:HikariCP-java6:2.3.7

So yeah, definitely linked to an old version.

For future reference, solved (updated) by https://github.com/slick/slick/pull/1677

Hi @0xdevalias ,
I had the same problem as you when configuring multiple data sources.
Could you please tell me how to solve this issue?
Thank you


Feature Suggestion: Detailed Info About Apps and Downloads

Hi, first off I'd like to thank you for putting the time and effort into this awesome program it really eased the process of Installing apps.
Now, I would like to suggest enhancing this app by making it display detailed information about the app we're going to install (name, size, icon,...etc) and also making that when downloading an app from the built-in browser the program displays info about the app and the download process (download speed, download progress in percentage,...etc) also allowing for pausing and resuming downloads.
Also, one last thing, I'm wondering if it's possible to extract the installed app into an installation package so we don't need to redownload it again.
I really hope you consider adding these features in the next update as it will really enhance the program in my opinion, good luck.

about app info its should already be present in the page where you select the app
the progress bar shows the progress, i intentionally didn't add much details to the download to make it simpler
pause resume functionality is already present hit stop when you want to pause. the download afterwards select the same app again then it will resume the download
the downloaded apps are stored in downloads folder (options --> downloads)

Wow! 😅 but also I just wanted the program to be elegant and reliable instead of everything being separated. Thanks for the info though.

I am planning on rebuilding the app from scratch using winui3.

regarding ui improvement, I am planning on rebuilding the app from scratch using winui3 don't ask the eta as i am doing it in my free time.

That's awesome! Take as much time as you need and we'll patiently wait for you. Good luck, thanks for this.


Remove per-layer attproj and fcproj activation tensors

I'm not sure how we missed this but we don't actually need these tensors at all for the backward pass at all! Possibly this wasn't the case when residual/layernorm/recompute were implemented differently, or I'm missing something? Either way, it's a significant GPU memory saving.

wow, this is great


Non english ASCII character are broken in downloaded files names

Hello,
the snap has wrong locale set: sun.jnu.encoding=ANSI_X3.4-1968
set correct locale within the snap/launcher
see
https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1576411
https://forum.snapcraft.io/t/lack-of-compiled-locales-breaks-gettext-based-localisation/3758
without proper locale set within the snap package, every non asci character will be broken/replaced by ?
my snap: latest/stable:    0+git.1670793

I have same issue. Other possible way to solve it, could be to run JDownloader with additional parameters:
java -Dsun.jnu.encoding=UTF-8 -Dfile.encoding=UTF-8 -jar JDownloader.jar
Running the JDownloader with above command in terminal, encoding is proper and all works.
Issue also desribed here: https://board.jdownloader.org/showthread.php?t=67428
And I reported similar issue for dcoker image:
https://github.com/jaymoulin/docker-jdownloader/issues/83
snap --version
snap    2.48+20.04
snapd   2.48+20.04
series  16
ubuntu  20.04
kernel  5.4.0-56-generic

I pushed a fix for this to the candidate channel. Please test and let me know if this works for you.
snap refresh jdownloader2 --channel=latest/candidate

Thanks for quick support. Unfortunatelly this is not working. I see you passing proper arguments into VM but the sun.jnu.encoding is still wrong. See below from the log. Probably setting locales is still needed.
file.encoding=UTF-8
sun.jnu.encoding=ANSI_X3.4-1968
sun.io.unicode.encoding=UnicodeLittle
VMArgs: [-Dsun.jnu.encoding=UTF-8, -Dfile.encoding=UTF-8]

I pushed another change to the candidate channel. Can you please try again?
snap refresh jdownloader2 --channel=latest/candidate

@fnkr hello, i have just tried and the downloaded file name still contain question marks. Details here.

@fnkr hello, the problem can be fixed by adding gnome-3-38 extension like:
apps:
jdownloader:
extensions:

gnome-3-38


model.final.h5 is not working?

Hi, Thanks for providing this. I run your project but model.final.h5 is empty so it's not working. Is there any solution to this problem?

Hi, I have re-uploaded model.final.h5, you can try to download it


An error occurred when the script was running

Error processing account keke3: Cannot read properties of undefined (reading 'dailyReward')

i just try with new Query and it's still working

Yeah new query. Me too. But there are an error even the script run. Maybe the task or somethings.

I will not close this issue.
Action plan if you have an error:

check the availability of updates;
restart the code;
check if the game is available and if errors pop up in the console when trying to do something;
update queryid/userid;
if none of the above helped, go to [tg channel] (https://t.me/tor_dev) there write about the error, if possible I will answer).


Better error handling

Fixes #26

Coverage decreased (-10.7%) to 84.502% when pulling 2d0816e7ea108f6f41b6dd74efe337c37ca36d47 on better-error into c6d294015d84e9fd5dae7a7e33c169f8e5ae5069 on release2.0.

Coverage decreased (-10.6%) to 84.559% when pulling 0787d75f7c07d18f4234f62a5fe51d67356ee742 on better-error into c6d294015d84e9fd5dae7a7e33c169f8e5ae5069 on release2.0.

Coverage decreased (-10.6%) to 84.559% when pulling 5e57296a16d3919fb8f7fc1ff3dc84c50f6fe909 on better-error into de0b5c5c712ee075e2dfe955207ce49e66d55362 on release2.0.

LGTM.


Influx: Tag data by month and year

Is your feature request related to a problem? Please describe.
The InfluxDB integration is fantastic for creating your own dashboards - even for use cases beyond vehicle charging. For example my dashboards in this thread.
However Influx has some grave limitations:

You cannot easily group data by months or years
You cannot change the tags later (e.g. I tried to create a script to add missing tags later, but Influx does not support that)

Describe the solution you'd like
Tag data that is written by evcc into influx by month and year. E.g. a month tag with values like [1,2,...12] or ["Jan", "Feb",..."Dec"] and a year tag containing the year.
I neither know the EVCC code well nor do I now Go, but from what I see this change could be done in influxdb.go in Line 72. The given tags map just needs to be extended by tags for months and year and hopefully this would solve this for all the data written by EVCC into Influx.
Describe alternatives you've considered
Tried to create a script that alters the data written by EVCC and adds tags. However Influx does not allow to change or add tags later.
Additional context
I know this request is not the core use case of EVCC, but due to the limitations of Influx, I haven't found another alternative yet.

This doesn't seem like a good idea, especially since Influx already has the data. Is there any indication, that doing so is best practice?

@andig See this thread, where Anaisdg (Influx Staff) is suggesting exactly this as solution. She suggest however to use the Date proxessor plugin of telegraf, which I am not sure whether it works with EVCC.
In any other DB I would write a script to add this later in a post-processing step. However this again is not possible with influx: https://github.com/influxdata/influxdb/issues/3904

The second is to use flux 813 to query your data. It allows you to query by year and month.

Since flux has been available for a couple of years now this seems to be the way to go?

@andig Note that Flux is going out of support:

https://docs.influxdata.com/flux/v0/stdlib/date/month/
I totally understand that I am trying to solve an issue, which is not in the scope of EVCC. However for EVCC it would be a small thing to add, while writing the data points. For me I do not have a good solution other than reading all the data, annotating it with the month and year tag and then writing the data into a new series (so ending up with duplicate data stores).
Maybe an idea that could please everyone? Would it be a good idea to add a generic tagging to the Influx configuration in EVCC? Something like
influx:
  url: http://localhost:8086
  database: evcc
  user: grafana
  password: xxxxxxxx
  tags:
     - key: month
       value: ${month}
     - key: year
       value: ${year}
     - key: evcc-instance
       value: garage-evcc

Like you can see this could also be used to tag the values by other dimensions, like an evcc-instance just in case you want to store data from multiple running EVCC instances in the same table.


Evens/Commands not added to the tree

Been following your set up mentioned in the integration test set.
Having difficulty debugging exactly where an error is taking place, but it seems that the commands and events being defined thrown away.
domain
├── lib
│   ├── command.json
│   └── order
│       ├── aggregate.ts
│       ├── businessRules
│       ├── commands
│       │   ├── commands.ts
│       │   ├── createOrder.ts
│       │   └── updateOrder.ts
│       ├── context.ts
│       ├── events
│       │   ├── events.ts
│       │   ├── orderCreated.ts
│       │   └── orderUpdated.ts
│       ├── order.ts
│       ├── validationRules
│       └── viewBuilders
│           ├── builders.ts
│           └── collection.ts
├── msgbus.ts
└── server.ts

 domain load domain files.. +0ms
  domain:structureLoader found aggregate at: /Users/jacob/projects/relay/lib/domain/lib/order/aggregate.js +0ms
domain:structureLoader found context at: /Users/jacob/projects/relay/lib/domain/lib/order/context.js +2ms
  domain:structureLoader found command at: /Users/jacob/projects/relay/lib/domain/lib/order/commands/commands.js +0ms
  domain:structureLoader found event at: /Users/jacob/projects/relay/lib/domain/lib/order/events/events.js +0ms
[ { path: '/Users/jacob/projects/relay/lib/domain/lib/order/events/events.js',
    dottiedBase: 'events',
    fileName: 'events.js',
    value:
     Event {
       name: 'orderUpdated',
       options: {},
       definitions: [Object],
       version: 0,
       payload: null,
       evtFn: [Function: applicator] },
    fileType: 'js',
    name: 'orderUpdated' } ]
  domain no validator extension defined +44ms
  domain prepare infrastructure... +1ms
  domain prepare eventStore... +1ms
  domain prepare aggregateLock... +0ms
node_redis: WARNING: You activated the retry_strategy and max_attempts at the same time. This is not possible and max_attempts will be ignored.
  eventstore no publisher defined +0ms
  domain inject all needed dependencies... +9ms
  domain domain inited +1ms
{
  "contexts": [
    {
      "name": "order",
      "aggregates": [
        {
          "name": "order",
          "version": 0,
          "commands": [],
          "events": [],
          "businessRules": []
        }
      ]
    }
  ]
}

I added some extra logs, I would expect commands and events in the final order context to be populated.

Ah looks like the dottied base got confused because they were exported in the subdirectory.
moving orders/commands/commands.ts up to orders/commands.ts helps the loader to define it properly.


Support 24-bit colour

This would give us nicer background highlighting and multiple shades (e.g. making certain parts of a change more prominent, similar to git-split-diffs).

A few points against and for this:
Pros:
Possibly custom language-based theming
Let's you change the colors only for this app.
Cons:
Reduces the ability to have a shared theme across all cli apps by using term theme.
Makes it more likely for the fallback colors to not work well.
Notes: Im not sure if you're using bright/bold colors, but if you aren't, they could be used to highlight granular changes.
:)

I’m using Base16 themes, which makes extensive use of ANSI colors. With Base16 I can keep the command unchanged, and switch theme purely via my terminal (the only right way when SSH is involved). If 24-bit color is going to be supported, please kindly provide an ANSI fallback.


[Feature Request] Ability to change the auto assign feature to map types to types that I want

Example use case trying to convert sqlserver to mysql
and the column is nvarchar(-1) and it naturally maps to varchar but I want it to map to text.

data types could be changed manually in data transfer dialog


Fix "Push Ansible Release Tag" Github workflow

Add change to galaxy.yml to trigger the release

oh... ansible 4.0.0 released 3 hours ago, ok


[WebToolsE2E][Aspire] When deploying AspireShop, if I choose to expose catalogdbmanager publicly, I still get a 404 from the deployed application after browsing to /health.

INSTALL STEPS

Clean machine: Win11 x64 23h2 ENU
Install VS 17.10 Preview 3 [ Includes Aspire 8.0.0-preview.5.24201.12 and SDK 8.0.300-preview.24203.14 ]
Install Docker Desktop for Windows

REPRO STEPS

Clone aspire-samples repo, checkout the preview.5 branch
Update sdk version to 8.0.300-preview.24203.14 in global.json
Open samples\AspireShop.sln
Build and run
Open Program.cs under AspireShop.AppHost, add following code to expose 'catalogmanager'

Open the solution folder in a Command Prompt
Run azd init to initialize the app for deployment
Run azd up to deploy to Azure, you can see that catalogdbmanager and frontend are available publicly (i.e. there's no 'internal' in the URL)

ACTUAL
Catalogdbmanager fails to load when browsing to /health

Note

But when you running it, if you click the Endpoint for 'catalogdbmanager' in the dashboard, you can see the status is 'Healthy'

EXPECTED
I can get status as 'Healthy' when I hit the Endpoint of the deployed catalogdbmanager.

What version of azd?

@davidfowl The azd version is 1.8.0.

The health endpoints are no longer added in Production environments so the 404 is expected after deployment.


Allow sending multiple responses for GroupMe

Hey, this contribution is great!
It's very appreciated and thank you for implementing it. We've looked into the code and would only suggest instead of the added dependency for promiseForEach, maybe implement it using a similar solution mentioned here https://stackoverflow.com/questions/37916064/sequential-iteration-using-es6-promises
Because Lambda uploads take longer with more dependencies, we tend to keep as few as possible. What do you think?

Thanks for the quick feedback! I copied the promise-each implementation into lib/promise-each.js, modified it to remove dependencies and linting errors, and used it instead. What do you think?

Hey @simalexan, have you had a chance to review the most recent changes? I just stumbled across this again and thought I'd check in.


Game crashes whenever i die

Describe your bug here.
It crashes when i enter the GameOverSubstate
Command Prompt/Terminal logs (if existing)
GameOverSubstate.hx (line 106)
flixel/FlxState.hx (line 203)
flixel/FlxState.hx (line 212)
flixel/FlxGame.hx (line 747)
flixel/FlxGame.hx (line 677)
flixel/FlxGame.hx (line 551)
openfl/events/EventDispatcher.hx (line 402)
openfl/display/DisplayObject.hx (line 1399)

Uncaught Error: Null Object Reference
Please report this error to the GitHub page: https://github.com/ShadowMario/FNF-PsychEngine

> Crash Handler written by: sqirra-rng

Are you modding a build from source or with Lua?
Source
What is your build target?
Windows
Did you edit anything in this build? If so, mention or summarize your changes.
i was source code editing, but for some reason idk why, it just crashes whenever i die or reset to the GameOverSubstate, i did not edit any code thats used for the GameOverSubstate, all i did in PlayState was add new rating names, rating fc, winning icons, and editing the rating fc bool variable since the rating name kept saying null

the bug was like at 0.6.2, i did edit like the assets, characters i left in the files are only BOYFRIEND, DADDY_DEAREST, GF_assets, Hyper, and spooky_kids_assets

Is there a death animation?

make it apart of the base mod

did 0.6.2 change which death animation is used for the GameOverSubstate, as i was updating the mod version from 0.5.2h to 0.6.2

The engine now uses a separate character for death state


chore: frontend brand updates

Use new frontend brand updates.

Looks very cool!

Trying to find out why the deploy preview does not work here. 🤔

Let's try to create a new PR.


Changing Tabs in the Export tool fails

The following gives me an error on trying to change to the tab "Files & Presets":
[Facebook\WebDriver\Exception\ElementClickInterceptedException] element click intercepted: Element ... is not clickable at point (170, 16). Other element would receive the click:
...

(Session info: headless chrome=89.0.4389.114)
"importexport": [
                    {
                        "action": "setScreenshotsImagePath",
                        "path": "Images/AutomaticScreenshots/ImportExport"
                    },
                    {
                        "action": "setScreenshotsRstPath",
                        "path": "Images/AutomaticScreenshots/ImportExport"
                    },
                    {"action": "resizeWindow", "width": 1024,"height": 768},
                    {
                        "action": "amOnPage",
                        "page": "/typo3/record/importexport/export?token=x&id=0&tx_impexp[pagetree][id]=7&tx_impexp[pagetree][levels]=0&tx_impexp[pagetree][tables][]=_ALL"
                    },
                    {
                        "action": "makeScreenshotOfWindow",
                        "fileName": "ExportDialog",
                        "altText": "Select the tables to be exported",
                        "captionText": "Select the tables to be exported"
                    },
                    {"action": "selectOption", "select": "select[name='tx_impexp[pagetree][levels]']", "option": "999"},
                    {"action":  "click", "link":  "Update"},
                    {
                        "action": "makeScreenshotOfWindow",
                        "fileName": "ExportDialogInfiniteLevels",
                        "altText": "Select the page levels to be exported",
                        "captionText": "Select the page levels to be exported"
                    },
                    {
                        "action": "amOnPage",
                        "page": "/typo3/record/importexport/export?token=x&id=0&tx_impexp[pagetree][id]=1&tx_impexp[pagetree][levels]=0&tx_impexp[pagetree][tables][]=_ALL"
                    },
                    {
                        "action": "makeScreenshotOfElement",
                        "selector": ".t3js-impexp-preview",
                        "fileName": "CheckExport",
                        "altText": "Check the exported data",
                        "captionText": "Check the exported data"
                    },
                    {
                        "action": "see",
                        "text": "File & Preset"
                    },
                    {
                        "action": "click",
                        "link": "File & Preset"
                    },
                    {"action": "fillField", "field": "input#impexp-filename", "value": "MyExport"},
                    {"action": "drawBox", "selector": "input[name='tx_impexp[download_export]']"},
                    {
                        "action": "makeScreenshotOfElement",
                        "selector": ".t3js-impexp-preview",
                        "fileName": "DownloadExport",
                        "altText": "Download the export data",
                        "captionText": "Download the export data"
                    }
                ]

Whenever you run into an error, there will be a screenshot captured in folder public/typo3temp/var/tests/ScreenshotsReports which might give further insights on what is going wrong. Would you post here the screenshot and tell which suite you run?

This was in Introduction and the Error-Screenshots showed no reason why this should happen

The module has been scrolled down a bit so the module header covered the tab you wanted to click. Handle it by scrolling the page up with action scrollModuleBodyToTop before clicking the tab:
{
    "suites": {
        "Introduction": {
            "screenshots": {
                "importexport": [
                    ..
                    {"action": "scrollModuleBodyToTop"},
                    {
                        "action": "see",
                        "text": "File & Preset"
                    },
                    {
                        "action": "click",
                        "link": "File & Preset"
                    },
                    {"action": "fillField", "field": "input#impexp-filename", "value": "MyExport"},
                    {"action": "drawBox", "selector": "input[name='tx_impexp[download_export]']"},
                    {
                        "action": "makeScreenshotOfElement",
                        "selector": ".t3js-impexp-preview",
                        "fileName": "DownloadExport",
                        "altText": "Download the export data",
                        "captionText": "Download the export data"
                    }
                ]
            }
        }
    }
}

This is the screenshot of the failing action:

worked fine


Step 5, Upload deployment assets issue (NoSuchBucket)

Describe the bug
Hi
I'm declaring successfully environment variables in step 4, but in step "5 , Upload deployment assets" the first copy works fine but when i run the second CP command i get this error:
upload failed: deployment/regional-s3-assets/ip_retention_handler.zip to s3://test-test-test-template-nv-us-east-1/test-test-test/1/ip_retention_handler.zip An error occurred (NoSuchBucket) when calling the PutObject operation: The specified bucket does not exist
But, if i change the variable "$DIST_OUTPUT_BUCKET-$AWS_REGION" with the bucket name, the command run successfully.

Thanks for reporting the issue. Per step 3 in readme, the distribution bucket is a regional bucket that stores lambda source code. Therefore the bucket name should have the region name (where you intend to deploy the solution) as its suffix. Step 5 meanly provides a sample command that uploads assets to the $DIST_OUTPUT_BUCKET-$AWS_REGION bucket that you created previously. If all the steps are followed, the command should succeed.

I did everything according to the instructions, please notice that when i don't user the variable  "$DIST_OUTPUT_BUCKET-$AWS_REGION"
The command run successfully

Thanks for the comment. We will revisit the relevant instructions in future releases.

A better resolution for the issue is the following:
# This assumes all of the OS-level configuration has been completed and git repo has already been cloned
#
# This script should be run from the repo's deployment directory
# cd deployment
# ./build-s3-dist.sh source-bucket-base-name trademarked-solution-name version-code
#
# Paramenters:
#  - template-bucket: Name for the S3 bucket location where the templates are found
#  - source-bucket-base-name: Name for the S3 bucket location where the Lambda source
#    code is deployed. The template will append '-[region_name]' to this bucket name.
#  - trademarked-solution-name: name of the solution for consistency
#  - version-code: version of the package
#
#    For example: ./build-s3-dist.sh template-bucket source-bucket-base-name my-solution v3.0
#    The template will then expect the source code to be located in the solutions-[region_name] bucket

For finding the solution to the problem, I had to deep dive into the source code in the aws-waf-security-automations-main/deployment/build-s3-dist.sh file to read it thoroughly and understand how it sets the env variables, and according to the following line source-bucket-base-name: Name for the S3 bucket location where the Lambda source code is deployed. The template will append '-[region_name]' to this bucket name., the source-bucket-base-name env variable mustn't have the region name appended to it, as the template will append it by itself. Whenever I appended the region name to that variable, the CF stack failed to create indicating that the S3 bucket doesn't exist, therefore, that variable must only contain the name of the global bucket, which is a prefix for it.
In the line The template will then expect the source code to be located in the solutions-[region_name] bucket, it "implies" that the source-bucket-base-name parameter must match the trademarked-solution-name parameter, which is the same as SOLUTION_NAME env variable, hence the DIST_OUTPUT_BUCKET and SOLUTION_NAME env variables values must match.
I created the S3 buckets with the following names:

global bucket: alb-waf-9282n
regional bucket: alb-waf-9282n-af-south-1

and I set the env variables for the solution as follows (where AWS_REGION varied for the CloudFront endpoint):

export TEMPLATE_OUTPUT_BUCKET="alb-waf-9282n"
export DIST_OUTPUT_BUCKET="alb-waf-9282n"
export SOLUTION_NAME="alb-waf-9282n"
export VERSION="v1.0"
export AWS_REGION="af-south-1"

I uploaded the deployment assets with the same commands described in the README.md, and it ran successfully.
Therefore, for avoiding the issue, I set the same values for TEMPLATE_OUTPUT_BUCKET, DIST_OUTPUT_BUCKET, and SOLUTION_NAME env variables, whether it's for the ALB endpoint or the CloudFront endpoint, and the CF stack executes successfully.


Binsperdec not being passed through to fermi sed generation

The following line: https://github.com/takdg123/vtspy/blob/415ac315b2cf03a9693b980385bf4b345c45bc66/vtspy/analysis/fermi_analysis.py#L577
sets the binning for the Fermi sed generation differently than is specified by the binsperdec provided in the config.yaml file.
This can most simply be resolved by replacing the loge_bins=loge_bins with loge_bins=self.gta.log_energies, which will pull the binning straight from the GTAnalysis object, which has been initialized with the Fermi portion of the config file. Beyond that, however, there is likely still some cleanup needed in the surrounding areas to remove extraneous code. Not sure if there needs to be edge cases accounted for in case of binsperdec missing from the config file.

I have already written the preliminary code that can fix this, but am waiting to submit a PR as it's built on top of the currently existing PR #6

I just merged PR #6.
But I think binsperdec and loge_bins have different goals. One is for the dataset construction in gammapy and the other one is for the fermpiy analysis that is defined with nbins. Do you think they should be the same? Or should we make clearer that they are different?

I guess we use binsperdec as part of the dataset construction for the gammapy analisys, but not for the fermipy analysis where we rely more on nbins. Maybe something like this would solve?
        if kwargs.get("nbins"):
            self._energy_bins = MapAxis.from_bounds(energy_bounds[0].to(u.MeV).value,
                energy_bounds[1].to(u.MeV).value,
                nbin=kwargs.pop("nbins"),
                name="energy",
                interp="log", unit="MeV")

            loge_bins=np.log10(self._energy_bins.edges.value)
        else:

            loge_bins = self.gta.log_energies

I agree, think that seems like a reasonable solution


Put node_modules in linked_dirs?

As the title suggests, what do you think about it?
The main advantage would be to speed up deploys, and as I see bundler plugin does a similar thing (although Bundler supports saving to a different path natively, npm will always install to ./node_modules).
I don't know if this is possible from the npm plugin itself (I have little Ruby and capistrano internals knowledge), but we can at least give a hint to users in the read me.
At the moment I simply added
set :linked_dirs, %w{node_modules}

in deploy.rb and it works perfectly.
Thanks.

@swalkinshaw npm's cache doesn't include anything compiled. For example, node-sass compiles libsass on each of our deploys (even though the src is cached).

@c0 never knew that, thanks. But even so there's an extension to manage this: https://github.com/capistrano/copy-files

@c0 good pint, so what you can suggest for speed up npm install during deployment? How can I skip compilation with capistrano/copy-files for node-sass for example?

+1 I would also like to know..

I think it's a good idea to reopen and discuss on this issue and document all this stuff in the readme.

@milushov @lichtamberg to skip compilation in node-sass you just need to use copy-files to copy the node_modules directory from the previous release:
set :copy_files, ['node_modules']

You may also want to prune the directory before npm install gets called:
before 'npm:install', 'npm:prune'


Chinese Character URLs not working

I found out, that URLs with chinese characters don't work. If I split the path and urlencode each part of the path it works.
I think it might also be the case for japanese and other character sets

@MichaelNussbaumerGOWEST thank you for lettings us know, it was fixed for 0.9.6 and 1.0 versions


cmake: build the traffic_dump plugin

This adds the building of the Traffic Dump plugin to our cmake configuration. This is the first experiemental plugin that is being added to our cmake configuration.

[approve ci autest]


File preview doesn't handle BOM (byte order mark) header  for UTF files

If file has BOM, it will be rendered in a preview. Example:

BOM should render without problems, are you using the latest build?

@lkho I'm using Bonobo Git Server <IP_ADDRESS> with Git-1.9.5-preview20141217` (portable version). I see that version 4.0.0 was released recently, I'll try it and post a results here.

Sorry for close\reopen, I've hit a wrong button :/

Confirmed, BOM works fine with version 4.0.0.


Create a 'convert from template' command

Wanted to put this idea up. Going from a legacy xml template to a versioned json is a very tedious process (I tried this with a couple examples from the Apache wiki).
It would be a better place to put this functionality in the toolkit. If we need to upload template, instantiate it, start version control, export, then at least it will be a good candidate for another macro command.

I'm not planning to do anything with templates for the initial version, but it is a good idea and something we can add. Currently there are no commands related to templates so to even get to the macro command you need to implement the Jersey client methods for upload and instantiate template, and then the corresponding commands.
Technically I think the back-end code already exists to take a TemplateDTO to a ProcessGroup, and then a ProcessGroup to a VersionedProcessGroup, but its all part of NiFi framework and not really resuable by the CLI. So I think your approach is probably the only option.


Retry subscriber setup issue - not being invoked.

I'm not sure what I'm doing wrong here - so I'd appreciate a pointer or two. So I have a retry subscriber setup to retry on specific response codes and on certain curl connection issues.
        // Retry 500 and 503 responses that were sent as GET and HEAD requests.
        $filter = \GuzzleHttp\Subscriber\Retry\RetrySubscriber::createChainFilter([
            // Performs the last check, returning ``true`` or ``false`` based on
            // if the response received a 500 or 503 status code.
            \GuzzleHttp\Subscriber\Retry\RetrySubscriber::createStatusFilter([500, 503]),
            //Will do a retry on connnection errors
            \GuzzleHttp\Subscriber\Retry\RetrySubscriber::createCurlFilter(
                [
                    CURLE_OPERATION_TIMEOUTED,
                    CURLE_COULDNT_RESOLVE_HOST,
                    CURLE_COULDNT_CONNECT,
                    CURLE_GOT_NOTHING
                ])
        ]);

        //Note retry interval is configurable, but I choose to defer to the built in exponential backoff strategy already there.
        $retry = new GuzzleHttp\Subscriber\Retry\RetrySubscriber([
            'filter' => $filter,
            'max' => static::MAX_RETRY_ATTEMPTS
        ]);

        $client->getEmitter()->attach($retry);

Next - I setup my Guzzle batch request and pass it certain functions.
        $responses = GuzzleHttp\Pool::batch(
            $client, array_values($requests), [
                'complete' => function (\GuzzleHttp\Event\CompleteEvent $event) {...}
                                'error' => function (\GuzzleHttp\Event\ErrorEvent $event) {...}
                        ]
        );

And I have a test case that is supposed to trigger a connection timeout - which it does because I see this status: "cURL error 28: Timeout was reached" - but the retries never get invoked. I think this is a setup issue on my part - but I have been struggling with this for the best part of the day. Any help would be appreciated.

Look this please.

Thanks for getting in touch, but I'm going to close this since this repo has been EOL for a while now.


Remove version: ExodusMovement.Exodus version 24.23.3

[Automated] It returns code over 400 in all urls
Microsoft Reviewers: Open in CodeFlow

URL: https://downloads.exodus.com/releases/exodus-windows-x64-24.23.3.exe
OK
(Automated message - build 912)

Close with reason: Package still available;


fix: check both secrets when reconciling InternodeCredentialSecret

What this PR does:

Check both CASecret and BootStrappingSecret when reconciling InternodeCredentialSecret
Create both secrets if both of them are not present. Create CABootStrappingSecret based on CASecret if CASecret is present but CABootStrappingSecret is not present.

Which issue(s) this PR fixes:
Fixes #225
Checklist

[ ] Changes manually tested
[ ] Automated Tests added/updated
[ ] Documentation added/updated
[ ] CHANGELOG.md updated (not required for documentation PRs)
[x] CLA Signed:  DataStax CLA

Thank you for the contribution.


simplified diffray example

Category

[ ] New feature
[ ] Bugfix
[ ] Breaking change
[x] Refactoring
[ ] Documentation
[ ] Other (please explain)

Description

Uses the barycentric coordinates obtained from wp.mesh_query_ray instead of manual calculation.
Changelog

Removed manual calculation of barycentric coordinates.

Before your PR is "Ready for review"

[x] Do you agree to the terms under which contributions are accepted as described in Section 9 the Warp License?
[x] Have you read the Contributor Guidelines?
[x] Have you written any new necessary tests?
[x] Have you added or updated any necessary documentation?
[x] Have you added any files modified by compiling Warp and building the documentation to this PR (.e.g. stubs.py, functions.rst)?
[x] Does your code pass ruff check and ruff format --check?

fwiw, I personally like the verbose method since it helps me understand it.


Feat/secure connect review

Summary

added SHA256 hash instead of MD5
Ability to provide user name and password for frpc client

Testing

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.3 out of 4 committers have signed the CLA.:white_check_mark: HenAmar:white_check_mark: raghavharness:white_check_mark: Sapa96:x: fatedierYou have signed the CLA already but the status is still pending? Let us recheck it.


Fix for multiple .po files

With multiple .po files (de_DE.po, fr_FR.po) it will show the following error:
Error: Too many positional arguments: ./resources/lang/fr_FR.po
error Command failed with exit code 1.

Seems like update-po only accepts one argument and doesn't handle the *.po properly.

A bit annoying that they don't accept a glob for that subcommand — thank you for the PR 🙏


Modify OracleDB connection string format.

What is the purpose of the pull request
This pull request modify the JDBC format of the Oracle database connection.
Number:#2791.
pull/2792 has been abandoned for other reasons.
The Oracle JDBC link I verified currently supports the following three methods:
jdbc:oracle:thin:@host:port:SID
jdbc:oracle:thin:@//host:port/service_name
jdbc:oracle:thin:@host:port/service_name
The above three methods are verified in the unit test.
Brief change log
DataSourceService.java:
Add Oracle link type parameter in buildParameter().
BaseDataSource.java:
Modify appendDatabase () method as a protected modifier to facilitate OracleDataSource to rewrite this method.
OracleDataSource.java:
Override appendDatabase () method.
Constants.java:
Add ORACLE_DB_CONNECT_TYPE type.
BaseDataSourceTest.java:
Unit test the newly modified code.
DataSourceServiceTest.java:
Add buildParameter () unit test.
Verify this pull request
This change added tests and can be verified as follows:
Add the Oracle data source in the data source center, including using the service name or SID.
Perform the task of executing the Oracle data source on the SQL type node and pass the verification.
##Addition
If anything is wrong, you are welcome to participate in the discussion. Thanks.

Codecov Report

Merging #2818 into dev will decrease coverage by 0.11%.
The diff coverage is 20.00%.

@@             Coverage Diff              @@
##                dev    #2818      +/-   ##
============================================
- Coverage     37.32%   37.20%   -0.12%
+ Complexity     2563     2553      -10
============================================
  Files           434      434
  Lines         19983    19985       +2
  Branches       2424     2423       -1
============================================
- Hits           7459     7436      -23
- Misses        11860    11866       +6
- Partials        664      683      +19

Impacted Files
Coverage Δ
Complexity Δ

.../org/apache/dolphinscheduler/common/Constants.java
83.33% <ø> (ø)
1.00 <0.00> (ø)

...olphinscheduler/dao/datasource/BaseDataSource.java
0.00% <ø> (ø)
0.00 <0.00> (ø)

...phinscheduler/dao/datasource/OracleDataSource.java
0.00% <0.00%> (ø)
0.00 <0.00> (ø)

...olphinscheduler/api/service/DataSourceService.java
7.41% <100.00%> (+5.15%)
5.00 <0.00> (+2.00)

...duler/server/entity/DataxTaskExecutionContext.java
35.00% <0.00%> (-60.00%)
7.00% <0.00%> (-6.00%)

...he/dolphinscheduler/common/thread/ThreadUtils.java
68.25% <0.00%> (-9.53%)
13.00% <0.00%> (-1.00%)

...he/dolphinscheduler/api/service/LoggerService.java
82.60% <0.00%> (-8.70%)
9.00% <0.00%> (-1.00%)

...ver/master/consumer/TaskPriorityQueueConsumer.java
54.41% <0.00%> (-5.15%)
16.00% <0.00%> (ø%)

...ler/server/master/runner/MasterTaskExecThread.java
8.98% <0.00%> (-4.50%)
2.00% <0.00%> (-1.00%)

...pache/dolphinscheduler/alert/utils/ExcelUtils.java
78.94% <0.00%> (-3.51%)
8.00% <0.00%> (-1.00%)

... and 4 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e89f543...8a982b9. Read the comment docs.

I added a line in the maven-surefire-plugin section of the pom file to ensure that my OracleDataSourceTest.java file can be executed, thus ensuring my code coverage.


[FEATURE] Update the MQTT Library for Android 9 and above compatibility

The Android MQTT Paho library project is out of date and appears to be abandoned.  There are many pull requests to fix issues that have been closed without merging the fixes.   One bug is causing issues with applications running on devices with Android Oreo or greater.   There is a pull request (https://github.com/eclipse/paho.mqtt.android/pull/359/files) that would fix this issue, but was closed.
The task is to fork the project and merge in appropriate fixes so that the MQTT server does not crash on Android devices running Android 9 or greater.   This task takes precedent over any other tasks as it is the main way to send commands to the Android application.

I found a fork of the MQTT Android Client that may resolve the issue, but it has moved the minimum SDK version of the application to Android 21. This should work for Android 9 and newer devices.
https://github.com/hannesa2/paho.mqtt.android
I will create a pre-release version of the application for testing the new library before general release.

Version for testing https://github.com/thanksmister/wallpanel-android/releases/tag/v<IP_ADDRESS>

Hi, I am using a Samsung i9501 with 18.1 lines, today I installed this beta and after 6 hours it works fine, mqtt does not disconnect. I will report the next few days.
Thank you for your work.

Thanks for the feedback @jumavi.   Keep an eye on it and let me know.

I have a crash on a Lenovo Android 10 device
‘’’
Fatal Exception: java.lang.RuntimeException
Unable to start service info.mqtt.android.service.MqttService@c6ab670 with Intent { cmp=com.thanksmister.iot.wallpanel/info.mqtt.android.service.MqttService }: java.lang.RuntimeException: android.os.DeadSystemException
‘’’

until now it's working fine, only a small cut for a couple of hours

I forgot, in a few days I will do a test with a xiaomi mi pad 3 tablet. I will inform.

Ok thanks

Bad news, last night mqtt stopped working. The application works fine, but when I go in and out of the settings I get a message saying that mqtt has a wrong setting or something like that. The only way to solve is reboot androird device.

Hmm maybe reinstall?

I have installed v<IP_ADDRESS> on a low-end tablet (Teclast p80) with Android 10 Go, and it's running without any issue since days with MQTT active.
At the beginning the app was crashing, but with some trial and error I have found the corect settings:

Battery optimization for the app must be disabled
Android display sleep must be disbaled (I instead use Wallpanel's clock screensaver)
Wallpanel runs as home screen app
Wi-Fi is set to aways active (although, since the system never goes to sleep, it should be irrelevant)

Of course this setup eats quite a lot of battery, but you can use a smart plug, or a sonoff/shelly to manage the charge cycle and to preserve the battery


add support for surrealdb

add support for surrealdb

@ralyodio: As currently architectured, the backend DB drivers that sq supports must implement the Go stdlib database/sql interface. From a quick read of the surrealdb Go driver docs, it seems that surrealdb uses a custom driver.
Ultimately, sq could be refactored to support non-database/sql, but it may be an easier lift to wrap the custom surrealdb drivers with a database/sql driver.
To be clear: I would be very, very happy to add support for surrealdb.

maybe this solution will solve your problem click


API: Evaluate required OAuth scopes

I bet we don't need all the scopes we are currently requesting here: https://github.com/csgotunes/csgotunes/blob/main/API/Auth/Functions/InitAuthFunction.cs#L83
Let's do some testing and reduce them to the bare minimum.

As it turns out, this is the bare minimum for now unless we figure out a clever way to get the user's ID without them.


small updates

Update dependencies, submodules and all the stuff :)
That's the PR I told you @lpascal-ledger, thanks for all the work!

REMEMBER TO RENAME DEFAULT BRANCH TO MAIN BEFORE MERGING


Dependency conflicts with React

Environment
System:

OS: Windows 10
CPU: x64 Intel(R) Core(TM) i7-5600U CPU @ 2.60GHz
Free Memory: 2.06 GB
Total Memory: 7.89 GB
Shell: ¯_(ツ)_/¯

Binaries:

Node: 8.9.3
Yarn: 1.5.1
npm: 5.8.0
Watchman: Not Found

npmPackages:
styled-components:

wanted: ^3.2.3
installed: 3.2.3

Reproduction
Steps to reproduce

Take an empty project with the following in package.json (please note flat: true):

{
  "license": "UNLICENSED",
  "flat": true,
  "dependencies": {
    "react": "^16.2.0",
    "react-dom": "^16.2.0"
  }
}

Install React

yarn

Install SC

$ yarn add styled-components

Expected Behavior
SC to install without issues.
Actual Behavior
info Unable to find a suitable version for "core-js", please choose one by typing one of the numbers below:
  1<EMAIL_ADDRESS>which resolved to "1.2.7"
  2<EMAIL_ADDRESS><EMAIL_ADDRESS>which resolved to "2.5.4"
Answer?: 1
info Unable to find a suitable version for "node-fetch", please choose one by typing one of the numbers below:
  1<EMAIL_ADDRESS>which resolved to "1.7.3"
  2<EMAIL_ADDRESS>which resolved to "1.6.3"
Answer?: 1
info Unable to find a suitable version for "supports-color", please choose one by typing one of the numbers below:
  1<EMAIL_ADDRESS>which resolved to "3.2.3"
  2<EMAIL_ADDRESS>which resolved to "2.0.0"
Answer?: 1
info Unable to find a suitable version for "strip-ansi", please choose one by typing one of the numbers below:
  1<EMAIL_ADDRESS><EMAIL_ADDRESS>which resolved to "3.0.1"
  2<EMAIL_ADDRESS>which resolved to "4.0.0"
Answer?: 1
info Unable to find a suitable version for "ansi-regex", please choose one by typing one of the numbers below:
  1<EMAIL_ADDRESS>which resolved to "3.0.0"
  2<EMAIL_ADDRESS><EMAIL_ADDRESS>which resolved to "2.1.1"
Answer?: 1
info Unable to find a suitable version for "regenerator-runtime", please choose one by typing one of the numbers below:
  1<EMAIL_ADDRESS>which resolved to "0.11.1"
  2<EMAIL_ADDRESS>which resolved to "0.10.5"
Answer?: 1

I am against including more than one version of dependencies in the client-side code, that's why I install client side dependencies in flat mode. Not even sure what will happen when I have 2 sets of core-js. Which one wins? This threatens the stability of the code base. This prevents the use of this library in my current setup.
Is there a suggested correct answer to the conflicts above?
Is there an intent to fix this somehow?

I'm not sure why this is happening at all, honestly, sorry.

I’m not quite sure where these conflicts stem from but a lot of things can go awry with flat installs.
I don’t recognise them as things that will be bundled actually. We have a flat bundle that pulls in just a couple of packages, so regular installs will be fine. But I’ll take a look

I think it's the expected behavior:
(https://yarnpkg.com/en/docs/cli/install#toc-yarn-install-flat)

Install all the dependencies, but only allow one version for each package. On the first run this will prompt you to choose a single version for each package that is depended on at multiple version ranges. These will be added to your package.json under a resolutions field.

Does it matter if styled-components and react or any other package have the same dependencies?

Just had a look, it seems that the opencollective package is responsible for all of these conflicts. Since we were planning to replace it, I can just open a PR to remove it


Add community creations to website

Ivy you suggested it, now implement... or do I need to make another PR to the blueprint web repo

I gave up nevermind

ivy when

what did i mean with this again

like thingy to show off stuff people make relating to blueprint (for example the 3d print of blueprint logo)

Refactored statement below*
Add some sort of page within the Blueprint.zip website that contains community works, or in other words, cool things people did with blueprint besides creating the usual extensions. If Ivy is interested in this idea I might PR it.

Refactored statement below*
Add some sort of page within the Blueprint.zip website that contains community works, or in other words, cool things people did with blueprint besides creating the usual extensions. If Ivy is interested in this idea I might PR it.

what in the chatgpt

uhhh


Fix build on NixOS

Hyprlang seems to have updated to use gcc14 in some way, and this causes compile errors in other tools. This moves hyprsplit to gcc14 to fix the compile errors.
See https://github.com/hyprwm/hyprlang/issues/60
I'm probably not doing this in the most idiomatic/nixlike way, feel free to fix

I can confirm this works!


Utilize swarm.BatchID

This issue tracks effort to update all occurrences of batch identifier to  swarm.BatchID type.
PR #3216 has introduce new type swarm.BatchID for unique batch identifier instead of []byte. That PR refactored occurrences only in the scope of the issue, but potentially there are more occurrences where this type could be used.

Firstly this PR is not merged yet. I dont understand why we are opening issues on this?
I am not sure if we even need this BatchID type.

Issue could be closed if it becomes irrelevant.

Closing this one as per #3216, #3221


Neobotix MP400 isn't rendered correctly in Gazebo

Bug report

operating system: Ubuntu 20.04
ROS2 Galactic (binaries)

Steps to reproduce:

clone repository from there to your ros2_ws, install aws-robomaker-small-warehouse-world ROS2 Galactic package (binary) and the rest from deps.repos (neobotix robot, simulation etc.)
build package colcon build --symlink-install
source install/setup.bash
ros2 launch nav2_rosdevday_2021 system_launch.py

Part of my .bashrc file:
source ~/nav2_ws/install/setup.bash
export TURTLEBOT3_MODEL=waffle
export GAZEBO_MODEL_PATH=$GAZEBO_MODEL_PATH:/home/ljaniec/ros2_ws/install/aws_robomaker_small_warehouse_world/share/aws_robomaker_small_warehouse_world/worlds:/home/ljaniec/ros2_ws/install/aws_robomaker_small_warehouse_world/share/aws_robomaker_small_warehouse_world/models:/home/ljaniec/ros2_ws/install/neo_simulation2/share/neo_simulation2/robots:/home/ljaniec/ros2_ws/install/neo_simulation2/share/neo_simulation2/models:/opt/ros/galactic/share/turtlebot3_gazebo/models:/home/ljaniec/.gazebo/models

Expected behavior
The simulation with one visible Neobotix MP 400 is rendered and Nav2 stack starts.
Actual behavior
The simulation doesn't have correctly rendered robot (screens below).

Additional information
What I tried:

reinstall Gazebo and Nav2 packages

I have found a similar bug there

this bug shows in Simple Commander Nav2 package too (TB3 is invisible, but not in "Collisions" view in Gazebo) - maybe it is something connected with these meshfile changes mentioned in the link above?

I mentioned it there and there - second one is quite similar (but the collision view suggests me that at least robot is rendered there, but invisible)

I checked URDF like there and it didn't show problems

Any suggestions how to fix it?

Well, the problem is indeed strange. deps.repos uses foxy branch. I would suggest you to change it to the galactic branch and retry it again. Also, please do check the documentation here for the setup of the simulation. Do let me know, if you still have trouble.

Hello,
I prepared a small set of commands to show, what I think the problem is.
TB3 case 1
Start Gazebo simulation with empty world
ros2 launch gazebo_ros gazebo.launch.py
Add TB3 SDF model to Gazebo (package turtlebot3_gazebo)
ros2 run gazebo_ros spawn_entity.py -file /opt/ros/galactic/share/turtlebot3_gazebo/models/turtlebot3_waffle/model.sdf -entity robot01
It spawns TB3 Waffle normally (visible model and LiDAR).
TB3 case 2-1
Start Gazebo simulation with empty world
ros2 launch gazebo_ros gazebo.launch.py
Add TB3 URDF model to Gazebo (package nav2_bringup)
ros2 run gazebo_ros spawn_entity.py -file /opt/ros/galactic/share/nav2_bringup/urdf/turtlebot3_waffle.urdf -entity robot01
Surprisingly, it spawns invisible TB3 Waffle. It is visible only in the 'Collision' view in Gazebo. No LiDAR too.
TB3 case 2-2
Start Gazebo simulation with empty world
ros2 launch gazebo_ros gazebo.launch.py
Generate TB3 SDF model from URDF
gz sdf -p turtlebot3_waffle.urdf > turtlebot3_waffle.sdf
Add TB3 SDF model to Gazebo (from package nav2_bringup)
ros2 run gazebo_ros spawn_entity.py -file ~/Desktop/turtlebot3_waffle.sdf -entity robot01
TB3 is invisible (but it's there, after launching 'Collision' view in Gazebo).
MP400 case
Start Gazebo simulation with empty world
ros2 launch gazebo_ros gazebo.launch.py
Add MP400 URDF model to Gazebo
ros2 run gazebo_ros spawn_entity.py -file ~/mp_400/mp_400.urdf -entity robot01
Robot is invisible, there are only blobs in the air and a LiDAR.
Generate SDF model from URDF
gz sdf -p mp_400.urdf > mp_400.sdf
Add MP400 SDF model to Gazebo
ros2 run gazebo_ros spawn_entity.py -file ~/mp_400/mp_400.sdf -entity robot01
Robot is again invisible, there are only blobs in the air and a LiDAR.
What is the problem there and how do I fix it?
I wanted to use MP400 as a model of AMR in my simulations, but Gazebo makes working with URDF models a bit hard... How could I fix it?
Relevant issues and links I have found:

https://github.com/ros-planning/navigation2/issues/2157 - but it's is solved - there is /opt/ros/galactic/share/turtlebot3_gazebo already
https://answers.gazebosim.org//question/26073/cannot-spawn-urdf-into-gazebo-using-ros2/ and https://answers.gazebosim.org//question/2282/convert-urdf-to-sdf-or-load-urdf/ - these two
https://github.com/ros-simulation/gazebo_ros_pkgs/pull/1284 - it looks like this could be the problem addressed it this (unmerged yet) PR ("[gazebo_ros_factory]: Resolve package:// urls")

I have all used files there:

MP400 from Neobotix, branch galactic
TB3 from Nav2 repository, branch galactic

I wanted to use MP400 as a model of AMR in my simulations, but Gazebo makes working with URDF models a bit hard... How could I fix it?

For your application, you are just utilizing our URDF models and unfortunately, we do not have further resource to help you. This issue is more related with Gazebo and usage of SDF. My suggestion would be to post this issue in answers.ros.org ! I'm pretty sure someone can help you over there.
Closing the issue. Feel free to reopen the issue, if you have any trouble with the pre-existing pipeline setup we have for the simulation.

Relevant issue: https://github.com/ros-simulation/gazebo_ros_pkgs/issues/1272#issuecomment-857513366


Frozen columns section has no scrollbar

Short description
If my grid has too many frozen columns, there may no longer be a horizontal scrollbar visible to scroll to remaining non-frozen columns.
What is current behavior
As more frozen columns are added to the grid (we allow the user to dynamically change this), they can get to a point where horizontal scroll disappears.
What is desired behavior
Either
a) provide a divider between frozen and non-frozen sections and in each section have scroll bar.
b) similar to toolbar header, have a "right" or "left" arrow that can jump to currently non-visible sections of the grid.
Link to jsfidle/codepan with sample code
...
Steps to reproduce or sample

Create a grid that is 500 px wide with 20 columns of equal size.
Freeze 15 of those columns and you should no longer see a horizontal scroll.

Simple reproducer: http://w2ui.com/web/demos/#/grid/27
Based on http://w2ui.com/web/demos/#/grid/27


[flink] [fix] Flink add computed column should be nullable

Purpose
sql "ALTER TABLE T add (__proc_time AS PROCTIME())" should be work well with paimon. And the clumn __proc_time which is ComputedColumn should be nullable.

You should add test to use computed column and watermark for reading.

You should add test to use computed column and watermark for reading, a real ITCase.

done

@leaves12138 Maybe you can just take a review to #2297, is that what you want?

Already resolved in https://github.com/apache/incubator-paimon/pull/2297#pullrequestreview-1728717978


NetworkedVar does not sync, permissions are not working as expected

Describe the bug
A Client joins the Host.
The Networked PlayerObject contains a NetworkedVar for the playerName which gets set by the owner on NetworkStart() or later.
The Client Recieves the Hostname correctly and also sets his own name accordingly.
The Host only sees his own name correctly, but not the Clients one.
Even when looping the process of setting and checking, the Host never recieves the Client playerName.Value, it stays empty.
Any permission setting in the constructor/Network start or just before setting the variable has no effect and yields same result. Even when The Client has actually no permission in setting his own name ( by setting it to server only) the Value on the Client side will be set by the Client.
The Client code and Host code do not differ in setting/reading the NetworkedVar.
Environment (please complete the following information):

OS: Windows 7
Unity Version: [e.g. 2018.3.0f2]
MLAPI Version: [e.g. v7.0.2]

:tada: This issue has been resolved in version 7.2.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Add validation API

This is the first part of #9. It adds support for the basic validation API (as outlined in the initial API draft), allowing for validation callbacks to be registered using @validate, both on the form and the field level. Although the @validateOn and @revalidateOn arguments have been added here already, they are not supported yet. So the form only validates on submit for now, as a regular server-side rendered form would do. Support for those variations will come in another PR, as this one seems already fairly large enough.
This also incorporates some of the insights we gained from yesterday's a11y workshop with Noah:

apply aria-invalid to controls
associate controls to error messages using aria-errormessage (and aria-live)

To Do:

[ ] wait for #16 to get merged
[ ] wire-up radio controls w/ a11y attributes as well

Also, would like to see tests using the native APIs.

Yeah, this is not supported yet, but will come soon(TM). I track that in #10


Search for pattern and move cursor

I'm using page for my scroll back buffer in kitty and I would like to set the cursor at the last non-empty line. I tried searching for a particular pattern in my prompt to move the cursor there, but I haven't been able to do it successfully. I believe the problem is that at the time I'm doing the search there's still no text on the screen.
This is what I'm trying:
au User PageDisconnect call feedkeys("G?╼\<CR>")

I also tried redrawing before doing the search but it's still failing.
au User PageDisconnect redraw | call feedkeys("G?╼\<CR>")

Do you have any ideas on how to get around this issue?
Ultimately, I think the problem is the terminal emulator in vim putting empty lines at the end of the buffer.

Do you have any ideas on how to get around this issue?

map f1 launch --stdin-source=@screen_scrollback --stdin-add-formatting page -C -e 'au User PageDisconnect sleep 100m | call feedkeys("G$?\\S\<CR>\<C-l>")'
This works for me

Ultimately, I think the problem is the terminal emulator in vim putting empty lines at the end of the buffer.

These lines are sent from kitty e.g. if I have half of the screen empty then that emptiness will be displayed in scrollback preview too and it seems that less displays it as well

map f1 launch --stdin-source=@screen_scrollback --stdin-add-formatting page -C -e 'au User PageDisconnect sleep 100m | call feedkeys("G$?\S<CR><C-l>")'

Well, that worked pretty well. Thanks!

These lines are sent from kitty e.g. if I have half of the screen empty then that emptiness will be displayed in scrollback preview too and it seems that less displays it as well

I think kitty sends a couple of lines at the end of the buffer, but the biggest problem for me is when the buffer doesn't fill the entire screen, I think that's related to how the terminal buffer works. For example:
$ echo -e "1\n2\n3" | page

->
1
2
3

▮  <- the cursor

Stripping these trailing lines should fix the issue completely
map f1 launch --stdin-source=@screen_scrollback --stdin-add-formatting bash -c "sd '\s*\z' '' | page -C -e 'au User PageDisconnect sleep 100m | call feedkeys(\"G$?\\\S\<CR>\<C-l>\")'"
Also, it seems that kitty doesn't support | in map or does it in unobvious and poorly documented way, so I've must to reuse bash for it


Use "@" for find symbol instead of "#"

When I type Cmd+Shift+O, the find symbol interaction launches. This shows the "@" symbol at the beginning and then shows a message saying "Unfortunately we have no symbol information for the file". But, when typing "#", the message "type to search for symbols" is shown.

Fixed by https://github.com/georgewfraser/vscode-javac/commit/9e4545932ca2e4173da7e8c8061856b1b4d26f26


Implement label_replace().

Implements part of https://github.com/prometheus/prometheus/issues/959.

@brian-brazil @fabxc
This currently does sub-string matches, like we do in label selectors and relabeling rules. We might want to switch all of them over to full string matches at some point. See also https://github.com/prometheus/prometheus/issues/996.

Adding the last test made me think: what if relabeling removes a distinguishing label between time series, so that the output vector will contain the same series multiple times? Should we keep track of that by keeping a hash table of all output label sets and erroring if a labelset appears more than once?

Yes, that's an error.

Agreed, we should treat that as an error like we do for binops.

:+1:

Ok, I added duplicate detection, and also a check that the destination label name is actually valid. I omitted a check for validity of the source label name, as an invalid source shouldn't matter, but don't feel strongly whether it should be added or not.


Ctrl-C Deadlock

It appears upon quiting a bridge using ctrl-c, it appears to wait forever to quit.
Pinning to version 40cab825bcb1a8ae0cb198e25de2752d0804d85b appears to work as expected (CTRL-C ends the bridge process), however latest master is exhibiting this issue.

(with that being said) New DNS library is looking great 👌

I have the same issue CTRL-\ works for me to exit the process.

Worth noting that supervisorctl seems to have no trouble gracefully stopping a running proc too

@nickw444 I'm not able to reproduce this issue using _example/example.go. It does work as expected for me.
What version of go are you using?

CRTL-C didn't work for me and I'm using 1.9.1

Running from TextMate seems to kill the process after some time no matter what. Running from Terminal gave me the deadlock as well.
I've updated _example/example.go and readme on how to correctly stop an ip transport.
Calling t.Stop() returns a channel to wait until the HTTP server and mDNS responder stopped as well. If you don't read from that channel t.Start() never returns.

The fix works for me, THX

Thanks for the fix 👍


Module 'pydot' has no attribute 'InvocationException'

The error occured using plot_model with the latest newly installed versions of pydot and graphviz. I tried to follow the instructions in issue 3210 to no avail. Specifically I tried
pip install pydot-ng
pip install pydot==1.0.2 --upgrade (but not sudo pip install pydot==1.0.2 --upgrade because I do not have administrative priveledges on this system)

Hi @novalex9800 ,
The error indicates the installed version of pydot might be older and don't have attribute InvocationException.
You might need pydot_ng ~=2.0.0 with keras3. I tested installing pydot_ng=1.0.0 & 2.0.0 , pydot=1.4.2 and called pydot.InvocationException() which is success.Please refer attached gist.
You might need to ensure latest pydot_ng and make sure it was imported. Please submit the version of pydot_ng imported. May be you can create a separate environment of your own.

I got the same error when trying to use the 'plot_model' function of Keras in TensorFlow. This function uses both pydot and graphviz,  and I solved the problem by properly installing graphviz. I installed graphviz (on Windows OS) using the executable file that can be found here - https://forum.graphviz.org/t/new-simplified-installation-procedure-on-windows/224
I hope this helps!!

The issue still persists!

Same here, the issue still persists for me!

possible solution: I installed pydot==2.0.0 and graphviz and the issue still persisted for me. However, after just simply restarting the pc, the issue was gone. Not sure if this simple solution helps, but you can try it :) good luck!

Please refer your tensorflow version when you ask about these packages issues, because most of the time it is just version compatibility.
For me i just had to close the pycharm project and reopen it to get it work.

tensorflow 2.16.1. The problem still exists

I installed pydot version 1.4.2 and now there is another error
You must install graphviz (see instructions at https://graphviz.gitlab.io/download/) for `plot_model` to work.

I installed version 2.46 of graphviz and rebooted the computer. Everything worked

I had the same issue, I have python3.9, and what worked for me was
pip install pydot==2.0.0
sudo apt install graphviz

for Mac:
brew install graphviz

I'm using tensorflow 2.16.1 with a Conda environment on macOS. The following worked for me:
pip install pydot
conda install graphviz

I'm using 'Windows-10-10.0.22631-SP0' with tensorflow 2.16.1, keras 3.4.1 in Conda environment. I had the same issue, and was fixed with the following:
pip install pydot # 2.0.0
conda install graphviz # 2.50.0

I'm using tf 2.16.1 and keras 3.4.1  with ubuntu2204.I had the same issue, and fixed.
pip install pydot # 2.0.0 sudo apt install graphviz

For Mac M2
Keras: 3.4.1
pydot: 1.4.2
brew install graphviz

I had the same issue, I have a conda environment with python3.11.9, and what worked for me was
pip install pydot==2.0.0
sudo apt install graphviz

On Ubuntu 22.04.4 and sudo apt install grphviz worked for me

tensorflow 2.16.1. The problem still exists

Hi,
Did you solve the issue??
if yes, could you tell me how??

for me with conda and tensorflow 2.17 on gpu RTX4060
this code from gayanlanke worked !!
pip install pydot # 2.0.0
conda install graphviz # 2.50.0

I have a the same problem in a docker container (downloaded image like so: FROM python:latest) on an M1 mac.


Test coverage

Some stuff to measure test coverage.

Codecov Report

Merging #560 (949d005) into develop (f133559) will decrease coverage by 1.27%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           develop     #560      +/-   ##
===========================================
- Coverage    51.55%   50.27%   -1.28%
===========================================
  Files          203      203
  Lines        14441    12347    -2094
===========================================
- Hits          7445     6208    -1237
+ Misses        6332     5507     -825
+ Partials       664      632      -32

Impacted Files
Coverage Δ

gossip/poset_hook.go
32.14% <0.00%> (-15.23%)
:arrow_down:

app/store_total_supply.go
33.33% <0.00%> (-12.13%)
:arrow_down:

poset/store_migration.go
60.00% <0.00%> (-11.43%)
:arrow_down:

poset/store_epoch_state.go
55.55% <0.00%> (-8.45%)
:arrow_down:

vector/store_branches_info.go
47.61% <0.00%> (-8.39%)
:arrow_down:

integration/db.go
66.66% <0.00%> (-8.34%)
:arrow_down:

poset/input.go
16.66% <0.00%> (-8.34%)
:arrow_down:

inter/pos/sort.go
80.00% <0.00%> (-7.50%)
:arrow_down:

gossip/store_heads.go
33.33% <0.00%> (-6.67%)
:arrow_down:

crypto/fake.go
60.00% <0.00%> (-6.67%)
:arrow_down:

... and 192 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f133559...949d005. Read the comment docs.


Feature: Ingest DBT Contract Information as a DataHub Data Contract

We (Checkout.com) have started using DataHub's contract feature more intensely over the past few months, and have implemented a custom mapping between DBT contracts and DataHub's data contract feature. We propose implementing this as a part of the native DBT Core ingestion with the following functionality:

DBT Contracts prevent breaking changes (column removals or column type changes), so they are equivalent to a schema contract in DataHub.
DBT Tests assigned with an arbitrary tag (default contract) have their assertion added to the data contract.
Optionally DBT constraints that are enforced in the target data platform (e.g not_null in Snowflake) could be added into the contract as well as always passing.

Example DBT Yaml:
- name: dbt_contract_test_view
  description: This view is used to test the data contract checks for the dbt models.
  config:
    contract:
      enforced: true # this adds a schema contract to the DataHub data contract.
  columns:
      - name: urn
        data_type: text
        description: The urn of the object.
        data_tests:
          - unique
             tags: ['contract'] # this is included in the data contract
          - not_null # this is not

We're happy to contribute this if there's appetite, happy to hide it behind a feature flag in the DBT config as well.

This is really cool.
I am sure others would be quite interested in this! As long as we can place behind reasonably well named feature flags with the appropriate early stage / incubating labeling, I think things should be fine!
To clarify, for dbt contracts you are minting net new schema assertions in DataHub is that right?
And for other DBT tests you are simply linking them to the contract for the assets.


[FEATURE/render hook] Migrate image shortcode functions to the default image render hook

Describe the feature you want 描述你的功能需求
No response
Useful reference 有价值的参考
https://gohugo.io/templates/render-hooks/

https://discourse.gohugo.io/t/pass-attributes-to-image-render-hook/36899/2

Probably not a good idea.


gnome-podcasts: add dependency gst-plugins-good

Motivation for this change
I get this error currently when playing a podcast with the app:
podcasts_gtk::widgets::player: gst warning: Warning from element /GstPlayBin:playbin/GstURIDecodeBin:uridecodebin0: There is no codec present that can handle the stream's type.
No decoder available for type 'application/x-id3'.
../gst/playback/gsturidecodebin.c(957): unknown_type_cb (): /GstPlayBin:playbin/GstURIDecodeBin:uridecodebin0

Adding gst-plugins-good to buildInputs fixes this problem.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Weird that good wasn't there while bad was. Thanks.


[BUG] [examples] extra should be merged

Description
Currently [examples] is a separate option not installed by default.  If the user tries to run the notebooks, they may get errors.  Given most users will try to run the example notebooks in their first try, it is important that they have smooth experiences.  Propose to merge [examples] option/extra to the main package.
Guiding principle should be that the user should be able to run the simplest examples without installing extras.
In which platform does it happen?

How do we replicate the issue?

Expected behavior (i.e. solution)

Other Comments

@loomlike

I'll take this one


Problem in showing message body

First of all thank you very much for this good library, I have a problem reading SMS.
Both sms date and sms number are Ok but the message is not shown correctly, rather than the text it shows some random number and squares!
Text is simple English , is there any special decoding ?

Hmm, that's odd. There's no special decoding needed, it should just return English. Maybe your phone company uses some different encoding?
I've never had this problem, so I don't know. If you figure out a solution, though, please open a PR so other people can benefit too!

Problem solved however I couldn't find any reason ! just compiled again in platformio rather than arduino IDE and it just works!
Now I'm struggling with deleting message which doesn't work!


Scorm/IMS Packages containing special characters not detected as Package attachment type

Describe the bug
When an zip file is uploaded using the attachment control, oEQ looks inside the zip file for an imsmanifest.xml file. That's how it determines if the zip is a SCORM or IMS package.
However, any Scorm or IMS packages which contain filenames with special characters (eg. é) will not get detected as a content package. It will fail silently behind the scenes, and just treat the attachment as a regular zip.
https://github.com/openequella/openEQUELLA/blob/a4c1501fadddb7f2ccdff9848bb5c801c02d219c/Source/Plugins/Core/com.equella.core/src/com/tle/core/services/impl/FileSystemServiceImpl.java#L965 is using code inside the java.util.zip package, which is throwing an IllegalArgumentException("MALFORMED") when it encounters a filename with a special character. It's using UTF8 encoding
To Reproduce
Steps to reproduce the behavior:

In a contribution wizard, upload this scorm package using an attachment control (don't use drag and drop)
special character in this scorm package.zip
oEQ will just treat it as a regular zip attachment, instead of informing you you have uploaded a package file.

Expected behavior
Any valid scorm or ims packages uploaded into oEQ should be detected as a package file, and ask how you want the file to be treated.

Platform:

OpenEquella Version: 2018.2, 2019.2, 2020.1

All done back in July - was just missing labels and update. Closing.