Video file length is 3 times lesser than the original video based on the resolution.

Hi @shimat @joreg @marek-stoj @tekezo @pimms @yukoba
Thank you for the reply.
Is there any relationship between the Height and Width with FPS?
in my application
I have set the
FPS as 30 and
Resolution:
Width = 640
Height = 480;
the output saved video seems 90% Okay.
but when i set the resolution as below
Width = 1280;
Height = 720;
the video file length is 3 times lesser than the original video.(especially when checking with external camera. not laptop camera)
for example, if i record the video for 3 minutes, but the video file has only 1 minute length.
Note: the code snippet is  shared
// This resolution working fine.
        private static int Width = 640;
        private static int Height = 480;
// This resolution is not working
        private static int Width = 1280;
        private static int Height = 720;

            capture = new VideoCapture(CaptureDevice.Any,index:1);

            capture.Fps = 0;
            capture.FrameWidth = Width;
            capture.FrameHeight = Height;

            // Read movie frames and write them to VideoWriter
            // Size dsize = new Size(Width, Height);
            using (VideoWriter writer = new VideoWriter(longVideoName, FourCC.H264,capture.Fps, new Size(Width, Height)))
            {
                Console.WriteLine("Converting each movie frames...");
                Mat frame = new Mat();
                while (true)
                {
                    System.Diagnostics.Debug.WriteLine(System.DateTime.Now.ToString("O"));
                    // Read image
                    capture.Read(frame);
                    //  frame = capture.RetrieveMat();
                    if (frame.Empty())
                        break;

                    // Console.CursorLeft = 0;
                    Console.WriteLine("{0} / {1}", capture.PosFrames, capture.FrameCount);
                    Cv2.PutText(frame,
                                        System.DateTime.Now.ToString("O"),
                                        TimePoint,
                                        HersheyFonts.HersheySimplex,
                                        0.8,
                                        TimeScalar,
                                        1,
                                        LineTypes.Link8);
                    writer.Write(frame);

                }

Please help me on this.
Thanks,
Rajasekar

If i increase the resolution, even though i set the FPS as 30, only 10 frames are taken in capture.Read method. due to this the video is less seconds than the original.


Class Metrics: Test Method column includes counts of @Before & @After methods

The count of test must be including be only including no of Test, Not @Before & @After Method in Class Metrics.
This is a minor change which can be fixed and should be made available for next version.
Thanks.

@saurabhgupta94 Fixed at this pull request https://github.com/adiralashiva8/testng-metrics/pull/10


Encounter XP/threat calculation should be influenced by the individual participants' alliance in the combat tracker (including NPCs), not strictly by whoever's in the party folder

As it stands, the system does not properly calculate a combat encounter's level and XP for the party whenever allied NPCs are involved. I often have to do the calculations with the proper adjustments myself because, for example, a party of four fighting a moderate threat encounter by Foundry will have the same difficulty and XP award as it would if, say, four to six guards were fighting on the PCs' side. This makes it harder to determine what actually constitutes a certain level of difficulty when NPC allies are included in a fight and it also throws the XP amounts way out of whack. The system should be able to account for allegiance and adjust the encounter budget properly when necessary.

Upstream issue: there are no rules for factoring in allied NPCs.


Add check to CMAES and make XNES default optimiser

Description
Only CMAES appears to be restricted to optimising multiple parameters at a time. This suggests that we should change the default optimiser away from CMAES.
Issue reference
Fixes #91.
Review
Before you mark your PR as ready for review, please ensure that you've considered the following:

Updated the CHANGELOG.md in reverse chronological order (newest at the top) with a concise description of the changes, including the PR number.
Noted any breaking changes, including details on how it might impact existing functionality.

Type of change

[ ] New Feature: A non-breaking change that adds new functionality.
[ ] Optimization: A code change that improves performance.
[ ] Bug Fix: A non-breaking change that addresses an issue.
[ ] Documentation: Updates to documentation or new documentation for new features.
[x] Refactoring: Non-functional changes that improve the codebase.
[ ] Style: Non-functional changes related to code style (formatting, naming, etc).
[x] Testing: Additional tests to improve coverage or confirm functionality.
[ ] Other: (Insert description of change)

Key checklist:

[ ] No style issues: $ pre-commit run (or $ nox -s pre-commit) (see CONTRIBUTING.md for how to set this up to run automatically when committing locally, in just two lines of code)
[ ] All unit tests pass: $ nox -s tests
[ ] The documentation builds: $ nox -s docs

You can run integration tests, unit tests, and doctests together at once, using $ nox -s quick.
Further checks:

[ ] Code is well-commented, especially in complex or unclear areas.
[ ] Added tests that prove my fix is effective or that my feature works.
[ ] Checked that coverage remains or improves, and added tests if necessary to maintain or increase coverage.

Thank you for contributing to our project! Your efforts help us to deliver great software.

I'm open to discussion on which optimiser to set as default, but the restriction on CMAES to multiple parameter optimisation problems only seems to rule it out from being the most user-friendly option!


"sl" package missing?

Getting errors like:

error: no matching function for call to ‘sl::Camera::enableRecording(const char*, sl::SVO_COMPRESSION_MODE&)’
error: ‘SVO_COMPRESSION_MODE_RAW’ is not a member of ‘sl’
error: ‘SUCCESS’ is not a member of ‘sl’
etc...

when executing: "colcon build --symlink-install --packages-select stereolabs_zed --cmake-args=-DCMAKE_BUILD_TYPE=Release"
How do I fix this?

Hi @nickgoberville
The ROS2 wrapper does not yet work with SDK v3.x.
You must use SDK 2.8.5. You can download it here:
https://www.stereolabs.com/developers/release/2.8/
We will update the ROS2 wrapper to support the ZED SDK v3.x and the latest ROS2 version in the next few months.

Thank you!


Support more VMMs (QEMU, crosvm, XEN)

Right now it's not possible to run the firmware with any non-Firecracker VMM. Ideally we would support a wide range of VMMs. There are many small changes that would fix this:

[ ] In the ELF binary, advertise support for a common boot specification. This would allow any VMM supporting that spec to run the firmware. Our options are:

Mutliboot/Multiboot2: this is an older FSF common boot standard. It would also let us work with QEMU's -kernel option (might also work with Xen).
PVH direct boot: This standard started with XEN, but support was added to QEMU recently. To use this, we just need to advertise XEN_ELFNOTE_PHYS32_ENTRY as an ELFNOTE. Not supporting PVH is why running QEMU with -kernel does not work:> qemu-system-x86_64 -kernel target/target/release/hypervisor-fw
qemu-system-x86_64: Error loading uncompressed kernel without PVH ELF Note

Note that both of these specs would (probably) require a separate 32-bit entry point. The firmware would then need to setup paging before jumping to the normal 64-bit ELF entry point (i.e. _start).

[ ] Issue #5: support building the firmware as a flat BIOS binary (like OVMF.fd), allowing it to be directly loaded/executed by any VMM that supports SeaBIOS/OVMF.

Implementing either of these would let the firmware work on QEMU. I'm not sure about how to get it working for crosvm (it should "just work" with any ELF binary). I can ask around at work Monday to see what the deal is.

PVH would be my strongest preference as I think it will require the least code to program the appropriate state. That being said patches will be accepted for all options.

Note that both of these specs would (probably) require a separate 32-bit entry point. The firmware would then need to setup paging before jumping to the normal 64-bit ELF entry point (i.e. _start).

Sounds fine.

I'm not sure about how to get it working for crosvm (it should "just work" with any ELF binary). I can ask around at work Monday to see what the deal is.

Last time I looked it had a hardcoded jump into 0x200 + text segment (for the Linux kernel setup64 entry point)


fix setValue:forUndefinedKey bug

remove mantle deprecated implementations
fix setValue:forUndefinedKey bug

Hi, thanks for the work. But I haven't tested this code yet.
I noticed that you have removed the Mantle 1.x APIs. So does this code comply all the changes in the Mantle 2.0 changelog now?
And do you think it's better to make it compatible for both 1.x and 2.0 (since Mantle 2.0 has just released recently)?
Thank you.


update homebrew instruction

homebrew/fuse has been merged into homebrew core: https://github.com/Homebrew/homebrew-core/pull/11283

thanks @khoan ! I don't use OS X so contributions like this is very valuable.


Unwrap Ember safe string before passing it to Showdown, fixes #34

isHTMLSafe will not work w/o the polyfill unless we drop support for < 2.8-2.9.
In any case, I disagree we need to unwrap and instead ember-i18n should return a string literal when not dealing with markup.  And when dealing with markup, you could create a helper that is responsible for unwrapping.
https://github.com/stefanpenner/ember-moment/issues/195#issuecomment-261819074


Feat: Application summary page access

Summary
Code changes to add access to an application's summary page from the /applications page. Also, include a small change to avoid unintended rewrites in the query parameters done by the component not selected, i.e., the only mounted component is the one under the selected tab.

I will merge that because it locks the All Apps tab on page one. I did not notice that during the test/review.
cc: @nevendyulgerov , @dandheedge


Drop six

Usage is so limited that we prefer to implement the glue ourselves.

Codecov Report

Merging #80 into master will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff          @@
##           master    #80   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           9      9
  Lines         876    881    +5
=====================================
+ Hits          876    881    +5

Impacted Files
Coverage Δ

ldap2pg/config.py
100% <ø> (ø)
:arrow_up:

ldap2pg/ldap.py
100% <100%> (ø)
:arrow_up:

ldap2pg/utils.py
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2cbc557...56fe3bb. Read the comment docs.


test: replace Equal nil with Nil

Description
In test we compare object with nil while more readable is assert.Nil
Checklist

[ ] Investigated and inspected CI test results
[ ] Unit test and regression tests added
[ ] Evaluated and added CHANGELOG entry if required
[ ] Determined and documented upgrade steps
[ ] Documented user facing changes (create PR based on openshift/openshift-docs and merge into rhacs-docs)

If any of these don't apply, please comment below.
Testing Performed
Here I tell how I validated my change
CI
Reminder for reviewers
In addition to reviewing code here, reviewers must also review testing and request further testing in case the
performed one does not seem sufficient. As a reviewer, you must not approve the change until you understand the
performed testing and you are satisfied with it.

#11531
#11533
#11503
#11507


record type and field indexes in archive metadata

When a type or field index (ie, a non-custom index) is created, we should record its existence in the archive's metadata file, and when a user issues a non-custom index search, we should use the entries in the metadata file to choose what index to use for lookup.

Verified in zq commit 314d783. After adding the type & field indexes first shown in the zar README, here's what the additional info in the archive metadata looks like:
...
$ cat zar.json | jq .
...
  "indexes": {
    "zdx-field-uri": {
      "type": "field",
      "path": "zdx-field-uri"
    },
    "zdx-type-ip": {
      "type": "type",
      "path": "zdx-type-ip"
    }
  }
...

Thanks @henridf!


8266 -- phone is not ok, but computer is ok

Traceback (most recent call last):
File "boot.py", line 11, in
File "wifimgr.py", line 60, in get_connection
File "wifimgr.py", line 315, in start
File "wifimgr.py", line 136, in handle_root
OSError: [Errno 104] ECONNRESET

Finally! The reason is  will trigger OSERROR in 8266 for phone connection, need to delete (colspan="2")


Consider removing 3DES ciphersuites

Context
When TLS 1.0 was standardized back in 1999, AES was not a standard yet (it was announced in 2001), so 3DES was one of of the strongest options, recommended by NIST at that time. Until TLS 1.3, later versions of TLS automatically inherited ciphersuites from previous versions, for ciphersuites based on 3DES can still be negotiated with TLS 1.1 and (D)TLS 1.2.
However, from the start 3DES was limited by its block size of 64 bits, and in 2016 the sweet32 attack made it clear that this limitation could be exploited in practice in several protocols including TLS, in settings where large amounts of data (a couple hundreds of GB) are transmitted or the attacker can cause such large amounts to be transmitted.
As a result several standard bodies started deprecated uses of 3DES in various protocols. NIST (who standardized DES then 3DES) deprecated 3DES in 2017 and disallowed its use in TLS in 2019 (though that's only NIST's guidelines, formally TLS is standardized by the IETF, not NIST). The IETF also deprecated 3DES in other standards.
In all currently maintained branches of Mbed TLS (2.16 and 2.x), 3DES ciphersuites are currently available but hidden by default: that is, they won't be offered or accepted unless the application explicitly includes them in the list of ciphersuites to be negotiated. There is currently a config.h option that can be disabled to "unhide" those and negotiate them by default. That option will be removed in Mbed TLS 3.0, regardless of whether the following proposal is accepted or not.
Proposal
Remove support for 3DES ciphersuites entirely in Mbed TLS 3.0. There would be no way to use those ciphersuites, even by explicit request.
Note: this proposal is only about 3DES ciphersuites in TLS, not about the triple-DES primitive itself. That is to say, this proposal is not about mbedtls_des* functions.
Rationale
Security / best practices: 3DES has weaknesses/limitations and there are better alternatives, and more and more standard bodies are recommending against its use in TLS. There are much better alternatives.
Testing: since other implementations are also retiring 3DES suite, it becomes less and less convenient to perform interop testing with those ciphersuites. This cost is does not seem justified as there are better an more secure alternatives.
Work to do

Remove all 3DES ciphersuites from ssl_ciphersuites.c and ssl_ciphersuites.h
Remove the option MBEDTLS_REMOVE_3DES_CIPHERSUITES and let the code be as if it was disabled (since there aren't any ciphersuites to filter out any more)
Remove tests that where specific to 3DES suites
Once the task is complete, git grep _3DES_ should find no match except in the ChangeLog, and the CI should still pass.

Mailing-list discussion
https://lists.trustedfirmware.org/pipermail/mbed-tls/2021-April/000334.html

There has been no objection on the list, so I'm marking this as approved.

The  #4396 "Remove single-DES and 2-DES from the public API" should be done first.

@TRodziewicz I disagree, there's not dependency between those two issues either way. This task only touches the SSL module and does not depend on any change in libmbedcrypto.

#4587 was merged


Seperating levels into individuals scenes

I want to procedurally generate a world for my game where the level order is randomly generated and to do that, I need to randomly instantiate the levels. But, as far as I know, there is no way to do that currently.

It's a feature I intend to support, but has implications when handling EntityRefs outside the level itself - they would have nothing to point to.
This likely might not matter to most people so I would have it set it up as an import flag. I 'll have another look at this soon.

Adding +1 to this feature request because Metroidvania System requires levels to be scenes and it would be incredible to use these add-ons alongside each other.

Added in V1.3


Changelog button

Version of HACS

v.0.9
Describe the bug
Changelog button on HACS is not working, not linked correctly
Debug log

That was fixed in 0.10.0


Names

To be simple, there is no need to rename most of the blocks in the JS code/enums
For example:

looks like:
player.AddSoldierWeapon(p, enums.SecondaryWeaponsBF2042.Taurus)
player.AddSoldierWeapon(p, enums.MeleeBF2042.Hatchet)

The annoyance arises with the confusion that the difference between AddSoldierWeapon and the actual block of ReplacePlayerInventory could actually do different tasks. Plus, the enum names use real names for weapons, instead of the names in the game (see Taurus -> M44 and Hatchet -> Fatal Friend) this is completely unnecessary and quite confusing.
There are many other instances of this, AllPlayers -> GetPlayers, RestrictedInputs -> InputRestrictions, DisplayCustomNotificationMessage -> DisplayCustomMessage, CustomMessages -> CustomMessageSlot, etc.
Most of these are rather minute and somewhat obvious as to what they mean, however, it would be much better if the names were uniform to their correct meaning/name within the actual Portal editor.
The reasoning for this uniformity so that while actually coding in JS for the editor, you still gain an understanding of the logic and process of creating the code blocks themselves, and will accurately be able to understand the code you are writing in relation to how it would appear in the Rules Editor, and to other people (whom are not adept with unleashed)
I will probably make a PR for this in the future, but for now this is just a notice of the existence of the issue

Overall, as another comment on this issue, Unleashed is rather disorganized. Just a general statement on the organization of the library.
As was noted here, there are a number of complicated overloads. In the case of Player State Booleans, there should (in my opinion) be different methods entirely for checking the different State Types.
While, yes, there is only one function in the Portal Editor for this:

It may make more sense code-wise to separate it.
Ideas:

GetPlayerStateBool()
GetPlayerStateNumber()
GetPlayerStateVector()


Boats location

I noticed that all the ships in the ships endpoint are missing latitude/longitude/course information.
Are these fields supposed to be null for future development or only currently unavailable?
I also noticed that the ASDS barges have valid coordinates under the landpads endpoint, but right now, during the launch of Starlink-25, the OCISLY ASDS (which is involved in the booster recovery), still has the coordinates of Port Canaveral. Is this meant to show the home port position of the ASDS?

Pretty sure the barges don't use AIS, so those coordinates should represent the home port. Went ahead and fixed those coords.
As far as the ships go, previously we were scraping the Marine Traffic pages to grab coords, speed, course, etc... but they switched to a SPA, so the scraper would need to run a headless browser to grab everything. Just haven't gotten around to rewriting it yet 🙃 .
The other issue is the only public data available is from ground based AIS stations on the coast, and the range is only about ~40 NM off the coast. Most of the landing locations are 100-200NM off the coast, so the data kinda falls off after that point anyway. Only solution around that is paying for API access to a satellite AIS provider, but those run about $500+ a month for access 😆

That's understandable, and definitely not cheap.
In my application (it's still in TestFlight beta, that's why I didn't add it to the clients list), I show a map with some points of interest for every launch, and at this point it's definitely cheaper to add a little disclaimer about location updates. I understand that getting the live location for all the droneships and support ships is not easy, and still, it would have made little sense (in my case) to show that information in the context of a past launch.

As a suggestion for an eventual future version, it would be really useful to have a pair of fields (lat/lon, maybe even time) that keep track of the location of the droneship at the time of a core's landing. I have found a map that could be useful for something like this, and it seems to be constantly updated, but I have no idea about how coordinates could be extracted from it (in general, I have literally zero experience in backend development).
This is the map I'm talking about, maybe you already know it and use it for other data. It seems quite accurate and it has a long changelog that shows constant updates. It also has lots of other useful data, such as hazard areas, splashdown points...
I leave this issue open for those who don't know about the broken scraper, feel free to close it if you prefer.


Refactor training loop merge meta into one file

PR types

Function optimization
PR changes

Others
Description

meta 聚合到一个文件，方便同步

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.8 out of 9 committers have signed the CLA.:white_check_mark: Meiyim:white_check_mark: ForFishes:white_check_mark: haohongxiang:white_check_mark: GhostScreaming:white_check_mark: xysheng-baidu:white_check_mark: wuhuachaocoding:white_check_mark: SylarTiaNII:white_check_mark: liuzhenhai93:x: pangengzhengpangengzheng seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


100 percent broken

Trying to load KML file from https://data-usdot.opendata.arcgis.com/datasets/north-american-rail-lines, all of about 300,000 rows, It gets hung up hard. Using the nuget 2.1.0 and LinqPad5 (any cpu).
Expected behavior: It runs and completes.
Actual behavior: It runs forever.
Steps to reproduce: Get the KML file, add the NuGet package to LinqPad, run the code below.
var fileStream = File.Open(@"D:\Download\North_American_Rail_Lines.kml", FileMode.Open);
var mapper = new Kml2SqlMapper(fileStream);
using (var connection = new SqlConnection(this.Connection.ConnectionString))
{
	connection.Open();
	var createTableCommand = mapper.GetCreateTableCommand(connection);
	createTableCommand.ExecuteNonQuery();
	foreach (var mapFeature in mapper.GetMapFeatures())
	{
		var command = mapFeature.GetInsertCommand();
		command.Connection = connection;
		command.ExecuteNonQuery();
	}
}

Seems like nuget updates to pull newer SharpKML fix this thing.


Azure Industrial IoT Gateway Installer

Describe the bug
The issue observed: The installer execution will cause the azure edge VM network failure, and to fix it I will need to manually clean up the Ubuntu changelog file via $sudo truncate -s 0 /var/lib/ubuntu-release-upgrader/release-upgrade-available, and the modules will be deployed.
However the deployed edge runtime version is v1.1, not the latest v1.2. and the installer is using dotnet SDK version 3.1 only. Could the develop team help to upgrade the installer for the up-to-date module deployment?
Desktop (please complete the following information):

Azure VM as the edge gateway
OS: Linux Ubuntu 18.04LTS

I am sorry to inform you that the Azure Industrial IoT Gateway Installer is no longer supported by our team. We recommend instead using the documentation in this github repo.


boards: adafruit feather nrf52840 uf2 initalize USB at boot

Make Adafruit Feather nrf52840 UF2 variants initialize USB by default.
Adafruit Feather nRF52840 UF2 variants have their USB enabled by default, and use the CDC ACM UART for the console. All other nRF52840 boards that use that, initialize their USB by default. This PR makes it so Adafruit Feather nRF52840 UF2 variants also do that.

CI fails are not caused by the changes from this PR. See #80215.

@jacobw can you review?

Looks good to me.

See #58349 #81308

Thanks for those links @jfischer-no. I get that in the end we'd prefer to have it done in a more tidy way.
But right now we have a target that is essentially not working correctly, so IMO we should:

first, go ahead with this PR which makes the target work correctly
and later, clean up CDC ACM configuration later (with the PR you linked)

This way we'd avoid keeping a non-working target in-tree and waiting for the more complex effort to land in order to sort this situation out.
WDYT?

See #58349 #81308

Thanks for those links @jfischer-no. I get that in the end we'd prefer to have it done in a more tidy way.
But right now we have a target that is essentially not working correctly, so IMO we should:
1. first, go ahead with this PR which makes the target work correctly

2. and later, clean up CDC ACM configuration later (with the PR you linked)

This way we'd avoid keeping a non-working target in-tree and waiting for the more complex effort to land in order to sort this situation out.
WDYT?

If you were to read the contents of the linked issue and commit messages in the linked PR, you would realize that this PR is not a correct fix at all.


Transfer queue processor base V2

What changed?
Rewrite transfer queue processor base with multi-cursor queue components.

Why?
Part of multi-cursor queue implementation

How did you test it?

Potential risks
N/A, implementation not wired up yet.

Coverage decreased (-0.2%) to 68.253% when pulling b9fe85f8234056bd228e107f675e88b617bbc620 on yycptt:new-transfer-processor-base into 1f3404b402e4f4813166871610e7e4625bd547ef on uber:master.


Notice for ctrl + click

Add instructions for users to show multiple time series using ctrl + click

This is done with a tooltip to the right.how's


[WIP] some improvements for tests speedup on windows

Proposed changes
Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request.
Fixes
If it fixes a bug or resolves a feature request, be sure to link to that issue.
Types of changes
What types of changes does your code introduce to agents-aea?
Put an x in the boxes that apply

[ ] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist
Put an x in the boxes that apply.

[ ] I have read the CONTRIBUTING doc
[ ] I am making a pull request against the develop branch (left side). Also you should start your branch off our develop.
[ ] Lint and unit tests pass locally with my changes and CI passes too
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have checked that code coverage does not decrease.
[ ] I have added necessary documentation (if appropriate)
[ ] Any dependent changes have been merged and published in downstream modules

Further comments
If this is a relatively large or complex change, kick off the discussion by explaining why you chose the solution you did and what alternatives you considered, etc...
DELETE INCLUSIVE THIS AND BELOW FOR STANDARD PR
Release summary
Version number: [e.g. 1.0.1]
Release details
Describe in short the main changes with the new release.
Checklist
Put an x in the boxes that apply.

[ ] I have read the CONTRIBUTING doc
[ ] I am making a pull request against the main branch (left side), from develop
[ ] Lint and unit tests pass locally and in CI
[ ] I have checked the fingerprint hashes are correct by running (aea packages lock --check)
[ ] I have regenerated the latest API docs
[ ] I built the documentation and updated it with the latest changes
[ ] I have added an item in HISTORY.md for this release
[ ] I bumped the version number in the aea/__version__.py file.
[ ] I bumped the version number in every Docker image of the repo and published it. Also, I built and published them with tag latest
(check the READMEs of aea-develop
and aea-user)
[ ] I have pushed the latest packages to the registry.
[ ] I have uploaded the latest aea to PyPI.
[ ] I have uploaded the latest plugins to PyPI.

Further comments
Write here any other comment about the release, if any.

Codecov Report
Base: 96.57% // Head: 93.03% // Decreases project coverage by -3.54% :warning:

Coverage data is based on head (5e67925) compared to base (9526b03).
 Consider uploading reports for the commit cda8caf to get more accurate results

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #550      +/-   ##
==========================================
- Coverage   96.57%   93.03%   -3.55%
==========================================
  Files         353      353
  Lines       28387    28376      -11
==========================================
- Hits        27416    26399    -1017
- Misses        971     1977    +1006

Flag
Coverage Δ

unittests
93.03% <ø> (-3.55%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

 Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

no significant improvements atm. will be closed


Fatal Error When Using Remote Directories in kustomization.yaml with microk8s on Ubuntu 24.04 LTS

Summary
When installing microk8s via snap, kubectl encounters a fatal error when specifying a remote directory as a resource in kustomization.yaml.
Channel: latest/stable
Version: v1.29.0
OS: Ubuntu 24.04 LTS (minimized)
What Should Happen Instead?
No errors should occur, and kubectl and helm commands should succeed.
Reproduction Steps
$ sudo snap install microk8s --classic --channel=latest/stable
$ cat << EOF > ./kustomization.yaml
resources:
- https://github.com/kubernetes-sigs/kustomize//examples/helloWorld/?timeout=120&ref=v3.3.1
EOF
$ microk8s kubectl apply -k .

Expected Result:
configmap/the-map created
service/the-service created
deployment.apps/the-deployment created

Actual Result:
error: accumulating resources: accumulation err='accumulating resources from 'https://github.com/kubernetes-sigs/kustomize//examples/helloWorld/?timeout=120&ref=v3.3.1': URL is a git repository': failed to run '/snap/microk8s/6364/usr/bin/git fetch --depth=1 https://github.com/kubernetes-sigs/kustomize v3.3.1': fatal: unable to find remote helper for 'https'
: exit status 128

Introspection Report
inspection-report-20240618_154427.tar.gz
Can you suggest a fix?
The issue seems to be caused by the absence of git-remote-https $SNAP/usr/lib/git-core/git-remote-https not being referenced in the git package included with snap.
$ snap run --shell microk8s
$ $SNAP/usr/bin/git --version
git version 2.25.1
$ $SNAP/usr/bin/git clone https://github.com/octocat/Hello-World.git
Cloning into 'Hello-World'...
warning: templates not found in /usr/share/git-core/templates
fatal: unable to find remote helper for 'https'
$ exit

To resolve this, it seems possible to define the environment variable in the snapcraft.yaml file.
https://github.com/canonical/microk8s/blob/b25957fe365f9382ff5626c381a1f8093beee868/snap/snapcraft.yaml#L15-L20
--- current/snap/snapcraft.yaml
+++ suggestion/snap/snapcraft.yaml
@@ -17,6 +17,7 @@
   REAL_LD_LIBRARY_PATH: $LD_LIBRARY_PATH
   REAL_PYTHONPATH: $PYTHONPATH
   SNAPCRAFT_ARCH_TRIPLET: $SNAPCRAFT_ARCH_TRIPLET
+  GIT_EXEC_PATH: $SNAP/usr/lib/git-core/

 parts:
   build-deps:

Let's try this.
$ mkdir ~/snap-microk8s
$ cd ~/snap-microk8s
$ sudo apt install git
$ git clone https://github.com/canonical/microk8s.git -b v1.30 .
$ patch -u snap/snapcraft.yaml --no-backup-if-mismatch << 'EOF'
--- current/snap/snapcraft.yaml
+++ suggestion/snap/snapcraft.yaml
@@ -17,6 +17,7 @@
   REAL_LD_LIBRARY_PATH: $LD_LIBRARY_PATH
   REAL_PYTHONPATH: $PYTHONPATH
   SNAPCRAFT_ARCH_TRIPLET: $SNAPCRAFT_ARCH_TRIPLET
+  GIT_EXEC_PATH: $SNAP/usr/lib/git-core/

 parts:
   build-deps:
EOF
$ snapcraft --use-lxd --debug
Created snap package Snapped microk8s_v1.30.2_amd64.snap
$ sudo snap install ./microk8s_v1.30.2_amd64.snap --dangerous --classic
$ sudo apt remove git --auto-remove
$ mkdir ~/snap-microk8s
$ cd ~/snap-microk8s
$ cat << EOF > ./kustomization.yaml
resources:
- https://github.com/kubernetes-sigs/kustomize//examples/helloWorld/?timeout=120&ref=v3.3.1
EOF
$ microk8s kubectl apply -k .
configmap/the-map created
service/the-service created
deployment.apps/the-deployment created

I'm not familiar with Snapcraft, so I'm unsure if this is the most appropriate fix.
note
If git is installed on the host OS, the error message changes, suggesting it references the host OS's git-remote-https.
$ microk8s kubectl apply -k .
error: accumulating resources: accumulation err='accumulating resources from 'https://github.com/kubernetes-sigs/kustomize//examples/multibases?timeout=120&ref=v3.3.1': URL is a git repository': failed to run '/snap/microk8s/6364/usr/bin/git fetch --depth=1 https://github.com/kubernetes-sigs/kustomize v3.3.1': /usr/lib/git-core/git-remote-https: symbol lookup error: /snap/core20/current/lib/x86_64-linux-gnu/libpthread.so.0: undefined symbol: __libc_pthread_init, version GLIBC_PRIVATE
: exit status 128

Using a remote file instead of a remote directory works as expected.
$ cat << EOF > ./kustomization.yaml
resources:
- https://raw.githubusercontent.com/kubernetes-sigs/kustomize/master/examples/helloWorld/configMap.yaml
EOF
$ microk8s kubectl apply -k .
configmap/the-map created

Here is a workaround that has been identified:
$ sudo ln -s /snap/microk8s/current/usr/lib/git-core /usr/lib/git-core
$ microk8s kubectl apply -k .
configmap/the-map created
service/the-service created
deployment.apps/the-deployment created

However, it relies on the absence of git on the host OS, making it an impractical solution.

This workaround is better because it has less impact on the host OS:
$ cat << EOF > ./kustomization.yaml
resources:
- https://github.com/kubernetes-sigs/kustomize//examples/helloWorld/?timeout=120&ref=v3.3.1
EOF
$ GIT_EXEC_PATH=/snap/microk8s/current/usr/lib/git-core/ microk8s kubectl apply -k .
configmap/the-map created
service/the-service created
deployment.apps/the-deployment created

I have added a proposed fix to the issue description.
Additionally, similar issues have been reported in #1260 and #4453.


Cannot generate XML coverage report

I noticed this in PyCharm, because it uses the XML report, but it occurs from the command line as well.
$ coverage xml
Coverage.py warning: Setting timid=True to support plugins.
Traceback (most recent call last):
  File "/Users/jessamyn/.virtualenvs/eggtimer3/bin/coverage", line 9, in <module>
    load_entry_point('coverage==4.0a4', 'console_scripts', 'coverage')()
  File "/Users/jessamyn/.virtualenvs/eggtimer3/lib/python3.4/site-packages/coverage/cmdline.py", line 669, in main
    status = CoverageScript().command_line(argv)
  File "/Users/jessamyn/.virtualenvs/eggtimer3/lib/python3.4/site-packages/coverage/cmdline.py", line 452, in command_line
    total = self.coverage.xml_report(outfile=outfile, **report_args)
  File "/Users/jessamyn/.virtualenvs/eggtimer3/lib/python3.4/site-packages/coverage/control.py", line 955, in xml_report
    return reporter.report(morfs, outfile=outfile)
  File "/Users/jessamyn/.virtualenvs/eggtimer3/lib/python3.4/site-packages/coverage/xmlreport.py", line 59, in report
    self.report_files(self.xml_file, morfs)
  File "/Users/jessamyn/.virtualenvs/eggtimer3/lib/python3.4/site-packages/coverage/report.py", line 80, in report_files
    report_fn(cu, self.coverage._analyze(cu))
  File "/Users/jessamyn/.virtualenvs/eggtimer3/lib/python3.4/site-packages/coverage/xmlreport.py", line 124, in xml_file
    filename = cu.file_locator.relative_filename(cu.filename)
AttributeError: 'FileReporter' object has no attribute 'file_locator'

This is fixed by a change in coverage.py: https://bitbucket.org/ned/coveragepy/commits/7fd1c40f2001cbaddada0a62c4e445d55182d45f


Docker file won´t built a working image

I cannot build the docker image using the docker file located in the root folder. It seems that the last 2 lines, besides uncommenting, need changing "conda run" for "RUN conda". But after it and when trying to build the docker image from get docker file, I am getting this error
executor failed running [conda run -n kluster_test /bin/bash -c conda -n kluster_test pip install git+https://github.com/noaa-ocs-hydrography/kluster.git#egg=hstb.kluster]: exit code: 1
See the log
(base) PS C:\Users\monoc\Downloads\kluster-kluster_0_8_9> docker build -t kluster089 .
[+] Building 1.4s (19/20)
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 1.89kB 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/library/ubuntu:18.04 0.8s
=> [ 1/17] FROM docker.io/library/ubuntu:18.04@sha256:c2aa13782650aa7ade424b12008128b60034c795f25456e8eb552d0a0f447cad 0.0s
=> CACHED [ 2/17] RUN apt-get update 0.0s
=> CACHED [ 3/17] RUN apt-get install -y git 0.0s
=> CACHED [ 4/17] RUN apt-get install -y wget 0.0s
=> CACHED [ 5/17] RUN apt install libgl1-mesa-glx -y 0.0s
=> CACHED [ 6/17] RUN apt-get install ffmpeg libsm6 libxext6 -y 0.0s
=> CACHED [ 7/17] RUN adduser --disabled-password --gecos "Non-root user" --uid 1000 --gid 100 --home /ho 0.0s
=> CACHED [ 8/17] RUN wget --quiet https://repo.anaconda.com/miniconda/Miniconda3-py38_4.10.3-Linux-x86_64.sh -O ~/minico 0.0s
=> CACHED [ 9/17] RUN echo ". /home/eyou102/miniconda3/etc/profile.d/conda.sh" >> ~/.profile 0.0s
=> CACHED [10/17] RUN conda init bash 0.0s
=> CACHED [11/17] RUN mkdir /home/eyou102/kluster 0.0s
=> CACHED [12/17] WORKDIR /home/eyou102/kluster 0.0s
=> CACHED [13/17] RUN conda update --name base --channel defaults conda 0.0s
=> CACHED [14/17] RUN conda create -n kluster_test python=3.8.12 0.0s
=> CACHED [15/17] RUN conda install -c conda-forge qgis=3.18.3 vispy=0.9.4 pyside2=5.13.2 gdal=3.3.1 h5py python-geohash 0.0s
=> ERROR [16/17] RUN conda -n kluster_test pip install git+https://github.com/noaa-ocs-hydrography/kluster.git#egg=hstb.k 0.6s
[16/17] RUN conda -n kluster_test pip install git+https://github.com/noaa-ocs-hydrography/kluster.git#egg=hstb.kluster:
https://github.com/noaa-ocs-hydrography/kluster/issues/19 0.540 ERROR conda.cli.main_run:execute(33): Subprocess for 'conda run ['/bin/bash', '-c', 'conda -n kluster_test pip install git+https://github.com/noaa-ocs-hydrography/kluster.git#egg=hstb.kluster']' command failed. (See above for error)
https://github.com/noaa-ocs-hydrography/kluster/issues/19 0.540
https://github.com/noaa-ocs-hydrography/kluster/issues/19 0.540 CommandNotFoundError: No command 'conda kluster_test'.
https://github.com/noaa-ocs-hydrography/kluster/issues/19 0.540
https://github.com/noaa-ocs-hydrography/kluster/issues/19 0.540
executor failed running [conda run -n kluster_test /bin/bash -c conda -n kluster_test pip install git+https://github.com/noaa-ocs-hydrography/kluster.git#egg=hstb.kluster]: exit code: 1

The last commands I had commented were wrong.  It was before I figured out how SHELL works.
I've updated the file, can you download and retry?
https://github.com/noaa-ocs-hydrography/kluster/blob/kluster_0_8_9/dockerfile

It still doesn´t work :
executor failed running [conda run -n kluster_test /bin/bash -c python -m HSTB.kluster]: exit code: 1
.........
(base) PS C:\Users\monoc\Downloads> docker build -t kluster089 .
[+] Building 60.4s (21/21) FINISHED
=> [internal] load build definition from Dockerfile                                                                        0.0s
=> => transferring dockerfile: 1.91kB                                                                                0.0s
=> [internal] load .dockerignore                                                                                0.0s
=> => transferring context: 2B                                                                                0.0s
=> [internal] load metadata for docker.io/library/ubuntu:18.04                                                             1.5s
=> [auth] library/ubuntu:pull token for registry-1.docker.io                                                               0.0s
=> [ 1/17] FROM docker.io/library/ubuntu:18.04@sha256:c2aa13782650aa7ade424b12008128b60034c795f25456e8eb552d0a0f447cad     0.0s
=> CACHED [ 2/17] RUN apt-get update                                                                                0.0s
=> CACHED [ 3/17] RUN apt-get install -y git                                                                               0.0s
=> CACHED [ 4/17] RUN apt-get install -y wget                                                                              0.0s
=> CACHED [ 5/17] RUN apt install libgl1-mesa-glx -y                                                                       0.0s
=> CACHED [ 6/17] RUN apt-get install ffmpeg libsm6 libxext6  -y                                                           0.0s
=> CACHED [ 7/17] RUN adduser --disabled-password     --gecos "Non-root user"     --uid 1000     --gid 100     --home /ho  0.0s
=> CACHED [ 8/17] RUN wget --quiet https://repo.anaconda.com/miniconda/Miniconda3-py38_4.10.3-Linux-x86_64.sh -O ~/minico  0.0s
=> CACHED [ 9/17] RUN echo ". /home/eyou102/miniconda3/etc/profile.d/conda.sh" >> ~/.profile                               0.0s
=> CACHED [10/17] RUN conda init bash                                                                                0.0s
=> CACHED [11/17] RUN mkdir /home/eyou102/kluster                                                                          0.0s
=> CACHED [12/17] WORKDIR /home/eyou102/kluster                                                                            0.0s
=> CACHED [13/17] RUN conda update --name base --channel defaults conda                                                    0.0s
=> CACHED [14/17] RUN conda create -n kluster_test python=3.8.12                                                           0.0s
=> CACHED [15/17] RUN conda install -c conda-forge qgis=3.18.3 vispy=0.9.4 pyside2=5.13.2 gdal=3.3.1 h5py python-geohash   0.0s
=> [16/17] RUN pip install git+https://github.com/noaa-ocs-hydrography/kluster.git#egg=hstb.kluster                       56.7s
=> ERROR [17/17] RUN python -m HSTB.kluster                                                                                2.1s

[17/17] RUN python -m HSTB.kluster:
#21 2.103 ERROR conda.cli.main_run:execute(33): Subprocess for 'conda run ['/bin/bash', '-c', 'python -m HSTB.kluster']' command failed.  (See above for error)
#21 2.103 Traceback (most recent call last):
#21 2.103   File "/home/eyou102/miniconda3/envs/kluster_test/lib/python3.8/runpy.py", line 194, in _run_module_as_main
#21 2.103     return _run_code(code, main_globals, None,
#21 2.103   File "/home/eyou102/miniconda3/envs/kluster_test/lib/python3.8/runpy.py", line 87, in _run_code
#21 2.103     exec(code, run_globals)
#21 2.103   File "/home/eyou102/miniconda3/envs/kluster_test/lib/python3.8/site-packages/HSTB/kluster/main.py", line 7, in
#21 2.103     from HSTB.kluster.gui import kluster_main
#21 2.103   File "/home/eyou102/miniconda3/envs/kluster_test/lib/python3.8/site-packages/HSTB/kluster/gui/kluster_main.py", line 23, in
#21 2.103     import matplotlib.pyplot as plt
#21 2.103   File "/home/eyou102/miniconda3/envs/kluster_test/lib/python3.8/site-packages/matplotlib/pyplot.py", line 2230, in
#21 2.103     switch_backend(rcParams["backend"])
#21 2.103   File "/home/eyou102/miniconda3/envs/kluster_test/lib/python3.8/site-packages/matplotlib/pyplot.py", line 275, in switch_backend
#21 2.103     raise ImportError(
#21 2.103 ImportError: Cannot load backend 'Qt5Agg' which requires the 'qt' interactive framework, as 'headless' is currently running
#21 2.103

executor failed running [conda run -n kluster_test /bin/bash -c python -m HSTB.kluster]: exit code: 1

I believe this is actually sort of working.  The last command in the dockerfile is 'python -m HSTB.kluster' which starts the GUI.  That fails in 'headless' mode as it has determined that you don't have any graphics capability.  This is as far as I have gotten with Docker.  If there is some way to run the GUI in Docker, I am not aware of it.
I probably should have commented that last line.  But I think you can at least run the processing with the container as is, outside of the GUI.

Not sure that I got the docker image right, Once, within the docker container command line, I cannot import any library.  The same if using an IDE.
Besides this , even though we couldn´t get a GUI, it would be nice to run scripts in Jupyter notebooks.

Maybe the GUI could work using the docker image by following the guide made by the MBsystem developing team for running their software in Windows 11.
I have adapted the launcher (sh file) accordingly but still is not loading the main menu

@monocilindro based on my googling, it appears this is related to not having a graphics driver in the dockerimage.  See here.  We could alter the dockerfile to install during the build.  I believe you could also try installing after starting the docker container.
I can look at this after I finish my current task.

Hi, first of all, thank you for this piece of software! It was missing!
I got the main UI working with the following docker file:
FROM nvidia/cuda:11.7.1-devel-ubuntu20.04
LABEL<EMAIL_ADDRESS>
ENV DEBIAN_FRONTEND=noninteractive
ENV PYTHONUNBUFFERED=1

RUN apt-get update && apt-get -y dist-upgrade

RUN apt-get install -y software-properties-common
RUN apt-get update && apt-get -y dist-upgrade
RUN add-apt-repository ppa:ubuntugis/ppa
RUN apt-get update && apt-get -y dist-upgrade

RUN apt install -y mesa-utils xserver-xorg-video-all nvidia-common kmod x11-apps wget

# download from NVIDIA or install from a debian repository
# COPY NVIDIA-Linux-x86_64-515.43.04.run .
RUN wget https://us.download.nvidia.com/XFree86/Linux-x86_64/515.43.04/NVIDIA-Linux-x86_64-515.43.04.run

RUN /bin/sh NVIDIA-Linux-x86_64-515.43.04.run -a -s --no-kernel-module --install-libglvnd || \
    cat /var/log/nvidia-installer.log

RUN apt-get install  -y qgis \
    libqgis-dev \
    python3-qgis \
    python3-vispy \
    python3-qtpy \
    python3-pyside2.* \
    libgdal-dev \
    python3-pip \
    build-essential \
    gfortran \
    cmake \
    git \
    nano \
    python3-h5py

RUN pip install geohash

RUN python3 --version

RUN pip install git+https://github.com/epifanio/kluster.git#egg=hstb.kluster

I am using Nvidia-docker as I needed some GPU processing and I installing the exact same video driver as the one installed on my machine.  - but the same dockerfile should work starting from a standard ubuntu-20.04 image and using the driver available from the debian repository, as long as they are the same drivers  available on the host machine (not sure how this will work on windows, I tested it only on my Linux WS)
I run the container via docker compose with :
version: '3.3'
services:
    gui:
        image: epinux/kluster:latest
        runtime: nvidia
        environment:
            - NVIDIA_VISIBLE_DEVICES=all
            - DISPLAY=$DISPLAY
        command: /usr/bin/python3 -m HSTB.kluster

        volumes:
            - /tmp/.X11-unix:/tmp/.X11-unix
            - ~/.Xauthority:/root/.Xauthority
        network_mode: "host"

before running docker-compose run:  xhost +local:  It requires the xhost utility installed on the host machine.

This is great Massimo!  Would you be comfortable with committing this new dockerfile, or updating the existing one?

Thanks  @ericgyounkin -  I will clean up my fork and make a PR from a dedicated branch.


URL::forceSchema('https') doesn't affect paginator render() function

So I used URL::forceSchema('https') to force https in url generation.
Everything works fine except render function from paginator.
route('login'); // HTTPS
asset('css/app.css'); // HTTPS
$users->render(); // HTTP

Thanks for reporting. Let me know if #10007 fixes your issue.
Please comment on the PR though rather than here again since I don't read comments on closed issues. :)

Not working.

+1
forceSchema('https') doesn't affect pagination urls.

The issue is still present on laravel 7 and 8

The issue is still present on laravel 7 and 8

Can confirm on Laravel 8 it doesn't work, but the older, less ideal way $this->app['request']->server->set('HTTPS', true); does.


Clean up replicaGroupStrategyConfig / replicaGroupPartitionConfig

replicaGroupStrategyConfig is the old one and replicaGroupPartitionConfig is the new, but right now you need to maintain both because the new one doesn't have partitioning column but the old one does.
It can easily lead to confusion why there is 2 configs especially since they share field names.
We should fully clean up and remove the old one

I would like to try if no one is working on this. Thanks.

This cleanup is backwards incompatible. I fully agree that we need to start using the new one and there is confusion / maintenance overhead etc but simply removing it right away is going to break things for people in production.

This is a good issue, but we should not deprecate the old flow since this will impact production systems. We should bring a plan  for migrations / compatibility  along these cleanups to align all the stakeholders before deprecating this fully.

We want to do it in a backward compatible way:

Add a new field _partitionColumn into the InstanceReplicaGroupPartitionConfig
If the field is not found, fall back to the old ReplicaGroupStrategyConfig
Keep the ReplicaGroupStrategyConfig and use it when the new config doesn't exist

Thanks, @siddharthteotia,  @GSharayu and @Jackie-Jiang, for the comments.
I'm just asking the question here that I have asked on the draft PR.
What if a user provides a different partitionColumn value in both configs? As per @Jackie-Jiang's comment, we will use the value of partitionColumn provided in InstanceReplicaGroupPartitionConfig. Is it correct? Also, for numInstancesPerPartition, it's going to be the same?
I was going over the documentation, and I think we need to update the documentation by mentioning ReplicaGroupStrategyConfig  as deprecated.
Please let me know if anything else needs to be updated. Thanks

@abhioncbr The overall goal is to keep the existing config work if new config is not provided, and use the new config if provided. So if the partitionColumn is provided in both places, we can either throw an exception to let the user know the config is invalid (preferred, can be done within the TableConfigUtils.validate()), or just use the one from the new config.

Please review the changes. Thanks


Fix issue with VMWare builds: "Waiting for HGFS kernel module to load..."

Whenever I bring up machines using the default share (e.g. the one that is used for the /vagrant mount by default, which could be switched to NFS/rsync/SMB, or disabled, but still...), I get the following error after a while:
Waiting for HGFS kernel module to load...
The HGFS kernel module was not found on the running virtual machine.
This must be installed for shared folders to work properly. Please
install the VMware tools within the guest and try again. Note that
the VMware tools installation will succeed even if HGFS fails
to properly install. Carefully read the output of the VMware tools
installation to verify the HGFS kernel modules were installed properly.

I'd like to not have to update all my Vagrantfiles to disable the default share or switch it to NFS, so I'd like to fix this, maybe using a technique like the one here: https://bascht.com/tech/2013/10/07/building-a-vagrant-box-with-centos-64-and-vmware/
TODO

[x] Update CentOS 6 packer/vagrant cloud box for VMWare and VirtualBox
[x] Update CentOS 7 packer/vagrant cloud box for VMWare and VirtualBox

Also, I can confirm that this is happening with at least CentOS 6.6; I haven't tested thoroughly on CentOS 7.x yet.

Fix is in code, now I just need to rebuild some packer boxes and put them up on Atlas/Vagrant Cloud.

For CentOS 7, there is no simple installation via RPM, it seems. So far I can get HGFS working if I manually install gcc + kernel headers (with uname -r so kernel-devel-[kernel]), then go through the gauntlet:
# After mounting the ISO on `/dev/cdrom` with 'Reinstall VMware tools' menu item.
mkdir /mnt/cdrom
mount /dev/cdrom /mnt/cdrom
cd /tmp
tar zxpf /mnt/cdrom/VMwareTools-xxxxxxx.tar.gz
umount /dev/cdrom
cd vmware-tools-distrib
# Watch the output of this command very closely. No decent error detection :P.
./vmware-install.pl --default

After doing that and a vagrant reload, the HGFS mounts work properly. Ugh.
Working on rebuilding the Packer box a few more times before I pull out more of my hair.

Might have to do something like:

Manually mount/run/unmount VMware tools
Same thing, different ideas

Supposedly (according to everything I've read), just installing open-vm-tools should be enough for CentOS 7/RHEL7, but this seems not to be the case from what I've been experiencing :(

Fixed.

I think I'm still seeing this issue with my CentOS 7.1 minimal install
It looks like vmware-install.pl --default runs, but can't build kernel modules unless gcc and kernel-devel are installed.

Ah, nope. I just hadn't updated to the latest version of the role properly.


[webapi] Update tests.xml for test uniform-samplers-test

Add timeout option to tests.xml for uniform-samplers-test

Impacted TCs num(approved): New 0, Update 1, Delete 0
Unit test Platform: Android Crosswalk Beta 15.44.384.9
Android test result summary: Pass 1, Fail 0, Block 0
BUG=https://crosswalk-project.org/jira/browse/XWALK-5248

How about these 2 tests?

tct-webgl-nonw3c-tests/webgl/khronos/quickCheckAPI-B1.html
tct-webgl-nonw3c-tests/webgl/khronos/quickCheckAPI-G_I.html

As per https://crosswalk-project.org/jira/browse/XWALK-5552, the 2 tests I mentioned above always got  PASS in the testing page, but testkit-lite got no results thus block.
So merging this, thanks.


Login w/o account wrong behavior

How to reproduce:
Accept license agrement -> proceed to LoginActivity -> Click "Have no account?" -> When app asks to enter group, click "Close". Then restart application and discover, that login (in guest mode) was successful, and some group's schedule is displayed
Which behavior expected:
Instead of seeing unknown group's schedule, user wants to see either login view (login & pwd) or group selection view (group name)
Reason:
LoginActivity.java line 42: PrefUtils.markAuthPassed(getApplicationContext()); Application marks auth as passed even if user has not finished it (has not selected his group)
BaseActivity.java line 442: SyncSchedule sync = SyncSchedule.getSyncSchedule("ФБ-41", getApplicationContext()); Hardcoded default group name

This wasn't implemented. Will be implemented today.

Fixed

@Deepnekroz , you can link commit to Issue by use commit message "Close #9"


ObjectManager, providing resource.objects(), is not thread-safe

move https://github.com/kelproject/pykube/issues/138 from upstream

I think a documentation string to highlight this behavior would already help users mitigate risks.


Cannot Undo

I get an error message if I try to undo (hit cmd-z) after using translated strings in my .dart-files. It happens every time after the i18n.dart got autogenerated. I thought if there's any way to... maybe generate the i18n.dart manually?

The file is auto-generated, do not edit it. It's written in bold in the beginning of the file. Instead, you should edit the res/values/*.arb files.

Oh... Thank you. But I didn't change the auto-generated file but any other file in my lib folder that has a translated string inside itself. So I hit save and the generator gets triggered. After that I try to undo my changes by hitting cmd-z. And then the error message pops up.

Hmmm... Could be that the IDE is just doing what it's supposed to do, which is to warn that the auto-generated file will also be reverted back to its earlier version.

I hit that bug/issue too, it's pretty annoying; You cannot undo unless you restart the IDE. I could figure out how to reproduce it, though.

That might help but I still think it's an IDE issue...

Yes, maybe. I didn't run into this since I upgraded to Android Studio 3.5, so maybe it's already fixed.

Closing for now, re-open if needed.


Issue running example with load_model()

Hello!
First of all thank you for this amazing work. I'll definitely use it.
The thing is I'm running into an issue when trying to initialize the algorithm. On the fourth cell of your notebook https://colab.research.google.com/drive/1pxTIMweAKApJZ3ZFqyBee3HtMqFpnwQ0?usp=sharing#scrollTo=FeJarWQuFQOT when calling the load_model() I have an error. I'll paste a bit of code here to illustrate:
device = torch.device('cuda' if torch.cuda.is_available() else 'cpu')
model_name = '2021-07-30T21-34-25_vggsound_transformer'
log_dir = 'SpecVQGAN/logs'
config, sampler, melgan, melception = load_model(model_name, log_dir, device)

The model downloads and I get the warning:
device  cuda
Using: 2021-07-30T21-34-25_vggsound_transformer (5 ResNet50 Features)
3.68GB [01:55, 31.7MB/s]
Unpacking SpecVQGAN/logs/2021-07-30T21-34-25_vggsound_transformer.tar.gz to SpecVQGAN/logs

But seconds after the unpack I get this error:

Traceback (most recent call last):
  File "/home/luis/Desktop/clip/scripts/test_both_libs.py", line 73, in <module>
    config, sampler, melgan, melception = load_model(model_name, log_dir, device)
  File "SpecVQGAN/feature_extraction/demo_utils.py", line 191, in load_model
    config = load_config(model_dir)
  File "SpecVQGAN/feature_extraction/demo_utils.py", line 178, in load_config
    if config.data.params[a] is not None:
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/omegaconf/dictconfig.py", line 373, in __getitem__
    self._format_and_raise(key=key, value=None, cause=e)
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/omegaconf/base.py", line 190, in _format_and_raise
    format_and_raise(
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/omegaconf/_utils.py", line 821, in format_and_raise
    _raise(ex, cause)
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/omegaconf/_utils.py", line 719, in _raise
    raise ex.with_traceback(sys.exc_info()[2])  # set end OC_CAUSE=1 for full backtrace
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/omegaconf/dictconfig.py", line 367, in __getitem__
    return self._get_impl(key=key, default_value=_DEFAULT_MARKER_)
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/omegaconf/dictconfig.py", line 438, in _get_impl
    node = self._get_node(key=key, throw_on_missing_key=True)
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/omegaconf/dictconfig.py", line 470, in _get_node
    raise ConfigKeyError(f"Missing key {key}")
omegaconf.errors.ConfigKeyError: Missing key flow_feats_dir_path
    full_key: data.params.flow_feats_dir_path
    object_type=dict

I can post my conda list if needed, pytorch is running CUDA enabled and works fine with other projects (I guess).
Pytorch 1.9.1.post3
NVIDIA RTX3070
CUDA 11.2
Any idea what it might be?
Thanks in advance

Hi. I think I saw this error before. Can you confirm that your Omegaconf package has another version?

Hello. Indeed it has. I can try downgrading and check if it solves!
omegaconf                 2.1.1                    pypi_0    pypi

Ok. I also confirmed it myself on Colab just now. Please downgrade it and tell me how it goes.

Ok just did, got a different text with the FileNotFoundError:
device  cuda
Using: 2021-07-30T21-34-25_vggsound_transformer (5 ResNet50 Features)
3.68GB [02:10, 28.1MB/s]
Unpacking SpecVQGAN/logs/2021-07-30T21-34-25_vggsound_transformer.tar.gz to SpecVQGAN/logs
Traceback (most recent call last):
  File "/home/luis/Desktop/clip/scripts/test_both_libs.py", line 73, in <module>
    config, sampler, melgan, melception = load_model(model_name, log_dir, device)
  File "SpecVQGAN/feature_extraction/demo_utils.py", line 201, in load_model
    melgan = load_vocoder(ckpt_melgan, eval_mode=True)['model'].to(device)
  File "SpecVQGAN/sample_visualization.py", line 144, in load_vocoder
    vocoder_sd = torch.load(ckpt_vocoder / 'best_netG.pt', map_location='cpu')
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/torch/serialization.py", line 594, in load
    with _open_file_like(f, 'rb') as opened_file:
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/torch/serialization.py", line 230, in _open_file_like
    return _open_file(name_or_buffer, mode)
  File "/home/luis/anaconda3/envs/pytorch/lib/python3.9/site-packages/torch/serialization.py", line 211, in __init__
    super(_open_file, self).__init__(open(name, mode))
FileNotFoundError: [Errno 2] No such file or directory: 'vocoder/logs/vggsound/best_netG.pt'

Ok might this error related to the fact that I'm not running this inside the SpecVQGAN folder? Relative paths text problem. Just because vocoder/logs/vggsound/best_netG.pt is actually there.

this error related to the fact that I'm not running this inside the SpecVQGAN folder

💯

Considering as resolved.


Update VS refs in WPF topics

[ ] https://review.docs.microsoft.com/en-us/dotnet/framework/winforms/advanced/walkthrough-creating-new-wpf-content-on-windows-forms-at-design-time?branch=pr-en-us-7068
[ ] https://review.docs.microsoft.com/en-us/dotnet/framework/wpf/advanced/attached-properties-overview?branch=pr-en-us-7068
[ ] https://review.docs.microsoft.com/en-us/dotnet/framework/wpf/advanced/custom-dependency-properties?branch=pr-en-us-7068
[ ] https://review.docs.microsoft.com/en-us/dotnet/framework/wpf/advanced/walkthrough-hosting-a-3-d-wpf-composite-control-in-windows-forms?branch=pr-en-us-7068
[ ] https://review.docs.microsoft.com/en-us/dotnet/framework/wpf/advanced/walkthrough-localizing-a-hybrid-application?branch=pr-en-us-7068
[ ] https://review.docs.microsoft.com/en-us/dotnet/framework/wpf/advanced/walkthrough-mapping-properties-using-the-elementhost-control?branch=pr-en-us-7068
[ ] https://review.docs.microsoft.com/en-us/dotnet/framework/wpf/advanced/walkthrough-mapping-properties-using-the-windowsformshost-element?branch=pr-en-us-7068
[ ] https://review.docs.microsoft.com/en-us/dotnet/framework/wpf/app-development/how-to-add-a-splash-screen-to-a-wpf-application?branch=pr-en-us-7068

@gewarren I also added this to the current sprint project, and the current sprint milestone. That's how we report progress.


Wifi + BT radios switch

@Mixss You're also going to need to set the variable in DasharoSystemFeaturesRouteConfig like this: https://github.com/Dasharo/DasharoModulePkg/blob/7c37e848655b5b48038895e3064fa389675408ea/Library/DasharoSystemFeaturesUiLib/DasharoSystemFeatures.c#L857-L869

@miczyg1 Applied your suggestion

@mkopec these commits look terrible: https://github.com/Dasharo/DasharoModulePkg/pull/23/commits/1e5c9b6352811bec5cdd03d521b3bccbbf0a4bd0
https://github.com/Dasharo/DasharoModulePkg/pull/23/commits/4bd3a90e8c6317c7a364f2b7febd2bc3d4e593d6
Please squash them somehow

@mkopec these commits look terrible: 1e5c9b6 4bd3a90
Please squash them somehow

Probably all @Mixss changes should be squashed into b14ff7b4fa9a4126675dbc4cf2a8acb04f46183d

@miczyg1 rebased and squashed

@mkopec can't fast-forward, it seems durign the rebase your local main branch was outdated

NVM

@miczyg1 Yeah, rebased again and merged.


[R] read_parquet performs to slow

Describe the bug, including details regarding any error messages, version, and platform.
I have been using the read_parquet() function to read a file (compressed / uncompressed) from S3, but its too slow (700MB file to be read takes 10m). I tried setting the params:  arrow::set_cpu_count(2) & arrow.use_threads = FALSE, but still is slow.
For writing the same file it takes 1-2m which still is not the best.

Would you mind try some S3 config and, like pre_buffer config or env (like AWS_EC2_METADATA_DISABLED )?

i tried:
-Sys.setenv("AWS_EC2_METADATA_DISABLED" = "true"

file = read_parquet(bucket$path(s3_path),pre_buffer=true)
But this did not help

Hmmm would you mind print the metadata of the file metadata? I want to take a look at the info of file

How many rowgroups does this file containing? Since this will affect how the file is fetched

The file has only one row group

Another is that:
class PARQUET_EXPORT ArrowReaderProperties {
 public:
  explicit ArrowReaderProperties(bool use_threads = kArrowDefaultUseThreads)
      : use_threads_(use_threads),
        read_dict_indices_(),
        batch_size_(kArrowDefaultBatchSize),
        pre_buffer_(true),
        cache_options_(::arrow::io::CacheOptions::LazyDefaults()),
        coerce_int96_timestamp_unit_(::arrow::TimeUnit::NANO) {}

we have a cache_options, can you change this to ::arrow::io::CacheOptions::Defaults(). This could make s3 request runs concurrently.
read a 700MB file using 10min is too slow. This could be well optimized using different fetch options

The file i saved in S3, is rds. I used the above advices but still reading the file did not improve (still takes 10m)
Bellow is code:

s3_path="train.rds"
CacheOptions.lazy=FALSE
bucket = s3_init()  .. initialize S3 connection
file = read_parquet(bucket$path(s3_path),pre_buffer=TRUE)

Hmmm would CacheOptions.lazy=FALSE not affect the read_parquet internal?

i guess not as the time did not improve

Hmm can we find out a way to figure out how many io-request is sent to s3? And the range of the io? I just want to make clear how the io works 🤔. Since 10m is too long
And you may take a look at https://github.com/apache/arrow/issues/38032#issuecomment-1750334102 . I'm not familiar with R, but I guess the CacheOptions and prebuffer is a parquet of ParquetArrowReaderProperties, they might not filled in arguments?

i tried to filled the arg in the ParquetArrowReaderProperties, but is throwing errors. Also i can not find how many io-request are send. Having in mind that write function is working fine i assume the # io-rw can be irrelevant

Having in mind that write function is working fine i assume the # io-rw can be irrelevant

Hmmm you can use default argument firstly. Also cc @thisisnic for some advices, I'm not familiar with R 🤔

I changed to this function:
file = read_parquet(bucket$path(s3_path),pre_buffer=TRUE,as_data_frame=FALSE, .lazy=FALSE), and time improved by 1min, but still slow

S3 will allow a log setting, would you mind try to set this on ( maybe
related to https://github.com/apache/arrow/issues/35260 )?
So that we can see the defail for io-requests
kostovasandra @.***> 于2023年10月6日周五 18:48写道：

I changed to this function:
file =
read_parquet(bucket$path(s3_path),pre_buffer=TRUE,as_data_frame=FALSE,
.lazy=FALSE), and time improved by 1min, but still slow
—
Reply to this email directly, view it on GitHub
https://github.com/apache/arrow/issues/38032#issuecomment-1750397539,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AFZZCTHCABWBJPPTLW5AUDDX57OWBAVCNFSM6AAAAAA5T3YX22VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONJQGM4TONJTHE
.
You are receiving this because you commented.Message ID:
@.***>

As i can see there, nobody is providing clear instruction, is on PR and no other answer

Oh sorry for that. s3_init has a possible argument ArrowS3GlobalOptions, it allow setting s3 log level.

Can you be more specific on the write command please.
S3)init() works, sr_init with paramt you wrote does not work (param not recognized) . Tries s3_init("debug") does not work

@paleolimbot @thisisnic I'm not familiar with R, do you know how to set prebuffer argument and s3 logging in R S3 FS SDK?

...had time to implement that before 13.0.0!

Unfortunately, no. And I don't think we have a way to adjust log level from R at the moment. Just Python and C++.
To that point, I think it would be useful here if we could reproduce the same performance from Python (PyArrow) or Arrow C++ since we can set the log level in those environments and they're exercising similar code paths. Something like this should work:
import os

# Workaround from https://github.com/apache/arrow/issues/35575 until fixed
import pyarrow._s3fs
pyarrow._s3fs.initialize_s3(pyarrow._s3fs.S3LogLevel.Debug)

from pyarrow import fs

s3  = fs.S3FileSystem(
  region = "",
  access_key=os.getenv("ECS_ACCESS_KEY_ID"),
  secret_key=os.getenv("ECS_SECRET_ACCESS_KEY"),
  endpoint_override=os.getenv("ECS_S3_ENDPOINT_URL")
)

table = pq.read_table(os.getenv("ECS_S3_BUCKET") + "/path/to/object", filesystem=s3)

@kostovasandra would you be willing to give that a try for us? I think it'd be a big help here.

Hey, i have tries in Python and is taking 30s

In Python, Would you mind set pre_buffer=True for read_table. It will be true in 14.0.0, but still default false in 13.0.

I did it, and it takes 10s

Ok, what does the s3 debug logging looks like? Would it contains some info about how does it take 10s?

Hmm sorry for being confusion. This is a bit confusing because I don't know how many requests have send to s3, and how they looks like.
10s is an optimization, I think it's because Default prefetch driver works a bit better than Lazy, since it will try it best to send io requests. But I don't know how these requests takes.
I'm not so familiar with s3 SDK, so might take time to debugging, so sorry for that. would you mind enable TRACE as log level ( https://docs.aws.amazon.com/sdk-for-cpp/v1/developer-guide/logging.html and set initialize_s3(pyarrow._s3fs.S3LogLevel.Trace) ) ? I just want to know the io-merging status.
Sorry again for low efficient

With this exercise i confirmed that python performs better for reading from S3 than R. Could you maybe give advice on how to improve R functions

10s is an optimization, I think it's because Default prefetch driver works a bit better than Lazy, since it will try it best to send io requests. But I don't know how these requests takes.

I think they both use underlying C++ impl, but with different argument. R SDK should better has way to set the logging and CacheOptions... The performance is come from PreBuffer I think.

i inserted this: pyarrow._s3fs.initialize_s3(pyarrow._s3fs.S3LogLevel.Trace)
SO how i can see the log?

It would have some [INFO] [DEBUG] log on console ( since it use stdout as output )

Right, running pyarrow._s3fs.initialize_s3(pyarrow._s3fs.S3LogLevel.Debug) should immediately start printing to stdout. For reference, with pyarrow 13 I see:
Python 3.11.0 (main, Oct 26 2022, 04:18:06) [GCC 10.2.1 20210110] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import pyarrow._s3fs
>>>
>>> pyarrow._s3fs.initialize_s3(pyarrow._s3fs.S3LogLevel.Debug)
[INFO] 2023-10-10 21:06:50.573 Aws_Init_Cleanup [281473376709936] Initiate AWS SDK for C++ with Version:1.10.55
[DEBUG] 2023-10-10 21:06:50.573 FileSystemUtils [281473376709936] Environment value for variable HOME is /root
[DEBUG] 2023-10-10 21:06:50.573 FileSystemUtils [281473376709936] Home directory is missing the final / appending one to normalize
[DEBUG] 2023-10-10 21:06:50.573 FileSystemUtils [281473376709936] Final Home Directory is /root/
[INFO] 2023-10-10 21:06:50.573 Aws::Config::AWSConfigFileProfileConfigLoader [281473376709936] Initializing config loader against fileName /root/.aws/credentials and using profilePrefix = 0
// continues...

(You should not upload your keys to gh...)

@kostovasandra I deleted your comment - as @mapleFU mentions above, your keys were visible in it.  You may want to remove those keys and generate new ones to be extra safe though.

During read_Parquets as i mentioned i can not print it out because consist of secure data

Just want to know the number of IO and the time it costs per-io

The time is 27s & the number of records is 217035

Sorry, do you have any update on this?

I haven't got enough message, but I think it would help to allow config prefetching in R.

Hi @kostovasandra, thanks for the patience. Support for modifying the S3 log level was just merged so that should go into the Arrow 15 release. Until then, what could really help would be if you could give us a way to reproduce your issue ourselves. Is it possible to share the Parquet file or for you to write a script that generates a Parquet file that reproduces the issue that you could share?
I did a test with a 17million row (~600MB) Parquet file on S3 and I get almost the exact timing (~17sec) in either R or Python against us-west-2. So while tweaking Parquet reader options might help, it seems to me like some characteristic of your custom S3 endpoint or your file may be involved here.

Hey thank you for your answer. I can not share the file or reproduce the error, as the error is slow time of reading a file from S3.
Also, i am reading a .rds file (data frame in R), could you maybe try to test it on an .rds file.
Also can you give me others hints on how to tweak the read_parquet function?
I am not sure that url is problem as writting rds file works fine

DO you have update on this?

Hi @kostovasandra, a few thoughts:

Can you elaborate on how RDS is involved here? Looking at your code, I don't see any functions related to reading/writing RDS files, though I do see that your code uses the string 'rds' in a few places, despite using only read_parquet and write_parquet
Have you tried reading the file on other S3-compatible storage and possibly even from your local machine?
Without being able to turn on S3 logging at the moment, could you find some way to track how many packets and how much data is transferred during the 10 minutes?
Can you try any other files on the same storage or a subset of your whole file? I wonder if all reads are slow or if there's some pattern

The dataframes in R are .rds file. So i use the read_parquet / write_parquet function to read/write .rds file from S3.
Yes i tries do read from local, but the read_parquet function still performs slow/
During the 10 min ~700Mb file is transferred which is 217K rows
I tried on different files similar size  (to assure that file is not corrupted) but same result

Hi @kostovasandra, just for good measure can you give us your OS and arrow R package version?
Other things to try:

Do you get the same timing when you run read_parquet(..., as.data.frame=FALSE)
Do you get the same timing when you use open_dataset instead of read_parquet?

The Arrow version is 13.0.0. The OS version is : Debian GNU/Linux 10
I tried read_parquet(..., as.data.frame=FALSE) but i get same results, maybe 30s improvement.
Open dataset i did not try because its for reading multiple files from directory and is not my case

This is what i tried but i am getting error.

bucket = s3_init()
file = open_dataset(bucket$path("train_arrow.rds"))
Error in open_dataset():
! IOError: Error creating dataset. Could not read schema from 'train_arrow.rds/'. Is this a 'parquet' file?:

Could you send me how to read one parquet file using open_dataset?

I think the easiest thing would be to pass a URI for the file. You can construct the string for the URI following this pattern, replacing the appropriate values with your own:
open_dataset("s3://access_key:secret_key@yourbucketname/your_file.parquet?endpoint_override=yourendpoint")


Changes in SvelteKit adapter API

https://github.com/sveltejs/kit/pull/4934

fixed with<EMAIL_ADDRESS>and<EMAIL_ADDRESS>

Thank you 👍🏼


MANIFEST.in: Fix tests, add examples and docs

The tests depend on test/i3.config
examples and docs are helpful to redist to users.

:+1:


migrate to GitHub Actions from Travis CI, upgrade codecov

Summary
This is a PR that does a couple of things:

migrates the existing .travis.yml Travis CI to a pair of GitHub Actions (ci.yml and publish-gem.yml)

i replicate the allow_failures option using the same hack I implemented when moving to sorbet-coerce
in addition, I also now allow failures for rails 7. Let me know if we'd like me to revert that (it currently fails). I believe when Donald last set this up, Rails 7 was not out yet.

swap out the deprecated/inactive codecov gem for the new Action + required formatter
resolve new rubocop issues (since the repo doesn't pin rubocop, and has been out of date)

resolves autofixable spacing issues
changes the target ruby version in the gemspec to the "correct" format, explicitly sets it in rubocop config
temporarily disables Performance/RedundantBlockCall since its autofixes cause a coverage drop. If we like this PR, I'll open up a follow-up issue/PR to resolve.

I think technically this PR is ready to merge. However, I have a few questions:

are we okay with introducing the new allowed failures?
are we okay with disabling the Performance/RedundantBlockCall cop?

In addition, we'll have to set the GitHub Actions secret before publishing the next release.
Shoutout to @katyho for figuring out how to properly connect to the db with psql (I later converted this to only use env vars, so the end-user experience is the same).
Closes #100.

Just to jot down things I've tried:

setting postgres env variables when creating the DB and executing the rake task; have tried combinations of USER, PASSWORD, DB, and HOSTNAME for:

PG, i.e. PGPASSWORD
PG_, i.e. PG_PASSWORD
POSTGRES_, i.e. POSTGRES_PASSWORD

using a connection URL with psql, i.e. psql postgresql://[user[:password]@][netloc][:port][/dbname][?param1=value1&...] with either localhost or postgres as the host

Think we're all good now :) definitely will want to squash this one on merge.


Letters - not only a-z for non-english speakers

For us and our customers, "åäöæøðüþ" (among others) are perfectly legitimate letters in our alphabet. How can I include these in "letter CharacterSets" in a meaningful way? I tried setting up two CharacterSets like so:
      <Predicate Id="Lowercase" Method="IncludesCharacters">
        <UserHelpText>a lowercase letter</UserHelpText>
        <Parameters>
          <Parameter Id="CharacterSet">abcdðefghijklmnopqrstþuvwxyäæåöø</Parameter>
        </Parameters>
      </Predicate>
      <Predicate Id="Uppercase" Method="IncludesCharacters">
        <UserHelpText>an uppercase letter</UserHelpText>
        <Parameters>
          <Parameter Id="CharacterSet">ABCDÐEFGHIJKLMNOPQRSTÞUVWXYZÅÄÆÖØ</Parameter>
        </Parameters>
      </Predicate>

But it seems f.i. "ö" and "Ö" are regarded as the same character, and therefore both regarded as uppercase letters in this setup.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ddd28e85-f3db-fcf9-7b6b-c45fe9dfc9e6
Version Independent ID: 75e4906f-3704-e416-79df-3e1565e33ab6
Content: Configure password complexity using custom policies - Azure AD B2C
Content Source: articles/active-directory-b2c/custom-policy-password-complexity.md
Service: active-directory
Sub-service: b2c
GitHub Login: @msmimart
Microsoft Alias: mimart

Oh. And if you use the exact example given on this page, but change Uppercase and Lowercase CharacterSets to the list of characters in my example above, a password "12345678" will be deemed valid by the PredicateValdidation(?!), even though it does not contain any letters or symbols.
(But when hitting the continue-button, a non-informative error message "password input invalid" will pop up)

@moiiran Thanks for your feedback! We will investigate and update as appropriate.

@moiiran I have used your predicates logic and tried using two different passwords one with lowercase - ö and another with uppercase Ö and both are treated as different letters(one lowercase and another uppercase).  If I am trying to pass lowercase in case of uppercase or vice versa the password is not working and I am getting error when hitting the continue button.  I am also able to create a new password with both  Ö and ö as it is also valid combination of 1 upper and 1 lower alphabet.  Are you getting any error while using these characters ?

@moiiran We will now proceed to close this thread as we haven't heard back. If there are further questions regarding this matter, please reopen it and we will gladly continue the discussion.


use_field_init_shorthand option breaks numbered struct field initialization

If I have a struct type with an implicit field such as
struct MyStruct(u64);

And I attempt to initialize it to 0
let instance = MyStruct { 0: 0 };

With the option "use_field_init_shorthand = true", rustfmt will incorrectly shorten the initialization to:
let instance = MyStruct { 0 };

This code will no longer compile after running rustfmt.

Is there any reason in particular you're trying to initialize it that way instead of the more canonical:
let instance = MyStruct(0);

For anyone interested in working on this, think you'll probably want to start around the below. Likely just need to enhance the check to not fall into the shorthand mode if the field name is itself an invalid ident (e.g. 0)
https://github.com/rust-lang/rustfmt/blob/e041c20eed3eecc1f29468c19877d7a05ac576bc/src/expr.rs#L1721-L1723

Is there any reason in particular you're trying to initialize it that way instead of the more canonical:
let instance = MyStruct(0);

The other way is valid syntax of course and we should probably adjust the rule to handle this, but with a tuple struct you'd typically see the aforementioned syntax instead.

Ignorance!  The syntax I was using worked even though it felt clumsy.  Of course there’s a better way and now I know.  Glad I could identify the issue though.

No worries, and thanks for bringing it to our attention! It's something we should handle anyway, so better we know than not know and fortunately there's a readily available (and more idiomatic) option for folks in the interim

I would like to take this up if that's ok. Can you assign it to me?

Hi @calebcartwright, just wanted to validate the expectation here before implementing the fix and was hoping you could help. AFAIU if the name of the field is any literal (i.e. numeric values, quoted strings, etc.), we want to avoid falling into the short-hand mode?
If the above is true, I am thinking of converting the Ident (i.e. 0 in the example above) contained within ExprField into an AST Token via from_ast_token(ident: Ident) function. I will then check if the resulting Token is a literal by calling the is_lit() method. If it returns true, we do not fall in the short-hand mode, otherwise we follow the current code flow.
Please let me know if I am overcomplicating or have missed something obvious.


Fix for Immediate Closure Issue of ocrantemp.iss File

Ruby does not immediately close file descriptors when a File object is closed. This behavior led to ISCC reporting an error, stating that "another process is using the file." By setting the autoclose option to false when opening the file, the File object is closed immediately.
Reference: https://docs.ruby-lang.org/ja/latest/method/IO/i/autoclose=3d.html
The autoclose feature for File objects was added in Ruby 1.9.2, which was released in August 2010.

Thank you for your pull request. I read the documentation and I'm not sure if this is correct. Autoclose: false might actually not do anything here.
Is it possible that you run your script many times and it crashed once before closing? I agree that we should change it, but maybe to:
File.open('ocrantemp.iss', 'w') do |f|
  f.write(iss)
end

This will automatically close the file for you after writing to it. It is like writing:
f = File.open('ocrantemp.iss', 'w')
begin
  f.write(iss)
ensure
  f.close
end

Subsequently, when I tried the --innosetup option, I didn't encounter the "ocrantemp.iss file is being used by another process" error even with the code in its original state. In other words, it worked fine without any issues. However, after rebooting the PC, I started getting errors reported by ISCC. At this point, the error occurred even when the autoclose: false option was in place.
I'm completely stumped as to the cause. I've tried running it with all IDEs (RubyMine) closed and even from the command prompt, but the error is still reported by ISCC.
Based on these results, it seems that this pull request won't address the issue. Therefore, I'll close this pull request.
We'll need to consider an alternative approach to resolving this problem.


WIP

All tests pass locally but default docs route shows an error:

while the direct link works:

Both route through the (WIP) function
    static func documentation(req: Request,
                              documentationVersions: [DocumentationVersion],
                              reference: String,
                              archive: String?,
                              awsResponse: ClientResponse,
                              owner: String,
                              repository: String,
                              fragment: Fragment) async throws -> Response {

and I cannot figure out why one would fail but not the other. All input parameters except req are identical. I can't see what in req would cause the different behaviour.

Superseded by #2063


How to clear output (vim.out_write)

After getting input from neovim with self.vim.eval('input("Enter a value: ")'), if I echo the output with either self.vim.out_write or self.vim.command("echo"), it doesn't clear "Enter a value: " before echo-ing.
Example:

self.vim.command("redraw | echo") fixes your issue.

Thanks @Shougo! Closing the issue now.


[ETL][Lake] -  Update existing code to query database by using PersistentDataStore.query_data

Motivation

Review pds.query_data.
Consider not returning a polars lazy_frame but something else... perhaps a generic pointer where you can then do more with it.

DoD:

[x] Updated existing logic that queries data from PDS/SQL, to get a better pointer to the data
[x] When using polars/pandas, the usage should be stable
[x] Tests are updated and passing

This is done. Closing ticket. Any outstanding logic here should be written as a bug.


Great project! Bot suggestions

This is a fantastic project! Some bot ideas:

Bridge spam
Mirror opponents elixir costs
Change placement dependant on opponent placement and tower health
Reduce sample spaces of possible moves and/or apply approximate-KNN to chose a move

@Pbatch Could we train bot NN on top ladder replays?
It's a huge readily available dataset and replay syntax is already excellently minimalistic - only timestamp, unit played and coordinates.
Additionally, ideal play in any situation is going to be very consistent, so even a single replay would be enough to learn correct response to opponent play for those situations.

Wow I didn't even realize replays existed! I'm assuming you're talking about these: https://royaleapi.com/decks/ranked
Do you know if there's a nice way to download the output?
It is the most promising way I've seen so far to response to enemies.

Do you know if there's a nice way to download the output?

Yes, there is. Do you have a discord?

Have you managed to download some data? I yes, how large is your dataset?

@wordpad25 PBatch#6429 is my Discord. @candlelightner we are working on it! No data yet :)

@wordpad25 PBatch#6429 is my Discord. @candlelightner we are working on it! No data yet :)

I might be able to help out.

@candlelightner awesome work! could you share your discord, so we could
collaborate on this?
I will share my dataset.
On Thu, Feb 2, 2023 at 10:39 AM candlelightner @.***>
wrote:

I am currently training my models (one CNN for card prediction, accuracy
around 36% for 110 cards, one MLP for calculating the position and time for
a given card to be played (Currently undergoing training, but I already
have 7% here after a few (~5, batch size ca. 500 moves)) epochs).
I am excited to try it out as soon as I have a more sensible accuracy
concerning the placement.
The only thing that I am worried about is the performance, since I use
quite large models that I train on the cloud. On the other hand, I only
have access to CPU-computing instances, so I should be fine. I can send
you some code, or the checkpoints privately, if needed.
—
Reply to this email directly, view it on GitHub
https://github.com/Pbatch/ClashRoyaleBuildABot/issues/11#issuecomment-1413942860,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ASSFEOGBWASP5HUVTNUIPKDWVPIKZANCNFSM5OFZZT5Q
.
You are receiving this because you were mentioned.Message ID:
@.***>

I sent you a request.

my discord is igor_#5314
On Thu, Feb 2, 2023 at 11:31 AM candlelightner @.***>
wrote:

I sent you a request.
—
Reply to this email directly, view it on GitHub
https://github.com/Pbatch/ClashRoyaleBuildABot/issues/11#issuecomment-1414025958,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ASSFEOADGJZYHUVJ44DE2W3WVPOPJANCNFSM5OFZZT5Q
.
You are receiving this because you were mentioned.Message ID:
@.***>

Do you guys have a dataset yet? I've been working on a model and (probably) have access to GPUs. Let me know - I can share my discord.

Share your discord with me if you don't already have the dataset.

Totally lost track of this at some point. But I'm still interested - discord is noahhw46#6161

Share your discord with me if you don't already have the dataset.

gala#3520 my discord i have high end gpus for training and ready to help

@wordpad25 PBatch#6429 is my Discord. @candlelightner we are working on it! No data yet :)

Hello, I am inerested on the replay data becasue. Did you make any progress?

@wordpad25 PBatch#6429 is my Discord. @candlelightner we are working on it! No data yet :)

Hello, I am interested on the replay data. Did you make any progress?

No, I failed at sending the inputs to the game.


CI: Move swifthelloworld to use Engflow's remote execution

Description:
Move swifthelloworld to use Engflow's remote execution.
TODO: Add results in the description once they actually run
Risk Level: Low
Testing: Manually tested
Docs Changes: N/A
Release Notes: N/A
Signed-off-by: Luis Fernando Pino Duque<EMAIL_ADDRESS>

/cc @ulfjack @goaway


missing the required key: CFBundleShortVersionString & CFBundleVersion not defined

Since upgrading to Flutter 1.20.3 i can build without issue but not publish to the apple store:
App Store Connect Operation Error
ERROR ITMS-90057: "The bundle 'Payload/Runner.app/PlugIns/Share Extension.appex' is missing plist key. The Info.plist file is missing the required key: CFBundleShortVersionString. Please find more information about CFBundleShortVersionString at https://developer.apple.com/documentation/bundleresources/information_property_list/cfbundleshortversionstring"

App Store Connect Operation Error
ERROR ITMS-90056: "This bundle Payload/Runner.app/PlugIns/Share Extension.appex is invalid. The Info.plist file is missing the required key: CFBundleVersion. Please find more information about CFBundleVersion at https://developer.apple.com/documentation/bundleresources/information_property_list/cfbundleversion"

despite having a Info.plist for the extension that contains the correct variables:
	  <key>CFBundleShortVersionString</key>
        <string>$(FLUTTER_BUILD_NAME)</string>
        <key>CFBundleVersion</key>
        <string>$(FLUTTER_BUILD_NUMBER)</string>

I manually set the values instead of the variables and it works but any idea how to fix that more "cleanly"?

any updates?

I have the same issue.

Same issue here

same issue here !! anyone have solved this issue ??

I solved with https://github.com/flutter/flutter/issues/71262#issuecomment-736154319


Fix AMD64 reference in requirements

Change all occurrences of "AMD64 processor" to "x86-64"

Backlog OS item
Terminology approved by Casey
Merge to nightly

Deploy preview for calico ready!
Built with commit 47c0f545c64f3cba10842db067f4d72ccd455ed4
https://deploy-preview-3261--calico.netlify.com


The add page button should be slightly right side in the mobile view.

Bagisto Version: Master
Steps To reproduce--
1. Log in as an admin on mobile.
2. Click on pages inside the CMS tab.
3. Try to add a new page.
Device name: iPhone SE
Expected result: The add page button should be slightly right side in the mobile view.
Actual result: The add page and export buttons are overlapping in the mobile view. Please find the screenshot Here

@Sanjaybhattwebkul  please assign

I'd like to work on this issue

Hey @Sanjaybhattwebkul assign this to me I'd like to work on this issue

@Sanjaybhattwebkul This Issue Fixed in #6827 PR. Please check it out
Thanks


Password.Reset is not defined on Custom Forgot Password sending link **API

Laravel Version: 9.2
PHP Version: 8.0.2
Database Driver & Version: MySql

Description:
I created a function called 'forgot-password' through api where user would be able to request reset link that will be send on their inputted email.

Im expecting it would go through like successfully if the email attribute is not null and existing in database, but I encounter error that password.reset route is not defined.

Did I make mistake on user password::sendResetLink ?
My last option would be customizing the sending of password reset link like Mail::send().
Steps To Reproduce:

Hi there,
Thanks for reporting but it looks like this is a question which can be asked on a support channel. Please only use this issue tracker for reporting bugs with the library itself. If you have a question on how to use functionality provided by this repo you can try one of the following channels:

Laracasts Forums
Laravel.io Forums
StackOverflow
Discord
Larachat
IRC

However, this issue will not be locked and everyone is still free to discuss solutions to your problem!
Thanks.