PLAT-354: Add delegationToken to outgoing messages in SMExecute

- What I did
Added delegationToken to outgoing messages in SMExecute
- How I did it
Fill field in outgoing messages from field SMExecute
- How to verify it
- Description for the changelog

https://insolar.atlassian.net/browse/PLAT-354

make sure to check - this is the opposite side of adding delegation token
https://github.com/insolar/assured-ledger/pull/319

@cyraxred I am not sure, what I understand your point? Explain please)


pull request for e2e test at 01/09/2017 01:56:10

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


DEC-1158: Render Media

-Honeycomb now renders a "media" object with a type instead of an "image" or "multimedia" object. Changed the renderers to support this
-Also fixed a few problems with mapping hits to items in the search store. Hits always have thumbnails, regardless of type, so we don't need to do this mapping. I'd also prefer this not give the illusion that it is an item, when it actually is just a hit.

👍

👍


How to use Audit with ASP.NET Identity

Any suggestions on the best way to hook up the Audit framework with ASP.NET Identity?

Ok, I think I can follow the instructions in this section "Saving automatically by overriding SaveChanges & SaveChangesAsync" of this wiki page Entity Framework Audit Trail Context and Track Changes.
Any other thoughts?
Thanks
marc

Upon reviewing the section  "Saving automatically by overriding SaveChanges & SaveChangesAsync", it seems to me that you need to have the DbSets for AuditEmtries and AuditEntryProperties in the same DbContext as where the SaveChanges and SaveChangesAsync are being overridden.
Is that correct?

Hello @mhsimkin ,
You are right. If you use code first and your context is named "EntityContext", you need to add AuditEntries & AuditEntryProperties (or whatever you name it) DbSet to your context.
Also, you need to cast the context as "EntityContext" instead of "TestContext" as you said.
Let me know if you successfully implement it.
Best Regards,
Jonathan

Hi Jonathan, that is what I thought.  I've coded it, just haven't tested it yet.  I have another question.
I have 3 different DBContext classes in  use, ASP.NET Identity, Identity Server Clients, and Identity Server Scopes.
I can inherit the DBContexts for each one, but is there a way to make the AutoSavePreAction unique for each context?  Could I make it work with an Interface something like:
public interface IAudit {      IDbSet<AuditEntry> AuditEntries { get; set; }      IDbSet<AuditEntryProperty> AuditEntryProperties { get; set; } }
Then code the AutoSavePreAction as
AuditManager.DefaultConfiguration.AutoSavePreAction = (context, audit) => {     (context as IAudit).AuditEntries.AddRange(audit.Entries); }
If not, I guess I will just use an if statement in that block of code to choice the correct context.
Thanks
marc

Yes, an Interface will work.


[Gluten-core][VL] Supports Delta Lake Read

What changes were proposed in this pull request?

Supports Delta scan in Velox .
Delta 2.x supports Column Mapping, which is also supported in this PR.
Not support DeletionVector that is a new feature after Delta2.3

(Fixes: #ISSUE-2891)
How was this patch tested?
TPC-DS test

@Shirosakirukia, do you know why Delta doesn't just work as it is implemented as an extension of ParquetFileFormat?
For me it is not clear why some things work, for example it scans the correct set of Parquet files, instead of all the files in the folder, but some other doesn't.
You are re-implementing column mapping here, ideally, we shouldn't duplicate Delta implementation as it would be impossible to maintain it, and it would also miss many other features: optimize command, DV, reorg command, optimize write, auto compact, invariants, check constraints, etc.

@felipepessoto We need to distinguish between these features (including OSS Delta or databricks Delta) and identify which ones need gluten/velox support. For example, some features related to optimize (auto-compaction, optimize write), is to redistribute data to files, and constraints only affect whether the coming data meets these constraints and how to deal with unqualified data. So IMO, these features don't need to taken int account when make gluten/velox supports DeltaLake.
While these features, like column-mapping and DV need. But the two features are still different. Essentially, column-mapping is just a mapping between table schema and file schema, So we can append ProjectExec before FileScanExec (as this pr) to make the native ParquetScan work for Delta Scan.
For DV, it's more complicated. Theoretically, we also transform Deletion Vector to a FilterExec that maybe has a bitmap, and put it before FileScanExec, but this is not a good way and also affects reading efficiency. So I prefer a solution that make velox to support DeltaScan with DV.

@felipepessoto Based on this, we prefer to support Delta Column Mapping by rewriting plan. and support DV by velox supporting DeltaFileFormat later on.

@zhouyuan may you take a look please.

The Iceberg PR's can also provide some ideas:
Gluten
https://github.com/oap-project/gluten/pull/3043
They implemented it differently, instead of changing FileSourceScanExecTransformer.scala to return ParquetReadFormat, they changed BatchScanExecTransformer.fileForma to return ParquetReadFormat (or ORC in their case).
I wonder if we could use a simple approach for both cases. Idk which one is better though
Velox
https://github.com/facebookincubator/velox/issues/5977 - https://github.com/facebookincubator/velox/pull/5897

@felipepessoto
I know the https://github.com/oap-project/gluten/pull/3043. The key reason why the two pr implementations are different, is not the lake format (one for deltalake, one for iceberg), but the spark datasource interface used. DeltaLake uses Spark DS V1, while Iceberg uses Spark DS V2.
For spark datasource v2, we are working to provide a better design that should have a generic interface in gluten to support the datasources used spark DS v2, and a nice framework as @liujiayi771 said in https://github.com/oap-project/gluten/pull/3043#issuecomment-1709764189.
Look forward to your reply a lot.

Got it. I don’t have much to add here. Just started with Gluten and still learning it.
Hope to see this merged soon as I use mostly Delta table.

@Shirosakirukia build is failing. Any idea why it can't find Delta classes? Maybe you need to specify the version to use Delta 2.2.0, which is compatible to Spark 3.3
java.lang.NoClassDefFoundError: org/apache/spark/sql/delta/DeltaParquetFileFormat
at io.glutenproject.extension.RewritePlanIfNeeded.io$glutenproject$extension$RewritePlanIfNeeded$$isDeltaColumnMappingFileFormat(ColumnarOverrides.scala:70)
at io.glutenproject.extension.RewritePlanIfNeeded$$anonfun$apply$1.applyOrElse(ColumnarOverrides.scala:63)

@felipepessoto Sure. Gluten-core build was successful with no functional issues. The error message indicates that the velox-backend test is unable to recognize the DeltaParquetFileFormat class. @YannByron  May you take a look please?

I will take over this pr soon, maybe open another to address the failure of CI, and add some UT.


fix: works when Gitlab runner is not at the same machine as Gitlab

Hello,
Thank you for this great product.
This little patch fixes the following issue with Gitlab integration:
Currently, it uses localhost to communicate with GitLab via API.
While in most real-life installations, gitlab runners and gitlab itself run on different machines,
So, localhost does not work.
Fortunately, gitlab has a special environment variable with its url.
The patch uses it. The patch was tested in a real environment.

Hey thanks very much for your contribution. I love the better GitLab implementation. Unfortunately, I can't merge it as is.

Please can you clean up the readmes?
If you no longer want to show the emoji summary can you add it as a flag to switch it off?
Similar to showing all reviews. This should be a flag. Imagine changing 30 files. It will become unreadable.
Removing the decoding of the answer means that whenever there is a code block suggested, that feedback will fail. This is not the desired functionality.

Many thanks, Matt

Sorry.
I intended to send only the first commit (which fixes one bug) not all 3 (with a lot of changes).
Please close this PR and I will send new with the only required things.
I guess I will send 2 PRs - one with the bug fixes and another one with the gitlab staff.
I will not touch emoji and other things.
Will it be okay?

I still cant merge this. Please can you check the diff.

Any news about this? It would be great to have a better Gitlab integration. Thanks!

Any news about this? It would be great to have a better Gitlab integration. Thanks!

Sorry, I am really too busy now :(
I keep it in mind.
Also, feel free to just get any code you find useful


update mongoose/mongoose.d.ts

mongoose ODM is already on 4th version, but here in repository it still on 3rd

@PLEEROCK please send a PR. I'll review it.

+1

+1


Ignore tests of packages that are checked out during deployment

PG1#498 is running

Per @jasonpet this is temporary and will be corrected from the push-notification test suite. Should we hold off?

Files are not copied anymore.


Marp 1.0.0 and current version

It seems that the active development of this Marp version stopped somewhere in summer 2016. No pull requests were accepted since there and it seems that the main contributer does not want to provide any updates for Marp 0.x.
There is an entry in the Marp wiki about the roadmap to version 1.0.0 which looks quiet impressive. However, there is neither public code to find somewhere no any more information about the progress of Marp 1.0.
Does anyone have any idea when we'll get the first "pre-release" of Marp 1.0 and if the main contributer is still working on that?

What a pity.

That really is a shame.
Hm, I've been poking through the codebase - it's really not that much code, so I'm thinking about:

Porting it to TypeScript - I find that CoffeeScript is really difficult to navigate, even a small codebase like this.

Make it run in the browser - the process of building from sources to a binary application is a clumsy extra step that slows down development.

Is there any practical reason this needs to be a desktop application?
The only application-feature it seems to have is PDF export, but there would be ways around that.
Loading and saving files? Meh, let's make it read/write gists on Github instead.
I think once the codebase is browser-based and modern ES6, and we remove the clunky build-step and make it easier to iterate on the code, it'll be easier and faster for most people to work with - maybe then more people will be interested in collaborating further on this?

AFAIAC, I often work during my commute, and this usually means without internet connection. And even when then I'm not committing, I'm often working in offline context, so a desktop a fixation bas a lot of value for me as it let's me work even without a access to the internet.

Use MARP in classroom environment with younger kids and their stations are not allowed internet access. If could not load and save files locally, would not be able to use MARP...

I agree with @xgouchet and @oleteacher. I need desktop functionality as well.

Note that @yhatt is actively working on
https://github.com/yhatt/markdown-it-incremental-dom
AFAICS that's going to be a core component of the next release of Marp.

I need desktop functionality as well.

offline-first then, hmm?

Now we are following https://github.com/yhatt/marp/issues/174#issuecomment-294577169. Marp Next is developing by TypeScript (except Marpit) and the main interface will become Marp Web. The future of desktop version would just be wrapping Web interface.
I had the suspicious look for TypeScript and PWA 2 years ago, but now I'm betting to them. If you still have a worry to offline usage, try Marp Web (demo). It can use offline after the first access.
Appendix: markdown-it-incremental-dom was a training of JS package for mine. Now I have decided changing the policy to use more grown VDOM like React or Vue.


Can not open dir content on treemap view

It seems like the directory tree next to the treemap in storage device details does not allow to go deeper than 3 levels in the tree.
I found that this is hard coded in the function where the treemap is created, I just don't know if ithis is intentional.

I wouldn't call this an issue, but rather a limitation. Its done that way because scanning the entire content of a disk drive can take a LOT of time depending of the content of the drive.  I found a crate that recursively path the tree usgin parallelism, the plan is to use that and then cache the tree so the device is not scanned from start everytime the user open that view.


Initial Draft Pathfinding Sample

Initial draft PR for Pathfinding Example .cpp and .uassets.

I might setup the pathfinding process as an observer and make better use of tag switching.

Yeah, ill prob fix that, i think its more inline with ECS.

Awesome job making new statetree tasks/evals!!!
A few initial questions after I skimmed it (I might be totally off the mark though so bear with me):

What's the A* for in there? Does ZG path follow not already do some navigation? Or is it just to draw the debug lines on the path?
FZoneGraphPathTestFromFragment has a TMap. We aren't really certain if putting dynamically sized things on fragments is okay or not. I guess it would be allocated outside?
Does the LODSync actor component on `BP_MassAgentCrowdCharacter' do anything? I can't see how it connects to Mass in any way.
How viable do you think it would be to have MASS AI just use the regular navigation mesh? Personally I would be happy with something just translating the existing actor nav stuff to Mass StateTree for starters.

Thanks for takin a look,
I haven't touched anything for a bit, but I am aware of 1,2 things with the ECS processors setup that I might want to change and fix.
I ended up typing alot, some of this stuff is weird so i listed things.

TMap<int, int>
The TMap thing didn't even cross my mind, probably because I didn't realise anything was breaking when I ran it. The first thing that I think of would just be to externalize the values completely and have the fragment point to it, but that almost feels a bit wrong to me, mabye i could have like a TStaticArray im not sure yet, if you know of an elegant way / the right place to stick them.

ZG Path
This one was wierd to understand the short answer is no. No pathfinding to a target.
Long answer is:
ZG follow takes a target location fragment, witch is basically only defines 1 Lane + LaneLink(used to define interlane connections (right, left, dest handle, index: 5, ect...)) to the next lane. With the defualt setup the system has caching and a 1-2 lane combined range. This works fine for what they have currently, which is basically run away logic. The use of annotations (tags on lanes) indicate distubance eg: UZoneGraphDisturbanceAnnotationBPLibrary and then they create a mask of the tag (the filter parameter in the FindEscapeTarget zone graph) and calculate a wieghted graph (CalculateEscapeGraph) and then return a 1(1.5) lane length escape path, and return that for the FollowPath to use, then after that if the character guy is still in the disturbance area just do it again.
There is a StateTree Task that i made that debug draws the current target location of the followpath target MSShowLanePositionTask.

A*
Short:
There is no logic for pathfinding for AI, the A* is used for both pathfinding and debug.
Long:
There is an A* pathfinder wrapper in the zonegraph that I connected to the find path proccessor i setup, any algoithem can be used, initially for testing I used a quick and lazy DFS algo, its still there and works, it can be uncommented (i might add a boolean for the DFS or something to switch just because the DFS is front and center and simple to skim and it makes it easier to focus on the Mass stuff without having to worry about diving into the wacky zonegraph wrapper of a generic templated A* inside the engine to check for hidden stuff).

A* default thing
A* So with the A* there is no current implementation in the AI behaviour for proper long range pathfinding (within the StateTree it self). However I did find a pathfinding implementation (the A* wrapper used) that was in ZoneGraphTestingActor its a defualt testing actor and you can actually see the A* if you drag 2 of them into a level set the OtherActor values to point to each other and tick the show path box (move them around a bit the updating is funky).

The BP_MassAgentCrowdCharacter the LODSync thing is not really functioning in the current thing, the LOD sync thing was internded for the kind of meta crowd character stuff, It should be fine to remove as there is already an LOD trait that deals with simple stuff like this. There are a couple other bits (some traits) that could be shaved off.

The MassNavigation module has some avoidance, steering stuff, and it works with the other modules to create a kind of half, localized navigation with ZoneGraph anvigation (uses obstical grid) with a point based pathing system that is used to move along lanes.
I have messed around with the nav stuff in ue4 before, and I think it would actually be nice to link the defualt nav setup and ECS. There is a lot similar logic between the two nav systems traversal (grids (hashGrid), path linking, avoidance) and the actions would align well. I dont think thats a coincidental, prob based on it.
I havent looked deeper into StateTree stuff, but from what i can tell it looks like it could be done, I dont think it would be hard. But I do think I would take a lot of time, it sounds like a whole project, I wouldent be suprised if Epic intends on doing that exactly. The inbuilt AI stuff already has similar kinds of optimization to stuff in zone graph, and the state tree
Normal Nav mesh -> StateTree Plugin -> Mass StateTree stuff
Normal Navmesh AI:

I think definantly possible, would take a fair bit (mabye alot) of work though (normal nav interfaces can be frustrating to work with in my experience).
Not something that I would do at the moment.

Honestly you've got me thinking about setting up the statetree with nav mesh now, not just to link up with stuff like ECS. But because the old Behaviour tree -> StateTree would be so nice...

Cancelling PR, haven't been able to update.
There is other relevant content.

I have closed PR, have not had time to update.


fix: expedite the sync'ing of shared key

- What I did

expedite the sync'ing of shared key to prevent the decryption failure of initial notifications. Notifications received before the shared_key is sync'ed to cloud secondary.

- How I did it
- How to verify it
- Description for the changelog

The functional test failed because the when directly writing the key to remote secondary, the sync process tries to decrypt the data( Since the data will be encrypted on client side). Since this particular key is not encrypted, getting invalid pad block issue in functional tests.
Attaching the error from functional tests:
  SEVERE|2022-09-01 10:36:00.402183|EncryptionUtil|Error while decrypting value: Invalid argument(s): Invalid or corrupted pad block

  SEVERE|2022-09-01 10:36:00.402429|SyncService|exception syncing entry to local {atKey: @bob🛠:shared_key@alice🛠, value: dJjqrOJFncoceBU15hi8ASLNco+SE4xtJwmFFQSsaUBmeUDNi8BX3/kE5VTG7ltwRnfb6wHMnxwwmlB/AfvzDeK+NZWIzy+Y5J3qSKoaBB8nGmqmOKxUehJ/uw+enrH1IMorOe8zO0Edn10VYGDJWGJJckYi7WkLo0yx09+6QuZ3C+GVHxM53YXFlQLesSh+C4RFs+0EKfJ3O3NMaICoJVuI0Uuw6g9QBkuDDZP0d7DrndEpp0kJdXnwCrwwUDYA/0KvzcXK5qDIXGLfm49RWJlp5LRhUrcUpIl2dyZ+8OpwVvvdsUvh55uw57JREncPYpMYoN0jJ6d3VgTMxyKTsA==, metadata: {createdAt: 2022-09-01 10:35:56.346Z, updatedAt: 2022-09-01 10:35:56.346Z, availableAt: 2022-09-01 10:35:56.346Z, refreshAt: 2022-10-16 10:35:56.346Z, status: active, version: 0, ttl: 0, ttb: 0, ttr: 3888000, ccd: false, isBinary: false, isEncrypted: false}, commitId: 5, operation: *} - Failed to decryptData caused by
  Invalid argument(s): Invalid or corrupted pad block

Closing the PR for now.


The current Dart SDK version is 2.4.0.

pub global activate get_cli
Resolving dependencies...
The current Dart SDK version is 2.4.0.
Because get_cli <1.3.16 depends on recase >=3.0.0 which requires SDK version

=2.6.0 <3.0.0, get_cli <1.3.16 is forbidden.
So, because get_cli >=1.3.16 requires SDK version >=2.7.0 <3.0.0 and pub
global activate depends on get_cli any, version solving failed.

update their version of the dart


proxy: detect TCP socket hang ups from client or server

Closes #434

I think we've already solved this in linkerd-tcp, so we can probably reuse that.

Oh awesome! This is definitely what I meant, that we write our own future instead of using Copy.
The comment I included suggests that this situation is rare. In your experience, is my comment incorrect?

OK, new commit, completely removing the caveat, and implementing our own Duplex future which should detect and forward shutdowns.

@briansmith I split the Duplex into two HalfDuplexes in such a way that a lock wasn't actually needed, and put distinct operations in separate methods. Hopefully it's much clearer what is happening.

I've combined the is_eof into an Option<CopyBuf>. Personally, I'm not sure that it's much better, and dropping the buf on eof was tricker thanks to mutable borrows. Still, I suppose its nice that the memory is freed sooner.
As for the shared buffer: I left it as a TODO. It does seem neat, but its also pretty easy to mess up, and the more-obvious way of doing it can result in accidentally copying bytes from the wrong connection, in the case that a copy was not saved. And the compiler wouldn't be able to catch that.
Having a safer version that the compiler could catch is less obvious, but I think investing in it should probably be done when metrics show that it would have a worthy impact.


remove HACBS prefix from parse_test_ output L87

The change in the utils file looks good, all occurrences of the function call in the unit tests as well as self tests files will also need to be updated to use the new name.
The gitlint check is failing because the commit message needs to follow the conventional commit format and the commit needs to also be signed.

Closing in favor of #109


TF2rc Simple model subclass with Gradient tape error when transformed with autograph

Please make sure that this is a bug. As per our GitHub Policy, we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:bug_template
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): No
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): https://colab.research.google.com/github/tensorflow/docs/blob/r2.0rc/site/en/r2/tutorials/quickstart/advanced.ipynb
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
TensorFlow installed from (source or binary): TF2RC binary
TensorFlow version (use command below): TF2RC
Python version:
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version:
GPU model and memory:

You can collect some of this information using our environment capture
script
You can also obtain the TensorFlow version with: 1. TF 1.0: python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)" 2. TF 2.0: python -c "import tensorflow as tf; print(tf.version.GIT_VERSION, tf.version.VERSION)"
Describe the current behavior
A simple toy example using Gradient tape and a subclass-model cannot be transformed into a graph with Autograph.
Error: could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, export AUTOGRAPH_VERBOSITY=10) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4
Describe the expected behavior
The use of @tf.function should correctly create Autograph
Code to reproduce the issue
Please, run
https://colab.research.google.com/github/tensorflow/docs/blob/r2.0rc/site/en/r2/tutorials/quickstart/advanced.ipynb

try:
%tensorflow_version only exists in Colab.
%tensorflow_version 2.x
except Exception:
pass
from future import absolute_import, division, print_function, unicode_literals
import tensorflow as tf
from tensorflow.keras.layers import Dense, Flatten, Conv2D
from tensorflow.keras import Model
mnist = tf.keras.datasets.mnist
(x_train, y_train), (x_test, y_test) = mnist.load_data()
x_train, x_test = x_train / 255.0, x_test / 255.0
Add a channels dimension
x_train = x_train[..., tf.newaxis]
x_test = x_test[..., tf.newaxis]
train_ds = tf.data.Dataset.from_tensor_slices(
(x_train, y_train)).shuffle(10000).batch(32)
test_ds = tf.data.Dataset.from_tensor_slices((x_test, y_test)).batch(32)
class MyModel(Model):
def init(self):
super(MyModel, self).init()
self.conv1 = Conv2D(32, 3, activation='relu')
self.flatten = Flatten()
self.d1 = Dense(128, activation='relu')
self.d2 = Dense(10, activation='softmax')
def call(self, x):
x = self.conv1(x)
x = self.flatten(x)
x = self.d1(x)
return self.d2(x)
Create an instance of the model
model = MyModel()
loss_object = tf.keras.losses.SparseCategoricalCrossentropy()
optimizer = tf.keras.optimizers.Adam()
train_loss = tf.keras.metrics.Mean(name='train_loss')
train_accuracy = tf.keras.metrics.SparseCategoricalAccuracy(name='train_accuracy')
test_loss = tf.keras.metrics.Mean(name='test_loss')
test_accuracy = tf.keras.metrics.SparseCategoricalAccuracy(name='test_accuracy')
@tf.function
def train_step(images, labels):
with tf.GradientTape() as tape:
predictions = model(images)
loss = loss_object(labels, predictions)
gradients = tape.gradient(loss, model.trainable_variables)
optimizer.apply_gradients(zip(gradients, model.trainable_variables))
train_loss(loss)
train_accuracy(labels, predictions)
@tf.function
def test_step(images, labels):
predictions = model(images)
t_loss = loss_object(labels, predictions)
test_loss(t_loss)
test_accuracy(labels, predictions)
EPOCHS = 5
for epoch in range(EPOCHS):
for images, labels in train_ds:
train_step(images, labels)
for test_images, test_labels in test_ds:
test_step(test_images, test_labels)
template = 'Epoch {}, Loss: {}, Accuracy: {}, Test Loss: {}, Test Accuracy: {}'
print(template.format(epoch+1,
train_loss.result(),
train_accuracy.result()*100,
test_loss.result(),
test_accuracy.result()*100))
Reset the metrics for the next epoch
train_loss.reset_states()
train_accuracy.reset_states()
test_loss.reset_states()
test_accuracy.reset_states()

Other info / logs
Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.

@fgr1986 ,
Given code worked with TF-2.0rc1 without any issue's, please take a look at the gist of colab. Try running the code in TF-2.0rc1

Hi @oanush , just reproduced the problem with ' 2.0.0-rc1'. Please, note that the error is a warning, (it continues execution but it does not correctly pass the autograph function.
You can see the issue putting ' print(tf.version)' in https://colab.research.google.com/github/tensorflow/docs/blob/r2.0rc/site/en/r2/tutorials/quickstart/advanced.ipynb

@fgr1986 ,
I tried again and I did not face and error for TF-2.0rc1. Let us know exactly what warnings are received.

Hi @oanush .
I do not know where the problem to reproduce the issue may be.

Right now, I just opened: https://colab.research.google.com/github/tensorflow/docs/blob/r2.0rc/site/en/r2/tutorials/quickstart/advanced.ipynb
Added import tensorflow as tf print(tf.__version__)
Which reports version 2.0.0-rc1

Changed the runtime to GPU

Run all, and get the following warnings:

WARNING:tensorflow:Entity <function train_step at 0x7f47c59bb268> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Str'
WARNING: Entity <function train_step at 0x7f47c59bb268> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Str'
WARNING:tensorflow:Layer my_model is casting an input tensor from dtype float64 to the layer's dtype of float32, which is new behavior in TensorFlow 2.  The layer has dtype float32 because it's dtype defaults to floatx.

If you intended to run this layer in float32, you can safely ignore this warning. If in doubt, this warning is likely only an issue if you are porting a TensorFlow 1.X model to TensorFlow 2.

To change all layers to have dtype float64 by default, call `tf.keras.backend.set_floatx('float64')`. To change just this layer, pass dtype='float64' to the layer constructor. If you are the author of this layer, you can disable autocasting by passing autocast=False to the base Layer constructor.

WARNING:tensorflow:Entity <bound method MyModel.call of <__main__.MyModel object at 0x7f47c59f7390>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4
WARNING: Entity <bound method MyModel.call of <__main__.MyModel object at 0x7f47c59f7390>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4
WARNING:tensorflow:Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0x7f47c4994c80> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'
WARNING: Entity <function Function._initialize_uninitialized_variables.<locals>.initialize_variables at 0x7f47c4994c80> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Num'
WARNING:tensorflow:Entity <bound method MyModel.call of <__main__.MyModel object at 0x7f47c59f7390>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4
WARNING: Entity <bound method MyModel.call of <__main__.MyModel object at 0x7f47c59f7390>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4
WARNING:tensorflow:Entity <function test_step at 0x7f47c59bb9d8> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Str'
WARNING: Entity <function test_step at 0x7f47c59bb9d8> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: module 'gast' has no attribute 'Str'
WARNING:tensorflow:Entity <bound method MyModel.call of <__main__.MyModel object at 0x7f47c59f7390>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4
WARNING: Entity <bound method MyModel.call of <__main__.MyModel object at 0x7f47c59f7390>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4
WARNING:tensorflow:Entity <bound method MyModel.call of <__main__.MyModel object at 0x7f47c59f7390>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4
WARNING: Entity <bound method MyModel.call of <__main__.MyModel object at 0x7f47c59f7390>> could not be transformed and will be executed as-is. Please report this to the AutoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: Bad argument number for Name: 3, expecting 4

Thanks

@fgr1986 I ran it in 2.0.0rc2 with GPU (as mentioned by you) and it runs without any issue. Please check the gist here.
Here is the error trace
WARNING:tensorflow:Layer my_model is casting an input tensor from dtype float64 to the layer's dtype of float32, which is new behavior in TensorFlow 2.  The layer has dtype float32 because it's dtype defaults to floatx.

If you intended to run this layer in float32, you can safely ignore this warning. If in doubt, this warning is likely only an issue if you are porting a TensorFlow 1.X model to TensorFlow 2.

To change all layers to have dtype float64 by default, call `tf.keras.backend.set_floatx('float64')`. To change just this layer, pass dtype='float64' to the layer constructor. If you are the author of this layer, you can disable autocasting by passing autocast=False to the base Layer constructor.

Epoch 1, Loss: 0.13170050084590912, Accuracy: 95.97166442871094, Test Loss: 0.06416505575180054, Test Accuracy: 97.98999786376953
Epoch 2, Loss: 0.04071308672428131, Accuracy: 98.74166870117188, Test Loss: 0.05933062732219696, Test Accuracy: 98.15999603271484
Epoch 3, Loss: 0.022074595093727112, Accuracy: 99.30333709716797, Test Loss: 0.053413353860378265, Test Accuracy: 98.33999633789062
Epoch 4, Loss: 0.013294064439833164, Accuracy: 99.55500030517578, Test Loss: 0.05290050432085991, Test Accuracy: 98.40999603271484
Epoch 5, Loss: 0.008136439137160778, Accuracy: 99.73500061035156, Test Loss: 0.06418339163064957, Test Accuracy: 98.2699966430664

If you set the default dtype  as tf.keras.backend.set_floatx('float64'), then the output is
Epoch 1, Loss: 0.14186638195651272, Accuracy: 95.70166666666667, Test Loss: 0.05724755003185461, Test Accuracy: 98.11999999999999
Epoch 2, Loss: 0.043617788805440066, Accuracy: 98.65666666666667, Test Loss: 0.047525364846504776, Test Accuracy: 98.49
Epoch 3, Loss: 0.022846894193099192, Accuracy: 99.23833333333333, Test Loss: 0.0562137230045946, Test Accuracy: 98.22
Epoch 4, Loss: 0.01501299387764108, Accuracy: 99.515, Test Loss: 0.05169376732314508, Test Accuracy: 98.38
Epoch 5, Loss: 0.008679648822207916, Accuracy: 99.715, Test Loss: 0.062491611017893994, Test Accuracy: 98.33

Please close the issue if it was resolved by 2.0.0rc2. Thanks!

Yeap, rc2 worked nicely.
Thanks


Tracker not work on mac 10.11.4

Experiencing the same, i can make decks, select them, but they don't seem to respond in any way to HS activity

Same problem on 10.10.5

Closing in favor of #366

I can only see my deck, no activity in HSTracker, clicking on auto position trackers hides the tracker completely, opponents deck doesn't show at all

@bmichotte Kind of follow-up about this issue, I tried your steps that you mentioned in #366 and it actually work, however, each time when a new game start, the Hearthstone app is totally frozen. I have to force quit the game and restart and sometime the tracker will work but sometime not.


Added test cases for LVGL

Added test cases to test basic functionality of zephyrs LVGL glue logic (fs interface, memory allocation, lvgl init). Further all bool KConfigs are enabled to make sure that all necessary lvgl source file are included in a build.
Additionally this PR bumps the lvgl module to v6.0.2 to prevent a sanitycheck failure due to a warning in the lvgl code.

Can you split this PR to two, one for the bug fix and one for the version bump?

Can you split this PR to two, one for the bug fix and one for the version bump?

@ioannisg Actually the version bump is the bug fix and the second part just introduces some basic test cases. I could move the version bump to a separate PR but it will break the sanitycheck for this PR.

@ioannisg Splitted the PR in 2 and marked this as DNM due to dependency on #18247


Add support for parsing the reinstall section of a package install plan

I thought reinstalls could never happen because we always had a fresh
sandbox. It turns out they can because there are a few packages like
process, filepath, directory, etc that are in the global package
database which is installed by default.
Ideally we could just exclude the global package database alltogether
but we need it for base and possibly ghc.
/cc @charleso
This needs to be merged before we can proceed with the upgrade on x because x-conduit does a reinstall of process.

:+1:


Fix typos, broken links, hints not showing up etc.

I just went through the first 4 concept exercises in Ruby on exercism.lol for the first time. I noticed a few tiny details that need improvement. I'm leaving my feedback in a form of a PR that already fixes those things. The commit history should describe well the changes I'm proposing. I'll revert anything you don't really want 🙂 in general:

some random typos
some hints not showing up because there were paragraphs between list items or because the task name was different than in instructions

We good to go on this, @SleeplessByte?

I think so haha


doesn't extract

async function foo() {
}
let bar;

still doesn't work.
let bar;

Sorry, I didn't notice the let bar;. This should be fixed, now.

doexn't extract let_declaration_inlined_3
let let_declaration_inlined_1, let_declaration_inlined_2 ,let_declaration_inlined_3;

Hmm… what did I do wrong?

@dlwe could you try last commit?

It doesn't work.
Not
let let_declaration_inlined_1, let_declaration_inlined_2, let_declaration_inlined_3;
But
let let_declaration_inlined_1, let_declaration_inlined_2 ,let_declaration_inlined_3;
Be aware of space and comma before let_declaration_inlined_3.
And last commit doesn't work with:
let
let_declaration_inlined_4;

Be aware of space and comma before let_declaration_inlined_3.

I see it, now.

And last commit doesn't work with:
let
let_declaration_inlined_4;

Yes, I voluntarily limited it to three levels for the time being.

This should do it. Sorry for not noticing the bad spacing.


Highlight the fact that there is no undo for this action

Marking the limitations of MEMORY OPTIMIZED TABLES with a Caution label because there is no undo for this.

@jesulink2514 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off


Xpand.VersionConverter

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]

Additional context
Add any other context about the problem here.

apologies for the delays we are back on track now, however this post makes no sense. Please add additional context. For the moment I am unassigned to this thread.


PyTorch update

Adds further info based on plooloops feedback
Adds filter to automatically filter information from notebooks
Adds instructions for setting up NVIDIA driver on K8s
Sets the K8s version to 1.11
Updates the k8s config to comply with the new driver

Nice work Mathew


Correction for raw affiliation Environmental Materials Team, ENSAM, Mohammed V University in Rabat, BP: 6207 Avenue des; Forces Armées Royales, Rabat-Morocco;; Laboratory of Spectroscopy, Molecular Modeling, Materials, Nanomaterials, Water and Environment,

Correction needed for raw affiliation Environmental Materials Team, ENSAM, Mohammed V University in Rabat, BP: 6207 Avenue des; Forces Armées Royales, Rabat-Morocco;; Laboratory of Spectroscopy, Molecular Modeling, Materials, Nanomaterials, Water and Environment,
raw_affiliation_name: Environmental Materials Team, ENSAM, Mohammed V University in Rabat, BP: 6207 Avenue des; Forces Armées Royales, Rabat-Morocco;; Laboratory of Spectroscopy, Molecular Modeling, Materials, Nanomaterials, Water and Environment,
new_rors: 01e5t7e46;00r8w8f84
previous_rors: 01e5t7e46;00r8w8f84;018pp1107
works_examples: W4379387020
contact: fc73620621e65c9099f14b6cfe557b0d:00c1a5018964f4d82497d95378 @ ensam.eu

This issue was accepted and ingested by the OpenAlex team on 2024-10-09. The new affiliations should be visible within the next 7 days.


fix the gradcam-segment tutorials's error

layer is not defined, it shoule be loss

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


MEN-2125: Allow trailing AUTOVERSION tags for page headers.

If the tag is above the header, the page doesn't render correctly.
Signed-off-by: Kristian Amlie<EMAIL_ADDRESS>

Looks ok to me although I'm not terribly familiar with the details.  But from a general docs perspective this is fine.

Thanks!


Correction for raw affiliation Department of Computer Science, Western University, London

Correction needed for raw affiliation Department of Computer Science, Western University, London
raw_affiliation_name: Department of Computer Science, Western University, London
new_rors: 02grkyz14
previous_rors: 05cgtjz78
works_examples: W4366589792;W4366682952
contact: 7bf24971c852e5df7f2706d5359be269:564994d296c8efd4 @ uwo.ca

This issue was accepted and ingested by the OpenAlex team on 2024-12-19. The new affiliations should be visible within the next 7 days.


fix(components): add missing target prop to anchor components

This is an extension of the PR here: https://github.com/ionic-team/ionic/pull/17844
Adds the following interfaces:
export interface AnchorInterface {
  href: string | undefined;
  target: string | undefined;
  rel: string | undefined;
  download: string | undefined;
}

export interface ButtonInterface {
  type: 'submit' | 'reset' | 'button';
  disabled: boolean;
}

Components that implement the interfaces
Implements the AnchorInterface in the following:

anchor
button
card
fab-button
item-option
item
tab-button

Implements the ButtonInterface in the following:

back-button
button
card
fab-button
item-option
item
menu-button
segment-button

Component properties added
Adds the following properties to the components listed under them:
rel, download, target

anchor
button
card
fab-button
item-option
item
tab-button

disabled

back-button
menu-button

type

back-button
item-option
menu-button
segment-button

fixes #16848 closes #16889

@liamdebeasi could you review this? also do you think it should add the rel property? The documentation for target includes a blockquote mentioning usage with it: https://developer.mozilla.org/en-US/docs/Web/HTML/Element/a

So I had the idea to instead just pass down certain attributes since things like rel and download are also missing. After talking with @jthoms1 on this more, we think it would be better than setting props for everything. I'm not sure if this will cause issues though. Here's a quick example, of course this would be cleaned up more:
render() {
    const attributes = ['download', 'href', 'hreflang', 'referrerpolicy', 'rel', 'target', 'type'];
    let attrs = {};

    if (this.el.hasAttributes()) {
      for (let i = 0; i < this.el.attributes.length; i++) {
        const attr = this.el.attributes[i];
        if ((attributes.indexOf(attr.name) > -1)) {
          console.log('pass down', attr.name, '->', attr.value);
          attrs = {
            ...attrs,
            [`${attr.name}`]: attr.value
          };
        }
      }
    }

    return (
      <a
        {...attrs}
        href={this.href}
      >
        <slot></slot>
      </a>
    );
  }

We think this may be good for Stencil to handle.

I like generics in general.
How would you deal with documentation with this though? It wouldn't auto-generated ?
It also hide the props behind a function. Hm, really a tough one!

I'm revisiting this @bitflower. After some further discussion it's out of scope to add the automated properties, so instead I am implementing an interface in the components to make sure they're all getting the missing properties. Let me know if you see any properties I've missed. Also, I'll add you as a co-author on this since I am just merging in the fab-button changes. 🙂

@liamdebeasi @manucorporat Can you review this? Besides the ion-anchor properties, does everything else look ok?

The interface approach is awesome!

for me the target property is still ignored on ionic 5


Generate favicon based on logo

Favicons should be automatically generated, if no favicon is present, using the logo defined in the hyperbook.json.

We should use this package https://www.npmjs.com/package/favicons


Don't set version or group in sample apps.

Issue #, if available:
Description of changes: We definitely don't want to override version with a constant. And there's no reason to override group either.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #19 (1cc9d9b) into main (7232e67) will increase coverage by 50.00%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             main      #19       +/-   ##
===========================================
+ Coverage        0   50.00%   +50.00%
- Complexity      0        3        +3
===========================================
  Files           0        2        +2
  Lines           0       10       +10
  Branches        0        1        +1
===========================================
+ Hits            0        5        +5
- Misses          0        3        +3
- Partials        0        2        +2

Impacted Files
Coverage Δ
Complexity Δ

...y/javaagent/providers/AwsOpenTelemetryFactory.java
62.50% <0.00%> (ø)
3.00% <0.00%> (?%)

...emetry/javaagent/providers/AwsAgentProperties.java
0.00% <0.00%> (ø)
0.00% <0.00%> (?%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7232e67...1cc9d9b. Read the comment docs.


Pub error message when version is not correct format is misleading

If I create a pubspec.yaml containing the following:
name: my_test
version: 1.0.0
Then "pub get" works fine. However, if I change it to:
name: my_test
version: 1.0
Then "pub get" gives the following error:
Error in pubspec for package "my_test" loaded from pubspec.yaml:
"version" field must be a string, but was "1.0".
The error message ("must be a string") doesn't seem to match with the problem. It would be better if the error indicated the expected format for a version (this confuses me every single time!).

This issue has been moved to dart-lang/pub#1156.


wifi is not connecting in ionic 3?

I am using  ionic framework for connecting wifi.
i am using this plugin
$ ionic cordova plugin add cordova-plugin-hotspot
$ npm install --save @ionic-native/hotspot

I am using this Instance Members to connect.
this.hotspot.connectToWifi(SSID, password)
.then((data) => {

          console.log(".........hotspot..........",data);
        }, (error) => {
            console.log(".........hotspot error..........",error);
          })

But particular Wifi device is not connecting why?
I am having like this error
.........hotspot.......... Connection was not successfull

Hi, can you let us know if there's an alternate that you or someone else is maintaining elsewhere?


NEW: Mock sleep unit test utility.

NEW: Mock sleep unit test utility.
Simple utility function for unit tests. Use instead of sleep(). I found this quite handy is several projects, we might as well make the code reusable.

I don't think we should be including methods that are only meant to be called in tests into production codebases.
There is some of that already, but it's too late to decouple those instances in the current major. I don't think we should be adding more.
I'll leave this open for a day or two in case a core committer disagrees with me, though.

@GuySartorelli Fair enough, is there a better place for it though? For example we could add a TestOnly service maybe under the Dev namespace?

I'm not sure, to be honest. I'd love (in the long term) for all of the test-related stuff to be moved out of framework altogether, and be in its own module that can be included as a dev dependency... but we're a ways off doing something like that just yet.
This might be the best place for it at the moment, to be honest, now that I've spent a bit more time considering it.
I still won't merge immediately in case there are opinions from other core committers on this but yeah probably this is the spot for this method, if there is a spot for it, in the current state of things.

All good @GuySartorelli , happy to keep the PR open. Having a separate module for this sounds great.

Let's wait a day or two if Max or Steve have a different view, and if not we can get it in.

Couldn't it be added to SapphireTest or some part of the PHPUnit framework to allow tests to call $this->addTime() or similar?
How would one expect this to work if mock_now was not set?

I'd be inclined to just delete the PHPUnit 5.7 version, it's an ancient API we shouldn't be developing for it
What happens if you put a sleep(3) in your unit test?

I'd be inclined to just delete the PHPUnit 5.7 version,

Just for the sake of clarity: I assume you mean the 5.7 version of the new method, not of the class itself.

Cool. Is the time reset after each test? I assume it is, just making sure...

If it isn't, that's a fundamental issue with the mock now functionality as a whole, not a new problem introduced with this PR.

Right, but a dev who implements mock_now is then responsible for the tear down of that test. This feature hides it behind syntactic sugar, so it'd be understandable that a dev that uses it assumes the date is reset at the end of the test for them.

Looks like it is handled: https://github.com/silverstripe/silverstripe-framework/blob/4/src/Dev/SapphireTest.php#L630-L632

@emteknetnz You've still got a review here with requested changes - is that for removing the new method on the old phpunit class? I don't think it's worth holding up merging for that personally, are you okay with the PR as is or do you still want some changes made?

I'm not too attached, feel free to merge if you see fit


Entry slug URI not updating on save

Bug description
I'm using the Eloquent driver for entries and it seems to be an issue when using the Eloquent driver as the file based driver works as expected.
When I update the slug for an entry, the change saves but checking the new URL results in a 404 page (old URL is still valid). If I save the page again, the new URL work.
It looks like the first save updates the slug field in the table. The second save then updates the uri field in the table.
How to reproduce

Use the Eloquent driver for entries.
Update a slug of an entry and visit the new page. This will be a 404 page. You can also check the DB table and see the slug has been updated , but the uri has not.
Save the entry again and visit the new page. This will now work as expected. You can also check the DB table and see the uri has now been updated.

Logs
No response
Environment
Environment
Application Name: Test Website
Laravel Version: 11.34.2
PHP Version: 8.3.14
Composer Version: 2.8.3
Environment: local
Debug Mode: ENABLED
URL: test-website.ddev.site
Maintenance Mode: OFF
Timezone: UTC
Locale: en

Cache
Config: NOT CACHED
Events: NOT CACHED
Routes: NOT CACHED
Views: CACHED

Drivers
Broadcasting: log
Cache: file
Database: mysql
Logs: stack / single
Mail: smtp
Queue: sync
Session: file

Statamic
Addons: 2
Sites: 1
Stache Watcher: Enabled
Static Caching: Disabled
Version: 5.42.0 PRO

Statamic Addons
statamic/eloquent-driver: 4.19.0
statamic/seo-pro: 6.4.0

Statamic Eloquent Driver
Asset Containers: file
Assets: eloquent
Blueprints: file
Collection Trees: eloquent
Collections: file
Entries: eloquent
Forms: eloquent
Global Sets: file
Global Variables: eloquent
Navigation Trees: eloquent
Navigations: file
Revisions: file
Sites: file
Taxonomies: eloquent
Terms: eloquent
Tokens: file

Installation
Fresh statamic/statamic site via CLI
Additional details
No response

After a second read over, this looks like a different issue. Re-opening.

I can replicate the issue.
It works as expected when using eloquent driven collections, but not when using file/stache driven collections. I've got a PR here for the changes required - ended up being a 1 method change.
Do you want to give it a check and see if it works for you? https://github.com/statamic/eloquent-driver/issues/391


question about torch 2.1.0 integration

Thanks for your sharing! I'm greatly appreciate your work for reducing the cuda memory fragmentation. Recently I have integrated GMLake into torch2.1.0 and finished compiling without error. I would like to know how to confirm if GMLake is working properly, as I did not find any reduction in peak memory reserved during using Lora to train Llama2-7B.
garbage_collect_fused_blocks() function jumps to the error handling section, and does it causing GMLake  not working?

Here are some running logs with only 6 iterations trainning steps.
node-9658:4032281:4036703 [0] GMLAKE_INFO get_fused_fragmented_blocks():4159 fused block 0x25f46060, ptr 0x12a0000000 of size 512.000000MB
node-9658:4032281:4036703 [0] GMLAKE_INFO get_fused_fragmented_blocks():4171 try 0: fuse 256 physical blocks to ptr 0x12a0000000 of size 512.000000MB for allocate size 512.000000MB succeeded, takes 20.435480ms, total_fuse_size 32558.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO get_fused_fragmented_blocks():4159 fused block 0x2a994d70, ptr 0x12c0000000 of size 954.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO get_fused_fragmented_blocks():4171 try 0: fuse 477 physical blocks to ptr 0x12c0000000 of size 954.000000MB for allocate size 954.000000MB succeeded, takes 40.207251ms, total_fuse_size 33512.000000MB
node-9658:4032281:4036703 [0] GMLAKE_INFO get_fused_fragmented_blocks():4159 fused block 0x2ba9e650, ptr 0x1320000000 of size 512.000000MB
node-9658:4032281:4036703 [0] GMLAKE_INFO get_fused_fragmented_blocks():4171 try 0: fuse 256 physical blocks to ptr 0x1320000000 of size 512.000000MB for allocate size 512.000000MB succeeded, takes 20.692452ms, total_fuse_size 34024.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO get_fused_fragmented_blocks():4159 fused block 0x2bab4010, ptr 0x1340000000 of size 954.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO get_fused_fragmented_blocks():4171 try 0: fuse 477 physical blocks to ptr 0x1340000000 of size 954.000000MB for allocate size 954.000000MB succeeded, takes 51.173343ms, total_fuse_size 34978.000000MB
node-9658:4032281:4036703 [0] GMLAKE_INFO get_fused_fragmented_blocks():4159 fused block 0x2b83a6b0, ptr 0x13a0000000 of size 512.000000MB
node-9658:4032281:4036703 [0] GMLAKE_INFO get_fused_fragmented_blocks():4171 try 0: fuse 256 physical blocks to ptr 0x13a0000000 of size 512.000000MB for allocate size 512.000000MB succeeded, takes 30.265250ms, total_fuse_size 35490.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO get_fused_fragmented_blocks():4159 fused block 0x26fa6af0, ptr 0x13c0000000 of size 954.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO get_fused_fragmented_blocks():4171 try 0: fuse 477 physical blocks to ptr 0x13c0000000 of size 954.000000MB for allocate size 954.000000MB succeeded, takes 49.731019ms, total_fuse_size 36444.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO get_fused_fragmented_blocks():4159 fused block 0x28e575f0, ptr 0x13fc000000 of size 954.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO get_fused_fragmented_blocks():4171 try 0: fuse 477 physical blocks to ptr 0x13fc000000 of size 954.000000MB for allocate size 954.000000MB succeeded, takes 40.066690ms, total_fuse_size 37398.000000MB
{'train_runtime': 25.9383, 'train_samples_per_second': 1.851, 'train_steps_per_second': 0.231, 'train_loss': 1.7313324610392253, 'epoch': 1.0}
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3824 gc from fragmented_free_fused_blocks: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3893 gc from free_fused_blocks_in_release_order: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO emptyCache():2425 garbage_collect_fused_blocks() return 0MB garbage memory
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3824 gc from fragmented_free_fused_blocks: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3893 gc from free_fused_blocks_in_release_order: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO emptyCache():2425 garbage_collect_fused_blocks() return 0MB garbage memory
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3824 gc from fragmented_free_fused_blocks: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3893 gc from free_fused_blocks_in_release_order: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO emptyCache():2425 garbage_collect_fused_blocks() return 0MB garbage memory
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3824 gc from fragmented_free_fused_blocks: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3893 gc from free_fused_blocks_in_release_order: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO emptyCache():2425 garbage_collect_fused_blocks() return 0MB garbage memory
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3824 gc from fragmented_free_fused_blocks: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3893 gc from free_fused_blocks_in_release_order: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO emptyCache():2425 garbage_collect_fused_blocks() return 0MB garbage memory
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3824 gc from fragmented_free_fused_blocks: blocks 0, size 0.000000MB
node-9658:4032281:4032281 [0] GMLAKE_INFO garbage_collect_fused_blocks():3893 gc from free_fused_blocks_in_release_order: blocks 0, size 0.000000MB

hi @Pegessi
I am currently working on the master branch of the repository and have encountered a compilation error when attempting to build the project with PyTorch version 2.1.
which branch do you use?

mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp:3499:27: error: ‘struct c10::cuda::CUDACachingAllocator::Native::{anonymous}::HistoryChain’ has no member named ‘h’
3499 |           block->history->h.context);
|                           ^
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp: In member function ‘void c10::cuda::CUDACachingAllocator::Native::DeviceCachingAllocator::record_trace(c10::cuda::CUDACachingAllocator::TraceEntry::Action, int64_t, size_t, cudaStream_t, int)’:
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp:3669:37: error: operands to ‘?:’ have different types ‘std::remove_reference<int&>::type’ {aka ‘int’} and ‘std::nullptr_t’
3669 |         alloc_trace_record_context_ ? std::move(context) : nullptr);
|         ^~
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp: At global scope:
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp:3802:8: error: ‘void c10::cuda::CUDACachingAllocator::Native::NativeCachingAllocator::recordHistory(bool, c10::cuda::CUDACachingAllocator::CreateContextFn, size_t, bool)’ marked ‘override’, but does not override
3802 |   void recordHistory(
|        ^~~~~~~~~~~~~
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp:3925:8: error: ‘void c10::cuda::CUDACachingAllocator::Native::NativeCachingAllocator::notifyCaptureBegin(int, c10::cuda::CaptureId_t, c10::cuda::MempoolId_t)’ marked ‘override’, but does not override
3925 |   void notifyCaptureBegin(
|        ^~~~~~~~~~~~~~~~~~
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp:3934:8: error: ‘void c10::cuda::CUDACachingAllocator::Native::NativeCachingAllocator::notifyCaptureAboutToEnd(int, c10::cuda::CaptureId_t)’ marked ‘override’, but does not override
3934 |   void notifyCaptureAboutToEnd(int device, CaptureId_t graph_id) override {
|        ^~~~~~~~~~~~~~~~~~~~~~~
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp:3939:8: error: ‘void c10::cuda::CUDACachingAllocator::Native::NativeCachingAllocator::notifyCaptureEnded(int, c10::cuda::CaptureId_t)’ marked ‘override’, but does not override
3939 |   void notifyCaptureEnded(int device, CaptureId_t graph_id) override {} // no-op
|        ^~~~~~~~~~~~~~~~~~
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp:3941:8: error: ‘void c10::cuda::CUDACachingAllocator::Native::NativeCachingAllocator::notifyCaptureDestroy(int, c10::cuda::MempoolId_t)’ marked ‘override’, but does not override
3941 |   void notifyCaptureDestroy(int device, MempoolId_t mempool_id) override {
|        ^~~~~~~~~~~~~~~~~~~~
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp:3967:8: error: ‘bool c10::cuda::CUDACachingAllocator::Native::NativeCachingAllocator::needsPoolSpecificPeerAccess()’ marked ‘override’, but does not override
3967 |   bool needsPoolSpecificPeerAccess() override {
|        ^~~~~~~~~~~~~~~~~~~~~~~~~~~
/mnt/pytorch/c10/cuda/CUDACachingAllocator.cpp:4031:24: error: cannot declare variable ‘c10::cuda::CUDACachingAllocator::Native::allocator’ to be of abstract type ‘c10::cuda::CUDACachingAllocator::Native::NativeCachingAllocator’
4031 | NativeCachingAllocator allocator;
|                        ^~~~~~~~~

I have integrated GMLake into torch2.1.0 manually by myself. These code cannot directly be used to replace the file in pytorch2.1.0
because of some interfaces change about cudacachingallocator.h&cpp. Although my manual version can be build successfully and logs display the virtual memory has been created, it's still not sure if GMLake works because my version doesn't reduce the peak memory during DNN training and cost greatly.

@Pegessi  Have you ever encountered the following problem?
when I patch GMLake to torch2.1.0, I found that sometimes when call func release_block where cudaFree small block, cuda will raise illegal memory
frame #2: c10::cuda::c10_cuda_check_implementation(int, char const*, char const*, int, bool) + 0x3f2 (0x7f3e8791e1f2 in /usr/local/lib/python3.10/dist-packages/torch/lib/libc10_cuda.so)
frame #3:  + 0x232c5 (0x7f3e878e52c5 in /usr/local/lib/python3.10/dist-packages/torch/lib/libc10_cuda.so)
frame #4:  + 0x2ed2a (0x7f3e878f0d2a in /usr/local/lib/python3.10/dist-packages/torch/lib/libc10_cuda.so)
frame #5:  + 0x1e4f5 (0x7f3e878e04f5 in /usr/local/lib/python3.10/dist-packages/torch/lib/libc10_cuda.so)
frame #6:  + 0x22a7e (0x7f3e878e4a7e in /usr/local/lib/python3.10/dist-packages/torch/lib/libc10_cuda.so)
frame #7:  + 0x3a07a (0x7f3e878fc07a in /usr/local/lib/python3.10/dist-packages/torch/lib/libc10_cuda.so)
frame #8:  + 0x3ac79 (0x7f3e878fcc79 in /usr/local/lib/python3.10/dist-packages/torch/lib/libc10_cuda.so)
frame #9:  + 0x3b143 (0x7f3e878fd143 in /usr/local/lib/python3.10/dist-packages/torch/lib/libc10_cuda.so)
frame #10: THCPModule_emptyCache(_object*, _object*) + 0x37 (0x7f3e86a442b7 in /usr/local/lib/python3.10/dist-packages/torch/lib/libtorch_python.so)
frame #11:  + 0x157a3e (0x5648cf980a3e in /usr/bin/python)
frame #12: _PyEval_EvalFrameDefault + 0x614a (0x5648cf971cfa in /usr/bin/python)
frame #13: _PyFunction_Vectorcall + 0x7c (0x5648cf9839fc in /usr/bin/python)
frame #14: _PyEval_EvalFrameDefault + 0x614a (0x5648cf971cfa in /usr/bin/python)
frame #15: _PyFunction_Vectorcall + 0x7c (0x5648cf9839fc in /usr/bin/python)
frame #16: _PyEval_EvalFrameDefault + 0x6bd (0x5648cf96c26d in /usr/bin/python)
frame #17: _PyFunction_Vectorcall + 0x7c (0x5648cf9839fc in /usr/bin/python)
frame #18: _PyEval_EvalFrameDefault + 0x6bd (0x5648cf96c26d in /usr/bin/python)
frame #19: _PyFunction_Vectorcall + 0x7c (0x5648cf9839fc in /usr/bin/python)
frame #20: _PyEval_EvalFrameDefault + 0x198c (0x5648cf96d53c in /usr/bin/python)
frame #21:  + 0x13f9c6 (0x5648cf9689c6 in /usr/bin/python)
frame #22: PyEval_EvalCode + 0x86 (0x5648cfa5e256 in /usr/bin/python)
frame #23:  + 0x260108 (0x5648cfa89108 in /usr/bin/python)
frame #24:  + 0x2599cb (0x5648cfa829cb in /usr/bin/python)
frame #25:  + 0x25fe55 (0x5648cfa88e55 in /usr/bin/python)
frame #26: _PyRun_SimpleFileObject + 0x1a8 (0x5648cfa88338 in /usr/bin/python)
frame #27: _PyRun_AnyFileObject + 0x43 (0x5648cfa87f83 in /usr/bin/python)
frame #28: Py_RunMain + 0x2be (0x5648cfa7aa5e in /usr/bin/python)
frame #29: Py_BytesMain + 0x2d (0x5648cfa5102d in /usr/bin/python)
frame #30:  + 0x29d90 (0x7f3e88356d90 in /usr/lib/x86_64-linux-gnu/libc.so.6)
frame #31: __libc_start_main + 0x80 (0x7f3e88356e40 in /usr/lib/x86_64-linux-gnu/libc.so.6)
frame #32: _start + 0x25 (0x5648cfa50f25 in /usr/bin/python)
terminate called after throwing an instance of '
c10::Error'
what():  CUDA error: an illegal memory access was encountered
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.


Started out on support for the polkadot.js extension.

This is causing a little bit of jank in the Keymanager class, due to differences between the injected signer and the keypair signer. If you see obvious ways to improve it, feel free to make suggestions, but the two do cause some need for workarounds.

Waiting on #76.


Unknown Person in history

Once you update the name of a person, in history, it still shows the old name, in my case, "Unknown Person".

Oh, thanks, I'll change it so we can update the back log when a contact is saved. This will be in the next release.
You can run ./manage.py update_sms_name_fields from the command line to do this manually at the minute. It will do it for every contact.
How you run the command will depend on how you have deployed apostello


⚠ Boutique - Ascentia has degraded performance

In 70a9ed1, Boutique - Ascentia (https://store.ascentia.fr/) experienced degraded performance:

HTTP code: 200
Response time: 1867 ms

Resolved: Boutique - Ascentia performance has improved in 313f1f3 after 1 hour, 37 minutes.


Checkstile rule not consistent across main and test source sets

In #2037 I encountered the issue:
Checkstyle didn't warn about indentation being 8 spaces instead of 4.
Checkstyle indentation rules should apply to test sources as well.

Unfortunately we cannot use IndentationCheck's forceStrictCondition, which is mainly what this is about.
It complains about various places, to use less indenting (since 'continuation' is either active, or not; there's no level of continuation).

Example where it wants the second wrapping to be less indented (click me)
https://github.com/querydsl/querydsl/blob/2468042ed7c20b269d85edafd4d7fe790a2dd6e3/querydsl-core/src/test/java/com/querydsl/core/group/GroupByIterateTest.java#L256-L258

But indentation in general can be added to the checkstyle configuration.

Just a heads-up btw.
Want to also focus on a few non-development related issues.


12/12/2018 Meeting.

User Stories.
Website Flow.
React routes.
Express routes.
Standard responses.

#User Journey:
As a team member, I can track our goals and organize ourselves;

Website Flow.


Abstract Shadow DOM V0  behind Shadow DOM V1 .

In some versions of skatejs absctracting Shadow DOM V0  behind Shadow DOM V1  doesn't work properly.
The code is:
if (tname === 'slot') {
	    if (support.shadowDomV0) {
	      if (attrs && attrs.slot) {
	        attrs.select = '[slot="' + attrs.slot + '"]';
	        delete attrs.slot;
	      }
	      tname = 'content';
	    }
	  }

AtlasKit animations don't work with this and do work perfectly when this code is commented out.
This can be found in this commit: 85dfbcbf7a7bb53d709719639ca7414b37769861

Interesting. I wonder if this will work in V1. Is there an isolated test case we could write for this?

No, it doesn't (not fully).
I've created a branch with included namedslots (https://github.com/skatejs/skatejs/tree/tests-with-named-slots). At least one test breaks because of this. Also wrote a test that imitates our animations structure, it's broken completely.


Alternate fix for PopUp keepInView recursion and speed up associated test

Related to #8483
I was reviewing the PopUp keepInView test with the eye of speeding it up, however I found that the pan animation was forced on. This was introduced with #7792 to guard against infinite recursion from (on moveend) -> _adjustPan -> panBy -> _resetView -> (fire moveend).
Reviewing the Popup code, we always expect _adjustPan to be triggered by its own panBy call but ordinarily the view will have updated and the dx and dy offsets will be 0, avoiding the recursive call. We only end up with the recursive call when _resetView is called, because the map doesn't have a chance to re-render itself (is that right?).
The fact that _adjustPan will always invoke itself allows an alternate solution: We can set a local variable when we start autopanning, and check it in the later invocation. If its present, we know the moveend currently being handled was invoked by the same function, and can thus return early – also avoiding the recursive invocation.
With this change, the associated test can be simplified and sped up from 812ms to 10ms (81x faster).
I'm raising this as a draft for now as I'm keen for thoughts on this as an alternate fix. I also want to do some manual testing varying pan distances and animations to further validate the change.

I'm happy opening this up as ready for review :)
I've added a debug page and had a play around with the keepInView popups. From my testing, I can confirm that the _autopanning local variable appears to be a reliable fix for the freeze issue that #7792 addressed.
As described in my comment earlier, I also noticed that there was no way to disable pan animations invoked by the keepInView logic. That meant my original attempt to speed up these tests was actually fragile and could break depending on future changes in Map.panBy even if the autopanning behaviour does not.
I have adjusted the test to work more reliably in that case, and added a new "short hop" to make sure we have coverage of Map.panBy's animated pan and reset view behaviours.
After these changes, we're now seeing a speed up from 812ms to 271ms (3x faster).
The resulting tests now also have no dependence on the _autopanning alternate fix. If we think that change is too risky, we can drop it but still keep the faster tests :)

Changing latlng with keepInView: false, doesn't move the map anymore

Oop, good catch! Thanks!
I've attached a quick fix for that by only setting the _autopanning flag when keepInView is set. :)

@Falke-Design could you give this PR another look?


[Platform] Move async output check to platform

Part of https://github.com/vllm-project/vllm/issues/9268
This is the last PR for platform reactor for config module.
This PR move the async output ability check to platform to avoid device hard code in config module.

Looks good now, thanks!


JS wallet creation is missing accountId

Expected Behaviour
Following the steps to create a Wallet here, I would expect to be able to complete all the steps successfully.

I continue getting an Error("Unknown account") that is thrown from the code sample here
🙋 Possible Solution [optional]

I added await syncWallet.resolveAccountId(); and that created the accountId, and I was able to complete the rest of the steps successfully.
Note: I got the idea for the solution by looking at the Rust SDK docs which have a similar method wallet.update_account_id().await?;. I think the JS docs should be updated to include this step as well.

I am running into this same issue, but using await syncWallet.resolveAccountId(); does not create an account id for me. When I run that function i get Error: Can't resolve account id from the zkSync node
Not sure what else to do

You need to deposit some eth into the zksync account and that will indeed give you an accountId
https://github.com/matter-labs/zksync-docs/blob/master/docs/api/sdk/js/tutorial.md#depositing-assets-from-ethereum-into-zksync


Add metrics for the rustdoc rendering times

I have a feeling the next refactoring I'm going to make (using a shared Storage instance for the whole application) is going to improve performance of rustdoc pages, so this adds some code to expose a metric that breaks down that endpoint's rendering time.
That endpoint is the one I think we should care about the most, so this is also going to be helpful to drive other performance improvements in the future.

Can you post some screenshots of what this looks like in grafana?

I don't have a (working) Grafana setup locally.

Going to make a separate PR for a prometheus instance in docker-compose. This PR looks fine.


Consider using zero value for the Other language

Done
https://github.com/src-d/enry/blob/master/common.go#L14


Bug? see test (F5)  Gravity-100 Y (object is sunken)

Hey! I see, quick look seems like gravity is too much for static collision resolution to keep the objects non penetrating.
This would probably be a hard fix to deal with such big values. The easier thing for now is to just write some recommended ranges for gravity in Solver.h so that the absolute value doesnt go above 20 in a given direction, allowing objects to come to rest. Ill leave this open for when I have more time to look into it


Remove warnings

It may look as my usual big PRs, but I just added comments, renamed functions, variables and constants to eliminate all the warnings we got with that code. I also remove some unused stuff.

Codecov Report

Merging #96 into master will increase coverage by 0.03%.
The diff coverage is 35.5%.

@@            Coverage Diff             @@
##           master      #96      +/-   ##
==========================================
+ Coverage   55.52%   55.56%   +0.03%
==========================================
  Files          53       53
  Lines        4706     4701       -5
==========================================
- Hits         2613     2612       -1
+ Misses       1800     1797       -3
+ Partials      293      292       -1

Impacted Files
Coverage Δ

awshelper/parameter_store.go
37.03% <ø> (ø)

options/options.go
70.06% <ø> (ø)
:arrow_up:

config/config.go
71.84% <ø> (-0.11%)
:arrow_down:

awshelper/config.go
20.4% <ø> (ø)

configstack/module.go
61.02% <ø> (ø)
:arrow_up:

awshelper/s3.go
45.37% <ø> (ø)

dynamodb/dynamo_lock_table.go
0% <0%> (ø)
:arrow_up:

cli/cli_app.go
45.53% <0%> (ø)
:arrow_up:

config/config_helpers.go
68.38% <0%> (ø)
:arrow_up:

remote/remote_state_s3.go
0% <0%> (ø)
:arrow_up:

... and 13 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5bef109...634be7f. Read the comment docs.


Add vault client

What
Add vault client to image importer. Following service initialiser interface example set in dp-image-api and use of vault client example in dp-observation-extractor.
This PR comprises two commits…

Refactor the service to use a service initialiser interface
Add vault client

How to review
Ensure that the service starts and shuts down cleanly. Ensure tests pass.
Who can review
Anyone but me

Approved - I tested the /health endpoint and the graceful shutdown. Everything works, and the code looks good.


⚠ Bofrost.at has degraded performance

In f39ce10, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1292 ms

Resolved: Bofrost.at performance has improved in e5a86aa after 8 minutes.


Strange limit behavior

Requirement - what kind of business use case are you trying to solve?
Searching traces by tags. View a certain amount of recent traces.
Problem - what in Jaeger blocks you from solving the requirement?
Jaeger shows very different search results depending on the limit. Some of traces from begging and the middle of the full list disappears on small limits.

In addition, the number of results also strangely varies depending on the limit. For example, 3 results for limit 10 and 4 results for limit 15.

It seems this problem only occurs when the operation is set to all.
Proposal - what do you suggest to solve the problem or improve the existing situation?
There is similar issue #411, But I'm not sure and there is no response since Oct 13.
I found that difference in processing of query without operation caused by this line https://github.com/jaegertracing/jaeger/blob/4a07b784ec57da1dbdc9da6523bd8940b0410859/plugin/storage/cassandra/spanstore/reader.go#L265
So we use queryByServiceName query (or queryByTag if any tags are specified) instead of queryByServiceAndOperationName.
https://github.com/jaegertracing/jaeger/blob/50429cb55aee9280e39621a0b5aae3c2afe5d190/plugin/storage/cassandra/schema/v001.cql.tmpl
And as a consequence we selecting from service_name_index or tag_index instead of service_operation_index. They both use bucket strategy, may this be the reason?
Any open questions to address

I think this is the same issue as #411

OK, but in #411 there is no activity from October 13. What to do next?
And I think that this is not a question, but definitely a bug.

Lack of activity is not going to be helped by opening a duplicate ticket. Both tickets are duplicates of a much earlier ticket #166, a known issue.


Revert "Merge pull request #27057 from theblixguy/unrevert/SR-11298"

This reverts #27057, reintroducing SR-11298, because the source compat implications were broader than expected.
rdar://problem/56165420

@swift-ci Please smoke test and merge


[Task]: Add Colab notebook example for Healthcare NLP API

What needs to happen?
Turn this notebook into a colab notebook and check into the Beam repo as an example.
Issue Priority
Priority: 3 (nice-to-have improvement)
Issue Components

[X] Component: Python SDK
[ ] Component: Java SDK
[ ] Component: Go SDK
[ ] Component: Typescript SDK
[ ] Component: IO connector
[ ] Component: Beam examples
[ ] Component: Beam playground
[ ] Component: Beam katas
[ ] Component: Website
[ ] Component: Spark Runner
[ ] Component: Flink Runner
[ ] Component: Samza Runner
[ ] Component: Twister2 Runner
[ ] Component: Hazelcast Jet Runner
[ ] Component: Google Cloud Dataflow Runner

.take-issue


NotificationListener callback not working on Android.

NotificationListener callback function in android is not invoked when scrolled - IOS correctly outputs "hello world", android does not!
Steps to reproduce:
Run following program. When scrolled the callback _onStartScroll() should run but fails in android.
class TempScreen extends StatelessWidget {
  @override
  Widget build(BuildContext context) {
    return Scaffold(
      appBar: AppBar(),
      body: NotificationListener(
          onNotification: (scrollNotification) {
            if (scrollNotification is ScrollUpdateNotification) {
              _onStartScroll(scrollNotification.metrics);
            }
          },
          child: CustomScrollView(
            physics: AlwaysScrollableScrollPhysics(),
            slivers: <Widget>[
              SliverToBoxAdapter(
                child: Container(
                  child: Center(
                    child: Text("Swipe Down"),
                  ),
                  margin: EdgeInsets.only(top: 5),
                ),
              ),
            ],
          )),
    );
  }

  _onStartScroll(ScrollMetrics metrics) {
      print('hello world');
  }
}

 flutter doctor
 flutter doctor -v
[✓] Flutter (Channel beta, v1.10.7, on Mac OS X 10.15.1 19B88, locale en-GB)
    • Flutter version 1.10.7 at /Users/me/flutter
    • Framework revision e70236e36c (7 weeks ago), 2019-10-02 09:32:30 -0700
    • Engine revision 9e6314d348
    • Dart version 2.6.0 (build 2.6.0-dev.0.0<PHONE_NUMBER>)

[✓] Android toolchain - develop for Android devices (Android SDK version 28.0.3)
    • Android SDK at /Users/me/Library/Android/sdk
    • Android NDK location not configured (optional; useful for native profiling support)
    • Platform android-28, build-tools 28.0.3
    • Java binary at: /Applications/Android Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_202-release-1483-b49-5587405)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 11.2.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 11.2.1, Build version 11B500
    • CocoaPods version 1.8.4

[✓] Android Studio (version 3.5)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin version 38.2.3
    • Dart plugin version 191.8423
    • Java version OpenJDK Runtime Environment (build 1.8.0_202-release-1483-b49-5587405)

[✓] IntelliJ IDEA Ultimate Edition (version 2019.2.4)
    • IntelliJ at /Applications/IntelliJ IDEA.app
    • Flutter plugin version 41.1.4
    • Dart plugin version 192.7402

[✓] Connected device (2 available)
    • Android SDK built for x86 • emulator-5554                        • android-x86 • Android 9 (API 28) (emulator)
    • iPhone 11 Pro Max         • 5BBFF83C-AAC4-4D77-A201-86CC7FE311E1 • ios         • com.apple.CoreSimulator.SimRuntime.iOS-13-2 (simulator)

• No issues found!

Hi @willladislaw
please take a look to this code sample.
This platform is not met for assistance on personal code.
Please see https://flutter.dev/community for resources for asking questions like this,
you may also get some help if you post it on Stack Overflow.
Closing, as this isn't an issue with Flutter itself,
if you disagree please write in the comments and I will reopen it
Thank you


Config flow could not be loaded: undefined

Getting this error during setup of integration.

issue was internet/dns/routing due to HA on VM (virtual box)


environment.nix: Split "less -R" into PAGER and LESS

Setting PAGER="less -R" relies on word splitting to work out properly.
Less also reads options from from a variable named LESS, by setting
PAGER="less" and LESS="-R" we don't have to rely on word splitting.

Motivation for this change
The PAGER="less -R" setting has always worked fine for me until today. I was trying out a bash script for note-taking and it errored with "command not found: less -R". By setting the option in LESS="-R" instead we can avoid relying on word splitting. I believe this should only make it work in more cases not less.
One backwards incompatibility issue is that people who don't like the -R flag and have overridden PAGER with less would have to clear the setting for LESS.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

Thinking about the constellation of possible settings:

PAGER unset
PAGER set

LESS unset
No change
Tools which directly invoke less will now pick up -R

LESS set
Things using PAGER will no longer pass -R, if they want the behaviour they'll have to add it to LESS themselves
No change

In any case, I think this is probably low impact beyond mild annoyance.

While I don't have a particularly strong opinion on this, my understanding is that EDITOR/PAGER/etc are conventionally word-split to allow for arguments to be passed like this. While I can't find a useful source, there are numerous bug reports for software that doesn't do this. Given that these are usually fixed, I think it's safe to assume that splitting is the expected behaviour. I've listed a few examples below.
sudoedit(1)'s handling of EDITOR:
v@january ~> EDITOR='echo hi' sudoedit /etc/passwd
[sudo] password for v:
hi /var/tmp/passwd.XXxBDZbR
sudoedit: /etc/passwd unchanged

From man(1):
       MANPAGER, PAGER
              If  $MANPAGER  or  $PAGER is set ($MANPAGER is used in preference), its
              value is used as the name of the program used  to  display  the  manual
              page.   By  default,  less  is used, falling back to cat if less is not
              found or is not executable.

              The value may be a simple command name or a command with arguments, and
              may  use  shell quoting (backslashes, single quotes, or double quotes).
              It may not use pipes to connect multiple commands; if  you  need  that,
              use  a  wrapper script, which may take the file to display either as an
              argument or on standard input.

To be clear, I'm not against this change (although I'll have to override LESS after this, since I don't like -R as default behaviour). This might be a bug you should file with the author(s) of nb, however.

Looks like this has already been fixed for EDITOR: https://github.com/xwmx/nb/pull/15

I was told in the #bash channel that relying on word-splitting causes no end of trouble. Hence the solution here. Note that I did at first intend to simply fix nb but was discouraged by the people who frequent that channel (I assumed they know what they're talking about).
Doesn't eval do parameter expansion? So now you might end up with a file path that is no longer properly quoted?


在 Linux 系统中安装并设置 kubectl

文档部分，在 Linux 系统中安装并设置页面的用 curl 在 Linux 系统中安装 kubectl中的说明，x86和arm的命令是一样的

文档部分，在 Linux 系统中安装并设置页面的用 curl 在 Linux 系统中安装 kubectl中的说明，x86和arm的命令是一样的

@isxiaok This description (here) doesn't provide enough information to evaluate the issue or determine if any action is needed. Could you please provide more details about the problem you're reporting or the help you need? Please include these details in the issue description in English.
/triage needs-information

@isxiaok  You can reopen the issue With Proper description and best practice is to describe the issue in English only putting [zn-ch]  before the description to denote in which localization the issue is .
For now Marking it as not planned and closing this issue. You can reopen / re raise the issue with proper description.

not planned /close  not planned

closing this issue marking as not planned
/close


[Iterators] Replace utility builders for LLVM ops by upstreamed builders (NFC).

This PR currently includes #650 (but doesn't depend on it in principle).
We have implemented some time ago utility builder functions for LLVM's ExtractValueOp and InsertValueOp with the plan to upstream them as builders eventually. In the meantime, somebody else has done that, so we can now use the upstreamed builders and remove our utility functions.

Closing in favor of #653, which includes this PR.


Run post hooks even if the pre hooks fail

Changelog
Fill this in and update CHANGELOG.md
Issues fixed or closed
Questions (open the PR then click the check boxes)
Did you update the documentation related to your changes?

[ ] Yes
[ ] My changes were not already documented

Did you run make before committing code and opening this PR?

[ ] Yes
[ ] I didn't change any code

Did you run porter create-stack and porter sync-stack to verify provisioning
works?

[ ] Yes
[ ] N/A

The intent of run_condition: fail is allow a post_ hook to be called after any failure in the phase.
This change extends “failure in the phase” to include a failure in a pre_ hook.  Previously, a pre_ hook failure would be a short-circuit to error exit.

@phylake — WIP, but if you have a minute to eyeball check, would be appreciated.

@phylake assigned, @gregoryfischer please review.

👍

👍


Tenancy -> RelationManager : General error: 1364 Field 'team_id' doesn't have a default value

Package
filament/filament
Package Version
v3.0.8
Laravel Version
v10.7.1
Livewire Version
v^3.0
PHP Version
PHP 8.1.20
Problem description
I'm trying to add a child using RelationManager, so I didn't set the parent_id neither the team_id, so on create action I get this error :
General error: 1364 Field 'team_id' doesn't have a default value
Expected behavior
the child object should be created with auto filling parent_id (it's okey) and team_id (failed)
Steps to reproduce

Setup tenancy
Create resource parent
Create Relation Manager for child
create a child under parent section
set child form attributes without parent selection nor team selection (should be added automatically)
save data
The error appears

Reproduction repository
https://github.com/filamentphp/filament
Relevant log output
No response

Hi,
here's the the reproduction repository url
issue-7511


why for ：{"detail":"Review the parameters to initialize a UnstructuredTableTransformerModel obj"}

Describe the bug
Defult mode is OK, but  when i try to set hi_res mode!!!
it turns to :{"detail":"Review the parameters to initialize a UnstructuredTableTransformerModel obj"}
it runs  in a local Unstructured-api docker image.
headers = {
'accept': 'application/json',
}
data = {
'strategy': 'hi_res',
# 'pdf_infer_table_structure': 'true',
# 'strategy': 'ocr_only',
}

Hi there - this may be a bug with our api docker image. Can you let me know what endpoint you're calling? The freemium (api.unstructured.io) or a paid SaaS url? Please include a minimal working example of your client code as well.

@J2DOG - If you're still having this issue, could you provide client code to reproduce? This may be fixed in a more recent version of the API.

as same when i run "docker run -p 8009:8000 -d --rm --name unstructured-api downloads.unstructured.io/unstructured-io/unstructured-api:latest --port 8000 --host <IP_ADDRESS>"

@MthwRobinson @awalker4 I'm having the same issue with downloads.unstructured.io/unstructured-io/unstructured-api:latest

# Cache table-transformers
RUN python -c "from transformers import TableTransformerForObjectDetection; model = TableTransformerForObjectDetection.from_pretrained(\"microsoft/table-transformer-structure-recognition\")"

I encountered the same issue, and it seemed to be an error when downloading "microsoft/table-transformer-structure-recognition" from Hugging Face. I resolved it after switching to a different VPN line.


Development: Remove unused Gradle jib plugin

Checklist
General

[ ] I tested all changes and their related features with all corresponding user types on a test server.
[x] This is a small issue that I tested locally and was confirmed by another developer on a test server.
[x] Language: I followed the guidelines for inclusive, diversity-sensitive, and appreciative language.
[x] I chose a title conforming to the naming conventions for pull requests.

Motivation and Context
Reduce the number of dependencies by removing unused ones and making it less confusing for new developers.
In future, when reproducible images are needed a builder container in which the WAR file is produced should be used. IIRC @4ludwig4 is already looking into that.
Description
As fas as I can tell, the Gradle jib plugin is not used anywhere. Instead a Dockerfile is used to manually build the Docker image for Artemis.
Additionally, in the plugin documentation I found no references how we could run additional commands when building the container. So the image built by jib would be partially broken in any case, as the required graphviz dependency cannot be installed.
Steps for Testing
A grep for jib showed no other references, so they should all have been removed.
Review Progress

Code Review

[ ] Review 1
[ ] Review 2

I added a commit which removes the jib directory.

... how we could run additional commands when building the container. So the image built by jib would be partially broken in any case, as the required graphviz dependency cannot be installed.

It seems that for reproduction reasons, Gradle doesn't have something similar to docker's RUN command. Instead, you should create a base image with a Dockerfile and then do the Java related things with Jib.

The last time someone seemed to use the jib task was here:

https://github.com/ls1intum/Artemis/pull/2183

Besides this, it seems like it was first introduced by jhipster and always just updated.
As you said, the currently resulting jib image would miss some dependencies and a probably out of sync /src/main/jib/entrypoint.sh.
I totally agree that removing it for now could avoid weight and confusion for new developers.

In general, Jib might have some cool features for building containers. I would maybe add it to some list of nice to have features for the future if there is something like that?


If i want git clone in sequence not parallel.

i can do it with custom task like below ,
desc "echo2"
task :echo2  do
  on roles(:all), in: :sequence, wait: 2 do |host|
    puts "doom #{host}    "
  end
 end

but how  git clone or git update is not clear

You can simply override the one task where we do the clone. IT's a Ruby method, and if you are using Ruby 2.x you can use Module.prepend. If you post back with an attempt, I'll help you get it working (and then I/we can document it, as it comes up quite a lot)

@rubyrobot I think you have the right idea. You just need to clear the existing task definition so that it is not additive. Like this:
Rake::Task["git:check"].clear_actions
namespace :git do
  desc 'Check that the repository is reachable'
  task :check do
    fetch(:branch)
    on release_roles(:all), in: :groups, limit: 10, wait: 3 do
      with fetch(:git_environmental_variables) do
        strategy.check
      end
    end
  end
end

More info on overriding tasks here: http://capistranorb.com/documentation/advanced-features/overriding-capistrano-tasks/

You're right: that is a pretty severe workaround. What's your ideal? Something like this?
# In deploy.rb
set :scm_runner, :in => :groups, :limit => 10, :wait => 3

Whilst I agree, the bigger problem is that "git" alone has ~20 command line flags in common usage, and many people need to tweak the knobs and dials, and if we "give an inch" making it configurable, the path leads to madness when "the next guy" wants to be able to run the clone in parallel groups, but the checkout sequentially, or some such.
We desperately need contributions to make the SCM pluggable, and to cleanly extract it into a "gem" (even if it's vendored for now) so we can start to define an API that we can live with which isn't blind hashes of options that have distantly removed side effects.
I do think the Rake "workaround" is valid, actually - it's a special use-case, you have a large number of servers and a (relatively) underpowered Git host (although, I've set things up similarly in the past), we documented it, it's typical Ruby, it benefits from our separation of the strategy classes from the Rake/task framework, and I find the "workaround" to be absolutely agreeable. Admittedly, I'll concede that Rake tasks being additive by default can be tricky, but also clearly documented and easy to work with, around, or disable.

@mattbrictson is this feature already included? I mean to avoid flood to fetch the code in group.

@larryzhao No, this configuration is not included. You will need to override the Rake tasks, as suggested above.

@mattbrictson Thx Matt.

Found the cure on the server side.
You could tweak MaxStartups in /etc/ssh/sshd_config on the server of Gitlab installation.
Default value is 10:30:60, the first 10 limits this.
MaxStartups
        Specifies the maximum number of concurrent unauthenticated con-
        nections to the sshd daemon.  Additional connections will be
        dropped until authentication succeeds or the LoginGraceTime
        expires for a connection.   The default is 10.

        Alternatively, random early drop can be enabled by specifying the
        three colon separated values "start:rate:full" (e.g.,
        "10:30:60").  sshd will refuse connection attempts with a proba-
        bility of "rate/100" (30%) if there are currently "start" (10)
        unauthenticated connections.  The probability increases linearly
        and all connection attempts are refused if the number of unau-
        thenticated connections reaches "full" (60).

For future reference, here's another recent Stack Overflow report of the "too many Git SSH connections" problem causing Capistrano to fail: http://stackoverflow.com/questions/40490835/cannot-deploy-multiple-hosts-in-capistrano

Has the SCM refactor made this easier?

I think this is orthogonal to the SCM refactor. The refactor does allow someone to plug in an alternative Git implementation, but to do so they'd have to essentially rewrite the whole thing.
Another, more general approach might be to set an upper limit on the number of threads :parallel (the default execution strategy) can create. Perhaps a :max_concurrency setting. This general solution could be then used for this issue, as well as others, e.g. this bundler one.

Since v3.12.0 capistrano supports git_max_concurrent_connections option: https://github.com/capistrano/capistrano/blob/v3.12.0/lib/capistrano/scm/tasks/git.rake