performance of training a new transformer

i follow the commend of training a new model(here is transformer)on iwslt2014 de-en, but I just got BLEU score 7.94 at 80th epoch.
my commend are as follows:
cd examples/translation/
bash prepare-iwslt14.sh
cd ../..
TEXT=examples/translation/iwslt14.tokenized.de-en
python3 preprocess.py --source-lang de --target-lang en --trainpref $TEXT/train --validpref $TEXT/valid --testpref $TEXT/test --destdir data-bin/iwslt14.tokenized.de-en
mkdir -p checkpoints/transformerlr0001
nohup python3 train.py data-bin/iwslt14.tokenized.de-en --lr 0.003 --clip-norm 0.1 --dropout 0.3 --batch-size 50 --arch transformer --no-progress-bar --save-dir checkpoints/transformerlr0003 > transformerlr0003.out 2>&1 &
python3 generate.py data-bin/iwslt14.tokenized.de-en --path checkpoints/transformerlr0001/checkpoint_best.pt   --beam 5 --batch-size 128 --remove-bpe | tee ./tmp/gen.out
Could you give me some advice, thanks very much ^_^

It doesn't seem like you're training/applying BPE to your input sequences.

i think i did, beacause that the \fairseq\examples\translation\prepare-iwslt14.sh applying BPE,and I saw my processed dataset ,it's indeed applying BPE.

Oops - I didn't see that in your commands above! You should make --max-tokens as large as possible without blowing out memory when training this model. Replace --batch-size with --max-tokens 4096 in your training step.

ok,i'll try that, thank u very much ^_^

Agree with @erip's advice. It looks like your command should work with this fix. Other things to look out for are adjusting the learning rate and dropout if your dataset is very different in size than IWSLT. Please open another issue if you are having trouble, thanks!


DimensionSets

Can you please elaborate what Dimension Set Entries does? Web Services Query Object ID 257
[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ec29b075-9cb9-9f87-c3d8-01d62a645b62
Version Independent ID: 6be392af-271e-7b31-2e0a-f5c2493dc9b5
Content: Design Details - Table Structure - Business Central
Content Source: business-central/design-details-table-structure.md
Service: dynamics365-business-central
GitHub Login: @SorenGP
Microsoft Alias: sgroespe

Hello Ben,
Dimension set entries is an under-the-hood term for how we store dimension sets. You can read about this here: https://docs.microsoft.com/en-us/dynamics365/business-central/design-details-dimension-set-entries-overview.
This query object looks up dimension sets in the Dimension Set Entries table based on the "Shortcut Dimension 1/2/3" codes that are defined in the general ledger setup. Nothing too mysterious, I believe.


chore(refactor): extract class JsonSchemaVersion to common package

Feel free to close this PR if you don't want duplicates at all.
To avoid breaking changes we can keep JsonSchemaVersion where it is -> add deprecated flag -> link a method at a new point it is implemented (in this case Json.java in common package)
This PR implements Extract Class refactoring:
I noticed JsonSchemaVersion should not be in WireMock class and saw that this was mentioned in the https://github.com/wiremock/wiremock/pull/2134#discussion_r1165986386.
References
Refactoring task

Submitter checklist

[ ] Recommended: Join WireMock Slack to get any help in #help-contributing or a project-specific channel like #wiremock-java
[ ] Recommended: If you participate in Hacktoberfest 2023, make sure you're signed up there and in the WireMock form
[ ] The PR request is well described and justified, including the body and the references
[ ] The PR title represents the desired changelog entry
[ ] The repository's code style is followed (see the contributing guide)
[ ] Test coverage that demonstrates that the change works as expected
[ ] For new features, there's necessary documentation in this pull request or in a subsequent PR to wiremock.org

Thanks for submitting this. Since it's a breaking change I don't think it's a good idea to do it at this stage so I'm going to close this PR. Something to consider under 4.x perhaps.


Exception thrown: \0\0\0\0 is not a valid sync command\r\nParameter name: value

When trying to push certain files I get this exception. It always happens with some files and not with others and I haven't been able to figure out the difference. The files are pushed successfully but the exception gets thrown anyway. Fixing this would help a lot with more accurate progress reporting. Thanks!

It happens to me too when i use a DeviceMonitor and the device is plugged in after the DeviceMonitor is initialized.
When i plug the device before initializing the DeviceMonitor, it happens only sometimes when i use the SyncService.GetDirectoryListing(string path) function.
Since i'm trying to make an user mode driver that loads an Android device as a full usb speeds flash drive, it'd be pretty helpful to have this bug fixed.
Thanks!


Scala S3 Sink?: S3 permissions problem when enriching in EMR

See this thread: https://groups.google.com/forum/#!topic/snowplow-user/nLjOuKwZoIQ
We have successfully reproduced this on snplow5 with lzo s3 sink and EMR enrichment. Notes:

We are running in a subnet, unlike Michael
Have tried deleting the .lzo.index files and running, and it still fails - suggests the problem isn't to do with reading the .lzo.index files

Next test: run the snplow5 EMR process with some vanilla CloudFront Collector files to see if it's something magical about the .lzo files.

:+1:

:+1:

Actually the error we get is slightly different:
Caused by: Status Code: 403, AWS Service: Amazon S3, AWS Request ID: F6003FA50CD80573, AWS Error Code: null, AWS Error Message: Forbidden, S3 Extended Request ID: ...

I have tried renaming the files to have shorter names and that didn't work. I'm going to try the CloudFront files next...

The difference of error was because we were using an S3 file in enrichments which we didn't have access to. With that removed, we get the exact same error as Michael and Anthony. This is good because we are running in a VPC subnet, and Michael isn't, so that rules out it being somehow VPC-related.
I'm investigating...

This is the error I get:
java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key must be specified as the username or password (respectively) of a s3n URL, or by setting the fs.s3n.awsAccessKeyId or fs.s3n.awsSecretAccessKey properties (respectively).
	at org.apache.hadoop.fs.s3.S3Credentials.initialize(S3Credentials.java:66)
	at org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.initialize(Jets3tNativeFileSystemStore.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
	at org.apache.hadoop.fs.s3native.$Proxy7.initialize(Unknown Source)
	at org.apache.hadoop.fs.s3native.NativeS3FileSystem.initialize(NativeS3FileSystem.java:216)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386)
	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
	at com.twitter.elephantbird.mapreduce.input.MultiInputFormat.determineFileFormat(MultiInputFormat.java:179)
	at com.twitter.elephantbird.mapreduce.input.MultiInputFormat.createRecordReader(MultiInputFormat.java:88)
	at com.twitter.elephantbird.mapred.input.DeprecatedInputFormatWrapper$RecordReaderWrapper.<init>(DeprecatedInputFormatWrapper.java:251)
	at com.twitter.elephantbird.mapred.input.DeprecatedInputFormatWrapper.getRecordReader(DeprecatedInputFormatWrapper.java:118)
	at cascading.tap.hadoop.io.MultiInputFormat$1.operate(MultiInputFormat.java:253)
	at cascading.tap.hadoop.io.MultiInputFormat$1.operate(MultiInputFormat.java:248)
	at cascading.util.Util.retry(Util.java:762)
	at cascading.tap.hadoop.io.MultiInputFormat.getRecordReader(MultiInputFormat.java:247)
	at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:197)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)

It's the exact same as Anthony's. Michael's is odd because it doesn't look like the error is caused when trying to read the lzo files.

Right so I believe the problem is AWS's recent IAM roles policy - see this thread:
https://github.com/awslabs/emr-bootstrap-actions/issues/33

When you use IAM roles, core-site.xml will not have these things:
fs.s3n.awsAccessKeyId

fs.s3.awsAccessKeyId
fs.s3bfs.awsAccessKeyId

And it looks like the hadoop-lzo code needs those properties to read the lzo files. I'll update the ticket name.

Here is more information on this: http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-iam-roles-calling.html
We can probably fix this by adding an S3DistCp step in front of the lzo files, so that hadoop-lzo doesn't have to attempt S3 access...

Right so I have the S3DistCp in place. The lzo filenames were causing some trouble with S3DistCp - apparently the version of S3DistCp on AMI 2.4.2 has:

some difficulties with copying S3 objects that may have similar paths (prefixes). AMI 2.4.3 and later > has a fixed version of S3DistCP.

Trying 2.4.3 gave me an error in the Iglu code (something related to Jackson parsing, maybe a Jackson dependency changed between 2.4.2 and 2.4.3). I am trying 2.4.5 now. If that fails, I am going to attempt renaming the lzo files and seeing if that fixes it.

So I can't promote to 2.4.3 because of this issue: https://github.com/snowplow/snowplow/issues/1001
I'm going to experiment with a different filename format for the lzo files and see if that works with 2.4.2...

So I tried another filename format (UUIDs) and that didn't work either - the problem is that whatever filename format I use, there are always two files with almost identical names (.lzo) and (.lzo.index)...
So I think the only solution is to fix #1001.

/cc @fblundun

:+1:


Add statistical confidence in measurements.

[x] Add Confindence Intervals (CI) for the measurents.
[x] Return median.
[x] Return CI.
[x] Adapt number of measurements in order to get CI to be a narrow area around median.

Closed by https://github.com/365andreas/X-Mem/commit/6f20b5cd0334c1f1ce14f9ec2c3f18a7948a1f29.


Bold font bug

Hello, after the last update, when you uncheck the Bold value in the font settings for the 'Function', it will revert to Bold after restarting the application.

Thank you. Will be fixed in v1.3.2.


MG Dataset

We currently have the MackeyGlass dataset generating a new time series on every init.
This would be fine, however it appears that on different machines (even with the same ISA, OS), the time series differs.
So, easiest fix is to generate MG data on one machine, and edit the dataset class such that it loads in this data rather than generating it.

#134


[improve][doc] Add docs about isolation deployments and separate task topics

Motivation
To add reference information about isolation deployments and separate task topics from an information architecture perspective.
Modifications

add reference information about isolation deployments
move "isolate broker" to a new sub-topic
move "isolate bookie" to a new sub-topic
Update sidebar file to refresh the left navigation

The preview looks good.

Documentation

[x] doc

Ping @gaoran10 @Anonymitaet for review.

Hi @gaoran10 , can you pls review this PR?


Fixed bedtools tmp paths to match extracted archive content

Is this breaking for you without these changes? If it is, I don't think it's due to a wrong path. Task Download bedtools source downloads the file to /tmp/bedtools2.tar.gz, which when extracted simply goes into /tmp/bedfiles2 dir so adding a version throws the whole thing off.

Yes. The latest archive extracts to a path with the version name in the folder (it appears to contain a nested folder). As a result, it breaks without the changes I've pushed.

It's definitely not what I'm seeing. In fact, it's the complete opposite where if the version is specified, it breaks: http://pastie.org/10407744

I get the exact opposite error.
    openstack: TASK: [galaxyprojectdotorg.trackster | Extract bedtools source] ***************
    openstack: changed: [localhost]
    openstack:
    openstack: TASK: [galaxyprojectdotorg.trackster | Make bedtools] *************************
    openstack: failed: [localhost] => {"failed": true, "rc": 258}
    openstack: msg: cannot change to directory '/tmp/bedtools2': path does not exist

I think the bedtools version is different. Trackster default is 2.20.1?

Yes, definitely a problem with the bedtools archive version. Shall I issue a new pull with the default bedtools version updated? (I've also removed the bedtools settings from the gvl playbook, so that the trackster setting takes precedence)

Ahh, OK - I had the version set at the playbook level to 2.24.0. The most recent version is 2.25.0 so I guess we can update to it in the role defaults. I can do that so you don't have to mess with a PR...


[WIP] Feature/presence

Hey Alex,
In regards to cluster tests, we now are using exactly four clients for testing in order to cover all possible edge cases in different scenarios. Be good if I can show you edge cases we want to cover using that number over a call!

Hi. This commit has been merged into master. Does that mean a presence api is now available? If so where can I find the documentation for it?
Thanks!!

Hey!
We only merged in the server aspect, the client and documentation are still a WIP. Should be done by end of month!

this is how the api will look like btw:
https://github.com/deepstreamIO/deepstream.io-client-js/pull/233
we just have a few conflicts in test scenarios that need to be sorted,


One model to resquest and other to response (JSONVIEW)

Can't make work with JSONVIEW
I want to use one MODEL for request and other for response.
Any suggestions?

Hi, @machadoapoena. Which version of SpringFox did you try with?


Add wireless switch mode & baby mode for ZNKG01HL ZNKG02HL

Since ZNKG03HL have these options, why not add them?

@xrh0905 Can you add ZNKG03HL too?

Thanks!


Harmonize with epidisco

Cohorts and Epidisco share some functionality. It would be nice to centralize the discussion of how we'll ensure they generate consistent results and ultimately separate concerns.
Currently my biggest concern is that Epidisco uses vaxrank but cohorts uses topiary. https://github.com/hammerlab/vaxrank/issues/31 might solve this issue.

Is this a dup. of https://github.com/hammerlab/cohorts/issues/154?

It is indeed a dup, closing.


Error running local testnet

Version:
Tendermint: 0.11.1-d4634dc6
Basecoin: 0.7.1-6c667b8
Baseserver: 0.7.1-6c667b8
Cosmos-ui: 9f45165

Steps:
npm i

npm run local

Error:
➜  cosmos-ui git:(test-fix) ✗ npm run local

><EMAIL_ADDRESS>local /Users/adrian/Code/cosmos/cosmos-ui
> npm run testnet local

><EMAIL_ADDRESS>testnet /Users/adrian/Code/cosmos/cosmos-ui
> node tasks/testnet.js "local"

Starting webpack-dev-server...

webpack  fallbackLoader option has been deprecated - replace with "fallback"

webpack  loader option has been deprecated - replace with "use"

webpack  Project is running at http://localhost:9080/

webpack  webpack output is served from /
         Content not from webpack is served from /Users/adrian/Code/cosmos/cosmos-ui/app/dist

webpack  (node:499) DeprecationWarning: loaderUtils.parseQuery() received a non-string value which can be problematic, see https://github.com/webpack/loader-utils/issues/56
         parseQuery() will be replaced with getOptions() in the next major version of loader-utils.

webpack  Hash: 2ae48ca3a59297d28723
         Version: webpack 2.7.0
         Time: 14284ms
                                     Asset     Size  Chunks                    Chunk Names
             fonts/fontawesome-webfont.eot   166 kB          [emitted]
              imgs/fontawesome-webfont.svg   444 kB          [emitted]  [big]
           fonts/MaterialIcons-Regular.ttf   128 kB          [emitted]
          fonts/MaterialIcons-Regular.woff  57.6 kB          [emitted]
         fonts/MaterialIcons-Regular.woff2  44.3 kB          [emitted]
             fonts/fontawesome-webfont.ttf   166 kB          [emitted]
           fonts/fontawesome-webfont.woff2  77.2 kB          [emitted]
            fonts/fontawesome-webfont.woff    98 kB          [emitted]
                               renderer.js  11.2 MB       0  [emitted]  [big]  renderer
                                index.html  1.63 kB          [emitted]
         chunk    {0} renderer.js (renderer) 3.87 MB [entry] [rendered]
             [6] ./app/~/babel-runtime/helpers/extends.js 544 bytes {0} [built]
            [46] ./app/~/babel-runtime/regenerator/index.js 49 bytes {0} [built]
           [380] ./app/src/renderer/main.js 2.52 kB {0} [built]
           [381] (webpack)-dev-server/client?http://localhost:9080 5.83 kB {0} [built]
           [382] (webpack)/hot/dev-server.js 1.57 kB {0} [built]
           [446] ./app/~/strip-ansi/index.js 161 bytes {0} [built]
           [452] ./app/src/renderer/node.js 1.85 kB {0} [built]
           [453] ./app/src/renderer/routes.js 3.01 kB {0} [built]
           [611] ./~/loglevel/lib/loglevel.js 6.74 kB {0} [built]
           [846] ./~/vuelidate/lib/index.js 14 kB {0} [built]
           [863] (webpack)-dev-server/client/overlay.js 3.6 kB {0} [built]
           [864] (webpack)-dev-server/client/socket.js 856 bytes {0} [built]
           [866] (webpack)/hot nonrecursive ^\.\/log$ 160 bytes {0} [built]
           [867] (webpack)/hot/log-apply-result.js 1.02 kB {0} [built]
           [896] multi (webpack)-dev-server/client?http://localhost:9080 webpack/hot/dev-server ./app/src/renderer/main.js 52 bytes {0} [built]
              + 882 hidden modules
         Child html-webpack-plugin for "index.html":
             chunk    {0} index.html 542 kB [entry] [rendered]
                 [0] ./~/lodash/lodash.js 540 kB {0} [built]
                 [1] ./~/html-webpack-plugin/lib/loader.js!./app/index.ejs 2.2 kB {0} [built]
                 [2] (webpack)/buildin/module.js 517 bytes {0} [built]

webpack  webpack: Compiled successfully.

Starting electron...
  (network path: ./app/networks/local)

electron  root exists (/Users/adrian/.cosmos-ui-dev)

electron  backing up data to "/Users/adrian/.cosmos-ui-dev_backup_1"

electron  initializing data directory (/Users/adrian/.cosmos-ui-dev)

electron  spawning /Users/adrian/go/bin/basecoin with args ""init" "1B1BE55F969F54064628A63B9559E7C21C925165" "--home" "/Users/adrian/.cosmos-ui-dev""

electron  Error: Initialization of basecoint failed:
              at /Users/adrian/Code/cosmos/cosmos-ui/app/src/main/index.js:384:13
              at <anonymous>
              at process._tickCallback (internal/process/next_tick.js:109:7)
              at Module.runMain (module.js:607:11)
              at run (bootstrap_node.js:431:7)
              at startup (bootstrap_node.js:155:9)
              at bootstrap_node.js:551:3

exited electron app/src/main/index.dev.js 1

I think this is resolved. Can you try to run npm run testnet now?


Print headers

Hello,
How can I print the headers in order to find the info mentioned here: http://developer.klout.com/blog/read/Rate_Limits_Insights ?
Thanks,
Stelios

You need to add
self.qps = handle.info().getheader('X-APIKey-QPS-Current')
self.quota = handle.info().getheader('X-APIKey-Quota-Current')

inside _handle_response after
handle = urllib_request.urlopen(req)

And return those values


Parquet files of indexed data.table objects error in read_parquet

Describe the bug, including details regarding any error messages, version, and platform.
When a data.table object is indexed (e.g., with setindex()), this can cause problems in reading the parquet back in (Error: IOError: Couldn't deserialize thrift: TProtocolException: Exceeded size limit) and it explodes the size of the file (e.g., from 400MB to 2GB with the only change being the index). See reprex below:
library(data.table)
library(arrow)

dt<-data.table(x=c(1:1e8), y = round(runif(n=1:1e8, min=1, max=5)))

#Looking at rows where y == 3
dt[y == 3,]

#Creating a new variable, which is done uniformly across all rows (suggesting the previous row index isn't applicable?)
dt[, z := 1]

#Save the dt
write_parquet(dt, "example.parquet")
gc()

#Cannot open the dt
dt_open<-read_parquet("example.parquet")

#Removing indexing that was created when looking at the y==3 subset before saving allows
#the file to be opened after re-saving.
setindex(dt, NULL)

write_parquet(dt, "example2.parquet")
dt_open<-read_parquet("example2.parquet")

Component(s)
Parquet, R

Thanks for this issue.
I took a look at the reprex and I can indeed trigger the same thing. What's happening is that the index itself is very large (like you note, 400MB) and when we convert that into an ascii serialization (which we do for all metadata objects), it gets even larger (0.8GB). Additionally,
Size of the overall attributes of the data.table, though this is actually both row.names and the index combined. We by default remove the row.names, so those won't end up contributing to the size of the metadata.
> print(object.size(attributes(dt)), units = "Gb")
0.7 Gb

The index alone is 400MB:
> print(object.size(attr(dt, "index")), units = "Gb")
0.4 Gb

And when we serialize the attributes, we end up with an object that's ~0.7GB. This was odd to me at first, how is the metadata larger after serialization than it was before? This is because we make an ascii representation of what was integers. We do also compress this, but since this particular metadata is worst-case the compression doesn't actually help too much here.
> print(object.size(arrow:::.serialize_arrow_r_metadata(attributes(dt))), units = "Gb")
0.7 Gb

We have (at least) two things we could do, and probably should do the first one for sure, the second one is harder:

Warn / prevent writing metadata that can't be read back in. We (can) know what the thrift buffer restriction is we should not let arrow write out metadata that can't later by written in.
Could we do something smarter about serializing long vectors of integers? Ini principle, we should be able to get this metadata down to at least what it is in memory. But I don't yet have a great idea of how to do that in this case off the top of my head.

From a functional perspective: how bad would it be to remove the index when it is too large? Would that disrupt people's flows with data.table?

Thanks for looking into this @jonkeane. Generally, it's not terribly expensive to recreate the index (unless someone is doing something extreme). If there was a clear message informing a user with an indexed data.table that the index will be dropped, think that would work well for most.

Option 2 ultimately would be awesome but understand that will take more thought. And again, don't think option 1 would be a problem for most situations.

This has come up at least once before, see https://github.com/apache/arrow/issues/40050. In addition to options (1) and (2), there's also an option in the ParquetReader, thrift_string_size_limit, that the user can increase to make the read succeed. I like the idea of warning when writing out a file that will encounter the limit and also improving the error message when reading in a file that would surpass the limit.


Is there a way to build an Arabic and English NLP model?

The jais models I shared instructions for are LLMs for that.  What do you mean by NLP model, the embedding model?

I want to build a model of the same model as the llama.... Can I and what is the plan?

You can ask in H2O LLM Studio, h2oGPT github project isn't focused on fine-tuning.


Add definable for codec

Describe the problem you are trying to solve
Right now codecs can't be configured or defined, this means every codec has to be hard coded instead of allowing us to integrate it in the standard library.
Describe the solution you'd like
As with all other defines we would have define codec.
Notes

it is worth discussing if we need a create here as it is created when it's used in a connector.
it's also worth discussing how we would change the define connector to allow codec configuration
No examples are given yet as this is a tracking ticket for now.

oh :sob:


Issues in Keras model loading in Tensorflow Serving

Running on keras 1.0.0 and TF Serving 0.7

Here's how I'm approaching this problem,

Create a model via Keras
Export it via the Tensorflow serving exporter infrastructure
Load it into TF serving's C++ wrappers and expose it on a port.

My problem is in (2).
Here's how I export the model.
  model = getKerasCompiledModel() # this is just a standard keras model
  sess = K.get_session()
  saver = tf.train.Saver(sharded=True)
  model_exporter = exporter.Exporter(saver)
  signature = exporter.classification_signature(input_tensor=model.input,
                                                scores_tensor=model.output)
  model_exporter.init(sess.graph.as_graph_def(),
                      default_graph_signature=signature)
  export_path = "./"
  model_exporter.export(export_path, tf.constant(FLAGS.export_version), sess)

So far so good. We've managed to export the keras model session via the session exporter.
However, the issue here is the way TF serving's exporter module expects a classification signature.
signature = exporter.classification_signature(input_tensor=model.input,
                                                scores_tensor=model.output)

In a non Keras model, this works fine. But in a Keras model using the TF backend, unless your input is of the form
[<tf.Tensor 'lstm_input_2:0' shape=(?, 128, 300) dtype=float32>,
 <tf.Tensor 'keras_learning_phase:0' shape=<unknown> dtype=uint8>]

with the second item being the K.learning_phase() placeholder, you can't invoke the prediction function.
You get this error,
You must feed a value for placeholder tensor 'keras_learning_phase' with dtype uint8
     [[Node: keras_learning_phase = Placeholder[dtype=DT_UINT8, shape=[], _device="/job:localhost/replica:0/task:0/cpu:0"]()]]")

Since the classification API only supports one input tensor and not a list, I can't see a way to export this model in a way that can be read by the Serving infrastructure.
Is there a workaround?

I will think about it. What you can do to fix it right now is to make the
learning phase constant. Here's how:
K._LEARNING_PHASE = tf.constant(0)  # test mode
(define your model here)
(export your model here)
In the future we might expose a built-in interface for exporting and
serving models, so you don't have to do this by hand.
Let me know how it goes.
On 13 April 2016 at 17:07, Viksit Gaur<EMAIL_ADDRESS>wrote:

Running on keras 1.0.0 and TF Serving 0.7
Here's how I'm approaching this problem,

Create a model via Keras
Export it via the Tensorflow serving exporter infrastructure
Load it into TF serving's C++ wrappers and expose it on a port.

My problem is in (2).
Here's how I export the model.
model = getKerasCompiledModel() # this is just a standard keras model
sess = K.get_session()
saver = tf.train.Saver(sharded=True)
model_exporter = exporter.Exporter(saver)
signature = exporter.classification_signature(input_tensor=model.input,
scores_tensor=model.output)
model_exporter.init(sess.graph.as_graph_def(),
default_graph_signature=signature)
export_path = "./"
model_exporter.export(export_path, tf.constant(FLAGS.export_version), sess)
So far so good. We've managed to export the keras model session via the
session exporter.
However, the issue here is the way TF serving's exporter module expects a
classification signature.
signature = exporter.classification_signature(input_tensor=model.input,
scores_tensor=model.output)
In a non Keras model, this works fine. But in a Keras model using the TF
backend, unless your input is of the form
[<tf.Tensor 'lstm_input_2:0' shape=(?, 128, 300) dtype=float32>,
<tf.Tensor 'keras_learning_phase:0' shape= dtype=uint8>]
with the second item being the K.learning_phase() placeholder, you can't
invoke the prediction function.
You get this error,
You must feed a value for placeholder tensor 'keras_learning_phase' with dtype uint8
[[Node: keras_learning_phase = Placeholderdtype=DT_UINT8, shape=[], _device="/job:localhost/replica:0/task:0/cpu:0"]]")
Since the classification API
https://github.com/tensorflow/serving/blob/master/tensorflow_serving/session_bundle/exporter.py#L66
only supports one input tensor and not a list, I can't see a way to
export this model in a way that can be read by the Serving infrastructure.
Is there a workaround?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub
https://github.com/fchollet/keras/issues/2310

@fchollet ah - so, I've tried doing that already and no luck.
Steps

Set K._LEARNING_PHASE = tf.constant(0) when building model
Export via the methods described above

Does an exported model contain the learning phase value within it? I'm still seeing the same error.

The method I described does work. Just make sure that all ops in your model
are defined after you set the learning phase to a constant.
On 13 April 2016 at 19:10, Viksit Gaur<EMAIL_ADDRESS>wrote:

@fchollet https://github.com/fchollet ah - so, I've tried doing that
already and no luck.
Steps

Set K._LEARNING_PHASE = tf.constant(0) when building model
Export via the methods described above

Does an exported model contain the learning phase value within it? I'm
still seeing the same error.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/fchollet/keras/issues/2310#issuecomment-209722743

Alright, let me retry with a fresh environment.
One thing to note - I train and export my model/weights into json and .h5 files to disk, and then load them/compile them again in the export script which is sitting in a different location. I'm hoping that won't cause any issues.

As long as you are setting the learning phase as constant before you build the fresh model (not just compile, everything), it will be fine. The learning phase does not affect weight loading.

Gotcha. Is there something I can check within a model to see that the learning phase constant is being set correctly?

No luck. Retried the entire model creation in one go and exporting via the Exporter.
Then loaded it via the C++ interface - and the same error message.

Since this issue should be reproducible even locally - that is, if I create a Keras model and then create a K.function() using the input and output - and then execute it directly, we bypass the internal _make_predict_function() (which adds the K.learning_phase()) - we should see this issue.
Here's the code to reproduce.
What am I missing?
from __future__ import print_function
import sys
import tensorflow as tf
import numpy as np
np.random.seed(8008)  # for reproducibility

from keras.datasets import mnist
from keras.models import Sequential
from keras.layers.core import Dense, Dropout, Activation
from keras.optimizers import SGD, Adam, RMSprop
from keras.utils import np_utils
from keras import backend as K

K._LEARNING_PHASE = tf.constant(0) # try with 1

batch_size = 128
nb_classes = 10
nb_epoch = 1

# the data, shuffled and split between train and test sets
(X_train, y_train), (X_test, y_test) = mnist.load_data()

X_train = X_train.reshape(60000, 784)
X_test = X_test.reshape(10000, 784)
X_train = X_train.astype('float32')
X_test = X_test.astype('float32')
X_train /= 255
X_test /= 255
print(X_train.shape[0], 'train samples')
print(X_test.shape[0], 'test samples')
# convert class vectors to binary class matrices
Y_train = np_utils.to_categorical(y_train, nb_classes)
Y_test = np_utils.to_categorical(y_test, nb_classes)

model = Sequential()
model.add(Dense(512, input_shape=(784,)))
model.add(Activation('relu'))
model.add(Dropout(0.2))
model.add(Dense(512))
model.add(Activation('relu'))
model.add(Dropout(0.2))
model.add(Dense(10))
model.add(Activation('softmax'))

model.summary()

model.compile(loss='categorical_crossentropy',
              optimizer=RMSprop(),
              metrics=['accuracy'])

history = model.fit(X_train, Y_train,
                    batch_size=batch_size, nb_epoch=nb_epoch,
                    verbose=1, validation_data=(X_test, Y_test))

# since we've set the constant for learning_phase, this should work?
pred = K.function([model.input], [model.output])
pred([X_test])

"""
W tensorflow/core/common_runtime/executor.cc:1102] 0x1102d1e50 Compute status: Invalid argument: You must feed a value for placeholder tensor 'keras_learning_phase' with dtype uint8
         [[Node: keras_learning_phase = Placeholder[dtype=DT_UINT8, shape=[], _device="/job:localhost/replica:0/task:0/cpu:0"]()]]
"""

# setting it explicitly works fine
pred = K.function([model.input, K.learning_phase()], [model.output])
pred([X_test, 1])
"""
Out[63]:
[array([[  1.00347834e-05,   3.74655019e-06,   1.54657057e-03, ...,
           9.96998191e-01,   2.86282466e-06,   2.00398354e-05],
        [  2.67221221e-05,   9.46493747e-05,   9.94248748e-01, ...,
           4.02291249e-07,   2.70981618e-05,   1.71050818e-08],
        [  3.57027639e-05,   9.91683960e-01,   2.65269703e-03, ...,
           3.92835867e-03,   2.83869915e-04,   5.37958549e-05],
        ...,
        [  4.45166961e-08,   4.54224505e-07,   8.53104893e-07, ...,
           1.04896884e-04,   3.14820500e-04,   1.58036346e-04],
        [  2.00932700e-05,   3.58963516e-05,   3.47329410e-06, ...,
           6.35720880e-07,   1.79862080e-03,   4.55387266e-07],
        [  3.58260934e-07,   2.49237320e-09,   2.99912131e-06, ...,
           9.83266024e-10,   1.59663855e-08,   8.79595341e-10]], dtype=float32)]
"""

Weird stuff:
...
K._LEARNING_PHASE = "bob" # try with 1
...

Still working:
60000 train samples
10000 test samples
____________________________________________________________________________________________________
Layer (type)                       Output Shape        Param #     Connected to
====================================================================================================
dense_4 (Dense)                    (None, 512)         401920      dense_input_2[0][0]
____________________________________________________________________________________________________
activation_4 (Activation)          (None, 512)         0           dense_4[0][0]
____________________________________________________________________________________________________
dropout_3 (Dropout)                (None, 512)         0           activation_4[0][0]
____________________________________________________________________________________________________
dense_5 (Dense)                    (None, 512)         262656      dropout_3[0][0]
____________________________________________________________________________________________________
activation_5 (Activation)          (None, 512)         0           dense_5[0][0]
____________________________________________________________________________________________________
dropout_4 (Dropout)                (None, 512)         0           activation_5[0][0]
____________________________________________________________________________________________________
dense_6 (Dense)                    (None, 10)          5130        dropout_4[0][0]
____________________________________________________________________________________________________
activation_6 (Activation)          (None, 10)          0           dense_6[0][0]
====================================================================================================
Total params: 669706
____________________________________________________________________________________________________
Train on 60000 samples, validate on 10000 samples
Epoch 1/1
59904/60000 [============================>.] - ETA: 0s - loss: 0.2772 - acc: 0.9160

With the same error:
...
InvalidArgumentError: You must feed a value for placeholder tensor 'keras_learning_phase' with dtype uint8
	 [[Node: keras_learning_phase = Placeholder[dtype=DT_UINT8, shape=[], _device="/job:localhost/replica:0/task:0/cpu:0"]
...

When I try to compile:
pred = K.function([model.input], [model.output])
pred([X_test])

It's working if I modify it directly in tensorflow_backend.

Import K from keras.layers.core and it should work!
...
from keras.layers.core import K
...

This is Python imports shenanigans, I get it now. This is easily solved via
adding a K.set_learning_phase() method, which will work regardless of who
you import K.
On 14 April 2016 at 06:59, Thomas Boquet<EMAIL_ADDRESS>wrote:

Import K from keras.layers.core and it should work!
...from keras.layers.core import K...
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/fchollet/keras/issues/2310#issuecomment-209956110

I added K.set_learning_phase(), but only for the TF backend, since it creates additional issues with Theano. In general it should only be used in such cases, since its effect will be to globally and permanently set the learning phase to a constant.

Thanks @fchollet - will update and test out. Hopefully I can make this a repeatable process as well.

Running on Keras 2.0.5, tensorflow 1.2.1 and tensorflow-serving-api 1.0.0
I added K.set_learning_phase(False) and then loaded model and defined signature and then exported model. It solved the issue of keras_learning_phase while loading model.

from keras.layers.core import  Dense, Dropout, Masking
this solved my problem.

it is not working for me at all.

This  worked for me.

This worked wonders for my export script for h5 -> pb. THANK YOU!

reinstall tensorflow==1.11.0 and keras==2.1.2 and tensorflow-serving-api==1.0.0 works for me.


fix(versions): update Activiti/activiti-cloud-notifications-graphql versions into master

UpdateBot pushed maven dependency: org.activiti.cloud.notifications.graphql:activiti-cloud-notifications-graphql-dependencies to: 7.1.197

UpdateBot commands:
updatebot push-version --kind maven org.activiti.cloud.notifications.graphql:activiti-cloud-notifications-graphql-dependencies 7.1.197


[$250] [Track Tax] The tax amount of a manual IOU will be in negative format

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 1.4.69-0
Reproducible in staging?: Y
Reproducible in production?: Y
If this was caught during regression testing, add the test name, ID and link from TestRail: N/A
Email or phone of affected tester (no customers<EMAIL_ADDRESS>Issue reported by: Applause - Internal Team
Issue found whene executing PR https://github.com/Expensify/App/pull/41264
Action Performed:

Open https://staging.new.expensify.com/
Log in to your HT account
Create a WS
Enable "Taxes"
Set "Tax Rate 1" as Workspace currency default
Navigate to the WS room
Create any manual IOU
Create another manual IOU with a default currency and a Tax Rate 1
Navigate to the details of the last IOU created
Change the tax amount to any valid amount
Start creating a new manual IOU
Navigate to the tax amount entry menu

Expected Result:
The tax amount when creating a manual IOU should not be in a negative format
Actual Result:
After editing the Tax amount in an existing IOU, the next time a manual IOU is created, the Tax amount in the edit menu will be in negative format
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[x] Android: Native
[x] Android: mWeb Chrome
[x] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[x] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence

https://github.com/Expensify/App/assets/78819774/e4d4c298-415d-4934-9bfb-eb13b0eefdb9
View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~010f30064172acce83
Upwork Job ID:<PHONE_NUMBER>556625408
Last Price Increase: 2024-05-03
Automatic offers:

hoangzinh | Reviewer | 0
bernhardoj | Contributor | 0

Issue OwnerCurrent Issue Owner: @greg-schroeder

@alexpensify  FYI I haven't added the External label as I wasn't 100% sure about this issue. Please take a look and add the label if you agree it's a bug and can be handled by external contributors

We think that this bug might be related to #wave-collect - Release 1

Proposal
Please re-state the problem that we are trying to solve in this issue.
The tax amount is shown in negative value.
What is the root cause of that problem?
The tax amount is taken from getTaxAmount.
https://github.com/Expensify/App/blob/12042dbe9e301e4f9dda497f18c8571ae63d505d/src/libs/TransactionUtils.ts#L301-L310
For an expense report, we negate the amount value. The reason is explained in the comment in getAmount, that is, the amount for the expense report is stored in negative value.
https://github.com/Expensify/App/blob/12042dbe9e301e4f9dda497f18c8571ae63d505d/src/libs/TransactionUtils.ts#L285-L287
That's true, but it's only when the request is created.
https://github.com/Expensify/App/blob/c5a1f96e7772592c0e1e2449b67dbc14afb35e02/src/libs/actions/IOU.ts#L1817-L1818
While we are creating the request, the amount is still in positive value, so negating it will give us a negative tax amount.
This doesn't happen on the amount page because we always return the absolute value.
https://github.com/Expensify/App/blob/c5a1f96e7772592c0e1e2449b67dbc14afb35e02/src/pages/iou/request/step/IOURequestStepAmount.tsx#L287
What changes do you think we should make in order to solve the problem?

Do the same as what we did on the amount page, that is return the absolute value of the amount.
Math.abs(transactionDetails?.taxAmount)
What alternative solutions did you explore? (Optional)
If we are creating a new request, don't negate the amount value.

@hoangzinh - when you get a chance, can you review if this proposal will fix this issue? Thanks!

Heads up, I will be offline until Tuesday, May 7, 2024, and will not actively watch over this GitHub during that period.
If anything urgent is needed here, please ask for help in the #expensify-open-source Slack Room-- thanks!

@hoangzinh any update regarding the proposal? Thanks!

the proposal looks good to me. we can return the absolute value 👍

PR is ready
cc: @hoangzinh

Thank you for that update!

@hoangzinh any news here? Thanks!

Thanks for that summary!

Payouts due: TBD

[ ] Contributor: $250 @bernhardoj
[ ] Contributor+: $250 @hoangzinh

Upwork job is here.

Hmm. Honestly, I don't think we need to put this in the regression period for https://github.com/Expensify/App/pull/42039 as the contributors in this issue aren't necessarily beholden to that code's performance. And any regressions will be handled by the authors of that PR. I'll pay out the offers for your work now @hoangzinh @bernhardoj

Thanks, @greg-schroeder, for your help here!

i gotchu @alexpensify!


Output the json

Slack returns information from its api endpoints. This PR exposes that information in the response output parameter for future steps.
This is especially useful for allowing threads since the chat.postMessage api endpoint allows using thread_ts to indicate the message is a response to a specific post.

The recent merge appears to have caused a bug due to a missing JSON executable. Can you please review the change and comment on that?
New error seen:
/entrypoint.sh: line 9: JSON: not found

@greglarkin Reverted https://github.com/abinoda/slack-action/pull/22

Oh, that's a whitespace bug: JSON=$( would fix it. My apologies.


Refactor the jobs that send email.

Break the jobs that deliver email updates to petition signatories into 2 parts:

a parent job that will load the recipients and enqueue a child job for each
a child job that will perform a single email delivery

Doing this removes the memory leak seen in previous version when delivering emails, and gives greater control over how much work is left to do as each job now does 1 thing and will eliminate the need for long running mail delivery jobs.
Multiple worker processes can spread the load of the actual email sending, rather than just tying up 1 process for a long time.
Both the parent and child jobs will check that the petition they are delivering information for and will exit if the petition has been updated since the jobs were enqueued.
Tried to keep with the existing structure, could do with further refactoring.
Tested locally delivering 10K emails:

Worker Memory levels at ~250MB when enqueuing mailing jobs (previously was unbounded growth)
Worker Memory evens out at ~270MB when running mailing jobs
Mailing jobs run at ~7 - ~10 job/s (with local mailhost)

Things this PR does not address:

there is no check to confirm that if a petition has X signatories, X emails actually got sent.
both parent and child jobs that perform the sending of emails are not idempotent

/cc @h-lame @oskarpearson @alanth @pixeltrix

Are we sure this eliminates the memory leak?  @pixeltrix narrowed it down to the double enqueue, which we're still doing and this branch doesn't sit on top of his one (see #359).  Not that we should avoid merging as it has merits above fixing the memory leak, but we should check it with more signatures first I guess?

Are we sure this eliminates the memory leak? @pixeltrix narrowed it down to the double enqueue, which we're still doing and this branch doesn't sit on top of his one (see #359). Not that we should avoid merging as it has merits above fixing the memory leak, but we should check it with more signatures first I guess?

Absolutely should test with more emails. Memory held steady across 10K but may grow with more than that. Should use @pixeltrix's fix anyway

@pixeltrix I've made the requested changes (except using email_spec helpers as that is a larger chunk of work)
Also refactored out using base classes for the email sending jobs in favour of concerns. Mainly due to the fact that the base classes could be be instantiated themselves (and would not make sense to)
I've left the new commits unsquashed to make it easier to see what I've changed, once everyones happy then I'll squash

I seem to remember trying iso8601(n) for comparisons somewhere, and having to not using because of rounding. Something like ruby doesn't round so a usec of 1178 passed to iso8601(2) is 11 not 12 but I think the times coming from PG do round? I can't really remember the exact details, but reading this I do remember trying it and having problems.

There are specs that check that the timestamps do match (and not match) when expected:
https://github.com/ansonK/e-petitions/blob/email-send-refactor/spec/jobs/shared_examples.rb
Done a quick console test and the rounding seems to work the same way .. ?:
irb(main):023:0> time = Time.current
=> Wed, 29 Jul 2015 13:28:37 BST +01:00
irb(main):024:0> Petition.last.update! created_at: time
  Petition Load (0.7ms)  SELECT  "petitions".* FROM "petitions"  ORDER BY "petitions"."id" DESC LIMIT 1
   (0.2ms)  BEGIN
  SQL (1.0ms)  UPDATE "petitions" SET "created_at" = $1, "updated_at" = $2 WHERE "petitions"."id" = $3  [["created_at", "2015-07-29 12:28:37.916448"], ["updated_at", "2015-07-29 12:28:39.594354"], ["id", 100000]]
   (0.8ms)  COMMIT
=> true
irb(main):025:0> petition = Petition.find 100000
  Petition Load (0.5ms)  SELECT  "petitions".* FROM "petitions" WHERE "petitions"."id" = $1 LIMIT 1  [["id", 100000]]
=> #<Petition id: 100000, action: "Incidunt delectus velit id suscipit nostrum eos do...", additional_details: "Aliquam porro asperiores dolores praesentium. Sed ...", state: "pending", open_at: nil, creator_signature_id: 1, created_at: "2015-07-29 12:28:37", updated_at: "2015-07-29 12:28:39", closed_at: nil, signature_count: 0, notified_by_email: false, background: "Ea nobis enim architecto labore ratione ullam dolo...", sponsor_token: "K3fnmTnaq2iw8GSF4uTV", government_response_at: nil, scheduled_debate_date: nil, last_signed_at: nil, response_threshold_reached_at: nil, debate_threshold_reached_at: nil, rejected_at: nil, debate_outcome_at: nil, moderation_threshold_reached_at: nil>
irb(main):026:0> time.getutc.iso8601(6)
=> "2015-07-29T12:28:37.916448Z"
irb(main):027:0> petition.created_at.getutc.iso8601(6)
=> "2015-07-29T12:28:37.916448Z"
irb(main):028:0> time.getutc.iso8601(2)
=> "2015-07-29T12:28:37.91Z"
irb(main):029:0> petition.created_at.getutc.iso8601(2)
=> "2015-07-29T12:28:37.91Z"

Ah, yes, maybe it's because I wasn't pushing everything through an iso8601 call so there were still some discrepancies.  This is probably fine.  Forget I said anything.


generic buyer skill coverage fixes.

Proposed changes
generic buyer skill coverage fixes.
Fixes
https://github.com/valory-xyz/open-aea/issues/348
Types of changes
What types of changes does your code introduce to agents-aea?
Put an x in the boxes that apply

[x] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist
Put an x in the boxes that apply.

[ ] I have read the CONTRIBUTING doc
[ ] I am making a pull request against the develop branch (left side). Also you should start your branch off our develop.
[ ] Lint and unit tests pass locally with my changes and CI passes too
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have checked that code coverage does not decrease.
[ ] I have added necessary documentation (if appropriate)
[ ] Any dependent changes have been merged and published in downstream modules

Further comments
If this is a relatively large or complex change, kick off the discussion by explaining why you chose the solution you did and what alternatives you considered, etc...
DELETE INCLUSIVE THIS AND BELOW FOR STANDARD PR
Release summary
Version number: [e.g. 1.0.1]
Release details
Describe in short the main changes with the new release.
Checklist
Put an x in the boxes that apply.

[ ] I have read the CONTRIBUTING doc
[ ] I am making a pull request against the main branch (left side), from develop
[ ] Lint and unit tests pass locally and in CI
[ ] I have checked the fingerprint hashes are correct by running (aea packages lock --check)
[ ] I have regenerated the latest API docs
[ ] I built the documentation and updated it with the latest changes
[ ] I have added an item in HISTORY.md for this release
[ ] I bumped the version number in the aea/__version__.py file.
[ ] I bumped the version number in every Docker image of the repo and published it. Also, I built and published them with tag latest
(check the READMEs of aea-develop
and aea-user)
[ ] I have pushed the latest packages to the registry.
[ ] I have uploaded the latest aea to PyPI.
[ ] I have uploaded the latest plugins to PyPI.

Further comments
Write here any other comment about the release, if any.

Codecov Report
Base: 87.25% // Head: 87.48% // Increases project coverage by +0.22% :tada:

Coverage data is based on head (4b0cce1) compared to base (6e6a444).
Patch coverage: 100.00% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #497      +/-   ##
==========================================
+ Coverage   87.25%   87.48%   +0.22%
==========================================
  Files         363      363
  Lines       29408    29410       +2
==========================================
+ Hits        25659    25728      +69
+ Misses       3749     3682      -67

Flag
Coverage Δ

unittests
87.48% <100.00%> (+0.22%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

packages/fetchai/skills/generic_buyer/handlers.py
100.00% <100.00%> (+29.00%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


PointerEnterEvent erases value of event.down

In PointerEnterEvent class documentation:
/// The pointer has moved with respect to the device while the pointer is not
/// in contact with the device, and entered a target object.
Implies pointer is always up.
In MouseRegion documentation for PointerEnterEvent onEnter:
/// Called when a mouse pointer (with or without buttons pressed) enters the
/// region defined by this widget, or when the widget appears under the
/// pointer.
Implies pointer can be up OR down.
In  PointerEnterEvent constructor, the param down is not exposed, and instead, in the call to super, down: false is always passed.
I'd suggest that it should expose the parameter so as to take its original value (because right now, in cases such as .fromMouseEvent (PointerMoveEvent(...)) the value will filp flop), and simply give it a default value of false, and the class doc should change to match that used in MouseRegion (otherwise, PointerEnterEvents have no way of detecting whether or not the mouse/etc is down).

cc @gspencergoog

cc @dkwingsmt


Recommend different HAproxy timeout value for cockroach sql

See https://github.com/cockroachdb/cockroach/issues/17184#issuecomment-322765249.

We have closed this issue because it is more than 3 years
old. If this issue is still relevant, please add a comment and re-open
the issue. Thank you for your contribution to CockroachDB docs!


Additional data stored in session cookies

I just read this question on stackoverflow: http://stackoverflow.com/questions/10512833/why-does-pyrocms-store-so-much-data-in-its-cookie/10513223 and to be honest - I can't think of a reason to really store the IP address, user-agent string, etc. in the cookie itself.
Is this by design and/or can we change that?
@philsturgeon @derekjones @pkriete @ericbarnes

Fixed by #3073.


MWPW-130778-update contentRoot to cc-shared

Update contentRoot to cc-shared

Resolves: MWPW-130778
Test URLs:

Before: https://main--cc--adobecom.hlx.page/creativecloud/video/hub/guides/avoid-continuity-errors-in-film?martech=off
After: https://main--cc--ruchika4.hlx.page/creativecloud/video/hub/guides/avoid-continuity-errors-in-film?martech=off

Note: Note do not merge this PR till the content has been moved in sharepoint also.

Content has been moved and this PR can be merged now.
cc @aishwaryamathuria


tests: Update runner-tests package.json

This gets rid of some of the JS errors from the runner-tests, but it looks like some of the tests are failing now.

I celebrated too early - even though those yarn install errors don't happen locally, they still happen in CI. Not sure how to proceed.

@saihaj Could you have a look at the complaints from yarn in the 'Subgraph Runner integration tests' ? I thought I had updated all the package.json files correctly and that part works locally, but somehow they fail in CI. Not sure how I would have to massage package.json to get past that.

This has been addressed by #4957


"invalid symbol name" when push contract action

Env: Ubuntu 16.04 x64, eos - v1.2.2 local single testnet.
I have this contract with action like:
// contract.hpp
...
// @abi action
void regorc(name oracle, name method, asset price, asset stake)

// contract.cpp
void contract::regorc(name oracle, name method, asset price, asset stake)
{
    print("regorc enter");
    ...
    print("regorc leave");
}

// contract.abi
{
      "name": "regorc",
      "base": "",
      "fields": [{
          "name": "oracle",
          "type": "name"
        },{
          "name": "method",
          "type": "name"
        },{
          "name": "price",
          "type": "asset"
        },{
          "name": "stake",
          "type": "asset"
        }
      ]
    }

and I have SYS token, and transfer SYS is fine.
so call this action:
cleos push action contract1234 regorc '["namenamename", "mmm", "1.0000 SYS", "1.0000 SYS"]' -p contract1234

it returns with error like:

It's never get the chance to call into regorc, because no regorc enter log prints.
Any ideas?

Hi @xJonathanLEI , are you using v1.2.2 ? What's your CORE_SYMBOL? Is it default SYS?

Yes I'm using v1.2.2, and my CORE_SYMBOL is SYS. The core symbol should not matter as the error thrown was from a call to is_valid() of the symbol, which simply performs checks on format, not the token existence.

You are right, I'm using your demo, and it works. So I think there's something wrong with my code. Thanks for help. :)


This is probably a typo

https://github.com/influxdata/influxdb-relay/blob/adaa2ea7bf97af592884fcfa57df1a2a77adb571/relay/http.go#L343
Line #344 as well, spotted this on a drive-by source code reading :) Not sure of the real-world implications

Fixed on https://github.com/vente-privee/influxdb-relay (https://github.com/vente-privee/influxdb-relay/commit/f58948363cfa59f040bc6f799a099bd77de6882e).


ACNA-272 - Remove explicit paging in console:ls command

Expected Behaviour
Listing integrations should just return all integrations without actual paging. If paging is desired, the command line can be piped through less or more.
Internally this means, the paging must be implemented on a script level where the API calls bear the page and size parameters but then just output all integrations continuously.
In essence the algorithm could be something like:
let hasMore = true
let page = 0
while (hasMore) {
   results = getIntegrations(page=0, size=50) // use max page size
   show results
   page++
   hasMore =  page < results.pages
}

Please let me know, whether you agree that this is an interesting feature and I can work on a PR.
Actual Behaviour
The console:ls command supports explicit paging paramaters page and size to page through the integrations.
Reproduce Scenario (including but not limited to)
n/a
Steps to Reproduce
n/a
Platform and Version
n/a
Sample Code that illustrates the problem
$aio console:ls
Success: Page 1 of 10, Showing 10 results of 179 total.`
....

Logs taken while reproducing problem
n/a

Unfortunately it seems the server is throttling it at a max of 50.
I tried:
# I have 98 integrations in my org
$ aio console:ls --pageSize=100
# it outputs: "Success: Page 1 of 2, Showing 50 results of 98 total."

Then, I also tried removing any page or pageSize parameters from the URL: https://github.com/adobe/aio-cli-plugin-console/blob/142f46a1716020b5118a181af35e061e1c5ac980/src/console-helpers.js#L131
Result:
# I have 98 integrations in my org
$ aio console:ls
# it outputs: "Success: Page 1 of 10, Showing 10 results of 98 total."

The url is the console_get_orgs_url value in your config.json.

yeah have a pr with linked promises for 50 page size coming tomorrow!
-brett
adobe.com

From: Shazron Abdullah<EMAIL_ADDRESS>Sent: Monday, May 13, 2019 22:34
To: adobe/aio-cli-plugin-console
Cc: Brett Rudd; Assign
Subject: Re: [adobe/aio-cli-plugin-console] Remove explicit paging in console:ls command (#36)
Unfortunately it seems the server is throttling it at a max of 50.
I tried:
I have 98 integrations in my org
$ aio console:ls --pageSize=100
it outputs: "Success: Page 1 of 2, Showing 50 results of 98 total."
Then, I also tried removing any page or pageSize parameters from the URL: https://github.com/adobe/aio-cli-plugin-console/blob/142f46a1716020b5118a181af35e061e1c5ac980/src/console-helpers.js#L131https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fadobe%2Faio-cli-plugin-console%2Fblob%2F142f46a1716020b5118a181af35e061e1c5ac980%2Fsrc%2Fconsole-helpers.js%23L131&data=02|01|rudd%40adobe.com|02535352cd024640695b08d6d82dcd24|fa7b1b5a7b34438794aed2c178decee1|0|0|636934088558824034&sdata=wnYOuEXm2NWiuGVfIZ1cH0jShRNMxZVDev4tWvit5nE%3D&reserved=0
Result:
I have 98 integrations in my org
$ aio console:ls
it outputs: "Success: Page 1 of 10, Showing 10 results of 98 total."
The url is the console_get_orgs_url value in your config.json.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHubhttps://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fadobe%2Faio-cli-plugin-console%2Fissues%2F36%3Femail_source%3Dnotifications%26email_token%3DAABS7BVMCW4ZRK2UXVKR26DPVJFNNA5CNFSM4HMOXMYKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODVKJ6YQ%23issuecomment-492085090&data=02|01|rudd%40adobe.com|02535352cd024640695b08d6d82dcd24|fa7b1b5a7b34438794aed2c178decee1|0|0|636934088558834029&sdata=VHm3stZ24IkeLkVnfwR1y5WyZGSTAjbRRqPJN0DhD0s%3D&reserved=0, or mute the threadhttps://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAABS7BQBMRYV33R3KL2YZH3PVJFNNANCNFSM4HMOXMYA&data=02|01|rudd%40adobe.com|02535352cd024640695b08d6d82dcd24|fa7b1b5a7b34438794aed2c178decee1|0|0|636934088558834029&sdata=SIX%2BmgFhEBpZMfMnfNg5IerEhZ%2F0FwVcsOc2maAn2JE%3D&reserved=0.

Unfortunately it seems the server is throttling it at a max of 50.

Right. But this issue is about not having to do paging at all any more on the command line. Rather the AIO console:ls should to the paged called internally and present the result in one fell swoop. Maybe the the JavaScript function returns an iterator while the command line run() function collects the iterator and just spits out the result ...

test org has 170+ integrations, during summit labs I saw > 500

implemented by @goya

Fix in #37


Proposal for backup infra controller redesign

Signed-off-by: Swapnil Mhamane<EMAIL_ADDRESS>What this PR does / why we need it:
This PR include the design proposal for https://github.com/gardener/etcd-backup-restore/issues/141.
Main goal is to use shared backup bucket among shoots. Things are explained in proposal docs in details.
Which issue(s) this PR fixes:
Fixes #
Special notes for your reviewer:
As per internal discussion we (@amshuman-kr @vlerenc @shreyas-s-rao  )agree on it. And it is ready to  be implemented. Please feel free to suggest any changes considering the extensibility proposal.
Release note:

NONE

@rfranzke Thank you for the review. I have update the doc addressing your queries.


Race condition w.r.t. reset

Since the UVC doesn't do any kind of reset at the start of the simulation (only when triggered), I need to implement drive a negedge on reset_n at time 0:
  bit reset_n = 1;
  bit clk;

  always #1 clk = ~clk;

  initial begin
    reset_n <= 0;
    @(negedge clk);
    @(negedge clk);
    reset_n <= 1;
  end

Normally I start a sequence in my test also at time 0:
virtual task run_phase(uvm_phase phase);
    apb_filter_tb::filter_sequence seq =
      apb_filter_tb::filter_sequence::type_id::create("seq", this);

    phase.raise_objection(this);

    seq.start(tb_env.master_agent.sequencer);

    phase.drop_objection(this);
  endtask

The problem is that there is a race condition here and the sequence process gets killed. This is because the sequencer's handle_reset() method stops all running sequences.

Why would you start the sequence at time 0?


Programming Exercise/Simplify local setup

Is your feature request related to a problem?

We have a private setup document for the local programming exercise setup with docker containers for jira, bamboo and bitbucket.
The first time setup process is time consuming and error-prone, because users, app-links, etc. have to be setup.
Describe the solution you'd like

We could preconfigure the 3 containers with users, app-links, etc., push the pre-configured images to a docker repository provided by the chair and use docker-compose to easily boot up the containers locally.
Describe alternatives you've considered

Another alternative would be to host the containers on a remote, but this would probably not be easily available to contributors outside of the main Artemis team (?).
Additional context

This was simplified by #1292 and will also be simpler due to #1290.
So I'm closing this issue for now.


VPN or Overlay Network?

Hi, cool project! I see you describe it as a VPN but is it more like an Overlay Network (like Nebula?) As a VPN I would have assumed you could route all your traffic through it with an external IP showing as the exit node. This looks more like a tool to allow optional connections between systems, right?

Hyprspace can forward all traffic to a node, see the bottom of https://github.com/hyprspace/hyprspace/discussions/3 for how, but, you are correct that without explicit configuration hyprspace does not forward traffic by default. (Not a dev btw)

Thanks @LynHyper ! https://github.com/hyprspace/hyprspace/discussions/3#discussioncomment-1037812 was exactly what I was looking for


RuntimeError: Event loop is closed

I am running this example from the documentation
from pydantic_ai import Agent

agent = Agent('openai:gpt-4o')

# First run
result1 = agent.run_sync('Who was Albert Einstein?')
print(result1.data)
#> Albert Einstein was a German-born theoretical physicist.

# Second run, passing previous messages
result2 = agent.run_sync(
    'What was his most famous equation?',
    message_history=result1.new_messages(),
)
print(result2.data)
#> Albert Einstein's most famous equation is (E = mc^2).

getting the below error with gemini-1.5-flash model.  -
Albert Einstein (1879-1955) was a German-born theoretical physicist widely regarded as one of the most influential scientists of all time. He is best known for his theory of relativity, which fundamentally changed our understanding of space, time, gravity, and the universe.  His work also included significant contributions to the development of quantum theory and statistical mechanics.  His mass–energy equivalence formula,  E=mc², is arguably the most famous equation in physics. Beyond his scientific achievements, Einstein was a humanist and pacifist, known for his advocacy of social justice and world peace.

Traceback (most recent call last):
  File "/Users/surajpisal/personal/ai-course/main.py", line 12, in <module>
    result2 = agent.run_sync(
              ^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/pydantic_ai/agent.py", line 220, in run_sync
    return asyncio.run(self.run(user_prompt, message_history=message_history, model=model, deps=deps))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 194, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 687, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/pydantic_ai/agent.py", line 172, in run
    model_response, request_cost = await agent_model.request(messages)
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/pydantic_ai/models/gemini.py", line 167, in request
    async with self._make_request(messages, False) as http_response:
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 210, in __aenter__
    return await anext(self.gen)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/pydantic_ai/models/gemini.py", line 205, in _make_request
    async with self.http_client.stream('POST', url, content=request_json, headers=headers) as r:
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 210, in __aenter__
    return await anext(self.gen)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1585, in stream
    response = await self.send(
               ^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1631, in send
    response = await self._send_handling_auth(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1659, in _send_handling_auth
    response = await self._send_handling_redirects(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1696, in _send_handling_redirects
    response = await self._send_single_request(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1732, in _send_single_request
    response = await transport.handle_async_request(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 394, in handle_async_request
    resp = await self._pool.handle_async_request(req)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpcore/_async/connection_pool.py", line 256, in handle_async_request
    raise exc from None
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpcore/_async/connection_pool.py", line 236, in handle_async_request
    response = await connection.handle_async_request(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpcore/_async/connection.py", line 103, in handle_async_request
    return await self._connection.handle_async_request(request)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpcore/_async/http11.py", line 135, in handle_async_request
    await self._response_closed()
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpcore/_async/http11.py", line 250, in _response_closed
    await self.aclose()
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpcore/_async/http11.py", line 258, in aclose
    await self._network_stream.aclose()
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/httpcore/_backends/anyio.py", line 53, in aclose
    await self._stream.aclose()
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/anyio/streams/tls.py", line 201, in aclose
    await self.transport_stream.aclose()
  File "/Users/surajpisal/personal/ai-course/.venv/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 1287, in aclose
    self._transport.close()
  File<EMAIL_ADDRESS>line 1210, in close
    super().close()
  File<EMAIL_ADDRESS>line 875, in close
    self._loop.call_soon(self._call_connection_lost, None)
  File<EMAIL_ADDRESS>line 795, in call_soon
    self._check_closed()
  File<EMAIL_ADDRESS>line 541, in _check_closed
    raise RuntimeError('Event loop is closed')
RuntimeError: Event loop is closed

Duplicate of #114, already fixed on main, I'll make a new release today.


Update dependency esbuild to v0.14.39

This PR contains the following updates:

Package
Change
Age
Adoption
Passing
Confidence

esbuild
0.14.38 -> 0.14.39

Release Notes

evanw/esbuild
v0.14.39
Compare Source

Fix code generation for export default and /* @__PURE__ */ call (#2203)
The /* @__PURE__ */ comment annotation can be added to function calls to indicate that they are side-effect free. These annotations are passed through into the output by esbuild since many JavaScript tools understand them. However, there was an edge case where printing this comment before a function call caused esbuild to fail to parenthesize a function literal because it thought it was no longer at the start of the expression. This problem has been fixed:
// Original code
export default /* @__PURE__ */ (function() {
})()

// Old output
export default /* @__PURE__ */ function() {
}();

// New output
export default /* @__PURE__ */ (function() {
})();

Preserve ... before JSX child expressions (#2245)
TypeScript 4.5 changed how JSX child expressions that start with ... are emitted. Previously the ... was omitted but starting with TypeScript 4.5, the ... is now preserved instead. This release updates esbuild to match TypeScript's new output in this case:
// Original code
console.log(<a>{...b}</a>)

// Old output
console.log(/* @__PURE__ */ React.createElement("a", null, b));

// New output
console.log(/* @__PURE__ */ React.createElement("a", null, ...b));

Note that this behavior is TypeScript-specific. Babel doesn't support the ... token at all (it gives the error "Spread children are not supported in React").

Slightly adjust esbuild's handling of the browser field in package.json (#2239)
This release changes esbuild's interpretation of browser path remapping to fix a regression that was introduced in esbuild version 0.14.21. Browserify has a bug where it incorrectly matches package paths to relative paths in the browser field, and esbuild replicates this bug for compatibility with Browserify. I have a set of tests that I use to verify that esbuild's replication of this Browserify is accurate here: https://github.com/evanw/package-json-browser-tests. However, I was missing a test case and esbuild's behavior diverges from Browserify in this case. This release now handles this edge case as well:

entry.js:
require('pkg/sub')

node_modules/pkg/package.json:
{
  "browser": {
    "./sub": "./sub/foo.js",
    "./sub/sub.js": "./sub/foo.js"
  }
}

node_modules/pkg/sub/foo.js:
require('sub')

node_modules/sub/index.js:
console.log('works')

The import path sub in require('sub') was previously matching the remapping "./sub/sub.js": "./sub/foo.js" but with this release it should now no longer match that remapping. Now require('sub') will only match the remapping "./sub/sub": "./sub/foo.js" (without the trailing .js). Browserify apparently only matches without the .js suffix here.

Configuration
📅 Schedule: At any time (no schedule defined).
🚦 Automerge: Disabled due to failing status checks.
♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.

[ ] If you want to rebase/retry this PR, click this checkbox.

This PR has been generated by Renovate Bot.

⚠ Artifact update problem
Renovate failed to update an artifact related to this branch. You probably do not want to merge this PR as-is.
♻ Renovate will retry this branch, including artifacts, only when one of the following happens:

any of the package files in this branch needs updating, or
the branch becomes conflicted, or
you click the rebase/retry checkbox if found above, or
you rename this PR's title to start with "rebase!" to trigger it manually

The artifact failure details are included below:
File name: pnpm-lock.yaml

added 1 package, and audited 2 packages in 672ms

found 0 vulnerabilities
Scope: all 5 workspace projects
Progress: resolved 1, reused 0, downloaded 0, added 0
Progress: resolved 35, reused 0, downloaded 34, added 0
Progress: resolved 55, reused 0, downloaded 38, added 0
Progress: resolved 134, reused 0, downloaded 109, added 0
Progress: resolved 277, reused 0, downloaded 247, added 0
.                                        |  WARN  deprecated<EMAIL_ADDRESS>Progress: resolved 430, reused 0, downloaded 401, added 0
packages/add-changeset                   |  WARN  deprecated<EMAIL_ADDRESS>Progress: resolved 599, reused 0, downloaded 566, added 0
packages/add-changeset                   |  WARN  deprecated<EMAIL_ADDRESS>packages/add-changeset                   |  WARN  deprecated<EMAIL_ADDRESS>packages/add-changeset                   |  WARN  deprecated<EMAIL_ADDRESS>packages/add-changeset                   |  WARN  deprecated<EMAIL_ADDRESS>Progress: resolved 727, reused 0, downloaded 704, added 0
 ERR_PNPM_PEER_DEP_ISSUES  Unmet peer dependencies

packages/add-changeset
└─┬ jest-runner-eslint
  └── ✕ missing peer eslint@"^6 || ^7 || ^8"
Peer dependencies that should be installed:
  eslint@"^6 || ^7 || ^8"

packages/extract-package-details
└─┬ jest-runner-eslint
  └── ✕ missing peer eslint@"^6 || ^7 || ^8"
Peer dependencies that should be installed:
  eslint@"^6 || ^7 || ^8"

packages/find-and-replace-all
└─┬ jest-runner-eslint
  └── ✕ missing peer eslint@"^6 || ^7 || ^8"
Peer dependencies that should be installed:
  eslint@"^6 || ^7 || ^8"


Execution context refactor

This change is

Current dependencies on/for this PR:

main

PR #457   👈

This comment was auto-generated by Graphite.


Feat/cache html

cache components whose models are associated with resource typ

Codecov Report

Merging #106 into test/performance-troubleshooting will decrease coverage by 10.42%.
The diff coverage is 25.35%.

@@                           Coverage Diff                           @@
##             test/performance-troubleshooting     #106       +/-   ##
=======================================================================
- Coverage                               79.14%   68.71%   -10.43%
- Complexity                                217      223        +6
=======================================================================
  Files                                      31       35        +4
  Lines                                     935     1106      +171
  Branches                                   79      108       +29
=======================================================================
+ Hits                                      740      760       +20
- Misses                                    153      301      +148
- Partials                                   42       45        +3

Impacted Files
Coverage Δ
Complexity Δ

...com/sinnerschrader/aem/react/cache/CachedHtml.java
0% <0%> (ø)
0 <0> (?)

...ain/java/com/sinnerschrader/aem/react/api/Cqx.java
92.3% <0%> (-7.7%)
6 <0> (ø)

...nerschrader/aem/react/cache/CacheStatsCounter.java
0% <0%> (ø)
0 <0> (?)

...der/aem/react/metrics/ComponentMetricsService.java
87.17% <0%> (-4.72%)
11 <0> (ø)

...om/sinnerschrader/aem/react/ReactScriptEngine.java
79.43% <100%> (-0.15%)
22 <0> (ø)

...erschrader/aem/react/ReactScriptEngineFactory.java
78.63% <100%> (+0.56%)
17 <1> (ø)
:arrow_down:

...schrader/aem/react/JavacriptEnginePoolFactory.java
100% <100%> (ø)
3 <2> (ø)
:arrow_down:

...a/com/sinnerschrader/aem/react/cache/CacheKey.java
16.32% <16.32%> (ø)
1 <1> (?)

...com/sinnerschrader/aem/react/api/ModelFactory.java
57.74% <37.5%> (-3.2%)
8 <1> (+1)

...n/java/com/sinnerschrader/aem/react/CqxHolder.java
66.66% <66.66%> (-8.34%)
5 <5> (ø)

... and 7 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 364e60d...e20650e. Read the comment docs.


Bundled extension does not appear to be minified

2022.9.13271012
Looking over extension.js in the shipped extension build, I noticed that it is not minified:

Can these files be minified to reduce the extension size?

Whoops, wrong repo/extension


Keylogger miss some keys combination

If I Hold Control[Ctrl] Key and press 'a' for example it logged and while holding Ctrl i pressed another letter 'c' for example it is logged like :
[Control + A]
instead of :
[Control + A] [Control + C]

the problem occurs also when i press Ctrl key and for example Up arrow and will holding Ctrl I pressed Down arrow  it is logged like :
[Control + Up] [Down]
Instead of :
[Control + Up] [Control + Down]

This is because of how the keys are processed.
One way to fix this would be to record the keystates of modifier keys with GetKeyState/GetAsyncKeyState functions, when the keys are being cleared from the pressedkeys lists

Now that I think about it I'm not sure this would be easy to do, as far as logging keys accurately, given the logic already implemented.

@d3agle I've come to realize that keylogging is never easy! hahaha
There are a few solutions I can think of. Maybe we should restrict the clearing of modifiers even more.

@yankejustin, Indeed.  How can we restrict the modifiers even more?  I've thought about some solutions but because we are handling the logging of keys in the KeyUp event, we might have to change the way we log the keys altogether.

Does the keylogger catch all the keystrokes and combinations

@bitterypaul Not 10p% sure if this is still an issue.
@d3able Is this issue still relevant?

100%*
@d3agle
On my phone currently..Please read the above comment. :)

@yankejustin, Yes it is, I took a look at the HotkeySet class and it looks like we might be able to control logging combinations of keys to accomplish this :D

I mean, it's not really an "issue" per say, however it's something that could be looked into a bit more.  I'm not really sure how we would do this to be honest, but I may take a look at it a little later today.
@yankejustin, How is your registry editor coming along? :D

@d3agle Good. Currently about to implement the ability to add RegistryKeys to the ListView. After that works, I will transfer the logic over to the Client so it will finally retrieve RegistryKeys from the Client. :)

@yankejustin I've created one, named regedit.


Encoding of generated files

Under Widows 10, I have the problem that the generated java files have the Windows default encoding, not UTF-8, which garbles the µ identifier in my case.
After trying every way to set an encoding in Maven or my IDE, I assume the annotation processor itself must take care of it. I think the relevant code location is GenCode:146:
Filer.createSourceFile(genClassName).openWriter()
As far as I understand, openWriter() simply wraps the underlying output stream with am OutputStreamWriter without setting an encoding, which results in using the system default (and not the encoding set for javac etc). I haven't tested it, but I would assume that using something like
new OutputStreamWriter(Filer.createSourceFile(genClassName).openOutputStream(), "UTF8")
could probably solve the problem. Of course instead of hard-coding, this could be also a parameter of the annotation processor (although I'm not sure in which scenarios would require another encoding)

Yes, we very certainly always want to use UTF-8. And your suggested fix looks fine (with java.nio.charset.StandardCharsets.UTF_8instead of "UTF8"). do you want to make a PR?

fixed by f775a81516a4640c02817767be9638254d790b88


Unable to create pcluster using version 3.3.1. I

Facing Issues while creating cluster using pcluster version 3.3.1 . Normally, I create the cluster through this version but today(22-Dec-2022) I faced this issues.
When I try to troubleshoot the issue I found some errors
Errors:
Ran ["yum", "-y", "install", "/opt/parallelcluster/sources/nice-dcv-2022.1-13300-el7-x86_64/nice-dcv-gl-2022.1.973-1.el7.x86_64.rpm"] returned 1
http://mirror.centos.org/centos/7/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 503 - Service Unavailable
Error: Package: nice-dcv-gl-2022.1.973-1.el7.x86_64 (/nice-dcv-gl-2022.1.973-1.el7.x86_64) Requires: xorg-x11-utils
cfnbootstrap.packages.requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
Don't know much about them but believe that some issue happens. If it is possible pls rectify asap.

try using package sudo yum install nice-dcv-gl-2022.2.983-1.el7.x86_64.rpm

Hello @ehimgoy,
The error appears to be a networking issue. Is the problem still reproducible?
If so, could you kindly share the cluster configuration and chef-client logs (/var/log/chef-client.log)? Ensure to remove any sensitive information.
It could be that you're using a Custom AMI that doesn't have xorg-x11-utils

Hello @EddyMM
I think it's not an issue with the custom ami because I have one running cluster with the same configuration. The real issue occurs after the release of pcluster version 3.4.0 . After 22nd Dec I am not able to create a very simple cluster. I used versions 3.1.1 and 3.3.1. Both are unable to create cluster and cluster creation failed on the HeadNode wait condition. Although this is not case before the release of 3.4.0.
On my request can you just create a cluster with any of the pcluster version like 3.1.1 or 3.3.1. If you get any success then let me know

Hi ehimgoy,
We have tests running daily and are able to create clusters. There are two possible causes:

mirror.centos.org might have temporarily down.
The subnet(s) for your cluster does not have Internet connection.
To verify this:
Can you create a cluster and see if problem persisst?
Can you make sure the subnet(s) have Internet access? To verify this, you can create an instance(s) in the subnet(s), and run ping mirror.centos.org -c 5

Hi hanwen-pcluste.
I tried to create cluster not just with centos but also with the alinux2 and it failed on the same Head Node wait condition.
And also checked the subnet and it have the internet connection.
One more thing I would like to add that I am able to create cluster with pcluster version 3.4.0 but not with the earlier versions like 3.1.1 and 3.3.1
So, my concern related to the version. After the release of 3.4.0, not able to create cluster with earlier versions.

I manually created clusters with Alinux2 and CentOS7. The creations were successful.
Could you provide the cluster configuration file (without sensitive information) and /var/log/chef-client.log to help us further the investigation?
Alternatively, could you describe in details of what customization are there:

Is a custom AMI used? If yes, how was the AMI created?
Is a custom action script used?
What instance type is used for head node?
Is the head node and compute node in the same subnet?
Any other customization in the cluster configuration file?

Thank you!


[Q] installed in full on windows 10 but I can't run the program.

Hi.
Want to get NIT BAT and SDT for a received DTT mux and output changes.
But that may sound very simple it is anything but
My windows 10 laptop I installed this on has multiple programs which if you double click you either get a command prompt with flashing cursor and sits there doing nothing or the command prompt window flashes for a split second and vanishes
Without a .bat file thus program us useless as I cannot use it. Either it us a command line program or it isn't. If it us nit a command line program which program do I double click on to make this work please?
Thank you

And btw where can I go d older versions before 2018? Only goes back to v3.10 do where are v1 and V2 releases?  And which was the last to work with Windows XP?

Either it us a command line program or it isn't. If it us nit a command line program which program do I double click on to make this work please?

TSDuck is a set of command line tools. There is no GUI.  It seems that you need to read the documentation first. This is a flexible, and admittedly complex, set of tools for TV engineers. This is absolutely not a point-and-click tool for beginners.
Since the commands can be complex, you must use a modern shell and shell scripts. Use either Windows PowerShell or Cygwin bash. Using the 40-years-old DOS command line window is hopeless.
I suggest to browse through the user's guide. Since it is pretty big, I recommend to read the table of contents, the intro, the description of the tsp command, browse through the examples chapter.

where can I go d older versions before 2018? Only goes back to v3.10 do where are v1 and V2 releases? And which was the last to work with Windows XP?

You can't. Binary installers for older versions, before 3.10, were removed long ago. The storage space on GitHub is not infinite. The Git code repository goes backward to version 3.0. Version 1 and 2 were not open source. If you are interested, see this presentation for an overview of TSDuck history.

Thank you for that response. My windows 10 laptop DOES have Powershell 5 so as far as I know up to date.
It just LOOKS LIKE command prompt
I just need to know
1 how to set it up to get the tables from my Linux set top box which has an internal IP on my home network;
2 let TSDuck read this data;
3 output the tables;
4 then send only changes to a file or website or email
Thank you again
On 25/03/2023 13:04 Thierry Lelegard<EMAIL_ADDRESS>wrote:

Either it us a command line program or it isn't. If it us nit a command line program which program do I double click on to make this work please?

TSDuck is a set of command line tools. There is no GUI.  It seems that you need to read the documentation first. This is a flexible, and admittedly complex, set of tools for TV engineers. This is absolutely not a point-and-click tool for beginners.
Since the commands can be complex, you must use a modern shell and shell scripts. Use either Windows PowerShell or Cygwin bash. Using the 40-years-old DOS command line window is hopeless.
I suggest to browse through the user's guide. Since it is pretty big, I recommend to read the table of contents, the intro, the description of the tsp command, browse through the examples chapter.
where can I go d older versions before 2018? Only goes back to v3.10 do where are v1 and V2 releases? And which was the last to work with Windows XP?

You can't. Binary installers for older versions, before 3.10, were removed long ago. The storage space on GitHub is not infinite. The Git code repository goes backward to version 3.0. Version 1 and 2 were not open source. If you are interested, see this presentation for an overview of TSDuck history.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

With Powershell the file extension should be .PS1 not .exe
If I go to tstables.exe
All I get is a flashing cursor. Thus won't work unless it was tstables.ps1
That would give a usable interface to use. Instead I get the attached image
Thank you

On 25/03/2023 13:04 Thierry Lelegard @.***> wrote:

Either it us a command line program or it isn't. If it us nit a command line program which program do I double click on to make this work please?
TSDuck is a set of command line tools. There is no GUI.  It seems that you need to read the documentation first. This is a flexible, and admittedly complex, set of tools for TV engineers. This is absolutely not a point-and-click tool for beginners.

Since the commands can be complex, you must use a modern shell and shell scripts. Use either Windows PowerShell or Cygwin bash. Using the 40-years-old DOS command line window is hopeless.
I suggest to browse through the user's guide https://tsduck.io/download/docs/tsduck.pdf. Since it is pretty big, I recommend to read the table of contents, the intro, the description of the tsp command, browse through the examples chapter.

where can I go d older versions before 2018? Only goes back to v3.10 do where are v1 and V2 releases? And which was the last to work with Windows XP?
You can't. Binary installers for older versions, before 3.10, were removed long ago. The storage space on GitHub is not infinite. The Git code repository goes backward to version 3.0. Version 1 and 2 were not open source. If you are interested, see this presentation https://tsduck.io/download/docs/tsduck-project.pdf for an overview of TSDuck history.

—
Reply to this email directly, view it on GitHub https://github.com/tsduck/tsduck/issues/1189#issuecomment-1483818091, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIE2IZ74MEPXBTYK6HGJTPLW53T5HANCNFSM6AAAAAAWHPLSN4.
You are receiving this because you authored the thread. https://github.com/notifications/beacon/AIE2IZYIG4FXCROYV4SZFMLW53T5HA5CNFSM6AAAAAAWHPLSN6WGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTSYOFCGW.gifMessage ID: @.***>

Ok. Realised the cursor enables me to type onto it. So I now need to know how to get it to target an IP address on my home network to get the data  to appear
Thanks.
On 25/03/2023 13:04 Thierry Lelegard<EMAIL_ADDRESS>wrote:

Either it us a command line program or it isn't. If it us nit a command line program which program do I double click on to make this work please?

TSDuck is a set of command line tools. There is no GUI.  It seems that you need to read the documentation first. This is a flexible, and admittedly complex, set of tools for TV engineers. This is absolutely not a point-and-click tool for beginners.
Since the commands can be complex, you must use a modern shell and shell scripts. Use either Windows PowerShell or Cygwin bash. Using the 40-years-old DOS command line window is hopeless.
I suggest to browse through the user's guide. Since it is pretty big, I recommend to read the table of contents, the intro, the description of the tsp command, browse through the examples chapter.
where can I go d older versions before 2018? Only goes back to v3.10 do where are v1 and V2 releases? And which was the last to work with Windows XP?

You can't. Binary installers for older versions, before 3.10, were removed long ago. The storage space on GitHub is not infinite. The Git code repository goes backward to version 3.0. Version 1 and 2 were not open source. If you are interested, see this presentation for an overview of TSDuck history.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

Even typing --help does nit do anything. So please can you give me an instruction to get the program to read my set top boxes via the local IP addresses
Thank you.
On 25/03/2023 13:04 Thierry Lelegard<EMAIL_ADDRESS>wrote:

Either it us a command line program or it isn't. If it us nit a command line program which program do I double click on to make this work please?

TSDuck is a set of command line tools. There is no GUI.  It seems that you need to read the documentation first. This is a flexible, and admittedly complex, set of tools for TV engineers. This is absolutely not a point-and-click tool for beginners.
Since the commands can be complex, you must use a modern shell and shell scripts. Use either Windows PowerShell or Cygwin bash. Using the 40-years-old DOS command line window is hopeless.
I suggest to browse through the user's guide. Since it is pretty big, I recommend to read the table of contents, the intro, the description of the tsp command, browse through the examples chapter.
where can I go d older versions before 2018? Only goes back to v3.10 do where are v1 and V2 releases? And which was the last to work with Windows XP?

You can't. Binary installers for older versions, before 3.10, were removed long ago. The storage space on GitHub is not infinite. The Git code repository goes backward to version 3.0. Version 1 and 2 were not open source. If you are interested, see this presentation for an overview of TSDuck history.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

So I have the latest version installed on windows 10. But if I want to use tstables there should be a command to send to get the data. My satellite receiver us on internal address
<IP_ADDRESS>
So how do I get TSDuck to read that IP address and send the data to a file or email? I followed instructions but it just will not work.
Thank you.
On 25/03/2023 13:04 Thierry Lelegard<EMAIL_ADDRESS>wrote:

Either it us a command line program or it isn't. If it us nit a command line program which program do I double click on to make this work please?

TSDuck is a set of command line tools. There is no GUI.  It seems that you need to read the documentation first. This is a flexible, and admittedly complex, set of tools for TV engineers. This is absolutely not a point-and-click tool for beginners.
Since the commands can be complex, you must use a modern shell and shell scripts. Use either Windows PowerShell or Cygwin bash. Using the 40-years-old DOS command line window is hopeless.
I suggest to browse through the user's guide. Since it is pretty big, I recommend to read the table of contents, the intro, the description of the tsp command, browse through the examples chapter.
where can I go d older versions before 2018? Only goes back to v3.10 do where are v1 and V2 releases? And which was the last to work with Windows XP?

You can't. Binary installers for older versions, before 3.10, were removed long ago. The storage space on GitHub is not infinite. The Git code repository goes backward to version 3.0. Version 1 and 2 were not open source. If you are interested, see this presentation for an overview of TSDuck history.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>


No mode, owner, group specified in File['/etc/aptly.conf']

The File resource which defined /etc/aptly.conf ignores the $user parameter, making it impossible to execute the commands as any user but 'root' (the default user).

What permissions does your aptly.conf file end up with?

# ls -l /etc/aptly.conf
-rw-r--r-- 1 root root 71 Jul  6 19:07 /etc/aptly.conf

This happens even when we set $user = 'aptly'

@amosshapira Can you paste the error you're getting in to this issue so that we can see it? It seems odd because your /etc/aptly.conf is world-readable, but only writable by root, which should work fine. The aptly user won't be able to write to that file, but it should be able to read.

@ajlanghorn looks like the report I passed wasn't complete. When I tried to re-create this on a different Vagrant box it passed fine, still with /etc/aptly.conf being owned by root but other files owned by a dedicated aptly user. I'll close this for now as it seems that the problem must be somewhere else.


Are there any plans to interrupt int1

For example,Update the tf flag

pushfd
or dword ptr [esp],100h
popfd

Is there a better model?

The first interrupt vector gets hooked in the old hardware breakpoint manager so I'm not sure what you mean. Is the code you posted not handled correctly?

I looked at the debugger code for the VBox，It uses int3 breakpoint manager.What are the drawbacks of this to be found?

I looked at the debugger code for the VBox，It uses int3 breakpoint manager.What are the drawbacks of this to be found?

I'm not sure what the advantage of an EPT breakpoint is

I'm not sure what the advantage of an EPT breakpoint is


[ENG-5335] Dep-group: html sanitization

Purpose
Bump bleach  and Markupsafe to the newest version
Changes
Specified Markupsafe in requirements.txt, fixed bleach usages to work with newest
QA Notes
Css sanitization may be broken
Documentation

Side Effects

Ticket
ENG-5335

D'oh! Hit enter too fast.  The other issue is that v6.0.0 now requires tags and attributes to be sets, not lists: https://bleach.readthedocs.io/en/latest/changes.html#version-6-0-0-january-23rd-2023

Looks good! I made two small amendments to the last commit, but otherwise A+!  Merged.