wrong entity detection

#./data/nlu.md
intent:greet

hey
hello
hi
hello there
good morning
good evening

intent:goodbye

bye
goodbye
have a nice day
see you around
bye bye
see you later

#config.json
{
"pipeline": "spacy_sklearn",
"path" : "./models",
"project": "nlu",
"data" : "./data/nlu.md"
}
#training
python -m rasa_nlu.train -c config.json --fixed_model_name current1
#server
python -m rasa_nlu.server -c config.json
#test
$ curl -s  -XPOST <IP_ADDRESS>:5000/parse -d '{"q":"thank you very much",  "project": "nlu", "model": "current1"}' | jq .
{
"entities": [
{
"start": 0,
"extractor": "ner_crf",
"end": 5,
"value": "thank",
"entity": "entity1"    ===================> wrong
},
{
"start": 6,
"extractor": "ner_crf",
"end": 9,
"value": "you",
"entity": "entity1"  ===================> wrong
},
{
"start": 10,
"extractor": "ner_crf",
"end": 14,
"value": "very",
"entity": "entity1"
},
{
"start": 15,
"extractor": "ner_crf",
"end": 19,
"value": "much",
"entity": "entity1"  ===================> wrong
}
],
"intent": {
"confidence": 0.7133572451492164,
"name": "goodbye"
},
"text": "thank you very much",
"intent_ranking": [
{
"confidence": 0.7133572451492164,
"name": "goodbye"
},
{
"confidence": 0.2866427548507836,
"name": "greet"
}
]
}

$ python -c "import rasa_nlu; print(rasa_nlu.version);"
0.10.5
$ pip show spacy
Name: spacy
Version: 2.0.5

Maybe it is because of the very small dataset? 1 example per entity might be too low a number to produce any results at all, maybe. Have you tried increasing the number of examples for entities ?

Why use the entities at all? Do you need more than hello and goodbye intents? Eitherway @parthsharma1996 is right and you need to increase your training data size.
I'm going to close, but post back here if a larger dataset doesn't improve performance.

nlu.md.txt

intent:thankyou

thank you very much !
that is helpful !

intent:continue_inform

how about item5 and s3
how about item3 and s2
how about item2 and s2
how about item4 and s2
how about item5 and s2
how about item1 and s4
how about item4 and s4
how about item7 and s2
how about item7
how about item1
how about item1 and s3
how about item3 and s1
how about item5 and s1
how about item7 and s1
how about item7 and s3
how about item5
how about item4 and s3
how about item3 and s4
how about item8 and s4
how about item6 and s2
how about item6 and s1
how about item2 and s4
how about item1 and s2
how about item5 and s4
how about item8 and s2
how about item3 and s3
how about item2 and s3
how about item2
how about s3
how about s4
how about item4
how about item6
how about item4 and s1
how about item3
how about s2
how about item6 and s4
how about item7 and s4
how about item8 and s1
how about item8 and s3
how about item8
how about item6 and s3
how about item2 and s1
how about s1
how about item1 and s1

intent:query

please show service s4
check service s2 item6
please show service s1 item1
please show service s1 item8
please show service s2 item6
please show service s4 item4
check service s3 item8
check service s4 item8
please show service item3
please show service s2 item3
please show service s3 item5
check service s1 item8
check service s1 item7
check service item8
check service s1 item5
check service s1 item4
check service s2 item2
please show service s2 item4
please show service item4
check service item5
please show service s1 item6
check service s1 item1
query
please show service s3 item6
check service item2
please show service item6
check service s3 item7
please show service s2 item2
check service s4 item6
check service item6
check service s4
please show service s4 item7
check service s4 item5
please show service s1 item2
please show service item1
check service s1
please show service s3 item7
check service s3 item5
please show service s2 item7
check service item1
check service s2 item1
please show service s3
please query
please show service s1
check service s4 item3
check service s2 item8
please show service s3 item8
check service s3 item2
please show service s2 item8
check service s1 item2
please show service s4 item3
please show service s2 item1
check service s4 item1
check service s2 item4
check service s3 item1
check service s2
check service s3 item6
check service s4 item2
check service item4
please show service s3 item2
check service s2 item5
check service s1 item3
check service s1 item6
please show service s2
please show service s1 item3
please show service s1 item7
please show service s4 item5
check service s2 item3
please show service s4 item1
please show service s3 item1
check service s4 item4
check service s3
please show service s4 item8
please show service s3 item4
check service s3 item3
check service s2 item7
check service item3
please show service item5
please show service item7
please show service s1 item4
please show service s2 item5
please show service s1 item5
please show service item8
please show service s4 item6
please show service s4 item2
check service s4 item7
check service item7
please show service s3 item3
please show service item2
check service s3 item4

intent:greet

hi bot
hello
hello bot
Hey there, bot

intent:inform

item2
item5
s3
s1
s2
item6
item8
item3
s4
item7
item4
item1

@parthsharma1996  @wrathagom   thanks for your reply.

after i added more training data.
still can not parse  'Thank you very much' right.

$ curl -s  -XPOST <IP_ADDRESS>:5000/parse -d '{"q":"thank you very much",  "project": "nlu", "model": "current"}' | jq .
{
"entities": [
{
"start": 10,
"extractor": "ner_crf",
"end": 14,
"value": "very",
"entity": "service"
},
{
"start": 15,
"extractor": "ner_crf",
"end": 19,
"value": "much",
"entity": "item"
}
],
"intent": {
"confidence": 0.6803716574426739,
"name": "thankyou"
},
"text": "thank you very much",
"intent_ranking": [
{
"confidence": 0.6803716574426739,
"name": "thankyou"
},
{
"confidence": 0.1765147169998018,
"name": "greet"
},
{
"confidence": 0.06148735605846666,
"name": "continue_inform"
},
{
"confidence": 0.05053404378794035,
"name": "query"
},
{
"confidence": 0.03109222571111734,
"name": "inform"
}
]
}


feat(dashmate): report pulled images during update

Issue being fixed or feature implemented

Dashmate should show info about the images of the service that has been pull during update https://github.com/dashpay/platform/issues/105
What was done?

dashmate update command now states which images were updating during pull
Added --format flag to the dashmate update command
Fixed incorrect node services running check

How Has This Been Tested?

Locally
CI
Devnet

Breaking Changes

No
Checklist:

[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have added or updated relevant unit/integration/functional/e2e tests
[x] I have made corresponding changes to the documentation

For repository code-owners and collaborators only

[x] I have assigned this pull request to a milestone

Test results:
Default output:

Format json:
$ dashmate update --format=json
[{"serviceName":"core","title":"Core","pulled":false,"image":"dashpay/dashd:19.2.0"},{"serviceName":"drive_abci","title":"Drive ABCI","pulled":false,"image":"dashpay/drive:0.24"},{"serviceName":"drive_tenderdash","title":"Drive Tenderdash","pulled":true,"image":"dashpay/tenderdash:0.11.2"},{"serviceName":"dapi_api","title":"DAPI API","pulled":false,"image":"dashpay/dapi:0.24"},{"serviceName":"dapi_envoy","title":"DAPI Envoy","pulled":false,"image":"dashpay/envoy:0.24"},{"serviceName":"dashmate_helper","title":"Dashmate Helper","pulled":false,"image":"dashpay/dashmate-helper:0.24"}]


[5.4] Ability to set cc and bcc for mail notifications

This adds the ability to set a cc and bcc for a mail notification message.

At last! Thanks! :)


Testnet fails to bind to grpc port

Probably it was not a bug, or it was fixing by one of the many improvements to the code that were happening at the moment.


Button 'autres' declaration-mobile

When you click on 'autres', nothing happens
We can't let that for the delivery,
We need to discuss of that to see if we let the button or remove it.
Link to ticket #326

This ticket has been merge with #326


internal/atlas: images are never GCed

Ebitengine Version
48f3d431893d503e263dbb17bc5002d3ff5fd3cb
Operating System

[ ] Windows
[ ] macOS
[ ] Linux
[ ] FreeBSD
[ ] OpenBSD
[ ] Android
[ ] iOS
[ ] Nintendo Switch
[ ] PlayStation 5
[ ] Xbox
[ ] Web Browsers

Go Version (go version)
go version go1.21.6 darwin/arm64
What steps will reproduce the problem?
Create an image and see the internal texture by EBITENGINE_INTERNAL_IMAGES_KEY.
What is the expected result?
A part of the iamge region on the texture is deallocated after the image is no longer used.
What happens instead?
A part of the iamge region on the texture was never deallocated.
Anything else you feel useful to add?
This doesn't happen on 2.6.

Culprit https://github.com/hajimehoshi/ebiten/commit/97d1e073e2fa5e4b94af397a0e27963eb7d01d91


Proxy readiness and make logs messages consistent

Description

Proxy readiness and make logs messages consistent
Motivation and Context
Closes #145 - removing the need for additional methods in the faas-middleware package, and fixing an underlying bug in the way the readiness endpoint was called in one of the handlers. These other handlers also printed out log messages when using the readiness proxying, so that's been changed, so that it only happens when the User-Agent is not from Kubernetes.
Also: Makes the response messages consistent between HTTP, streaming and serializing modes.
How Has This Been Tested?
Tested with various processes as a Go process on a Linux host.
Including the unit testing added by Lucas in the reviewed PR.
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[x] Breaking change (fix or feature that would cause existing functionality to change)

The log format is changed, if users are relying on parsing this, they can stay on an older version until they can migrate.
However all OF templates use either classic-watchdog or HTTP mode.

Based on the description, this sounds like it may also close https://github.com/openfaas/of-watchdog/issues/144.


[MAJOR] Init as NPM package.

This will init the repository as an NPM package.

@iliqportals Please have a look at this PR but don't merge it!
After your approval I will bump the version to 1.0.0, publish the package and merge it.

At least one approved review is required by reviewers with write access :D


Button onPressed highlight not working when in ListView

Steps to Reproduce
Run this app:
import 'package:flutter/material.dart';

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({super.key});

  @override
  Widget build(BuildContext context) {
    return MaterialApp(
        title: 'Flutter Demo',
        home: Scaffold(
          appBar: AppBar(title: const Text("Test")),
          body: Center(
            child: Column(
              children: <Widget>[
                OutlinedButton(
                  onPressed: () {},
                  style: OutlinedButton.styleFrom(
                      splashFactory: NoSplash.splashFactory),
                  child: const Text("Working"),
                ),
                Expanded(
                    child: ListView(
                  children: [
                    OutlinedButton(
                      onPressed: () {},
                      style: OutlinedButton.styleFrom(
                          splashFactory: NoSplash.splashFactory),
                      child: const Text("Not working"),
                    ),
                  ],
                )),
              ],
            ),
          ),
        ));
  }
}

Environment: Android 13

briefly tap on "Working" button, you will notice a change of the background color to a light blue as expected
briefly tap on "Not working" button
Expected results: exact same behavior as with "Working" button: the background of the button should change to a light blue
Actual results: no visual change

Note:

once you tap and hold for a little longer, the background color will change to a light blue color as expected
working as expected in Chrome browser

Logs

Analyzing flutter_ui_test...
No issues found! (ran in 6.3s)

[√] Flutter (Channel stable, 3.3.10, on Microsoft Windows [Version 10.0.19044.2364], locale de-DE)
    • Flutter version 3.3.10 on channel stable at C:\sdk\flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 135454af32 (4 weeks ago), 2022-12-15 07:36:55 -0800
    • Engine revision 3316dd8728
    • Dart version 2.18.6
    • DevTools version 2.15.0

[√] Android toolchain - develop for Android devices (Android SDK version 33.0.1)
    • Android SDK at C:\sdk\android
    • Platform android-33, build-tools 33.0.1
    • Java binary at: C:\scoop\apps\android-studio\current\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 11.0.13+0-b1751.21-8125866)
    • All Android licenses accepted.

[√] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[!] Visual Studio - develop for Windows (Visual Studio Professional 2019 16.9.4)
    • Visual Studio at C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional
    • Visual Studio Professional 2019 version 16.9.31205.134
    • Windows 10 SDK version 10.0.19041.0
    X Visual Studio is missing necessary components. Please re-run the Visual Studio installer for the "Desktop development with C++" workload, and include these components:
        MSVC v142 - VS 2019 C++ x64/x86 build tools
         - If there are multiple build tool versions available, install the latest
        C++ CMake tools for Windows
        Windows 10 SDK

[√] Android Studio (version 2021.3)
    • Android Studio at C:\scoop\apps\android-studio\current
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.13+0-b1751.21-8125866)

[√] Proxy Configuration
    • HTTP_PROXY is set
    • NO_PROXY is localhost,<IP_ADDRESS>,::1
    • NO_PROXY contains localhost
    • NO_PROXY contains ::1
    • NO_PROXY contains <IP_ADDRESS>

[√] Connected device (4 available)
    • Pixel 4a (mobile) • xxxx • android-arm64  • Android 13 (API 33)
    • Windows (desktop) • windows        • windows-x64    • Microsoft Windows [Version 10.0.19044.2364]
    • Chrome (web)      • chrome         • web-javascript • Google Chrome 108.0.5359.125
    • Edge (web)        • edge           • web-javascript • Microsoft Edge 108.0.1462.54

[√] HTTP Host Availability
    • All required HTTP hosts are available

! Doctor found issues in 1 category.

@BenjaminZaiser This is caused by using NoSplash.splashFactory of OutlinedButton's style. Try removing it from the style and you can see the splash is drawn.
https://github.com/flutter/flutter/blob/1220245b330c94ec573d9f4801e93c5c72908f4f/packages/flutter/lib/src/material/no_splash.dart#L38-L40

@huycozy  Thanks for your feedback. Based on the brandguide I have to comply with, no animation should happen when a button is tapped. That's the reason for NoSplash. It should just immediately switch to the highlight color, which I also would expect from NoSplash. Maybe that is a bug in NoSplash implementation?

@BenjaminZaiser I'm not sure about the brandguide you're following, but if you don't apply a splashFactory or use InkSplash.splashFactory, the issue will not happen. If you are proposing something for NoSplash, please file a new issue (proposal) for it. Thanks!


Fix issue 299

Description
Add link to documentation generated for redhatinsights/insights-operator-cli/commands/rest_api_mock_test.go
Fixes #299
Type of change

Documentation update

Testing steps
N/A

Codecov Report

Merging #327 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #327   +/-   ##
=======================================
  Coverage   70.95%   70.95%
=======================================
  Files          12       12
  Lines         730      730
=======================================
  Hits          518      518
  Misses        208      208
  Partials        4        4

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 33e451d...aa9b11e. Read the comment docs.


The alarm timings on the another Widget is not correct, it shows completely random alarm timings that aren't even set by me (the user)

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Smartphone (please complete the following information):

Device: [e.g. OnePlus 6]
OS Version: [e.g. Android 9.0]
App Version (that you can find inside the advanced settings) [e.g. v2.0.5 (71)]

Additional context
Add any other context about the problem here.

Please refer to #158


[bug] PostStartHookError: command 'sh -c /scripts/post-start.sh' exited with 126

Describe the problem
I switched from a three-node cluster to a two-node cluster, and the xenon container reported the following error
PostStartHookError: command 'sh -c /scripts/post-start.sh' exited with 126

The xenon container keeps restarting, and the pod cannot be started.
Expected behavior
Environment:

RadonDB MySQL version: operator

resolved.
The reason is that the old xenon image is used. Since the xenon image does not provide pull strategy parameters, if the old image is used, you need to manually enter each worker node to delete the old image.
docker rmi <tag>


Keyboard Multi Layout support

Hi!
I added multi layout support
Now you can use en_us, es_es, it_it layouts
I will try to add more layouts when I have free time
To use this: read the Keyboard multi layout support section in README.md

Thanks for this PR, but i would suggest to change code the way the users wont need to change library to use it.

Thanks for this PR, but i would suggest to change code the way the users wont need to change library to use it.

I think this is a little difficult
If you have any idea how to do this, I can try this

I think this is a little difficult
If you have any idea how to do this, I can try this

There is few ways. One is to include all keymap arrays and add function that will assign one when language/layout is selected with separate function. This way is not the best option, because will include all arrays and increase binary by 1-2kB, depending on layouts amount. But this is some start.

There is few ways. One is to include all keymap arrays and add function that will assign one when language/layout is selected with separate function. This way is not the best option, because will include all arrays and increase binary by 1-2kB, depending on layouts amount. But this is some start.

Hi
I have seen that you have added SD Mass Storage
I tried to test this but when I compile the example your library gives many errors.
Now I can't use the keyboard example either
I attach screenshots with the errors:

@joelsernamoreno Please open new issue so we can track it.


Running circuit containing SymbolicPulse with new IBMProvider raises RuntimeError

Information

qiskit-ibm-provider version: 0.5.2
Python version: 3.11.2
Operating system: Windows 10

What is the current behavior?
I migrated my Pulse codes to the new qiskit-ibm-provider and can't run any of my previously working codes. The error I get is 9999, something along the line "RuntimeError: Job compilation status is error for job circuit-runner_cgq8n75aro27qhdg423g_32e7_0: Failure during build: Error making pulse P0 on logical channel Q0, physical channel Q0.. Error code: 9999." I checked the jobs on the IBM Quantum Jobs and there the error that is produced goes as "Results Type: object Description: Circuit execution results in a RunnerResult object." I made a simple pulse Jupyter notebook to help reproduce the  problem and am attaching it to this message. P.S. I tried on both Manila and Oslo. Maybe the issue is related to https://github.com/Qiskit/qiskit-ibm-provider/issues/518, but I did not find the same error message there.
Steps to reproduce the problem
The Jupyter notebook attached in this bug report shows a minimal example of the issue. I had to zip it since the .ipynb extension was not accepted.
What is the expected behavior?
The expected behaviour is for the job to return a result object by calling job.result() rather than an error.
Suggested solutions
PulseErrorExample.zip

I just checked and found that the issue is fixed. Now calling job.result() does not cause a RuntimeError. I am closing the issue.


First results - comparing some vendors

Hello together,
i create this prototype project in order to try out the different UserAgent parsers available for PHP.
First i wanted to try if it's currently possible to create an abstract result set, like it's done for GeoIP already https://github.com/geocoder-php/Geocoder
Second i wanted to have a Chain Adapter on top it to get results from different vendors to get better results https://github.com/ThaDafinser/UserAgentParser/blob/master/bin/generateMatrix.php#L45-L53
Last but not least i wanted to compare the different implementations - how complete and good are they?
At this stage the results of the comparison are not completed, since some vendor adapter will be not complete or have errors.
But i still wanted to share those results to you all, to get (hopefully) some feedback about your Adapter implementation and get improvements https://github.com/ThaDafinser/UserAgentParser/tree/master/src/Provider
See the (current not correct or complete) results
Download the HTML files from here and open it just in a browser https://github.com/ThaDafinser/UserAgentParser/tree/master/data/results
It should look like this screenshot.
Click on "toggle" to see the original data and the result detail

Note about used datasets to generate the matrix
I currently did not used datasets from each vendor, so the comparison is not fair currently. (and of course missing convertions or errors)

[ ] browscap/browscap-php the resources have placeholders...need to check how they can we replaced accordingly example file
[x] donatj/phpuseragentparser
[x] piwik/device-detector
[ ] ua-parser/uap-php waiting for a release https://github.com/ua-parser/uap-core/issues/114
[ ] whichbrowser/whichbrowser found no test data list.
[ ] woothee/woothee waiting for a release https://github.com/woothee/woothee/issues/19
[x] yzalis/ua-parser

Better would be an additional independent list...need to find a good source first
Next steps

[ ] get some feedback, about the provider adapter

[ ] complete and correct the provider adapters to get better results and a true comparison

[ ] refactor all code...it's ugly written...just a prototype

[ ] seperate UserAgentParser and the Matrix generation

[ ] release initial UserAgentParser

[ ] add more test datasets for the matrix

[ ] create a better comparison markup...the current on is not so "nice"

[ ] release a Matrix generator website

I hope it's ok to ping you all ...if not just tell me and i wont do it again :+1:
@mimmi20
@donatj
@sgiehl
@lstrojny
@NielsLeenheer
@yuya-takeyama
@blaugueux

The big advantage to mine - parse time an order of magnitude quicker than the others ;)

I just noticed OS is never filled in my results, but I provide OS, just not OS version.

@donatj every parser here has it's eligibility, it just depends on the goal you want to achieve with a UA analyisation.
I didn't include OS, since it was mixed with device informations, see here: https://github.com/ThaDafinser/UserAgentParser/blob/master/src/Provider/DonatjUAParser.php#L17-L18

@ThaDafinser The resources of the browscap parser are not meant to be used directly. These rules are parsed together into ini files and have the format designed for PHPs get_gebrowser function. The browscap-php library can handle this and parses the rules into regexes who are tested against the useragent.
Do you need more feedback?

@ThaDafinser If you find a useragant who is not detected correctly, be free to open an issue in the browscap/browscap project.

Very interesting project!
I must first say that WhichBrowser currently isn't designed to be used directly from PHP. It does server side detection, but exposes a JavaScript API in the browser. So calling it directly from PHP is certainly possible, but it might be a bit iffy.
I'll create a pull request from some improvements to the WhichBrowser adapter later today (I hope).
I also have a test suite that you are free to incorporate into this project, but at the moment it is in a separate git branch and not part of the composer distribution. They are a bunch of Yaml files and contain a number of headers (including User-Agent) and the results I expect. But it would be fairly trivial to strip all of that out and get a list of ua strings: https://github.com/WhichBrowser/WhichBrowser/tree/dev/tests

@NielsLeenheer i have a completely rewriten all of  the adapters localy. I will push them later this weekend so you can grab the updates.
I will try to include the testsuite in this case with the next update i will make in a seperate branch.
If you feel that its not good to include it as a server side adapter i will remote it, that nobody expect good results like the "good" one as a JS include provides them

@ThaDafinser The code for doing the comparisons seems to have disappeared? Is that still part of the scope of this project? Is it coming back?

@NielsLeenheer you need to use the v0.0.1 https://github.com/ThaDafinser/UserAgentParser/tree/v0.0.1
I will release a new package under the the name https://github.com/ThaDafinser/UserAgentParserMatrix soon
I think a split is better, since this can be used without the matrix

@ThaDafinser Ok, makes sense.

Moving to https://github.com/ThaDafinser/UserAgentParserComparison/issues/1


Annotation Design Discussion

Questions & Todo:

Discuss how Annotations should be implemented in HashStore
What format should we use to store annotation content in /hashstore/metadata? JSON-LD or EML?
What is HashStore's responsibility when storing annotations?

Is the EML document already formed at this point?
Where is the content coming from?
Who currently creates the EML documents to be stored?

Summarize issue discussion into substorage design document

Initial Proposal to kickstart the conversation (the content below is not final, and will likely change):

A dataset that is represented by an EML document can be broken down to 2 components:

Attributes that describe the dataset (ex. title, author, method, keywordSet, etc.)
Attributes that represent the tables associated with the dataset (ex. dataTable, otherEntity, etc.)

A HashStore annotation is a mapping document that should consist of a single parent member and a list that represents the child members

This document's location in hashstore/metadata is formed by calculating the SHA-256 hex digest of a given pid and formatId

The parent member's value is the id (location) of the parent metadata document in hashstore/metadata
- The id/location/address of this document is formed by calculating the SHA-256 hex digest of a given pid, formatId and the string "parent". Ex. sha-256(pid + formatId + "parent")
- This document is composed of the attributes/content that describe the dataset (ex. title, author, method, keywordSet, etc.)
The List/HashMap of child members are represented with a number as the key, and the id (location) of the child's metadata document in hashstore/metadata as the value
- The id/address of each child is formed by calculating the SHA-256 hex digest of a given pid, formatId and (int) key. Ex. sha-256(pid + formatId + 0) where 0 is the first table in the dataset
- Each child represents a data table in the dataset, or chunk of data that belongs to the dataset

Note: The format of the parent/child metadata documents to be stored/chunked requires further discussion/clarification

---
title: HashStoreAnnotation Class
---
classDiagram
    direction RL
    class HashStoreAnnotation{
        +String Parent
        +List~Dict/KVP~ Children
        +setParent(string)
        +setChildren(List)
        +getContent()
        +setContent()
        +getChildrenTotal()
    }

Example/flow to store an annotation document:

hs_annotation = HashStoreAnnotation()

// Get and store parent content
// Get and store children content

// Get parent location
dataset_parent = sha-256(pid + formatId + "parent")
// Create child list
dataset_children = [
    {0: sha-256(pid + formatId + 0)},
    {1: sha-256(pid + formatId + 1)},
    ...
]
hs_annotation.setParent(dataset_parent)
hs_annotation.setChildren(dataset_children)

// getContent() will format the document to be written based on the chosen format
hs_annotation_content = hs_annotation.getContent()

hashstore.store_metadata(pid, hs_annotation_content, formatId)

Example/flow to work with/retrieve an annotation document:

// Retrieve the mapping document
hs_annotation_stream = hashstore.retrieve_metadata(pid, formatId)
hs_annotation = HashStoreAnnotation.setContent(hs_annotation_stream)
hsa_parent = hs_annotation.parent
hsa_children = hs_annotation.children

// Iterate over the first 1000 table items
for i in range(0, 1000):
     rel_path = shard(hsa_children[i])
     location = `/hashstore/metadata/` + rel_path
     // ... Do what we will with each child element

Thanks for getting this started, @doulikecookiedough . We should discuss, as I don't understand the parent/child nomenclature you are mentioning above.
TO kick things off, I think it is useful to list examples things we might want to store in an annotation store. Here are some expressed as triples:

<EntityPID1> <ore:aggregatedBy> <OREPID3>   # Expresses that a data file is a member of a package (primary use case, typically in an ORE doc)

<EntityPID1> <cito:documentedBy> <EMLPID4> # Expresses that a data file is documented by a metadata file (typically in an ORE doc)

<EntityPID2> <prov:wasDerivedFrom> <EntityPID1> # Expresses a provenance relationship

<EMLPID4> <dwt:subject> <adcad:Hydrology>  # Expresses that a metadata file has a subject of a particular discipline; many other classification-style annotations like this could be used

It might be best to have these grouped as a single file graph for each object (serialized in JSON-LD or RDF formats), which would be indexed like other metadata. So in this case, we would have 3 annotation files, one each for EntityPID1, EntityPID2, and EMLPID4. In this example, annotations are stored in the annotation file for the subject PID. The DataONE indexer would then be responsible for indexing these annotation files anytime they change, and adding the annotations to the appropriate index systems (currently our SOLR object index, but we will likely need another for the entity/package mapping).

@mbjones Thank you for the prompt feedback! When I was reviewing how we would implement Annotations, I was specifically looking at how we could store the science-metadata.xml document. My understanding (or misunderstanding now...) is that I thought these types of files would be the extremely large files we would have to break down into pieces that could be retrieved/treated as a whole.
To clarify, using your example above:

There would be 1 annotation file for the subjectPID

This would be stored like any other metadata: store_metadata(subjectPID, formatId)

Inside of this  annotation file for the subject PID, there would be 3 lines (annotations), one for each of EntityPID1, EntityPID2, and EMLPID4.

The content for these annotations can be stored and retrieved like any other metadata document

If we're on the same page now, I'm wondering how HashStore plays a role in the Annotation implementation...? It would appear that the calling app would still be working with metadata in HashStore with the same Public API calls. If not, should we save further discussion here for the backend dev meeting to discuss so Robyn/Rushi can also get additional context?

The content of this annotation file for the subject PID, would contain 3 lines

Maybe, or maybe not. Depends on the format. If stored as JSON-LD, it would likely have more lines, and certainly a lot more if in RDF/XML format.

Notes:
Background:

EML documents are not going anywhere, they will continue to be possible
If a data package has multiple entities, we get an ORE map that lists every member as part of that package - and an EML entry that that lists the metadata for the entity. This is not an issue when there are not too many entities (100s)
When we get a huge dataset, these documents slow down our systems, especially the Javascript frontend

Design Goal:

If we have to attach millions of files to a data package, how do we do it without creating a file with a million entities? Each member should get to state who they are a member of, then we use a service to mediate the relationship. The main difference here from what we currently have is that we would have an entity service that is queryable.

Annotation General Design/Infrastructure Discussion:

So, instead of centrally listing all the entities as part of one package in an ORE document, we propose that there would be annotation metadata documents in HashStore, which would declare itself to be part of a package.

A new type of "a mini annotation document" would be created that is particular to a specific PID.
These documents would either be in JSON-LD or RDF format, it must be flexible enough to store multiple types of information, like a mini ORE For each PID.
Note: Every dataset would still have an ORE document, and that document might list 3 entities that are part of it. In addition, there might be 17 entities that are also stored and part of that package.

This system is essentially a "Paged API", so when creating a page view in a dataset, we could efficiently get the first 50 entities of that dataset.

Metacat/Dataone will be in charge of indexing all these annotations/building the entity index for quick retrieval

A dataset that has a million files is not going to be uploaded through the MetacatUI. We would create a dataset/package in MetacatUI (so that it exists) and another API would be responsible for attaching a datafile to the dataset/package.
We would need a way to say to Metacat, here is the datafile to attach to one package and here is the annotation. Then Metacat would be responsible for writing that file to the PID store, and maintain the annotation associated with it.

Metacat and MetacatUI would also need to be able to communicate to keep attaching annotations and attributes.
In order to add a file to a data package, we wouldn't change the data pacakge, but the annotation store instead.

Every data package should still have a resource map as it's where we store the identifier for the package
There could be a million annotation files, with a handful of triple files. So the metadata associated with each entity, is a property of the entity and the EML it's associated with.

Ex. This entity is associated with that package. That package contains the EML file with this version V1 of the EML. This package of EML has some entity metadata from the annotation file.

For a data package with a million entities, we are not able to serialize it in a logistically feasible way. So to help make researchers' lives easier, we will try to come up with a design that does not force them to learn how to work with more involved file formats such as NetCDF to interact with their large datasets.

Potential Issue to Ponder:

Context: The V1 annotation document would have top level metadata of the document. We would also have a million annotation files, one for each 'CSV' file. This V1 annotation document would have the EML entity section for each CSV file that's associated with V1 of that metadata.
Problem: When we get to V2 metadata, then we would potentially need a million versions for V2, because each member has to state who they are a member of.

Each member could also say they are a part of V2... but how?

Next Step:

Create mermaid diagram to show the relationship between the moving parts (big picture view) for discussion & update storage subsystem document

Mermaid Diagram for review, summary and a few thoughts:

For now, each annotation file contains an RDFTriple

They can express a relationship like a PID/GUID's metadata document's location

These annotation files will be indexed and facilitate a PagedAPI of sorts

Entity/Packaging indexer to be a part of HashStore? Or do we see this as a new library/project?

Perhaps to address a potential issue of millions of duplicate files, we can set the expectation that in our annotation system, the RDFTriple's "Object" value is to be a list (comma separated?) that should be parsed, which will allow the indexer to create multiple relations for one subject without having to duplicate the annotation files.

Or would it make more sense for each annotation file to contain multiple RDFTriples?

<EntityPID1> <ore:aggregatedBy> <OREPID3, OREPID4, OREPID5>

vs.

<EntityPID1> <ore:aggregatedBy> <OREPID3>
<EntityPID1> <ore:aggregatedBy> <OREPID4>
<EntityPID1> <ore:aggregatedBy> <OREPID5>

graph TD
    subgraph RDFTriple2
        direction BT
        S["EntityPID1"]
        P["ore:aggregatedBy"]
        O["OREPID3"]
    end
    subgraph RDFTriple1
        direction BT
        S1["EntityPID1"]
        P1["cito:documentedBy"]
        O1["EMLPID4"]
    end
    subgraph RDFTriple3
        direction BT
        S2["EntityPID2"]
        P2["prov:wasDerivedFrom"]
        O2["EntityPID1"]
    end
    %% subgraph RDFTriple4
    %%     direction BT
    %%     S3["EMLPID4"]
    %%     P3["dwt:subject"]
    %%     O3["adcad:Hydrology"]
    %% end
    ANNO-1 -. "ANNO-1 content" .-> RDFTriple2
    ANNO-2 -. "ANNO-2 content" .-> RDFTriple3
    subgraph Dataset
        %% C1["CSV-1"]
        %% C2["CSV-2"]
        %% C3["CSV-3"]
        %% C4["CSV-4"]
        %% C5["CSV-5"]
        %% C6["..."]
        %% C7["CSV-1000"]
    end
    O -. "Expresses that a data file is a member of a package" .-> Dataset
    subgraph hs["`**HashStore**`"]
        subgraph /objects
            direction RL
            OBJ-1
            OBJ-2
            OBJ-3
            OBJ-4
            OBJ-5
            OBJ-6
        end
        subgraph /metadata
            direction TB
            META-0
            META-1
            META-2
            %% META-3
            %% META-4
            %% META-5
            ANNO-0
            ANNO-1
            ANNO-2
            ANNO-3
            ANNO-4
            ANNO-5
        end
    end
    O1 -. "Expresses that a data file is documented by a metadata file" .-> META-2

Next Step:

Provide context to help decide what format should we use (RDFTriple or JSON-LD).

To Do:

Update mermaid diagram for clarity, it's not immediately clear what are files here, how we would retrieve an annotation file, what the subject should be, and what the object represents exactly.

Updated Diagram:
graph TD
    RDF1["(EntityPID1 - ore:aggregatedBy - OREPID3)\ndou.mok.1 - ore:aggregatedBy - ORE_mok.dataset"]
    RDF2["(EntityPID2 - prov:wasDerivedFrom - EntityPID1)\ndou.mok.rev.1 - prov:wasDerivedFrom - dou.mok.1"]
    RDF3["(EntityPID1 - cito:documentedBy - EMLPID4)\ndou.mok.1 - cito:documentedBy - sha-256(dou.mok.1+formatId)"]
    RDF4["(EMLPID4 - dwt:subject - adcad:Hydrology)\nsha-256(dou.mok.1+formatId) - dwt:subject - adcad:Hydrology"]
    RDF3 -. "Expresses that a data file is documented by a metadata file" .-> META-2
    ANNO-1 .-> RDF1
    ANNO-2 .-> RDF2
    ANNO-5 .-> RDF4
    subgraph ORE_mok.dataset
        %% C1["CSV-1"]
        %% C2["CSV-2"]
        %% C3["CSV-3"]
        %% C4["CSV-4"]
        %% C5["CSV-5"]
        %% C6["..."]
        %% C7["CSV-1000"]
    end
    RDF1 -. "Expresses that a data file is a member of a package" .-> ORE_mok.dataset
    subgraph hs["HashStore"]
        subgraph /objects
            direction RL
            OBJ-1
            OBJ-2
            OBJ-3
            OBJ-4
            OBJ-5
            OBJ-6
        end
        subgraph /metadata
            direction TB
            META-0
            META-1
            META-2
            %% META-3
            %% META-4
            %% META-5
            ANNO-N
            ANNO-0
            ANNO-1
            ANNO-2
            ANNO-3
            ANNO-4
            ANNO-5
            ANNO-6
        end
    end

Updated Diagram (continued...):
flowchart TD
    subgraph dmcr["dou.mok.rev.1"]
        direction RL
        dmpr1["dou.mok.rev.1 - prov:wasDerivedFrom - dou.mok.1"]
    end
    dmcr .-> ANNO-4
    subgraph dmc["dou.mok.1"]
        direction RL
        dmp1["dou.mok.1 - ore:aggregatedBy - datasetpkg"]
        dmp2["dou.mok.1 - rdf:type - hsfs:obj\n(metacat/objects/OBJ-1)"]
        dmp3["dou.mok.1 - cito:documentedBy - hsfs:sysmeta\n(metacat/metadata/SYSMETA-2)"]
        dmp4["dou.mok.1 - hsfs:algo - 'SHA-256'"]
        dmp5["dou.mok.1 - hsfs:checksum - 'a1...f9'"]
    end
    dmc .-> ANNO-3
    subgraph ds["datasetpkg"]
        direction RL
        dsp2["datasetpkg - ore:aggregates - dou.mok.1"]
        dsp3["datasetpkg - cito:documentedBy - hsfs:sysmeta\n(metacat/metadata/SYSMETA-1)"]
        dsp1["datasetpkg - dwt:subject - adcad:Hydrology"]
    end
    ds .-> ANNO-2
        subgraph hs["HashStore"]
        subgraph /objects
            direction RL
            o1["OBJ-1\n(SHA-256 Hash:\n datasetpkg')"]
            OBJ-2
            OBJ-3
            objdot("...")
        end
        subgraph /metadata
            direction RL
            sys1["SYSMETA-1\n(SHA-256 Hash:\n datasetpkg + format_id')"]
            ANNO-0
            ANNO-1
            ANNO-2
            ANNO-3
            ANNO-4
            sys2["SYSMETA-2\n(SHA-256 Hash:\n dou.mok.1 + format_id')"]
            metadot("...")
        end
    end

Question: 'dou.mok.rev.1' has a triple that describes a provenance relationship between 'dou.mok.1'. Should 'dou.mok.rev.1' automatically assume the same triples due to this relationship? Or will the triples have to be redefined once again regardless of what they are derived from and stored accordingly?

Design Challenges & Questions (cont):

If we had a dataset with a million members, each stating their relationship with the dataset, and we were to make a change to the dataset identifier - how do we maintain the annotation graph between the dataset and members without duplicating all the members?
How do we only index annotation files in HashStore if they will exist alongside sysmeta in /metadata?
Where will this new index exist? A new triple store or in SOLR?
Should we create a custom ontology/vocabulary to assist with our annotation system?

Proposed Semantic Data Info Package (SDIP) Diagram from Matt's sketch
flowchart TD
    H13["H13
        H13 type PACKAGE
        H13 contains H11
        H13 contains H12
        H13 contains H10"]
    subgraph ORE
        H12["H12
            H12 type ANNO"]
        H1["H1: ORE"]
        P1["P1: Sysmeta"]
        P1 --> H1
        H12 --> H1
    end
    subgraph EML
        H11["H11
            H11 type ANNO"]
        H2["H2: EML"]
        P2["P2: Sysmeta"]
        H11 --> H2
        P2 --> H2
    end
    H10["H10
        H10 type FOLDER
        H10 contains H6
        H10 contains H9"]
    H13 --> H12
    H13 --> H11
    H13 --> H10
    subgraph Blob1
        H6["H6
            H6 type ANNO
            H6 contains H3"]
        H3["H3: Data"]
        P3["P3: Sysmeta"]
        H6 --> H3
        P3 --> H3
    end
    H10 --> H6
    H9["H9
        H9 type FOLDER
        H9 contains H8
        H9 contains H8"]
    H10 --> H9
    subgraph Blob2
        H7["H7
            H7 type ANNO
            H7 contains H4
            H4 type BLOB"]
        H4["H4: Data"]
        P4["P4: Sysmeta"]
        H7 --> H4
        P4 --> H4
    end
    H9 --> H7
    subgraph Blob3
        H8["H8
            H8 type ANNO
            H8 contains H5
            H5 type BLOB"]
        H5["H5: Data"]
        P5["P5: Sysmeta"]
        H8 --> H5
        P5 --> H5
    end
    H9 --> H8
    classDef cyan fill:#7ff;
    class H13,H12,H11,H10,H6,H9,H7,H8 cyan
    classDef mage fill:#ff7ffe;
    class P1,P2,P3,P4,P5 mage
    classDef lime fill:#dfffda;
    class H1,H2 lime

Some more thoughts on annotations & the impacts of a change on a large dataset

Assumptions/Background:

A Paging API/indexer first has to retrieve the head annotation file that describes a package, in order to begin walking the annotation tree and discovering the members associated with it
Instead of a member's annotation file declaring what package it is a part of, it will declare that is belongs to a unique_annotation_tree_id

This unique id never changes for a large dataset. A new database may be needed to keep track of large datasets, and we would have to agree on how to come up with this id.

The Paging API/indexer will be responsible for establishing the connection between a package name/identifier and its respective unique_annotation_tree_id for the front-end

A package name/id change for a dataset with a million files

We could do this by first retrieving the head annotation file of the package and then add/obsolete triple statements like what is currently being done with data objects.

This will allow the previous package to still be discoverable, and establish the new association within the same head annotation file.

We would not have to duplicate a million data files - the tree associated with the unique_annotation_tree_id hasn't technically changed at this point

Because all data members are declaring they belong to a unique_annotation_tree_id, and not a specific package name, we would instead have to re-index a million files to establish this new package...

Our triple store will grow instead of our object store.

Dataset member updates in a package with a million files

Continuing with the example above, a change to the dataset members would then only involve replacing the affected data objects, updating the sysmeta, and then updating the respective annotation files' triple statements.
After any change, we call the indexer to update the triple store, which begins by looking for the head annotation file of the package, and then traverses the tree to index/re-index the dataset
If we optimize how we perform the indexing, updating a large dataset could be a routine and efficient process.

It would be better not to walk an entire tree just to re-index a few files. However, the reality might just be that we have to walk the entire tree to be safe that we did not miss anything. Pausing my thoughts here for now to reflect.

Closing previous discussion/issue for Annotation Design: N-Triple vs JSON-LD Discussion and will continue discussions here as progress is made with the greater team regarding how to handle large packages.


I am sure this has been reported, but I am stumped on this one

Receive following error when running Webpack.  This has been working forever, but for some reason, it is now a problem
ERROR in ./index.js
Module build failed: Error: Final loader didn't return a Buffer or String
    at DependenciesBlock.onModuleBuild (/Users/mikee/Documents/Projects/dev/angular/angular-sandbox/node_modules/webpack-core/lib/NormalModuleMixin.js:299:42)
    at nextLoader (/Users/mikee/Documents/Projects/dev/angular/angular-sandbox/node_modules/webpack-core/lib/NormalModuleMixin.js:275:25)
    at /Users/mikee/Documents/Projects/dev/angular/angular-sandbox/node_modules/webpack-core/lib/NormalModuleMixin.js:292:15
    at runSyncOrAsync (/Users/mikee/Documents/Projects/dev/angular/angular-sandbox/node_modules/webpack-core/lib/NormalModuleMixin.js:160:12)
    at nextLoader (/Users/mikee/Documents/Projects/dev/angular/angular-sandbox/node_modules/webpack-core/lib/NormalModuleMixin.js:290:3)
    at /Users/mikee/Documents/Projects/dev/angular/angular-sandbox/node_modules/webpack-core/lib/NormalModuleMixin.js:292:15
    at Object.context.callback (/Users/mikee/Documents/Projects/dev/angular/angular-sandbox/node_modules/webpack-core/lib/NormalModuleMixin.js:148:14)
    at Object.module.exports (/Users/mikee/Documents/Projects/dev/angular/angular-sandbox/node_modules/babel-loader/index.js:89:8)

Followup with the ./index.js file
/**
 * index.js
 * Created: 5/10/2016 2:24 PM (merickson)
 * =============================================================================
 */

// Initialize angular module and require any dependencies and global css (less)
import app  from './app.module'
import '!style!css!less!./app.less'

// all components are constructors `component` suppress from filename
// adopting React class filename convention
// all components filename's are singular (ie `Compliment` vs `Compliments`)

import Complient from './components/compliments'
import User      from './components/users'

And webpack.config.js
/**
 * webpack.config.js
 * Mike Erickson<EMAIL_ADDRESS> * 2016.06.06 18:40 (mikee)
 * =============================================================================
 */

var path                = require('path')
var ProgressBarPlugin   = require('progress-bar-webpack-plugin')
var CopyWebpackPlugin   = require('copy-webpack-plugin');
var BuildNotifierPlugin = require('webpack-build-notifier')
var ESLintWebpackPlugin = require('eslint-loader')
var msg                 = require('gulp-messenger')
var webpack             = require('webpack')

var outputPath     = path.join(__dirname, '/dist')
var outputFilename = 'bundle.js'
var publicPath     = outputPath

var webpackConfig = {
  context: __dirname + '/src',
  devtool: 'eval', // source-map
  entry:   './index.js',
  output: {
    path:       outputPath,
    filename:   outputFilename,
    publicPath: publicPath
  },
  // devServer: {
  //   contentBase: outputPath,
  //   hot: true
  // },
  module: {
    preLoaders: [
      {test: /\.(less|css)$/, loader: 'stylelint' },
      {test: /\.js$/, loader: "eslint-loader", exclude: /node_modules/}
    ],
    loaders: [
      {test: /\.js?$/, loaders: ['ng-annotate','babel'], exclude: /node_modules/},
      {test: /\.html?$/, loaders: ['raw']},
      {test: /\.less?$/, loaders: ['style!css!less?strictMath&noIeCompat']},
      {
        test: /\.css$/,
        loaders: [
          'style',
          'css?sourceMap&modules&localIdentName=[name]__[local]___[hash:base64:5]'
        ]
      },
    ]
  },
  stylelint: {
    configFile: path.join(__dirname, './.stylelintrc'),
    configOverrides: {
      rules: {
        // Your rule overrides here
      }
    }
  },
  plugins: [

    // Display notification when build completed
    new BuildNotifierPlugin(),

    // Removes duplicate modules from the build
    new webpack.optimize.DedupePlugin(),

    // Configure ProgressBar
    new ProgressBarPlugin({
      format: msg.chalk.yellow.bold('  Building [:bar] ') + msg.chalk.green.bold(':percent') + msg.chalk.bold(' (:elapsed seconds)'),
      clear:   false,
      summary: true
    }),

    // Copy assets not part of bundle
    new CopyWebpackPlugin([
      { from: './index.html', to: './index.html' },
      { from: './fonts',      to: './fonts' },
      { from: './css',        to: './css' },
      { from: './data',       to: './data' },
    ]),

    // Compress build
    new webpack.optimize.UglifyJsPlugin({
      compress: {
        warnings: false
      }
    }),

  ]
};

module.exports = webpackConfig;

import '!style!css!less!./app.less'

Two observations:

The leading ! in the module name shouldn't be there: the syntax is 'loader!module'.
As you have a section in webpack.config.js that sets up a loader chain for .less files, you don't need to specify the loaders when importing Less stylesheets.

I believe you should be able to replace this line with
import './app.less'

@mikeerickson Did that help?


AttributeError: 'function' object has no attribute 'send_message'

Hello , when itry to send an sms with the following code i get the error  AttributeError: 'function' object has no attribute 'send_message'
from vonage import Sms
sms = Sms(key='key', secret='secret')

response = sms.send_message({'from': senderName, 'to': number, 'text': message, 'type': 'unicode'})

When I use the following code it works
import vonage
client = vonage.Client(key='key', secret='secret')

response = client .send_message({'from': senderName, 'to': number, 'text': message, 'type': 'unicode'})

Hello @dimitrisal, Looking at your code example, you have the space between client and .send_message.
Which should just be client.send_message({'from': senderName, 'to': number, 'text': message, 'type': 'unicode'}).
I tested the code and believe from your example having the space is what's causing your problem, please remove it and try the code again.
I'm going to close this issue as a non issue. If you still have a problem with the code, please feel free to join our Slack server where we can help. https://developer.nexmo.com/community/slack

Hello @dimitrisal, Looking at your code example, you have the space between client and .send_message.
Which should just be client.send_message({'from': senderName, 'to': number, 'text': message, 'type': 'unicode'}).
I tested the code and believe from your example having the space is what's causing your problem, please remove it and try the code again.
I'm going to close this issue as a non issue. If you still have a problem with the code, please feel free to join our Slack server where we can help. https://developer.nexmo.com/community/slack

@GregHolmes the client .send_message does work (the space is from the copy paste) but it is deprecated the sms.send_message doesn't work and i get the above error.

@GregHolmes the client .send_message does work (the space is from the copy paste) but it is deprecated the sms.send_message doesn't work and i get the above error.


Add me please

Name: Remilia Scarlet
Nick: MistressRemilia
Mastodon: https://mastodon.sdf.org/@MistressRemilia
CL Projects: all listed here https://alexa.partition36.com/programming/

Amazing!! Thank you for your add request, it had been a while since I had received one of these!
I will process this tomorrow.

Forgot to ask, what do you want as your two highlights?
Review the Common Lispers list for inspiration.

cl-meltysynth: https://chiselapp.com/user/MistressRemilia/repository/CL-MeltySynth/
midi123: https://chiselapp.com/user/MistressRemilia/repository/midi123/
Am I able to open a request to change these later?  Within reason, of course.

Yes, actually this is pretty much the only type of customization supported at this time, heh...

Your entry is live!
I hope this is to your satisfaction.


Visual Studio hangs when building a Blazor project (15.8.0)

I tried to report a VS issue using the feedback system with
"I have a Blazor based solution with 6 DLL's built with the Blazor tooling that are all .Net Standard 2.0 and one that is ASP.Net Core 2.1
Up until yesterday, this solution built properly with VS 15.7, I upgraded to VS 15.8 and now the build hangs after I make a source change and do either Ctrl-F5 or F6. I have to cancel the build and then the next build works as expected. If I make another source change again the build hangs and has to be canceled.
The environment is Win 10 X64"
The response that I received was
"Van Kichline [MSFT] on 8/16/2018
Thank you for your feedback.Currently Blazor is in an experimental phase and is only accepting issue reports on the GitHub issue tracker at https://github.com/aspnet/Blazor/issues . Thanks!"
The issue was better defined by @uwefms in #1323 as being caused by starting the build with changed files.

Hi @MarkStega - could you try the fix suggested here: https://github.com/aspnet/Blazor/issues/1019#issuecomment-398497792?

@rynowak
I tried both the #1019 fix as well as the one suggested further down in the original issue as
    <!-- see https://github.com/aspnet/Razor/issues/2406 -->
    <UseRazorBuildServer>false</UseRazorBuildServer>
    <_RazorBuildServerPipeName>razor-issues-2406</_RazorBuildServerPipeName>

This doesn't seem to be the issue as I waited over 10 minutes on the hung build after making the change to the csproj.

Although my issue didn't appear until I upgrade to VS 15.8.0 I wonder if it is related to #1247 ?

I have the same problem. After I upgrade my VS from 15.7.6 to 15.8, and sometimes VS will hang when compiling.

I have the same issue after upgrading to 15.8.0
On Fri, Aug 17, 2018, 7:44 AM LuohuaRain<EMAIL_ADDRESS>wrote:

I have the same problem. After I upgrade my VS from 15.7.6 to 15.8, and
sometimes VS will hang when compiling.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/aspnet/Blazor/issues/1326#issuecomment-413737469, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ACnwPwiTtwPylK0jQsMpoLtlweKaUvBuks5uRicHgaJpZM4WAXio
.

+1 for hanging when compiling and the non-preview released 15.8.0. Above change doesn't to address it...

Saving before compiling did the job for me

@uwefms  Yes, saving first does work but that is pretty lame after years of just doing a ctrl-f5 or f6 after making changes. I am finding that I start the build some 50% of the time forgetting to do the save first...

I had the same problem -- it always hung after the "restoring" message. I seem to have resolved the problem by turning off NuGet auto-download: Tools -> Options -> NuGet Package Manager, un-tick "Allow NuGet to download missing packages". I did this yesterday and I haven't seen the lockup once since then.

@MarkStega
Hmmm... Sorry to hear that. I just tried setting my NuGet option back to ticked to see what happens. The odd thing is that yesterday, right after updating to 15.8.0, I seemed to always be getting the "Restoring" message when I built. Now I'm not seeing that message. I'll keep an eye on it and report any relevant observations.

A few questions for those experiencing these issues:

Is this limited to Blazor projects - are you having problems with other .NET Core project types?
1a. Does the problem occur at the command line or only in VS?
When the build is 'hanging' is the CPU usage of VS low or high?

Could one of you experiencing this problem collect a memory dump for us to look at?

Reproduce the failure
Open a second VS windows and Debug->Attach to Process to the slow VS instance
Break All in ebugger
Debug ->Save Dump As...

Then upload somewhere we get at it (onedrive, google drive)

I created an ASP.Net Core API project and it does not repro the issue
1a) The build runs from command line but since the error seems to be triggered by having a changed file open in VS when you start a build I'm not certain if that helps.
low

Mem dump at
git clone<EMAIL_ADDRESS>

Thanks, I'll take a look.

@MarkStega One other question - when this happens to you does VS prompt you to save the changed files?

I think i came across the same thing now in a new blazor project - It didn't seem to happen to me on my existing project that i started back in 0.3.0 but that's probably just a fluke.
@rynowak At least in my case it didn't prompt.

@rynowak No prompt (I've never has VS prompt me to save files before a build, it just saves them & does the build, probably a setting but in a quick look I don't see it).

We've been able to dig into this a bit more and looks like a core VS issue that's easy to hit with Blazor. Thanks everyone for your patience with this so far.
If you're bothered by this, you might be able to work around the problem by unchecking Automatically check for missing packages....

Huh. Now that you mention it, i did recall seeing the restore messages in the status bar for a moment, but didn't link it to this. Good to know.

I found that cancelling the build, killing all dotnet.exe, msbuild.exe, and vbcscompiler.exe instances in task manager would permit me to Clean the solution and then build it. None of those appeared to be doing any work, it almost looks like VS lost connection to those child processes.

@rynowak I've been getting this too and your workaround does fix it for me. Do you know if/when VS expects to fix the underlying issue?

Let me ask what happened to this, it got handed off to one of the VS teams to deal with..

This will be fixed in 15.9 - I'm not sure if the current public preview has the fix or not.

I had applied the workaround back in August and it seemed to be fine. The last several days I am again seeing the hung build. I checked and the workaround setting is still in place. It may be coincidental but I wasn't seeing this until after I upgraded to 0.6.0

This issue should now be fixed in Visual Studio 15.9 Preview 3: https://visualstudio.com/preview


Add the linux nightly builder (~22min) to the pre-submit CI

What happened?
Our nightly builds being shipped to end users use GCC10 + manylinux docker.
We have failures such as https://discord.com/channels/689900678990135345/1078332034830835833 that can sometime compound.
https://github.com/openxla/iree/actions/runs/4251432533 is an example of a CUDA toolkit failure hiding a Transform Dialect failure.
Lets please add this to the pre-submit CI. Also we can reduce the 22min by just building for one Python version instead of 4/5 with
Steps to reproduce your issue
No response
What component(s) does this issue relate to?
No response
Version information
No response
Additional context
No response

+1 to a smoketest (not all the python versions)!


Kivy implementation

@landlessdrunk Hello, are you still working on it?
I was interested in supporting Monero Subscription Wallet in my application, but sadly the original project seems to be abandoned.
The application I'm working on is Mitra, it is a decentralized social network where authors can make XMR-paywalled posts, and a payment scheduler would nicely complement this feature.


Feat/add logger interface

This PR resolves #7
Custom loggers which implement the Logger interface are to be passed through the AwsUploaderModule and S3Uploarder instead

LGTM I'm not sure how this release should be handled because this will break the applications that currently uses this with a winston logger


Make changes for new nav

What
Make the following changes to images on these pages based on new Airbrake navigation.

[x] https://airbrake.io/docs/integrations/bitbucket/

settings_cog.png

bitbucket_auth.png

bitbucket_settings.png

[x] https://airbrake.io/docs/integrations/campfire/

campfire_settings.png

campfire_testing.png

[ ] https://airbrake.io/docs/integrations/github-enterprise/

github_integration_type.png

github_enterprise_repo_url.png

[ ] https://airbrake.io/docs/integrations/github/

github_auth.png

github_repo_url.png

[ ] https://airbrake.io/docs/integrations/gitlab/

gitlab_adding_token.png

gitlab_adding_repo_url.png

[x] https://airbrake.io/docs/integrations/lighthouse/

lighthouse_token_settings.png

lighthouse_settings.png

[x] https://airbrake.io/docs/integrations/slack/

slack_settings_in_airbrake.png

[x] https://airbrake.io/docs/integrations/trello/

trello_auth.png

trello_settings.png

[x] https://airbrake.io/docs/airbrake-faq/configuring-notifications/

dropdown_settings.png

[x] https://airbrake.io/docs/airbrake-faq/configuring-project-environments/

project_environments.png - just edit image

[x] https://airbrake.io/docs/airbrake-faq/how-do-distinct-error-types-work/

settings_cog.png

distinct_grouping.png - just edit image

[x] https://airbrake.io/docs/airbrake-faq/how-do-global-error-types-work/

settings_cog.png

global_grouping.png - just edit image

[x] https://airbrake.io/docs/airbrake-faq/what-is-my-subdomain/

subdomain_url.png

subdomain_settings.png

[x] https://airbrake.io/docs/airbrake-android-ios/app-versions/

settings_cog.png

[x] https://airbrake.io/docs/billing/account-cancelation/

cancel_account.png

[x] https://airbrake.io/docs/billing/update-credit-card-information/

credit_card_edit.png - do we need an image here?

[x] https://airbrake.io/docs/billing/updating-your-billing-info/

billing_settings.png

I need to look at the GitHub login to make sure it's all correct

(External) Box Governance Datasheet.pdf

I believe the Git___ pages are OK.


ActiveX subsystem discontinued ?

isn't there a contradiction between this page and the fact that this subsystem is discontinued since SQL Server 2016 ? see https://docs.microsoft.com/en-us/sql/database-engine/discontinued-database-engine-functionality-in-sql-server?view=sql-server-ver15#discontinued-features-in--1 this subsystem

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a5008405-0ab9-5fbd-11df-5ffac1c631b0
Version Independent ID: 1759bd47-7e19-582b-9c71-a4ba4485f5bb
Content: Create an ActiveX Script Job Step - SQL Server Agent
Content Source: docs/ssms/agent/create-an-activex-script-job-step.md
Product: sql
Technology: ssms
GitHub Login: @markingmyname
Microsoft Alias: maghan

@mco100 -- thank you for your question.
@markingmyname -- please look into this issue.

@mco100
Apologizes for the delay.
We are investigating this.

The issue has been reassigned to get a further investigation.


about ctrl+w shortcut

Hey. Huge thanks for great and comfortable ide.
But the thing I have a problem with is just ctrl+w shortcut.  I'm more bash user., I guess. And sometimes i just press ctrl+w just instantly (it removes last words). And I restart my console.
I've done it like 100 times and still do this. I understand it's surely my problem. But If is there any problem to reassign this action to another shortcut?
or maybe there's a way to do it? Cause I didnt find these kind of hotkeys in preferences

Hey. Huge thanks for great and comfortable ide.

Thanks a lot for your kind words!

But the thing I have a problem with is just ctrl+w shortcut. I'm more bash user., I guess. And sometimes i just press ctrl+w just instantly (it removes last words). And I restart my console.

Unfortunately most shortcuts in the IPython console can't be reconfigured for now, sorry. We'll see what we can do in the future.


Fix(KCL-Vet): Turn the execution mode of KCL-Vet's test cases from parallel to serial.

1. Does this PR affect any open issues?(Y/N) and add issue references (e.g. "fix #123", "re #123".):

[ ] N
[x] Y

issue #277

2. What is the scope of this PR (e.g. component or file name):
KCL-Vet
3. Provide a description of the PR(e.g. more details, effects, motivations or doc link):

[ ] Affects user behaviors
[ ] Contains syntax changes
[ ] Contains variable changes
[ ] Contains experimental features
[ ] Performance regression: Consumes more CPU
[ ] Performance regression: Consumes more Memory
[x] Other

Add test case 'test_validator' for KCL-Vet to turn the execution mode of KCL-Vet's test cases from parallel to serial.
4. Are there any breaking changes?(Y/N) and describe the breaking changes(e.g. more details, motivations or doc link):

[x] N
[ ] Y

5. Are there test cases for these changes?(Y/N) select and add more details, references or doc links:

[x] Unit test
[ ] Integration test
[ ] Benchmark (add benchmark stats below)
[ ] Manual test (add detailed scripts or steps below)
[ ] Other

6. Release note

Please refer to Release Notes Language Style Guide to write a quality release note.
None

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 89.712%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
1369

Relevant Lines:
1526

💛  - Coveralls


VM Module does not have an option to specify/modify secret name for VM password

CN VM module automatically includes the creation of a random password, after which a key vault secret is created. Currently, this way of working does not allow for the modification of the name of this secret. It is possible with workarounds to accomplish this, but might be nice to have the option in the module itself?

@msmit-CN: Please check https://github.com/CloudNationHQ/terraform-azure-vm/tree/main/examples/authentication#usage-bringing-your-own-password-or-ssh-key
You can bring your own password or SSH key from (e.g.) the KV Module, and specify your own naming there.


Page speed optimization

Eliminate render-blocking resources:
1.1 google fonts "/css?family=Share+Tech+Mono"
transfer the fonts to the server or apply the system fonts
1.2 use preload for  /console.css

Enable text compression.
it would be good to use brotli compress

Use modern HTTP/2

This example is not about front-end, it shows server-side platform and access to it from browser, so client-side optimizations are not a goal for us. Moreover we serve static files because it is comfortable for developers and as a source for supply static files to cdn.
Ditto
We are going to implement HTTP/2 transport provider for metacom and add its support in impress but it is not critical because we use websocket over htts for rpc, so connection is permanent and there is no overhead for cryptography handshakes, etc.


Take support expedition damage into account for battle prediction

Fix #485
Now it should work for api_supoort_flag = 0 (without support) or api_supoort_flag = 2 (with hougeki support)
It should also work fine for 1 and 3 if the data format has not yet been changed (see discussion #485 for detail)
I haven't unlock world 5 but it works on data provided by @NicolaosGreene
Some bug for expedition evalutation is also fixed, but this part has not yet been used by KC3 Kai anyway.

:+1:


proposal: store joint and weights in mesh

In the current design, we store joints and joint weights in skin object. But these data could be stored in mesh instead of skin like glTF design. In this way we could access joints and weights more easily. Render engines could load joints/weights more easily...

Now we have mopher and skinner objects in node element which will store weights.


tACK in "GitHub review" not counted in GitHub merge

The following tACK was not recognised by our GitHub merge script:
https://github.com/bitcoin/bitcoin/pull/15084#pullrequestreview-190732482

It looks like it refers to a different commit ID than the one that was merged? If so, this is intentional, it counts only ACKs on what was exactly merged.

Yes, this is a feature

Oh. I see. Thanks for closing.


Mod Support

Central Kitchen plans to support all of following:
If you found some of 1.18.2 only mod supports 1.19.2, please leave a comment to let us know.
If you have any other support request. Please comment here too.
Support Request Guidelines

Provide links to the mod.
Elaborate on the integration features you want.
Farmer's Delight add-ons are preferred.
Mods with more downloads (more players using) are preferred.
The mod should have good textures that would fit in Create's style.
The mod should have good code and preferably open-source.
Integration features should include different aspects.
Mechanic-oriented is better than content-oriented.

1.19.2

[x] Create: Craft & Additions
[x] Farmer's Delight
[ ] Brewin' And Chewin
[x] Collector's Reap
[ ] Cultural Delights
[x] Farmer's Respite
[x] Nether's Delight
[x] Atmospheric
[x] Autumnity
[x] Buzzier Bees
[x] Environmental
[x] Neapolitan
[x] Upgrade Aquatic
[x] Peculiars
[x] Seasonals
[x] Respiteful

1.18.2

[x] Create: Craft & Additions
[x] Farmer's Delight
[ ] Brewin' And Chewin
[ ] Cultural Delights
[x] Farmer's Respite
[x] Nether's Delight
[x] Miner's Delight +
[x] Atmospheric
[x] Autumnity
[x] Buzzier Bees
[x] Environmental
[x] Neapolitan
[x] Upgrade Aquatic
[x] Cookielicious
[x] Peculiars
[x] Seasonals
[x] Respiteful

Something for this mod? https://www.curseforge.com/minecraft/mc-mods/sushigocrafting

Add support for "Festive Delight" and "Collector's Reap"?
Festive Delight adds Cinnamon Bush, and Collector's Reap adds Lime Bush and Pomegranate Bush.
However, none of these three crops can be automatically harvested by Mechanical Harvester.
Curseforge page:
https://www.curseforge.com/minecraft/mc-mods/festive-delight
https://www.curseforge.com/minecraft/mc-mods/collectors-reap

what if support for the croptopia mod for its recipes
https://www.curseforge.com/minecraft/mc-mods/croptopia

what if support for the croptopia mod for its recipes
https://www.curseforge.com/minecraft/mc-mods/croptopia

I would personally say Mods like Croptopia and Pam's are not in favor.
Also decision should be made by @LimonBlaze.

How about Pam's Harvestcraft? Pamela has updated the mod for 1.19.2 though it is not in 1.18.2 (at least I think).

How about Pam's Harvestcraft? Pamela has updated the mod for 1.19.2 though it is not in 1.18.2 (at least I think).
Edit: I see that you said that it's not in your taste - but the more mods you support, the more people will want to use your mod in their modpacks.

Don't mind me, that just my personal taste. All decisions should finally be made by @LimonBlaze since he's lead design of this project.

How about Pam's Harvestcraft? Pamela has updated the mod for 1.19.2 though it is not in 1.18.2 (at least I think).
Edit: I see that you said that it's not in your taste - but the more mods you support, the more people will want to use your mod in their modpacks.

Pam's is also not in my taste nor in Create's style, sorry.
Another good reason to refuse support for Pam's is its size, I don't feel like sacrificing all my time for Central Kitchen to support only one mod. The same applies to pack makers, I doubt if it's a good choice to spend great amounts of time on integrating Pam's content in a Create based pack.

https://beta.curseforge.com/minecraft/mc-mods/caupona

We can't make Caupona support due to license reasons.
Caupona is using GPL v3.0 which enforces downstream software to also use GPL v3.0 license, and has only made exception for Minecraft, Forge and it's api package.We need more than the api package to make a full functioning support for Caupona. If we're going to do this, we have to migrate to GPL v3.0.
However, since we are providing support for other mods using Mixin, we can't use GPL v3.0 because Mixin will cause targeted mods to become our downstream at runtime. Since apparently none of our supported mods is using GPL v3.0, this would lead to license conflicts.
Even if we make exceptions for our supported mods in our license, those mods will still be considered as downstream of Caupona because they will inherit such dependency relationship from Central Kitchen, and again it's license conflicts.

How about adding support for Windswept mod? Integration features for Wild Berry Cookie, Wild Berry Juice, and Mutton Pie will be nice.
Curseforge page:
https://www.curseforge.com/minecraft/mc-mods/windsweptmod

Seems that this causes an issue with Cooking For Blockheads kitchens: Here
When I added it to a server with CFB, the CFB Cooking Table stopped recognizing any recipes and just outputs 'Not Enough Ingredients'

Seems that this causes an issue with Cooking For Blockheads kitchens: Here When I added it to a server with CFB, the CFB Cooking Table stopped recognizing any recipes and just outputs 'Not Enough Ingredients' Note: Server is 1.18.2.

This issue is for feature requests, not for bug reports, and I can't replicate the bug you described:

May I ask if it is possible to add the formula for matcha ice cream and raspberry ice cream
Curseforge page:
https://www.curseforge.com/minecraft/mc-mods/delightful

Support for Bundled Delight would be cool. It adds compatibility with many Farmers Delight addons adding copper cup alternatives for Farmers Respite's Tea, Glass Tankards for Brewin' & Chewin' and White Strawberry uses for Neapolitan. Fluids for the drinks could be filled into the compat containers. https://www.curseforge.com/minecraft/mc-mods/bundled-delight

请求添加对于玉米乐事和末地乐事的食物配方流水线、饮品流体支持。
以及对于玉米乐事两个高的玉米作物的收割机优化、对于末地乐事“紫颂多肉植物”的收割机支持。
Request to add food formulation pipeline and beverage fluid support for Corn Delight and End's Delight. Mechanical Harvester optimization for Corn Delight two high corn crops and harvester support for the "Purple succulent" in End's Delight. （Sorry, my English is not very good）
https://www.curseforge.com/minecraft/mc-mods/corn-delight （https://www.mcmod.cn/class/5646.html）
https://www.curseforge.com/minecraft/mc-mods/ends-delight （https://www.mcmod.cn/class/6298.html）

I think it is a good idea, so I'll repost it here:

Seems that Corn Delight finally updated,
I hope the issue is fixed and you will be able to proceed.

Seems that Corn Delight finally updated, I hope the issue is fixed and you will be able to proceed.

Nope. Issue still arises in newest version.

Nope. Issue still arises in newest version.
Sorry for the false hope.

Other than that, Italian Delight could be a good addition (I have to mention some recipes are made to work with Brewin' and Chewin).

Nope. Issue still arises in newest version.

Sorry for the false hope.
~Other than that, Italian Delight could be a good addition (I have to mention some recipes are made to work with Brewin' and Chewin).~
~EDIT: it's MIT licensed but I can't manage to find its source code and it's a MCreator mod, so maybe it falls in the no-list.~
EDIT 2: Forget about Italian Delight for now, it is too buggy at the moment (grapevine is unusable, so that make half the content unusable, not to mentions there are too much warnings in logs, no source code and badly documented).

Now Corn Delight support has been added.

Thanks

Requesting support for Crabber's Delight. One of the only 1.20.1 addons for Farmer's Delight I haven't seen anyone mention yet.
https://modrinth.com/mod/crabbers-delight

Request to add Mechanical Harvester support for the "Lemon Tree" and “Blueberry Bush” in Fruits Delight. https://www.curseforge.com/minecraft/mc-mods/fruits-delight

Requesting for updating the support of those updated Abnormals mods, especially Atmospheric.
And please improve the interaction between Create machines and Neapolitan crops if possible. For example, when try to use Mechanical Harvester to reap the mature Adzuki crops, the Adzuki soil will normally appear again, but the crop also re-appears at the same time, which is not good for automating. Another example is, when trying to use Mechanical Harvester to reap the mature Mint crops, the inventory inside the machine will get some sprouts of Mint except the Mint leaves. This action is as same as to break the crop by hand.

Requesting for updating the support of those updated Abnormals mods, especially Atmospheric. And please improve the interaction between Create machines and Neapolitan crops if possible. For example, when try to use Mechanical Harvester to reap the mature Adzuki crops, the Adzuki soil will normally appear again, but the crop also re-appears at the same time, which is not good for automating. Another example is, when trying to use Mechanical Harvester to reap the mature Mint crops, the inventory inside the machine will get some sprouts of Mint except the Mint leaves. This action is as same as to break the crop by hand.

I'm check that later. Thanks for reporting.

The mod is Delightful, and the particular features are sequenced crafting of the items added, like the cheeseburger and smore, and also adding Create liquids for the teas added by the mod. The number of items in this mod is definitely smaller than some, and I just think it would be a great addition to the compats.

Compat request for Aether Delight which adds 17 food items from across the Aether mod and three larger addons to the base mod. If harvesting and crafting support was added, I'd be a happy camper. A couple fluids will have to be added as well.
Huge caveat: Mod is made with MCreator. However, it seems to be the only Aether extension for Farmer's Delight out there, so I think it might be worth taking a look at.

Request for My Nether's Delight, a newer branch of Nether's Delight with more polished concepts of the original. There are 3 feasts and 18 plated meals, and some crops without out-of-the-box compat with create, like bullet peppers and powdery cane.

Request for the Let's Do Mods series
https://www.curseforge.com/minecraft/mc-mods/lets-do-candlelight
https://www.curseforge.com/minecraft/mc-mods/lets-do-meadow
https://www.curseforge.com/minecraft/mc-mods/lets-do-beachparty
https://www.curseforge.com/minecraft/mc-mods/lets-do-herbal-brews
https://www.curseforge.com/minecraft/mc-mods/lets-do-bakery
https://www.curseforge.com/minecraft/mc-mods/lets-do-vinery
https://www.curseforge.com/minecraft/mc-mods/lets-do-brewery
Thoses mods add a lot of recipes that cannot be automated with Create so it would be awesome if they were supported by central kitchen!

The mod is Delightful, and the particular features are sequenced crafting of the items added, like the cheeseburger and smore, and also adding Create liquids for the teas added by the mod. The number of items in this mod is definitely smaller than some, and I just think it would be a great addition to the compats.

The mod also adds animal oil, which I feel would be good to be made as a liquid fuel by this mod for Create and its addons

Request for Vintage Delight, adds a bunch of mechanics to delight such as pickling, cheese-making, and salt production. I feel that adding ways to automate these processes in Create would be awesome.

Request for (re-) adding support for Collectors reap in 1.20.1, as the mod has updated from it's 1.19 iteration and has added several new meals and mobs relating to seafood.
Unfortunately I cannot think of any possibilities for original or interesting automation additions besides the new chieftain crab cooking process, and the compatibility / recipes that was in the 1.19 version.


Show number of confs for incoming onchain txs in activity list

Description:
Resoles #1685

How Has This Been Tested?
Manually

Screenshots (if appropriate):

Types of changes:
Enhancement/feature

Checklist:

[x] My code follows the code style of this project.
[x] I have reviewed and updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes where needed.
[ ] All new and existing tests passed.
[x] My commits have been squashed into a concise set of changes.

Hey @mrfelton @korhaliv.
When discussing with Namson and Ole, we all feel that showing the number of confirmations is an unnecessary addition to the UI, as it is always one click away in the detail modal.
I do like the idea of being able to visually see what transactions are unconfirmed, but I think that is as far as this PR should go personally. What are your thoughts there?

Coverage decreased (-0.02%) to 22.647% when pulling d82f3abb86470d8a40c4d2e84022a5f3d3232362 on korhaliv:feat/unconf-conf-tx into 576dade8ba80a3201e533ccc18979cf39483ebaf on LN-Zap:next.


Adds GIP currency code to CurrencyCode enum

Description
Adds the missing currency code value for GIP that is also present in billing_graph_api/schema.graphql. This change is necessary in order to fix the following bug reported.
Bugsnag: https://app.bugsnag.com/shopify/shopify-production/timeline?filters[error][0]=5e14e89ba14aea0018358f98
Type of change
Updating the CurrencyCode enum to include the value GIP

[x]  Patch: Bug/ Documentation fix (non-breaking change which fixes an issue or adds documentation)
[ ]  Minor: New feature (non-breaking change which adds functionality)
[ ]  Major: Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist

[x] I have added a changelog entry, prefixed by the type of change noted above

We should centralize the source of truth for currencies. Polaris has pipelines to create ruby gems and node modules, which could be leverage to have one source of truth servicing ruby/node apps


HHH-12033 README.md links should use Markdown notation instead of AsciiDoc

This PR fixes a small typo in the links in README.md's markdown.
Before:

After:

Also http is replaced by https in that area.

Applied upstream, thanks


too many C levels

Hi,
I have manually imported your lua script into /usr/local/share/lua/5.3/haproxy-lua-http.lua along with https://github.com/TimWolla/haproxy-auth-request/blob/main/auth-request.lua and https://github.com/rxi/json.lua (I want to use Authelia).
After this, I tried adding the required loading lines in the global section
lua-prepend-path /usr/local/share/lua/5.3/haproxy-lua-http.lua
lua-load /usr/local/share/lua/5.3/auth-request.lua

When adding the second line, then HAProxy starts to complain about your file and I have no idea why:
Errors found while starting haproxy
[NOTICE] 013/044744 (18131) : haproxy version is 2.2.14-a07ac36
[ALERT] 013/044744 (18131) : parsing [/var/etc/haproxy_test/haproxy.cfg:25] : Lua runtime error: error loading module 'json' from file '/usr/local/share/lua/5.3/haproxy-lua-http.lua':
/usr/local/share/lua/5.3/haproxy-lua-http.lua:673: too many C levels (limit is 200) in function at line 619 near 'v'

Can you help me figure this out?
Many thanks :)

You need to provide a lua json library.
https://github.com/haproxytech/haproxy-lua-http/blob/master/http.lua#L33

Thank you so much!


Error in src/App.jsx

Error in src/App.jsx, "styles" is not defined on line 37, 62 and 68
The error makes the app to show a blank screen

Error in src/App.jsx, "styles" is not defined on line 37, 62 and 68 The error makes the app to show a blank screen

for this one somehow can't replicate the issue at all, since in App.jsx there is the styles as @0xPr0f shown there 🤔


Added --ease-anticipate-* easings

breaking change
Added --ease-elastic-in, renamed --ease-elastic-* and --ease-squish-* to --ease-elastic-out-* and --ease-elastic-in-out-* (rename as per Adam's comment). Corresponding changes to docsite were made (adding --ease-elastic-in-* demo box and refactored for the rename).
P.S: First time OSS contributor and new to CSS, sorry it there are any issues w/ my Bezier functions or anything else.

Accepted your changes Adam! I also made another commit to adjust the tests. Thanks for catching the typo. As for your discussion of making a v2 branch, I feel it would be nice to give users this additional prop. Why don't we go with your send proposal of making a change to 1.6.0, aliasing --ease-squish-* and --ease-elastic-* to avoid breaking anything.


The ontap-nas-economy driver should have more intelligent volume placement

The placement of flexvols by the ontap-nas-economy driver needs to be more intelligent.  The following suggestions are made as a starting point, based on customer feedback for a large scale environment:

Allow Trident to be configured so that we only continue to provision qtrees in a flexvol until the underlying aggregate is X percentage full or Y percentage oversubscribed.

If multiple aggregates are defined, prefer to use whatever aggregate has the most free space and least oversubscribed.

While #1 and #2 are more important in the short term, at some point it would also be desirable to have provisioning take into account node headroom.

To be clear, most of these would apply to all ONTAP drivers.  The Trident scheduler is definitely a rich target environment.

Well, if we talk about placement logic, I'll add a few more items to consider (based on actual customer requirements):

Number of volumes on a node (since Ontap has logical limits that you don't want to exceed)
Node which holds the LIF for the SVM (in order to avoid indirect data access for best performance)
Provisioned IOPS (via adapative QoS concept) on the node/aggregate

Combined with the points already mentioned by others and weighted and sorted according to the specific requirements the customer has.
In the end, we'd either need a customizable rule engine in trident, or a flexible mechanism to attach other tools. If we decide to go with the later, I'd vote for WFA in addition to AppDM and NSLM that are already mentioned, since (today) it is the only tool that is flexible enough to build a custom solution that takes all of the above items into consideration.

+1 for this as i'm hitting issues when using Trident + cloud manager together, as its still not picking the correct pool which is automatically generated for me.

+1 Same request: we have a 12 node cluster for the point: Node which holds the LIF for the SVM (in order to avoid indirect data access for best performance)
and
leveraging full volume provisioning as mentioned before.

Well, if we talk about placement logic, I'll add a few more items to consider (based on actual customer requirements):

Number of volumes on a node (since Ontap has logical limits that you don't want to exceed)
Node which holds the LIF for the SVM (in order to avoid indirect data access for best performance)
Provisioned IOPS (via adapative QoS concept) on the node/aggregate

Combined with the points already mentioned by others and weighted and sorted according to the specific requirements the customer has.
In the end, we'd either need a customizable rule engine in trident, or a flexible mechanism to attach other tools. If we decide to go with the later, I'd vote for WFA in addition to AppDM and NSLM that are already mentioned, since (today) it is the only tool that is flexible enough to build a custom solution that takes all of the above items into consideration.


Overriding schedule disables schedule switch

As a user, if I toggle the schedule on and then force the mower to mow, the switch even though the schedule is still active shows as being off.
Expected behavior
The switch should remain on even if the mower has had the schedule temporarily overridden.

If the mower is in operation when the server restarts, the plugin will not be able to ascertain whether the mower is scheduled to run. The mower only reports its schedule status while docked in the charge station.


Add log4j-slf4j-impl as runtime dependency in default project build

This prepares support for other runtime, like Quarkus, that bring their own logging backend.
This requires apache/camel-k-runtime#37.

Is there a way to make the version of log4j not hardcoded? Can't we import the camel-bom and use its version or something?

Yes, it could probably be defined in the Camel runtime BOM.


SslHandler and OpenSslEngine miscalculation of wrap destination buffe…

…r size
Motivation:
When we do a wrap operation we calculate the maximum size of the destination buffer ahead of time, and return a BUFFER_OVERFLOW exception if the destination buffer is not big enough. However if there is a CompositeByteBuf the wrap operation may consist of multiple ByteBuffers and each incurs its own overhead during the encryption. We currently don't account for the overhead required for encryption if there are multiple ByteBuffers and we assume the overhead will only apply once to the entire input size. If there is not enough room to write an entire encrypted packed into the BIO SSL_write will return -1 despite having actually written content to the BIO. We then attempt to retry the write with a bigger buffer, but because SSL_write is stateful the remaining bytes from the previous operation are put into the BIO. This results in sending the second half of the encrypted data being sent to the peer which is not of proper format and the peer will be confused and ultimately not get the expected data (which may result in a fatal error). In this case because SSL_write returns -1 we have no way to know how many bytes were actually consumed and so the best we can do is ensure that we always allocate a destination buffer with enough space so we are guaranteed to complete the write operation synchronously.
Modifications:

SslHandler#allocateNetBuf should take into account how many ByteBuffers will be wrapped and apply the encryption overhead for each
Include the TLS header length in the overhead computation

Result:
Fixes https://github.com/netty/netty/issues/6481

@normanmaurer - PTAL

4.1 (53fc693) 4.0 (ccd6098)


Fixed #24693 -- Added label and label_lower property to Options

Ticket : https://code.djangoproject.com/ticket/24693

Thanks for the pull request :)
Can you go through the Django source code and replace the places where either (app_label, model_name) or (app_label, object_name) is used with the respective label.

Will do

buildbot, add to whitelist.

After you update the patch, please uncheck "Patch needs improvement" on the ticket so it appears in the review queue, thanks!

I didn't know about "Patch needs improvement" will keep in mind for future PRs thanks

diff --git a/django/db/migrations/state.py b/django/db/migrations/state.py
index 7c4984f..4b24414 100644
--- a/django/db/migrations/state.py
+++ b/django/db/migrations/state.py
@@ -424,7 +424,7 @@ class ModelState(object):
         # Make our record
         bases = tuple(
             (
-                "%s" % base._meta.label_lower
+                base._meta.label_lower
                 if hasattr(base, "_meta") else
                 base
             )
diff --git a/django/db/models/base.py b/django/db/models/base.py
index 42474c5..27764bb 100644
--- a/django/db/models/base.py
+++ b/django/db/models/base.py
@@ -327,7 +327,6 @@ class ModelBase(type):
             cls.__doc__ = "%s(%s)" % (cls.__name__, ", ".join(f.name for f in opts.fields))

         get_absolute_url_override = settings.ABSOLUTE_URL_OVERRIDES.get(opts.label_lower)
-
         if get_absolute_url_override:
             setattr(cls, 'get_absolute_url', get_absolute_url_override)

diff --git a/django/forms/models.py b/django/forms/models.py
index 5828b0a..1ea0dea 100644
--- a/django/forms/models.py
+++ b/django/forms/models.py
@@ -973,12 +973,12 @@ def _get_foreign_key(parent_model, model, fk_name=None, can_fail=False):
                     (fk.remote_field.model != parent_model and
                      fk.remote_field.model not in parent_model._meta.get_parent_list()):
                 raise ValueError(
-                    "fk_name '%s' is not a ForeignKey to '%s'."
-                    % (fk_name, parent_model._meta.label))
+                    "fk_name '%s' is not a ForeignKey to '%s'." % (fk_name, parent_model._meta.label)
+                )
         elif len(fks_to_parent) == 0:
             raise ValueError(
-                "'%s' has no field named '%s'."
-                % (model._meta.label, fk_name))
+                "'%s' has no field named '%s'." % (model._meta.label, fk_name)
+            )
     else:
         # Try to discover what the ForeignKey from model to parent_model is
         fks_to_parent = [
diff --git a/docs/ref/models/options.txt b/docs/ref/models/options.txt
index 2098395..1dff215 100644
--- a/docs/ref/models/options.txt
+++ b/docs/ref/models/options.txt
@@ -414,7 +414,8 @@ Read-only ``Meta`` attributes

     .. versionadded:: 1.9

-    Representation of the object, returns ``app_label.object_name``.
+    Representation of the object, returns ``app_label.object_name``, e.g.
+    ``'polls.Question'``.

 ``label_lower``
 ---------------
@@ -423,4 +424,5 @@ Read-only ``Meta`` attributes

     .. versionadded:: 1.9

-    Representation of the model, returns ``app_label.model_name``.
+    Representation of the model, returns ``app_label.model_name``, e.g.
+    ``'polls.question'``.

Merged in 69ddc1b3da043195a0f4e09211d395724b42c70b. Thanks! :smile:


ERROR:  relation "public.Block"/"public.Withdrawal" does not exist at character 862

OS
Ubuntu
Versions
db-sync: 13.0.4
postgresql: 11.5
cardano: 1.35.3
cardano graphql: 7.0.0
cardano graphql hasura: 7.0.0
ogmios 5.5.5
Build/Install Method
Docker container
Run method
Docker
Problem Report
2022-09-16 17:31:17.174 UTC [3040] ERROR:  relation "public.Block" does not exist at character 862
2022-09-16 17:31:17.174 UTC [3040] STATEMENT:  SELECT  coalesce(json_agg("root" ORDER BY "root.or.firstAppearedInBlock.pg.slotNo" DESC NULLS FIRST), '[]' ) AS "root" FROM  (SELECT  "_3_root.or.firstAppearedInBlock"."root.or.firstAppearedInBlock.pg.slotNo" AS "root.or.firstAppearedInBlock.pg.slotNo", row_to_json((SELECT  "_4_e"  FROM  (SELECT  "_3_root.or.firstAppearedInBlock"."firstAppearedInBlock" AS "firstAppearedInBlock"       ) AS "_4_e"      ) ) AS "root" FROM  (SELECT  *  FROM "public"."Asset"  WHERE ('true')     ) AS "_0_root.base" LEFT OUTER JOIN LATERAL (SELECT  "_1_root.or.firstAppearedInBlock.base"."slotNo" AS "root.or.firstAppearedInBlock.pg.slotNo", row_to_json((SELECT  "_2_e"  FROM  (SELECT  "_1_root.or.firstAppearedInBlock.base"."hash" AS "hash", "_1_root.or.firstAppearedInBlock.base"."slotNo" AS "slotNo"       ) AS "_2_e"      ) ) AS "firstAppearedInBlock" FROM  (SELECT  *  FROM "public"."Block"  WHERE (("_0_root.base"."firstAppearedInSlot") = ("slotNo"))     ) AS "_1_root.or.firstAppearedInBlock.base"      ) AS "_3_root.or.firstAppearedInBlock" ON ('true')    ORDER BY "root.or.firstAppearedInBlock.pg.slotNo" DESC NULLS FIRST LIMIT 1 OFFSET ('1')::integer) AS "_5_root"

and
2022-09-16 13:36:11.414 UTC [1665] ERROR:  relation "public.Withdrawal" does not exist at character 198
2022-09-16 13:36:11.414 UTC [1665] STATEMENT:  SELECT  json_build_object('aggregate', json_build_object('sum', json_build_object('amount', sum("amount" ) ) ) ) AS "root" FROM  (SELECT  "_0_root.base"."amount" AS "amount" FROM  (SELECT  *  FROM "public"."Withdrawal"  WHERE ('true')     ) AS "_0_root.base"      ) AS "_1_root"

But when I log into postgresql (database 'graphql') and list the tables using \d it shows:
public | Block                           | view     | postgresuser
public | Withdrawal                      | view     | postgresuser

Can anyone help me what is going wrong here? The env variables for the database etc seem okay. It worked before, but then broke after restarting the node I assume

This is a graphql` issue. Transferring that to the appropriate repo.