Both test loss and validation loss go to 0.5

I modified your code for my problem. I added regularization terms in Embedding layers. But when I train the model, both test loss and val loss go to 0.5. I guess this is because both user and item latent vectors shrink to zero, which makes the bpr_triplet_loss always be 0.5.
Do you have any idea why this happens?

Maybe you added too much regularization?

Even when I set regularization to 0, it still happens. You can check my code (sorry for the messy code, I'm still in debugging):
`training_data = []
tuning_data   = []
all_users = set()
all_pois  = set()
all_words = set()
user_pois = dd(set)
dim = 50
reg = 0.01
max_words = 200
num_negs = 5
learning_rate = 0.001
num_epochs = 500
batch_size = 256
def load_data():
print 'loading data...'
for filename in ['new_training.txt', 'new_tuning.txt']:
print filename
for line in open(DIR + filename):
line = map(int,line.split())
user = line[0]
poi = line[1]
        all_users.add(user)
        all_pois.add(poi)

        words = line[2:max_words+2]
        all_words.update(words)

        if filename == 'new_training.txt':
            training_data.append([user,poi,words])
            user_pois[user].add(poi)
        else:
            tuning_data.append([user,poi,words])

load_data()
num_users = max(all_users)
num_pois  = max(all_pois)
num_words = max(all_words)
all_users = list(all_users)
all_pois  = list(all_pois)
all_words = list(all_words)
def identity_loss(y_true, y_pred):
return K.mean(y_pred - 0 * y_true)
def bpr_triplet_loss(X):
user_latent, pos_poi_latent, neg_poi_latent = X
# BPR loss
loss = 1.0 - K.sigmoid(
    K.sum(user_latent * (pos_poi_latent - neg_poi_latent), axis=-1, keepdims=True))

return loss

def build_model():
user_input = Input(shape=(1,), dtype='int32', name='user_input')
pos_poi_input  = Input(shape=(1,), dtype='int32', name='pos_poi_input')
neg_poi_input  = Input(shape=(1,), dtype='int32', name='neg_poi_input')
# Embedding layer
Embedding_user = Embedding(input_dim = num_users+1, output_dim = dim, name = 'user_embedding',
                              embeddings_initializer = RandomUniform(), embeddings_regularizer = l2(reg), input_length=1)

item_embedding_layer = Embedding(input_dim = num_pois+1, output_dim = dim, name='item_embedding',
                              embeddings_initializer = RandomUniform(), embeddings_regularizer = l2(reg), input_length=1)

user_latent = Embedding_user(user_input)
user_latent = Flatten()(user_latent)

pos_poi_latent = item_embedding_layer(pos_poi_input)
pos_poi_latent = Flatten()(pos_poi_latent)

neg_poi_latent = item_embedding_layer(neg_poi_input)
neg_poi_latent = Flatten()(neg_poi_latent)

loss = merge([user_latent, pos_poi_latent, neg_poi_latent], mode=bpr_triplet_loss, output_shape=(1,))
# prediction = Dense(1, activation='sigmoid', name='prediction')(predict_score)

model = Model(input=[user_input, pos_poi_input, neg_poi_input], output=loss)

return model

training_idx = range(len(training_data))*num_negs
np.random.shuffle(training_idx)
mini_batch_size = 200000
start_idx = 0
end_idx = mini_batch_size
def get_training_instances():
global start_idx, end_idx
user_input, pos_poi_input, neg_poi_input = [], [], []

if start_idx >= len(training_idx):
    np.random.shuffle(training_idx)
    start_idx = 0
    end_idx = mini_batch_size

for samp in xrange(start_idx, min(end_idx, len(training_idx))):
    idx = training_idx[samp]
    user, poi, words = training_data[idx]

    user_input.append(user)
    pos_poi_input.append(poi)

    while True:
        neg_poi = all_pois[np.random.randint(len(all_pois))]
        if neg_poi not in user_pois[user]:
            break

    neg_poi_input.append(neg_poi)

start_idx = end_idx
end_idx += mini_batch_size

return user_input, pos_poi_input, neg_poi_input

def get_validation_set():
user_input, pos_poi_input, neg_poi_input = [],[],[]
for user, pos_poi, words in tuning_data:
    user_input.append(user)
    pos_poi_input.append(pos_poi)

    while True:
        neg_poi = all_pois[np.random.randint(len(all_pois))]
        if neg_poi not in user_pois[user]:
            break

    neg_poi_input.append(neg_poi)

return user_input, pos_poi_input, neg_poi_input

model = build_model()
optimizer = Adam(lr=learning_rate)
optimizer = SGD(lr=learning_rate)
model.compile(optimizer=optimizer, loss=identity_loss)
#run training
val_user_input, val_pos_poi_input, val_neg_poi_input = get_validation_set()
x_validate = [np.array(val_user_input), np.array(val_pos_poi_input), np.array(val_neg_poi_input)]
y_validate = np.ones(len(val_user_input))
for epoch in xrange(num_epochs):
user_input, pos_poi_input, neg_poi_input = get_training_instances()

x_training = [np.array(user_input), np.array(pos_poi_input), np.array(neg_poi_input)]
y_training = np.ones(len(user_input))

model.fit(x_training, y_training,
          validation_data = (x_validate, y_validate),
          batch_size=batch_size, nb_epoch=1, shuffle=True
         )

model.save(DIR + 'model_test.txt')`

It's hard to say what's going wrong. Are you sure you set regularization to 0.0? In the code above it's set to 0.01.
I would spend some time refactoring the code, it would be easier for you to understand what's actually happening.

Even I set regularization to 0.0, this still happens.
What is more strange is that, I change the model to simple matrix factorization (using dot product between user and item latent factors to fit the matrix), the issue still happens. Then when I try fit only nonzero values (which are 1), it still happens. Even though latent factors tend to go to zero (hence their dot product as well), the training loss shown on screen decreases!!! It should be increased because I only fit with nonzero values (I used 'mse' as loss metric).
I think there should be wrong somewhere in my code.

I think I know the problem. The problem is that the Embedding layers of current keras are broken with regularization!!
From above link, they say normally we don't use regularization for embeddings. But I really don't understand that why the model is not over-fitting without regularization? Are there any constraints that make the model avoid over-fitting?
Now, we have two choices: 1) do not use any regularization at all, 2) assign updating weights for each user and item based on its frequency, as the suggestion from the above link, 3) use embeddings_constraint. I have tested option 3 in the simple matrix factorization model, it produces better validation loss, although training loss is worse. I will test this option in your model later.

Updating every embedding weight after every minibatch when a L2 penalty is applied is the right behaviour. It is perfectly fine to use L2 regularization, but the penalty needs to be a small enough value.
In your case, I would:

Try to refactor the code. You have functions that close over and modify variables defined in the outer scope, for one: I worry that you are making mistakes you (or I) can't see because your training code is not clear.
You are running a huge number of epochs.
Try a different optimizer: Adam or Adagrad.
Try a larger learning rate.

The good news is that there is an issue with your code or hyperparameters: the framework is fine.


async_publish msg with qos0, but received not in order, is it possible?

publish a qos0 message with async_publish of async_client, other client subscribed to the message may receive the message in garbled order?

There is only one clientP1 and clientS1, publishing and receiving are all single-threaded, but broker is not mqtt_cpp, sent three messages ABC continuously , but the receiver received ACB, may be the broker rearranged the order?

I guess so.
You can try async_mqtt (mqtt_cpp's successor project) docker container broker.
https://github.com/redboltz/async_mqtt/blob/doc/README.md#run-on-the-docker-container
For testing you can replace emqx with async_mqtt broker, and observe the sersult.

I'll try it, thanks a lot!


Remove checks for reserved fields in decode stage for FENCE.I

Hi there!
The RISC-V specification says

The unused fields in the FENCE.I instruction, imm[11:0], rs1, and rd, are reserved for finer-grain
fences in future extensions. For forward compatibility, base implementations shall ignore these
fields, and standard software shall zero these fields.

Therefore, it seems that these checks should be removed.
Thanks!
Flavien

Agreed.


Cannon.js collision - preservation of energy

Hello, I’m using cannon.js to handle collisions in threejs and it’s working fine except for one case: I need the collision between a sphere and a box doesn’t make them lose energy so they can preserve their velocity. The box body is STATIC.
Is it possible?
As you can see in the following demo after the collision, the sphere lose energy and start going slower.
cannonjs-walls-collision.zip
This is the build folder:
build.zip
Thanks,
Regards

You should be able to make a contact material between the two bodies and set restitution to 1 so no energy is lost on bouncing

here is a zip file containing the example. Uses cdns (three.js)/base repo code (cannon.js, orbitcontrols) so no need to download new libraries.
cannonjs-walls-collision.zip


Update nishith-pathak.yml

updated description

Docs Build status updates of commit 1102677:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

rd/nishith-pathak.yml
:x:Error

Details

rd/toc.yml
:warning:Warning

Details

rd/map.yml
:warning:Warning

Details

rd/index.yml
:warning:Warning

Details

rd/nishith-pathak.yml

Line 9, Column 2: [Error-yaml-syntax-error] While parsing a block mapping, did not find expected key.

rd/toc.yml

Line 275, Column 10: [Warning-xref-not-found] Cross reference not found: 'rd.nishith-pathak'.

rd/map.yml

Line 15, Column 8: [Warning-file-not-found] Invalid file link: './map'.
Line 17, Column 8: [Warning-file-not-found] Invalid file link: './about'.
Line 19, Column 8: [Warning-file-not-found] Invalid file link: './CodeOfConduct'.
Line 1351, Column 8: [Warning-xref-not-found] Cross reference not found: 'rd.nishith-pathak'.

rd/index.yml

Line 14, Column 8: [Warning-file-not-found] Invalid file link: './map'.
Line 16, Column 8: [Warning-file-not-found] Invalid file link: './about'.
Line 18, Column 8: [Warning-file-not-found] Invalid file link: './CodeOfConduct'.
Line 1350, Column 8: [Warning-xref-not-found] Cross reference not found: 'rd.nishith-pathak'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Fix uppercase handling of deployment name under traffic/mirror_traffic

Description
When creating an online deployment, if the given deployment name has uppercase letters, it is converted to lowercase, and the created deployment has all-lowercased name
If users try to set traffic using deployment name that has uppercase letters
we are throwing an error.
We need to convert the deployment names under traffic/mirror_traffic to be lower case.
All SDK Contribution checklist:

[ ] The pull request does not introduce [breaking changes]
[ ] CHANGELOG is updated for new features, bug fixes or other significant changes.
[ ] I have read the contribution guidelines.

General Guidelines and Best Practices

[ ] Title of the pull request is clear and informative.
[ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[ ] Pull request includes test coverage for the included changes.
Updated unit test to include case for lowercase name

API change check
API changes are not detected in this pull request.


Create validator for metadata file

Should validate that:

Name of geojson file is lowercase
Data URL should be fully-qualified, with protocol, etc.

Make sure data URL resolves

Author name resolves to valid twitter ID

It would be valuable to write a well-defined schema that the *metadata.json files should follow.


Android missing files

Hi,
I am trying to create a custom app to control the jumping sumo via android devices.
So far, I have accomplished to build your sources for Android (following https://github.com/ARDroneSDK3/Docs/blob/master/Installation/INSTALL) and as expected ended up with some jar libs and the respective .so libs.
I created an android project in eclipse, included the libs and copied the android sample .java files (https://github.com/ARDroneSDK3/Samples/tree/master/Android) to my source folder, unfortunately ending up with a lot of missing files.
After reading the reported iOS issues, I am aware that I am expected to implement some of the classes myself. For some classes, (e.g. the Photo-/Video- RecordController) this makes sense, but for others I wonder wheter this was intended:
If I use the eclipse quick fix feature to resolve missing imports by creatíng all the missing classes and their respective functions I end up with 8 classes to implement:
ARRouter
ARRouterDiscoveryConnection
JumpingSumoPhotoRecordController
JumpingSumoVideoRecordController
DataCollectionUtils
DeviceUtils
ARFrame
ARStreamManager
Also I found no include for ARBundle, so I assume I am meant to create this class in the devicecontrollers package.
Finally, I guess the following imports in JumpingSumoDeviceController are misplaced:
import com.parrot.freeflight3.recordcontrollers.ARDrone3PhotoRecordController;
import com.parrot.freeflight3.recordcontrollers.ARDrone3VideoRecordController;
Afaik, the ARDrone3 is a different parrot drone right? Or does the 3 stand for SDK3 in this case?
Would you mind pointing out what the respective classes are meant to do or which router etc you expect me to wrap? At least I guess I am expected to provide my own router/binder etc? Is there a documentation i am simply missing? I didnt find anything useful in https://github.com/ARDroneSDK3/Docs which seems just to include the auto-generated API reference.
Thanks in advance!

In addition to this, your twitter site mentioned that you'd be releasing working examples for all platforms in January - is this still going to be the case?

It would be nice if they would release an working sample for the JumpingSumo...
Is there anyone who has the missing classes?? :D Please share with us :))


[BUG] AEProject includes old node/compiler version

Describe the bug
AEProject includes old node/compiler version, an "update" resets it to old versions from manually updated ones
Expected behavior
Up to date node/compiler should be included and only upgrades should be applied.
Aeproject information (please complete the following information):

AEproject Version 2.1.0

Hey @thepiwo,
These are the tested stable versions that we could guarantee are working as intended.
This change could potentially break Aeproject.
It would be an overhaul if we change how we build our images, while we are soon expecting the core team to provide the possibility of a saenbox. As soon as this happens, we prefer to invest that time into integrating this feature. We believe this will be much more convenient for local development.
In the meantime, we'll strive to be up to date with the latest versions of the node and compiler.
Cheers!
Hris

My problem with this is that as a developer of contracts I see the newest versions documentation online, also base-aepp and hosted infrastructure uses newer versions of everything that my tests and contract may not be compatible with perfectly.


Add email & country

Fixes #
Describe the changes you have made in this pr - I have added Email and country.
we er show the country or create a new attribute then it'll be more attractive for the user
Screenshots of the changes (If any) -

Hi @soumyadip007 , thank you for this PR, please make the corresponding issue and discuss it before working on any PR. This helps us discuss whether the proposed feature is worth working on or not and helps us save the time for the contributor. Thanks

Okay @armudgal.....so in which field I should start work?

I'm really excited to contribute in your org.

Hello, Why have you add your proposal as a file in this PR?


Catch uncaught exception in web api upload.

As described in #750
webapi upload function will return bunch object instead of response in certain circumstances causing an AttributeError to be thrown. We should catch this.

Very annoying the docs build fine for me locally...


Fix and improvements on Brazilian Portuguese translation

I found a little mistake in the file: resources/lang/pt-BR/passwords.php. The word "confimação" is misspeling... There is some improvements than can be made on the file resources/lang/pt-BR/project.php the first word for the translation of 'write your message...' is begining lowercase, I belive it will look a bit better with it start with a uppercase letter.
Can I make a PR with this fixes?

Sure, go ahead.


Is there any tracker segmentation for human annotaion in videos?

My actions before raising this issue

[x] Read/searched the docs
[x] Searched past issues

I have a video ( this is just a frame of video) and i want to track the human [ just human ] and then annotate the human as he/she acts during the video using attributes of that label!
Is there any automatic labeler ( using nucli https://opencv.github.io/cvat/docs/administration/advanced/installation_automatic_annotation/ ) that can detect just the human and subtract it from background automatically [ just two labels]?
the exact human without unnessasary boxes! {something like what SAM does but for video}
It might also be related to this issue: #5984 , #6019
https://github.com/gaomingqi/Track-Anything
https://github.com/kadirnar/segment-anything-video
https://github.com/z-x-yang/Segment-and-Track-Anything
https://github.com/UX-Decoder/Segment-Everything-Everywhere-All-At-Once
https://github.com/ZrrSkywalker/Personalize-SAM
I'm on ubuntu server 20.04 and latest cvat!
Thanks

Hello @p0mad
You can find all supported models on the main page in README.md: https://github.com/opencv/cvat#deep-learning-serverless-functions-for-automatic-labeling
Track Anything is not implemented.

@bsekachev thank you. Maybe you can help me further, correct me if I was wrong.

I extend the serverless transT, what I have done:

In model_handler, I call the SAM with the bbox or shape.
In main, I add masks  to the results dict and follow state-quo code to push all stuff back on the front.

If the image was ie. size (1270,512), the masks pushed back should have the same size. Actually, I have logged out the output from SAM, it was expected  (1270,512).
So, can you guide me, on how to adjust the checkTrackedStates to show the masked objects based on the returned SAM outputs, or does CVAT source code contain some similar stuff?
Thank you.

Does anyone know if this feature is part of the roadmap? And if yes, when is it going to be available?


[WIP] Automate workflow using github actions - execute-workflow

Closes #21
This PR implements GitHub actions to run benchmark experiments workflow (execute-workflow)
End to end workflow:
new release -> run experiment batch -> post process data -> submit through metriq API

[x] Create base yaml file and Test a hello world command to run every hour
[x] Add command to retrieve qiskit versions
[x] Update qiskit package name from qiskit-terra to qiskit (as per review comment)
[x] Keep track of results already submitted to metriq
[x] Update existing submission data to only keep the latest qiskit version for every major.minor combination
[x] Adjust tox environments for end to end runs
[ ] Create env variable for this repo
[ ] Change scheduler to run once a month
[ ] Update README

Other items to handle by this automation process:

if new results are computed, commit new csv files and deletion of outdated ones
ignore committing new tox.ini files
add metriq token as secret env var in this repo


Fix a typo of the description

I found a typo in remove_retention_in_days description.
I think retention_in_days_key is correct, not retention_in_days.
see: https://github.com/fluent-plugins-nursery/fluent-plugin-cloudwatch-logs/blob/51eccdb2a6f22951e542bcef22ebbd769bdcf663/lib/fluent/plugin/out_cloudwatch_logs.rb#L192

Oops, I've mistake.
The actual problem was that non-existent parameter is specified.


fwctl build errors when built with osquery 3.2.9

osquery version: 3.2.9-98-g2f872cb9
Name and version of OS tested on: Windows 10
The final build step (building the extensions) fails, with the following errors related to safeStrtoull:
C:\Projects\osquery-fb-master\external\extension_trailofbits\fwctl\src\portblacklist.cpp(506): error C2039: 'safeStrtoull': is not a member of 'osquery' [C:\Projects\osquery-fb-master\build
\windows10\external\trailofbits_osquery_extensions.vcxproj]
C:\Projects\osquery-fb-master\external\extension_trailofbits\fwctl\src\portblacklist.cpp(506): error C3861: 'safeStrtoull': identifier not found [C:\Projects\osquery-fb-master\build\windows
10\external\trailofbits_osquery_extensions.vcxproj]

This function was apparently removed from osquery after 3.2.6 or so.
Replace it with tryTo<'unsigned long long'> ?

Office hours today: confirmed that they are moving away from safeStrtoull toward tryTo

Fixed with commit https://github.com/trailofbits/osquery-extensions/commit/f369aad742e199577abd651318243ac1ccad214f


Added test coverage command

Run npm run coverage and check out coverage/index.html in your browser.

not sure why this would fail a build 🤔

not sure why this would fail a build 🤔

[09:08:17.328] Cloning github.com/AlexMassenzio/wordchain (Branch: guppy/test-coverage, Commit: d202d71)
[09:08:18.303] Cloning completed: 974.924ms
[09:08:19.141] Restored build cache
[09:08:19.195] Running "vercel build"
[09:08:19.855] Vercel CLI 28.6.0
[09:08:20.668] Detected pnpm-lock.yaml generated by pnpm 7...
[09:08:20.679] Installing dependencies...
[09:08:21.398] Lockfile is up to date, resolution step is skipped
[09:08:21.402]  ERR_PNPM_OUTDATED_LOCKFILE  Cannot install with "frozen-lockfile" because pnpm-lock.yaml is not up to date with package.json
[09:08:21.402]
[09:08:21.402] Note that in CI environments this setting is true by default. If you still need to run install in such cases, use "pnpm install --no-frozen-lockfile"
[09:08:21.426] Error: Command "pnpm install" exited with 1

Looks like lock file wasnt included. Ill send it up

oh, interesting, not used to committing lock files, but that makes sense, ty boi


Feat webpack

It's finally here!
I think u need to run yarn to install all node_components.

Can you update the Readme plz for how to use dependencies. Also what happens if (somehow) a dependency isn't on npm?

I will update the Readme.
It's not complicated, we can put the not npm library somewhere in our repo and just import it in main. That should work.
Yeah, I think we have to using it to find out…

i committed main.js with the lazySizes import commented out. this is because lazySizes.init(); is commented, resulting in this jshint error:
WARNING in ./src/js/main.js
(Emitted value instead of an instance of Error) jshint results in errors
  'lazySizes' is defined but never used. @ line 5 char 8
    import lazySizes from 'lazysizes';


ConfgureScope called only for ConsumerConsumeContext.

Is this a bug report?, Can you also reproduce the problem with the latest version?
YES, YES 6.2.5-develop.2574
Steps to Reproduce
Setup MT bus using Autofac integration.
namespace WebApplication
{
    public class Startup
    {
        public void ConfigureServices(IServiceCollection services)
        {
            services
                .AddControllers();

            services
                .AddHealthChecks();

            services
                .AddMassTransitHostedService();
        }

        public void Configure(IApplicationBuilder app)
        {
            app.UseRouting();
            app.UseEndpoints(endpoints =>
            {
                endpoints.MapControllers();
            });
        }

        public void ConfigureContainer(ContainerBuilder builder)
        {
            builder
                .AddMassTransit(x =>
                {
                    x.ConfigureScope = MyConfigureMethod;

                    x.AddSagaStateMachine<MyStateMachine, MySaga>().InMemoryRepository();
                    x.AddConsumer<AbcConsumer>();

                    x.AddBus(c => Bus.Factory.CreateUsingAmazonSqs(bfc =>
                    {
                        bfc.SetLoggerFactory(c.Resolve<ILoggerFactory>());

                        bfc.Host("eu-central-1", hc =>
                        {
                            hc.AccessKey("...");
                            hc.SecretKey("...");
                        });

                        bfc.ReceiveEndpoint("...-rec1", rec =>
                        {
                            rec.WaitTimeSeconds = 1;
                            rec.ConfigureConsumer<AbcConsumer>(c);
                        });

                        bfc.ReceiveEndpoint("...-rec2", rec =>
                        {
                            rec.WaitTimeSeconds = 1;
                            rec.ConfigureSaga<MySaga>(c);
                        });
                    }));
                });
        }

        public static void MyConfigureMethod(ContainerBuilder builder, ConsumeContext context)
        {
            var x = nameof(builder);
        }
    }

    public class Abc
    {
        public string Payload { get; set; }
    }

    public class MySaga : SagaStateMachineInstance
    {
        public string CurrentState { get; set; }
        public Guid CorrelationId { get; set; }
    }

    public class MyStateMachine : MassTransitStateMachine<MySaga>
    {
        public Event<IMyEvent> Create { get; set; }

        public MyStateMachine()
        {
            InstanceState(x => x.CurrentState);
            Event(() => Create, cfg => cfg.CorrelateById(x => x.Message.ReferenceId));

            Initially(
                When(Create)
                    .ThenAsync(x =>
                    {
                        return Console.Out.WriteLineAsync("Received Create: " + x.Data);
                    }));
        }
    }

    public interface IMyEvent
    {
        Guid ReferenceId { get; }
    }

    public class AbcConsumer : IConsumer<Abc>
    {
        public Task Consume(ConsumeContext<Abc> context)
        {
            return Console.Out.WriteLineAsync("Received Abc: " + context.Message.Payload);
        }
    }
}

Expected Behavior
MyConfigureMethod should be called whenever there's message to be handled by saga or consumer.
Actual Behavior
When I send message to  ReceiveEndpoint#2 (standard customer) MyConfigureMethod is actually called. When I send message to ReceiveEndpoint#1 (state machine / saga) it is NOT.

interesting, I'll check

@Crozin could you provide how you configure endpoints please :)

@NooNameR I've updated OP. I'll try setup a complete example in like a half an hour.

basically, @phatboyg you broke it with this commit for all containers:
https://github.com/MassTransit/MassTransit/commit/9eedeb8952fab938ed61a35aa12f8f922934a948#diff-5993eb55507cf9415c872682c8bde409R29

converted to test:
 [TestFixture]
    public class Autofac_SagaScope : InMemoryTestFixture
    {
        readonly IContainer _container;
        bool _isCalled;

        public Autofac_SagaScope()
        {
            var builder = new ContainerBuilder();
            builder.AddMassTransit(x =>
            {
                x.AddSagaStateMachine<TestStateMachineSaga, TestInstance>()
                    .InMemoryRepository();

                x.ConfigureScope = (containerBuilder, context) => _isCalled = true;

                x.AddBus(provider => BusControl);
            });
            builder.RegisterType<PublishTestStartedActivity>();

            _container = builder.Build();
        }

        protected override void ConfigureInMemoryReceiveEndpoint(IInMemoryReceiveEndpointConfigurator configurator)
        {
            configurator.ConfigureSaga<TestInstance>(_container);
        }

        [OneTimeTearDown]
        public void Close_container()
        {
            _container.Dispose();
        }

        [Test]
        public async Task Should_configure_scope()
        {
            Task<ConsumeContext<TestStarted>> started = ConnectPublishHandler<TestStarted>();

            await InputQueueSendEndpoint.Send(new StartTest
            {
                CorrelationId = NewId.NextGuid(),
                TestKey = "Unique"
            });

            await started;

            Assert.IsTrue(_isCalled);
        }
    }

I don't even know what cfg.ConfigureScope = is supposed to do, or where it came from.

I can remove those lines, but I wasn't sure without asking you

Remove which lines?
So it appears that it works for consumers, etc. but not for sagas since they were rewritten. it also it's used for the new Send/Publish scope providers (it should). I don't know how to fix it yet, and haven't looked yet.

I don't even know what cfg.ConfigureScope = is supposed to do, or where it came from.

It's some abstraction over https://autofaccn.readthedocs.io/en/latest/lifetime/working-with-scopes.html#adding-registrations-to-a-lifetime-scope

Yeah, it's just a method that MassTransit provides to configure the container scope when it is created. The fact it is ignored by the new saga repository is just an oversight. I think that's another v7 update, remove all the old "shim" repositories that just pass through to the single SagaRepository.

I see the only difference new scope is started here:
https://github.com/MassTransit/MassTransit/blob/c95ef2be28105e332822a15ec8a5275b4416516c/src/Containers/MassTransit.AutofacIntegration/ScopeProviders/AutofacSagaRepositoryContextFactory.cs#L82
instead of using: ISendScopeProvider


lbreakouthd: 1.1.7 -> 1.1.8

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for lbreakouthd is: A widescreen Breakout clone
meta.homepage for lbreakouthd is: https://lgames.sourceforge.io/LBreakoutHD/
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.1.8 with grep in /nix/store/qdmq4y3n40gkxdl3wd3alz3cyfzc74rn-lbreakouthd-1.1.8
found 1.1.8 in filename of file in /nix/store/qdmq4y3n40gkxdl3wd3alz3cyfzc74rn-lbreakouthd-1.1.8

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

lbreakouthd

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/qdmq4y3n40gkxdl3wd3alz3cyfzc74rn-lbreakouthd-1.1.8 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A lbreakouthd https://github.com/r-ryantm/nixpkgs/archive/7f78418eff088630321f4ff558713c9c7712b12f.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/7f78418eff088630321f4ff558713c9c7712b12f#lbreakouthd

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/qdmq4y3n40gkxdl3wd3alz3cyfzc74rn-lbreakouthd-1.1.8
ls -la /nix/store/qdmq4y3n40gkxdl3wd3alz3cyfzc74rn-lbreakouthd-1.1.8/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review --extra-nixpkgs-config '{ allowInsecurePredicate = x: true; }' run on x86_64-linux 1

1 package built:

lbreakouthd

Maintainer pings
cc @AndersonTorres for testing.

@NixOS/nixpkgs-merge-bot merge


Miscellaneous fixes

This PR contains two things:

Fixes the RV32 linker address
Updates the linked_list_allocator version to the latest release

I addresses your comment and added an extra commit

Just added another commit. Now the RISC-V apps are working correctly.

Updated again with a fix to the argument passing.


Update travis-ci.md

add missing full stop :)

hi! wrong branch! please read https://github.com/dogecoin/dogecoin#development-and-contributions--omg-developers


fix: improve HA MQTT discovery for scene

don't expose writable values as read-only scenes
give HA a hint when values are numbers and not strings

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.006%) to 22.091%

Totals

Change from base Build<PHONE_NUMBER>:
-0.006%

Covered Lines:
3737

Relevant Lines:
17994

💛  - Coveralls

LGTM


"Error 1059: Identifier name '10k_dm_jobs_1577b500-bdba-4fcd-b9c3-7a169426d865_lightning_checkpoint_list' is too long"

Is your feature request related to a problem?
add a precheck about user inputs a long task name so DM internal table can't be created
Describe the feature you'd like
see above
Describe alternatives you've considered
No response
Teachability, Documentation, Adoption, Migration Strategy
No response

Looks like this issue is fixed. Close it.


Add automerge to renovateBot PR's.

This still requires one of us to review before it merges, right?

Yes
On Fri, Feb 21, 2020 at 10:18 AM Kurtis Van Gent<EMAIL_ADDRESS>wrote:

This still requires one of us to review before it merges, right?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/GoogleCloudPlatform/getting-started-java/pull/572?email_source=notifications&email_token=AAIVLDS75X5BV2XVEGCD6BTREALHRA5CNFSM4KZH6DTKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEMTTJYI#issuecomment-589772001,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAIVLDSAWMMCMXK5S35SBBLREALHRANCNFSM4KZH6DTA
.

--

•  *Les Vogel
•  *Cloud Developer Relations
•<EMAIL_ADDRESS>•  *+1-4 <%2B1-650-338-7103>08-676-7023


Rewrite .get_snmp_information()

For napalm-automation/napalm-eos#113
<!-- Make sure you have read http://napalm.readthedocs.io/en/latest/contributing/index.html --!>

I'll fix the tests tomorrow morning, gotta run for now.

I created an example in #115 which would solve this. It's really just a very small change in the TextFSM template. Also in general for these kind of changes I think it would generally be safer to keep the old test and reference data as is and just create a new test so it's easy to see that nothing old breaks.

Yes, I agree with @ogenstad - and I find I do prefer his proposal instead.
I will listen also what @dbarrosop thinks about that before taking any action.

Also in general for these kind of changes I think it would generally be safer to keep the old test

It depends. There are a few cases to consider:

Internal commands/behavior changes. As the commands changes the test fail if the mocked data is not updated accordingly. So we have two cases:
1.a. Default test case, if it's too complex and it's not testing any particular scenario, it's fine to completely rewrite the normal case.
1.b. Extra cases for weird scenarios. These have to be addressed properly updating the mocked data to avoid reintroducing old bugs.
Internal commands/behavior doesn't change. Unless a problem is detected on the data, it is forbidden to touch those. A new one can be added and I really encourage people to add test cases triggering the bug they are fixing but old tests shouldn't be modified.

@dbarrosop, it always depends. :)

Coverage increased (+0.3%) to 79.923% when pulling 9a7eee8bccdfffe8f87e259ebce1ec71f672d8f7 on bewing:iss113 into 3aee29e5a63f7bfebbb2c9797c96ee9fea7ef6fe on napalm-automation:develop.

Coverage increased (+0.3%) to 79.923% when pulling 9a7eee8bccdfffe8f87e259ebce1ec71f672d8f7 on bewing:iss113 into 3aee29e5a63f7bfebbb2c9797c96ee9fea7ef6fe on napalm-automation:develop.

Coverage increased (+0.3%) to 79.923% when pulling 9a7eee8bccdfffe8f87e259ebce1ec71f672d8f7 on bewing:iss113 into 3aee29e5a63f7bfebbb2c9797c96ee9fea7ef6fe on napalm-automation:develop.


instrument probes with some prometheus metrics

In running probes in our Weave Cloud clusters, we have had a few incidents of entire probes or data going missing from the app. The probe logs usually indicate a problem, but we - and other scope users - would really benefit from some metrics here.

count of report sending attempts, labelled by destination
count of failed report sending attempts, labelled by destination
count of conntrack errors (e.g. because buffer is too small)

Also, metrics for each of the functions that are timed, such as procspy would be good.

+1


Certificate manager: allow to secure exports with a password

Via a forum post:

Is there a way to export the full certificate and also include a password? I'm actually wanting to use the module to generate certificates for another device and for some inexplicable reason it won't let me enter a blank password when importing - I'm thinking that they assume no-one stores full certificates without a password.

Really could have done with this last night, right pain to import a renewed certificate from opnSense onto my server/access-point.

timeout due to inactivity

Please re-open, I would still like this added as a feature

@Taomyn are you planning to work on it? We can't keep issues open if nobody has the intention of working on it. We can always reopen if there's someone committed to do the work for it.

No as I'm not a developer, but it's not an issue but a feature request.

I know it's a feature request, we keep them open for several months (as stated https://github.com/opnsense/core/blob/master/CONTRIBUTING.md).
If there is someone interested  in working on it we assign an owner and the issue remains open.
Maintaining issues/feature requests takes time during every release cycle, which we try to keep manageable.


AttributeError: 'IndexedSlices' object has no attribute '_copy'

Hello,
This is puzzling, as this only happens with tensorflow-gpu version 1.12.0 -- tensorflow version 1.12.0 works flawlessly (both on GNU/Linux and OSX).
Traceback (most recent call last):
  File "./bin/moe-cli.py", line 476, in <module>
    main(sys.argv[1:])
  File "./bin/moe-cli.py", line 372, in main
    gradients = tape.gradient(loss, trainable_variables)
  File "/home/testing/.pyenv/versions/3.6.5/lib/python3.6/site-packages/tensorflow/python/eager/backprop.py", line 901, in gradient
    output_gradients=output_gradients)
  File "/home/testing/.pyenv/versions/3.6.5/lib/python3.6/site-packages/tensorflow/python/eager/imperative_grad.py", line 64, in imperative_grad
    output_gradients)
  File "/home/testing/.pyenv/versions/3.6.5/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 858, in grad_fun
    return [dresult._copy(device_name=self_device)]
AttributeError: 'IndexedSlices' object has no attribute '_copy'

Since the problematic line seems to be https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/framework/ops.py#L852, I have fixed the TF source code as follows:
  def _copy(self, ctx=None, device_name=None):
    """Copies tensor to dest device."""
    new_tensor = self._copy_nograd(ctx, device_name)
    # Record the copy on tape and define backprop copy as well.
    if context.executing_eagerly():
      self_device = self.device
      def grad_fun(dresult):
        # return [dresult._copy(device_name=self_device)]
        return [dresult]
      tape.record_operation("_copy", [new_tensor], [self], grad_fun)
    return new_tensor

Closing this issue since its resolved. Thanks!

@ymodak it is not really resolved - I just hacked that "fix" into my tensorflow installation, but the problem persists

Can you please fill the information asked by the template and we can reopen your issue? Thanks!
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
TensorFlow installed from (source or binary):
TensorFlow version (use command below):
Python version:
Bazel version (if compiling from source):
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version:
GPU model and memory:

You can collect some of this information using our environment capture script
You can also obtain the TensorFlow version with
python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)"
Describe the current behavior
Describe the expected behavior
Code to reproduce the issue
Provide a reproducible test case that is the bare minimum necessary to generate the problem.
Other info / logs
Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.

Having the same issue:

CUDA 10.0
Ubuntu 16.04
GPU Nvidia TITAN
Tensorflow version: 2.0.0-dev20190225

The fix mentioned above seems to work.

I got the same issue when I enabled the eager execution and called tf.gather() on a custom variable. I found it was okay when I used the keras Embedding layer that basically calls the same gather() function on a low level. I did the debug in TensorFlow code and then found the reason. There is a piece of code in the keras embeddings.py:
  def build(self, input_shape):     # Note: most sparse optimizers do not have GPU kernels defined. When     # building graphs, the placement algorithm is able to place variables on CPU     # since it knows all kernels using the variable only exist on CPU.     # When eager execution is enabled, the placement decision has to be made     # right now. Checking for the presence of GPUs to avoid complicating the     # TPU codepaths which can handle sparse optimizers.     if context.executing_eagerly() and context.context().num_gpus():       with ops.device('cpu:0'):         self.embeddings = self.add_weight(             shape=(self.input_dim, self.output_dim),             initializer=self.embeddings_initializer,             name='embeddings',             regularizer=self.embeddings_regularizer,             constraint=self.embeddings_constraint)     else:       self.embeddings = self.add_weight(           shape=(self.input_dim, self.output_dim),           initializer=self.embeddings_initializer,           name='embeddings',           regularizer=self.embeddings_regularizer,           constraint=self.embeddings_constraint)     self.built = True
And my custom variable was defined on GPU by default.
To fix it, try to define your variable on CPU if you are going to call tf.gather() or other sparse ops on it.

To fix it, try to define your variable on CPU if you are going to call tf.gather() or other sparse ops on it.

it's not really a fix tho, just an inefficient workaround

@netpaladinx @meyerjo you may be interested in this pull request of mine: https://github.com/tensorflow/tensorflow/pull/27986


Magit not works

What did you expect to happen?
Magit status buffer shold open after press leader gg, but error occues.
What actually happened?
When I try to toggle magit status buffer, error occurs:
cl-generic-ensure-function: magit-menu-common-value is already defined as something else than a generic function

Here is the backtrace:
Backtrace:
  explain-pause-report-measuring-bug("not top level in wrap-native for #<subr recursive-..." "current" #s(explain-pause-command-record :command root-emacs :native nil :parent nil :executing-time 7260 :entry-snap (25174 4062 816401 0) :too-slow nil :is-profiled nil :under-profile nil :profile nil :depth 0))
  explain-pause--wrap-native(#<subr recursive-edit>)
  apply(explain-pause--wrap-native #<subr recursive-edit> nil)
  recursive-edit()
  debug(error (error "magit-menu-common-value is already defined as some..."))
  signal(error ("magit-menu-common-value is already defined as some..."))
  error("%s is already defined as something else than a gen..." magit-menu-common-value)
  cl-generic-ensure-function(magit-menu-common-value)
  cl-generic-define-method(magit-menu-common-value nil ((_section magit-diff-section)) nil #f(compiled-function (section) #<bytecode 0x337b455>))
<EMAIL_ADDRESS>[cl-generic-define-method magit-buffer-value nil (&context (major-mode magit-diff-mode)) #f(compiled-function () #<bytecode 0x337a04d>) magit-menu-common-value ((_section magit-diff-section)) #f(compiled-function (section) #<bytecode 0x337b455>) defvaralias magit-diff-section-base-map magit-diff-section-map (saved-value saved-variable-comment) put make-obsolete-variable "Magit-Section 3.4.0"] 7)
  require(magit-diff)
  eval-buffer(#<buffer  *load*-330852> nil "c:/Users/zhiru/.emacs.d/.local/straight/build-27.2..." nil t)  ; Reading at buffer position 2423
  load-with-code-conversion("c:/Users/zhiru/.emacs.d/.local/straight/build-27.2..." "c:/Users/zhiru/.emacs.d/.local/straight/build-27.2..." nil t)
  require(magit)
  eval-buffer(#<buffer  *load*> nil "c:/Users/zhiru/.emacs.d/.local/straight/build-27.2..." nil t)  ; Reading at buffer position 1107
  load-with-code-conversion("c:/Users/zhiru/.emacs.d/.local/straight/build-27.2..." "c:/Users/zhiru/.emacs.d/.local/straight/build-27.2..." nil t)
  autoload-do-load((autoload "magit-status" ("c:/Users/zhiru/.emacs.d/.local/autoloads.27.2.elc" . 642677) t nil) magit-status)
  command-execute(magit-status)

Describe your attempts to resolve the issue
No response
Steps to reproduce

Open Emacs
Go to any git project
Press leader gg to toggle magit status buffer

System Information
https://pastebin.com/6dtPamUw

I cannot reproduce this.

Can you reproduce this in vanilla Doom? (I.e. your config disabled)
Does doom build && doom sync fix it?

I cannot reproduce this.

Can you reproduce this in vanilla Doom? (I.e. your config disabled)
Does doom build && doom sync fix it?

Thanks for helping. The problem still existed after disable all my config. But it can be solved by doom build && doom sync.


chore(concurrency): add return values to WithLock/WithRLock

Description
Based on a discussion within the style guide regarding improving the usage of WithLock/RLock to allow multiple return values.
Checklist

[ ] Investigated and inspected CI test results
[ ] Unit test and regression tests added
[ ] Evaluated and added CHANGELOG entry if required
[ ] Determined and documented upgrade steps
[ ] Documented user facing changes (create PR based on openshift/openshift-docs and merge into rhacs-docs)

If any of these don't apply, please comment below.
Testing Performed
Here I tell how I validated my change

see CI.

Reminder for reviewers
In addition to reviewing code here, reviewers must also review testing and request further testing in case the
performed one does not seem sufficient. As a reviewer, you must not approve the change until you understand the
performed testing and you are satisfied with it.

Current dependencies on/for this PR:

master

PR #7993   👈

This comment was auto-generated by Graphite.

/retest


Cannot find module 'glob'

Hi Deepu,
When I run yo jhipster-entity-audit, I get an error:
Error: Cannot find module 'glob'
node -v
v4.2.3
I solved it by npm install -g glob, maybe a dep is missing in package.json

Thats strange, glob is defined in the package.json anyway ill take a look

Ok glob should be in the dependencies and not dev dependencies, have updated it

closed via https://github.com/deepu105/generator-jhipster-entity-audit/commit/bb90bfa2b69fe8b05f6241c3f5c0519484777657


Add three options to disable: examples, tests and install

Introducing three options (by default set to: ON aka 'true'), allowing users to disable; examples, tests and install.
Fixes: https://github.com/avocadoboi/cpp20-http-client/issues/8

@avocadoboi Feel free to merge it.

Despite only building a specific target, this PR allows more fine-grated CMake configure step to specifically enable or disable parts during the CMake configure step. Which still adds value for you and external users.

Is it useful because it takes extra time and disk space to create the build system files for the tests and examples when running the cmake configuration step? I could see that, although the project is very small so the effect is probably not very big.

It also can help you doing specific builds now via ci/cd.


Allow providing kubeconfig from String

Hi, as above, it would be nice to use some abstraction for Kubeconfig, not depending only on filesystem Path
Helm.withKubeConfig(String)

Hi @jakublabno,
Thanks for your feedback.
Could you please elaborate on your request.
If you're suggesting to allow for the path to be provided as a String instead of a Path or File, then you'd really need to make a good case for that. Personally, I see it as polluting the API and I can't really see or understand a good motive for that (but maybe I'm missing something).
Semantically, for me, withKubeConfig(String) means that you provide the .kube/config content as a String.
If this is what you're suggesting, I don't see any reason why we shouldn't provide that. However, it'd be nice to better understand your use case and how you're actually computing or obtaining that .kube/config content.

If you don't want to enhance your API, which is strange since it's common practice, even in official kubernetes java client. you have multiple options to provide config. It's better to provide withKubeConfig(String), it's always easier to convert kubeconfig to string, rather than saving it to the file and provide as File.
Personally, I don't want to store kubeconfig in my project, I store it as base64 in secret and what I have to do now is to crate temporary file which I can later use in withKubeConfig(String)

Probably I didn't explain myself correctly.
I'm happy to add withKubeConfig(String) if this method delivers the functionality to provide the .kube/config content as a String. After your minor elaboration, this is what I now understand you're requesting (as opposed to withKubeConfig("/home/user/.kube/config") which is what I won't add unless someone really makes a case for this).
However, you still haven't elaborated on your use case. It's my understanding that you would be running this in a build automation tool and passing the the .kube/config retrieving it from a secret. If this is the case, note that helm-java is actually leveraging helm libs under the covers, and it's likely that you can pass a lot of information using variables such as: HELM_KUBEAPISERVER, HELM_KUBECAFILE, HELM_KUBETOKEN, and so on).

official kubernetes java client.

I wouldn't use the Official Kubernetes Java Client as an example of API-friendly when you get horrible things such as:
V1PodList list = api.listPodForAllNamespaces(null, null, null, null, null, null, null, null, null);

Especially when you can use the Fabric8 Kubernetes Client that provides completely fluent interfaces :wink:
PodList podList = client.pods().inAnyNamespace().list();

Probably I didn't explain myself correctly.
I'm happy to add withKubeConfig(String) if this method delivers the functionality to provide the .kube/config content as a String.

May I ask when this idea will be implemented

For me, it also would be very helpful to be able to configure helm operations with kube config file contents like it is also possible for the Fabric8 Kubernetes Client: https://github.com/fabric8io/kubernetes-client/blob/faedc39b0dc49deee5bb962068eecf61128cf74b/kubernetes-client-api/src/main/java/io/fabric8/kubernetes/client/Config.java#L782
Our use case is to build an application which can manage installations in multiple kubernetes clusters from a single cluster using Fabric8 Kubernetes Client and helm.

I've just published v0.0.15 which includes the feature requested in this issue:

https://repo1.maven.org/maven2/com/marcnuri/helm-java/helm-java/0.0.15/
https://github.com/manusa/helm-java/releases/tag/0.0.15

Please, share any feedback you may have, it is much appreciated :pray:


test(ingest/nifi): Configure nifi tests for arm64

Bumps the nifi version which  changes the custom property set (now expanded).
Also checks a url every 10 seconds for when nifi is done executing, rather than sleeping for 120 seconds always
Checklist

[ ] The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
[ ] Links to related issues (if applicable)
[ ] Tests for the changes have been added/updated (if applicable)
[ ] Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
[ ] For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

I broke the commits down between (i) expanding MCPs and (ii) changes made by the updates. Everything remains the same except some properties change, and urn:li:dataJob:(urn:li:dataFlow:(nifi,80820b2f-017d-1000-85cf-05f56cde9185,PROD),c8c73d4c-ebdd-1bee-9b46-629672cd11a0) loses an inputDatajob (order also seems to change). That seems somewhat concerning to me and this difference persists even with the flat 120 second wait. @mayurinehate does this seem concerning to you?


install goctl failed

install goctl error .
The same problem occurs with go install and download compile source code .
root@0666af6ac1b4:~# GO111MODULE=on GOPROXY=https://goproxy.cn/,direct go install<EMAIL_ADDRESS>go: downloading github.com/tal-tech/go-zero v1.2.0 go: downloading go.opentelemetry.io/otel/trace v1.0.0-RC2 go: downloading go.opentelemetry.io/otel v1.0.0-RC2 go build github.com/zeromicro/ddl-parser/gen: /usr/local/go/pkg/tool/linux_amd64/compile: signal: killed

system os :centos 7


Ensure macOS compatibility

Hi @JonathanBechtel I wanted to use this package but couldn't get it to install due to this #3 . This fix worked for me on local, please check if it's good from your point of view.

Merged, thank you.


feat: track fcu validity

blocked by #2802
closes #2916
we did not track if the received FCU was invalid,valid or syncing.
This keeps track of the status of the received FCU.
It will track the latest FCU to which we responded with SYNCING, this is the sync target to which we need to sync. before this change we triggered pipeline with the last received FCU which could be invalid.

Codecov Report

Merging #2929 (2ca8616) into main (cb44ce0) will decrease coverage by 30.96%.
The diff coverage is 49.48%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@             Coverage Diff             @@
##             main    #2929       +/-   ##
===========================================
- Coverage   71.15%   40.20%   -30.96%
===========================================
  Files         515      516        +1
  Lines       66723    66845      +122
===========================================
- Hits        47480    26877    -20603
- Misses      19243    39968    +20725

Flag
Coverage Δ

integration-tests
15.34% <0.00%> (-2.07%)
:arrow_down:

unit-tests
34.06% <49.48%> (-31.98%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

crates/interfaces/src/blockchain_tree/error.rs
0.00% <ø> (-32.30%)
:arrow_down:

crates/interfaces/src/blockchain_tree/mod.rs
12.50% <ø> (-37.50%)
:arrow_down:

crates/interfaces/src/executor.rs
75.00% <ø> (-25.00%)
:arrow_down:

crates/primitives/src/transaction/signature.rs
64.93% <ø> (-29.23%)
:arrow_down:

crates/primitives/src/transaction/util.rs
100.00% <ø> (ø)

crates/stages/src/error.rs
66.66% <ø> (-16.67%)
:arrow_down:

crates/stages/src/pipeline/ctrl.rs
23.07% <ø> (-30.77%)
:arrow_down:

crates/storage/provider/src/providers/database.rs
30.50% <0.00%> (-8.29%)
:arrow_down:

crates/blockchain-tree/src/blockchain_tree.rs
13.82% <5.55%> (-68.97%)
:arrow_down:

crates/stages/src/stages/sender_recovery.rs
60.33% <23.52%> (-32.73%)
:arrow_down:

... and 9 more

... and 259 files with indirect coverage changes

closing and reopening after #2802 because it's a mess


starlark-rust allows string.startswith to take a list as value of its prefix parameter, contrary to language spec

starlark-rust allows the following: 'a'.startswith(['a'])
By contrast, java and go starlark implementations allow only a string or a tuple of strings as the prefix parameter, in accordance with the spec: https://github.com/bazelbuild/starlark/blob/master/spec.md#string·startswith
(Arguably, starlark-rust's behavior is better here - so maybe we ought to change the spec...)

... and same for 'a'.endswith(['a'])

I think the correct Starlark thing would be either to accept all iterables, or just tuples. Given that the Rust one accepts lists and tuples that seems wrong. I'll switch to just tuples.

Fixed in 5b888f6ad062cb70c7744bb6427e4039e1a310a7


Update subscription api use

@imsickofmaps Please review.

Apart from the auth change, get Travis to retest then :+1:


Navigation by browser back and forward button is failing

If I navigate between pages - let's say from page-1 to page-3 then to page-4 and finally to page-2 - I can navigate all the way back by using the browser back-button as expected.
The main navigation is done with a menu and the stacked navigation-service issuing the command "navigateWithTransition". As expected the routing information is pushed onto the navigation stack and the back-button of the browser pops the route back to its beginning.
The problem is, that if the back-button is then pushed once more even if the backwards navigation has reached its beginning (unfortunately the back-button is then still active), the navigation with the browser buttons is no longer possible neither forwards nor backwards.

@ferrarafer the issue we identified will fix this issue as well.

A fix has been pushed for this when using the new RouterService which is meant for web. It's available in Stacked stacked: ^3.2.6
I'll keep this issue open until I post the docs on how to use the RouterService here.

@FilledStacks How do I prevent the page being POPed when hitting back browser button.
Here is my code (2nd page) - I have set the PopScope not to allow pop. However, pressing back button still goes to previous.
  @override
  Widget builder(
    BuildContext context,
    HomeViewModel viewModel,
    Widget? child,
  ) {
    return PopScope(
      canPop: false,
      child: Scaffold(

I don't think that's allowed in Flutter, you have to check in a normal Flutter project that it's allowed, then implement it there. Once you get it working in a normal Flutter project without Stacked then you can implement it the same way for Stacked.


FWXV-58: Reduce build system spam

Description
With ShiCheng's suggestion, added COMSTR env variables to control output when building projects.
Kind of outside of scope of this PR, but also moved lint.py and new_target.py to a new scons folder and updated their paths accordingly.
Comments
Running scons using scons -Q will help suppress some more scons messages - notably:
scons: Reading SConscript files ...
scons: done reading SConscript files.
scons: Building targets ...

This is much nicer! I still get some long prints from ar, ranlib, and objcopy - are there more COMSTR variables that could make those messages nicer?

This is much nicer! I still get some long prints from ar, ranlib, and objcopy - are there more COMSTR variables that could make those messages nicer?

Unfortunately, I couldn't find something for objcopy, but was able to use ARCOMSTR, RANLIBCOMSTR, and also ASCOMSTR for compiling assembly files.

I couldn't find anything in the Scons Builder documentation for controlling the build output... maybe objcopy will just have to stay the way it is. Fortunately the output is generally a lot better than before now.


[PDI-13961] - Spoon firstly tries to conect via JNDI although connection type is JDBC

introduce a new method for distinguishing the source where to look for data sources
remove some legacy code, that is not used anymore
add tests

@mattyb149, @brosander, @mattcasters, @deinspanjer, @pentaho-nbaker, @rmansoor,
Please review it and mention your opinions. This is a risky change, as it touches the core class.
/cc @pamval

A simple code review didn't raise any red flags for me.  I'll need to do some actual testing on Monday.

This change will cause classes downstream to break such as org.pentaho.platform.plugin.action.kettle.PlatformKettleDataSourceProvider who implement the interface.

The PR is supposed to be paired with pentaho/pentaho-platform#2453 . I notified @rmansoor and @pentaho-nbaker based on an e-mail Friday about this, but it looks like I should have just +1'ed it and waited for the other half to be merged. :/  I've backed it out for now in
https://github.com/pentaho/pentaho-kettle/issues/1660


Gemini Support

We need to add support for Google's Gemini
We can follow the format of other integrations, I assume only a few pieces of it will need to change

Hi! I am working on this right now in a fork. Will share soon! 😁

Got it. Good luck :)

#9 is working on this.

This is done. I will add some more later on.


Event switch-case ordering - inconsistent sort

In Marten's codegen, event switch-case ordering does not get sorted properly when there are multiple types with the same name but in different namespaces.
e.g.
namespace Foo {
	public record MyRecord(int foo);
}

namespace Bar {
	public record MyRecord(int bar);
}

In the above, EventTypePatternMatchFrame.TypeSorter will fail to sort MyRecord consistently - it uses type.Name which does not include the 2 different MyRecords respective namespaces. This means CodeGen is unable to generate reproducible code from run to run, making it problematic for validating generated code in CI pipeline.
I'll raise a simple PR to change type.Name to type.FullName.

PR: https://github.com/JasperFx/marten/pull/2997


[ZEPPELIN-4528]bump up the bigquery dependencies version

What is this PR for?
Improvements to have latest bigquery google api libs
What type of PR is it?
Improvement
Todos
N/A
What is the Jira issue?
[ZEPPELIN-4528] https://issues.apache.org/jira/browse/ZEPPELIN-4528
How should this be tested?

First time? Setup Travis CI as described on https://zeppelin.apache.org/contribution/contributions.html#continuous-integration
Strongly recommended: add automated unit tests for any new or changed behavior
Outline any manual steps to test the PR here.

Screenshots (if appropriate)
N/A
Questions:

Does the licenses files need update? No
Is there breaking changes for older versions? No
Does this needs documentation? No

Thanks @fred521 Could you paste the travis CI link ?

Thanks @fred521 Could you paste the travis CI link ?

copied the https://travis-ci.org/fred521/zeppelin/builds/631753220
but not sure why the build job failed, do you have any ideas? thanks

I think this issue has been fixed, could you rebase your PR and retrigger the travis ?

I think this issue has been fixed, could you rebase your PR and retrigger the travis ?

looks like all passed https://travis-ci.org/fred521/zeppelin/builds/631753220
one job randomly failed, but re-run fixed the error

Thanks @fred521 will merge if no more comment


Attempting to connect to wrong port (PG post), hangs

crash --host "localhost:5433" --verbose

Runs for long time, without returning any error.

Hi Marios,
thank you for reporting this. I can confirm it by using, for example:
nc -l -p 5433
crash --host "localhost:5433" --verbose

Because crash uses timeout=None, the default timeout value for "connect" and "read" will be used, which is "infinite". The requests library behaves equally. There is some discussion around the topic at https://github.com/urllib3/urllib3/issues/655.
In different spots, I observed others to use default timeout values like those:
from urllib3.util.timeout import Timeout
Timeout(connect=2, read=7)
Timeout(connect=3.05, read=27)
Timeout(connect=5.0, read=?)
Timeout(connect=10.0, read=?)

Do you think it is a good idea to also set reasonable non-infinite default timeout values for crash? If so, what do you think which values we should use?
With kind regards,
Andreas.

I think yes we should. It seems to me that a user would expect to see and error message if connection cannot be established.
I would say that 5 or even 10 seconds is a reasonable value, and probably it would be nice to be able to configure it on demand.

+1 for connect timeout. E.g. 5sec by default
-1 for read timeout.

Could we also have some "keep-alive" test that can happen in the background, so even if there is a long running query, we can still get an error that the server(s) is/are disconnected?

Otherwise, do you think we should also configure the read timeout to a maximum value by default? If yes, what do think would be an optimal default value? 24 hours?
I think there should be none. 24h might be even worse

Could we also have some "keep-alive" test that can happen in the background, so even if there is a long running query, we can still get an error that the server(s) is/are disconnected?

This would address the issue that a client issues a long-run query and the hosts it's connected go down, but the client still "thinks" the query is still running. WDYT?

Dear Marios,
sure we can think about such an "availability background check" feature. However, let's track it on behalf of a different issue instead? I think the scope of this one would be to only adjust the connect timeout accordingly. I also think five seconds as a default value, with an option to adjust it, would be fine.
With kind regards,
Andreas.

@amotl Of course, I just wanted to ask here and get opinions, since it's somehow relevant, so we can open a separate issue.

@amotl Created a new issue for that proposal: https://github.com/crate/crash/issues/371

Hi again. GH-421 brings the --timeout command-line argument, for the purpose outlined here. As suggested, it also configures the default connect timeout to five seconds, while still using an infinite read timeout.
On this particular case, at least when emulating a server through nc -l -p 5433, this does not help much, because the client actually connects, but would need to limit the read timeout to not block forever.
You can exercise it like this:
# Blocks, because read timeout is still infinite.
crash --host "localhost:5433" --timeout=0.42

# Does not block, because read timeout is decreased.
crash --host "localhost:5433" --timeout=0.42,0.42

How are other clients like e.g. psql behave?
One idea could be to do a fast probing query with a short read timeout at the connection instantiation, but not sure if this is really good (what if the cluster is overloaded? other issues?)

How do other clients like e.g. psql behave?

It looks like psql behaves in the same way. Running that on macOS, it does not return for the time of writing this.
nc -l -p 5433
time psql postgresql://postgres@localhost:5433/

One idea could be to do a fast probing query with a short read timeout at the connection instantiation (SELECT 1).

That will not work. What would "fast" actually mean? What if this "quick/fast probe check" with a lower timeout than the configured one would be below the value needed to actually make the connection work, because the server is far away, or, as you may be referring to, overloaded, or such?

Problem Report

crash --host "localhost:5433" --verbose

Runs for long time, without returning any error.

Evaluation
When connecting to a TCP endpoint "that does not talk the right protocol" [^1], and partners can't establish a good conversation, so the request sent by the client will not get answered by the server at all, the conversation on this TCP connection will naturally stall. Unfortunately, the network connection will not be terminated, because there are no measures in place that could make that happen, other than client- and server-side timeout settings.
By default, the behaviour is the same with psql, we've confirmed it on localhost both on Linux and macOS.
psql postgresql://postgres@localhost:5433/

To reproduce it with both psql and crash, a server that does not talk the right protocol can easily be emulated using netcat [^2].
Conclusion and Thoughts
Therefore, we are closing this ticket. Please re-open if you feel your issue has not been addressed properly. Thank you for GH-421, which probably would not have happened without your request.
[^1]: Long version: Where an application is bound to the corresponding TCP socket in LISTEN mode, which implements certain application-level protocols.
[^2]: nc -l -p 5433. It works well for both HTTP and the PostgreSQL wire protocol, because such a dummy server understands neither of both.


Polymer gum handler and dialog for testrtc

For now added a 'closed' event so it can easily be wired up in current non-polymerized testrtc.

Something is preventing this from being rendered properly on Internet explorer (testing the gum not supported error). Last time one of the imports had a capital "i" which caused, cannot see anything that obvious now. IE is not presenting any useful info as usual.....

As we noted offline, all buttons became green in Safari, since we only want one button green it makes sense to remove paper-button in main.css and add color and background-color explicitly to "#start-button".

Fixed the CSS and the IE template if inside template ifs.

Fixed now with another change (threw out the old history).

LGTM


[Investigation] C++ plugin system implementation plan

Nuke ships with a CMake helper function add_nuke_plugin in its cmake/NukeConfig.cmake file

Creates a MODULE library
Links it Nuke and other dependencies.
Ensures it has no lib prefix and, on MacOS, that it has a .dylib extension
Sets some Windows-specific compile definitions.

We might want to provide something similar.  Though I'd shy away from it if we can.

Katana expects dlls to expose a registerPlugins top-level function, within which multiple plugins can be registered from a single dll. Something to think about.  Katana doesn't seem to have a canonical CMake helper function.

USD
Using the OpenAssetIO Ar2 plugin as a reference: USD searches for plugins in a two step process. Firstly, JSON pluginInfo.json is located on search paths given by an environment variable. This JSON contains the location of the library binary to load.
When the plugin binary is loaded, it registers itself via a macro, i.e. AR_DEFINE_RESOLVER(UsdOpenAssetIOResolver, ArResolver).
Inside this macro some metadata about the plugin is computed and stored in a new TfType (e.g. typeinfo), which is added to a global Tf_TypeRegistry instance (via TfType::Declare).
Crucially the macro then calls a SetFactory<Ar_ResolverFactory<Resolver> >() function (where Resolver is the first argument of the macro).  Later on, the factory is retrieved from the global registry and the factory->New() method instantiates the plugin class.
In stepping through/browsing the code, a couple of other useful tidbits:
Something to consider, clearing the dlerror before calling dlopen.
    // Clear any unchecked error first.
    (void)dlerror();
    return dlopen(filename.c_str(), flag);

Platform specific path constants
#if defined(ARCH_OS_WINDOWS)
    #define ARCH_PATH_SEP       "\\"
    #define ARCH_PATH_LIST_SEP  ";"
    #define ARCH_REL_PATH_IDENT ".\\"
#else
    #define ARCH_PATH_SEP       "/"
    #define ARCH_PATH_LIST_SEP  ":"
    #define ARCH_REL_PATH_IDENT "./"
#endif

ASWF
Browsing around the ASWF GitHub org
OpenRV
OpenRV has a full-on package manager, which accepts zip files with dependencies between packages. Ultimately, of course, it comes down to dlopen et al.
Plugin binaries must expose a MuInitialize function which returns a Module-derived object.

Based on the above perusal of prior art, the basics are pretty standard. There are a couple of questions we need to consider, however.
Does the host call a registration function, or does the plugin register itself?
Our Python plugin system expects plugins to expose a PythonPluginSystemManagerPlugin-derived class as a top-level plugin attribute on a Python module. This class overrides a (static) interface() method, which returns a new instance of a ManagerInterface. It also has a (static) identifier() method to get the manager identifier.
So the closest analogue to this in C++ is the host calling a plugin() function in the plugin binary, which returns a CppPluginSystemManagerPlugin-derived instance with (virtual) interface()andidentifier()` methods.
This approach mirrors most of the prior art collected above (with notable exceptions being Nuke and USD).
Should we provide a CMake convenience
What value would an add_openassetio_plugin CMake function provide? Simply linking to OpenAssetIO::openassetio-core gets you most of what you want.
But then there's OpenAssetIO::openassetio-python-bridge, if Python interop is required, and OpenAssetIO-MediaCreation::openassetio-mediacreation for common traits.
The latter is hard to do in a generic way, but perhaps its ubiquitous enough that we can provide a dedicated argument to include it? - though, being as it's an entirely separate package, the user would have to do work to ensure it's discoverable anyway.
Having such a function means we can change the CMake boilerplate required for creating an OpenAssetIO plugin without plugin authors having to do manual steps (beyond a CMake reconfigure). But its extra maintenance overhead for us, with little initial benefit.
I'm tempted to say lets skip it, at least on a first pass.

Considerations during implementation
Error handling

Use Windows API functions to format errors from LoadLibrary (see examples in prior art above).
Ensure dlerror() is called before dlopen, to clear any previous error.
Check ABI/API version compatibility of the plugin. Perhaps this can be left to the plugin author, since OpenAssetIO itself exposes version introspection functions.

Create an anti-corruption layer around the platform-specific dll/dso loading functions.

Ensure wstring vs. string issues considered for Windows API.
Ensure Unicode paths enabled for Windows API.
Use platform-specific path separator in OPENASSETIO_PLUGIN_PATH environment variable.

Plugin loader re-entrancy and lifetime

Thread-safety
Refcounting
Unloading
All hard to do without either global variables or a long-lived ManagerImplementationFactoryInterface instance. Tempted to say this is the host's problem to deal with.

Compatibility with an eventual hybrid Python/C++ plugin system. The way we've theorised this could work in the past is

Assuming a CppPluginSystemManagerImplementationFactory that roughly mirrors the PythonPluginSystemManagerImplementationFactory, the two construct distinct ManagerInterface instances.
A HybridPluginSystemManagerImplementationFactory can compose the two, construct both ManagerInterface instances (assuming both find a suitable plugin for a given ID), and return a ManagerInterface instance that delegates to one or the other based on hasCapability() checks.

As long as this roughly describes the approach we're likely to take, then we're all good.

Capturing offline discussion:
The above assumptions of the implementation are all good, except for the question of "Should plugin binary names follow a standard?".
We settled on mostly mirroring the Python plugin system, i.e.

The plugin binary file name should be unrestricted.
The environment variable should give directories (rather than target individual files), which is consistent with Python.
Thus we must load every binary in a search path and look for the hook function that returns CppPluginSystemManagerPlugin instance, again consistent with Python.

The one deviation from the Python plugin system is that the hook function in the plugin binary should be namespaced, i.e. openassetioPlugin. An issue should be created to deprecate the existing plugin hook in Python, and add openassetioPlugin, for consistency.


rspec ./spec/models/mediaflux/http/asset_exist_request_spec.rb:15 is failing oftent in CI

What maintenance needs to be done?
We should take time to figure out why it is so flaky
It looks like there is more than one flaky test, we just noted that collection_asset_root_request also is failing intermittently.
Level of urgency

[ ] High
[x] Moderate
[ ] Low

Why is this maintenance needed?
This is slowing down PRs
Acceptance criteria

[ ] The test passes during CI constantly

Hey team! Please add your planning poker estimate with Zenhub @carolyncole @JaymeeH @jrgriffiniii @kelynch @leefaisonr

All the following went green after a rerun from failed:
rspec ./spec/models/mediaflux/project_update_request_spec.rb:57
rspec ./spec/models/mediaflux/http/asset_exist_request_spec.rb:15
rspec ./spec/models/mediaflux/http/collection_asset_create_root_request_spec.rb:9

Documenting more flakiness:

https://app.circleci.com/insights/github/pulibrary/tiger-data-app/workflows/build_accept_deploy/tests?branch=main contains all flaky test runs as defined by CI in the flaky section

@carolyncole this is great information, I didn't know CircleCI kept track of flaky tests.
PR #843 (merged a couple of hours ago) should take care of Mediaflux::Http::CollectionAssetCreateRootRequest -- if that works we can probably try to apply a similar approach to the rest.

@hectorcorrea  The root namespace is cleared out before each test.  You can see in a couple of the flaky tests that the namespace not existing is the reason for the failure.  I'm guessing that there is some sort of error during the deletion creation https://github.com/pulibrary/tiger-data-app/blob/main/spec/support/connect_to_mediaflux.rb#L16-L24


Improve restriction site selection

Chris Robinson: The restriction site selection is a bit awkward, it would be simpler for the user to tick boxes next to each enzyme rather than hold control. It would be also useful to see a list of the excluded  sites afterwards to confirm their selection.

Implemented dual listbox solution.


Service doesn't start properly

Every time I boot up my machine the service starts but stops after a few seconds. After manually sudo systemctl start doh-client it, it works fine and has no issues.
OS: Arch
Output of journalctl -b -p 7 -u doh-client:
Aug 15 19:58:02 mango systemd[1]: Started DNS-over-HTTPS Client.
Aug 15 19:58:03 mango systemd[1]: Stopping DNS-over-HTTPS Client...
Aug 15 19:58:03 mango systemd[1]: doh-client.service: Deactivated successfully.
Aug 15 19:58:03 mango systemd[1]: Stopped DNS-over-HTTPS Client.
Aug 15 19:58:03 mango systemd[1]: Started DNS-over-HTTPS Client.

Aug 15 19:58:08 mango systemd[1]: doh-client.service: Deactivated successfully.
Aug 15 19:58:08 mango systemd[1]: Stopped DNS-over-HTTPS Client.
Aug 15 19:58:08 mango systemd[1]: Started DNS-over-HTTPS Client.
Aug 15 19:58:09 mango systemd[1]: Stopping DNS-over-HTTPS Client...
Aug 15 19:58:09 mango systemd[1]: doh-client.service: Deactivated successfully.
Aug 15 19:58:09 mango systemd[1]: Stopped DNS-over-HTTPS Client.
Aug 15 19:58:09 mango systemd[1]: Started DNS-over-HTTPS Client.
Aug 15 19:58:09 mango systemd[1]: Stopping DNS-over-HTTPS Client...
Aug 15 19:58:09 mango systemd[1]: doh-client.service: Deactivated successfully.
Aug 15 19:58:09 mango systemd[1]: Stopped DNS-over-HTTPS Client.
Aug 15 19:58:09 mango systemd[1]: Started DNS-over-HTTPS Client.
Aug 15 19:58:09 mango systemd[1]: Stopping DNS-over-HTTPS Client...
Aug 15 19:58:09 mango systemd[1]: doh-client.service: Deactivated successfully.
Aug 15 19:58:09 mango systemd[1]: Stopped DNS-over-HTTPS Client.
Aug 15 19:58:09 mango systemd[1]: doh-client.service: Start request repeated too quickly.
Aug 15 19:58:09 mango systemd[1]: doh-client.service: Failed with result 'start-limit-hit'.
Aug 15 19:58:09 mango systemd[1]: Failed to start DNS-over-HTTPS Client.

Note that the dial tcp errors sometimes occur during normal operation, but they don't cause the service to stop.

This is strange. Can you try running doh-client manually without systemd and see whether it runs?

Here's running it in command line and browsing example.com:
$ sudo /usr/bin/doh-client -conf /etc/dns-over-https/doh-client.conf -verbose
2023/08/22 21:34:40 random mode start
<IP_ADDRESS>:42150 - - [22/Aug/2023:21:34:45 +0200] "ping.archlinux.org. IN AAAA"
<IP_ADDRESS>:42150 - - [22/Aug/2023:21:34:45 +0200] "ping.archlinux.org. IN A"
2023/08/22 21:34:45 choose upstream: upstream type: IETF, upstream url: https://adguard_id.d.adguard-dns.com/dns-query
2023/08/22 21:34:45 choose upstream: upstream type: IETF, upstream url: https://adguard_id.d.adguard-dns.com/dns-query
<IP_ADDRESS>:34359 - - [22/Aug/2023:21:34:45 +0200] "ping.archlinux.org. IN A"
2023/08/22 21:34:45 choose upstream: upstream type: IETF, upstream url: https://adguard_id.d.adguard-dns.com/dns-query
<IP_ADDRESS>:34359 - - [22/Aug/2023:21:34:45 +0200] "ping.archlinux.org. IN AAAA"
2023/08/22 21:34:45 choose upstream: upstream type: IETF, upstream url: https://adguard_id.d.adguard-dns.com/dns-query
<IP_ADDRESS>:35798 - - [22/Aug/2023:21:34:46 +0200] "_dnslink.example.com. IN TXT"
2023/08/22 21:34:46 choose upstream: upstream type: IETF, upstream url: https://adguard_id.d.adguard-dns.com/dns-query
<IP_ADDRESS>:52656 - - [22/Aug/2023:21:34:46 +0200] "example.com. IN TXT"
2023/08/22 21:34:46 choose upstream: upstream type: IETF, upstream url: https://adguard_id.d.adguard-dns.com/dns-query
<IP_ADDRESS>:53264 - - [22/Aug/2023:21:34:46 +0200] "example.com. IN A"
2023/08/22 21:34:46 choose upstream: upstream type: IETF, upstream url: https://adguard_id.d.adguard-dns.com/dns-query
<IP_ADDRESS>:53264 - - [22/Aug/2023:21:34:46 +0200] "example.com. IN AAAA"
2023/08/22 21:34:46 choose upstream: upstream type: IETF, upstream url: https://adguard_id.d.adguard-dns.com/dns-query

As I said, there's nothing happening that shouldn't be.

I have it start successfully by changing the Type= from simple to idle and also After= to multi-user.target.
Seems like there are something wrong with the order.
(But I don't know much about systemd to know exactly what caused it)

I have it starts successfully by changing the Type= from simple to idle and also After= to multi-user.target.

I can confirm this does in fact work.

Due to a technical limitation of Golang’s standard library, doh-client and doh-server is unable to detect network change, for example, loss of Wi-Fi signal or switching between wireless and wired network.
Therefore, we rely on systemd to determine whether the network is online. The service will not start until the network is ready, and will be automatically restarted whenever there is a network change.
For most Linux distributions, systemd is configured to collaborate with either NetworkManager or whatever network management framework. However, there are cases that your system contains more than one such framework, or the configuration is incorrect.
In such situations, our service will be unable to start, or automatically restarts itself.
I’m glad your modification solves your issue. However, this fix doesn’t apply to every user. We expect systemd’s network detection to function properly, as it is necessary for those users on Wi-Fi or mobile network.

Do you think we should suggest this fix to the Arch maintainer?
Or should it better to just leave as a note in Arch Wiki?

Do you think we should suggest this fix to the Arch maintainer?
Or should it better to just leave as a note in Arch Wiki?

I see! No wonder the online detection is broken. ArchLinux doesn’t come with a default network management framework, thus systemd comes without online detection pre-configured.
If you are on Wi-Fi, I suggest making sure systemd’s online detection can function properly. I believe your system have already installed some network management framework such as NetworkManager to help you manage Wi-Fi passwords.
Or, if you are on wired network, simply modifying the .service file to disable online detection would be the easiest solution. Installing NetworkManager for a non-mobile machine might not be against the K.I.S.S. principle.
No matter which method you take, I believe I can’t make the choice for you. So I suggest we leave a note on ArchWiki.
For other distributions, their distributors usually have made the decision for them, so they all got NetworkManager or equivalent frameworks installed, even for non-mobile machines.
So I believe this issue is mainly related to DIY distributions such as ArchLinux, Gentoo, NixOS, etc. putting it on ArchWiki is great.

Thanks for your suggestion and advice, I appreciate it.
I don't have an Arch Wiki account, if anybody interested on this: you can help me adding the note to Arch Wiki.
Also it might be better if we change the title to "Service doesn't start properly in Arch Linux"?
To make it easier for search engines.

I don't have an Arch Wiki account, if anybody interested on this: you can help me adding the note to Arch Wiki.
I don't have an account there, so anyone who sees this and can do that feel free to do so.

Also it might be better if we change the title to "Service doesn't start properly in Arch Linux"? To make it easier for search engines.
Done

Hi there, I found this problem on my Arch today and glad you guys already figure out the solution of it! Also, I left a note on ArchWiki https://wiki.archlinux.org/title/DNS-over-HTTPS

Hi there, I found this problem on my Arch today and glad you guys already figure out the solution of it! Also, I left a note on ArchWiki https://wiki.archlinux.org/title/DNS-over-HTTPS

Thank you so much!


Results Feedback

Hi,
Could you please help in posting how to get a result file(*-armttk.xml') in linux environment.
Sorry for writing this under issue section as I am not able find any other section.
Thanks

@StartAutomating - can we take this issue as a work item to update the doc for this scenario?

@StartAutomating - can we take this issue as a work item to update the doc for this scenario?

We can close this issue. I used Invoke-pester to get result files. Thank you so much for this nice tool 👍

We can close this issue. I used Invoke-pester to get result files. Thank you so much for this nice tool 👍

Thx for the update @DillyBabu - but I think you have a good issue/improvement for us here...

Thx for the update @DillyBabu - but I think you have a good issue/improvement for us here...


Niamh25/DOC-4990/Remove-all-reference-to-node-explorer

Removed all reference to node explorer in documentation as we no longer support it and have no done so in quite a while.

@Niamh25 you might want to run a search in your text editor. Here is mine in VSC. There are nearly 200 instances of node explorer found in 15 files, which takes in multiple versions. Please do a search in your editor and just check that you have them all. Thanks


Add test for events in handles.cairo

Hello @Darlington02 , I keep running into this error

I need a bit of assistance

Hi @Jemiiah could you please ask on the GC instead? will take a look at all blockers once I'm a bit free

Hi @Jemiiah could you please ask on the GC instead? will take a look at all blockers once I'm a bit free

I tried another approach and was able to find a solution. Thank you


Please list tags on docker hubpage

Most docker hub pages have a supported tags section up top. Example, mysql.

Microsoft SQL Server docker images should use this convention.

Great suggestion.  Done!


My  binding crashes vim

Syntastic + my  binding  crashes vim.  My bindings seem no to have any conflicts that I could detect looking at :map    Any ideas as to what is going on?

Syntastic doesn't define, use, or care about key mappings.
On the other hand, <C-a> is the standard binding for increasing numbers (cf. :h CTRL-A).  It has a long history of crashing Vim in various situations, and bugs about it seems are found and fixed every once in a while.  However, you don't offer enough details to identify the problem, so who knows what's actually going on.
Feel free to re-open this if (1) you can actually provide an actionable description of the problem, and (2) you have evidence of it being somehow related to syntastic. shrug

Thank you for the FYI.  I tried to learn more about the historical issues with <C-a> but was not able to solve it.  I did pull a log from nvim.  I have  mapped to writing and clearing whitespace. Only when I have syntastic loaded do I freeze nvim.  I turn off just this one plugin, everything works. Here are the last few lines of the nvim log.  Thank in advance for any guidance.  - E  (PS: everything has been updated to the latest stable version)
continuing in function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[8]..282[8]..289
calling function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[8]..282[8]..289[4]..syntastic#util#argsescape
function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[8]..282[8]..289[4]..syntastic#util#argsescape returning []
continuing in function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[8]..282[8]..289
function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[8]..282[8]..289 returning []
continuing in function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[8]..282
function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[8]..282 returning 'hdevtools check /Users/edmund/Dropbox....drop/pack_2/Learning/words/src/Lib.hs'
continuing in function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList
calling function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake
calling function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[1]..syntastic#log#debug
calling function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[1]..syntastic#log#debug[1]..147__isDebugEnabled_smart
function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[1]..syntastic#log#debug[1]..147__isDebugEnabled_smart returning #0
continuing in function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[1]..syntastic#log#debug
function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[1]..syntastic#log#debug returning #0
continuing in function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake
calling function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[30]..syntastic#util#system
calling function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[30]..syntastic#util#system[5]..syntastic#util#var
calling function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[30]..syntastic#util#system[5]..syntastic#util#var[1]..syntastic#util#rawVar
function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[30]..syntastic#util#system[5]..syntastic#util#var[1]..syntastic#util#rawVar returning '/bin/zsh'
continuing in function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[30]..syntastic#util#system[5]..syntastic#util#var
function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[30]..syntastic#util#system[5]..syntastic#util#var returning '/bin/zsh'
continuing in function 86_BufWritePostHook[4]..86_UpdateErrors[15]..86_CacheErrors[39]..278[1]..277[24]..SyntaxCheckers_haskell_hdevtools_GetLocList[22]..SyntasticMake[30]..syntastic#util#system
Writing ShaDa file "/Users/edmund/.local/share/nvim/shada/main.shada"

Your description of the problem is still useless.  Random logs are not useful without a context.  Please show the famous map.  Explain what you did, what did you expect to happen, and what happened instead.  Can you reproduce the problem with all other plugins uninstalled?  Neovim is not supported, can you reproduce the problem with plain Vim?

It happens as follows:
filetype: haskell (no issues with rc files for instance; I don't use syntastic for non haskell)
trigger:    :w   -- when I write to file
fix:       -- this will give me back control
here is a profile of what happens when I open a file, change one thing, write to file.  I understand how it is likely not syntastic.  However, I keep getting pulled back to thinking this is the place to figure it out.  The syntastic plugin is hanging when I write to file.  I've checked through as much as I can on other functions that might be causing the hang with syntastic to no avail.  I've also read through the documentation for working with other plugins (e.g., airline), and can't see the culprit.
What did you do?
What did you expect to happen?
What happened instead?

I found the incompatible plugin: eagletmt/neco-ghc

What is the <C-a> map? A:  :w  (it also triggered a function that cleaned up the whitespace; I disabled that early in the process)
What did you do? A: I could replicate the problem by using :w directly
What did you expect to happen? A: I expected the buffer to write to file and see syntastic do it's magic (i.e., check my syntax and style using ghc-mod and lint; both operating when called directly)
What happened instead? A: Vim would freeze, be unresponsive until I hit <c-c> (note: <c-q> did not work).  Following <c-c> syntastic operated as expected.

My baseline configuration is .  Once I disabled eagletmt/neco-ghc syntastic functioned as designed.
Thank you for your help.  I appreciate your keeping at it.
Takeaway: Perhaps one benefit for these efforts might be to update the syntastic documentation to include a warning specifically using  and or the neco-ghc plugin.
The longer answer has to do with finding how neco-ghc was triggered with :w.  I still have not solved that one.  However, the neco-ghc functionality is somewhat redundant with syntastic so having both working side-by-side is not likely useful.

It's far from clear (at least to me) that your analysis is correct.  At this point I see no reason for ghc-mod to be incompatible to syntastic.  Do you have autocmds triggered on write?  Can you reproduce the problem with only syntastic and neco-ghc, and all other plugins disabled?

Based on your input I tried syntastic with neco-ghc.  The two work together, and more, when I reloaded (systematically) the rest of the plugins, they continued to work.  But, the system is not able to find types nor perform any of the tab complete lookups.  I'll take another crack at it later in the week and update you accordingly.  - E

I was able to get everything to work with neco-ghc, ghcmod-vim, deoplete.nvim and neomake.  Syntastic does not officially support neovim.  It looks like that was the the answer.  I'm still not 100% convinced that it would not eventually work and/or that I'm missing something obvious, but I have the functionality I need with the above mentioned mix of plugins.  Thank you for your help and support of this resource.  - E


Issue 155 - Non-null Strike field

This is a simple change to make the strike field non-nullable in the ingest model. This helps a number of other pieces of the code which expects the strike field to be populated.
This closes #155.

lgtm


Pathing issues

Seems to be some issues with pathing via the green dotted lines. Not really a huge priority.
Looks as though its always going through scions ascendant thing. Maybe one of the algorithms is busted?

Lol, looks as though the algorithms is thinking that the quickest thing to do is to run "ascendant" and jump through the tree.


emulationstation: refactor

Found by https://github.com/NixOS/nixpkgs/commit/af039eb7c612e55cb7ed3141c3ae20587aafcf0f#r143796136
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Since emulationstation needs an insecure freeimage (and I still did not figure out how to fix it), it will not be built by ofBorg.

@edwtjo Do you have objections?