How do I continue training with PEFT?

I'd be greatful if I can be given an example as to how I can continue fine tuning an already trained model with PEFT, the examples I seem to be coming to (specifically for int8 training) seem to only showcase training for training it from scratch
can I just continue fine tuning the trained model with peft ?, do I have to call prepare_model_for_training again on the new peft model before I continue training it

Hi! I have the similar issue when trying to further train the finetuned LoRa model. What I did is
`model = LlamaForCausalLM.from_pretrained(
base_model,
load_in_8bit=True,
torch_dtype=torch.float16,
device_map=device_map,
)
prepare_model_for_int8_training(model)
model = PeftModel.from_pretrained(
model,
lora_weights,
torch_dtype=torch.float16,
# is_trainable=True
)
model.train()
But when runningmodel.print_trainable_parameters() `, it says the trainable params is 0.

Hello, if it is for LoRA method using INT8, call the prepare_int8_model_for_training on the base model, then do the PeftModel.from_pretrained(base_model, peft_model_id). Now, before training, do model.train() and you are good to continue with the training. Please let us know in case you encounter issues.

Hi, I wonder that if I continue training with peft, the learning rate will inherit the old one's, but if the old training has already done, the learning rate would be close to 0. How to solve this?

hi edwardelric1202,
for name, param in model.named_parameters():
if 'lora' in name or 'Lora' in name:
param.requires_grad = True
this will help you :)

As far as I know, the graceful solution is someway like this
from peft.tuners.lora import mark_only_lora_as_trainable lora_model = PeftModel.from_pretrained(in_model, path, is_trainable=True) mark_only_lora_as_trainable(lora_model)

With either @shaunheilee  and @sayhellotoAI2 proposed solutions, I get NaN loss when resuming a training.... Am I the only one ?

@SimonBenhamou , I'm having the same problem as you. I've tried all of the above solutions, but I'm still not training model. did you find a solution?

When trying to resume training  on  LLama2 lora I was running into
RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn
This was solved with the following:
base_model = AutoModelForCausalLM.from_pretrained(base_model_id)
base_model.enable_input_require_grads()
model = PeftModel.from_pretrained(base_model, peft_adapter_path, is_trainable=True)
model._mark_only_adapters_as_trainable()

The _mark_only_adapters_as_trainable() might not be necessary,

The mark is not necesaary, if resume then you msut only want training lora only, it just will train lora only indded

I tried above both solution and I am running into the following error:
self.dtype = self.optimizer.param_groups[0]['params'][0].dtype
I am using deep speed with two GPUs. I did merge state for rank0 and rank1 but that did not solve issue on resuming training. However, I can evaluate Peft Model.

I tried above both solution and I am running into the following error: self.dtype = self.optimizer.param_groups[0]['params'][0].dtype
I am using deep speed with two GPUs. I did merge state for rank0 and rank1 but that did not solve issue on resuming training. However, I can evaluate Peft Model.

I managed to load a trainable peft model like this:
from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM

config = PeftConfig.from_pretrained("not-lain/Gemma-2b-Peft-finetuning")
model = AutoModelForCausalLM.from_pretrained("google/gemma-2b")
model = PeftModel.from_pretrained(model,
"not-lain/Gemma-2b-Peft-finetuning",
 is_trainable=True # 👈 here
)
# check if it's working
model.print_trainable_parameters()

this will help you easily restore the former peft training states for continuous training.


bedtools needs genome

bedtools bamtobed needs a genome file on recent (within the last few years?) versions of bedtools. Using BAM files as input is not possible with the bedtools versions available in bioconda due to this call to bedtools.

Nice catch, now next on my todo. Thanks to your last PR, this will be super easy to solve with the genome size files from pkg_utils.

The bug was actually that I used bedToBam not bamToBed. This was fixed a while ago, but I must have gotten confused by git. (Wonder what other regressions I introduced?) Thanks again.

This is still a problem using epic version 0.0.6


store waypoint data to bakcend map  and no service pod ip to forntend map

What type of PR is this?

What this PR does / why we need it:
Which issue(s) this PR fixes:
Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

please donot force push

/lgtm

/lgtm
/approve

/lgtm


ci: merge opae-libs

Automated changes by create-pull-request GitHub action

Coverage remained the same at 75.346% when pulling cc06fbf8e248c0bcddbb22bbac4414ae491c74da on auto/update-libs into 7c429f0f379f4540cd8917dc87017ea0f34e52f8 on master.

Coverage remained the same at 75.346% when pulling cc06fbf8e248c0bcddbb22bbac4414ae491c74da on auto/update-libs into 7c429f0f379f4540cd8917dc87017ea0f34e52f8 on master.


adding ASGCN to the model list and refinement on the code

main changes:

setting PYTHONHASHSEED to the fixed seed number.
renaming a few variables to make them more distinguishable from each other.
adding early stop on validation set with a patience number.
adding support for all models available in an inference exemplar script, merging the inference script specifically designed for bert-based models.
adding a graph-based model ASGCN.

test:

ASGCN tested
train tested
train cross-val tested
infer example tested

disclaimer:

bert-based models are not tested

Great work!

Hello dears, I would like to train the models on a different  TSA dataset  without aspects but I get errors regarding the missing raw.graph files. I am wondering what those graphs are and  whether or not it is possible to train on different datasets. Thank you very much!!!


Add all possible profile icons to creators in search

:heart: Thank you for your contribution!
Description
Adds all profile Icons to creators in search. Previously only the first was shown. Closes #1492.
(Also fixed spacing)

Checklist
Ticks in all boxes and 🟢 on all GitHub actions status checks are required to merge:

[x] I'm aware of the code of conduct.
[x] I've created logical separate commits and followed the commit message format.
[x] I've added relevant test cases.
[x] I've added relevant documentation.
[x] I've marked translation strings (for relevant code).
[x] I've followed the CSS/JS and React guidelines (for relevant code).
[x] I've followed the web accessibility guidelines (for relevant code).
[x] I've followed the user interface guidelines (for relevant code).
[x] I've identified the copyright holder(s) and updated copyright headers for touched files (>15 lines contributions).
[x] I've NOT included third-party code (copy/pasted source code or new dependencies).

Third-party code
If you've added third-party code (copy/pasted or new dependencies), please reach out to an architect.
Reminder
By using GitHub, you have already agreed to the GitHub’s Terms of Service including that:

You license your contribution under the same terms as the current repository’s license.
You agree that you have the right to license your contribution under the current repository’s license.

broken something, will resubmit.


Add instructions for running a Go function periodically

Can kala do this, or must the Go function be inside a main function in a .go file?  Thanks.
(I see https://github.com/ajvb/kala/blob/master/client/client_test.go but that's still just calling a bash command from Go.)

Context: I am writing a simple SMS-based app that helps people keep on track with their goals by texting them on certain days per week (initially every day) at the same time on each of those days, and I'm sending those texts via Twilio from Go.  I'd like to use kala to periodically send out those texts.

@elimisteve This is a great use case that I haven't thought of before.

Can kala do this, or must the Go function be inside a main function in a .go file? Thanks.

Right now, the Go function must be inside a main function in a .go file. I would like to in the future allow for a "Plugin" like architecture within how jobs are ran, so for example you could implement running a Dockerfile (rather than running a bash script that runs a Dockerfile).
For now, I would have a simple CLI where you can pass in the needed info.
Also, please let me know if you have any troubles with deployments and I will be very interested to here how Kala is working for you. Let me know if you have any specific requests, as I prioritize based on what people are asking for :)

@elimisteve I'm going to marked this closed for now. If you it ends up not being, feel free to re-open.


tell: use the term "bytes" instead of "octets"

Make "tell" and "seek" use the same unit.
https://github.com/perl6/specs/issues/85

Thanks!


Include py.typed file in output

📝 Description of the feature
The package is type hinted and we run mypy as part of the build and release CI. However, we don't include a py.typed file, and so the type hints cannot be consumed by mypy when this package is included in a project as a dependency.
We should check that the type hints are correct and up to date for the latest mypy release and add a py.typed file.
💡 Steps for implementing the feature
No response
🔗 Useful links and references
No response

Duplicate of #434


⚠ ClamAV has degraded performance

In a868d3a, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 57 ms

Resolved: ClamAV performance has improved in f2c85ae.


Validating primitive types

I'm trying to find a way how I can use built-in validators to validate primitive types like strings or ints. For example, I would like to be able to use EmailValidator to validate a string value (not a string property of a complex type) by calling something like Validate. But EmailValidator is IPropertyValidator, not IValidator.
Any ideas how to use FluentValidation to validate primitive types?

That isn't really something that's supported I'm afraid. The whole point of FluentValidation is to validate properties on objects.
Technically, you can define rules for primitives like this:
public class MyValidator: AbstractValidator<string> {
  public MyValidator() {
     RuleFor(x=>x).EmailAddress();
  }
}

...however, you will find that there are some features that don't work with this approach, and isn't really recommended.

Similar to this, is there a way to define a set of rules for a primitive type, and reuse that set of rules?  For example, if I want to validate the complexity of a password with several checks, but I have multiple models that use those same checks - I would rather not refactor the password component into a complex type.  It would be great to group multiple rules into a group and be able to reuse them.
I did see rule sets, but those are a bit different.
Thanks!

Yes, you have a couple of options. You can use the approach I documented above, by creating an AbstractValidator instance that acts on strings. The other option is to write an extension that wraps the multiple calls to RuleFor.

Hi Jeremy,
Thanks for the quick response!  I've been looking for examples of the second approach, wrapping multiple calls to RuleFor and have not found any.  Do you have any advice there?

Sure, here's an example that chains multiple rules on a string property, within an extension method.
// In the validator
RuleFor(x => x.Surname).CustomSurnameValidation();

// Custom extensions class
public static class MyExtensions {

  // Generic type is hard-coded to string, menaing this method will only appear for string properties.
  // If you wanted it to appear for *all* properties, introduce a second type-parameter called TProperty
  public static IRuleBuilderOptions<T, string> CustomSurnameValidation<T>(this IRuleBuilder<T, string> rule) {
    return rule.NotNull().NotEqual("foo");
  }
}

This is actually how all of FV's default validation rules (NotNull, NotEmpty etc) work- they're all extesnions on IRuleBuilder that perform certain actions (usually calling SetValidator to encapsulate within a custom property validator)

Thanks Jeremy!

Maintenance / cleanup: Closing this as the question appears to be answered.


ROS2 Livox support

Any chance of supporting Livox custom message under ros2? I know there's a custom livox driver for ros, but ros2 has no support. I believe the custom message has all necessary information inside, just line -> ring.

PR welcome ... unfortunately I don't have a livox at hand ...


[main] Upgrade to latest dependencies

Cron -knative-prow-robot
/cc knative-sandbox/networking-wg-leads
/assign knative-sandbox/networking-wg-leads
Produced by: knative-sandbox/knobots/actions/update-deps
Details:
bumping knative.dev/networking 17e1877...1934422:
  > 1934422 upgrade to latest dependencies (# 622)
bumping knative.dev/hack a8ef7b6...e178598:
  > e178598 Update community files (# 157)
  > cf8cbc0 Fix the regex used for matching GitHub Actions files (# 156)
bumping knative.dev/pkg d481724...062ca30:
  > 062ca30 upgrade to latest dependencies (# 2433)
  > 4fcbc1b Update actions (# 2434)
  > 80c511a Wait for reconciler/controllers to return prior to exiting the process (# 2437)

/lgtm
/approve


[Epic] Add New Themes to Project Styling

Description:
This epic encompasses the task of introducing new themes to the project as part of the v2.0.0 update. By adding a variety of themes, we aim to enhance user experience and provide easy access to more customization options. Note that themes are managed within a separate themes repository and all pull requests to create new themes should be made there. However, the tracking of progress for v2.0.0 will be done in this main repository.
Note:

Theme authors should open pull requests here when submitting new themes
This epic will be resolved when the set of themes to release in v2.0.0 are completed

Resolved with v2.


strftime with variable

Formatting timestamp is one of the common use cases of ${...} expression.
Vanilla JavaScript doesn't have good support for it.
Having a strftime library such as https://github.com/samsonjs/strftime as a built-in library should be useful.
Discussions are:

How should we recommend users to convert session_time (string) to a Date object?
How to set default timezone? (I think users will expect that timezone:  parameter is used as the default timezone).

👍  for having it.
FWIW, let me share my case.
I need to calculate "N days ago from session_time (not last_session_time)" and format it as '%Y-%m-%d' in a workflow.
I did it by ${(d=new Date((session_time - (86400 * N)) * 1000) && [d.getFullYear(), ('0' + (d.getMonth()+1)).slice(-2), ('0' + d.getDate()).slice(-2)].join('-')}. It worked but it has 4 complexity:

Formatting ([d.getFullYear(), ...].join). strftime will solve this!
Converting seconds to milli seconds (new Date((session_time ...) * 1000))
Calculating date. session_time - (86400 * N) almost work but roughly.
Can't assign variable without hack ((d=new Date(...)) && ....)

Other popular time library moment.js can do converting and avoid assigning variable.
Above one liner can be rewritten with moment.js as ${moment(session_time * 1000).add(-N, 'days').format('YYYY-MM-DD')}. It's much simpler.
Probably typical user (including me) prefer strftime for formatting, but moment.js can do more work.

:+1: would also like something like this

I checked several libraries:

strftime: https://github.com/samsonjs/strftime
Moment.JS: http://momentjs.com/
XDate: http://arshaw.com/xdate/

maintenance mode: http://blog.arshaw.com/1/post/2013/03/xdate-08-and-future-development.html

Datejs: http://www.datejs.com/
d3-time-format: https://github.com/d3/d3-time-format

I first thought that simple strftime is the best. However, I found that it can't cover following common operations well:

Reformatting session_time, next_session_time, and last_session_time in custom format
Format tomorrow's time
Adding N hours for each loop
Using different time zones

On the other hand, Moment.JS seems quite feature complete:
$ jirb
> js = Java::jdk.nashorn.api.scripting.NashornScriptEngineFactory.new.getScriptEngine("--no-java", "--no-syntax-extensions", "-timezone=Asia/Tokyo")
> js.eval(File.read('moment.js')
> js.eval(%{moment("2016-09-27T00:00:00Z").format()})
=> "2016-09-27T09:00:00+09:00"
> js.eval(%{moment("2016-09-27T00:00:00Z").format("YYYY-MM-DD HH:mm:ss Z")})
=> "2016-09-27 09:00:00 +09:00"
> js.eval(%{moment("2016-09-27T00:00:00Z").utc().format("YYYY-MM-DD HH:mm:ss Z")})
=> "2016-09-27 00:00:00 +00:00"
> js.eval(%{moment("2016-09-27T00:00:00Z").utc().add(1, 'hours').format("YYYY-MM-DD HH:mm:ss Z")})
=> "2016-09-27 01:00:00 +00:00"

@danielnorberg @komamitsu I think bundling Moment.js makes sense. Do you have any ideas around?

Moment is pretty nice. We're using it in the console.


Limit curiosity to valid features

Increase early learning efficiency  by not developing curiosity about unpopulated features.
Perhaps set the number of times tried high and reset when a feature is populated. Or perhaps set a conditional and check whether features are in range.


Convert test functions into 1 liners where possible

Close #3

Coverage remained the same at 97.59% when pulling ffd64a2982421a4420bdba98204c1d582ceef1e5 on style/issue/3 into fa3e947ef18be3a6d241d4e174882da87d73f652 on master.


Add AbstractUnaryGrpcService.

For #1703
AbstractUnaryGrpcService allows defining unary gRPC services that are provided the direct bytes of a single gRPC message and return the bytes of a single gRPC message, and the base class takes cafe of the gRPC wire protocol. As this is an advanced use case, it doesn't attempt to implement everything in gRPC but should hopefully provide enough for most armeria-grpc users that are concerned about having dependencies on stub libraries.
@adriancole can you check whether this works for you or provide any suggestions?

wonder if you need to rebase this in order to get the gradle + JITPACK goodness or not..

at any rate I can just use snapshot to test :P

Jitpack is set up by the depending project (e.g, zipkin), don't think we'd need to do anything here for you to try it

@anuraaga sorry.. didn't tag you on this reference https://github.com/line/gradle-scripts/pull/55

looks like still a dep on grpc's utilities, used for the following header
    /**
     * {@code "armeria.grpc.ThrowableProto-bin"}.
     */
    public static final AsciiString ARMERIA_GRPC_THROWABLEPROTO_BIN =
            HttpHeaderNames.of(ProtoUtils.keyForProto(ThrowableProto.getDefaultInstance()).name());

Caused by: java.lang.ClassNotFoundException: io.grpc.protobuf.ProtoUtils
	at java.net.URLClassLoader.findClass(URLClassLoader.java:471) ~[?:?]
	at java.lang.ClassLoader.loadClass(ClassLoader.java:588) ~[?:?]
	at org.springframework.boot.loader.LaunchedURLClassLoader.loadClass(LaunchedURLClassLoader.java:93) ~[zipkin-server-2.13.0-SNAPSHOT-exec.jar:?]
	at java.lang.ClassLoader.loadClass(ClassLoader.java:521) ~[?:?]
	at com.linecorp.armeria.common.grpc.GrpcHeaderNames.<clinit>(GrpcHeaderNames.java:52) ~[armeria-grpc-0.84.0-SNAPSHOT.jar!/:?]
	at com.linecorp.armeria.common.grpc.protocol.AbstractUnaryGrpcService.<clinit>(AbstractUnaryGrpcService.java:47) ~[armeria-grpc-0.84.0-SNAPSHOT.jar!/:?]

testing by inlining "armeria.grpc.ThrowableProto-bin" vs using code to generate it

right now I am building with a small patch. I still have the exception above, just trying to figure out what to do about it.
diff --git a/grpc/src/main/java/com/linecorp/armeria/common/grpc/GrpcHeaderNames.java b/grpc/src/main/java/com/linecorp/armeria/common/grpc/GrpcHeaderNames.java
index b14f5442..0c0bb342 100644
--- a/grpc/src/main/java/com/linecorp/armeria/common/grpc/GrpcHeaderNames.java
+++ b/grpc/src/main/java/com/linecorp/armeria/common/grpc/GrpcHeaderNames.java
@@ -17,8 +17,6 @@
 package com.linecorp.armeria.common.grpc;

 import com.linecorp.armeria.common.HttpHeaderNames;
-
-import io.grpc.protobuf.ProtoUtils;
 import io.netty.util.AsciiString;

 /**
@@ -49,7 +47,7 @@ public final class GrpcHeaderNames {
      * {@code "armeria.grpc.ThrowableProto-bin"}.
      */
     public static final AsciiString ARMERIA_GRPC_THROWABLEPROTO_BIN =
-            HttpHeaderNames.of(ProtoUtils.keyForProto(ThrowableProto.getDefaultInstance()).name());
+            HttpHeaderNames.of("armeria.grpc.ThrowableProto-bin");

     private GrpcHeaderNames() {}
 }

this also crashes the server.. looking into it now.
java.lang.NoClassDefFoundError: io/grpc/ServerServiceDefinition
	at com.linecorp.armeria.server.grpc.GrpcDocServicePlugin.loadDocStrings(GrpcDocServicePlugin.java:195) ~[armeria-grpc-0.84.0-SNAPSHOT.jar!/:?]
	at com.linecorp.armeria.server.docs.DocService.lambda$addDocStrings$4(DocService.java:181) ~[armeria-0.84.0-SNAPSHOT.jar!/:?]
	at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:271) ~[?:?]
	at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:?]
	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?]
	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?]
	at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) ~[?:?]
	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
	at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578) ~[?:?]
	at com.linecorp.armeria.server.docs.DocService.addDocStrings(DocService.java:183) ~[armeria-0.84.0-SNAPSHOT.jar!/:?]
	at com.linecorp.armeria.server.docs.DocService.access$200(DocService.java:80) ~[armeria-0.84.0-SNAPSHOT.jar!/:?]
	at com.linecorp.armeria.server.docs.DocService$1.serverStarting(DocService.java:161) ~[armeria-0.84.0-SNAPSHOT.jar!/:?]
	at com.linecorp.armeria.server.Server$ServerStartStopSupport.notifyStarting(Server.java:494) ~[armeria-0.84.0-SNAPSHOT.jar!/:?]
	at com.linecorp.armeria.server.Server$ServerStartStopSupport.notifyStarting(Server.java:266) ~[armeria-0.84.0-SNAPSHOT.jar!/:?]
	at com.linecorp.armeria.common.util.StartStopSupport.notifyListeners(StartStopSupport.java:342) ~[armeria-0.84.0-SNAPSHOT.jar!/:?]
	at com.linecorp.armeria.common.util.StartStopSupport.lambda$start$3(StartStopSupport.java:171) ~[armeria-0.84.0-SNAPSHOT.jar!/:?]
	at io.netty.util.concurrent.GlobalEventExecutor$TaskRunner.run(GlobalEventExecutor.java:248) [netty-common-4.1.34.Final.jar!/:4.1.34.Final]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.34.Final.jar!/:4.1.34.Final]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: java.lang.ClassNotFoundException: io.grpc.ServerServiceDefinition
	at java.net.URLClassLoader.findClass(URLClassLoader.java:471) ~[?:?]
	at java.lang.ClassLoader.loadClass(ClassLoader.java:588) ~[?:?]
	at org.springframework.boot.loader.LaunchedURLClassLoader.loadClass(LaunchedURLClassLoader.java:93) ~[zipkin-server-2.13.0-SNAPSHOT-exec.jar:?]
	at java.lang.ClassLoader.loadClass(ClassLoader.java:521) ~[?:?]
	... 19 more

Ah I think the doc service stuff will get triggered as long as armeria-grpc is on the classpath, using service loader.
This would be a reason to extract a separate artifact for grpc-protocol. Otherwise, I can just add a try / catch there which feels yucky but might be fine. @trustin any thoughts?

I've a try/catch in progress.. just testing now
--- a/core/src/main/java/com/linecorp/armeria/server/docs/DocService.java
+++ b/core/src/main/java/com/linecorp/armeria/server/docs/DocService.java
@@ -32,6 +32,7 @@ import java.util.Set;
 import java.util.function.BiFunction;
 import java.util.stream.Collectors;

+import java.util.stream.Stream;
 import javax.annotation.Nullable;

 import com.fasterxml.jackson.annotation.JsonInclude.Include;
@@ -178,8 +179,14 @@ public class DocService extends AbstractCompositeService<HttpRequest, HttpRespon
     private static ServiceSpecification addDocStrings(ServiceSpecification spec, List<ServiceConfig> services) {
         final Map<String, String> docStrings =
                 plugins.stream()
-                       .flatMap(plugin -> plugin.loadDocStrings(findSupportedServices(plugin, services))
-                                                .entrySet().stream())
+                       .flatMap(plugin -> {
+                           try { // Guard when optional classpath dependencies are unmet
+                               return plugin.loadDocStrings(findSupportedServices(plugin, services))
+                                   .entrySet().stream();
+                           } catch (NoClassDefFoundError e) {
+                               return Stream.empty();
+                           }
+                       })
                        .collect(toImmutableMap(Entry::getKey, Entry::getValue, (a, b) -> a));

         return new ServiceSpecification(

ok with the two diffs I posted the server starts. the response is different, which I'm looking into now. Seems like a missing content type header.
before
$ curl -X POST localhost:9411/zipkin.proto3.SpanService/Report -H'Content-Type: application/grpc' -v
*   Trying ::1...
* TCP_NODELAY set
* Connected to localhost (::1) port 9411 (#0)
> POST /zipkin.proto3.SpanService/Report HTTP/1.1
> Host: localhost:9411
> User-Agent: curl/7.54.0
> Accept: */*
> Content-Type: application/grpc
>
< HTTP/1.1 200 OK
< content-type: application/grpc+proto
< grpc-status: 13
< grpc-message: Half-closed without a request
< content-length: 0
<
* Connection #0 to host localhost left intact

now (plus the two patches)
$ curl -X POST localhost:9411/zipkin.proto3.SpanService/Report -H'Content-Type: application/grpc' -v
*   Trying ::1...
* TCP_NODELAY set
* Connected to localhost (::1) port 9411 (#0)
> POST /zipkin.proto3.SpanService/Report HTTP/1.1
> Host: localhost:9411
> User-Agent: curl/7.54.0
> Accept: */*
> Content-Type: application/grpc
>
< HTTP/1.1 200 OK
< grpc-encoding: identity
< transfer-encoding: chunked
<
* Connection #0 to host localhost left intact

ps hold a tick as I think the path I'm looking at isn't actually required..

here's my entire code now.. same thing with the difference in curl result (also with grpc client fail). Not sure if there's a smoking gun here.
service SpanService {
  rpc Report(zipkin.proto3.ListOfSpans) returns (google.protobuf.Empty) {}
}

@ConditionalOnProperty(name = "zipkin.collector.grpc.enabled") // disabled by default
final class ZipkinGrpcCollector {
  @Bean ArmeriaServerConfigurator grpcCollectorConfigurator(StorageComponent storage,
    CollectorSampler sampler, CollectorMetrics metrics) {
    CollectorMetrics grpcMetrics = metrics.forTransport("grpc");
    Collector collector = Collector.newBuilder(getClass())
      .storage(storage)
      .sampler(sampler)
      .metrics(grpcMetrics)
      .build();

    return sb ->
      sb.service("/zipkin.proto3.SpanService/Report", new SpanService(collector, grpcMetrics));
  }

  static final class SpanService extends AbstractUnaryGrpcService {

    final Collector collector;
    final CollectorMetrics metrics;

    SpanService(Collector collector, CollectorMetrics metrics) {
      this.collector = collector;
      this.metrics = metrics;
    }

    @Override protected CompletableFuture<byte[]> handleMessage(byte[] bytes) {
      metrics.incrementMessages();
      CompletableFutureCallback result = new CompletableFutureCallback();
      collector.acceptSpans(bytes, SpanBytesDecoder.PROTO3, result);
      return result;
    }
  }

  static final class CompletableFutureCallback extends CompletableFuture<byte[]>
    implements Callback<Void> {

    @Override public void onSuccess(Void value) {
      complete(new byte[0] /* empty result */);
    }

    @Override public void onError(Throwable t) {
      completeExceptionally(t);
    }
  }
}

it seems the thing grpc's client dislikes most is the missing content-type in the response
io.grpc.StatusRuntimeException: UNKNOWN: HTTP status code 200
invalid content-type: null
headers: Metadata(:status=200,grpc-encoding=identity)
DATA-----------------------------

Yeah will add that in, that was not intended. Will also update the test to use upstream client instead of armeria client to catch that, since it's more important to test that anyways. Thanks for checking out the code!

actually there's a bit tougher issue trying to exclude protobuf (which reduces the jar cost of this integration to near nothing). serviceloader pukes on .hasNext()

@anuraaga wrote:

This would be a reason to extract a separate artifact for grpc-protocol. Otherwise, I can just add a try / catch there which feels yucky but might be fine. @trustin any thoughts?

+1 for a separate module, because otherwise it will be fairly easy to break this again and again.

Ready for another look.
Extracted a module, which solves doc service issue and ensures no more accidental usage of gRPC dependencies. And fixed content type header, upstream client went from not working to working in a unit test.
@adriancole think you should be good. I merged master so jitpack might work too

trying now thanks!

the anticipation! cc @bsideup

dunno why it adds in 0.4.0.Final- to the stuff..
https://jitpack.io/com/github/anuraaga/armeria/unary-grpc-service-armeria-0.4.0.Final-g792dcc8-1703/build.log

ignore the jitpack related comments.. will follow-up on these elsewhere

shipit! this works https://github.com/apache/incubator-zipkin/pull/2328/files

I think we can merge this and do a follow-up on armeria-grpc-protocol later. Sounds good, @anuraaga and @adriancole ?

Yeah I'm good but just to clarify, what do you mean by follow up? Do you mean the name of the artifact?

@anuraaga That's because I didn't know you finished the separation already. That was fast. :+1:

Could you update the PR description and commit message finally so I can merge this PR?

Updated description :)

@hyangtack Could you take another look since it was updated since your last review?

Thanks, @anuraaga and @adriancole !


Require external (unmanaged) file

I would have expected that a
require.ensure(['script!//ajax.googleapis.com/ajax/libs/angularjs/1.2.9/angular.min.js'], function(require){

});

would work out-of-the-box. But it doesn't.
(I don't need this for angular, but would like to do this for some payments-gateway-js.)
Any solution for this.

I was just looking for something like this but for fonts, not scripts. It doesn't seem common fonts are stored in npm, so rather than maintaining my own variants I was hoping I could convince webpack to download them.
@m59peacemaker - It looks like you removed your loader project, do you still have the source?

@jbcpollak I haven't used webpack in a long time, so I don't know how fonts should work. My loader was bad and wrong, so I removed it.

Would it be possible to do something similar but with CSS. I'm assuming $scriptjs would only work with js files.

@simkessy - Thats similar to what I'm looking for (for fonts) - I can imagine the same for images, etc. It seems like a useful feature for webpack.

Yea it would be nice. If you find anything let me know.

webpack is a module bundler not a javascript loader. It package files from local disk and don't load files from the web (except its own chunks).
Use a javascript loader, i. e. script.js

And how it can be work if we want to load a extenal-script which have been written with module API(for example AMD) ?
In other word, is there any way we can add a module into webpack module list at runtime ?  :mask:

@mc-zone you should be able to load AMD modules with script.js. But this has nothing to do with webpack, it just works because AMD was designed for this. Thus you won't be able to use webpack features inside these AMD modules. webpack requires static analysis on build time.
If you want to include another webpack build, you could try to use the DllPlugin to compile the library and the DllReferencePlugin to reference this library inside your bundle without including it.

We have a similar issue.  We have large video files that would be too big to check into our local code repository - but are loaded via a cdn.  Is there an easy way to tell webpack to make the path for these files come from a specific external host?

@oveddan Why would you want to manage that file with webpack? What would be the expected behavior?

As I mentioned before, this behavior would be handy for things like fonts that you want embedded in your application but are only available as URLs online.
It doesn't seem appropriate to have to download fonts and check them into source control when you could refer to them by URL.
I realise you could refer to them by URL at runtime, but I would rather webpack bundle them for us. (And in my case I am building an offline app so I need the fonts local to the application)

I could second that this would be handy. We have to lazy load an external script that we do not want to bundle since our vendor might update it at will. using webpack as a single source management solution would be awesome. A loader would be nice for this, maybe something similar to require("bundle?lazy!./file.js") where instead of ./file.js we could have //yadda.something.you/know.js.

My preference would probably be:

In externals we specify CDN URL starting from //
Webpack adds corresponding

If the script I load using script.js defines a global variable that I need to use, how would I then use this global variable?
var $script = require("scriptjs");
$script("http://example.com/someScript.js", function() {
  // how do I use the global variable here that someScript defined?
});

window.globalVariable or even just  globalVariable? 😁

Oh, lol, sorry. This doesn't work for me because I am doing this inside an es6 module (using babel), so no access to global variables.

You can still access global variables inside an es6 module

I'm completely new to Webpack, but this makes no sense to me.
I am assuming that I'm missing something here, but could not figure it out.
The fact Webpack has no (built-in, easy) way to resolve remote dependencies discourages CDN usage for popular packages like React, jQuery etc.. (I realize there are ways around it, but none are pretty as far as I could find and it is seems like the less common usage).
I just started using Webpack and the most natural thing to do was npm install everything I needed.
But then my bundle quickly became huge, and cached versions of these libs I installed would no longer be used to speed up loading of my app.
So is Webpack's design actually encouraging bloated bundles (with many included libs), and slow-loading web apps???
I must be missing something...

@shachar-i please, check this out https://webpack.github.io/docs/library-and-externals.html

You can use different configs for dev/prod. Dev without externals, so all scripts go into bundle, prod with - so files are used from CDN.

Thanks @nkbt , but if I use externals, I'll have to take care of my own dependencies (which is a major reason to start using Webpack to begin with).
This is actually what I did (use externals), but not the point I'm trying to make.
Since bundling npm installed packages is way nicer and more Webpacky, Isn't Webpack encouraging bloated bundles by not giving a good remote CDN option for 3rd party libs???
A half-lazy developer would just pick the easy big-bundle way. I supposed many did.
For example, I've looked at several react-webpack tutorials. All of them encourage 'npm install react' rather than the ugly external.

I understand where you are going here, but the thing is - CDN is an app concern, not bundler. Besides, there is no such thing as good remote CDN option for 3rd party libs except maybe the recent unpkg (npmcdn). But for any reasonably loaded prod it makes sense to buy/setup your own CDN.
I personally cannot come up with any reasonable answer to this. If you do - PR to docs would be a good point to start the discussion.
PS: mastering your tools is always a difficult process that takes heaps of time and errors. If it is possible to reduce this time - awesome

I haven't thoroughly tested it yet, but you can use something like this to load an external script:
const _scriptCache = new Map();

/**
 * @param {string} url
 * @param {string=} name
 * @return {Promise}
 */
export function loadScript(url, name) {
    let promise;

    if(_scriptCache.has(url)) {
        // TODO: normalize URL
        promise = _scriptCache.get(url);
    } else {
        promise = new Promise((resolve,reject) => {
            let script = document.createElement('script');
            script.onerror = event => reject(new Error(`Failed to load '${url}'`));
            script.onload = resolve;
            script.async = true;
            script.src = url;

            if(document.currentScript) {
                document.currentScript.parentNode.insertBefore(script, document.currentScript);
            } else {
                (document.head || document.getElementsByTagName('head')[0]).appendChild(script);
            }
        });

        _scriptCache.set(url, promise);
    }

    return promise.then(() => {
        if(global[name]) {
            return global[name];
        } else {
            throw new Error(`"${name}" was not created by "${url}"`);
        }
    });
}

Usage:
loadScript('https://js.stripe.com/v2/', 'Stripe').then(Stripe => {
    console.log('Stripe loaded!', Stripe);
});

The name parameter is to ensure the API you're loading actually created the global variable you were expecting (e.g. Stripe creates window.Stripe) and it avoids some IDE warnings ("Stripe is undefined").

I totally agree with @shachar-i 's points above at https://github.com/webpack/webpack/issues/150#issuecomment-257114083.
I have spent 8 hours trying to learn Webpack today, and the docs do not clarify:
I want to know how a Webpack website application (with multiple entry points) can manage lots of different dependencies (which I thought was the main motivation for Webpack) while also taking advantage of the fact that many people have jQuery and other popular libraries cached in their browsers because they've already visited sites that pulled them from CDNs, such as https://ajax.googleapis.com/ajax/libs/jquery/2.2.3/jquery.min.js.
Why would I serve my own copies of popular libraries (e.g. bundled into the rest of my JS)? That seems like a waste of browser payload.
But I also don't yet understand @sokra 's https://github.com/webpack/webpack/issues/150#issuecomment-32756166 recommending scriptJs.
Why can't Webpack manage them CDN dependencies?
What am I misunderstanding?
Thanks, everyone!

@ryancwalsh

I want to know how a Webpack website application (with multiple entry points) can manage lots of different dependencies ... while also taking advantage of the fact that many people have jQuery and other popular libraries cached in their browsers because they've already visited sites that pulled them from CDNs

You can do this the same way you always would. Add
<script src="https://code.jquery.com/jquery-3.2.1.min.js" integrity="sha384-xBuQ/xzmlsLoJpyjoggmTEz8OWUFM0/RC5BsqQBDX2v5cMvDHcMakNTNrHIW2I5f" crossorigin="anonymous"></script>

To the top of your page, and then use $ or window.$ in your bundle.

Why would I serve my own copies of popular libraries (e.g. bundled into the rest of my JS)? That seems like a waste of browser payload.

It's your choice. If you trust your CDN to always be available, don't bundle it. I personally put all my vendor/3rd party libraries in a CommonsChunk and perma-cache it. Our users only have to download this bundle once the first time they visit the site. Since it's a web-app, 99% of our users are recurring. If most of your users are new visitors, you might prefer a CDN.

But I also don't yet understand @sokra 's #150 (comment) recommending scriptJs.
Why can't Webpack manage them CDN dependencies?

Because it's not webpack's job to do that for you. Its purpose is to bundle local files, not manage CDNs. It's relatively easy to add a <script src="..."> to the top of your page, use scriptjs, or create a helper function like I did. There's no need to bake that into webpack.
What would that even look like? Supporting require('https://...') would lock up your browser while the script downloads, because require is synchronous. require.ensure is async and support could be added there, but it's just as trivial to create your own myExternalRequire.

@mnpenner Thanks for the response!!  ☺
Yes, most of my site's visitors are new and not recurring.  Maybe I'm in the minority and starting to use Webpack was the wrong choice for me.
I'm surprised more Webpack fans aren't asking for this functionality. To me, managing dependencies is important, regardless of whether the code is hosted all together locally or if some of it sits on a CDN.
I'm not sure how to create my own myExternalRequire function to do what we're describing.
[I'm impressed that I even got Webpack working at all—it took me more than a full day to migrate my site over (to the Webpack way). The docs are super sparse and seem like they were written as reminders to the creators of Webpack rather than to introduce new developers to it.]

@ryancwalsh I posted my implementation just a few comments up. Webpack is difficult to get started with, I'll grant you that. I'm sure the maintainers wouldn't mind some help on the documentation side once you get it all figured out. There's lots of blogs/tutorials on the subject if you find the official documentation too sparse.

@mnpenner Sweet--I don't know how I missed that. I'll check that out. Thanks!

Is it possible to bundle library as a module for dynamic import (https://webpack.js.org/guides/code-splitting-async/#dynamic-import-import-)?
I just want my library code to be wrapped by webpackJsonp function (without all that webpack bootstrap) and then in a parent project i want to have import("path/to/external/library.js") which doesn't throw any "Module not found" errors.

In my use case, I want to be able to use System.import() to import some external url's that I only want resolved during runtime.
After scouring this page a bit: https://github.com/webpack/docs/wiki/configuration#automatically-created-contexts-defaults-modulexxxcontextxxx
The simplest thing I got working was to disable the error in the webpack config.
module: {
        exprContextCritical: false, // true triggers warning
        rules: [ ...

I tried to figure out how to disable the warning only for certain imports, like if the expression started with certain letters like "url", or if I had provided a string literal that said "http", using the remaining properties. I couldn't figure it out unfortunately. If anyone else knows how, would be happy to know!

Ok, I found how to import a webpack bundle from another project.
fetch(appUrl).then(response => response.text()).then(function(text) {
    let theModule = null;
    let define = (a) => theModule = a();
    eval(text); // the imported module ends up in theModule
});

Hello.
I have some pre-bundled with webpack angular modules stored on the another server.
I want to lazy-load them when it is necessary from both client and server side (server pre-rendering).
I have tried already:

$scriptjs => but it uses document so it doesn't work on the server side
requirejs => looks like it overlapping with webpack require method that causes an error:

ERROR in ./~/requirejs/bin/r.js
Module parse failed: /app/node_modules/requirejs/bin/r.js Unexpected character '#' (1:0)
You may need an appropriate loader to handle this file type.

Is there any other way to lazy load external js-bundles that does work with angular 4 and webpack?

I've written a loader that allows you to expose modules from one webpack build to others via a global defined namespace, this lets you define which modules you want to share between the webpack builds and allows you to share common modules while maintaining the bundles intact.
https://github.com/MrFrankel/share-loader/blob/master/README.md

A possible workaround my be using __non_webpack_require__  that is is the original require function which exists in the environment before webpack comes in. See https://github.com/webpack/webpack/issues/1021#issuecomment-97440458

I posted a workaround here: https://stackoverflow.com/a/54559637/39013
This solution uses webpack's noParse configuration to make a module that exports the native require function to bundled code.

It looks like there's a few different cases being discussed here, but if you're trying to require an external file and pull it in at build time (e.g. pull it from a CDN and include it in your bundle), I wrote a blog post on how to do that using val loader: https://httptoolkit.tech/blog/bundling-remote-scripts-with-webpack/
In short: you can write a tiny script and load it with val loader to make webpack read the latest content from the CDN on every build and include it in your bundle, so you can treat it like any other normal dependency without having to vendor it into your repo.


Add Intel GKL (Genomics Kernel Lib) support

global sequila param
separate packages MacOs and Linux
documentation

resolved by #102


Adding login functionality

What is it?
This PR adds login functionality to the app! Now, you can login as a user, register as a new user, and log out. You log in with your email and password. This PR also fixes the UI test toast issue (fingers crossed)!
After this PR is merged, I suggest that everybody creates their own user, so you have your own list of habits/events to work with, independent from other members. Following this, all UI tests run on their own test user, so it won't mess up any ongoing work :)
Note: Although the number of files changed may look daunting, about half of the files changed are just updating our queries to use the user's ID instead of the user's username.
Tasks

[x] run unit tests
[x] run UI tests
[x] comments + documentation

Screenshots

Login screen:

Sign up screen:

Related to #63.

Left some questions about the UserVaildator class that I would like answered before I give this my approval

@jaskim9824 Replied to all of your comments!

@rudy-patel I think the replies might have not been saved because I can't see them, or GitHub is acting up for me

@rudy-patel I think the replies might have not been saved because I can't see them, or GitHub is acting up for me

@jaskim9824 Just need to scroll up a bit in the conversation tab. They are not there anymore because the file got updated.

@rudy-patel Weird, because on my end my comments aren't deleted. I have no idea why,


[CI] Test fail on i586

referring to https://github.com/nnstreamer/nntrainer/pull/1123, that test is failing.
I found that i586 wasn't tested beforehand.
verified with commit as old as f41e0bc74761414c3e44fb0d4975bc6191d22b7e . I think it's okay to not test i586 as the number difference is small and it wouldn't affect the behavior of the library.
Leaving this for the record, I am going to disable i586.
[   97s] The output from the failed tests:
[   97s]
[   97s] 17/26 unittest_ccapi                 FAIL           7.05s (exit status 1)
[   97s]
[   97s] --- command ---
[   97s] 11:33:33 /home/abuild/rpmbuild/BUILD/nntrainer-0.1.1/build/test/ccapi/unittest_ccapi --gtest_output=xml:/home/abuild/rpmbuild/BUILD/nntrainer-0.1.1/build/unittest_nntrainer_profiler.xml
[   97s] --- Listing only the last 100 lines from a long log. ---
[   97s] Unit = 10
[   97s] Type = fully_connected
[   97s] input_layers = inputlayer
[   97s]
[   97s] #1/1 [ =                    ] 0% ( Training Loss: 2.42675 )
[   97s] #1/1 [ =======              ] 31% ( Training Loss: 5.60378 )
[   97s] #1/1 [ =============        ] 63% ( Training Loss: 5.27162 )
[   97s] #1/1 - Training Loss: 4.43405 >> [ Accuracy: 8.33333% - Validation Loss : 2.96461 ]
[   97s] ../test/ccapi/unittest_ccapi.cpp:204: Failure
[   97s]       Expected: model->getValidationLoss()
[   97s]       Which is: 2.964613
[   97s] To be equal to: 2.9646113

:octocat: cibot: Thank you for posting issue #1125. The person in charge will reply soon.

Be careful, Tizen-emul for armv7l devices may use i586 binaries; thus we may have app developers relying on i586 binaries.
Does the issue occur in armv7l binaries? Is this relative with 32b-64b C types?

Be careful, Tizen-emul for armv7l devices may use i586 binaries; thus we may have app developers relying on i586 binaries.
Does the issue occur in armv7l binaries? Is this related with 32b-64b C types?

This difference are only occure in tizen-i586. tizen-armv7l does not have this issue.
I am suspecting there are arch specific reason how floating points are calculated inside tizen-i586.
Considering the error propagation, this much error is acceptable, and i586 will be still supported.
fyi) exact one test fails that checks the calculating loss, and the difference is fairly small (2.964613 vs 2.9646113)

For floating points, use EXPECT_NEAR instead of EXPECT_EQ.

We are using EXPECT_FLOAT_EQ, I'll lower the precision for the test :)


Add Job Posting link to frontpage

Is your feature request related to a problem? Please describe.
Leverage HET static pages to advertise SWE job posting.
Describe the solution you'd like
Create a link underneath the site menu that will guide the user to the "Contact" page where a small description and button to the MSM job posting can be found.
Describe alternatives you've considered
N/A
Additional context
See attached images. Recommend we hold on this until at least next week - assuming current candidate is selected to advance this may not be needed.

Apply Now Button leads to: https://careers.msm.edu/postings/11805


Getting erros from git-validate

><EMAIL_ADDRESS>install /Users/imp/code/js.ipfs.io/node_modules/git-validate
> node bin/install

fs.js:119
    throw err;
    ^

Error: ENOENT: no such file or directory, open '/Users/imp/code/js.ipfs.io/.git/hooks/pre-push'
    at Object.openSync (fs.js:443:3)
    at Object.writeFileSync (fs.js:1163:35)
    at Object.exports.installHooks (/Users/imp/code/js.ipfs.io/node_modules/git-validate/lib/utils.js:248:12)
    at Object.<anonymous> (/Users/imp/code/js.ipfs.io/node_modules/git-validate/bin/install.js:3:7)
    at Module._compile (internal/modules/cjs/loader.js:689:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:700:10)
    at Module.load (internal/modules/cjs/loader.js:599:32)
    at tryModuleLoad (internal/modules/cjs/loader.js:538:12)
    at Function.Module._load (internal/modules/cjs/loader.js:530:3)
    at Function.Module.runMain (internal/modules/cjs/loader.js:742:12)

@vmx did you test it in repos without a previous pre-push hook? Started seeing this with the new version.

I can't reproduce the issue. I tried:
npm init --yes
npm install --save-dev aegir

Haven't seen an error.

@vmx did you get to try doing a npm install on the js.ipfs.io repo?

I tried with the js.ipfs.io repo. Builds for me without any errors.

fresh clone, fresh npm install

Just got this from js-libp2p too
><EMAIL_ADDRESS>install /Users/imp/code/js-libp2p/node_modules/git-validate
> node bin/install

fs.js:646
  return binding.open(pathModule._makeLong(path), stringToFlags(flags), mode);
                 ^

Error: ENOENT: no such file or directory, open '/Users/imp/code/js-libp2p/.git/hooks/pre-push'
    at Object.fs.openSync (fs.js:646:18)
    at Object.fs.writeFileSync (fs.js:1299:33)
    at Object.exports.installHooks (/Users/imp/code/js-libp2p/node_modules/git-validate/lib/utils.js:248:12)
    at Object.<anonymous> (/Users/imp/code/js-libp2p/node_modules/git-validate/bin/install.js:3:7)
    at Module._compile (module.js:652:30)
    at Object.Module._extensions..js (module.js:663:10)
    at Module.load (module.js:565:32)
    at tryModuleLoad (module.js:505:12)
    at Function.Module._load (module.js:497:3)
    at Function.Module.runMain (module.js:693:10)

Closing for now. Diagnosis is still unclear.

Yeah, tried reproducing this as well but was unable to. Could you share your nodejs + npm version perhaps?


Add more descriptive unit_of error message

The previous error message was prone to confusion, and although temporary I think it is best to return a more helpful message.
I hope this change will help with https://github.com/sharkdp/numbat/issues/621 and similar issues until https://github.com/sharkdp/numbat/issues/521 is resolved.

Thank you. I had a nice message for this once, but then I needed to change the implementation and put a temporary message in place, forgetting to copy it over.


Compiled x.shape throws Tuple out-of-range error

Issue type
Bug
Have you reproduced the bug with TensorFlow Nightly?
Yes
Source
source
TensorFlow version
tf2.13, 2.15.0-dev20230913
Custom code
Yes
OS platform and distribution
No response
Mobile device
No response
Python version
No response
Bazel version
No response
GCC/compiler version
No response
CUDA/cuDNN version
No response
GPU model and memory
No response
Current behavior?
When a tensor has shape (2,), x.shape returns 2, and throws an error when I try to get x.shape[0]. Without @tf.function(jit_compile=True) it works well.
Standalone code to reproduce the issue
class Model(tf.keras.Model):

  def __init__(self):
    super(Model, self).__init__()

  @tf.function(jit_compile=True)
  def call(self, x1):
    def select_2_or_one(x):
      print(x.shape)
      if int(x.shape[0]) == 2:
        return x
      else:
        return tf.stack([x,x])
    return tf.cond(tf.less(x1[0], x1[1]),
        lambda: select_2_or_one(x1),
        lambda: select_2_or_one(x1[0]))

m = Model()

input_shape = [2,]
x1 = tf.constant([2.,3.], shape=input_shape)

y = m(x1)
print(y)

Relevant log output
if int(x.shape[0]) == 2:

    IndexError: tuple index out of range

Call arguments received by layer 'model_1' (type Model):
  • x1=tf.Tensor(shape=(2,), dtype=float32)

Related: https://github.com/tensorflow/tensorflow/issues/61856

@sachinprasadhs,
I was able to reproduce the issue on tensorflow v2.12, v2.13 and tf-nightly. Kindly find the gist of it here.


Removed EmoteCraft from currently working section

It doesn't work and isn't maintained based on the repository activity

just curious, what error do you get indicating that it doesn't work?
Might be worth creating an issue on their repository for that :)

Already did, the error listed there. Some one else also report it.

Ah, yeah, that error makes sense - there was a package change in the mcpl library, so they need to update the extension. Thanks for making this PR!


Burred dependency into code

hey @ahmad-shoja your commit not include persianDate package and Persian Date Class.


Add support for Kubespray clusters

Add config files and documentation for Kubespray clusters.
The discovery services are almost the same as the kubeadm ones, the only change is the selector's name. Maybe someone jsonnet fluent could factor them?

LGTM. Just one grammar nitpick.
You can also fix that later on, if you want.

/cc @ant31

/lgtm

CI fails, because the "current" version of kube-prometheus configured does not contain the kubespray changes. You just need to run jb update in the contrib/kube-prometheus/ directory and do a separate commit. Sorry for the inconvenience, we're looking into how to solve this better, but this extra step is necessary for the time being.

The jb update has updated all dependencies and Grafana dashboards definitions have changed.
Should I add those changes to my P/R or bump only the kube-prmetheus dependency?

For simplicity on your side, I would say to only bump the kube-prometheus dependency. Otherwise you might need to update and re-generate more things.

lgtm thanks for the addition!


Change usage script

DISTRO=`cat /etc/*-release...`

in debian/ubuntu based distros has no /etc/something-release
https://github.com/bucharest-gold/origin-s2i-nodejs/blob/master/nodejs.org/s2i/bin/usage#L3
https://github.com/openshift/source-to-image/blob/master/docs/builder_image.md#example-usage-script

https://github.com/bucharest-gold/origin-s2i-nodejs/commit/74ed08b42853454812829ba1ed83fae5e4493ac4


Remove too strict parameter validation to allow json and xml params

See Issue https://github.com/naver/ngrinder/issues/565
Encreased length is handled here https://github.com/naver/ngrinder/pull/647
Caution: I don't have vue skills. This is a test to check if the regex is working.

@MahatmaFatalError
We had been fixing this feature and your changes looks not enough to meet our needs.
see #652.
Thanks for your contribution and sorry about closing.


Create a new UI project that uses WPF-style architecture instead of Winform-style

Experience result:

WinUI: Support .NET 5, however, types are the mess, some located in Windows.Foundation, some located in Microsoft.UI, some located in Windows.UI...
UWP: Support many controls that WPF doesn't contain, such as NavigationView. However, UWP apps doesn't support .NET 5.
WPF: Too complex to implement some features.


Cannot buy stamp with space in the label

I cannot buy a stamp if there is space or other special characters (like dash) in the label field, the button becomes disabled. I am not sure where this limitation comes from.
If there is a limitation for label names in Bee then it would be good to display a warning with an explanation of what is an allowed label name. Or alternatively we could only allow those characters in the field which make up valid label names.

Actually this is already the case. Maybe you were running some older version?
See the label regex check https://github.com/ethersphere/bee-dashboard/blob/master/src/pages/stamps/PostageStampCreation.tsx#L115
and the !isValid check on the button https://github.com/ethersphere/bee-dashboard/blob/master/src/pages/stamps/PostageStampCreation.tsx#L150

But I did discover that the form sometimes updates only after you de-focus the input field. I could investigate that.


Use cygwin

is there a way to use terminus as a font-end for cygwin?

nevermind, I found how to open cygwin terminal...


Alpha channel indicates opacity, not transparency

A color is fully transparent when alpha is 0, and fully opaque when alpha is 1. So it's technically incorrect to describe "alpha" as "transparency", "opacity" should be used instead.

Thanks!


[improvement][default_config] enlarge default value compaction related

configs

Because vertical compaction is enabled by default, it consumes less memory, we can enlarge default value of compaction related configs.
Enlarge default value of shard size related to lock.

Proposed changes
Issue Number: close #xxx

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.56 seconds
stream load tsv:          506 seconds loaded<PHONE_NUMBER>9 Bytes, about 140 MB/s
stream load json:         19 seconds loaded<PHONE_NUMBER> Bytes, about 118 MB/s
stream load orc:          65 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select:          34.2 seconds inserted 10000000 Rows, about 292K ops/s
storage size:<PHONE_NUMBER>9 Bytes


unrecognized option '--tcpip'

[X] I have read the FAQ.
[X] I have searched in existing issues.

Environment

OS: Ubuntu 20.04.3
scrcpy version: 1.12.1
installation method: apt

Describe the bug
The tpcip option is not recognized
❯ scrcpy --tcpip
scrcpy: unrecognized option '--tcpip'

It's because the apt install do only provide v1.17  will have to wait for it. As there is no .deb, it could be quite great to get an appimage for this super nice soft.
as the tcpip option : in windows it said target device refuse it.. but no firewall or so present .

I installed the v1.21 through snap https://snapcraft.io/scrcpy


Persist filters, notifications and source bindings state from commands

Description
Changes proposed in this pull request:

Persist filters, notifications and source bindings state from commands

NOTE:

Limitations

Notifications state for MS Teams is not preserved due to the limitation of the MS Teams integration.
Runtime state reload may take a few or more (even 30+) seconds, as stated here. To avoid this issue, we could use ConfigMap informers for Config Watcher.

To do

[x] Documentation: https://github.com/kubeshop/botkube-docs/pull/143
[x] Testing
[ ] Ensure Helm chart values are properly merged across Helm chart upgrades - as a follow-up PR

Testing
export WS_SLACK_BOT_TOKEN=""
export WS_SLACK_APP_TOKEN=""
export DISCORD_TOKEN=""

cat > /tmp/values.yaml << ENDOFFILE
communications:
  'default-group':
    socketSlack:
      enabled: true
      botToken: "${WS_SLACK_BOT_TOKEN}"
      appToken: "${WS_SLACK_APP_TOKEN}"
      token: ""
      channels:
        'default':
          name: botkube-test
          notification:
            disabled: true
          bindings:
            executors:
              - kubectl-read-only
            sources:
              - k8s-events
        'second':
          name: botkube-demo
          bindings:
            executors:
              - kubectl-read-only
            sources:
              - k8s-events

    discord:
      enabled: true
      botID: "976786722706821120"
      token: "${DISCORD_TOKEN}"
      channels:
        'default':
          id: "{id1}"
          notification:
              disabled: true
          bindings:
            executors:
              - kubectl-read-only
            sources:
              - k8s-events
        'test':
          id: "{id2}"
          bindings:
            executors:
              - kubectl-read-only
            sources:
              - k8s-events
        'test2':
          id: "{id3}"
          bindings:
            executors:
              - kubectl-read-only
            sources:
              - k8s-events
      notification:
        type: short

settings:
  clusterName: dev
executors:
  'kubectl-read-only':
    kubectl:
      enabled: true
analytics:
  disable: true
image:
  #registry: docker.io
  #repository: pkosiec/botkube
  #tag: '746-PR'
  repository: kubeshop/pr/botkube
  tag: '746-PR'
  pullPolicy: Always
ENDOFFILE
helm install botkube ./helm/botkube -n botkube --create-namespace  -f /tmp/values.yaml

Get ConfigMaps:
kubectl get cm -n botkube botkube-runtime-config -oyaml
kubectl get cm -n botkube botkube-startup-config -oyaml

Run command on any configured channel:
@BotKube filters disable NodeEventsChecker

Get ConfigMap:
kubectl get cm -n botkube botkube-startup-config -oyaml

Notice that the Pod doesn't restart.
Run command on botkube-test channel on Slack:
@BotKube notifier start

And e.g. on test channel on Discord:
@BotKube notifier stop

See the ConfigMaps again:
kubectl get cm -n botkube botkube-runtime-config -oyaml
kubectl get cm -n botkube botkube-startup-config -oyaml

You can trigger some notifications:
k delete po -n kube-system -l k8s-app=metrics-server

Also, edit the runtime ConfigMap and e.g. change sources for a given channel:
k edit cm -n botkube botkube-runtime-config

Wait until Pod restarts.
Related issue(s)
#704

About to test locally.

In the PR testing section:

@BotKube NextGen filters disable NodeEventsChecker

What does "NextGen" refer to here?
The command: @BotKube filters disable NodeEventsChecker runs fine without it.

@ezodude
I have BotKube NextGen app inside my workspace, and yeah, it's my custom name 😄 So please use @BotKube or whatever name you have for your Slack app 👍 thanks!

Ran the code locally, all works.

Thanks @ezodude for review. I rebased the PR and tested all the communication platforms:

Discord
Slack
Teams
Mattermost

Both Source Bindings + notifications are properly persisted after small changes https://github.com/kubeshop/botkube/pull/746/commits/b8130d2e7b4f9d0881c78c2a690ded7e3ad68d58 👍


When using /restart for anonymous-user config, redirecting to page not found.

In some cases when hitting the URL /restart to force a restart, the proxy in the dashboard instance is redirecting to /user/<username>/undefined.

After some extra additions to validate session and return error message, new error is now from:
            if (req.session.handshakes[state] === undefined) {
                return res.status(400).json('Invalid session');
            }

So maybe shouldn't clear the state from handshakes cache immediately.
That is, in:
            var next_url = req.session.handshakes[state];
            delete req.session.handshakes[state];

Find another way to expire them if necessary.
Possibly also related to code:
        if (Object.keys(req.session.handshakes).length > 10) {
            // If the number of oustanding auth handshakes gets to be
            // too many, something fishy going on so clear them all and
            // start over again.

            req.session.handshakes = {}
        }

Increased number of states allow before clearing. Also redirect back to main page if don't know about session state. This could be an issue if request was against a sub URL, so may still have to change it back to an error.


Feat: DevDocs Revamp

The devdocs are currently in a state where they are functional and have lots of information on the multiple parts of Yearn, but this information is fragmented and sometimes outdated or inaccurate. The organizational structure is haphazard and reflects the piecemeal way that information has been added over the years. By consolidating, updating, and improving on the docs, there is an opportunity to fill a missing piece of Yearn's information ecosystem: The passive sales and marketing domain that is not captured with the dApp and out of scope of the social channels.
This PR is an effort to streamline and simplify the structure of the docs site so that is easy to use for Users, Developers, and DAO members/contributors.

Original Document laying out goals: https://hackmd.io/@rossgalloway/rJgQN_5mR
Slideshow showing progress and rationale for changes: https://docs.google.com/presentation/d/1rruTTqJMmg49LxhyvGHb80QgE4t_nXD_ZINr8yOhlLY/edit?usp=sharing

This PR is not expected to be approved like this as it is going to be hard to review everything. Instead I want to use it as an reference to discuss changes and particular sections and then push individual upgrades and updates to reach this point. There also need to be changes to the content of numerous section of the docs to maximize the impact of these changes and those updated will happen in the aforementioned individual upgrades.

This is the messy reference implementation of changes to be made to the devdocs site.
Changes since the presentation in the cantina:

Added new "yearn" admonition to use as a callout
New Diagrams for V2 and V3 vaults
simplify user docs for vaults, push technical data into dev docs
remove yearn.watch from docs. see: https://github.com/yearn/yearn-devdocs/pull/445/commits/fe0546098f440eedc30954eb16f3540eba0a3d5f
Update site font to use Aeonik to match yearn brand
edit font sizing
remove "Yearn.Finance" title and just use logo
some sidebar updates:

simplify "yearn products section" by adding yPools, moving yBribe to Deprecated and veYFI to dao docs
add deprecated projects to user docs sidebar
give deprecated projects its own sidebar

closing this PR as most changes have been implemented


Fix commits page url

Fixes #2805.

Codecov Report

Merging #2823 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #2823   +/-   ##
=======================================
  Coverage   26.84%   26.84%
=======================================
  Files          89       89
  Lines       17608    17608
=======================================
  Hits         4727     4727
  Misses      12195    12195
  Partials      686      686

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 266ebf8...00ed428. Read the comment docs.

@lafriks Done.

LGTM

LGTM


Fix twitter image URL

I was wondering why img/poster.png was not shown on Twitter for my web page https://wvlet.org/airframe/, generated by sbt-microsites.
twitter:image tag was pointing to the img/poster.png, not (site.url)/(site.baseurl)/img/poster.png
By using the same image path with og:image meta tag, we can fix this image link path.

Nice!  Thanks for your contribution @xerial!

@calvellido Thanks for the new release, but I’ve found twitter:image tag requires absolute URLs
https://twittercommunity.com/t/not-whitelisted-unable-to-render-or-no-image-read-this-first/62736
I’ll create a new PR.


Evaluation script

Hi, thanks for releasing your code and your contribution! Could you please release an evaluation script to test the saved models?

Hi fabriziojpiva,
thank you for your interest in the code. You can use the evaluation script (CLAN_evaluate.py) from this repository (https://github.com/RoyalVane/CLAN). It should work for the saved models.
Best,
Gabriel


File "/usr/local/lib/python3.10/dist-packages/torch/serialization.py", line 1033, in _legacy_load     magic_number = pickle_module.load(f, **pickle_load_args) _pickle.UnpicklingError: invalid load key, '<'.

On colab, I am trying to fine-tune llama on a personal set of prompts starting from the Italian adapter weights stambecco (https://huggingface.co/mchl-labs/stambecco-7b-plus).
To do so, I set --resume_from_checkpoint='./teelinsan/camoscio-7b-llama', after downloading the adapter_config.bin and adapter_model.bin in the related directory:
!cd /content/alpaca-lora/ && python finetune.py \     --base_model='decapoda-research/llama-7b-hf' \     --data_path='/content/drive/MyDrive/Colab Data/data.json' \     --output_dir='/content/drive/MyDrive/Colab Data/model' \     --num_epochs=10 \     --cutoff_len=512 \     --batch_size 128 \     --micro_batch_size 4 \     --num_epochs 10 \     --learning_rate 3e-4 \     --val_set_size 250 \     --lora_r 8 \     --lora_alpha 16 \     --lora_dropout 0.05 \     --lora_target_modules '[q_proj,v_proj]' \     --train_on_inputs \     --group_by_length #\     --resume_from_checkpoint='./mchl-labs/stambecco-7b-plus'
Execution produces the following error:
Loading checkpoint shards: 100% 2/2 [01:08<00:00, 34.29s/it] You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama.LlamaTokenizer'>. If you see this, DO NOT PANIC! This is expected, and simply means that the legacy(previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, setlegacy=False. This should only be set if you understand what it means, and thouroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565 /usr/local/lib/python3.10/dist-packages/peft/utils/other.py:133: FutureWarning: prepare_model_for_int8_training is deprecated and will be removed in a future version. Use prepare_model_for_kbit_training instead.   warnings.warn( Restarting from ./teelinsan/camoscio-7b-llama/adapter_model.bin Traceback (most recent call last):   File "/content/alpaca-lora/finetune.py", line 283, in <module>     fire.Fire(train)   File "/usr/local/lib/python3.10/dist-packages/fire/core.py", line 141, in Fire     component_trace = _Fire(component, args, parsed_flag_args, context, name)   File "/usr/local/lib/python3.10/dist-packages/fire/core.py", line 475, in _Fire     component, remaining_args = _CallAndUpdateTrace(   File "/usr/local/lib/python3.10/dist-packages/fire/core.py", line 691, in _CallAndUpdateTrace     component = fn(*varargs, **kwargs)   File "/content/alpaca-lora/finetune.py", line 206, in train     adapters_weights = torch.load(checkpoint_name)   File "/usr/local/lib/python3.10/dist-packages/torch/serialization.py", line 815, in load     return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)   File "/usr/local/lib/python3.10/dist-packages/torch/serialization.py", line 1033, in _legacy_load     magic_number = pickle_module.load(f, **pickle_load_args) _pickle.UnpicklingError: invalid load key, '<'.
No luck using /teelinsan/camoscio-7b-llama either.
I succeed in training the model without resume option, as well as in generating from the resulting model.
Nevertheless I guess that training on few Italian prompts starting from the base model only (which is not Italian friendly) would not be effective, am I wrong?
Similar error results from generating from the same base model and using the adapter model stambecco as --lora_weights
It is worth saying that no error was produced when I tried the same approach (starting from the adapter model as a checkpoint) using https://github.com/zetavg/LLaMA-LoRA-Tuner

The adapter_model.bin file was damaged due to wrong download.
Now fine-tuning starts as usual after Loading checkpoint shards: 100%


Error when navigating to Networks -> Topology

@Ladas
FATAL -- : Error caught: [PG::UndefinedColumn] ERROR:  column floating_ips.host_id does not exist
LINE 1: SELECT "floating_ips".* FROM "floating_ips" WHERE "floating_...
...
lib/extensions/ar_virtual.rb:384:in `preloaders_for_one'
...
app/services/network_topology_service.rb:39:in `build_topology'
app/controllers/network_topology_controller.rb:34:in `generate_topology'
app/controllers/network_topology_controller.rb:20:in `data'

@miq-bot assign @dclarizio

@mzazrivec please post the whole SQL that is failing, maybe also bigger part of the log
I think this is the OpenStack Infra env, but I don't have any infra env to test it on now

https://bugzilla.redhat.com/show_bug.cgi?id=1343553

@miq-bot assign @andyvesel

@miq-bot assign @andyvesel


Running a command as a specific user and bootstrapping a new server

What is the general approach to bootstrap a server, i.e. setup the deploy user?
I'd like to be able to run init:remote with shipit to setup the server and ssh access, after a create a new DigitalOcean droplet or an AWS EC2 instance.
I initially tried shipit.remote(..., {user: 'root'})
Or do I have to use something like Ansible?

Yes you should, Shipit is designed to run basic commands and deploy code, it's not designed to manage pool of servers.


added different tree generation

I'm not sure if this is a good way to implement different trees. What do you think?

You've got the right idea, but the TreeBlock isn't a good idea. You should just be using the normal Block implementation. For the TreeGenerator instead of it returning an ArrayList<TreeBlock>, have a Chunk instance as a parameter, and have it add the blocks directly to it. There's no need to return them. That way you won't need to use an array. Also since you'll be removing the TreeBlock class, when you create new TreeBlock's and you add them to the array, replace that by just using the BlockManager.getBlock method and set it directly in the Chunk.

Btw what do you think about using gitter for chatting about TerraLegion?

I changed what you said: https://github.com/jmrapp1/TerraLegion/pull/30/commits/42a6a60ab34a775d4fd287d873d401e78adda622

Great!


Can't create a Scroll canvas username to start badges activity

The checking is going forever, even i changed browser, clear cash and tried several nicknames.

Thanks for reporting this. Please ask for assistance in the dev support channel on Discord.


Replicate action is completely useless unless using it for super basic stuff

Package
filament/filament
Package Version
3.2.72
Laravel Version
11
Livewire Version
No response
PHP Version
8.3
Problem description
Just look at the code. It shows forms being filled so you would think you can edit before replicate. But all it does is call eloquent replicate, the form is completely disregarded. And it doesn't do anything but the basic attributes on the record. No relationship data will be used, even if you repeat your entire form because the form does nothing...
https://github.com/filamentphp/filament/blob/3.x/packages/actions/src/Concerns/CanReplicateRecords.php#L52
Expected behavior
To actually replicate resources and not just be a pointless call to replicate on eloquent which you could just do with a normal action.
Steps to reproduce
...
Reproduction repository
https://github.com/filamentphp/filament
Relevant log output
Creating an issue on this repos is a pain and I won't bother in future because wtf.

 Managed to make discord pointless and now issues are as well.


Trait and derive macro for ToFieldElementIter.

It is a common pattern in the circuits used in arecibo for us to take complex types allocated in a constraint system, and decomposing them by hand into a set of AllocatedNums to be absorbed in an RO transcript (or for other purposes in the circuit).
We should add a ToFieldElementIter trait that implements a to_field_iter function with type T -> impl IntoIterator<Item = AllocatedNum<E::Base>>.
Resolving this issue should include a custom derive macro that could derive the implementation of the trait automatically.

Some additional thoughts:

For some type T with corresponding AllocatedT we would need to have a native version of this trait as well, and make sure both implementations are consistent with each other.
The trait should probably only be parametrized by a Field rather than E::Base.
There is a lot of potential for providing default implementations of certain gadgets such as

enforce equal: given two variables which implement this trait, zip both field iterators and create an equality constraint for each pair.
conditional selection: if the type implements Clone, create a copy of the selected value depending on the state of the selection bit, and create a conditional selection constraint for each element of the type out_i = bit * in_L_i + (1-bit) * in_R_i.
enforce default: if the native type supports Default, create one and iterate over these field values using them as constants in the constraints of the type  is_default * (allocated_var_i - default_value_i) = 0

Note that there may be some subtle edge cases that appear due to types containing variable length containers like vec since this trait essentially just returns a flattened iterator.
There is a degenerate case where the field representation of an element may be different than what we want to include in the transcript. For example, an AllocatedPoint has x, y, is_infinity as members, but we would only to include the x, y elements in the transcript. Another example would be a type that contains a hash of itself, in which case we would only add the hash to the transcript. It's not clear if this is a real scenario, but we should be careful.
We may also want to include a len() or size() function for convenience. Making the return type an ExactSizeIterator may make more sense, but it also seems like a derive macro would use std::chain to implement the method, which does not return an ExactSizeIterator. Therefore, we would have to implement size manually.

See #340 where we're hashing this out.


 fixed the conflicting label

Notes for Reviewers
This PR fixes #
#6513
Signed commits

[x] Yes, I signed my commits.

Previous Behavior

Current Behavior

Very cool! 😎 🎈


Support elicit slot and update intent

Support the ElicitSlot directive and updated intents in dialog directives

Related to #168


Enable Deployer Whitelist

Description
Adds checks in the execution manager to only allow deployments if the deployer is whitelisted by, or arbitrary deployment is enabled in, the OVM_DeployerWhitelist.
Metadata
Fixes

Fixes roadmap#254

Contributing Agreement

[x] I have read and understood the Optimism Contributing Guide and Code of Conduct and am following those guidelines in this pull request.

Let's merge this into separate branch and integration test first so things appear working.


When receiving a multi-output transaction, all memos must be displayed

Describe the issue
When a received transaction contains more than one output for the wallet, at present only one of the received memos is displayed, and which is displayed is random.
Can you reliably reproduce the issue?
If so, please list the steps to reproduce below:
Use the zcashd wallet or YWallet to send multiple outputs with different memos to Zashi as a single transaction.
Observe that only one of the received memos is displayed.
Expected behavior
All the memos should be displayed.

waiting for final design

Similar issue #1315


[Bug] Broken SimpleMath+ Node after update

use simplemath as variable, just put the value that you need in a simplemath node and you can use that as variable for other simplemath nodes

Just so I understand correctly, like this ?

same error message

Still doesn't work on my end.

okay today's version of Comfy broke it... should be easy to fix, need to check what changed

Hope it gets fixed soon

should be fixed

Hey! Days ago, I faced the same problem. Now I've found another node that looks like it's working:

I am having this issue no matter what simple math node I use. Including the last one mentioned above. I see that this is closed, but didn't see a final resolution. I've updated comfyui to the latest and it hasn't helped. Is there a solution?

What is the problem again? Everything seems to be working. Please open a new issue with detailed instruction to replicate

Hope it gets fixed soon

I ALSO HAVE A SIMILAR SITUATION. IT STILL CAN'T BE FIXED

I can confirm that Matteo fixed the issue I had 3 weeks ago.
Are you sure you are using the latest version? The new simple math node now has 3 inputs

ComfyUI Manager Menu > "Update all". This solved the problem in my case....


Update Readme.md

Added location for adding files (for users clueless of iOS development as myself)

thanks!


Updated twitchpl, set ListenAndServe to 'localhost'

Updated twitchpl to v0.5.0, by default it doesn't show ads (commercial breaks) anymore.
Set ListenAndServe to localhost for a security reason, its especially important when the node has public IP.

Hi, kappaflow! Oh yeah! I am sorry, forgot to bump twitchpl up to v0.5.0. Will merge soon!

Actually, I've just noticed, that it doesn't work anymore (my pulled version) since Aug, 1. It seems like it requires another dependencies update.

Yes, this repo needs some love and support. Will look at it later

I've fixed temporarily that issue when proxy stopped working.
https://github.com/kappaflow/twitchpl/commit/7b2ea36520c1689f17bf99e37afc503472374f37


knife bootstrap no longer looks for a default key (~/.ssh/id_rsa) with ChefDK 4

In ChefDK 3.11.3 knife bootstrap without specifying -i would use ~/.ssh/id_rsa as the default key. ChefDK 4.x has a regression where it no longer respects this and requires a default key be provided via -i.

ChefDK 3.11.3 resolved as chef-client 14.13.11. As per my analysis, I have tested the vagrant ubuntu 16.04 node on the following scenario:

chef version
cmd
target node ssh config
comments

14.11.13
knife bootstrap node2.test  -x vagrant
without authetication_keys added
ask for password

14.11.13
knife bootstrap node2.test  -x vagrant
with authetication_keys added
successfully bootstrap

15.4.1
knife bootstrap node2.test  -U vagrant
without authetication_keys added
ask for password

15.4.1
knife bootstrap node2.test  -U vagrant
with authetication_keys added
successfully bootstrap

Also I have looked into the code it never set  ~/.ssh/id_rsa in identity_file config option in both chef-14 and chef-15.
Let me know if I am missing something at my end?
Thanks!
vagrant@node1:~$ chef -v
Chef Development Kit Version: 3.11.3
chef-client version: 14.13.11
delivery version: master (9d07501a3b347cc687c902319d23dc32dd5fa621)
berks version: 7.0.8
kitchen version: 1.25.0
inspec version: 3.9.3

@vivek I feel we should check with ChefDk 4.x once.

@Vasu1105  I tried to bootstrap the ubuntu node from ChefDK 4.3.1 as well seems showing expected behaviour as my earlier testing with one know issue,
it won't ask for password due to https://github.com/chef/chef/pull/8856 not yet merge

It seems no response from @mattray, as I am waiting for more info.
@marcparadise could you please help me out how ~/.ssh/id_rsa is associated with the chef-15 bootstrap process as from my side in both chef-14 & 15 does not have any default consideration?
Thanks!

@lamont-granquist & @tas50 could you please suggest something on this issue. As per my analysis  ~/.ssh/id_rsa key associated only if we make an entry in node known_host which working as expected for both chef-14/15

@vsingh-msys there's no direct usage, but net-ssh does default to using id_rsa/dsa if present, but only if we don't pass in any keys.
Did we or train have any earlier issues where we were setting keys in the option list, even if we had none? That would have prevented them from loading, since net-ssh checks to see if the hash key exists in order to exclude default keys - but it does not check  if  the value is  empty/nil.
I could also see this happening if  had turned off the default behavior of allowing net-ssh to use a running ssh-agent . It defaults to true, we would have had to be explicit in turning it off.  We currently do not disable it.
Your tests show that the issue is not currently occurring; I checked in with @mattray as well, and he has not come across this since filing the issue. I recommend closing this one as not reproducible.

Hi @marcparadise,
Thank you so much for your help.

Did we or train have any earlier issues where we were setting keys in the option list, even if we had none? That would have prevented them from loading, since net-ssh checks to see if the hash key exists in order to exclude default keys - but it does not check if the value is empty/nil.

As I can check we are not setting any key in the options list. will look into more into later.
Closing for now as I am not able to replicate expected behavior. Thanks!

@vsingh-msys i think i've seen a related problem happen with my macbook in target mode using train.
i suspect it has something to do with the mac keystore (?) acting as an ssh-agent and therefore bypassing using the files on disk.  if my suspicion is correct, it won't repro on ubuntu or anything like that.  IDK if it is due to something that changed in the macOS or in train.
@mattray a repro with the actual output and error message and the stack trace would be useful since i'm currently forced to speculate two levels deep here.

Using ChefDK version: 4.5.0 I can confirm that this has not been fixed.
$ ssh crushinator
Linux crushinator 4.19.0-6-amd64 #1 SMP Debian 4.19.67-2+deb10u1 (2019-09-20) x86_64
mattray@crushinator:~$ logout
$ knife bootstrap crushinator -N crushinator --policy-group home --policy-name x86
Connecting to crushinator
WARNING: Failed to authenticate  to crushinator - trying password auth
Enter password for @crushinator.
^C
Connection to crushinator closed.
$ knife bootstrap crushinator -i ~/.ssh/id_rsa -N crushinator --policy-group home --policy-name x86
Connecting to crushinator
The authenticity of host 'crushinator (<IP_ADDRESS>)' can't be established.
fingerprint is SHA256:TbRYVVLx5QtZhOYQjErHIetU+bgIeQ5DZ879qhCNXdA.

Are you sure you want to continue connecting
? (Y/N) n
You said no, so I'm done here.

Hey @mattray thanks for the info.

$ ssh crushinator
Linux crushinator 4.19.0-6-amd64 #1 SMP Debian 4.19.67-2+deb10u1 (2019-09-20) x86_64
mattray@crushinator:~$ logout
$ knife bootstrap crushinator -N crushinator --policy-group home --policy-name x86
Connecting to crushinator
WARNING: Failed to authenticate  to crushinator - trying password auth
Enter password for crushinator.

Will check and revert back accordingly and assuming that your workstation is MacOS?
As I tried on from Ubuntu workstation and it's working fine.
RE:

$ knife bootstrap crushinator -i ~/.ssh/id_rsa -N crushinator --policy-group home --policy-name x86
Connecting to crushinator
The authenticity of host 'crushinator (<IP_ADDRESS>)' can't be established.
fingerprint is SHA256:TbRYVVLx5QtZhOYQjErHIetU+bgIeQ5DZ879qhCNXdA.

Are you sure you want to continue connecting
? (Y/N) n
Seems this is expected behaviour as you confirmed you did not want to override fingerprint.

Yes, my workstation is MacOS 10.14.
The fingerprint override bit was extraneous, I was just showing that -i would use the id_rsa key.

Verified on MacOS 10.14 and Debian Linux 10 with Chef Client 15.7.32 that this is still an issue.
knife bootstrap machine -N machine -U mattray
Connecting to machine
WARNING: Failed to authenticate mattray to machine - trying password auth
Enter password for mattray@machine.

I am facing the similar issue.
For more details can go through the Bug #9675

@yogeshlc did you have an ssh-agent process running on linux?

@lamont-granquist Yes ssh-agent is running on the linux.
here is the output:
-bash-4.2$ ps aux | grep ssh-agent
ABC   11892  0.0  0.0  72480   780 ?        Ss   05:36   0:00 /usr/bin/ssh-agent

@mattray @yogeshlc  i have tested on MacOS 10.15.6 using chefdk 4.11.0, 4.5.0 and 3.11.3 with debian 10.6 node and ubuntu node, the bootstrap is being succeeded without password prompt.
For me starting ssh agent and adding private key to SSH agent worked.
can you please go through these steps and let me know if i am missing anything?
Thanks!
These are the steps that i have followed -

Setup SSH key in Mac with ssh-keygen -t rsa -b 4096

Put public key id_rsa.pub from workstation to authorized_key in node

Started the SSH agent with eval "$(ssh-agent -s)"

Added ~/.ssh/id_rsa to SSH agent with ssh-add ~/.ssh/id_rsa

Bootstrapped the node without -i option.

Command - knife bootstrap <IP_ADDRESS> -U 'ubuntu' --sudo -c /Users/administrator/ayush/chef-repo/chef-repo/.chef/knife.rb -N ubuntu1010
output -
Bootstrapping <IP_ADDRESS>
 [<IP_ADDRESS>] -----> Installing Chef Omnibus (stable/15)
 [<IP_ADDRESS>] downloading https://omnitruck.chef.io/chef/install.sh
 [<IP_ADDRESS>]   to file /tmp/install.sh.1811/install.sh
 [<IP_ADDRESS>] trying wget...
 [<IP_ADDRESS>] ubuntu 20.04 x86_64
 [<IP_ADDRESS>] Getting information for chef stable 15 for ubuntu...
 [<IP_ADDRESS>] downloading https://omnitruck.chef.io/stable/chef/metadata?v=15&p=ubuntu&pv=20.04&m=x86_64
 [<IP_ADDRESS>]   to file /tmp/install.sh.1815/metadata.txt
 [<IP_ADDRESS>] trying wget...
 [<IP_ADDRESS>] sha1    c0202b67c12988f1dbad01bb3c4431e5ae14ed1d
sha256  a98043d49bf0f8439a75ea4308f6e9789e8ebb1fc29646756fa005cd2324a2a2
url     https://packages.chef.io/files/stable/chef/15.14.0/ubuntu/20.04/chef_15.14.0-1_amd64.deb
version 15.14.0
 [<IP_ADDRESS>]
 [<IP_ADDRESS>] downloaded metadata file looks valid...
 [<IP_ADDRESS>] downloading https://packages.chef.io/files/stable/chef/15.14.0/ubuntu/20.04/chef_15.14.0-1_amd64.deb
 [<IP_ADDRESS>]   to file /tmp/install.sh.1815/chef_15.14.0-1_amd64.deb
 [<IP_ADDRESS>] trying wget...
 [<IP_ADDRESS>] Comparing checksum with sha256sum...
 [<IP_ADDRESS>] Installing chef 15
 [<IP_ADDRESS>] installing with dpkg...
 [<IP_ADDRESS>] Selecting previously unselected package chef.
 [<IP_ADDRESS>] (Reading database ... 87598 files and directories currently installed.)
 [<IP_ADDRESS>] Preparing to unpack .../chef_15.14.0-1_amd64.deb ...
 [<IP_ADDRESS>] Unpacking chef (15.14.0-1) ...
 [<IP_ADDRESS>] Setting up chef (15.14.0-1) ...
 [<IP_ADDRESS>] Thank you for installing Chef Infra Client! For help getting started visit https://learn.chef.io
 [<IP_ADDRESS>] Starting the first Chef Infra Client Client run...
 [<IP_ADDRESS>] +---------------------------------------------+
✔ 2 product licenses accepted.
+---------------------------------------------+
 [<IP_ADDRESS>] Starting Chef Infra Client, version 15.14.0
 [<IP_ADDRESS>]
 [<IP_ADDRESS>] Creating a new client identity for ubuntu1010 using the validator key.
 [<IP_ADDRESS>]
 [<IP_ADDRESS>] resolving cookbooks for run list: []
 [<IP_ADDRESS>]
 [<IP_ADDRESS>] Synchronizing Cookbooks:
 [<IP_ADDRESS>]
 [<IP_ADDRESS>] Installing Cookbook Gems:
 [<IP_ADDRESS>]
 [<IP_ADDRESS>] Compiling Cookbooks...
 [<IP_ADDRESS>]
 [<IP_ADDRESS>] [2020-10-15T04:33:43+00:00] WARN: Node ubuntu1010 has an empty run list.
 [<IP_ADDRESS>] Converging 0 resources
 [<IP_ADDRESS>]
 [<IP_ADDRESS>]
 [<IP_ADDRESS>]
 [<IP_ADDRESS>] Running handlers:
 [<IP_ADDRESS>]
 [<IP_ADDRESS>] Running handlers complete

 [<IP_ADDRESS>] Chef Infra Client finished, 0/0 resources updated in 01 seconds
 [<IP_ADDRESS>]

my target mode stuff got magically fixed at some point.
@mattray does this work now for bootstrap?

@lamont-granquist yes, it finds ~/.ssh/id_rsa and works now

@mattray Thank you so much, closing the issue now as this is no longer a issue.


Added iko.soy

Missing:

Submit a Pull Request with the location of the webring icon on your site.

The webring's aim is to share hand-crafted websites such as diaries, wikis & portfolios, single pagers with nothing but outgoing links to social platforms will be rejected.

The webring icon is at the bottom of every page


Add global keyboard shortcuts

TBD

Trying to implement hotkeys from scratch does not make much sense. So using an external dependency for this is unavoidable. My requirements for these dependencies include:

Hotkeys should be available globally. Global in the sense that:

Hotkeys can trigger a registered callback if the focused window does not use.
It does not require focus of a window in order to trigger the callback.

Must be non-blocking.

If it provides a non-blocking interface using threads, it must not block the main thread which GUI main loops might need.

Available for Windows and Debian GUI.

The following are Python modules that were considered while searching for an appropriate one.

pynput: This is the module that is selected for creating hotkeys.
keyboard: It is available for Windows and Debian, but the latter requires sudo which I would like to avoid.
PySide2 QKeySequence: This does not provide global hotkeys.


1.0 building a walking skeleton api

Remove extra code from Program.cs file, extra middleware and extra services from service container. Also manage the luanchSettings.json file, remove extra configuration.


NoChatClear

CurseForge link
No response
CurseForge Mod Distribution
Unknown
Modrinth link
https://modrinth.com/mod/nochatclear
Source/other link
https://github.com/shaijana/NoChatClear
Mod file size
16.83KB
License
(any other license)
What it does

Minecraft 1.20.2 has added a configuration phase where the server can reconfigure several features for the client. Unfortunately when entering this configuration phase the clients chat is cleared and the server can not prevent that.

Emphasis mine
Why should it be in the modpack

It brings familiarity by making hub-based servers work the way they used to

Which has use cases like playing with friends across minigames, reporting cheaters etc.

As evident by mod's description, this cannot be fixed by servers themselves
It is ironic that Mojang implemented it this way, considering they even nerfed the serverside message deletion feature added in 1.19.1, in 1.19.3.
It does not work on random servers where it is not needed (like #388 did), it simply makes certain servers work the way they did before
It does not duplicate the chat preservation features that were added in 1.20.something
It's very small

Why shouldn't it be in the modpack

Not on CurseForge
Not tested
There is still an open PR for fixing its mixins
Unlike other simple chat mods, this has a chance of breakage across Minecraft versions, because Mojang keeps tweaking the configuration stage stuff

That said, considering its size it is likely easy to update

Additional details
See also #800

Coming in 1.20.5 (as now available only in snaphots)

Mojang fixed it in 1.20.6 and I don't feel like it is worth backporting at this point.


CODE_OF_CONDUCT.md lacks reporting details

The new code of conduct lacks any reporting guidelines. The ## Enforcement section reads:
Instances of abusive, harassing, or otherwise unacceptable behavior may be
reported to the community leaders responsible for enforcement at
.
All complaints will be reviewed and investigated promptly and fairly.

The sentence telling folks where/how to report Code of Conduct violations in a confidential/private manner is missing.
Having a clear & easy to find reporting mechanism is critical to ensuring that victims of abuse are able to identify the proper channels to seek assistance, even in a time of crisis in the aftermath of an abusive incident.
Both the victim & the accused deserve that initial reports of Code of Conduct violations be made in a private manner, out of respect for the privacy of all parties involved.

It is defined in the readme. I will also add it to the Code of conduct.
Thank you for the input


[Terra] Append terra support

normal apis & staking apis

Client.GetTxsOfAddress()
Client.CurrentBlockNumber() & Client.GetBlockByNumber()
Client.GetValidators & Client.GetDelegations

New Tx Types to support Blockchains with multiple currencies

multi_coin_transfer
multi_coin_any_action

Test will be filed due to validator.list is not found.
I made PR to assets repository here.
https://github.com/trustwallet/assets/pull/968
close #693

Find a way to have a dynamic
https://github.com/trustwallet/blockatlas/blob/992ead10accaf971f0af398f559130dd661587d8/platform/terra/stake.go#L42-L47
This comment was generated by todo based on a TODO comment in 992ead1 in #695. cc @YunSuk-Yeo.

Works done

you can split in more them one PR
add transactions methods, and the block, and stake after

ok


Feature/etm keyedvectors embeddings input file

Resolves #32, #37.
Adds support for original-formatted word2vec and gensim.models.KeyedVectors-formatted embeddings files for ETM model training.
Updates some details on the CONTRIBUTING section of the documentation.

Thank you for your work! :) I just added a few comments to address before merging

Thanks for the feedback, @silviatti! I've added docstrings for the changed methods, at your request.

Hi @silviatti . Updated the PR with a commit adding support for headerless original word2vec embeddings file in textual format. This feature provides support for the Dieng's pretrained embeddings found here, as requested by cayaluke's comment on #32. Previously, my PR supported only regular files including the header.


Cover Art Credit

On individual issues, add a field for cover artist, and display the field on the individual issue page.

Template file updated. Must add Cover Artist ( cover_artist ) ACF field to issue. Using conditional in template so won't break if no value set.

Closing this out. New field in backend sidebar that will show author name if added