[grpc-io] Re: Benchmark data for gRPC + xDS. vs envoy

Hi, The gRPC team did a one-time perf benchmarking to get some general idea. A comprehensive and continuous benchmarking plan is on the roadmap. In the ad hoc test, we tested gRPC 1.30 C++ xDS stack against Enovy that was compiled with -c opt and -fno-omit-frame-pointer from the 1.14.1 tag.

[grpc-io] Re: Slides for xDS + gRPC talk

Hi, I am able to access the slides here: https://static.sched.com/hosted_files/kccnceu2021/2a/Service%20Mesh%20with%20gRPC%20and%20xDS.pdf Not sure why this link doesn't work for you. On Thursday, August 12, 2021 at 11:10:04 AM UTC-7 Gaurav Poothia wrote: > Hi, > I was trying to follow the

[grpc-io] Re: gRPC load balancing

Hi, When you say a request from a client is sent to all servers at once, what is your expected behavior with the responses? If only the first response is accepted and others are discarded, then this similar to hedging functionality. Hedging is available in gRPC in Java

[grpc-io] Re: Missing protocol buffers submodule commit

Must be a temporary issue. I see both commits fine. On Wednesday, July 28, 2021 at 9:04:54 AM UTC-7 mark...@gmail.com wrote: > The heap of the grpc repository is pointing at a missing protocol buffers > commit: > > >

[grpc-io] Re: grpc proxyless using istio

Hi, AFAIK, Istio doesn't yet support gRPC clients. I believe they have it on the roadmap but please confirm with the Istio community. On Sunday, July 25, 2021 at 2:11:49 AM UTC-7 tiz...@gmail.com wrote: > Hi > I'm looking for examples of using istio as an xds server. I want my grpc > client to

[grpc-io] Re: Connection management and load balancing

Hi Vitaly, Please see this post if you are planning to use gRPCLB. gRPC has moved away from gRPCLB protocol. Instead, gRPC is adopting xDS protocol. A number of xDS features

[grpc-io] Re: Connection management and load balancing

Hi, Option 3 is ideal but since you don't have that as well as option 4 available, option 2 is worth exploring. Are the concerns with options 2 based on some experiments you have done or is it just a hunch? This comment has

[grpc-io] Re: Minimum gRPC stack requirement to support gNMI proto 070

Hi, A quick look at gNMI seems to indicate it needs streaming and reflection in gRPC. 1.0.0 should be fine. That said, why not upgrade to the latest version v1.33.0 which is backward compatible with 1.0.0 and get all the bug fixes and enhancements done since 1.0.0 release? FYI, gRPC project

[grpc-io] Re: Is there have "Resolver" and "Balancer" interface in Python ?

Unfortunately, no. This is a long pending item that is resource starved. See https://github.com/grpc/grpc/pull/16617 and https://github.com/grpc/grpc/issues/11685. On Sunday, November 8, 2020 at 7:53:25 PM UTC-8 stef...@gmail.com wrote: > Hello guys. > > I found "Resolver" and "Balancer" in

[grpc-io] Re: Load balancing while using gRPC

You can specify client side round robin load balancing like this: opts = [("grpc.lb_policy_name", "round_robin",)] channel = grpc.insecure_channel(':' , opts) If your target address resolves to multiple addresses then requests are load balanced in a round robin fashion. Other than

[grpc-io] Re: "Could not contact DNS servers" even setting GRPC_DNS_RESOLVER=native

DNS is the default name resolver in gRPC. gRPC C++ uses C-Ares as default library to resolve DNS unless you set GRPC_DNS_RESOLVER=native. Check that you have valid nameserver in /etc/resolv.conf. It is strange that GRPC_DNS_RESOLVER=native did not help which should just use the system

[grpc-io] Re: At times new channel get stuck in resolver

Have you tried newer versions of gRPC to reproduce this issue? 1.14 is fairly old. On Monday, April 20, 2020 at 11:45:23 AM UTC-7 grpc_user wrote: > Hi! > > We are running grpc version 1.14 and we hit a strange condition (at times, > not easily reproducible). When attempting to create a new

Re: [grpc-io] gRPC for large data transfer

FWIW, gRPC can support msg size up to 4GB (minus a few bytes) but you may be limited to 2GB or less due to protobuf library limitations. For example, python protobuf plugin default is 64MB which can be increased. See https://github.com/grpc/grpc/issues/19221. On Tuesday, April 21, 2020 at

[grpc-io] Re: create channel credential from access token only (python)

I believe credentials can be added to an insecure channel only if the channel is local (e.g. UDS). See more details here: https://github.com/grpc/grpc/pull/20875 On Tuesday, April 21, 2020 at 2:35:29 PM UTC-7 davidk...@gmail.com wrote: > I am creating a channel as follows: >

[grpc-io] Re: Intermediate Certificates not sending

Have you tried another gRPC language with same certs/keys to isolate this issue to gRPC-Go implementation? You can find examples in other languages here. https://grpc.io/docs/guides/auth/ On Wednesday, April 22, 2020 at 8:13:54 AM UTC-7 edward...@lacity.org wrote: > -- Golang app server TLS

[grpc-io] Re: TLS chain of trust and Golang

For chain of trust to work, you must ensure that the server is presenting the right cert to the client and the client has Comodo root cert in its trust store. Ensure that you are using the right cert file in the client dial "creds, _ := credentials.NewClientTLSFromFile(certFile, "")". This

Re: [grpc-io] Optimizing gRPC for localhost

Currently there is no plan to do this and I don't think it has a lot of value. One option is to write your own interceptors on both sides to bypass HTTP/2 stack. You'll have to handle deadlines, flow control, multiplexing etc. on your own. Essentially, you'll be implementing your own transport

Re: [grpc-io] Report vulnerability

Hi, Thanks for reaching out. Please follow the CVE process here: https://github.com/grpc/proposal/blob/master/P4-grpc-cve-process.md. Thanks. On Wed, Aug 21, 2019 at 3:19 AM wrote: > Hi, > > Our team has recently discovered a Null Pointer Dereference security > vulnerability in gRPC. > > How

[grpc-io] Re: is it possible to use grpc's loadbalancing framework for active/passive?

You can look into enabling keepalive on the channel that will detect failure of underlying TCP connections and attempt to reconnect. If you have multiple TCP connections, gRPC will pick the first available connection by default and switch to another one when that one fails. On Monday, August

Re: [grpc-io] connect grpc with rest API

Check out Cloud Endpoints or grpc-gateway . On Sat, Jul 27, 2019 at 3:23 AM abdelrahman hamdy < hamdyabdelrahman...@gmail.com> wrote: > how to connect grpc with rest API? > > -- > You

Re: [grpc-io] Re: Pushback in unidirectional streaming RPC's

Enabling flowctl debug tracing might show some useful log when, say, client is not at all consuming while server keeps generating. https://github.com/grpc/grpc/blob/master/doc/environment_variables.md On Fri, Jul 19, 2019 at 1:03 PM Yonatan Zunger wrote: > I have no idea what would be

Re: [grpc-io] Re: Can the gRPC be used by the client to transmit only unidirect messages to Server.

I am not clear abt the requirements here but setting the deadline to now() won't work. Server will see the deadline has passed and not process the request at all. On Wed, May 29, 2019 at 2:58 PM 'Juanli Shen' via grpc.io < grpc-io@googlegroups.com> wrote: > Sorry, what do you mean by "undirect"

[grpc-io] Re: server side streaming

Your understanding is correct. You may want to consider using streaming instead of repeated field if the aggregate response size is very large which can cause out-of-memory or flow control issues in your application. Using unary for large repeated response has no big benefits over streaming.

Re: [grpc-io] Re: Evolution of gRPCLB

; team is going propose - gRPC services can make use of it for load balancing > (optionally control planes can also implement and configure > LoadReportService, which would be used for more intelligent load > balancing?) Is that right? > Thanks, > Rama > > On Sat, Mar 2, 20

[grpc-io] Re: Evolution of gRPCLB

On Friday, March 1, 2019 at 10:18:28 AM UTC-8, blazej...@gmail.com wrote: > > > Do you work on both sides of xDS protocol, or only on the client-side > implementation? > gRPC team does not work on the LB server side of xDS. The goal here is to be able to use existing and future xDS compatible

[grpc-io] Re: Future of GRPC-LB

Details are posted now. On Wednesday, February 27, 2019 at 9:58:18 PM UTC-8, Srini Polavarapu wrote: > > Please expect a post on this soon. It will have the details you are > looking for but a detailed gRFC will come later. We

[grpc-io] Evolution of gRPCLB

If you are using gRPCLB , please read on: gRPC team is working on evolving the current gRPCLB functionality. We will be moving away from our custom load balancing protocol and adopting xDS

[grpc-io] Re: Future of GRPC-LB

Please expect a post on this soon. It will have the details you are looking for but a detailed gRFC will come later. We can continue discussion on that post. Thanks. On Monday, February 25, 2019 at 12:39:27 PM UTC-8, blazej...@gmail.com wrote: > > The thing is, that we have implemented a

[grpc-io] gRPC-Core Release 1.19.0

This is the 1.19.0 (gold) release announcement for gRPC-Core and the wrapped languages C++, C#, Objective-C, Python, PHP and Ruby. Latest release notes are here . This release contains refinements, improvements, and bug fixes, with highlights

[grpc-io] Re: SEGFAULT in greeter_client

Bump the priority of the Github issue to P1. Let's track it over there. On Wednesday, February 13, 2019 at 8:36:09 PM UTC-8, Gautham B A wrote: > > I had filed it long back - https://github.com/grpc/grpc/issues/17807 . > > On Thursday, 14 February 2019 00:06:05 UTC+5:30, Carl Mastrangelo wrote:

Re: [grpc-io] PHP and Python client fails SSL connection

You are very likely running into this issue . This fix will be available in gRPC release 1.19.0. You can try nightly pkgs from https://packages.grpc.io/ or wait for 1.19 RC coming out early next week. On Wednesday, February 6, 2019 at 10:52:41 AM

[grpc-io] Re: Load balancing while using gRPC

Since you want to use an in-line load balancer, take a look at NGINX proxy that supports gRPC. In such a topology, the DNS points to your LB IP which gRPC clients connects to. LB will then load balance to backends. gRPC client is not aware of how

[grpc-io] Re: CERTIFICATE_VERIFY_FAILED in OpenSuse leap 15.0

The root CA cert is bundled with gRPC that is used by Speech library. To point to your own root CA cert, you can try setting the env variable "GRPC_DEFAULT_SSL_ROOTS_FILE_PATH=/your/path/to/CAcert" On Monday, January 28, 2019 at 3:25:23 AM UTC-8, rohan@matrixcomsec.com wrote: > > Hi all, >

[grpc-io] Re: gRPC Python DNS Resolution

>From your description it looks like you are destroying all the old servers and bringing up a completely new set of servers with new IPs. The gRPC client is still seeing old IPs in the cached DNS, none of which are available. It will try to connect to these unavailable IPs until the deadline

[grpc-io] Re: Calling gRPC Client from an External Django Application

Are you able to use the examples shown here to write an independent gRPC server? On Tuesday, January 15, 2019 at 8:58:46 AM UTC-8, asadh...@gmail.com wrote: > > I am following the post with link: > >

[grpc-io] Re: Unable to connect to remote grpc server using InsecureChannelCredentials from local client

You may need to enable HTTP/2 in the NGINX config. gRPC uses HTTP/2. The proxy may be downgrading to HTTP/1.1 which a gRPC server doesn't support. On Wednesday, December 26, 2018 at 5:38:11 PM UTC-8, Gopalakrishna Hegde wrote: > > I tried that with no success. I experimented a bit and noticed

Re: [grpc-io] How to solve the problem reported by Mergeable when open a PR to GRPC

You can ignore this error. Once the PR is accepted, a maintainer will apply appropriate labels to pass this check. The labels mentioned here are need to figure out if the PR needs to be noted in release notes. On Sun, Dec 23, 2018 at 11:30 PM Tao Tse wrote: > Mergeable has found the following

[grpc-io] Re: GRPC with istio for public clients and internal applications

gRPC clients have only round-robin and pick-first built-in LB policies available to them. You are probably better off using Istio ingress LB to share LB policy unless you want to run your own gRPCLB service and implement your LB policy in there. On Wednesday, November 14, 2018 at 8:35:36 PM

Re: [grpc-io] Re: Does gRPC use only http2? tcpdump from a particular client does not show it as http2

> > > What does grpc rely on to for http2 capability? (any tool in os > environment or http2 capability is inbuilt in grpc?) > gRPC Python has a built-in HTTP/2 stack. On Thursday, November 29, 2018 at 10:13:27 AM UTC-8, Josh Humphries wrote: > > The main gRPC libraries *only* use HTTP/2. As

Re: [grpc-io] How to set source ip address in grpc client application

Specifying a source address is not supported in gRPC-Core on which Python is wrapped. Please file an issue on github and give details on your use case. I see that a similar issue for C++ was created recently.

Re: [grpc-io] Re: python quick start "hello world" example fails

Your connection issue is due to proxy configuration on your machine. As you can see gRPC is connecting to a proxy for localhost. http_connect_handshaker.cc:300] Connecting to server localhost:50051 via HTTP proxy ipv4:10.19.8.225:912 Try setting http_proxy= or try no_proxy=localhost. On

Re: [grpc-io] bidirectional communication on the same socket?

I think the OP is asking if server can start a request to client after client (behind a firewall) has established a gRPC connection to the server. The answer is no. See discussion here https://github.com/grpc/grpc/issues/14101. It is possible in gRPC-Go in a convoluted way. See

[grpc-io] Re: grpc multithreading

Replied on the other thread you opened. On Wednesday, October 24, 2018 at 10:06:15 PM UTC-7, rob.vai...@gmail.com wrote: > > Hi, > > How to write the program of grpc multithreading in python? please share > some references with me. > Thank you > -- You received this message because you are

Re: [grpc-io] Re: python support multi-thread

On the server you can provide a threadpool like this: server = grpc.server(futures.ThreadPoolExecutor(max_workers=10)) This will spawn a maximum of 10 concurrent threads to handle requests in parallel. See this example:

[grpc-io] Re: fork() support in Python!

Hi Yonatan, Your understanding is correct. The design takes care of not affecting RPCs in parent process due to FD shutdown in the child's post-fork handlers. Child process will recreate its own connection when a Python object (with a gRPC stub inside) inherited from the parent needs to be

[grpc-io] Re: How to change DSCP value of gRPC packets

Hi, There is no API in gRPC Python to set DSCP value. Please open an issue to track this although this would be low priority for us. Thanks. On Monday, October 15, 2018 at 1:52:25 PM UTC-7, sara...@arista.com wrote: > > Hello, > > I am writing a

[grpc-io] Re: Python channel option documentation. (or at least example)

Hi, Thanks for bringing this up. This is definitely an area where we need improvement. Our first order of priority is to update the reference guide with latest release and clean up beta APIs. We need to fix some broken scripts on our end. This is the tracking

[grpc-io] Re: Is there a way to tell if Write failed because the msg is too big

After the write fails, you have to call Finish() to get the status. See example here: https://grpc.io/docs/tutorials/async/helloasync-cpp.html On Wednesday, September 26, 2018 at 12:17:05 PM UTC-7, dataman wrote: > > > Thanks for the response! I am using the async Write. There is no status >

[grpc-io] Re: [gRPC-python] Any examples of using "fork" method of parallelism in gRPC-Python

The fork support added in 1.15.0 in gRPC-Python is only for the client side. This means, on a gRPC-Python client, it is now possible to fork the process while an RPC is in progress. Typically mulitprocessing module is used to distribute your work to child processes and get the result back. For

Re: [grpc-io] Re: Are there any good example of grpc in the browser?

Greg, a gRPC-web tutorial is in the works here https://github.com/grpc/grpc.github.io/pull/737. If you are interested please give your feedback in the PR. On Thursday, September 20, 2018 at 1:53:06 PM UTC-7, Spencer Fang wrote: > > Yes envoy proxy is an example of a supported proxy. gRPC on

[grpc-io] gRPC-Core Release 1.15.0

This is 1.15.0(glider ) release announcement for gRPC-Core and the wrapped languages C++, C#, Objective-C, Python, PHP and Ruby. Latest release notes are here . Core -

Re: [grpc-io] gRFC A16 Option for setting socket option TCP_USER_TIMEOUT

In my opinion, gRPC should not set an artificial limit on min value of TCP_USER_TIMEOUT. It is a well know option available in Linux for a long time. It should be a pass-thru value for gRPC as it does not modify the kernel behavior w.r.t this setting. There are applications (e.g. in graphics

[grpc-io] Re: Support additional different platforms

Added an assignee to the PR. This is low priority so please bear with the delay. On Thursday, August 9, 2018 at 12:27:20 AM UTC-7, Jasper Siepkes wrote: > > Hi all! > > There is a PR for adding Solaris support in gRPC ( > https://github.com/grpc/grpc/pull/15926 ). Is there a chance for such >

[grpc-io] Re: Fatal: grpc_call_start_batch returned 8

There is some flakiness in bazel tests. Please file an issue on github and provide the steps in detail to reproduce this. Thanks. On Friday, August 17, 2018 at 3:16:13 PM UTC-7, Abhishek Parmar wrote: > > I have a weird problem with one of my unit tests that is using streaming > grpc. The

[grpc-io] Re: gRPC java multiple bi-directional streams share same channel is faster than 1 channel per streaming

Could you provide some stats on your observation and how you are measuring this? Two streams sharing a connection vs. separate connections could be faster due to these reasons: - One less socket to service: less system calls, context switching, cache misses etc. - Better batching of data from

[grpc-io] Re: Establishing multiple grpc subchannels for a single resolved host

It looks like python does not have the API to set wait_for_ready :-( On Friday, August 17, 2018 at 5:17:43 PM UTC-7, Srini Polavarapu wrote: > > Hi Alysha, > > How did you confirm that client is going into backoff and it is indeed > receiving a RST when nginx goes away? Have you looked at the

[grpc-io] Re: Establishing multiple grpc subchannels for a single resolved host

Hi Alysha, How did you confirm that client is going into backoff and it is indeed receiving a RST when nginx goes away? Have you looked at the logs gRPC generates when this happens? One possibility is that nginx doesn't send RST and client doesn't know that the connection is broken until TCP

Re: [grpc-io] Re: SSL/TLS handshake NPN vs ALPN

The fix is made in gRPC Core which gRPC-Python wraps. If you are building from src from an older version then yes, you will have to patch the file. If you are doing pip install, you could either wait for next release or try nightly builds from https://packages.grpc.io/ On Thursday, August 9,

Re: [grpc-io] Why does not grpc use a lot of cpu?

If your workload is CPU intensive then you should pre-fork your subprocesses and have each one start their own gRPC server. gRPC-Python does not support forking after the server is created. If your workload is not CPU intensive (i.e., subprocesses/threads block on I/O frequently) then using

Re: [grpc-io] Re: grpc streaming large file

You could set request parameters as metadata for the file upload RPC. Server receives metadata before the streaming data is received. On Wednesday, April 11, 2018 at 10:58:20 AM UTC-7, rSam wrote: > > I recently had to implement a similar solution to send files. I considered > these options: >

[grpc-io] Re: grpc python streaming response order

If your goal is to notify an invalid argument why not use context.set_code(grpc.StatusCode.INVALID_ARGUMENT) instead of abort. On Friday, March 23, 2018 at 4:48:33 AM UTC-7, rvsh...@gmail.com wrote: > > I was trying out python server streaming, and it is unclear to me if there > is a guarantee

[grpc-io] Re: gRPC calls from a Web App (in browser)?

Yes. See this https://github.com/grpc/grpc-web On Saturday, March 24, 2018 at 11:20:08 AM UTC-7, amer...@gmail.com wrote: > > Hi. > > Is there any way to call a gRPC back-end service from a web browser > application (say using Dart or JavaScript)? > > Thanks. > -- You received this message

[grpc-io] Re: Handshake in TLS

Please specify the language you are using and whether it is flex or standard AppEngine. On Monday, March 12, 2018 at 10:21:03 AM UTC-7, Baojun Xu wrote: > > Hi, > > We are calling our grpc endpoint with TLS from app engine. I am wondering > how often does a TLS handshake happen in case we are

[grpc-io] Re: C fork() server->embedded Python->gRPC-python deadlock on method call

Looks similar to https://github.com/grpc/grpc/issues/14258 . Have you tried setting GRPC_ENABLE_FORK_SUPPORT=FALSE as described in https://github.com/grpc/grpc/issues/14056 ? On Monday, February 12, 2018 at 10:50:05 PM UTC-8, ascani...@gmail.com wrote: > > > (gdb) py-bt > #4 Waiting for a

[grpc-io] Re: gRFC L22: Change name of directory `include/grpc++` to `include/grpcxx`

Is the reason for choosing grpcxx (vs grpc_cpp or grpc_plusplus) is so that it is inline with #ifndef GRPCXX_AAA_BBB_H usage in header files? On Thursday, January 25, 2018 at 4:44:05 PM UTC-8, Muxi Yan wrote: > > grpc.io members, > > Please review gRFC proposal L22 >