Maximum concurrent request for tensorflow serving client?

175
December 08, 2017, at 2:03 PM

Im using tensorflow serving for making predictions from Java application to the tensorflow server, wanted to know what is the maximum number of concurrent request tensorflow server can handle ?

Also, if we can improve the concurrency by having more number of threads doing the prediction on the client...is the prediction done sequentially or parallel threads in the server do prediction, also is it customizable?

Thanks a lot!

READ ALSO
Expression-Based Access Control alternatives?

Expression-Based Access Control alternatives?

Are there any alternatives to Expression-Based Access Control ? And is it still used nowadays? Also, could Angular replace apache tiles?

192
Get HTML code from dynamic page

Get HTML code from dynamic page

I am trying to get the HTML code of the following websitehttp://fortune

214
Getting incorrect sort order

Getting incorrect sort order

Failing test case:

252
Commas causing issue in $ value String to Float conversion

Commas causing issue in $ value String to Float conversion

I'm trying to convert dollar amounts from a text file to a stored numeric type (therefore 'String' to float,BigDecimal,etc)

203