rest_simple.ipynb tutorial is broken

This issue has been created since 2022-06-13.

Bug Report

If this is a bug report, please fill out the following form in full:

Running this tutorial in Google colab fails due to some GLIBC errors.

System information

  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
  • TensorFlow Serving installed from (source or binary):
  • TensorFlow Serving version:

Platform: Google colab
The notebook was ran exactly as it is (no changes made).

Describe the problem

Describe the problem clearly here. Be sure to convey here why it's a bug in
TensorFlow Serving.

I would not say this is a TF Serving bug per se but a bug in the tutorial.

Server fails to spin up. server.log has this info:

tensorflow_model_server: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.28' not found (required by tensorflow_model_server)
tensorflow_model_server: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.26' not found (required by tensorflow_model_server)
tensorflow_model_server: /lib/x86_64-linux-gnu/libm.so.6: version `GLIBC_2.29' not found (required by tensorflow_model_server)

Exact Steps to Reproduce

Please include all steps necessary for someone to reproduce this issue on their
own machine. If not, skip this section.

Just running the tutorial in google colab.

Source code / logs

Include any logs or source code that would be helpful to diagnose the problem.
If including tracebacks, please include the full traceback. Large logs and files
should be attached. Try to provide a reproducible test case that is the bare
minimum necessary to generate the problem.

Tayge wrote this answer on 2022-06-17

Hello! Just install this version of tensorflow-model-server and everything will work.

!wget 'http://storage.googleapis.com/tensorflow-serving-apt/pool/tensorflow-model-server-universal-2.8.0/t/tensorflow-model-server-universal/tensorflow-model-server-universal_2.8.0_all.deb'
!dpkg -i tensorflow-model-server-universal_2.8.0_all.deb

As far as I understand, versions of tensorflow-model-server 2.8.2 and 2.9.0 require newer ones GLIBC.

andres-zartab wrote this answer on 2022-06-17

I can confirm this works. Thanks @Tayge! :)

pindinagesh wrote this answer on 2022-06-20

Hi @andres-zartab

Could you please move this issue to closed status if it works. Thanks!

andres-zartab wrote this answer on 2022-06-20

The workaround worked but the tutorial is still broken for anyone opening it for the first time. Should I close in this case?

Forpee wrote this answer on 2022-07-21

The tutorial is also broken for me but not for GLIBC errors.

The notebook was run exactly as it is (no changes made).

And I get this error

`---------------------------------------------------------------------------
ConnectionRefusedError Traceback (most recent call last)
/usr/local/lib/python3.7/dist-packages/urllib3/connection.py in _new_conn(self)
158 conn = connection.create_connection(
--> 159 (self._dns_host, self.port), self.timeout, **extra_kw)
160

19 frames
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

NewConnectionError Traceback (most recent call last)
NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fa196602550>: Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

MaxRetryError Traceback (most recent call last)
MaxRetryError: HTTPConnectionPool(host='localhost', port=8501): Max retries exceeded with url: /v1/models/fashion_model:predict (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa196602550>: Failed to establish a new connection: [Errno 111] Connection refused'))

During handling of the above exception, another exception occurred:

ConnectionError Traceback (most recent call last)
/usr/local/lib/python3.7/dist-packages/requests/adapters.py in send(self, request, stream, timeout, verify, cert, proxies)
514 raise SSLError(e, request=request)
515
--> 516 raise ConnectionError(e, request=request)
517
518 except ClosedPoolError as e:

ConnectionError: HTTPConnectionPool(host='localhost', port=8501): Max retries exceeded with url: /v1/models/fashion_model:predict (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa196602550>: Failed to establish a new connection: [Errno 111] Connection refused'))`

gaikwadrahul8 wrote this answer on 2022-11-09

@Forpee, @andres-zartab

It seems like duplicate issue like #2054 and As workaround please comment this line : !{SUDO_IF_NEEDED} apt-get install tensorflow-model-server line and add below 03 lines of command to install Tensorflow serving 2.8.0 in section : Install TensorFlow Serving

!wget` 'http://storage.googleapis.com/tensorflow-serving-apt/pool/tensorflow-model-server-2.8.0/t/tensorflow-model-server/tensorflow-model-server_2.8.0_all.deb'
!dpkg -i tensorflow-model-server_2.8.0_all.deb
!pip3 install `tensorflow-serving-api==2.8.0

Sharing the working gist file for reference. Can you please close this issue, since it is already being tracked on #2054.

Thank you!

More Details About Repo
Owner Name tensorflow
Repo Name serving
Full Name tensorflow/serving
Language C++
Created Date 2016-01-26
Updated Date 2022-12-05
Star Count 5711
Watcher Count 238
Fork Count 2173
Issue Count 152

YOU MAY BE INTERESTED

Issue Title Created Date Comment Count Updated Date
CTRL C - delete resource is stuck 2 2022-08-07 2022-12-06
Audio Classification Task Page 0 2022-10-13 2022-11-16
Two questions about the paper 3 2021-01-27 2022-11-14
老哥我是通过docker安装的发现这个错误 11 2021-04-01 2022-11-29
Unraid使用docker部署访问页面显示message:unauthorized 14 2021-04-08 2022-12-03
Outgoing SSL connection hangs, cannot be dropped and re-established 2 2020-09-10 2022-11-19
Module random won't generate the same pseudo-random sequence of numbers after setting seed to the same value. 0 2021-01-18 2022-10-18
Cannot find device under chrome://inspect 0 2021-07-07 2022-11-14
Use console warn instead of error for duplicate node names 1 2022-08-27 2022-09-14
Dollar value not showing for rewards on Boba ETH. 0 2022-10-24 2022-11-29
Firefox ESR 102: needs rule for DBus names `org.mozilla.firefox_esr.*` 3 2022-09-25 2022-11-26
依赖FileDownloader,打包成aar,依赖aar时却找不到相关文件 2 2020-09-02 2022-11-04
Can't add both server and client library. 4 2021-04-09 2022-11-18
Unable to fully maximize app windows 5 2021-09-25 2022-11-11
Setting the delimiter parameter for Get-S3ObjectV2 should return a collection of objects 3 2021-10-15 2022-11-28
TNBGem- All about banks- 2 1 2021-10-09 2022-07-29
Saved question funnel charts shouldn't display a redundant legend with the name of the question 0 2021-12-03 2022-09-25
Remove graphics sources on iPlug2_Core cmake library 0 2022-11-15 2022-12-05
Pihole stats not displaying through a proxy URL 13 2022-06-27 2022-11-27
I often get a browser duplication error when running 10 2021-07-30 2022-09-26
jwt token 如何使用rsa256 生成 1 2022-11-15 2022-11-19
SysBaseApiImpl中使用了过时的方法 1 2022-11-15 2022-11-19
org.jeecg.common.api.CommonAPI 错误 6 2022-11-16 2022-12-01
RFC: How to handle email updates 4 2021-02-15 2022-11-03
Planning ticket task 0 2021-09-16 2022-11-16
Edit then optionally sort 1 2021-02-16 2022-12-06
Question : Download map at startup 2 2022-08-07 2022-11-20
FlippingCard not working. 2 2021-05-14 2022-11-25
Slower performance than tf 6 2022-07-11 2022-11-30
OpenMP offload built-in profiler doesn't produce data for multiple threads 3 2022-09-26 2022-09-30
Webrtc seems completely broken 0 2022-01-31 2022-11-27
High CPU usage with compressed audio 8 2021-11-05 2022-11-13
Unable to get threejs camera worldMatrix for realtime light 0 2022-11-04 2022-11-30
Layered: ConsiderModelOrder should handle backward edges correctly 1 2021-10-07 2022-12-04
0008-listGen-test-01 2 2021-07-06 2022-12-01
hex2b64 returning null - Step 3 Accept terms not working. 3 2019-04-30 2022-11-11
Expected instance not static method org.scalatest.Assertions in DataFrame and DataSet SuitBase 1 2021-10-11 2022-10-31
Initial deploy fails - GitHub Actions w/ Angular 14 - fatal: unable to connect to github.com: 1 2022-10-27 2022-11-28
I can't import gRPC generated files (_pb2.py and _pb2_grpc.py) in one Azure Queue storage trigger function (Python) 1 2022-01-04 2022-10-02
Question related to model compilation 2 2021-10-06 2022-12-06
Parser: Best way to implement reusable Custom Field Types? 1 2021-10-07 2022-10-22
com.github.jkcclemens:khttp not resolved from some regions 1 2021-08-28 2022-11-28
Docker wodle on Debian Bullseye agent 1 2021-09-22 2022-11-28
[TRACKING ISSUE] fix leak on client message decoder 1 2021-12-09 2022-10-31
Running `make test` fails with Xcode 10.2 5 2019-04-09 2022-11-13
Text input blinking cursor is shown in note sneak peek for an empty note 0 2021-06-30 2022-11-12
[Task] Use the annotation @ConfigurationProperties instead of the @Value in NettyTcpConfig 1 2021-11-24 2022-11-08
automatically present valid TLS cert when configured secretName contains invalid cert 10 2022-09-12 2022-10-03
Can't execute containerize tutorial on MBP 1 2022-02-05 2022-11-30
JSON Serializer Source Generator doesn't work 13 2021-12-16 2022-10-03