Skip to content

Latest commit

 

History

History
37 lines (23 loc) · 594 Bytes

File metadata and controls

37 lines (23 loc) · 594 Bytes

tinybert_server_node

The project shows the usage of quanti tinybert model in http server mode on Sunrise X5 board.

Preperation

  • Download the Repository
git clone https://github.com/zixi01chen/tinybert_server_node
  • Build on Sunrise X5 borad.
cd tinybert_server_node

bash build.sh

Runtime

Server

./build_arm/user_app

Client

curl -X POST http://10.112.148.128:10000/infer -H "Content-Type: application/json" -d '{"text":"向前出发"}'

Get Result:

{"confidence":0.8853142261505127,"id":6,"label":"前进"}