Skip to content

Latest commit

 

History

History
307 lines (232 loc) · 9.07 KB

README.md

File metadata and controls

307 lines (232 loc) · 9.07 KB
Raw

Pruina-Socket-Python

Pruina-Socket

Pruina-Socket是一个用于快速开发的TCP Socket组件，包含服务端、客户端等内容。

Pruina-Socket-Python

安装：

pip install pruina-socket

通过以下简单的代码，即可启动具有响应功能的Pruina-Socket的服务端和客户端：

from pruina.socket.server import PruinaSocketServer
from pruina.socket.client import PruinaSocketClient


# 服务端响应函数
def server_response(word, handler= None, **kwargs):
    print(f"{handler.server_name}: get '{word.decode()}'")
    handler.send("server response", word)


# 客户端响应函数
def client_response(word, handler: PruinaSocketClient = None, **kwargs):
    decoded_word = word.decode()
    print(f"{handler.name}: get '{decoded_word}'")


# 服务端
server = PruinaSocketServer()
server.hooks.add_hook("client msg", server_response)
server.serve_forever(new_thread=True)  # new_thread=False时，将阻塞

# 客户端
client = PruinaSocketClient()
client.hooks.add_hook("server response", client_response)
client.connect()
client.send("client msg", b"hello world!")

# 暂时阻止退出
import time

time.sleep(1)

也可通过以下简单的代码，即可启动复杂的服务端（以torch模型服务为例）：

  1. 模型配置

    # 模型配置
import torch.nn as nn
import os
import torch


class Model(nn.Module):
    def __init__(self):
        super().__init__()
        self.linear = nn.Linear(1, 1)

    def forward(self, x):
        return self.linear(x)


# 模型存储路径，不存在自动生成
model_path = 'resources/example.pt'
if not os.path.exists('resources/example.pt'):
    torch.save(Model(), model_path)

  2. 服务端配置和启动

    # 响应函数
from pruina.socket.handler.MessageHookRequestHandler import MessageHookRequestHandler
from pruina.socket.server import PruinaSocketServer


def predict(d: bytes, handler: MessageHookRequestHandler = None, **kwargs):
    model = handler.resources.get("torch_model")
    x = torch.tensor([float(d.decode())], dtype=torch.float32)
    y = model(x)
    print(f'Torch model:\n\t{x.item():.4f}->{y.item():.4f}')

server = PruinaSocketServer()
server.resources.add_lazy_resource("torch_model", torch.load, "resources/example.pt")
server.hooks.add_hook("predict", predict)
server.serve_forever()

  3. 使用客户端测试（此处使用另一进程）

    # 响应函数
from pruina.socket.client import PruinaSocketClient

client = PruinaSocketClient()
client.connect()
client.send("predict", b"1.23")

使用概览

服务端

  • PruinaSocketServer
    以hook形式运行的SocketServer

PruinaSocketServer 可选参数

  • host: str = socket.gethostname() # 服务地址
  • port: int = 50003 # 端口
  • name: str = 'server' # 服务名称
  • daemon_threads: bool = True # daemon设置

PruinaSocketServer 属性

  • name: str = name # 服务名称
  • server: ThreadingTCPServer = ThreadingTCPServer((host, port), MessageHookRequestHandler) # ThreadingTCPServer
  • properties: Properties = Properties() # Properties
  • local_properties: Properties = Properties() # Local Properties
  • resources: Resources = Resources() # Resources
  • local_resources: Resources = Resources() # Local Resources
  • hooks: CachedMsgHooks = CachedMsgHooks() # CachedMsgHooks

示例代码：

from pruina.socket.handler.PruinaHandler import PruinaHandler
from pruina.socket.server import PruinaSocketServer


# 服务端响应函数
def server_response(word, handler: PruinaHandler = None, **kwargs):
   decoded_word = word.decode()
   print(f"{handler.server_name}: get '{decoded_word}'")
   handler.send("server response", word)


# 服务端
server = PruinaSocketServer()
server.hooks.add_hook("client msg", server_response)
server.serve_forever()

客户端

  • PruinaSocketClient
    以hook形式运行的SocketClient

PruinaSocketClient 可选参数

  • host: str = socket.gethostbyname(socket.gethostname()) # 服务地址
  • port: int = 50003 # 端口
  • name: str = 'server' # 服务名称
  • max_retry: int = 3 # 最大重试次数

PruinaSocketClient 属性

  • name: str = name # 服务名称
  • host: str = socket.gethostbyname(socket.gethostname()) # 服务地址
  • port: int = 50003 # 端口
  • client: socket.socket(socket.AF_INET, socket.SOCK_STREAM) # socket.socket
  • properties: Properties = Properties() # Properties
  • resources: Resources = Resources() # Resources
  • hooks: CachedMsgHooks = CachedMsgHooks() # CachedMsgHooks

示例代码：

from pruina.socket.client import PruinaSocketClient


# 客户端响应函数
def client_response(word, handler: PruinaSocketClient = None, **kwargs):
    decoded_word = word.decode()
    print(f"{handler.name}: get '{decoded_word}'")


# 客户端
client = PruinaSocketClient()
client.hooks.add_hook("server response", client_response)
client.connect()
client.send("client msg", b"hello world!")

组件

  • Hooks
    默认使用CachedMsgHooks。
    CachedMsgHooks是拥有一级缓存的Hook映射集，实现将消息标识符与函数的绑定。

CachedMsgHooks 参数

  • parent: MsgHooks = None 指向另一个CachedMsgHooks时，会进行deepcopy

示例代码：

from pruina.socket.server import PruinaSocketServer


# hook函数
def server_response(word, handler=None, **kwargs):
    decoded_word = word.decode()
    print(f"{handler.server_name}: get '{decoded_word}'")
    handler.send("server response", word)


server = PruinaSocketServer()
server.hooks.add_hook("client msg", server_response)
server.serve_forever()
  • Properties
    Properties用于传入小型对象，如int，str等。
    Pruina的server中，有properties和local_properties之分。

  • properties
    在整个server和所有handler中，只存在唯一的properties

  • local_properties
    对于每一个建立连接的handler，都有唯一的Properties。 每个handler中的local_properties都将从Server中设定的local_properties中deepcopy一份，作为handler独立的local_properties。

示例代码：

from pruina.socket.server import PruinaSocketServer

server = PruinaSocketServer()

server.properties.set("var_int", 1)
server.properties.set("var_str", "Hello World!")
server.local_properties.set("var_list", list())
server.local_properties.set("var_dict", dict())

server.init()
server.serve_forever()
  • Resources
    Resources用于传入大型资源，如torch.nn.model等。
    Resources中保存着Resource和LazyResource（见Resource & LazyResource）
    Pruina的server中，有resources和local_resources之分。

  • resources
    在整个server和所有handler中，只存在唯一的resources。

  • local_resources
    对于每一个建立连接的handler，都有唯一的local_resources。
    每个handler中的local_resources都将从Server中设定的local_resources中deepcopy一份，作为handler独立的local_resources。

示例代码见Resource和LazyResource部分。

  • Resource & LazyResource Resource和LazyResource是资源实体。

  • Resource
    资源实体，传入构造数据后，将在服务器启动时加载。

  • LazyResource
    资源实体，传入构造数据后，将在首次get()时进行加载。

示例代码：

import os

import torch
import torch.nn as nn

from pruina.socket.server import PruinaSocketServer
from pruina.socket.handler.PruinaHandler import PruinaHandler


class Model(nn.Module):
   def __init__(self):
      super().__init__()
      self.linear = nn.Linear(1, 1)

   def forward(self, x):
      return self.linear(x)


def predict(d: bytes, handler: PruinaHandler = None, **kwargs):
   model = handler.resources.get("torch_model_1")
   x = torch.tensor([float(d.decode())], dtype=torch.float32)
   y = model(x)
   print(f'Torch model:\n\t{x.item():.4f}->{y.item():.4f}')


model_path = 'resources/example.pt'
if not os.path.exists('resources/example.pt'):
   torch.save(Model(), model_path)
server = PruinaSocketServer()

server.resources.add_resource("torch_model_1", torch.load, model_path)
server.resources.add_lazy_resource("torch_model_2", torch.load, model_path)
server.local_resources.add_resource("torch_model_3", torch.load, model_path)
server.local_resources.add_lazy_resource("torch_model_4", torch.load, model_path)

server.hooks.add_hook("predict", predict)

server.init()
server.serve_forever()

Cython

Pruina-SocketServer可通过cypackage直接转化为cython版本。

  • 安装cypackage：
pip install cypackage
  • 使用cypackage生成cython版本的Pruina-SocketServer
cypackage pruina-socket